2024-04-25T13:26:14.361 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T13:26:14.361 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_pdonnell@teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/fsstress}} --name pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673172 -- /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673172/orig.config.yaml 2024-04-25T13:26:14.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T13:26:14.515 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673172 branch: wip-pdonnell-testing-20240425.015853-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/fsstress}} email: pdonnell@redhat.com first_in_suite: false job_id: '7673172' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240425.015853-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240425.015853-debug sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 owner: scheduled_pdonnell@teuthology priority: 85 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1880 sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 sleep_before_teardown: 0 subset: 178/512 suite: fs suite_branch: wip-pdonnell-testing-20240425.015853-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLTdaC9A8E53LrXeMsnplk2vtDVm9Xhnzpp6xpHqxhSIfe4O/7KHqDlwwz+sU5BpbjlCILNU3l+Mx5s/oCzgS1w= smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCP77CtSAUNihs56ZVs1C6k9AmFKgt1Tvzm7gi6s86dhRLDx7OcO10BDuLdig7kBIAZEeULRKfsetMb3BfOqj7U= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG364+1urpHH8ZUk4Nwx0rs0vHJx/YRgM0riDE5CEJYQ4mwSgYGDH/wTI8xUj/rkiRkNvrvmfrZIR7hHSWdHpiU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_10:00:23 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T13:26:14.515 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa; will attempt to use it 2024-04-25T13:26:14.515 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks 2024-04-25T13:26:14.516 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T13:26:14.517 INFO:teuthology.task.internal:Checking packages... 2024-04-25T13:26:14.544 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '994e2f20102a20fa9a27966c14b625cc01884df8' 2024-04-25T13:26:14.544 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T13:26:14.544 INFO:teuthology.packaging:ref: None 2024-04-25T13:26:14.544 INFO:teuthology.packaging:tag: None 2024-04-25T13:26:14.544 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240425.015853-debug 2024-04-25T13:26:14.544 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:26:14.544 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240425.015853-debug 2024-04-25T13:26:14.906 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3291.g994e2f20 2024-04-25T13:26:14.907 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T13:26:14.914 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T13:26:14.914 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T13:26:14.927 INFO:teuthology.task.internal:Saving configuration 2024-04-25T13:26:14.951 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T13:26:14.958 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T13:26:14.983 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673172', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:19:33.595067', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLTdaC9A8E53LrXeMsnplk2vtDVm9Xhnzpp6xpHqxhSIfe4O/7KHqDlwwz+sU5BpbjlCILNU3l+Mx5s/oCzgS1w='} 2024-04-25T13:26:15.001 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673172', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:19:33.595974', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCP77CtSAUNihs56ZVs1C6k9AmFKgt1Tvzm7gi6s86dhRLDx7OcO10BDuLdig7kBIAZEeULRKfsetMb3BfOqj7U='} 2024-04-25T13:26:15.023 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673172', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:19:33.596928', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG364+1urpHH8ZUk4Nwx0rs0vHJx/YRgM0riDE5CEJYQ4mwSgYGDH/wTI8xUj/rkiRkNvrvmfrZIR7hHSWdHpiU='} 2024-04-25T13:26:15.023 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T13:26:15.031 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-04-25T13:26:15.031 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-04-25T13:26:15.031 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-04-25T13:26:15.031 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T13:26:15.129 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1c5ce4a0d0>, signals=[15]) 2024-04-25T13:26:15.130 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T13:26:15.136 INFO:teuthology.task.internal:Opening connections... 2024-04-25T13:26:15.137 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T13:26:15.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:26:15.219 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2024-04-25T13:26:15.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:26:15.295 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T13:26:15.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:26:15.369 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T13:26:15.376 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-04-25T13:26:15.395 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-04-25T13:26:15.395 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-04-25T13:26:15.453 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-04-25T13:26:15.453 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2024-04-25T13:26:15.453 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-04-25T13:26:15.453 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-04-25T13:26:15.453 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2024-04-25T13:26:15.454 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2024-04-25T13:26:15.454 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T13:26:15.454 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-04-25T13:26:15.454 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2024-04-25T13:26:15.454 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T13:26:15.454 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-04-25T13:26:15.454 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T13:26:15.454 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T13:26:15.454 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T13:26:15.455 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-04-25T13:26:15.474 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-04-25T13:26:15.492 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-04-25T13:26:15.492 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-04-25T13:26:15.549 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-04-25T13:26:15.549 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-04-25T13:26:15.549 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-04-25T13:26:15.549 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-04-25T13:26:15.549 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-04-25T13:26:15.549 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-04-25T13:26:15.549 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T13:26:15.550 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-04-25T13:26:15.550 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-04-25T13:26:15.550 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T13:26:15.550 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-04-25T13:26:15.550 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T13:26:15.550 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T13:26:15.550 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T13:26:15.550 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-04-25T13:26:15.581 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-04-25T13:26:15.599 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-04-25T13:26:15.600 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-04-25T13:26:15.657 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-04-25T13:26:15.657 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-04-25T13:26:15.657 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-04-25T13:26:15.657 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-04-25T13:26:15.657 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-04-25T13:26:15.657 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-04-25T13:26:15.657 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T13:26:15.657 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-04-25T13:26:15.657 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-04-25T13:26:15.657 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T13:26:15.657 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-04-25T13:26:15.658 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T13:26:15.658 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T13:26:15.658 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T13:26:15.658 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-04-25T13:26:15.682 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T13:26:15.692 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T13:26:15.698 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T13:26:15.698 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2024-04-25T13:26:15.701 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2024-04-25T13:26:15.703 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-04-25T13:26:15.719 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T13:26:15.725 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T13:26:15.725 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2024-04-25T13:26:15.758 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2024-04-25T13:26:15.761 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-04-25T13:26:15.789 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T13:26:15.871 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T13:26:15.885 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-25T13:26:15.885 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-25T13:26:15.885 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T13:26:15.886 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T13:26:15.886 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T13:26:15.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:26:15.903 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-04-25T13:26:15.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:26:15.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:26:15.904 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-04-25T13:26:15.905 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-04-25T13:26:15.964 INFO:teuthology.orchestra.run.smithi043.stdout:5.14.0-437.el9.x86_64 2024-04-25T13:26:15.964 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-437.el9.x86_64 2024-04-25T13:26:15.964 INFO:teuthology.task.kernel:Running kernel on smithi043: 5.14.0-437.el9.x86_64 2024-04-25T13:26:15.964 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum install -y kernel 2024-04-25T13:26:15.965 INFO:teuthology.task.kernel:Running kernel on smithi175: 5.14.0-437.el9.x86_64 2024-04-25T13:26:15.965 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum install -y kernel 2024-04-25T13:26:15.966 INFO:teuthology.orchestra.run.smithi161.stdout:5.14.0-437.el9.x86_64 2024-04-25T13:26:15.966 INFO:teuthology.task.kernel:Running kernel on smithi161: 5.14.0-437.el9.x86_64 2024-04-25T13:26:15.966 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum install -y kernel 2024-04-25T13:26:18.464 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 8.0 MB 00:00 2024-04-25T13:26:18.687 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - BaseOS 7.1 MB/s | 8.0 MB 00:01 2024-04-25T13:26:19.127 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.0 MB 00:01 2024-04-25T13:26:20.905 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-25T13:26:21.290 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-04-25T13:26:21.440 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 10 MB/s | 19 MB 00:01 2024-04-25T13:26:25.155 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 6.2 MB 00:00 2024-04-25T13:26:25.461 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-25T13:26:25.849 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.2 MB 00:00 2024-04-25T13:26:26.637 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 16 kB 00:00 2024-04-25T13:26:27.118 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-25T13:26:27.430 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 16 kB 00:00 2024-04-25T13:26:28.948 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-25T13:26:29.530 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 21 MB 00:02 2024-04-25T13:26:29.763 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 7.0 MB/s | 21 MB 00:03 2024-04-25T13:26:34.206 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-04-25T13:26:34.535 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-04-25T13:26:34.762 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-04-25T13:26:36.146 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T13:26:36.146 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T13:26:36.243 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-04-25T13:26:36.244 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2024-04-25T13:26:36.244 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-04-25T13:26:36.339 DEBUG:teuthology.orchestra.run.smithi043:> echo no | sudo yum reinstall kernel || true 2024-04-25T13:26:36.391 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T13:26:36.391 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T13:26:36.494 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-04-25T13:26:36.495 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2024-04-25T13:26:36.495 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-04-25T13:26:36.589 DEBUG:teuthology.orchestra.run.smithi175:> echo no | sudo yum reinstall kernel || true 2024-04-25T13:26:36.669 INFO:teuthology.orchestra.run.smithi161.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T13:26:36.669 INFO:teuthology.orchestra.run.smithi161.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T13:26:36.757 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-04-25T13:26:36.758 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-04-25T13:26:36.758 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-04-25T13:26:36.861 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 01:26:34 PM UTC. 2024-04-25T13:26:36.891 DEBUG:teuthology.orchestra.run.smithi161:> echo no | sudo yum reinstall kernel || true 2024-04-25T13:26:36.985 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-04-25T13:26:37.001 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-25T13:26:37.001 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2024-04-25T13:26:37.002 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-25T13:26:37.002 INFO:teuthology.orchestra.run.smithi043.stdout:Reinstalling: 2024-04-25T13:26:37.002 INFO:teuthology.orchestra.run.smithi043.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:26:37.002 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:26:37.002 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-04-25T13:26:37.002 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-25T13:26:37.002 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:26:37.002 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 255 k 2024-04-25T13:26:37.002 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 0 2024-04-25T13:26:37.003 INFO:teuthology.orchestra.run.smithi043.stderr:Operation aborted. 2024-04-25T13:26:37.060 INFO:teuthology.orchestra.run.smithi043.stdout:Is this ok [y/N]: 2024-04-25T13:26:37.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum reinstall -y kernel || true 2024-04-25T13:26:37.131 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 01:26:34 PM UTC. 2024-04-25T13:26:37.251 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-04-25T13:26:37.271 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-25T13:26:37.271 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2024-04-25T13:26:37.271 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-25T13:26:37.271 INFO:teuthology.orchestra.run.smithi175.stdout:Reinstalling: 2024-04-25T13:26:37.271 INFO:teuthology.orchestra.run.smithi175.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:26:37.271 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:26:37.271 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-04-25T13:26:37.271 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-25T13:26:37.271 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:26:37.272 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 255 k 2024-04-25T13:26:37.272 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 0 2024-04-25T13:26:37.272 INFO:teuthology.orchestra.run.smithi175.stderr:Operation aborted. 2024-04-25T13:26:37.326 INFO:teuthology.orchestra.run.smithi175.stdout:Is this ok [y/N]: 2024-04-25T13:26:37.326 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum reinstall -y kernel || true 2024-04-25T13:26:37.385 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 01:26:34 PM UTC. 2024-04-25T13:26:37.513 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-04-25T13:26:37.520 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-04-25T13:26:37.520 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-04-25T13:26:37.520 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-04-25T13:26:37.520 INFO:teuthology.orchestra.run.smithi161.stdout:Reinstalling: 2024-04-25T13:26:37.520 INFO:teuthology.orchestra.run.smithi161.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:26:37.520 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:26:37.520 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-04-25T13:26:37.520 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-04-25T13:26:37.520 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:26:37.521 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 255 k 2024-04-25T13:26:37.521 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 0 2024-04-25T13:26:37.521 INFO:teuthology.orchestra.run.smithi161.stderr:Operation aborted. 2024-04-25T13:26:37.578 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 01:26:34 PM UTC. 2024-04-25T13:26:37.583 INFO:teuthology.orchestra.run.smithi161.stdout:Is this ok [y/N]: 2024-04-25T13:26:37.583 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum reinstall -y kernel || true 2024-04-25T13:26:37.698 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-04-25T13:26:37.699 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-25T13:26:37.699 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2024-04-25T13:26:37.699 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-25T13:26:37.699 INFO:teuthology.orchestra.run.smithi043.stdout:Reinstalling: 2024-04-25T13:26:37.700 INFO:teuthology.orchestra.run.smithi043.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:26:37.700 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:26:37.700 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-04-25T13:26:37.700 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-25T13:26:37.700 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:26:37.700 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 255 k 2024-04-25T13:26:37.700 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 0 2024-04-25T13:26:37.700 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-04-25T13:26:37.821 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 01:26:34 PM UTC. 2024-04-25T13:26:37.937 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-04-25T13:26:37.937 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-25T13:26:37.938 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2024-04-25T13:26:37.938 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-25T13:26:37.938 INFO:teuthology.orchestra.run.smithi175.stdout:Reinstalling: 2024-04-25T13:26:37.938 INFO:teuthology.orchestra.run.smithi175.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:26:37.938 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:26:37.938 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-04-25T13:26:37.938 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-25T13:26:37.938 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:26:37.938 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 255 k 2024-04-25T13:26:37.938 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 0 2024-04-25T13:26:37.939 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-04-25T13:26:38.079 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:04 ago on Thu 25 Apr 2024 01:26:34 PM UTC. 2024-04-25T13:26:38.101 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-5.14.0-437.el9.x86_64.rpm 768 kB/s | 255 kB 00:00 2024-04-25T13:26:38.101 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:26:38.102 INFO:teuthology.orchestra.run.smithi043.stdout:Total 636 kB/s | 255 kB 00:00 2024-04-25T13:26:38.118 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-04-25T13:26:38.197 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-04-25T13:26:38.198 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-04-25T13:26:38.198 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-04-25T13:26:38.198 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-04-25T13:26:38.198 INFO:teuthology.orchestra.run.smithi161.stdout:Reinstalling: 2024-04-25T13:26:38.198 INFO:teuthology.orchestra.run.smithi161.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:26:38.198 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:26:38.198 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-04-25T13:26:38.199 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-04-25T13:26:38.199 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:26:38.199 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 255 k 2024-04-25T13:26:38.199 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 0 2024-04-25T13:26:38.199 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-04-25T13:26:38.299 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-04-25T13:26:38.300 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-04-25T13:26:38.305 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-04-25T13:26:38.305 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-04-25T13:26:38.328 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.0 MB/s | 255 kB 00:00 2024-04-25T13:26:38.329 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:26:38.329 INFO:teuthology.orchestra.run.smithi175.stdout:Total 652 kB/s | 255 kB 00:00 2024-04-25T13:26:38.350 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-04-25T13:26:38.445 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-04-25T13:26:38.518 INFO:teuthology.orchestra.run.smithi043.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:26:38.518 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:26:38.531 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-04-25T13:26:38.531 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-04-25T13:26:38.536 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-04-25T13:26:38.537 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-04-25T13:26:38.548 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.4 MB/s | 255 kB 00:00 2024-04-25T13:26:38.548 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:26:38.548 INFO:teuthology.orchestra.run.smithi161.stdout:Total 728 kB/s | 255 kB 00:00 2024-04-25T13:26:38.571 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-04-25T13:26:38.665 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-04-25T13:26:38.729 INFO:teuthology.orchestra.run.smithi175.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:26:38.729 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:26:38.759 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-04-25T13:26:38.759 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-04-25T13:26:38.764 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-04-25T13:26:38.764 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-04-25T13:26:38.902 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-04-25T13:26:38.974 INFO:teuthology.orchestra.run.smithi161.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:26:38.974 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:26:39.185 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:26:39.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:26:39.379 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:26:39.379 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:26:39.697 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:26:39.698 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:26:39.824 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:26:39.824 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:26:39.824 INFO:teuthology.orchestra.run.smithi043.stdout:Reinstalled: 2024-04-25T13:26:39.824 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T13:26:39.825 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:26:39.825 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-04-25T13:26:40.014 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T13:26:40.059 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:26:40.059 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:26:40.059 INFO:teuthology.orchestra.run.smithi175.stdout:Reinstalled: 2024-04-25T13:26:40.059 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T13:26:40.059 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:26:40.059 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-04-25T13:26:40.062 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T13:26:40.062 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T13:26:40.063 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T13:26:40.063 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T13:26:40.063 DEBUG:teuthology.orchestra.run.smithi043:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T13:26:40.095 INFO:teuthology.orchestra.run.smithi043.stdout:ttyS1 2024-04-25T13:26:40.113 DEBUG:teuthology.parallel:result is None 2024-04-25T13:26:40.215 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T13:26:40.261 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T13:26:40.261 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T13:26:40.261 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T13:26:40.261 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-04-25T13:26:40.261 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T13:26:40.293 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2024-04-25T13:26:40.312 DEBUG:teuthology.parallel:result is None 2024-04-25T13:26:40.392 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:26:40.392 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:26:40.392 INFO:teuthology.orchestra.run.smithi161.stdout:Reinstalled: 2024-04-25T13:26:40.392 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T13:26:40.393 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:26:40.393 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-04-25T13:26:40.579 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T13:26:40.665 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T13:26:40.666 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T13:26:40.666 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T13:26:40.667 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-25T13:26:40.667 DEBUG:teuthology.orchestra.run.smithi161:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T13:26:40.694 INFO:teuthology.orchestra.run.smithi161.stdout:ttyS1 2024-04-25T13:26:40.725 DEBUG:teuthology.parallel:result is None 2024-04-25T13:26:40.725 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T13:26:40.732 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T13:26:40.732 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T13:26:40.735 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T13:26:40.768 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T13:26:40.783 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T13:26:40.790 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T13:26:40.801 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T13:26:40.801 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T13:26:40.804 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T13:26:40.824 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T13:26:40.853 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T13:26:40.860 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T13:26:40.860 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T13:26:40.864 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T13:26:40.889 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T13:26:40.902 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:26:40.913 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:26:40.916 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:26:40.926 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:26:40.927 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:26:40.936 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:26:40.938 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T13:26:40.945 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T13:26:40.945 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T13:26:40.958 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T13:26:40.980 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T13:26:41.004 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T13:26:41.013 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T13:26:41.013 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T13:26:41.026 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T13:26:41.044 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T13:26:41.059 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:26:41.125 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:26:41.180 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:26:41.263 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:26:41.305 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:26:41.306 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T13:26:41.371 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:26:41.413 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:26:41.463 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:26:41.542 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:26:41.583 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-04-25T13:26:41.583 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T13:26:41.646 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:26:41.689 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:26:41.744 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:26:41.830 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:26:41.869 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T13:26:41.869 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T13:26:41.935 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2024-04-25T13:26:41.937 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2024-04-25T13:26:41.940 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-04-25T13:26:41.978 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:26:41.979 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:26:42.015 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:26:42.465 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T13:26:42.473 INFO:teuthology.task.internal:Starting timer... 2024-04-25T13:26:42.473 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T13:26:42.561 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T13:26:42.570 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-25T13:26:42.571 DEBUG:teuthology.orchestra.run.smithi043:> sudo service auditd rotate 2024-04-25T13:26:42.655 INFO:teuthology.orchestra.run.smithi043.stdout:Rotating logs: 2024-04-25T13:26:42.657 DEBUG:teuthology.orchestra.run.smithi161:> sudo service auditd rotate 2024-04-25T13:26:42.707 INFO:teuthology.orchestra.run.smithi161.stdout:Rotating logs: 2024-04-25T13:26:42.709 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2024-04-25T13:26:42.775 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2024-04-25T13:26:42.776 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T13:26:42.777 DEBUG:teuthology.orchestra.run.smithi043:> /usr/sbin/getenforce 2024-04-25T13:26:42.798 INFO:teuthology.orchestra.run.smithi043.stdout:Permissive 2024-04-25T13:26:42.798 DEBUG:teuthology.orchestra.run.smithi161:> /usr/sbin/getenforce 2024-04-25T13:26:42.823 INFO:teuthology.orchestra.run.smithi161.stdout:Permissive 2024-04-25T13:26:42.823 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2024-04-25T13:26:42.848 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2024-04-25T13:26:42.848 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi043.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi161.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2024-04-25T13:26:42.849 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:26:42.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:26:42.875 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:26:42.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:26:42.900 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:26:42.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:26:42.925 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T13:26:42.925 DEBUG:teuthology.orchestra.run.smithi043:> sudo /usr/sbin/setenforce permissive 2024-04-25T13:26:42.950 DEBUG:teuthology.orchestra.run.smithi161:> sudo /usr/sbin/setenforce permissive 2024-04-25T13:26:42.984 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2024-04-25T13:26:43.018 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T13:26:43.028 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T13:26:43.049 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T13:26:43.051 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi043.front.sepia.ceph.com,smithi161.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T13:30:15.724 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-04-25T13:30:15.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-25T13:30:15.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:30:15.807 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-04-25T13:30:15.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-25T13:30:15.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-04-25T13:30:15.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:30:15.969 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-04-25T13:30:16.047 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-04-25T13:30:16.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-25T13:30:16.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:30:16.132 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-04-25T13:30:16.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-25T13:30:16.215 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T13:30:16.230 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T13:30:16.231 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T13:30:16.232 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:30:16.235 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T13:30:16.235 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:30:16.238 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T13:30:16.239 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:30:16.264 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T13:30:16.268 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T13:30:16.278 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T13:30:16.283 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T13:30:16.285 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T13:30:16.299 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T13:30:16.302 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: ntpd: command not found 2024-04-25T13:30:16.308 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: ntpd: command not found 2024-04-25T13:30:16.313 INFO:teuthology.orchestra.run.smithi043.stdout:506 Cannot talk to daemon 2024-04-25T13:30:16.319 INFO:teuthology.orchestra.run.smithi161.stdout:506 Cannot talk to daemon 2024-04-25T13:30:16.323 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2024-04-25T13:30:16.327 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T13:30:16.333 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T13:30:16.334 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2024-04-25T13:30:16.341 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T13:30:16.346 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T13:30:16.347 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T13:30:16.360 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T13:30:16.400 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:30:16.402 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:30:16.404 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:30:16.404 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2024-04-25T13:30:16.404 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:30:16.404 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:30:16.404 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:30:16.404 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:30:16.406 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:30:16.407 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-04-25T13:30:16.407 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:30:16.407 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:30:16.407 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:30:16.407 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:30:16.417 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:30:16.421 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:30:16.421 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-04-25T13:30:16.421 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:30:16.421 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:30:16.421 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:30:16.421 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:30:16.422 INFO:teuthology.run_tasks:Running task install... 2024-04-25T13:30:16.431 DEBUG:teuthology.task.install:project ceph 2024-04-25T13:30:16.432 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}} 2024-04-25T13:30:16.432 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'} 2024-04-25T13:30:16.432 INFO:teuthology.task.install:Using flavor: default 2024-04-25T13:30:16.438 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T13:30:16.438 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T13:30:16.439 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T13:30:16.439 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:30:16.441 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T13:30:16.442 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:30:16.443 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T13:30:16.443 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:30:16.583 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T13:30:16.583 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T13:30:16.658 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T13:30:16.658 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T13:30:16.662 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T13:30:16.662 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T13:30:16.750 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T13:30:16.750 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-04-25T13:30:16.751 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T13:30:16.765 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T13:30:16.765 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:30:16.765 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T13:30:16.772 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T13:30:16.773 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T13:30:16.773 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T13:30:16.776 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T13:30:16.776 DEBUG:teuthology.orchestra.run.smithi161:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T13:30:16.791 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T13:30:16.791 DEBUG:teuthology.orchestra.run.smithi043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T13:30:16.798 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T13:30:16.798 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T13:30:16.841 DEBUG:teuthology.orchestra.run.smithi161:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T13:30:16.857 DEBUG:teuthology.orchestra.run.smithi043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T13:30:16.862 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T13:30:16.914 DEBUG:teuthology.orchestra.run.smithi161:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T13:30:16.932 DEBUG:teuthology.orchestra.run.smithi043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T13:30:16.935 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T13:30:16.977 INFO:teuthology.orchestra.run.smithi161.stdout:check_obsoletes = 1 2024-04-25T13:30:16.978 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum clean all 2024-04-25T13:30:16.996 INFO:teuthology.orchestra.run.smithi043.stdout:check_obsoletes = 1 2024-04-25T13:30:16.998 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum clean all 2024-04-25T13:30:16.998 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2024-04-25T13:30:17.000 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2024-04-25T13:30:17.203 INFO:teuthology.orchestra.run.smithi161.stdout:48 files removed 2024-04-25T13:30:17.224 INFO:teuthology.orchestra.run.smithi175.stdout:48 files removed 2024-04-25T13:30:17.230 INFO:teuthology.orchestra.run.smithi043.stdout:48 files removed 2024-04-25T13:30:17.231 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T13:30:17.251 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T13:30:17.257 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T13:30:17.836 INFO:teuthology.orchestra.run.smithi043.stdout:ceph packages for x86_64 274 kB/s | 84 kB 00:00 2024-04-25T13:30:17.896 INFO:teuthology.orchestra.run.smithi161.stdout:ceph packages for x86_64 206 kB/s | 84 kB 00:00 2024-04-25T13:30:17.916 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 208 kB/s | 84 kB 00:00 2024-04-25T13:30:18.145 INFO:teuthology.orchestra.run.smithi043.stdout:ceph noarch packages 44 kB/s | 12 kB 00:00 2024-04-25T13:30:18.322 INFO:teuthology.orchestra.run.smithi161.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-04-25T13:30:18.333 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-04-25T13:30:18.504 INFO:teuthology.orchestra.run.smithi043.stdout:ceph source packages 5.9 kB/s | 1.9 kB 00:00 2024-04-25T13:30:18.714 INFO:teuthology.orchestra.run.smithi161.stdout:ceph source packages 5.3 kB/s | 1.9 kB 00:00 2024-04-25T13:30:18.725 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 5.3 kB/s | 1.9 kB 00:00 2024-04-25T13:30:19.286 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-04-25T13:30:19.350 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.0 MB 00:00 2024-04-25T13:30:19.409 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-25T13:30:21.163 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-04-25T13:30:21.335 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-25T13:30:21.650 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-25T13:30:25.355 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.2 MB 00:00 2024-04-25T13:30:25.502 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.2 MB 00:00 2024-04-25T13:30:25.884 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-25T13:30:27.067 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 16 kB 00:00 2024-04-25T13:30:27.120 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-04-25T13:30:27.374 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 16 kB 00:00 2024-04-25T13:30:29.245 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-25T13:30:29.629 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 21 MB 00:02 2024-04-25T13:30:29.907 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 7.9 MB/s | 21 MB 00:02 2024-04-25T13:30:34.500 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-25T13:30:34.769 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-04-25T13:30:34.937 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-04-25T13:30:36.735 INFO:teuthology.orchestra.run.smithi043.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:30:36.736 INFO:teuthology.orchestra.run.smithi043.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:30:36.747 INFO:teuthology.orchestra.run.smithi043.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T13:30:36.748 INFO:teuthology.orchestra.run.smithi043.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T13:30:36.749 INFO:teuthology.orchestra.run.smithi043.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T13:30:36.749 INFO:teuthology.orchestra.run.smithi043.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T13:30:36.751 INFO:teuthology.orchestra.run.smithi043.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T13:30:36.753 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T13:30:36.754 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T13:30:36.820 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-04-25T13:30:36.829 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-04-25T13:30:36.829 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-04-25T13:30:36.830 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-04-25T13:30:36.830 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-04-25T13:30:36.830 INFO:teuthology.orchestra.run.smithi043.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T13:30:36.830 INFO:teuthology.orchestra.run.smithi043.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T13:30:36.830 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T13:30:36.830 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T13:30:36.830 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T13:30:36.830 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T13:30:36.830 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T13:30:36.830 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T13:30:36.830 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T13:30:36.831 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T13:30:36.831 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T13:30:36.831 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T13:30:36.831 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T13:30:36.831 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T13:30:36.831 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T13:30:36.831 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T13:30:36.831 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T13:30:36.831 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T13:30:36.831 INFO:teuthology.orchestra.run.smithi043.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T13:30:36.831 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T13:30:36.832 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T13:30:36.832 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T13:30:36.832 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T13:30:36.832 INFO:teuthology.orchestra.run.smithi043.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T13:30:36.832 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T13:30:36.832 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T13:30:36.832 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T13:30:36.832 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T13:30:36.832 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T13:30:36.832 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T13:30:36.832 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T13:30:36.832 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T13:30:36.832 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T13:30:36.833 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T13:30:36.833 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T13:30:36.833 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T13:30:36.833 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T13:30:36.833 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2024-04-25T13:30:36.833 INFO:teuthology.orchestra.run.smithi043.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T13:30:36.833 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T13:30:36.833 INFO:teuthology.orchestra.run.smithi043.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T13:30:36.833 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T13:30:36.833 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-04-25T13:30:36.833 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T13:30:36.833 INFO:teuthology.orchestra.run.smithi043.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T13:30:36.833 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T13:30:36.834 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T13:30:36.834 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T13:30:36.834 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T13:30:36.834 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T13:30:36.834 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T13:30:36.834 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T13:30:36.834 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T13:30:36.834 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T13:30:36.834 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T13:30:36.834 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T13:30:36.834 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T13:30:36.834 INFO:teuthology.orchestra.run.smithi043.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T13:30:36.834 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T13:30:36.835 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T13:30:36.835 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T13:30:36.835 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T13:30:36.835 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T13:30:36.835 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T13:30:36.835 INFO:teuthology.orchestra.run.smithi043.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T13:30:36.835 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T13:30:36.835 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T13:30:36.835 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T13:30:36.835 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T13:30:36.835 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T13:30:36.835 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T13:30:36.835 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T13:30:36.835 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T13:30:36.836 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T13:30:36.836 INFO:teuthology.orchestra.run.smithi043.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T13:30:36.836 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T13:30:36.836 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T13:30:36.836 INFO:teuthology.orchestra.run.smithi043.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T13:30:36.836 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T13:30:36.836 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T13:30:36.836 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T13:30:36.836 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T13:30:36.836 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T13:30:36.836 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T13:30:36.836 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T13:30:36.836 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T13:30:36.837 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T13:30:36.837 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T13:30:36.837 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T13:30:36.837 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T13:30:36.837 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T13:30:36.837 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T13:30:36.837 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T13:30:36.837 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T13:30:36.837 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T13:30:36.837 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T13:30:36.837 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T13:30:36.837 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T13:30:36.837 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T13:30:36.837 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T13:30:36.838 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T13:30:36.838 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T13:30:36.838 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T13:30:36.838 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T13:30:36.838 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T13:30:36.838 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T13:30:36.838 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T13:30:36.838 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T13:30:36.838 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T13:30:36.838 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T13:30:36.838 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T13:30:36.838 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T13:30:36.838 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T13:30:36.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T13:30:36.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T13:30:36.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T13:30:36.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T13:30:36.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T13:30:36.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T13:30:36.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T13:30:36.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T13:30:36.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T13:30:36.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T13:30:36.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T13:30:36.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T13:30:36.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T13:30:36.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T13:30:36.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T13:30:36.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T13:30:36.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T13:30:36.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T13:30:36.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T13:30:36.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T13:30:36.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T13:30:36.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T13:30:36.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T13:30:36.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T13:30:36.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T13:30:36.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T13:30:36.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T13:30:36.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T13:30:36.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T13:30:36.841 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T13:30:36.841 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T13:30:36.841 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T13:30:36.841 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T13:30:36.841 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T13:30:36.841 INFO:teuthology.orchestra.run.smithi043.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T13:30:36.841 INFO:teuthology.orchestra.run.smithi043.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T13:30:36.841 INFO:teuthology.orchestra.run.smithi043.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T13:30:36.841 INFO:teuthology.orchestra.run.smithi043.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T13:30:36.841 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T13:30:36.841 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T13:30:36.841 INFO:teuthology.orchestra.run.smithi043.stdout:Installing weak dependencies: 2024-04-25T13:30:36.841 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T13:30:36.842 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:30:36.842 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-04-25T13:30:36.842 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-04-25T13:30:36.842 INFO:teuthology.orchestra.run.smithi043.stdout:Install 148 Packages 2024-04-25T13:30:36.842 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 4 Packages 2024-04-25T13:30:36.842 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:30:36.842 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 214 M 2024-04-25T13:30:36.843 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-04-25T13:30:36.878 INFO:teuthology.orchestra.run.smithi161.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:30:36.879 INFO:teuthology.orchestra.run.smithi161.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:30:36.890 INFO:teuthology.orchestra.run.smithi161.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T13:30:36.891 INFO:teuthology.orchestra.run.smithi161.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T13:30:36.892 INFO:teuthology.orchestra.run.smithi161.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T13:30:36.892 INFO:teuthology.orchestra.run.smithi161.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T13:30:36.894 INFO:teuthology.orchestra.run.smithi161.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T13:30:36.896 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T13:30:36.897 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T13:30:36.958 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-04-25T13:30:36.967 INFO:teuthology.orchestra.run.smithi161.stdout:======================================================================================= 2024-04-25T13:30:36.967 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-04-25T13:30:36.967 INFO:teuthology.orchestra.run.smithi161.stdout:======================================================================================= 2024-04-25T13:30:36.967 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-04-25T13:30:36.967 INFO:teuthology.orchestra.run.smithi161.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T13:30:36.968 INFO:teuthology.orchestra.run.smithi161.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T13:30:36.968 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T13:30:36.968 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T13:30:36.968 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T13:30:36.968 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T13:30:36.968 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T13:30:36.968 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T13:30:36.968 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T13:30:36.968 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T13:30:36.968 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T13:30:36.968 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T13:30:36.968 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T13:30:36.968 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T13:30:36.969 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T13:30:36.969 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T13:30:36.969 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T13:30:36.969 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T13:30:36.969 INFO:teuthology.orchestra.run.smithi161.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T13:30:36.969 INFO:teuthology.orchestra.run.smithi161.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T13:30:36.969 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T13:30:36.969 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T13:30:36.969 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T13:30:36.969 INFO:teuthology.orchestra.run.smithi161.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T13:30:36.969 INFO:teuthology.orchestra.run.smithi161.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T13:30:36.969 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T13:30:36.970 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T13:30:36.970 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T13:30:36.970 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T13:30:36.970 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T13:30:36.970 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T13:30:36.970 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T13:30:36.970 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T13:30:36.970 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T13:30:36.970 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T13:30:36.970 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T13:30:36.970 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T13:30:36.970 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2024-04-25T13:30:36.970 INFO:teuthology.orchestra.run.smithi161.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T13:30:36.970 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T13:30:36.971 INFO:teuthology.orchestra.run.smithi161.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T13:30:36.971 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T13:30:36.971 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-04-25T13:30:36.971 INFO:teuthology.orchestra.run.smithi161.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T13:30:36.971 INFO:teuthology.orchestra.run.smithi161.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T13:30:36.971 INFO:teuthology.orchestra.run.smithi161.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T13:30:36.971 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T13:30:36.971 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T13:30:36.971 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T13:30:36.971 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T13:30:36.971 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T13:30:36.971 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T13:30:36.971 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T13:30:36.972 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T13:30:36.972 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T13:30:36.972 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T13:30:36.972 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T13:30:36.972 INFO:teuthology.orchestra.run.smithi161.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T13:30:36.972 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T13:30:36.972 INFO:teuthology.orchestra.run.smithi161.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T13:30:36.972 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T13:30:36.972 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T13:30:36.972 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T13:30:36.972 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T13:30:36.972 INFO:teuthology.orchestra.run.smithi161.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T13:30:36.972 INFO:teuthology.orchestra.run.smithi161.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T13:30:36.973 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T13:30:36.973 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T13:30:36.973 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T13:30:36.973 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T13:30:36.973 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T13:30:36.973 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T13:30:36.973 INFO:teuthology.orchestra.run.smithi161.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T13:30:36.973 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T13:30:36.973 INFO:teuthology.orchestra.run.smithi161.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T13:30:36.973 INFO:teuthology.orchestra.run.smithi161.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T13:30:36.973 INFO:teuthology.orchestra.run.smithi161.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T13:30:36.973 INFO:teuthology.orchestra.run.smithi161.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T13:30:36.973 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T13:30:36.974 INFO:teuthology.orchestra.run.smithi161.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T13:30:36.974 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T13:30:36.974 INFO:teuthology.orchestra.run.smithi161.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T13:30:36.974 INFO:teuthology.orchestra.run.smithi161.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T13:30:36.974 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T13:30:36.974 INFO:teuthology.orchestra.run.smithi161.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T13:30:36.974 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T13:30:36.974 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T13:30:36.974 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T13:30:36.974 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T13:30:36.974 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T13:30:36.974 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T13:30:36.974 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T13:30:36.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T13:30:36.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T13:30:36.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T13:30:36.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T13:30:36.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T13:30:36.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T13:30:36.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T13:30:36.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T13:30:36.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T13:30:36.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T13:30:36.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T13:30:36.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T13:30:36.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T13:30:36.976 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T13:30:36.976 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T13:30:36.976 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T13:30:36.976 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T13:30:36.976 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T13:30:36.976 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T13:30:36.976 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T13:30:36.976 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T13:30:36.976 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T13:30:36.976 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T13:30:36.976 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T13:30:36.976 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T13:30:36.976 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T13:30:36.976 INFO:teuthology.orchestra.run.smithi161.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T13:30:36.977 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T13:30:36.977 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T13:30:36.977 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T13:30:36.977 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T13:30:36.977 INFO:teuthology.orchestra.run.smithi161.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T13:30:36.977 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T13:30:36.977 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T13:30:36.977 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T13:30:36.977 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T13:30:36.977 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T13:30:36.977 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T13:30:36.977 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T13:30:36.977 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T13:30:36.977 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T13:30:36.978 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T13:30:36.978 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T13:30:36.978 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T13:30:36.978 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T13:30:36.978 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T13:30:36.978 INFO:teuthology.orchestra.run.smithi161.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T13:30:36.978 INFO:teuthology.orchestra.run.smithi161.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T13:30:36.978 INFO:teuthology.orchestra.run.smithi161.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T13:30:36.978 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T13:30:36.978 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T13:30:36.978 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T13:30:36.979 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T13:30:36.979 INFO:teuthology.orchestra.run.smithi161.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T13:30:36.979 INFO:teuthology.orchestra.run.smithi161.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T13:30:36.979 INFO:teuthology.orchestra.run.smithi161.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T13:30:36.979 INFO:teuthology.orchestra.run.smithi161.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T13:30:36.979 INFO:teuthology.orchestra.run.smithi161.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T13:30:36.979 INFO:teuthology.orchestra.run.smithi161.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T13:30:36.979 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T13:30:36.979 INFO:teuthology.orchestra.run.smithi161.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T13:30:36.979 INFO:teuthology.orchestra.run.smithi161.stdout:Installing weak dependencies: 2024-04-25T13:30:36.979 INFO:teuthology.orchestra.run.smithi161.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T13:30:36.979 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:30:36.979 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-04-25T13:30:36.980 INFO:teuthology.orchestra.run.smithi161.stdout:======================================================================================= 2024-04-25T13:30:36.980 INFO:teuthology.orchestra.run.smithi161.stdout:Install 148 Packages 2024-04-25T13:30:36.980 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 4 Packages 2024-04-25T13:30:36.980 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:30:36.980 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 214 M 2024-04-25T13:30:36.980 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-04-25T13:30:37.097 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:30:37.097 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:30:37.110 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T13:30:37.110 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T13:30:37.110 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T13:30:37.111 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T13:30:37.112 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T13:30:37.115 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T13:30:37.115 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T13:30:37.178 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-04-25T13:30:37.187 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-04-25T13:30:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-04-25T13:30:37.187 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-04-25T13:30:37.187 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-04-25T13:30:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T13:30:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T13:30:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T13:30:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T13:30:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T13:30:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T13:30:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T13:30:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T13:30:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T13:30:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T13:30:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T13:30:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T13:30:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T13:30:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T13:30:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T13:30:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T13:30:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T13:30:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T13:30:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T13:30:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T13:30:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T13:30:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T13:30:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T13:30:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T13:30:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T13:30:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T13:30:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T13:30:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T13:30:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T13:30:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T13:30:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T13:30:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T13:30:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T13:30:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T13:30:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T13:30:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T13:30:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T13:30:37.190 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2024-04-25T13:30:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T13:30:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T13:30:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T13:30:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T13:30:37.191 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-04-25T13:30:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T13:30:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T13:30:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T13:30:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T13:30:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T13:30:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T13:30:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T13:30:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T13:30:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T13:30:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T13:30:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T13:30:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T13:30:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T13:30:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T13:30:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T13:30:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T13:30:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T13:30:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T13:30:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T13:30:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T13:30:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T13:30:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T13:30:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T13:30:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T13:30:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T13:30:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T13:30:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T13:30:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T13:30:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T13:30:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T13:30:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T13:30:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T13:30:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T13:30:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T13:30:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T13:30:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T13:30:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T13:30:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T13:30:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T13:30:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T13:30:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T13:30:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T13:30:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T13:30:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T13:30:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T13:30:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T13:30:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T13:30:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T13:30:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T13:30:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T13:30:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T13:30:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T13:30:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T13:30:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T13:30:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T13:30:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T13:30:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T13:30:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T13:30:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T13:30:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T13:30:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T13:30:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T13:30:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T13:30:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T13:30:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T13:30:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T13:30:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T13:30:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T13:30:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T13:30:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T13:30:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T13:30:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T13:30:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T13:30:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T13:30:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T13:30:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T13:30:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T13:30:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T13:30:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T13:30:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T13:30:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T13:30:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T13:30:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T13:30:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T13:30:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T13:30:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T13:30:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T13:30:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T13:30:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T13:30:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T13:30:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T13:30:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T13:30:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T13:30:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T13:30:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T13:30:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T13:30:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T13:30:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T13:30:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T13:30:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T13:30:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T13:30:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T13:30:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T13:30:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T13:30:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T13:30:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T13:30:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T13:30:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T13:30:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T13:30:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T13:30:37.200 INFO:teuthology.orchestra.run.smithi175.stdout:Installing weak dependencies: 2024-04-25T13:30:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T13:30:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:30:37.200 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-04-25T13:30:37.200 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-04-25T13:30:37.200 INFO:teuthology.orchestra.run.smithi175.stdout:Install 148 Packages 2024-04-25T13:30:37.200 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 4 Packages 2024-04-25T13:30:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:30:37.201 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 214 M 2024-04-25T13:30:37.201 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-04-25T13:30:37.727 INFO:teuthology.orchestra.run.smithi043.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 36 kB/s | 6.6 kB 00:00 2024-04-25T13:30:37.895 INFO:teuthology.orchestra.run.smithi161.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-04-25T13:30:37.910 INFO:teuthology.orchestra.run.smithi043.stdout:(2/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 4.6 MB/s | 863 kB 00:00 2024-04-25T13:30:37.977 INFO:teuthology.orchestra.run.smithi043.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 2.2 MB/s | 147 kB 00:00 2024-04-25T13:30:38.402 INFO:teuthology.orchestra.run.smithi043.stdout:(4/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 5.3 MB/s | 2.3 MB 00:00 2024-04-25T13:30:38.728 INFO:teuthology.orchestra.run.smithi043.stdout:(5/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 4.6 MB/s | 1.5 MB 00:00 2024-04-25T13:30:38.787 INFO:teuthology.orchestra.run.smithi161.stdout:(2/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 968 kB/s | 863 kB 00:00 2024-04-25T13:30:38.803 INFO:teuthology.orchestra.run.smithi043.stdout:(6/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 4.3 MB/s | 5.4 MB 00:01 2024-04-25T13:30:38.805 INFO:teuthology.orchestra.run.smithi175.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 12 kB/s | 6.6 kB 00:00 2024-04-25T13:30:38.962 INFO:teuthology.orchestra.run.smithi161.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 840 kB/s | 147 kB 00:00 2024-04-25T13:30:39.920 INFO:teuthology.orchestra.run.smithi043.stdout:(7/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 4.1 MB/s | 4.9 MB 00:01 2024-04-25T13:30:40.295 INFO:teuthology.orchestra.run.smithi161.stdout:(4/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 1.7 MB/s | 2.3 MB 00:01 2024-04-25T13:30:40.854 INFO:teuthology.orchestra.run.smithi161.stdout:(5/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 2.7 MB/s | 1.5 MB 00:00 2024-04-25T13:30:41.020 INFO:teuthology.orchestra.run.smithi043.stdout:(8/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x86 8.0 MB/s | 18 MB 00:02 2024-04-25T13:30:41.112 INFO:teuthology.orchestra.run.smithi043.stdout:(9/152): ceph-selinux-19.0.0-3291.g994e2f20.el9 276 kB/s | 25 kB 00:00 2024-04-25T13:30:41.129 INFO:teuthology.orchestra.run.smithi175.stdout:(2/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 371 kB/s | 863 kB 00:02 2024-04-25T13:30:41.521 INFO:teuthology.orchestra.run.smithi175.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 375 kB/s | 147 kB 00:00 2024-04-25T13:30:41.929 INFO:teuthology.orchestra.run.smithi161.stdout:(6/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 4.5 MB/s | 4.9 MB 00:01 2024-04-25T13:30:42.371 INFO:teuthology.orchestra.run.smithi161.stdout:(7/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 1.1 MB/s | 5.4 MB 00:04 2024-04-25T13:30:42.579 INFO:teuthology.orchestra.run.smithi043.stdout:(10/152): ceph-radosgw-19.0.0-3291.g994e2f20.el 3.8 MB/s | 10 MB 00:02 2024-04-25T13:30:42.754 INFO:teuthology.orchestra.run.smithi043.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 1.2 MB/s | 224 kB 00:00 2024-04-25T13:30:42.855 INFO:teuthology.orchestra.run.smithi043.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 271 kB/s | 27 kB 00:00 2024-04-25T13:30:42.946 INFO:teuthology.orchestra.run.smithi043.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 346 kB/s | 32 kB 00:00 2024-04-25T13:30:43.130 INFO:teuthology.orchestra.run.smithi175.stdout:(4/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 1.1 MB/s | 5.4 MB 00:04 2024-04-25T13:30:43.139 INFO:teuthology.orchestra.run.smithi043.stdout:(14/152): ceph-common-19.0.0-3291.g994e2f20.el9 3.5 MB/s | 20 MB 00:05 2024-04-25T13:30:43.264 INFO:teuthology.orchestra.run.smithi043.stdout:(15/152): libcephsqlite-19.0.0-3291.g994e2f20.e 1.2 MB/s | 158 kB 00:00 2024-04-25T13:30:43.314 INFO:teuthology.orchestra.run.smithi043.stdout:(16/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 2.0 MB/s | 756 kB 00:00 2024-04-25T13:30:43.389 INFO:teuthology.orchestra.run.smithi043.stdout:(17/152): librados-devel-19.0.0-3291.g994e2f20. 1.0 MB/s | 127 kB 00:00 2024-04-25T13:30:43.556 INFO:teuthology.orchestra.run.smithi043.stdout:(18/152): libradosstriper1-19.0.0-3291.g994e2f2 2.0 MB/s | 497 kB 00:00 2024-04-25T13:30:43.657 INFO:teuthology.orchestra.run.smithi043.stdout:(19/152): python3-ceph-argparse-19.0.0-3291.g99 452 kB/s | 45 kB 00:00 2024-04-25T13:30:43.757 INFO:teuthology.orchestra.run.smithi043.stdout:(20/152): python3-ceph-common-19.0.0-3291.g994e 1.3 MB/s | 135 kB 00:00 2024-04-25T13:30:43.857 INFO:teuthology.orchestra.run.smithi043.stdout:(21/152): python3-cephfs-19.0.0-3291.g994e2f20. 1.6 MB/s | 161 kB 00:00 2024-04-25T13:30:44.008 INFO:teuthology.orchestra.run.smithi043.stdout:(22/152): python3-rados-19.0.0-3291.g994e2f20.e 2.1 MB/s | 321 kB 00:00 2024-04-25T13:30:44.113 INFO:teuthology.orchestra.run.smithi161.stdout:(8/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x86 8.1 MB/s | 18 MB 00:02 2024-04-25T13:30:44.124 INFO:teuthology.orchestra.run.smithi043.stdout:(23/152): python3-rbd-19.0.0-3291.g994e2f20.el9 2.5 MB/s | 298 kB 00:00 2024-04-25T13:30:44.196 INFO:teuthology.orchestra.run.smithi161.stdout:(9/152): ceph-selinux-19.0.0-3291.g994e2f20.el9 303 kB/s | 25 kB 00:00 2024-04-25T13:30:44.199 INFO:teuthology.orchestra.run.smithi043.stdout:(24/152): python3-rgw-19.0.0-3291.g994e2f20.el9 1.3 MB/s | 100 kB 00:00 2024-04-25T13:30:44.505 INFO:teuthology.orchestra.run.smithi175.stdout:(5/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 1.1 MB/s | 1.5 MB 00:01 2024-04-25T13:30:44.608 INFO:teuthology.orchestra.run.smithi043.stdout:(25/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 4.2 MB/s | 5.2 MB 00:01 2024-04-25T13:30:44.783 INFO:teuthology.orchestra.run.smithi043.stdout:(26/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 148 kB/s | 86 kB 00:00 2024-04-25T13:30:45.084 INFO:teuthology.orchestra.run.smithi043.stdout:(27/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 565 kB/s | 169 kB 00:00 2024-04-25T13:30:45.176 INFO:teuthology.orchestra.run.smithi043.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3291.g 373 kB/s | 34 kB 00:00 2024-04-25T13:30:45.455 INFO:teuthology.orchestra.run.smithi175.stdout:(6/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 588 kB/s | 2.3 MB 00:03 2024-04-25T13:30:45.470 INFO:teuthology.orchestra.run.smithi043.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 484 kB/s | 142 kB 00:00 2024-04-25T13:30:45.535 INFO:teuthology.orchestra.run.smithi043.stdout:(30/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 3.3 MB/s | 3.0 MB 00:00 2024-04-25T13:30:47.585 INFO:teuthology.orchestra.run.smithi043.stdout:(31/152): ceph-mgr-diskprediction-local-19.0.0- 3.6 MB/s | 7.4 MB 00:02 2024-04-25T13:30:47.693 INFO:teuthology.orchestra.run.smithi043.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3291.g99 2.3 MB/s | 249 kB 00:00 2024-04-25T13:30:47.793 INFO:teuthology.orchestra.run.smithi043.stdout:(33/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 493 kB/s | 49 kB 00:00 2024-04-25T13:30:47.869 INFO:teuthology.orchestra.run.smithi043.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3291.g9 219 kB/s | 16 kB 00:00 2024-04-25T13:30:47.927 INFO:teuthology.orchestra.run.smithi043.stdout:(35/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 1.4 MB/s | 3.5 MB 00:02 2024-04-25T13:30:47.952 INFO:teuthology.orchestra.run.smithi043.stdout:(36/152): ceph-volume-19.0.0-3291.g994e2f20.el9 3.2 MB/s | 273 kB 00:00 2024-04-25T13:30:48.022 INFO:teuthology.orchestra.run.smithi043.stdout:(37/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 265 kB/s | 18 kB 00:00 2024-04-25T13:30:48.097 INFO:teuthology.orchestra.run.smithi175.stdout:(7/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 1.4 MB/s | 4.9 MB 00:03 2024-04-25T13:30:48.122 INFO:teuthology.orchestra.run.smithi043.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 804 kB/s | 80 kB 00:00 2024-04-25T13:30:48.147 INFO:teuthology.orchestra.run.smithi043.stdout:(39/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 3.4 MB/s | 762 kB 00:00 2024-04-25T13:30:48.171 INFO:teuthology.orchestra.run.smithi161.stdout:(10/152): ceph-test-19.0.0-3291.g994e2f20.el9.x 11 MB/s | 43 MB 00:03 2024-04-25T13:30:48.198 INFO:teuthology.orchestra.run.smithi043.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2024-04-25T13:30:48.223 INFO:teuthology.orchestra.run.smithi043.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-04-25T13:30:48.248 INFO:teuthology.orchestra.run.smithi043.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-04-25T13:30:48.263 INFO:teuthology.orchestra.run.smithi161.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 2.4 MB/s | 224 kB 00:00 2024-04-25T13:30:48.290 INFO:teuthology.orchestra.run.smithi043.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-04-25T13:30:48.315 INFO:teuthology.orchestra.run.smithi043.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-25T13:30:48.330 INFO:teuthology.orchestra.run.smithi161.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 407 kB/s | 27 kB 00:00 2024-04-25T13:30:48.341 INFO:teuthology.orchestra.run.smithi043.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-25T13:30:48.366 INFO:teuthology.orchestra.run.smithi043.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-25T13:30:48.388 INFO:teuthology.orchestra.run.smithi161.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 543 kB/s | 32 kB 00:00 2024-04-25T13:30:48.391 INFO:teuthology.orchestra.run.smithi043.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-25T13:30:48.416 INFO:teuthology.orchestra.run.smithi043.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 14 MB/s | 689 kB 00:00 2024-04-25T13:30:48.450 INFO:teuthology.orchestra.run.smithi043.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-04-25T13:30:48.475 INFO:teuthology.orchestra.run.smithi043.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-25T13:30:48.501 INFO:teuthology.orchestra.run.smithi043.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 431 kB/s | 21 kB 00:00 2024-04-25T13:30:48.505 INFO:teuthology.orchestra.run.smithi161.stdout:(14/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 6.3 MB/s | 756 kB 00:00 2024-04-25T13:30:48.526 INFO:teuthology.orchestra.run.smithi043.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-04-25T13:30:48.551 INFO:teuthology.orchestra.run.smithi043.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 660 kB/s | 33 kB 00:00 2024-04-25T13:30:48.597 INFO:teuthology.orchestra.run.smithi161.stdout:(15/152): libcephsqlite-19.0.0-3291.g994e2f20.e 1.7 MB/s | 158 kB 00:00 2024-04-25T13:30:48.640 INFO:teuthology.orchestra.run.smithi043.stdout:(54/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-25T13:30:48.660 INFO:teuthology.orchestra.run.smithi043.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 172 kB/s | 18 kB 00:00 2024-04-25T13:30:48.672 INFO:teuthology.orchestra.run.smithi161.stdout:(16/152): librados-devel-19.0.0-3291.g994e2f20. 1.7 MB/s | 127 kB 00:00 2024-04-25T13:30:48.677 INFO:teuthology.orchestra.run.smithi043.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 306 kB/s | 11 kB 00:00 2024-04-25T13:30:48.703 INFO:teuthology.orchestra.run.smithi043.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-04-25T13:30:48.719 INFO:teuthology.orchestra.run.smithi043.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-04-25T13:30:48.753 INFO:teuthology.orchestra.run.smithi043.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-04-25T13:30:48.756 INFO:teuthology.orchestra.run.smithi161.stdout:(17/152): libradosstriper1-19.0.0-3291.g994e2f2 5.8 MB/s | 497 kB 00:00 2024-04-25T13:30:48.778 INFO:teuthology.orchestra.run.smithi043.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 582 kB 00:00 2024-04-25T13:30:48.795 INFO:teuthology.orchestra.run.smithi043.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 624 kB/s | 25 kB 00:00 2024-04-25T13:30:48.821 INFO:teuthology.orchestra.run.smithi043.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-04-25T13:30:48.854 INFO:teuthology.orchestra.run.smithi043.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-04-25T13:30:48.880 INFO:teuthology.orchestra.run.smithi043.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-04-25T13:30:48.913 INFO:teuthology.orchestra.run.smithi043.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 602 kB/s | 35 kB 00:00 2024-04-25T13:30:49.031 INFO:teuthology.orchestra.run.smithi043.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2024-04-25T13:30:49.114 INFO:teuthology.orchestra.run.smithi043.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-04-25T13:30:49.147 INFO:teuthology.orchestra.run.smithi043.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-04-25T13:30:49.182 INFO:teuthology.orchestra.run.smithi043.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 14 MB/s | 911 kB 00:00 2024-04-25T13:30:49.206 INFO:teuthology.orchestra.run.smithi043.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.3 MB/s | 133 kB 00:00 2024-04-25T13:30:49.340 INFO:teuthology.orchestra.run.smithi161.stdout:(18/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 8.8 MB/s | 5.2 MB 00:00 2024-04-25T13:30:49.348 INFO:teuthology.orchestra.run.smithi043.stdout:(71/152): postgresql-server-13.14-1.el9.x86_64. 35 MB/s | 5.8 MB 00:00 2024-04-25T13:30:49.382 INFO:teuthology.orchestra.run.smithi043.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 5.8 MB/s | 1.0 MB 00:00 2024-04-25T13:30:49.407 INFO:teuthology.orchestra.run.smithi043.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-25T13:30:49.440 INFO:teuthology.orchestra.run.smithi161.stdout:(19/152): python3-ceph-argparse-19.0.0-3291.g99 453 kB/s | 45 kB 00:00 2024-04-25T13:30:49.532 INFO:teuthology.orchestra.run.smithi161.stdout:(20/152): python3-ceph-common-19.0.0-3291.g994e 1.4 MB/s | 135 kB 00:00 2024-04-25T13:30:49.558 INFO:teuthology.orchestra.run.smithi043.stdout:(74/152): python3-babel-2.9.1-2.el9.noarch.rpm 34 MB/s | 6.0 MB 00:00 2024-04-25T13:30:49.585 INFO:teuthology.orchestra.run.smithi043.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.4 MB/s | 244 kB 00:00 2024-04-25T13:30:49.608 INFO:teuthology.orchestra.run.smithi043.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-25T13:30:49.616 INFO:teuthology.orchestra.run.smithi161.stdout:(21/152): python3-cephfs-19.0.0-3291.g994e2f20. 1.9 MB/s | 161 kB 00:00 2024-04-25T13:30:49.633 INFO:teuthology.orchestra.run.smithi043.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-04-25T13:30:49.659 INFO:teuthology.orchestra.run.smithi043.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-04-25T13:30:49.684 INFO:teuthology.orchestra.run.smithi043.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-25T13:30:49.708 INFO:teuthology.orchestra.run.smithi161.stdout:(22/152): python3-rados-19.0.0-3291.g994e2f20.e 3.4 MB/s | 321 kB 00:00 2024-04-25T13:30:49.709 INFO:teuthology.orchestra.run.smithi043.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-04-25T13:30:49.802 INFO:teuthology.orchestra.run.smithi161.stdout:(23/152): python3-rbd-19.0.0-3291.g994e2f20.el9 3.1 MB/s | 298 kB 00:00 2024-04-25T13:30:49.813 INFO:teuthology.orchestra.run.smithi175.stdout:(8/152): ceph-common-19.0.0-3291.g994e2f20.el9. 1.7 MB/s | 20 MB 00:11 2024-04-25T13:30:49.852 INFO:teuthology.orchestra.run.smithi043.stdout:(81/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 31 MB/s | 5.1 MB 00:00 2024-04-25T13:30:49.855 INFO:teuthology.orchestra.run.smithi175.stdout:(9/152): ceph-selinux-19.0.0-3291.g994e2f20.el9 612 kB/s | 25 kB 00:00 2024-04-25T13:30:49.877 INFO:teuthology.orchestra.run.smithi043.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-04-25T13:30:49.902 INFO:teuthology.orchestra.run.smithi043.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-04-25T13:30:49.927 INFO:teuthology.orchestra.run.smithi043.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-25T13:30:49.953 INFO:teuthology.orchestra.run.smithi043.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-04-25T13:30:49.978 INFO:teuthology.orchestra.run.smithi043.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-04-25T13:30:50.003 INFO:teuthology.orchestra.run.smithi043.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-25T13:30:50.027 INFO:teuthology.orchestra.run.smithi161.stdout:(24/152): ceph-common-19.0.0-3291.g994e2f20.el9 1.6 MB/s | 20 MB 00:12 2024-04-25T13:30:50.028 INFO:teuthology.orchestra.run.smithi043.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-04-25T13:30:50.052 INFO:teuthology.orchestra.run.smithi161.stdout:(25/152): python3-rgw-19.0.0-3291.g994e2f20.el9 398 kB/s | 100 kB 00:00 2024-04-25T13:30:50.053 INFO:teuthology.orchestra.run.smithi043.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-25T13:30:50.079 INFO:teuthology.orchestra.run.smithi043.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-25T13:30:50.111 INFO:teuthology.orchestra.run.smithi161.stdout:(26/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 1.0 MB/s | 86 kB 00:00 2024-04-25T13:30:50.228 INFO:teuthology.orchestra.run.smithi161.stdout:(27/152): ceph-radosgw-19.0.0-3291.g994e2f20.el 1.3 MB/s | 10 MB 00:07 2024-04-25T13:30:50.253 INFO:teuthology.orchestra.run.smithi161.stdout:(28/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 1.2 MB/s | 169 kB 00:00 2024-04-25T13:30:50.279 INFO:teuthology.orchestra.run.smithi043.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 210 kB/s | 42 kB 00:00 2024-04-25T13:30:50.337 INFO:teuthology.orchestra.run.smithi161.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3291.g 315 kB/s | 34 kB 00:00 2024-04-25T13:30:50.354 INFO:teuthology.orchestra.run.smithi161.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 1.4 MB/s | 142 kB 00:00 2024-04-25T13:30:50.404 INFO:teuthology.orchestra.run.smithi161.stdout:(31/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 8.7 MB/s | 3.0 MB 00:00 2024-04-25T13:30:50.471 INFO:teuthology.orchestra.run.smithi043.stdout:(92/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-04-25T13:30:50.497 INFO:teuthology.orchestra.run.smithi043.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 205 kB/s | 44 kB 00:00 2024-04-25T13:30:50.504 INFO:teuthology.orchestra.run.smithi161.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3291.g99 2.4 MB/s | 249 kB 00:00 2024-04-25T13:30:50.522 INFO:teuthology.orchestra.run.smithi043.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-25T13:30:50.581 INFO:teuthology.orchestra.run.smithi043.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 431 kB/s | 36 kB 00:00 2024-04-25T13:30:50.596 INFO:teuthology.orchestra.run.smithi161.stdout:(33/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 538 kB/s | 49 kB 00:00 2024-04-25T13:30:50.648 INFO:teuthology.orchestra.run.smithi043.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 378 kB/s | 47 kB 00:00 2024-04-25T13:30:50.673 INFO:teuthology.orchestra.run.smithi043.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.2 MB/s | 305 kB 00:00 2024-04-25T13:30:50.680 INFO:teuthology.orchestra.run.smithi161.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3291.g9 197 kB/s | 16 kB 00:00 2024-04-25T13:30:50.698 INFO:teuthology.orchestra.run.smithi043.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-25T13:30:50.723 INFO:teuthology.orchestra.run.smithi043.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-25T13:30:50.749 INFO:teuthology.orchestra.run.smithi043.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T13:30:50.774 INFO:teuthology.orchestra.run.smithi043.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-04-25T13:30:50.780 INFO:teuthology.orchestra.run.smithi161.stdout:(35/152): ceph-volume-19.0.0-3291.g994e2f20.el9 2.7 MB/s | 273 kB 00:00 2024-04-25T13:30:50.799 INFO:teuthology.orchestra.run.smithi043.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2024-04-25T13:30:50.833 INFO:teuthology.orchestra.run.smithi043.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 14 MB/s | 863 kB 00:00 2024-04-25T13:30:50.905 INFO:teuthology.orchestra.run.smithi161.stdout:(36/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 6.0 MB/s | 762 kB 00:00 2024-04-25T13:30:50.989 INFO:teuthology.orchestra.run.smithi161.stdout:(37/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 219 kB/s | 18 kB 00:00 2024-04-25T13:30:51.089 INFO:teuthology.orchestra.run.smithi161.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 804 kB/s | 80 kB 00:00 2024-04-25T13:30:51.164 INFO:teuthology.orchestra.run.smithi161.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2024-04-25T13:30:51.206 INFO:teuthology.orchestra.run.smithi161.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-04-25T13:30:51.248 INFO:teuthology.orchestra.run.smithi161.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-04-25T13:30:51.307 INFO:teuthology.orchestra.run.smithi161.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 21 MB/s | 1.2 MB 00:00 2024-04-25T13:30:51.349 INFO:teuthology.orchestra.run.smithi161.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-04-25T13:30:51.382 INFO:teuthology.orchestra.run.smithi161.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 4.0 MB/s | 135 kB 00:00 2024-04-25T13:30:51.416 INFO:teuthology.orchestra.run.smithi161.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 3.7 MB/s | 125 kB 00:00 2024-04-25T13:30:51.466 INFO:teuthology.orchestra.run.smithi161.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-25T13:30:51.513 INFO:teuthology.orchestra.run.smithi175.stdout:(10/152): ceph-radosgw-19.0.0-3291.g994e2f20.el 3.0 MB/s | 10 MB 00:03 2024-04-25T13:30:51.516 INFO:teuthology.orchestra.run.smithi161.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 13 MB/s | 689 kB 00:00 2024-04-25T13:30:51.541 INFO:teuthology.orchestra.run.smithi043.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 436 kB/s | 309 kB 00:00 2024-04-25T13:30:51.567 INFO:teuthology.orchestra.run.smithi161.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 943 kB 00:00 2024-04-25T13:30:51.583 INFO:teuthology.orchestra.run.smithi043.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 701 kB/s | 548 kB 00:00 2024-04-25T13:30:51.600 INFO:teuthology.orchestra.run.smithi161.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 107 kB 00:00 2024-04-25T13:30:51.626 INFO:teuthology.orchestra.run.smithi161.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 868 kB/s | 21 kB 00:00 2024-04-25T13:30:51.642 INFO:teuthology.orchestra.run.smithi043.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 194 kB/s | 19 kB 00:00 2024-04-25T13:30:51.655 INFO:teuthology.orchestra.run.smithi175.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 1.6 MB/s | 224 kB 00:00 2024-04-25T13:30:51.667 INFO:teuthology.orchestra.run.smithi161.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-04-25T13:30:51.701 INFO:teuthology.orchestra.run.smithi161.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 981 kB/s | 33 kB 00:00 2024-04-25T13:30:51.739 INFO:teuthology.orchestra.run.smithi175.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 324 kB/s | 27 kB 00:00 2024-04-25T13:30:51.767 INFO:teuthology.orchestra.run.smithi043.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 208 kB/s | 26 kB 00:00 2024-04-25T13:30:51.818 INFO:teuthology.orchestra.run.smithi161.stdout:(53/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-25T13:30:51.822 INFO:teuthology.orchestra.run.smithi175.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 381 kB/s | 32 kB 00:00 2024-04-25T13:30:51.852 INFO:teuthology.orchestra.run.smithi161.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 546 kB/s | 18 kB 00:00 2024-04-25T13:30:51.876 INFO:teuthology.orchestra.run.smithi043.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 449 kB/s | 49 kB 00:00 2024-04-25T13:30:51.885 INFO:teuthology.orchestra.run.smithi161.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 337 kB/s | 11 kB 00:00 2024-04-25T13:30:51.927 INFO:teuthology.orchestra.run.smithi161.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-04-25T13:30:51.961 INFO:teuthology.orchestra.run.smithi161.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-04-25T13:30:52.003 INFO:teuthology.orchestra.run.smithi161.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 662 kB 00:00 2024-04-25T13:30:52.018 INFO:teuthology.orchestra.run.smithi043.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 475 kB/s | 67 kB 00:00 2024-04-25T13:30:52.045 INFO:teuthology.orchestra.run.smithi161.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 582 kB 00:00 2024-04-25T13:30:52.079 INFO:teuthology.orchestra.run.smithi161.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 760 kB/s | 25 kB 00:00 2024-04-25T13:30:52.112 INFO:teuthology.orchestra.run.smithi161.stdout:(61/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-04-25T13:30:52.156 INFO:teuthology.orchestra.run.smithi175.stdout:(14/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 2.2 MB/s | 756 kB 00:00 2024-04-25T13:30:52.213 INFO:teuthology.orchestra.run.smithi161.stdout:(62/152): ceph-mgr-diskprediction-local-19.0.0- 4.0 MB/s | 7.4 MB 00:01 2024-04-25T13:30:52.231 INFO:teuthology.orchestra.run.smithi175.stdout:(15/152): libcephsqlite-19.0.0-3291.g994e2f20.e 2.1 MB/s | 158 kB 00:00 2024-04-25T13:30:52.238 INFO:teuthology.orchestra.run.smithi161.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-04-25T13:30:52.263 INFO:teuthology.orchestra.run.smithi161.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T13:30:52.288 INFO:teuthology.orchestra.run.smithi161.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 710 kB/s | 35 kB 00:00 2024-04-25T13:30:52.347 INFO:teuthology.orchestra.run.smithi161.stdout:(66/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 1.8 MB/s | 3.5 MB 00:02 2024-04-25T13:30:52.382 INFO:teuthology.orchestra.run.smithi175.stdout:(16/152): librados-devel-19.0.0-3291.g994e2f20. 844 kB/s | 127 kB 00:00 2024-04-25T13:30:52.417 INFO:teuthology.orchestra.run.smithi043.stdout:(110/152): ceph-test-19.0.0-3291.g994e2f20.el9. 3.8 MB/s | 43 MB 00:11 2024-04-25T13:30:52.422 INFO:teuthology.orchestra.run.smithi161.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-04-25T13:30:52.444 INFO:teuthology.orchestra.run.smithi043.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 355 kB/s | 151 kB 00:00 2024-04-25T13:30:52.502 INFO:teuthology.orchestra.run.smithi043.stdout:(112/152): libarrow-9.0.0-10.el9.x86_64.rpm 4.8 MB/s | 4.4 MB 00:00 2024-04-25T13:30:52.564 INFO:teuthology.orchestra.run.smithi161.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-04-25T13:30:52.598 INFO:teuthology.orchestra.run.smithi161.stdout:(69/152): postgresql-13.14-1.el9.x86_64.rpm 6.4 MB/s | 1.6 MB 00:00 2024-04-25T13:30:52.623 INFO:teuthology.orchestra.run.smithi161.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 4.5 MB/s | 911 kB 00:00 2024-04-25T13:30:52.635 INFO:teuthology.orchestra.run.smithi043.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 415 kB/s | 43 kB 00:00 2024-04-25T13:30:52.648 INFO:teuthology.orchestra.run.smithi161.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-04-25T13:30:52.661 INFO:teuthology.orchestra.run.smithi043.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 2.5 MB/s | 548 kB 00:00 2024-04-25T13:30:52.682 INFO:teuthology.orchestra.run.smithi175.stdout:(17/152): libradosstriper1-19.0.0-3291.g994e2f2 1.6 MB/s | 497 kB 00:00 2024-04-25T13:30:52.749 INFO:teuthology.orchestra.run.smithi161.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-04-25T13:30:52.761 INFO:teuthology.orchestra.run.smithi043.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 259 kB/s | 32 kB 00:00 2024-04-25T13:30:52.786 INFO:teuthology.orchestra.run.smithi043.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 120 kB/s | 15 kB 00:00 2024-04-25T13:30:52.815 INFO:teuthology.orchestra.run.smithi161.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 30 MB/s | 5.8 MB 00:00 2024-04-25T13:30:52.841 INFO:teuthology.orchestra.run.smithi161.stdout:(74/152): python3-attrs-20.3.0-7.el9.noarch.rpm 462 kB/s | 87 kB 00:00 2024-04-25T13:30:52.870 INFO:teuthology.orchestra.run.smithi043.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-04-25T13:30:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-04-25T13:30:52.949 INFO:teuthology.orchestra.run.smithi161.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 6.0 MB 00:00 2024-04-25T13:30:52.974 INFO:teuthology.orchestra.run.smithi161.stdout:(76/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.8 MB/s | 244 kB 00:00 2024-04-25T13:30:52.987 INFO:teuthology.orchestra.run.smithi043.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-04-25T13:30:52.991 INFO:teuthology.orchestra.run.smithi161.stdout:(77/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-04-25T13:30:53.017 INFO:teuthology.orchestra.run.smithi161.stdout:(78/152): python3-jsonpatch-1.21-16.el9.noarch. 388 kB/s | 26 kB 00:00 2024-04-25T13:30:53.021 INFO:teuthology.orchestra.run.smithi043.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 325 kB/s | 35 kB 00:00 2024-04-25T13:30:53.042 INFO:teuthology.orchestra.run.smithi161.stdout:(79/152): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-04-25T13:30:53.069 INFO:teuthology.orchestra.run.smithi161.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-04-25T13:30:53.092 INFO:teuthology.orchestra.run.smithi161.stdout:(81/152): python3-markupsafe-1.1.1-12.el9.x86_6 464 kB/s | 35 kB 00:00 2024-04-25T13:30:53.096 INFO:teuthology.orchestra.run.smithi043.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 1.8 MB/s | 206 kB 00:00 2024-04-25T13:30:53.142 INFO:teuthology.orchestra.run.smithi161.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-04-25T13:30:53.205 INFO:teuthology.orchestra.run.smithi043.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-04-25T13:30:53.209 INFO:teuthology.orchestra.run.smithi161.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-04-25T13:30:53.243 INFO:teuthology.orchestra.run.smithi161.stdout:(84/152): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-04-25T13:30:53.268 INFO:teuthology.orchestra.run.smithi161.stdout:(85/152): python3-packaging-20.9-5.el9.noarch.r 626 kB/s | 77 kB 00:00 2024-04-25T13:30:53.280 INFO:teuthology.orchestra.run.smithi043.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 7.9 MB/s | 2.0 MB 00:00 2024-04-25T13:30:53.285 INFO:teuthology.orchestra.run.smithi161.stdout:(86/152): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-04-25T13:30:53.305 INFO:teuthology.orchestra.run.smithi043.stdout:(124/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 944 kB/s | 838 kB 00:00 2024-04-25T13:30:53.310 INFO:teuthology.orchestra.run.smithi161.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-04-25T13:30:53.331 INFO:teuthology.orchestra.run.smithi043.stdout:(125/152): python3-jaraco-8.2.1-3.el9.noarch.rp 85 kB/s | 11 kB 00:00 2024-04-25T13:30:53.336 INFO:teuthology.orchestra.run.smithi161.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-04-25T13:30:53.361 INFO:teuthology.orchestra.run.smithi161.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-04-25T13:30:53.386 INFO:teuthology.orchestra.run.smithi161.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 680 kB/s | 51 kB 00:00 2024-04-25T13:30:53.389 INFO:teuthology.orchestra.run.smithi043.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 162 kB/s | 18 kB 00:00 2024-04-25T13:30:53.411 INFO:teuthology.orchestra.run.smithi161.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 717 kB/s | 54 kB 00:00 2024-04-25T13:30:53.414 INFO:teuthology.orchestra.run.smithi043.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 213 kB/s | 23 kB 00:00 2024-04-25T13:30:53.457 INFO:teuthology.orchestra.run.smithi043.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 155 kB/s | 19 kB 00:00 2024-04-25T13:30:53.470 INFO:teuthology.orchestra.run.smithi161.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 500 kB/s | 42 kB 00:00 2024-04-25T13:30:53.524 INFO:teuthology.orchestra.run.smithi043.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 147 kB/s | 20 kB 00:00 2024-04-25T13:30:53.599 INFO:teuthology.orchestra.run.smithi043.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 326 kB/s | 46 kB 00:00 2024-04-25T13:30:53.633 INFO:teuthology.orchestra.run.smithi043.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 727 kB/s | 79 kB 00:00 2024-04-25T13:30:53.637 INFO:teuthology.orchestra.run.smithi161.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 197 kB/s | 44 kB 00:00 2024-04-25T13:30:53.687 INFO:teuthology.orchestra.run.smithi161.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 1.0 MB/s | 221 kB 00:00 2024-04-25T13:30:53.708 INFO:teuthology.orchestra.run.smithi043.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 531 kB/s | 58 kB 00:00 2024-04-25T13:30:53.741 INFO:teuthology.orchestra.run.smithi043.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2024-04-25T13:30:53.775 INFO:teuthology.orchestra.run.smithi043.stdout:(134/152): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-04-25T13:30:53.817 INFO:teuthology.orchestra.run.smithi043.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-04-25T13:30:53.846 INFO:teuthology.orchestra.run.smithi161.stdout:(95/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-04-25T13:30:53.858 INFO:teuthology.orchestra.run.smithi043.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 768 kB/s | 90 kB 00:00 2024-04-25T13:30:53.871 INFO:teuthology.orchestra.run.smithi161.stdout:(96/152): qatlib-service-24.02.0-1.el9.x86_64.r 155 kB/s | 36 kB 00:00 2024-04-25T13:30:53.892 INFO:teuthology.orchestra.run.smithi043.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 241 kB/s | 28 kB 00:00 2024-04-25T13:30:53.896 INFO:teuthology.orchestra.run.smithi161.stdout:(97/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 228 kB/s | 47 kB 00:00 2024-04-25T13:30:53.926 INFO:teuthology.orchestra.run.smithi043.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 282 kB/s | 31 kB 00:00 2024-04-25T13:30:53.930 INFO:teuthology.orchestra.run.smithi161.stdout:(98/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-25T13:30:53.955 INFO:teuthology.orchestra.run.smithi161.stdout:(99/152): uuid-1.6.2-55.el9.x86_64.rpm 692 kB/s | 58 kB 00:00 2024-04-25T13:30:53.968 INFO:teuthology.orchestra.run.smithi043.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-04-25T13:30:53.980 INFO:teuthology.orchestra.run.smithi161.stdout:(100/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.1 MB/s | 94 kB 00:00 2024-04-25T13:30:54.001 INFO:teuthology.orchestra.run.smithi043.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 543 kB/s | 59 kB 00:00 2024-04-25T13:30:54.006 INFO:teuthology.orchestra.run.smithi161.stdout:(101/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T13:30:54.031 INFO:teuthology.orchestra.run.smithi161.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 598 kB/s | 45 kB 00:00 2024-04-25T13:30:54.035 INFO:teuthology.orchestra.run.smithi043.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 329 kB/s | 36 kB 00:00 2024-04-25T13:30:54.056 INFO:teuthology.orchestra.run.smithi161.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-04-25T13:30:54.077 INFO:teuthology.orchestra.run.smithi043.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 469 kB/s | 51 kB 00:00 2024-04-25T13:30:54.090 INFO:teuthology.orchestra.run.smithi161.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 14 MB/s | 863 kB 00:00 2024-04-25T13:30:54.111 INFO:teuthology.orchestra.run.smithi043.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-25T13:30:54.153 INFO:teuthology.orchestra.run.smithi043.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 766 kB/s | 90 kB 00:00 2024-04-25T13:30:54.165 INFO:teuthology.orchestra.run.smithi175.stdout:(18/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x8 2.0 MB/s | 18 MB 00:08 2024-04-25T13:30:54.194 INFO:teuthology.orchestra.run.smithi043.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-04-25T13:30:54.220 INFO:teuthology.orchestra.run.smithi043.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 183 kB/s | 20 kB 00:00 2024-04-25T13:30:54.270 INFO:teuthology.orchestra.run.smithi043.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-04-25T13:30:54.274 INFO:teuthology.orchestra.run.smithi175.stdout:(19/152): python3-ceph-argparse-19.0.0-3291.g99 417 kB/s | 45 kB 00:00 2024-04-25T13:30:54.332 INFO:teuthology.orchestra.run.smithi161.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 80 kB/s | 19 kB 00:00 2024-04-25T13:30:54.354 INFO:teuthology.orchestra.run.smithi043.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-04-25T13:30:54.421 INFO:teuthology.orchestra.run.smithi043.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-04-25T13:30:54.482 INFO:teuthology.orchestra.run.smithi161.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 728 kB/s | 309 kB 00:00 2024-04-25T13:30:54.505 INFO:teuthology.orchestra.run.smithi043.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-04-25T13:30:54.533 INFO:teuthology.orchestra.run.smithi175.stdout:(20/152): python3-ceph-common-19.0.0-3291.g994e 523 kB/s | 135 kB 00:00 2024-04-25T13:30:54.565 INFO:teuthology.orchestra.run.smithi161.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-04-25T13:30:54.591 INFO:teuthology.orchestra.run.smithi161.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 239 kB/s | 26 kB 00:00 2024-04-25T13:30:54.641 INFO:teuthology.orchestra.run.smithi161.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 646 kB/s | 49 kB 00:00 2024-04-25T13:30:54.675 INFO:teuthology.orchestra.run.smithi161.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 805 kB/s | 67 kB 00:00 2024-04-25T13:30:54.725 INFO:teuthology.orchestra.run.smithi161.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-04-25T13:30:54.875 INFO:teuthology.orchestra.run.smithi175.stdout:(21/152): python3-cephfs-19.0.0-3291.g994e2f20. 473 kB/s | 161 kB 00:00 2024-04-25T13:30:54.900 INFO:teuthology.orchestra.run.smithi161.stdout:(112/152): libarrow-9.0.0-10.el9.x86_64.rpm 7.8 MB/s | 4.4 MB 00:00 2024-04-25T13:30:54.934 INFO:teuthology.orchestra.run.smithi161.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.2 MB/s | 838 kB 00:00 2024-04-25T13:30:54.959 INFO:teuthology.orchestra.run.smithi161.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 2.3 MB/s | 548 kB 00:00 2024-04-25T13:30:54.984 INFO:teuthology.orchestra.run.smithi161.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 519 kB/s | 43 kB 00:00 2024-04-25T13:30:55.018 INFO:teuthology.orchestra.run.smithi161.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 384 kB/s | 32 kB 00:00 2024-04-25T13:30:55.052 INFO:teuthology.orchestra.run.smithi161.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 162 kB/s | 15 kB 00:00 2024-04-25T13:30:55.077 INFO:teuthology.orchestra.run.smithi161.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-04-25T13:30:55.102 INFO:teuthology.orchestra.run.smithi161.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-04-25T13:30:55.153 INFO:teuthology.orchestra.run.smithi161.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-04-25T13:30:55.169 INFO:teuthology.orchestra.run.smithi161.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 383 kB/s | 35 kB 00:00 2024-04-25T13:30:55.195 INFO:teuthology.orchestra.run.smithi161.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.2 MB/s | 206 kB 00:00 2024-04-25T13:30:55.262 INFO:teuthology.orchestra.run.smithi161.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-04-25T13:30:55.287 INFO:teuthology.orchestra.run.smithi161.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-04-25T13:30:55.329 INFO:teuthology.orchestra.run.smithi161.stdout:(125/152): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-04-25T13:30:55.354 INFO:teuthology.orchestra.run.smithi161.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-04-25T13:30:55.379 INFO:teuthology.orchestra.run.smithi161.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 251 kB/s | 23 kB 00:00 2024-04-25T13:30:55.405 INFO:teuthology.orchestra.run.smithi161.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-04-25T13:30:55.430 INFO:teuthology.orchestra.run.smithi161.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-25T13:30:55.505 INFO:teuthology.orchestra.run.smithi161.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-04-25T13:30:55.508 INFO:teuthology.orchestra.run.smithi175.stdout:(22/152): python3-rados-19.0.0-3291.g994e2f20.e 507 kB/s | 321 kB 00:00 2024-04-25T13:30:55.530 INFO:teuthology.orchestra.run.smithi161.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 369 kB/s | 46 kB 00:00 2024-04-25T13:30:55.556 INFO:teuthology.orchestra.run.smithi161.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 629 kB/s | 79 kB 00:00 2024-04-25T13:30:55.581 INFO:teuthology.orchestra.run.smithi161.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 765 kB/s | 58 kB 00:00 2024-04-25T13:30:55.623 INFO:teuthology.orchestra.run.smithi161.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-04-25T13:30:55.648 INFO:teuthology.orchestra.run.smithi161.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-04-25T13:30:55.673 INFO:teuthology.orchestra.run.smithi161.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 977 kB/s | 90 kB 00:00 2024-04-25T13:30:55.699 INFO:teuthology.orchestra.run.smithi161.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-04-25T13:30:55.799 INFO:teuthology.orchestra.run.smithi161.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 204 kB/s | 31 kB 00:00 2024-04-25T13:30:55.824 INFO:teuthology.orchestra.run.smithi161.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 472 kB/s | 59 kB 00:00 2024-04-25T13:30:55.849 INFO:teuthology.orchestra.run.smithi161.stdout:(140/152): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-04-25T13:30:55.875 INFO:teuthology.orchestra.run.smithi161.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 475 kB/s | 36 kB 00:00 2024-04-25T13:30:55.908 INFO:teuthology.orchestra.run.smithi161.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 607 kB/s | 51 kB 00:00 2024-04-25T13:30:55.934 INFO:teuthology.orchestra.run.smithi161.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-25T13:30:55.950 INFO:teuthology.orchestra.run.smithi161.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-25T13:30:55.984 INFO:teuthology.orchestra.run.smithi161.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-04-25T13:30:56.009 INFO:teuthology.orchestra.run.smithi161.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-04-25T13:30:56.054 INFO:teuthology.orchestra.run.smithi043.stdout:(151/152): librados2-19.0.0-3291.g994e2f20.el9. 1.8 MB/s | 3.3 MB 00:01 2024-04-25T13:30:56.058 INFO:teuthology.orchestra.run.smithi175.stdout:(23/152): python3-rbd-19.0.0-3291.g994e2f20.el9 542 kB/s | 298 kB 00:00 2024-04-25T13:30:56.060 INFO:teuthology.orchestra.run.smithi161.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-25T13:30:56.160 INFO:teuthology.orchestra.run.smithi161.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-04-25T13:30:56.219 INFO:teuthology.orchestra.run.smithi161.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 23 MB/s | 1.3 MB 00:00 2024-04-25T13:30:56.292 INFO:teuthology.orchestra.run.smithi175.stdout:(24/152): python3-rgw-19.0.0-3291.g994e2f20.el9 427 kB/s | 100 kB 00:00 2024-04-25T13:30:56.302 INFO:teuthology.orchestra.run.smithi161.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-04-25T13:30:56.467 INFO:teuthology.orchestra.run.smithi175.stdout:(25/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 493 kB/s | 86 kB 00:00 2024-04-25T13:30:57.486 INFO:teuthology.orchestra.run.smithi161.stdout:(151/152): librados2-19.0.0-3291.g994e2f20.el9. 2.3 MB/s | 3.3 MB 00:01 2024-04-25T13:30:58.009 INFO:teuthology.orchestra.run.smithi175.stdout:(26/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 991 kB/s | 5.2 MB 00:05 2024-04-25T13:30:58.218 INFO:teuthology.orchestra.run.smithi175.stdout:(27/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 814 kB/s | 169 kB 00:00 2024-04-25T13:30:58.309 INFO:teuthology.orchestra.run.smithi175.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3291.g 374 kB/s | 34 kB 00:00 2024-04-25T13:30:58.518 INFO:teuthology.orchestra.run.smithi175.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 683 kB/s | 142 kB 00:00 2024-04-25T13:30:58.703 INFO:teuthology.orchestra.run.smithi161.stdout:(152/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 1.2 MB/s | 3.1 MB 00:02 2024-04-25T13:30:58.707 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:30:58.707 INFO:teuthology.orchestra.run.smithi161.stdout:Total 9.9 MB/s | 214 MB 00:21 2024-04-25T13:30:59.790 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-04-25T13:30:59.934 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-04-25T13:30:59.934 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-04-25T13:31:00.096 INFO:teuthology.orchestra.run.smithi043.stdout:(152/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 543 kB/s | 3.1 MB 00:05 2024-04-25T13:31:00.103 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:31:00.103 INFO:teuthology.orchestra.run.smithi043.stdout:Total 9.2 MB/s | 214 MB 00:23 2024-04-25T13:31:00.385 INFO:teuthology.orchestra.run.smithi175.stdout:(30/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 795 kB/s | 3.0 MB 00:03 2024-04-25T13:31:01.248 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-04-25T13:31:01.409 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-04-25T13:31:01.409 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-04-25T13:31:01.660 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-04-25T13:31:01.661 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-04-25T13:31:02.009 INFO:teuthology.orchestra.run.smithi175.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 1.0 MB/s | 3.5 MB 00:03 2024-04-25T13:31:02.393 INFO:teuthology.orchestra.run.smithi175.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3291.g99 650 kB/s | 249 kB 00:00 2024-04-25T13:31:02.485 INFO:teuthology.orchestra.run.smithi175.stdout:(33/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 537 kB/s | 49 kB 00:00 2024-04-25T13:31:02.585 INFO:teuthology.orchestra.run.smithi175.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3291.g9 164 kB/s | 16 kB 00:00 2024-04-25T13:31:03.086 INFO:teuthology.orchestra.run.smithi175.stdout:(35/152): ceph-volume-19.0.0-3291.g994e2f20.el9 546 kB/s | 273 kB 00:00 2024-04-25T13:31:03.245 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-04-25T13:31:03.245 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-04-25T13:31:04.528 INFO:teuthology.orchestra.run.smithi175.stdout:(36/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 529 kB/s | 762 kB 00:01 2024-04-25T13:31:04.636 INFO:teuthology.orchestra.run.smithi175.stdout:(37/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 169 kB/s | 18 kB 00:00 2024-04-25T13:31:04.745 INFO:teuthology.orchestra.run.smithi175.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 742 kB/s | 80 kB 00:00 2024-04-25T13:31:04.820 INFO:teuthology.orchestra.run.smithi175.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2024-04-25T13:31:04.862 INFO:teuthology.orchestra.run.smithi175.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-04-25T13:31:04.904 INFO:teuthology.orchestra.run.smithi175.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.0 MB/s | 253 kB 00:00 2024-04-25T13:31:04.962 INFO:teuthology.orchestra.run.smithi175.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 21 MB/s | 1.2 MB 00:00 2024-04-25T13:31:04.996 INFO:teuthology.orchestra.run.smithi175.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2024-04-25T13:31:05.030 INFO:teuthology.orchestra.run.smithi175.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 4.0 MB/s | 135 kB 00:00 2024-04-25T13:31:05.063 INFO:teuthology.orchestra.run.smithi175.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 3.7 MB/s | 125 kB 00:00 2024-04-25T13:31:05.097 INFO:teuthology.orchestra.run.smithi175.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 6.3 MB/s | 215 kB 00:00 2024-04-25T13:31:05.139 INFO:teuthology.orchestra.run.smithi175.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 16 MB/s | 689 kB 00:00 2024-04-25T13:31:05.197 INFO:teuthology.orchestra.run.smithi175.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-04-25T13:31:05.231 INFO:teuthology.orchestra.run.smithi175.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 107 kB 00:00 2024-04-25T13:31:05.264 INFO:teuthology.orchestra.run.smithi175.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 650 kB/s | 21 kB 00:00 2024-04-25T13:31:05.307 INFO:teuthology.orchestra.run.smithi175.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-04-25T13:31:05.340 INFO:teuthology.orchestra.run.smithi175.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 987 kB/s | 33 kB 00:00 2024-04-25T13:31:05.424 INFO:teuthology.orchestra.run.smithi175.stdout:(53/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2024-04-25T13:31:05.457 INFO:teuthology.orchestra.run.smithi175.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 549 kB/s | 18 kB 00:00 2024-04-25T13:31:05.491 INFO:teuthology.orchestra.run.smithi175.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 336 kB/s | 11 kB 00:00 2024-04-25T13:31:05.524 INFO:teuthology.orchestra.run.smithi175.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 160 kB 00:00 2024-04-25T13:31:05.558 INFO:teuthology.orchestra.run.smithi175.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-04-25T13:31:05.658 INFO:teuthology.orchestra.run.smithi175.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-04-25T13:31:05.700 INFO:teuthology.orchestra.run.smithi175.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 582 kB 00:00 2024-04-25T13:31:05.726 INFO:teuthology.orchestra.run.smithi175.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 1.0 MB/s | 25 kB 00:00 2024-04-25T13:31:05.751 INFO:teuthology.orchestra.run.smithi175.stdout:(61/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.9 MB/s | 47 kB 00:00 2024-04-25T13:31:05.794 INFO:teuthology.orchestra.run.smithi175.stdout:(62/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2024-04-25T13:31:05.835 INFO:teuthology.orchestra.run.smithi175.stdout:(63/152): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-04-25T13:31:05.868 INFO:teuthology.orchestra.run.smithi175.stdout:(64/152): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 35 kB 00:00 2024-04-25T13:31:06.019 INFO:teuthology.orchestra.run.smithi175.stdout:(65/152): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2024-04-25T13:31:06.144 INFO:teuthology.orchestra.run.smithi175.stdout:(66/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 36 MB/s | 4.4 MB 00:00 2024-04-25T13:31:06.211 INFO:teuthology.orchestra.run.smithi175.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-04-25T13:31:06.270 INFO:teuthology.orchestra.run.smithi175.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 15 MB/s | 911 kB 00:00 2024-04-25T13:31:06.303 INFO:teuthology.orchestra.run.smithi175.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 3.9 MB/s | 133 kB 00:00 2024-04-25T13:31:06.445 INFO:teuthology.orchestra.run.smithi175.stdout:(70/152): postgresql-server-13.14-1.el9.x86_64. 41 MB/s | 5.8 MB 00:00 2024-04-25T13:31:06.529 INFO:teuthology.orchestra.run.smithi175.stdout:(71/152): ceph-mgr-diskprediction-local-19.0.0- 1.2 MB/s | 7.4 MB 00:06 2024-04-25T13:31:06.562 INFO:teuthology.orchestra.run.smithi175.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-04-25T13:31:06.588 INFO:teuthology.orchestra.run.smithi175.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-25T13:31:06.713 INFO:teuthology.orchestra.run.smithi175.stdout:(74/152): python3-babel-2.9.1-2.el9.noarch.rpm 40 MB/s | 6.0 MB 00:00 2024-04-25T13:31:06.738 INFO:teuthology.orchestra.run.smithi175.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.6 MB/s | 244 kB 00:00 2024-04-25T13:31:06.763 INFO:teuthology.orchestra.run.smithi175.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-25T13:31:06.789 INFO:teuthology.orchestra.run.smithi175.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-04-25T13:31:06.814 INFO:teuthology.orchestra.run.smithi175.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-04-25T13:31:06.839 INFO:teuthology.orchestra.run.smithi175.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-25T13:31:06.864 INFO:teuthology.orchestra.run.smithi175.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-04-25T13:31:06.990 INFO:teuthology.orchestra.run.smithi175.stdout:(81/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-04-25T13:31:07.015 INFO:teuthology.orchestra.run.smithi175.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-04-25T13:31:07.040 INFO:teuthology.orchestra.run.smithi175.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-04-25T13:31:07.065 INFO:teuthology.orchestra.run.smithi175.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-25T13:31:07.091 INFO:teuthology.orchestra.run.smithi175.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-04-25T13:31:07.116 INFO:teuthology.orchestra.run.smithi175.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-04-25T13:31:07.142 INFO:teuthology.orchestra.run.smithi175.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-25T13:31:07.167 INFO:teuthology.orchestra.run.smithi175.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-04-25T13:31:07.192 INFO:teuthology.orchestra.run.smithi175.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-25T13:31:07.217 INFO:teuthology.orchestra.run.smithi175.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-25T13:31:07.451 INFO:teuthology.orchestra.run.smithi175.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 180 kB/s | 42 kB 00:00 2024-04-25T13:31:07.601 INFO:teuthology.orchestra.run.smithi175.stdout:(92/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-04-25T13:31:07.626 INFO:teuthology.orchestra.run.smithi175.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 254 kB/s | 44 kB 00:00 2024-04-25T13:31:07.723 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-04-25T13:31:07.815 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T13:31:07.837 INFO:teuthology.orchestra.run.smithi175.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 937 kB/s | 221 kB 00:00 2024-04-25T13:31:07.853 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T13:31:07.879 INFO:teuthology.orchestra.run.smithi175.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 142 kB/s | 36 kB 00:00 2024-04-25T13:31:07.896 INFO:teuthology.orchestra.run.smithi175.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-04-25T13:31:07.914 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T13:31:07.930 INFO:teuthology.orchestra.run.smithi175.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 305 kB 00:00 2024-04-25T13:31:07.946 INFO:teuthology.orchestra.run.smithi175.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-25T13:31:07.948 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T13:31:07.971 INFO:teuthology.orchestra.run.smithi175.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.2 MB/s | 94 kB 00:00 2024-04-25T13:31:07.982 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T13:31:07.988 INFO:teuthology.orchestra.run.smithi175.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-04-25T13:31:08.014 INFO:teuthology.orchestra.run.smithi175.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-04-25T13:31:08.025 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T13:31:08.031 INFO:teuthology.orchestra.run.smithi175.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 531 kB/s | 22 kB 00:00 2024-04-25T13:31:08.090 INFO:teuthology.orchestra.run.smithi175.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 11 MB/s | 863 kB 00:00 2024-04-25T13:31:08.359 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T13:31:08.406 INFO:teuthology.orchestra.run.smithi175.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 976 kB/s | 309 kB 00:00 2024-04-25T13:31:08.433 INFO:teuthology.orchestra.run.smithi175.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.3 MB/s | 548 kB 00:00 2024-04-25T13:31:08.457 INFO:teuthology.orchestra.run.smithi175.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 388 kB/s | 19 kB 00:00 2024-04-25T13:31:08.475 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T13:31:08.515 INFO:teuthology.orchestra.run.smithi175.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 445 kB/s | 26 kB 00:00 2024-04-25T13:31:08.574 INFO:teuthology.orchestra.run.smithi175.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 833 kB/s | 49 kB 00:00 2024-04-25T13:31:08.600 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T13:31:08.626 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T13:31:08.674 INFO:teuthology.orchestra.run.smithi175.stdout:(109/152): libarrow-9.0.0-10.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-04-25T13:31:08.691 INFO:teuthology.orchestra.run.smithi175.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 577 kB/s | 67 kB 00:00 2024-04-25T13:31:08.718 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T13:31:08.733 INFO:teuthology.orchestra.run.smithi175.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-04-25T13:31:08.755 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T13:31:08.808 INFO:teuthology.orchestra.run.smithi175.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 7.2 MB/s | 548 kB 00:00 2024-04-25T13:31:08.833 INFO:teuthology.orchestra.run.smithi175.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.8 MB/s | 838 kB 00:00 2024-04-25T13:31:08.884 INFO:teuthology.orchestra.run.smithi175.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 578 kB/s | 43 kB 00:00 2024-04-25T13:31:08.904 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T13:31:08.909 INFO:teuthology.orchestra.run.smithi175.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 428 kB/s | 32 kB 00:00 2024-04-25T13:31:08.943 INFO:teuthology.orchestra.run.smithi175.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 256 kB/s | 15 kB 00:00 2024-04-25T13:31:08.953 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T13:31:08.976 INFO:teuthology.orchestra.run.smithi175.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-04-25T13:31:08.980 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T13:31:09.002 INFO:teuthology.orchestra.run.smithi175.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-04-25T13:31:09.043 INFO:teuthology.orchestra.run.smithi175.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-04-25T13:31:09.069 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T13:31:09.069 INFO:teuthology.orchestra.run.smithi175.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 528 kB/s | 35 kB 00:00 2024-04-25T13:31:09.098 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T13:31:09.110 INFO:teuthology.orchestra.run.smithi175.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 3.0 MB/s | 206 kB 00:00 2024-04-25T13:31:09.144 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T13:31:09.166 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:31:09.185 INFO:teuthology.orchestra.run.smithi175.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-04-25T13:31:09.187 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:31:09.211 INFO:teuthology.orchestra.run.smithi175.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-04-25T13:31:09.253 INFO:teuthology.orchestra.run.smithi175.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-04-25T13:31:09.278 INFO:teuthology.orchestra.run.smithi175.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 264 kB/s | 18 kB 00:00 2024-04-25T13:31:09.312 INFO:teuthology.orchestra.run.smithi175.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 393 kB/s | 23 kB 00:00 2024-04-25T13:31:09.337 INFO:teuthology.orchestra.run.smithi175.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 330 kB/s | 19 kB 00:00 2024-04-25T13:31:09.371 INFO:teuthology.orchestra.run.smithi175.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2024-04-25T13:31:09.391 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:31:09.424 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:31:09.438 INFO:teuthology.orchestra.run.smithi175.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-04-25T13:31:09.463 INFO:teuthology.orchestra.run.smithi175.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 506 kB/s | 46 kB 00:00 2024-04-25T13:31:09.488 INFO:teuthology.orchestra.run.smithi175.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-25T13:31:09.530 INFO:teuthology.orchestra.run.smithi175.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 863 kB/s | 58 kB 00:00 2024-04-25T13:31:09.534 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T13:31:09.556 INFO:teuthology.orchestra.run.smithi175.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-04-25T13:31:09.597 INFO:teuthology.orchestra.run.smithi175.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-04-25T13:31:09.622 INFO:teuthology.orchestra.run.smithi175.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-25T13:31:09.630 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T13:31:09.638 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-04-25T13:31:09.664 INFO:teuthology.orchestra.run.smithi175.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 423 kB/s | 28 kB 00:00 2024-04-25T13:31:09.665 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T13:31:09.690 INFO:teuthology.orchestra.run.smithi175.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 460 kB/s | 31 kB 00:00 2024-04-25T13:31:09.700 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T13:31:09.733 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T13:31:09.740 INFO:teuthology.orchestra.run.smithi175.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-25T13:31:09.765 INFO:teuthology.orchestra.run.smithi175.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 786 kB/s | 59 kB 00:00 2024-04-25T13:31:09.775 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T13:31:09.780 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T13:31:09.799 INFO:teuthology.orchestra.run.smithi175.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 612 kB/s | 36 kB 00:00 2024-04-25T13:31:09.816 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T13:31:09.824 INFO:teuthology.orchestra.run.smithi175.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 871 kB/s | 51 kB 00:00 2024-04-25T13:31:09.842 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T13:31:09.858 INFO:teuthology.orchestra.run.smithi175.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-04-25T13:31:09.860 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T13:31:09.883 INFO:teuthology.orchestra.run.smithi175.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-04-25T13:31:09.884 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T13:31:09.900 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T13:31:09.909 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T13:31:09.916 INFO:teuthology.orchestra.run.smithi175.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 7.2 MB/s | 427 kB 00:00 2024-04-25T13:31:09.928 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T13:31:09.933 INFO:teuthology.orchestra.run.smithi175.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-04-25T13:31:09.953 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T13:31:09.975 INFO:teuthology.orchestra.run.smithi175.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-04-25T13:31:09.998 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T13:31:10.067 INFO:teuthology.orchestra.run.smithi175.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-25T13:31:10.069 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T13:31:10.098 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T13:31:10.142 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T13:31:10.219 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T13:31:10.269 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T13:31:10.304 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T13:31:10.312 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T13:31:10.341 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T13:31:10.411 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T13:31:10.418 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T13:31:10.464 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T13:31:10.530 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T13:31:10.539 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T13:31:10.553 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T13:31:10.646 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T13:31:10.674 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T13:31:10.675 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T13:31:10.724 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T13:31:10.827 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T13:31:10.880 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T13:31:10.907 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T13:31:11.014 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T13:31:11.042 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T13:31:11.105 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T13:31:11.126 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:31:11.145 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:31:11.248 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T13:31:11.328 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T13:31:11.357 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T13:31:11.361 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:31:11.393 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:31:11.400 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T13:31:11.438 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T13:31:11.479 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T13:31:11.503 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T13:31:11.600 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T13:31:11.633 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T13:31:11.633 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T13:31:11.660 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T13:31:11.682 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T13:31:11.736 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T13:31:11.737 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T13:31:11.785 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T13:31:11.810 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T13:31:11.828 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T13:31:11.841 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T13:31:11.861 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T13:31:11.878 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T13:31:11.888 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T13:31:11.925 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T13:31:11.961 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T13:31:11.961 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T13:31:12.004 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T13:31:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T13:31:12.042 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T13:31:12.046 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T13:31:12.086 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T13:31:12.164 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T13:31:12.182 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T13:31:12.196 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T13:31:12.235 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T13:31:12.240 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T13:31:12.265 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T13:31:12.268 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T13:31:12.306 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T13:31:12.317 INFO:teuthology.orchestra.run.smithi175.stdout:(148/152): librados2-19.0.0-3291.g994e2f20.el9. 1.4 MB/s | 3.3 MB 00:02 2024-04-25T13:31:12.341 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T13:31:12.392 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T13:31:12.392 INFO:teuthology.orchestra.run.smithi175.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 18 MB/s | 1.3 MB 00:00 2024-04-25T13:31:12.401 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T13:31:12.440 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T13:31:12.470 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T13:31:12.472 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T13:31:12.497 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T13:31:12.522 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T13:31:12.576 INFO:teuthology.orchestra.run.smithi175.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2024-04-25T13:31:12.597 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T13:31:12.605 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T13:31:12.661 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T13:31:12.726 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T13:31:12.762 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T13:31:12.790 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T13:31:12.825 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T13:31:12.864 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T13:31:12.896 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T13:31:13.001 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T13:31:13.043 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T13:31:13.077 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T13:31:13.118 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T13:31:13.153 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T13:31:13.214 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T13:31:13.240 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T13:31:13.283 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T13:31:13.300 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T13:31:13.335 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T13:31:13.344 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T13:31:13.378 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T13:31:13.395 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T13:31:13.416 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T13:31:13.458 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T13:31:13.493 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T13:31:13.549 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T13:31:13.613 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T13:31:13.677 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T13:31:13.733 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T13:31:13.808 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T13:31:13.845 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T13:31:13.882 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T13:31:13.962 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T13:31:14.006 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T13:31:14.050 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T13:31:14.092 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T13:31:14.143 INFO:teuthology.orchestra.run.smithi175.stdout:(151/152): ceph-test-19.0.0-3291.g994e2f20.el9. 1.8 MB/s | 43 MB 00:24 2024-04-25T13:31:14.235 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T13:31:14.275 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T13:31:14.280 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T13:31:14.310 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T13:31:14.321 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T13:31:14.351 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T13:31:14.354 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T13:31:14.445 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T13:31:14.449 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T13:31:14.459 INFO:teuthology.orchestra.run.smithi175.stdout:(152/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 721 kB/s | 3.1 MB 00:04 2024-04-25T13:31:14.465 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:31:14.465 INFO:teuthology.orchestra.run.smithi175.stdout:Total 5.8 MB/s | 214 MB 00:37 2024-04-25T13:31:14.485 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T13:31:14.504 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T13:31:14.525 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T13:31:14.551 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T13:31:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T13:31:14.592 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T13:31:14.640 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T13:31:14.653 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T13:31:14.792 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T13:31:14.820 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T13:31:14.824 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T13:31:14.846 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T13:31:14.852 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T13:31:14.887 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T13:31:14.924 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T13:31:14.926 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T13:31:14.966 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T13:31:14.995 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T13:31:15.030 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T13:31:15.080 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T13:31:15.122 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T13:31:15.156 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T13:31:15.247 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T13:31:15.296 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T13:31:15.326 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T13:31:15.374 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T13:31:15.486 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T13:31:15.545 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T13:31:15.565 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T13:31:15.590 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-04-25T13:31:15.678 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T13:31:15.739 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-04-25T13:31:15.740 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-04-25T13:31:16.308 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T13:31:16.358 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T13:31:16.392 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T13:31:16.498 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T13:31:16.552 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T13:31:16.641 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T13:31:16.678 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T13:31:16.862 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T13:31:16.892 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T13:31:16.919 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T13:31:16.972 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T13:31:17.009 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T13:31:17.037 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T13:31:17.070 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T13:31:17.392 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T13:31:17.442 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T13:31:17.532 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-04-25T13:31:17.533 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T13:31:17.533 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-04-25T13:31:17.563 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T13:31:17.599 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T13:31:17.654 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T13:31:17.778 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T13:31:18.087 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T13:31:18.119 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T13:31:18.190 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T13:31:18.212 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T13:31:19.092 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T13:31:19.180 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T13:31:19.208 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T13:31:19.240 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T13:31:19.577 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T13:31:19.611 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T13:31:19.712 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T13:31:19.741 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T13:31:19.778 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T13:31:20.293 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T13:31:20.323 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T13:31:20.394 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T13:31:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T13:31:20.487 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T13:31:20.525 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T13:31:21.089 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T13:31:21.140 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T13:31:21.232 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T13:31:21.232 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T13:31:21.232 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T13:31:21.233 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:31:21.264 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T13:31:22.759 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T13:31:22.796 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T13:31:23.386 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T13:31:23.424 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T13:31:23.427 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-04-25T13:31:23.516 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T13:31:23.516 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T13:31:23.516 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T13:31:23.516 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:31:23.522 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T13:31:23.542 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T13:31:23.559 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T13:31:23.638 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T13:31:23.672 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T13:31:23.698 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T13:31:23.740 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T13:31:24.126 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T13:31:24.182 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T13:31:24.305 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T13:31:24.333 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T13:31:24.423 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T13:31:24.453 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T13:31:24.602 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T13:31:24.651 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T13:31:24.678 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T13:31:24.766 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T13:31:24.796 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T13:31:24.858 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T13:31:24.880 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:31:24.900 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:31:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:31:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:31:25.237 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T13:31:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T13:31:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T13:31:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T13:31:25.469 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T13:31:25.512 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T13:31:25.556 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T13:31:25.588 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T13:31:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T13:31:25.693 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T13:31:25.746 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T13:31:25.777 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T13:31:25.812 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T13:31:25.888 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T13:31:25.923 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T13:31:25.966 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T13:31:25.995 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T13:31:26.065 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T13:31:26.126 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T13:31:26.201 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T13:31:26.334 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T13:31:26.386 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T13:31:26.944 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T13:31:27.023 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T13:31:27.053 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T13:31:27.095 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T13:31:27.133 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T13:31:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T13:31:27.332 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T13:31:27.386 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T13:31:27.440 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T13:31:27.504 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T13:31:27.537 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T13:31:27.573 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T13:31:27.619 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T13:31:27.655 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T13:31:27.698 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T13:31:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T13:31:27.874 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T13:31:27.921 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T13:31:27.951 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T13:31:27.992 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T13:31:28.086 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T13:31:28.118 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T13:31:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T13:31:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T13:31:28.224 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T13:31:28.298 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T13:31:28.424 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T13:31:28.457 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T13:31:28.484 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T13:31:28.518 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T13:31:28.558 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T13:31:28.589 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T13:31:28.619 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T13:31:28.654 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T13:31:28.678 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T13:31:28.722 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T13:31:28.754 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T13:31:28.840 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T13:31:28.884 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T13:31:28.916 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T13:31:28.954 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T13:31:29.052 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T13:31:29.109 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T13:31:29.819 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T13:31:29.864 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T13:31:29.897 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T13:31:29.995 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T13:31:30.055 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T13:31:30.142 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T13:31:30.183 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T13:31:30.359 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T13:31:30.380 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T13:31:30.457 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T13:31:31.083 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T13:31:31.203 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T13:31:32.408 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T13:31:32.492 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T13:31:32.519 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T13:31:32.553 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T13:31:32.835 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T13:31:32.835 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /sys 2024-04-25T13:31:32.835 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /proc 2024-04-25T13:31:32.835 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /mnt 2024-04-25T13:31:32.835 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /var/tmp 2024-04-25T13:31:32.835 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /home 2024-04-25T13:31:32.835 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /root 2024-04-25T13:31:32.835 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /tmp 2024-04-25T13:31:32.835 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:31:32.872 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T13:31:32.915 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T13:31:33.005 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T13:31:33.009 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T13:31:33.025 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T13:31:33.025 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:33.025 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T13:31:33.025 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:31:33.036 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T13:31:33.073 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T13:31:33.557 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T13:31:33.593 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T13:31:33.664 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T13:31:33.695 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T13:31:34.596 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T13:31:34.621 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T13:31:34.621 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:34.621 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T13:31:34.621 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:31:34.622 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:31:34.622 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:31:34.855 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T13:31:34.877 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T13:31:34.877 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:34.877 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T13:31:34.877 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:31:34.878 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:31:34.878 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:31:35.339 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T13:31:35.361 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T13:31:35.361 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:35.361 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T13:31:35.361 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:31:35.362 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:31:35.362 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:31:35.439 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T13:31:35.439 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /sys 2024-04-25T13:31:35.439 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /proc 2024-04-25T13:31:35.439 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /mnt 2024-04-25T13:31:35.439 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /var/tmp 2024-04-25T13:31:35.439 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /home 2024-04-25T13:31:35.439 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /root 2024-04-25T13:31:35.440 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /tmp 2024-04-25T13:31:35.440 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:31:35.469 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T13:31:35.527 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T13:31:35.581 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T13:31:35.613 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T13:31:35.628 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T13:31:35.628 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:35.628 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T13:31:35.628 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:31:35.768 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T13:31:35.814 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T13:31:35.893 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T13:31:35.931 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T13:31:35.974 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T13:31:35.981 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:31:36.120 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:31:36.165 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T13:31:36.197 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T13:31:36.232 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T13:31:36.527 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T13:31:36.577 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T13:31:36.666 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T13:31:36.667 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T13:31:36.667 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T13:31:36.667 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:31:36.695 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T13:31:36.735 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T13:31:36.765 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T13:31:36.788 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T13:31:36.842 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T13:31:36.871 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T13:31:37.258 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T13:31:37.286 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T13:31:37.286 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:37.286 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T13:31:37.286 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:31:37.286 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:31:37.286 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:31:37.526 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T13:31:37.550 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T13:31:37.550 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:37.551 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T13:31:37.551 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:31:37.551 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:31:37.551 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:31:37.916 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T13:31:37.948 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T13:31:38.035 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T13:31:38.059 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T13:31:38.059 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:38.059 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T13:31:38.059 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:31:38.059 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:31:38.060 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:31:38.166 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T13:31:38.224 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T13:31:38.288 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T13:31:38.482 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T13:31:38.537 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T13:31:38.610 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T13:31:38.708 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:31:38.849 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:31:38.895 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T13:31:38.913 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T13:31:38.927 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T13:31:38.940 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T13:31:38.954 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T13:31:39.040 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T13:31:39.206 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T13:31:39.259 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T13:31:39.281 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T13:31:39.281 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:39.281 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T13:31:39.281 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:31:39.281 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:31:39.281 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:31:39.326 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T13:31:39.337 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T13:31:39.350 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T13:31:39.389 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T13:31:39.427 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T13:31:39.436 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T13:31:39.491 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T13:31:39.491 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T13:31:39.526 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T13:31:40.426 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T13:31:40.462 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T13:31:40.484 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T13:31:40.485 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:40.485 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T13:31:40.485 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:31:40.485 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:31:40.485 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:31:40.529 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T13:31:40.551 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T13:31:40.551 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:40.551 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T13:31:40.551 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:31:40.596 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T13:31:40.619 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T13:31:40.619 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:40.619 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T13:31:40.619 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:31:40.619 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:31:40.619 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:31:40.620 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T13:31:40.661 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T13:31:40.930 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T13:31:40.953 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T13:31:40.953 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:40.953 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T13:31:40.953 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:31:40.953 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:31:40.954 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:31:41.675 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T13:31:41.703 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T13:31:41.810 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T13:31:41.986 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T13:31:42.014 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T13:31:42.037 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T13:31:42.037 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:42.037 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T13:31:42.037 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:31:42.038 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:31:42.038 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:31:42.089 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T13:31:42.101 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T13:31:42.203 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T13:31:42.256 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T13:31:43.241 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T13:31:43.268 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T13:31:43.292 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T13:31:43.293 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:43.293 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T13:31:43.293 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:31:43.293 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:31:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:31:43.334 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T13:31:43.357 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T13:31:43.358 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:43.358 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T13:31:43.358 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:31:43.410 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T13:31:43.433 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T13:31:43.433 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:43.433 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T13:31:43.433 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:31:43.433 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:31:43.434 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:31:43.760 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T13:31:43.785 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T13:31:43.785 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:43.785 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T13:31:43.785 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:31:43.785 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:31:43.785 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:31:45.226 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T13:31:45.276 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T13:31:45.316 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T13:31:45.348 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T13:31:45.375 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T13:31:45.561 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T13:31:45.597 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T13:31:45.635 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T13:31:46.258 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:31:46.291 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:31:46.311 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:31:47.149 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T13:31:47.238 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T13:31:47.278 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T13:31:47.362 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T13:31:47.391 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T13:31:47.392 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:31:47.467 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:31:47.500 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:31:47.500 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:31:47.574 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:31:47.640 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:31:48.119 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T13:31:48.119 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2024-04-25T13:31:48.119 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2024-04-25T13:31:48.119 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2024-04-25T13:31:48.119 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2024-04-25T13:31:48.119 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2024-04-25T13:31:48.119 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /root 2024-04-25T13:31:48.119 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2024-04-25T13:31:48.119 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:31:48.288 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T13:31:48.290 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T13:31:48.304 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T13:31:48.304 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:48.304 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T13:31:48.304 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:31:48.332 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T13:31:48.372 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T13:31:48.404 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T13:31:48.431 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T13:31:48.623 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T13:31:48.669 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T13:31:48.699 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T13:31:49.354 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:31:49.397 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:31:49.418 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:31:49.874 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T13:31:49.900 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T13:31:49.900 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:49.901 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T13:31:49.901 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:31:49.901 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:31:49.901 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:31:50.125 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T13:31:50.148 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T13:31:50.148 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:50.148 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T13:31:50.148 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:31:50.148 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:31:50.148 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:31:50.321 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T13:31:50.418 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T13:31:50.460 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T13:31:50.543 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T13:31:50.573 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T13:31:50.573 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:31:50.609 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T13:31:50.632 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T13:31:50.632 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:50.632 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T13:31:50.633 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:31:50.633 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:31:50.633 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:31:50.658 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:31:50.689 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:31:50.690 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:31:50.731 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T13:31:50.768 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:31:50.787 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T13:31:50.841 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:31:50.842 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T13:31:51.027 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T13:31:51.076 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T13:31:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T13:31:51.233 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:31:51.367 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:31:51.418 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T13:31:51.450 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T13:31:51.478 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T13:31:51.847 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T13:31:51.868 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T13:31:51.891 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T13:31:51.953 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T13:31:51.982 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T13:31:53.014 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T13:31:53.051 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T13:31:53.566 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:31:53.566 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T13:31:53.566 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T13:31:53.566 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T13:31:53.566 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T13:31:53.566 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T13:31:53.566 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T13:31:53.566 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T13:31:53.566 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T13:31:53.567 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T13:31:53.567 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T13:31:53.567 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T13:31:53.567 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T13:31:53.567 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T13:31:53.567 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T13:31:53.567 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T13:31:53.567 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T13:31:53.567 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T13:31:53.567 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T13:31:53.567 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T13:31:53.567 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T13:31:53.567 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T13:31:53.567 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T13:31:53.568 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T13:31:53.568 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T13:31:53.568 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T13:31:53.568 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T13:31:53.568 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T13:31:53.568 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T13:31:53.568 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T13:31:53.568 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T13:31:53.568 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T13:31:53.568 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T13:31:53.568 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T13:31:53.568 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T13:31:53.568 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T13:31:53.569 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T13:31:53.569 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T13:31:53.569 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T13:31:53.569 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T13:31:53.569 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T13:31:53.569 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T13:31:53.569 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T13:31:53.569 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T13:31:53.569 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T13:31:53.569 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T13:31:53.569 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T13:31:53.569 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T13:31:53.569 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T13:31:53.570 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T13:31:53.570 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T13:31:53.570 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T13:31:53.570 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T13:31:53.570 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T13:31:53.570 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T13:31:53.570 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T13:31:53.570 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T13:31:53.570 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T13:31:53.570 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T13:31:53.571 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T13:31:53.571 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T13:31:53.571 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T13:31:53.571 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T13:31:53.571 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T13:31:53.571 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T13:31:53.571 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T13:31:53.571 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T13:31:53.571 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T13:31:53.571 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T13:31:53.572 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T13:31:53.572 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T13:31:53.572 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T13:31:53.572 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T13:31:53.572 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T13:31:53.572 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T13:31:53.572 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T13:31:53.572 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T13:31:53.572 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T13:31:53.572 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T13:31:53.572 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T13:31:53.572 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T13:31:53.572 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T13:31:53.573 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T13:31:53.573 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T13:31:53.573 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T13:31:53.573 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T13:31:53.573 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T13:31:53.573 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T13:31:53.573 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T13:31:53.573 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T13:31:53.573 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T13:31:53.573 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T13:31:53.573 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T13:31:53.573 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T13:31:53.573 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T13:31:53.574 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T13:31:53.574 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T13:31:53.574 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T13:31:53.574 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T13:31:53.574 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T13:31:53.574 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T13:31:53.574 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T13:31:53.574 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T13:31:53.574 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T13:31:53.574 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T13:31:53.574 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T13:31:53.574 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T13:31:53.574 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T13:31:53.575 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T13:31:53.575 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T13:31:53.575 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T13:31:53.575 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T13:31:53.575 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T13:31:53.575 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T13:31:53.575 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T13:31:53.575 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T13:31:53.575 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T13:31:53.575 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T13:31:53.575 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:31:53.575 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:31:53.575 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T13:31:53.575 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T13:31:53.576 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T13:31:53.576 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T13:31:53.576 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T13:31:53.576 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T13:31:53.576 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T13:31:53.576 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T13:31:53.576 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T13:31:53.576 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T13:31:53.576 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T13:31:53.576 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T13:31:53.576 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T13:31:53.576 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T13:31:53.576 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T13:31:53.576 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T13:31:53.577 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T13:31:53.577 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T13:31:53.577 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T13:31:53.577 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T13:31:53.577 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T13:31:53.577 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T13:31:53.577 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T13:31:53.577 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T13:31:53.577 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T13:31:53.577 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T13:31:53.577 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T13:31:53.577 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T13:31:53.577 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T13:31:53.577 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T13:31:53.578 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T13:31:53.578 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T13:31:53.578 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T13:31:53.578 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T13:31:53.578 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:31:53.578 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T13:31:54.015 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T13:31:54.034 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T13:31:54.135 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T13:31:54.300 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T13:31:54.328 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T13:31:54.351 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T13:31:54.351 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:54.351 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T13:31:54.351 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:31:54.351 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:31:54.352 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:31:54.395 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T13:31:54.406 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T13:31:54.505 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T13:31:54.551 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T13:31:55.486 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T13:31:55.514 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T13:31:55.537 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T13:31:55.537 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:55.537 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T13:31:55.537 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:31:55.537 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:31:55.537 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:31:55.581 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T13:31:55.603 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T13:31:55.603 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:55.603 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T13:31:55.603 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:31:55.623 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:31:55.624 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:31:55.624 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2024-04-25T13:31:55.624 INFO:teuthology.orchestra.run.smithi161.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.624 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.624 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T13:31:55.624 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T13:31:55.624 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-04-25T13:31:55.624 INFO:teuthology.orchestra.run.smithi161.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T13:31:55.624 INFO:teuthology.orchestra.run.smithi161.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T13:31:55.624 INFO:teuthology.orchestra.run.smithi161.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T13:31:55.624 INFO:teuthology.orchestra.run.smithi161.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T13:31:55.624 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.624 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.625 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.625 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.625 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:55.625 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.625 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.625 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.625 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:55.625 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:55.625 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:55.625 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:55.625 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:55.625 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.626 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.626 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:55.626 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.626 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.626 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.626 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:55.626 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:55.626 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.626 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.626 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:55.626 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T13:31:55.626 INFO:teuthology.orchestra.run.smithi161.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T13:31:55.627 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T13:31:55.627 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T13:31:55.627 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T13:31:55.627 INFO:teuthology.orchestra.run.smithi161.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T13:31:55.627 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T13:31:55.627 INFO:teuthology.orchestra.run.smithi161.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T13:31:55.627 INFO:teuthology.orchestra.run.smithi161.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T13:31:55.627 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T13:31:55.627 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T13:31:55.627 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.627 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.627 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.627 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T13:31:55.627 INFO:teuthology.orchestra.run.smithi161.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T13:31:55.628 INFO:teuthology.orchestra.run.smithi161.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T13:31:55.628 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T13:31:55.628 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T13:31:55.628 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.628 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.628 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T13:31:55.628 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.628 INFO:teuthology.orchestra.run.smithi161.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T13:31:55.628 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T13:31:55.628 INFO:teuthology.orchestra.run.smithi161.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T13:31:55.628 INFO:teuthology.orchestra.run.smithi161.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T13:31:55.628 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T13:31:55.629 INFO:teuthology.orchestra.run.smithi161.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T13:31:55.629 INFO:teuthology.orchestra.run.smithi161.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T13:31:55.629 INFO:teuthology.orchestra.run.smithi161.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T13:31:55.629 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T13:31:55.629 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T13:31:55.629 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T13:31:55.629 INFO:teuthology.orchestra.run.smithi161.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T13:31:55.629 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T13:31:55.629 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T13:31:55.629 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T13:31:55.630 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T13:31:55.630 INFO:teuthology.orchestra.run.smithi161.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T13:31:55.630 INFO:teuthology.orchestra.run.smithi161.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T13:31:55.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T13:31:55.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T13:31:55.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T13:31:55.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T13:31:55.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T13:31:55.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.631 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.631 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T13:31:55.631 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T13:31:55.631 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T13:31:55.631 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T13:31:55.631 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T13:31:55.631 INFO:teuthology.orchestra.run.smithi161.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T13:31:55.631 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T13:31:55.631 INFO:teuthology.orchestra.run.smithi161.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T13:31:55.631 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T13:31:55.631 INFO:teuthology.orchestra.run.smithi161.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T13:31:55.631 INFO:teuthology.orchestra.run.smithi161.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T13:31:55.631 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T13:31:55.631 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T13:31:55.632 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T13:31:55.632 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T13:31:55.632 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T13:31:55.632 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T13:31:55.632 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T13:31:55.632 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T13:31:55.632 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T13:31:55.632 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T13:31:55.632 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T13:31:55.632 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T13:31:55.632 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T13:31:55.632 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T13:31:55.632 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T13:31:55.633 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T13:31:55.633 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T13:31:55.633 INFO:teuthology.orchestra.run.smithi161.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T13:31:55.633 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T13:31:55.633 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T13:31:55.633 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T13:31:55.633 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T13:31:55.633 INFO:teuthology.orchestra.run.smithi161.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T13:31:55.633 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T13:31:55.633 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T13:31:55.633 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T13:31:55.633 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T13:31:55.633 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T13:31:55.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T13:31:55.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T13:31:55.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T13:31:55.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T13:31:55.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T13:31:55.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T13:31:55.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T13:31:55.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T13:31:55.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T13:31:55.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T13:31:55.635 INFO:teuthology.orchestra.run.smithi161.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T13:31:55.635 INFO:teuthology.orchestra.run.smithi161.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T13:31:55.635 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T13:31:55.635 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T13:31:55.635 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T13:31:55.635 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T13:31:55.635 INFO:teuthology.orchestra.run.smithi161.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T13:31:55.635 INFO:teuthology.orchestra.run.smithi161.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T13:31:55.635 INFO:teuthology.orchestra.run.smithi161.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T13:31:55.635 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.635 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.635 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:55.635 INFO:teuthology.orchestra.run.smithi161.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T13:31:55.636 INFO:teuthology.orchestra.run.smithi161.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T13:31:55.636 INFO:teuthology.orchestra.run.smithi161.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T13:31:55.636 INFO:teuthology.orchestra.run.smithi161.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T13:31:55.636 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T13:31:55.636 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T13:31:55.637 INFO:teuthology.orchestra.run.smithi161.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T13:31:55.637 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-04-25T13:31:55.637 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-04-25T13:31:55.648 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T13:31:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T13:31:55.671 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:55.671 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T13:31:55.671 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:31:55.671 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:31:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:31:55.982 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T13:31:56.005 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T13:31:56.005 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:31:56.005 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T13:31:56.005 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:31:56.006 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:31:56.006 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:31:56.019 DEBUG:teuthology.parallel:result is None 2024-04-25T13:31:56.572 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:31:56.573 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T13:31:56.573 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T13:31:56.573 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T13:31:56.573 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T13:31:56.573 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T13:31:56.573 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T13:31:56.573 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T13:31:56.573 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T13:31:56.573 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T13:31:56.573 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T13:31:56.573 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T13:31:56.573 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T13:31:56.574 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T13:31:56.574 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T13:31:56.574 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T13:31:56.574 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T13:31:56.574 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T13:31:56.574 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T13:31:56.574 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T13:31:56.574 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T13:31:56.574 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T13:31:56.574 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T13:31:56.574 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T13:31:56.574 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T13:31:56.574 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T13:31:56.575 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T13:31:56.575 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T13:31:56.586 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T13:31:56.586 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T13:31:56.586 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T13:31:56.586 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T13:31:56.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T13:31:56.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T13:31:56.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T13:31:56.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T13:31:56.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T13:31:56.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T13:31:56.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T13:31:56.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T13:31:56.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T13:31:56.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T13:31:56.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T13:31:56.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T13:31:56.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T13:31:56.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T13:31:56.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T13:31:56.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T13:31:56.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T13:31:56.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T13:31:56.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T13:31:56.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T13:31:56.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T13:31:56.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T13:31:56.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T13:31:56.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T13:31:56.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T13:31:56.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T13:31:56.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T13:31:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T13:31:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T13:31:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T13:31:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T13:31:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T13:31:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T13:31:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T13:31:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T13:31:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T13:31:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T13:31:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T13:31:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T13:31:56.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T13:31:56.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T13:31:56.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T13:31:56.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T13:31:56.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T13:31:56.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T13:31:56.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T13:31:56.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T13:31:56.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T13:31:56.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T13:31:56.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T13:31:56.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T13:31:56.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T13:31:56.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T13:31:56.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T13:31:56.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T13:31:56.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T13:31:56.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T13:31:56.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T13:31:56.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T13:31:56.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T13:31:56.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T13:31:56.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T13:31:56.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T13:31:56.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T13:31:56.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T13:31:56.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T13:31:56.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T13:31:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T13:31:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T13:31:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T13:31:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T13:31:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T13:31:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T13:31:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T13:31:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T13:31:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T13:31:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T13:31:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T13:31:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T13:31:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T13:31:56.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T13:31:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T13:31:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T13:31:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T13:31:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T13:31:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T13:31:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:31:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:31:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T13:31:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T13:31:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T13:31:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T13:31:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T13:31:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T13:31:56.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T13:31:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T13:31:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T13:31:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T13:31:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T13:31:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T13:31:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T13:31:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T13:31:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T13:31:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T13:31:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T13:31:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T13:31:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T13:31:56.594 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T13:31:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T13:31:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T13:31:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T13:31:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T13:31:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T13:31:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T13:31:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T13:31:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T13:31:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T13:31:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T13:31:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T13:31:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T13:31:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T13:31:56.595 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T13:31:56.596 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:31:56.596 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T13:31:58.674 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:31:58.674 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:31:58.674 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2024-04-25T13:31:58.674 INFO:teuthology.orchestra.run.smithi043.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.675 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.675 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T13:31:58.675 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T13:31:58.675 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-04-25T13:31:58.675 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T13:31:58.675 INFO:teuthology.orchestra.run.smithi043.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T13:31:58.675 INFO:teuthology.orchestra.run.smithi043.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T13:31:58.675 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T13:31:58.675 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.675 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.675 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.675 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.676 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:58.676 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.676 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.676 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.676 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:58.676 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:58.676 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:58.676 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:58.676 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:58.676 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.676 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.676 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:58.676 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.677 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.677 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.677 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:58.677 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:58.677 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.677 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.677 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:31:58.677 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T13:31:58.677 INFO:teuthology.orchestra.run.smithi043.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T13:31:58.677 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T13:31:58.677 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T13:31:58.677 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T13:31:58.678 INFO:teuthology.orchestra.run.smithi043.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T13:31:58.678 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T13:31:58.678 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T13:31:58.678 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T13:31:58.678 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T13:31:58.678 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T13:31:58.678 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.678 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.678 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.678 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T13:31:58.678 INFO:teuthology.orchestra.run.smithi043.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T13:31:58.678 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T13:31:58.679 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T13:31:58.679 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T13:31:58.679 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.679 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.679 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T13:31:58.679 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.679 INFO:teuthology.orchestra.run.smithi043.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T13:31:58.679 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T13:31:58.679 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T13:31:58.679 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T13:31:58.679 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T13:31:58.679 INFO:teuthology.orchestra.run.smithi043.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T13:31:58.680 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T13:31:58.680 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T13:31:58.680 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T13:31:58.680 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T13:31:58.680 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T13:31:58.680 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T13:31:58.680 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T13:31:58.680 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T13:31:58.680 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T13:31:58.680 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T13:31:58.680 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T13:31:58.681 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T13:31:58.681 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T13:31:58.681 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T13:31:58.681 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T13:31:58.681 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T13:31:58.681 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T13:31:58.681 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.681 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.681 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.682 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T13:31:58.682 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T13:31:58.682 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T13:31:58.682 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T13:31:58.682 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T13:31:58.682 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T13:31:58.682 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T13:31:58.682 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T13:31:58.682 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T13:31:58.682 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T13:31:58.682 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T13:31:58.683 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T13:31:58.683 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T13:31:58.683 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T13:31:58.683 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T13:31:58.683 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T13:31:58.683 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T13:31:58.683 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T13:31:58.683 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T13:31:58.683 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T13:31:58.684 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T13:31:58.684 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T13:31:58.684 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T13:31:58.684 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T13:31:58.684 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T13:31:58.684 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T13:31:58.684 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T13:31:58.684 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T13:31:58.684 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T13:31:58.684 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T13:31:58.684 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T13:31:58.684 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T13:31:58.684 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T13:31:58.685 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T13:31:58.685 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T13:31:58.685 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T13:31:58.685 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T13:31:58.685 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T13:31:58.685 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T13:31:58.685 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T13:31:58.685 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.686 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.686 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T13:31:58.686 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T13:31:58.686 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T13:31:58.686 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.686 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T13:31:58.686 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T13:31:58.687 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T13:31:58.687 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T13:31:58.687 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T13:31:58.687 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T13:31:58.687 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T13:31:58.687 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T13:31:58.687 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T13:31:58.687 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T13:31:58.687 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T13:31:58.687 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T13:31:58.687 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T13:31:58.687 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T13:31:58.688 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T13:31:58.688 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.688 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.688 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:31:58.688 INFO:teuthology.orchestra.run.smithi043.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T13:31:58.688 INFO:teuthology.orchestra.run.smithi043.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T13:31:58.688 INFO:teuthology.orchestra.run.smithi043.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T13:31:58.688 INFO:teuthology.orchestra.run.smithi043.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T13:31:58.688 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T13:31:58.688 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T13:31:58.689 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T13:31:58.689 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:31:58.689 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-04-25T13:31:59.115 DEBUG:teuthology.parallel:result is None 2024-04-25T13:32:00.261 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T13:32:00.302 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T13:32:00.343 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T13:32:00.374 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T13:32:00.402 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T13:32:00.585 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T13:32:00.631 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T13:32:00.661 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T13:32:01.267 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:32:01.317 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:32:01.337 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:32:02.160 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T13:32:02.246 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T13:32:02.287 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T13:32:02.370 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T13:32:02.408 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T13:32:02.408 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:32:02.492 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:32:02.525 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:32:02.525 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:32:02.620 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:32:02.699 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:32:08.578 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:32:08.578 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T13:32:08.578 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T13:32:08.578 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T13:32:08.578 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T13:32:08.578 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T13:32:08.578 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T13:32:08.578 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T13:32:08.579 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T13:32:08.579 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T13:32:08.579 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T13:32:08.579 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T13:32:08.579 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T13:32:08.579 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T13:32:08.579 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T13:32:08.579 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T13:32:08.579 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T13:32:08.579 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T13:32:08.579 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T13:32:08.579 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T13:32:08.579 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T13:32:08.579 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T13:32:08.580 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T13:32:08.580 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T13:32:08.580 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T13:32:08.580 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T13:32:08.580 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T13:32:08.580 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T13:32:08.580 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T13:32:08.580 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T13:32:08.580 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T13:32:08.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T13:32:08.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T13:32:08.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T13:32:08.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T13:32:08.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T13:32:08.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T13:32:08.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T13:32:08.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T13:32:08.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T13:32:08.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T13:32:08.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T13:32:08.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T13:32:08.592 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T13:32:08.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T13:32:08.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T13:32:08.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T13:32:08.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T13:32:08.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T13:32:08.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T13:32:08.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T13:32:08.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T13:32:08.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T13:32:08.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T13:32:08.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T13:32:08.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T13:32:08.593 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T13:32:08.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T13:32:08.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T13:32:08.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T13:32:08.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T13:32:08.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T13:32:08.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T13:32:08.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T13:32:08.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T13:32:08.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T13:32:08.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T13:32:08.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T13:32:08.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T13:32:08.594 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T13:32:08.595 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T13:32:08.595 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T13:32:08.595 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T13:32:08.595 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T13:32:08.595 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T13:32:08.595 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T13:32:08.595 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T13:32:08.595 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T13:32:08.595 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T13:32:08.595 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T13:32:08.595 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T13:32:08.595 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T13:32:08.595 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T13:32:08.596 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T13:32:08.596 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T13:32:08.596 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T13:32:08.596 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T13:32:08.596 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T13:32:08.596 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T13:32:08.596 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T13:32:08.596 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T13:32:08.596 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T13:32:08.596 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T13:32:08.596 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T13:32:08.596 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T13:32:08.596 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T13:32:08.597 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T13:32:08.597 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T13:32:08.597 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T13:32:08.597 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T13:32:08.597 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T13:32:08.597 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T13:32:08.597 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T13:32:08.597 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T13:32:08.597 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T13:32:08.597 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T13:32:08.598 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T13:32:08.598 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T13:32:08.598 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T13:32:08.598 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T13:32:08.598 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T13:32:08.598 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T13:32:08.598 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T13:32:08.598 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T13:32:08.598 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T13:32:08.598 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T13:32:08.598 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T13:32:08.598 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T13:32:08.598 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:32:08.598 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:32:08.599 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T13:32:08.599 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T13:32:08.599 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T13:32:08.599 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T13:32:08.599 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T13:32:08.599 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T13:32:08.599 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T13:32:08.599 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T13:32:08.599 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T13:32:08.599 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T13:32:08.599 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T13:32:08.599 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T13:32:08.599 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T13:32:08.600 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T13:32:08.600 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T13:32:08.600 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T13:32:08.600 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T13:32:08.600 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T13:32:08.600 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T13:32:08.600 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T13:32:08.600 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T13:32:08.600 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T13:32:08.600 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T13:32:08.600 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T13:32:08.600 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T13:32:08.600 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T13:32:08.600 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T13:32:08.601 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T13:32:08.601 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T13:32:08.601 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T13:32:08.601 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T13:32:08.601 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T13:32:08.601 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T13:32:08.601 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T13:32:08.601 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:32:08.601 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T13:32:10.705 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:32:10.706 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:32:10.706 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2024-04-25T13:32:10.706 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.706 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.706 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T13:32:10.706 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T13:32:10.706 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-04-25T13:32:10.706 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T13:32:10.706 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T13:32:10.707 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T13:32:10.707 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T13:32:10.707 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.707 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.707 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.707 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.707 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:32:10.707 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.707 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.707 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.707 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:32:10.707 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:32:10.707 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:32:10.708 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:32:10.708 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:32:10.708 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.708 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.708 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:32:10.708 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.708 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.708 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.708 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:32:10.708 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:32:10.708 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.708 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.708 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T13:32:10.709 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T13:32:10.709 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T13:32:10.709 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T13:32:10.709 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T13:32:10.709 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T13:32:10.709 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T13:32:10.709 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T13:32:10.709 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T13:32:10.709 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T13:32:10.709 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T13:32:10.709 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T13:32:10.709 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.709 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.710 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.710 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T13:32:10.710 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T13:32:10.710 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T13:32:10.710 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T13:32:10.710 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T13:32:10.710 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.710 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.710 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T13:32:10.710 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.710 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T13:32:10.710 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T13:32:10.710 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T13:32:10.710 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T13:32:10.711 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T13:32:10.711 INFO:teuthology.orchestra.run.smithi175.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T13:32:10.711 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T13:32:10.711 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T13:32:10.711 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T13:32:10.711 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T13:32:10.711 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T13:32:10.711 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T13:32:10.711 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T13:32:10.711 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T13:32:10.711 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T13:32:10.711 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T13:32:10.711 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T13:32:10.711 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T13:32:10.711 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T13:32:10.712 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T13:32:10.712 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T13:32:10.712 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T13:32:10.712 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T13:32:10.712 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.712 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.712 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.712 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T13:32:10.712 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T13:32:10.712 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T13:32:10.712 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T13:32:10.712 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T13:32:10.712 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T13:32:10.712 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T13:32:10.712 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T13:32:10.713 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T13:32:10.713 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T13:32:10.713 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T13:32:10.713 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T13:32:10.713 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T13:32:10.713 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T13:32:10.713 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T13:32:10.713 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T13:32:10.713 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T13:32:10.713 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T13:32:10.713 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T13:32:10.713 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T13:32:10.713 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T13:32:10.713 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T13:32:10.714 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T13:32:10.714 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T13:32:10.714 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T13:32:10.714 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T13:32:10.714 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T13:32:10.714 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T13:32:10.714 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T13:32:10.714 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T13:32:10.714 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T13:32:10.714 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T13:32:10.714 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T13:32:10.714 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T13:32:10.714 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T13:32:10.714 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T13:32:10.715 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T13:32:10.715 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T13:32:10.715 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T13:32:10.715 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T13:32:10.715 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.715 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.715 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T13:32:10.715 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T13:32:10.715 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T13:32:10.715 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.715 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T13:32:10.715 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T13:32:10.715 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T13:32:10.716 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T13:32:10.716 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T13:32:10.716 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T13:32:10.716 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T13:32:10.716 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T13:32:10.716 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T13:32:10.716 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T13:32:10.716 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T13:32:10.716 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T13:32:10.716 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T13:32:10.716 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T13:32:10.716 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T13:32:10.717 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.717 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.717 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T13:32:10.717 INFO:teuthology.orchestra.run.smithi175.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T13:32:10.717 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T13:32:10.717 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T13:32:10.717 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T13:32:10.717 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T13:32:10.717 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T13:32:10.717 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T13:32:10.717 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:32:10.717 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-04-25T13:32:11.081 DEBUG:teuthology.parallel:result is None 2024-04-25T13:32:11.082 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:32:11.228 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T13:32:11.255 INFO:teuthology.orchestra.run.smithi043.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T13:32:11.255 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T13:32:11.255 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T13:32:11.257 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:32:11.473 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T13:32:11.500 INFO:teuthology.orchestra.run.smithi161.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T13:32:11.500 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T13:32:11.500 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T13:32:11.502 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:32:11.719 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T13:32:11.740 INFO:teuthology.orchestra.run.smithi175.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T13:32:11.741 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T13:32:11.741 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T13:32:11.744 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T13:32:11.744 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:32:11.745 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T13:32:11.777 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-04-25T13:32:11.778 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T13:32:11.808 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T13:32:11.808 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T13:32:11.835 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T13:32:11.836 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:32:11.836 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T13:32:11.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T13:32:11.936 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-04-25T13:32:11.937 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T13:32:11.964 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T13:32:12.032 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T13:32:12.032 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T13:32:12.057 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T13:32:12.120 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T13:32:12.121 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:32:12.121 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T13:32:12.150 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T13:32:12.220 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-04-25T13:32:12.220 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T13:32:12.249 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T13:32:12.315 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T13:32:12.315 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T13:32:12.338 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T13:32:12.401 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T13:32:12.402 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:32:12.402 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T13:32:12.433 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T13:32:12.501 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-04-25T13:32:12.501 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T13:32:12.525 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T13:32:12.589 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T13:32:12.589 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T13:32:12.612 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T13:32:12.677 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-25T13:32:12.786 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-04-25T13:32:12.787 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:32:12.787 INFO:tasks.cephadm:Cluster fsid is 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:32:12.787 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-25T13:32:12.787 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.43', 'mon.b': '172.21.15.161', 'mon.c': '172.21.15.175'} 2024-04-25T13:32:12.787 INFO:tasks.cephadm:First mon is mon.a on smithi043 2024-04-25T13:32:12.788 INFO:tasks.cephadm:First mgr is x 2024-04-25T13:32:12.788 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-25T13:32:12.788 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname $(hostname -s) 2024-04-25T13:32:12.813 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname $(hostname -s) 2024-04-25T13:32:12.837 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname $(hostname -s) 2024-04-25T13:32:12.863 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-25T13:32:12.863 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:32:13.105 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78872/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3291-g994e2f20', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3291.g994e2f20'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-25 04:02:18.990013', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240425.015853-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-04-25T13:32:13.324 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-pdonnell-testing-20240425.015853-debug, sha1 994e2f20102a20fa9a27966c14b625cc01884df8 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:32:13.325 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/x86_64/flavors/default/cephadm 2024-04-25T13:32:13.325 DEBUG:teuthology.orchestra.run.smithi043:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-25T13:32:14.226 INFO:teuthology.orchestra.run.smithi043.stdout:-rw-r--r--. 1 ubuntu ubuntu 781647 Apr 25 13:32 /home/ubuntu/cephtest/cephadm 2024-04-25T13:32:14.227 DEBUG:teuthology.orchestra.run.smithi161:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-25T13:32:14.919 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r--. 1 ubuntu ubuntu 781647 Apr 25 13:32 /home/ubuntu/cephtest/cephadm 2024-04-25T13:32:14.919 DEBUG:teuthology.orchestra.run.smithi175:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-25T13:32:15.678 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r--. 1 ubuntu ubuntu 781647 Apr 25 13:32 /home/ubuntu/cephtest/cephadm 2024-04-25T13:32:15.678 DEBUG:teuthology.orchestra.run.smithi043:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-25T13:32:15.699 DEBUG:teuthology.orchestra.run.smithi161:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-25T13:32:15.718 DEBUG:teuthology.orchestra.run.smithi175:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-25T13:32:15.752 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 on all hosts... 2024-04-25T13:32:15.753 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 pull 2024-04-25T13:32:15.755 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 pull 2024-04-25T13:32:15.761 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 pull 2024-04-25T13:32:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8... 2024-04-25T13:32:17.328 INFO:teuthology.orchestra.run.smithi161.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8... 2024-04-25T13:32:17.471 INFO:teuthology.orchestra.run.smithi175.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8... 2024-04-25T13:33:42.397 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T13:33:42.398 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T13:33:42.398 INFO:teuthology.orchestra.run.smithi175.stdout: "image_id": "d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4", 2024-04-25T13:33:42.398 INFO:teuthology.orchestra.run.smithi175.stdout: "repo_digests": [ 2024-04-25T13:33:42.398 INFO:teuthology.orchestra.run.smithi175.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385" 2024-04-25T13:33:42.398 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-25T13:33:42.398 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T13:33:47.760 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T13:33:47.760 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T13:33:47.760 INFO:teuthology.orchestra.run.smithi043.stdout: "image_id": "d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4", 2024-04-25T13:33:47.760 INFO:teuthology.orchestra.run.smithi043.stdout: "repo_digests": [ 2024-04-25T13:33:47.760 INFO:teuthology.orchestra.run.smithi043.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385" 2024-04-25T13:33:47.761 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T13:33:47.761 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T13:33:48.126 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-04-25T13:33:48.126 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T13:33:48.126 INFO:teuthology.orchestra.run.smithi161.stdout: "image_id": "d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4", 2024-04-25T13:33:48.126 INFO:teuthology.orchestra.run.smithi161.stdout: "repo_digests": [ 2024-04-25T13:33:48.127 INFO:teuthology.orchestra.run.smithi161.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385" 2024-04-25T13:33:48.127 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-04-25T13:33:48.127 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-04-25T13:33:48.153 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph 2024-04-25T13:33:48.182 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph 2024-04-25T13:33:48.210 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph 2024-04-25T13:33:48.242 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /etc/ceph 2024-04-25T13:33:48.268 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /etc/ceph 2024-04-25T13:33:48.292 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /etc/ceph 2024-04-25T13:33:48.319 INFO:tasks.cephadm:Writing seed config... 2024-04-25T13:33:48.320 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-25T13:33:48.320 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-25T13:33:48.320 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-25T13:33:48.320 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-25T13:33:48.320 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-25T13:33:48.320 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-25T13:33:48.321 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-25T13:33:48.321 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-25T13:33:48.321 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-04-25T13:33:48.321 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-04-25T13:33:48.321 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-04-25T13:33:48.321 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-04-25T13:33:48.321 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-25T13:33:48.321 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-25T13:33:48.321 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-25T13:33:48.321 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-25T13:33:48.321 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-04-25T13:33:48.321 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-04-25T13:33:48.321 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-25T13:33:48.321 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-25T13:33:48.322 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-25T13:33:48.322 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-04-25T13:33:48.322 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-04-25T13:33:48.322 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-25T13:33:48.322 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-25T13:33:48.322 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-25T13:33:48.322 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-25T13:33:48.322 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-25T13:33:48.322 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-25T13:33:48.322 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-25T13:33:48.322 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-25T13:33:48.322 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-25T13:33:48.322 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-25T13:33:48.322 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-04-25T13:33:48.322 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-04-25T13:33:48.323 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-25T13:33:48.323 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-25T13:33:48.323 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-04-25T13:33:48.323 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-25T13:33:48.323 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-25T13:33:48.323 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-25T13:33:48.323 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-25T13:33:48.323 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-25T13:33:48.323 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-25T13:33:48.323 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-25T13:33:48.323 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-04-25T13:33:48.324 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:33:48.324 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-25T13:33:48.340 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 394efb6c-0308-11ef-bc93-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-25T13:33:48.340 DEBUG:teuthology.orchestra.run.smithi043:mon.a> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mon.a.service 2024-04-25T13:33:48.383 DEBUG:teuthology.orchestra.run.smithi043:mgr.x> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mgr.x.service 2024-04-25T13:33:48.425 INFO:tasks.cephadm:Bootstrapping... 2024-04-25T13:33:48.425 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 -v bootstrap --fsid 394efb6c-0308-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.43 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-25T13:33:48.620 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:33:48.620 INFO:teuthology.orchestra.run.smithi043.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8', '-v', 'bootstrap', '--fsid', '394efb6c-0308-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.43', '--skip-admin-label'] 2024-04-25T13:33:48.621 INFO:teuthology.orchestra.run.smithi043.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-25T13:33:48.621 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying podman|docker is present... 2024-04-25T13:33:48.645 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-25T13:33:48.646 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying lvm2 is present... 2024-04-25T13:33:48.646 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying time synchronization is in place... 2024-04-25T13:33:48.653 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-25T13:33:48.653 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-25T13:33:48.659 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-25T13:33:48.659 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-04-25T13:33:48.666 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout enabled 2024-04-25T13:33:48.672 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout active 2024-04-25T13:33:48.672 INFO:teuthology.orchestra.run.smithi043.stdout:Unit chronyd.service is enabled and running 2024-04-25T13:33:48.672 INFO:teuthology.orchestra.run.smithi043.stdout:Repeating the final host check... 2024-04-25T13:33:48.696 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-25T13:33:48.696 INFO:teuthology.orchestra.run.smithi043.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-25T13:33:48.696 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl is present 2024-04-25T13:33:48.696 INFO:teuthology.orchestra.run.smithi043.stdout:lvcreate is present 2024-04-25T13:33:48.702 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-25T13:33:48.702 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-25T13:33:48.708 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-25T13:33:48.708 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-04-25T13:33:48.715 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout enabled 2024-04-25T13:33:48.722 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout active 2024-04-25T13:33:48.722 INFO:teuthology.orchestra.run.smithi043.stdout:Unit chronyd.service is enabled and running 2024-04-25T13:33:48.722 INFO:teuthology.orchestra.run.smithi043.stdout:Host looks OK 2024-04-25T13:33:48.722 INFO:teuthology.orchestra.run.smithi043.stdout:Cluster fsid: 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:33:48.722 INFO:teuthology.orchestra.run.smithi043.stdout:Acquiring lock 139731915869344 on /run/cephadm/394efb6c-0308-11ef-bc93-c7b262605968.lock 2024-04-25T13:33:48.722 INFO:teuthology.orchestra.run.smithi043.stdout:Lock 139731915869344 acquired on /run/cephadm/394efb6c-0308-11ef-bc93-c7b262605968.lock 2024-04-25T13:33:48.723 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying IP 172.21.15.43 port 3300 ... 2024-04-25T13:33:48.723 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying IP 172.21.15.43 port 6789 ... 2024-04-25T13:33:48.723 INFO:teuthology.orchestra.run.smithi043.stdout:Base mon IP(s) is [172.21.15.43:3300, 172.21.15.43:6789], mon addrv is [v2:172.21.15.43:3300,v1:172.21.15.43:6789] 2024-04-25T13:33:48.726 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.43 metric 100 2024-04-25T13:33:48.726 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.43 metric 100 2024-04-25T13:33:48.729 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-25T13:33:48.729 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-04-25T13:33:48.729 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-04-25T13:33:48.731 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-25T13:33:48.732 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-25T13:33:48.732 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-25T13:33:48.732 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout 3: ens1f0: mtu 1500 state UP qlen 1000 2024-04-25T13:33:48.732 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1358/64 scope link noprefixroute 2024-04-25T13:33:48.732 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-25T13:33:48.732 INFO:teuthology.orchestra.run.smithi043.stdout:Mon IP `172.21.15.43` is in CIDR network `172.21.0.0/20` 2024-04-25T13:33:48.732 INFO:teuthology.orchestra.run.smithi043.stdout:Mon IP `172.21.15.43` is in CIDR network `172.21.0.0/20` 2024-04-25T13:33:48.733 INFO:teuthology.orchestra.run.smithi043.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-25T13:33:48.733 INFO:teuthology.orchestra.run.smithi043.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-25T13:33:48.734 INFO:teuthology.orchestra.run.smithi043.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8... 2024-04-25T13:33:49.162 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stdout d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 2024-04-25T13:33:49.162 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8... 2024-04-25T13:33:49.162 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Getting image source signatures 2024-04-25T13:33:49.162 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Copying blob sha256:665339d96aad80d083ba9988a62422bcef0a42210fb2b28340e33ab98589f7b8 2024-04-25T13:33:49.163 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Copying blob sha256:3d665f4c032644be9cae748af04bee69f2bfe96cdc3616dabe0ab17899633ab5 2024-04-25T13:33:49.163 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Copying config sha256:d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 2024-04-25T13:33:49.163 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-25T13:33:50.110 INFO:teuthology.orchestra.run.smithi043.stdout:ceph: stdout ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev) 2024-04-25T13:33:50.110 INFO:teuthology.orchestra.run.smithi043.stdout:Ceph version: ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev) 2024-04-25T13:33:50.111 INFO:teuthology.orchestra.run.smithi043.stdout:Extracting ceph user uid/gid from container image... 2024-04-25T13:33:51.009 INFO:teuthology.orchestra.run.smithi043.stdout:stat: stdout 167 167 2024-04-25T13:33:51.009 INFO:teuthology.orchestra.run.smithi043.stdout:Creating initial keys... 2024-04-25T13:33:51.866 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph-authtool: stdout AQC/WypmMq2bExAA5A0JfzWfx3mAbnCOHA5PsQ== 2024-04-25T13:33:52.757 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph-authtool: stdout AQDAWypmSmVBDBAArqlgc5EVG6g0EX47BVLZtA== 2024-04-25T13:33:53.654 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph-authtool: stdout AQDBWypmS8jRBBAAeJPP4YMMa3MTaQDvhgYtNQ== 2024-04-25T13:33:53.655 INFO:teuthology.orchestra.run.smithi043.stdout:Creating initial monmap... 2024-04-25T13:33:54.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-25T13:33:54.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-25T13:33:54.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:33:54.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-25T13:33:54.612 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool for a [v2:172.21.15.43:3300,v1:172.21.15.43:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-25T13:33:54.612 INFO:teuthology.orchestra.run.smithi043.stdout:setting min_mon_release = quincy 2024-04-25T13:33:54.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: set fsid to 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:33:54.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-25T13:33:54.612 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:33:54.612 INFO:teuthology.orchestra.run.smithi043.stdout:Creating mon... 2024-04-25T13:33:55.561 INFO:teuthology.orchestra.run.smithi043.stdout:create mon.a on 2024-04-25T13:33:55.790 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-25T13:33:55.943 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-25T13:33:56.142 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-394efb6c-0308-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-394efb6c-0308-11ef-bc93-c7b262605968.target. 2024-04-25T13:33:56.143 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-394efb6c-0308-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-394efb6c-0308-11ef-bc93-c7b262605968.target. 2024-04-25T13:33:56.385 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-394efb6c-0308-11ef-bc93-c7b262605968@mon.a 2024-04-25T13:33:56.385 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Failed to reset failed state of unit ceph-394efb6c-0308-11ef-bc93-c7b262605968@mon.a.service: Unit ceph-394efb6c-0308-11ef-bc93-c7b262605968@mon.a.service not loaded. 2024-04-25T13:33:56.561 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-394efb6c-0308-11ef-bc93-c7b262605968.target.wants/ceph-394efb6c-0308-11ef-bc93-c7b262605968@mon.a.service → /etc/systemd/system/ceph-394efb6c-0308-11ef-bc93-c7b262605968@.service. 2024-04-25T13:33:57.072 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T13:33:57.072 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout disabled 2024-04-25T13:33:57.079 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T13:33:57.079 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-04-25T13:33:57.080 INFO:teuthology.orchestra.run.smithi043.stdout:firewalld.service is not enabled 2024-04-25T13:33:57.080 INFO:teuthology.orchestra.run.smithi043.stdout:Not possible to enable service . firewalld.service is not available 2024-04-25T13:33:57.080 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mon to start... 2024-04-25T13:33:57.080 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mon... 2024-04-25T13:33:58.069 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout cluster: 2024-04-25T13:33:58.069 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout id: 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:33:58.069 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-25T13:33:58.069 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T13:33:58.069 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout services: 2024-04-25T13:33:58.069 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.522084s) 2024-04-25T13:33:58.070 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-25T13:33:58.070 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-25T13:33:58.070 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T13:33:58.070 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout data: 2024-04-25T13:33:58.070 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-25T13:33:58.070 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-25T13:33:58.070 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-25T13:33:58.070 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout pgs: 2024-04-25T13:33:58.070 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T13:33:58.070 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.489+0000 7f3e640db700 1 Processor -- start 2024-04-25T13:33:58.070 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.489+0000 7f3e640db700 1 -- start start 2024-04-25T13:33:58.071 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.490+0000 7f3e640db700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e5c109910 0x7f3e5c109d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:33:58.071 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.490+0000 7f3e640db700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c10a310 con 0x7f3e5c109910 2024-04-25T13:33:58.071 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.490+0000 7f3e61e77700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e5c109910 0x7f3e5c109d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:33:58.071 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.490+0000 7f3e61e77700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e5c109910 0x7f3e5c109d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36744/0 (socket says 172.21.15.43:36744) 2024-04-25T13:33:58.071 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.490+0000 7f3e61e77700 1 -- 172.21.15.43:0/1620514654 learned_addr learned my addr 172.21.15.43:0/1620514654 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:33:58.071 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.490+0000 7f3e61e77700 1 -- 172.21.15.43:0/1620514654 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c10aa90 con 0x7f3e5c109910 2024-04-25T13:33:58.071 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.491+0000 7f3e61e77700 1 --2- 172.21.15.43:0/1620514654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e5c109910 0x7f3e5c109d20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009e80 tx=0x7f3e5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e109a3a0fb892d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:33:58.071 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.491+0000 7f3e60e75700 1 -- 172.21.15.43:0/1620514654 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e54017070 con 0x7f3e5c109910 2024-04-25T13:33:58.071 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.491+0000 7f3e60e75700 1 -- 172.21.15.43:0/1620514654 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e54003a20 con 0x7f3e5c109910 2024-04-25T13:33:58.071 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.491+0000 7f3e60e75700 1 -- 172.21.15.43:0/1620514654 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e54003d20 con 0x7f3e5c109910 2024-04-25T13:33:58.071 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.491+0000 7f3e640db700 1 -- 172.21.15.43:0/1620514654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e5c109910 msgr2=0x7f3e5c109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:33:58.072 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.491+0000 7f3e640db700 1 --2- 172.21.15.43:0/1620514654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e5c109910 0x7f3e5c109d20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009e80 tx=0x7f3e5400b330 comp rx=0 tx=0).stop 2024-04-25T13:33:58.072 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.491+0000 7f3e640db700 1 -- 172.21.15.43:0/1620514654 shutdown_connections 2024-04-25T13:33:58.072 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.491+0000 7f3e640db700 1 --2- 172.21.15.43:0/1620514654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e5c109910 0x7f3e5c109d20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:33:58.072 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.491+0000 7f3e640db700 1 -- 172.21.15.43:0/1620514654 >> 172.21.15.43:0/1620514654 conn(0x7f3e5c104f30 msgr2=0x7f3e5c107400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:33:58.072 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.492+0000 7f3e640db700 1 -- 172.21.15.43:0/1620514654 shutdown_connections 2024-04-25T13:33:58.072 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.492+0000 7f3e640db700 1 -- 172.21.15.43:0/1620514654 wait complete. 2024-04-25T13:33:58.072 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.492+0000 7f3e640db700 1 Processor -- start 2024-04-25T13:33:58.072 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.492+0000 7f3e640db700 1 -- start start 2024-04-25T13:33:58.072 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.492+0000 7f3e640db700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e5c109910 0x7f3e5c19d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:33:58.072 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.492+0000 7f3e640db700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c10afc0 con 0x7f3e5c109910 2024-04-25T13:33:58.072 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.493+0000 7f3e61e77700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e5c109910 0x7f3e5c19d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:33:58.073 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.493+0000 7f3e61e77700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e5c109910 0x7f3e5c19d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36756/0 (socket says 172.21.15.43:36756) 2024-04-25T13:33:58.073 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.493+0000 7f3e61e77700 1 -- 172.21.15.43:0/1458073288 learned_addr learned my addr 172.21.15.43:0/1458073288 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:33:58.073 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.493+0000 7f3e61e77700 1 -- 172.21.15.43:0/1458073288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c19d940 con 0x7f3e5c109910 2024-04-25T13:33:58.073 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.493+0000 7f3e61e77700 1 --2- 172.21.15.43:0/1458073288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e5c109910 0x7f3e5c19d400 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3e54004000 tx=0x7f3e54004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:33:58.073 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.493+0000 7f3e5affd700 1 -- 172.21.15.43:0/1458073288 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e54022020 con 0x7f3e5c109910 2024-04-25T13:33:58.073 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.493+0000 7f3e5affd700 1 -- 172.21.15.43:0/1458073288 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e54018040 con 0x7f3e5c109910 2024-04-25T13:33:58.073 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.493+0000 7f3e640db700 1 -- 172.21.15.43:0/1458073288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e5c19dbd0 con 0x7f3e5c109910 2024-04-25T13:33:58.073 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.493+0000 7f3e5affd700 1 -- 172.21.15.43:0/1458073288 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e54017070 con 0x7f3e5c109910 2024-04-25T13:33:58.073 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.493+0000 7f3e640db700 1 -- 172.21.15.43:0/1458073288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e5c1a07e0 con 0x7f3e5c109910 2024-04-25T13:33:58.073 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.494+0000 7f3e5affd700 1 -- 172.21.15.43:0/1458073288 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3e54025020 con 0x7f3e5c109910 2024-04-25T13:33:58.073 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.494+0000 7f3e5affd700 1 -- 172.21.15.43:0/1458073288 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3e5400f050 con 0x7f3e5c109910 2024-04-25T13:33:58.073 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.494+0000 7f3e640db700 1 -- 172.21.15.43:0/1458073288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e5c064cf0 con 0x7f3e5c109910 2024-04-25T13:33:58.074 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.497+0000 7f3e5affd700 1 -- 172.21.15.43:0/1458073288 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f3e5402c030 con 0x7f3e5c109910 2024-04-25T13:33:58.074 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.571+0000 7f3e640db700 1 -- 172.21.15.43:0/1458073288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f3e5c02e780 con 0x7f3e5c109910 2024-04-25T13:33:58.074 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.571+0000 7f3e5affd700 1 -- 172.21.15.43:0/1458073288 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f3e5401e480 con 0x7f3e5c109910 2024-04-25T13:33:58.074 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.572+0000 7f3e640db700 1 -- 172.21.15.43:0/1458073288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e5c109910 msgr2=0x7f3e5c19d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:33:58.074 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.572+0000 7f3e640db700 1 --2- 172.21.15.43:0/1458073288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e5c109910 0x7f3e5c19d400 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3e54004000 tx=0x7f3e54004ad0 comp rx=0 tx=0).stop 2024-04-25T13:33:58.074 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.572+0000 7f3e640db700 1 -- 172.21.15.43:0/1458073288 shutdown_connections 2024-04-25T13:33:58.074 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.572+0000 7f3e640db700 1 --2- 172.21.15.43:0/1458073288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e5c109910 0x7f3e5c19d400 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:33:58.074 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.572+0000 7f3e640db700 1 -- 172.21.15.43:0/1458073288 >> 172.21.15.43:0/1458073288 conn(0x7f3e5c104f30 msgr2=0x7f3e5c193a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:33:58.074 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.572+0000 7f3e640db700 1 -- 172.21.15.43:0/1458073288 shutdown_connections 2024-04-25T13:33:58.074 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:57.572+0000 7f3e640db700 1 -- 172.21.15.43:0/1458073288 wait complete. 2024-04-25T13:33:58.074 INFO:teuthology.orchestra.run.smithi043.stdout:mon is available 2024-04-25T13:33:58.075 INFO:teuthology.orchestra.run.smithi043.stdout:Assimilating anything we can from ceph.conf... 2024-04-25T13:33:59.165 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:33:59 smithi043 ceph-mon[28818]: from='client.? 172.21.15.43:0/1185154309' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-25T13:33:59.174 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T13:33:59.174 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [global] 2024-04-25T13:33:59.174 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout fsid = 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:33:59.174 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-25T13:33:59.174 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.43:3300,v1:172.21.15.43:6789] 2024-04-25T13:33:59.175 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-25T13:33:59.175 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-25T13:33:59.175 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-25T13:33:59.175 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-25T13:33:59.175 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T13:33:59.175 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-25T13:33:59.175 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-25T13:33:59.175 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T13:33:59.175 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [osd] 2024-04-25T13:33:59.175 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-25T13:33:59.175 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-25T13:33:59.175 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-25T13:33:59.175 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-25T13:33:59.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-25T13:33:59.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.507+0000 7fdfc3116700 1 Processor -- start 2024-04-25T13:33:59.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.507+0000 7fdfc3116700 1 -- start start 2024-04-25T13:33:59.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.508+0000 7fdfc3116700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc108800 0x7fdfbc108c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:33:59.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.508+0000 7fdfc3116700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc109200 con 0x7fdfbc108800 2024-04-25T13:33:59.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.508+0000 7fdfc0eb2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc108800 0x7fdfbc108c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:33:59.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.508+0000 7fdfc0eb2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc108800 0x7fdfbc108c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36762/0 (socket says 172.21.15.43:36762) 2024-04-25T13:33:59.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.508+0000 7fdfc0eb2700 1 -- 172.21.15.43:0/411917996 learned_addr learned my addr 172.21.15.43:0/411917996 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:33:59.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.508+0000 7fdfc0eb2700 1 -- 172.21.15.43:0/411917996 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc1099d0 con 0x7fdfbc108800 2024-04-25T13:33:59.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.508+0000 7fdfc0eb2700 1 --2- 172.21.15.43:0/411917996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc108800 0x7fdfbc108c10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00098a0 tx=0x7fdfb0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42507922d940f617 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:33:59.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.509+0000 7fdfbb7fe700 1 -- 172.21.15.43:0/411917996 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfb0004160 con 0x7fdfbc108800 2024-04-25T13:33:59.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.509+0000 7fdfbb7fe700 1 -- 172.21.15.43:0/411917996 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb0004300 con 0x7fdfbc108800 2024-04-25T13:33:59.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.509+0000 7fdfbb7fe700 1 -- 172.21.15.43:0/411917996 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfb00036a0 con 0x7fdfbc108800 2024-04-25T13:33:59.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.509+0000 7fdfc3116700 1 -- 172.21.15.43:0/411917996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc108800 msgr2=0x7fdfbc108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:33:59.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.509+0000 7fdfc3116700 1 --2- 172.21.15.43:0/411917996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc108800 0x7fdfbc108c10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00098a0 tx=0x7fdfb0009bb0 comp rx=0 tx=0).stop 2024-04-25T13:33:59.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.509+0000 7fdfc3116700 1 -- 172.21.15.43:0/411917996 shutdown_connections 2024-04-25T13:33:59.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.509+0000 7fdfc3116700 1 --2- 172.21.15.43:0/411917996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc108800 0x7fdfbc108c10 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:33:59.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.509+0000 7fdfc3116700 1 -- 172.21.15.43:0/411917996 >> 172.21.15.43:0/411917996 conn(0x7fdfbc103e60 msgr2=0x7fdfbc1062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:33:59.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.509+0000 7fdfc3116700 1 -- 172.21.15.43:0/411917996 shutdown_connections 2024-04-25T13:33:59.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.509+0000 7fdfc3116700 1 -- 172.21.15.43:0/411917996 wait complete. 2024-04-25T13:33:59.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.510+0000 7fdfc3116700 1 Processor -- start 2024-04-25T13:33:59.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.510+0000 7fdfc3116700 1 -- start start 2024-04-25T13:33:59.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.510+0000 7fdfc3116700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc108800 0x7fdfbc19c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:33:59.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.510+0000 7fdfc3116700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc109f00 con 0x7fdfbc108800 2024-04-25T13:33:59.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.510+0000 7fdfc0eb2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc108800 0x7fdfbc19c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:33:59.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.510+0000 7fdfc0eb2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc108800 0x7fdfbc19c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36778/0 (socket says 172.21.15.43:36778) 2024-04-25T13:33:59.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.510+0000 7fdfc0eb2700 1 -- 172.21.15.43:0/1185154309 learned_addr learned my addr 172.21.15.43:0/1185154309 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:33:59.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.511+0000 7fdfc0eb2700 1 -- 172.21.15.43:0/1185154309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc19c7f0 con 0x7fdfbc108800 2024-04-25T13:33:59.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.511+0000 7fdfc0eb2700 1 --2- 172.21.15.43:0/1185154309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc108800 0x7fdfbc19c2b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0000c00 tx=0x7fdfb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:33:59.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.511+0000 7fdfb9ffb700 1 -- 172.21.15.43:0/1185154309 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfb0003db0 con 0x7fdfbc108800 2024-04-25T13:33:59.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.511+0000 7fdfb9ffb700 1 -- 172.21.15.43:0/1185154309 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb0011630 con 0x7fdfbc108800 2024-04-25T13:33:59.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.511+0000 7fdfc3116700 1 -- 172.21.15.43:0/1185154309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfbc19ca80 con 0x7fdfbc108800 2024-04-25T13:33:59.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.511+0000 7fdfb9ffb700 1 -- 172.21.15.43:0/1185154309 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfb0011950 con 0x7fdfbc108800 2024-04-25T13:33:59.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.511+0000 7fdfc3116700 1 -- 172.21.15.43:0/1185154309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfbc19f690 con 0x7fdfbc108800 2024-04-25T13:33:59.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.511+0000 7fdfb9ffb700 1 -- 172.21.15.43:0/1185154309 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdfb001a460 con 0x7fdfbc108800 2024-04-25T13:33:59.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.512+0000 7fdfb9ffb700 1 -- 172.21.15.43:0/1185154309 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdfb001b780 con 0x7fdfbc108800 2024-04-25T13:33:59.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.512+0000 7fdfc3116700 1 -- 172.21.15.43:0/1185154309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfbc064cf0 con 0x7fdfbc108800 2024-04-25T13:33:59.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.515+0000 7fdfb9ffb700 1 -- 172.21.15.43:0/1185154309 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fdfb0031020 con 0x7fdfbc108800 2024-04-25T13:33:59.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.585+0000 7fdfc3116700 1 -- 172.21.15.43:0/1185154309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fdfbc02e960 con 0x7fdfbc108800 2024-04-25T13:33:59.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.589+0000 7fdfb9ffb700 1 -- 172.21.15.43:0/1185154309 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7fdfb001b9d0 con 0x7fdfbc108800 2024-04-25T13:33:59.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.590+0000 7fdfb9ffb700 1 -- 172.21.15.43:0/1185154309 <== mon.0 v2:172.21.15.43:3300/0 8 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fdfb001ad00 con 0x7fdfbc108800 2024-04-25T13:33:59.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.590+0000 7fdfc3116700 1 -- 172.21.15.43:0/1185154309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc108800 msgr2=0x7fdfbc19c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:33:59.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.590+0000 7fdfc3116700 1 --2- 172.21.15.43:0/1185154309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc108800 0x7fdfbc19c2b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0000c00 tx=0x7fdfb0004750 comp rx=0 tx=0).stop 2024-04-25T13:33:59.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.590+0000 7fdfc3116700 1 -- 172.21.15.43:0/1185154309 shutdown_connections 2024-04-25T13:33:59.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.590+0000 7fdfc3116700 1 --2- 172.21.15.43:0/1185154309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfbc108800 0x7fdfbc19c2b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:33:59.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.590+0000 7fdfc3116700 1 -- 172.21.15.43:0/1185154309 >> 172.21.15.43:0/1185154309 conn(0x7fdfbc103e60 msgr2=0x7fdfbc190260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:33:59.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.590+0000 7fdfc3116700 1 -- 172.21.15.43:0/1185154309 shutdown_connections 2024-04-25T13:33:59.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:58.590+0000 7fdfc3116700 1 -- 172.21.15.43:0/1185154309 wait complete. 2024-04-25T13:33:59.179 INFO:teuthology.orchestra.run.smithi043.stdout:Generating new minimal ceph.conf... 2024-04-25T13:34:00.196 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.574+0000 7f629f264700 1 Processor -- start 2024-04-25T13:34:00.196 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.574+0000 7f629f264700 1 -- start start 2024-04-25T13:34:00.196 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.574+0000 7f629f264700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6298108830 0x7f6298108c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:00.197 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.574+0000 7f629f264700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6298109230 con 0x7f6298108830 2024-04-25T13:34:00.197 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.574+0000 7f629d000700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6298108830 0x7f6298108c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:00.197 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.575+0000 7f629d000700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6298108830 0x7f6298108c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36790/0 (socket says 172.21.15.43:36790) 2024-04-25T13:34:00.197 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.575+0000 7f629d000700 1 -- 172.21.15.43:0/4097057224 learned_addr learned my addr 172.21.15.43:0/4097057224 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:00.197 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.575+0000 7f629d000700 1 -- 172.21.15.43:0/4097057224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62981099b0 con 0x7f6298108830 2024-04-25T13:34:00.197 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.575+0000 7f629d000700 1 --2- 172.21.15.43:0/4097057224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6298108830 0x7f6298108c40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f628c0098a0 tx=0x7f628c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4cf0663743055f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:00.197 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.575+0000 7f62977fe700 1 -- 172.21.15.43:0/4097057224 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f628c004160 con 0x7f6298108830 2024-04-25T13:34:00.197 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.575+0000 7f62977fe700 1 -- 172.21.15.43:0/4097057224 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f628c004300 con 0x7f6298108830 2024-04-25T13:34:00.197 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.575+0000 7f62977fe700 1 -- 172.21.15.43:0/4097057224 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f628c0119e0 con 0x7f6298108830 2024-04-25T13:34:00.197 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.576+0000 7f629f264700 1 -- 172.21.15.43:0/4097057224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6298108830 msgr2=0x7f6298108c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:00.197 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.576+0000 7f629f264700 1 --2- 172.21.15.43:0/4097057224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6298108830 0x7f6298108c40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f628c0098a0 tx=0x7f628c009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:00.198 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.576+0000 7f629f264700 1 -- 172.21.15.43:0/4097057224 shutdown_connections 2024-04-25T13:34:00.198 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.576+0000 7f629f264700 1 --2- 172.21.15.43:0/4097057224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6298108830 0x7f6298108c40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:00.198 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.576+0000 7f629f264700 1 -- 172.21.15.43:0/4097057224 >> 172.21.15.43:0/4097057224 conn(0x7f6298103e70 msgr2=0x7f6298106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:00.198 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.576+0000 7f629f264700 1 -- 172.21.15.43:0/4097057224 shutdown_connections 2024-04-25T13:34:00.198 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.576+0000 7f629f264700 1 -- 172.21.15.43:0/4097057224 wait complete. 2024-04-25T13:34:00.198 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.577+0000 7f629f264700 1 Processor -- start 2024-04-25T13:34:00.198 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.577+0000 7f629f264700 1 -- start start 2024-04-25T13:34:00.198 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.577+0000 7f629f264700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6298108830 0x7f6298105fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:00.198 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.577+0000 7f629f264700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f629810cd60 con 0x7f6298108830 2024-04-25T13:34:00.198 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.577+0000 7f629d000700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6298108830 0x7f6298105fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:00.198 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.577+0000 7f629d000700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6298108830 0x7f6298105fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36802/0 (socket says 172.21.15.43:36802) 2024-04-25T13:34:00.198 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.577+0000 7f629d000700 1 -- 172.21.15.43:0/2913800570 learned_addr learned my addr 172.21.15.43:0/2913800570 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:00.199 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.577+0000 7f629d000700 1 -- 172.21.15.43:0/2913800570 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6298106510 con 0x7f6298108830 2024-04-25T13:34:00.199 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.578+0000 7f629d000700 1 --2- 172.21.15.43:0/2913800570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6298108830 0x7f6298105fd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f628c0119b0 tx=0x7f628c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:00.199 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.578+0000 7f6295ffb700 1 -- 172.21.15.43:0/2913800570 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f628c003970 con 0x7f6298108830 2024-04-25T13:34:00.199 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.578+0000 7f6295ffb700 1 -- 172.21.15.43:0/2913800570 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f628c003b10 con 0x7f6298108830 2024-04-25T13:34:00.199 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.578+0000 7f629f264700 1 -- 172.21.15.43:0/2913800570 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6298104760 con 0x7f6298108830 2024-04-25T13:34:00.199 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.578+0000 7f6295ffb700 1 -- 172.21.15.43:0/2913800570 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f628c024610 con 0x7f6298108830 2024-04-25T13:34:00.199 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.578+0000 7f629f264700 1 -- 172.21.15.43:0/2913800570 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6298104c40 con 0x7f6298108830 2024-04-25T13:34:00.199 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.578+0000 7f6295ffb700 1 -- 172.21.15.43:0/2913800570 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f628c024c10 con 0x7f6298108830 2024-04-25T13:34:00.199 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.578+0000 7f6295ffb700 1 -- 172.21.15.43:0/2913800570 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f628c019700 con 0x7f6298108830 2024-04-25T13:34:00.199 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.579+0000 7f629f264700 1 -- 172.21.15.43:0/2913800570 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6298064cf0 con 0x7f6298108830 2024-04-25T13:34:00.199 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.581+0000 7f6295ffb700 1 -- 172.21.15.43:0/2913800570 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f628c0094f0 con 0x7f6298108830 2024-04-25T13:34:00.199 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.651+0000 7f629f264700 1 -- 172.21.15.43:0/2913800570 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f6298196d30 con 0x7f6298108830 2024-04-25T13:34:00.199 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.652+0000 7f6295ffb700 1 -- 172.21.15.43:0/2913800570 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f628c01aae0 con 0x7f6298108830 2024-04-25T13:34:00.199 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.653+0000 7f629f264700 1 -- 172.21.15.43:0/2913800570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6298108830 msgr2=0x7f6298105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:00.200 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.653+0000 7f629f264700 1 --2- 172.21.15.43:0/2913800570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6298108830 0x7f6298105fd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f628c0119b0 tx=0x7f628c011a90 comp rx=0 tx=0).stop 2024-04-25T13:34:00.200 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.653+0000 7f629f264700 1 -- 172.21.15.43:0/2913800570 shutdown_connections 2024-04-25T13:34:00.200 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.653+0000 7f629f264700 1 --2- 172.21.15.43:0/2913800570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6298108830 0x7f6298105fd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:00.200 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.653+0000 7f629f264700 1 -- 172.21.15.43:0/2913800570 >> 172.21.15.43:0/2913800570 conn(0x7f6298103e70 msgr2=0x7f6298194190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:00.200 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.653+0000 7f629f264700 1 -- 172.21.15.43:0/2913800570 shutdown_connections 2024-04-25T13:34:00.200 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:33:59.653+0000 7f629f264700 1 -- 172.21.15.43:0/2913800570 wait complete. 2024-04-25T13:34:00.200 INFO:teuthology.orchestra.run.smithi043.stdout:Restarting the monitor... 2024-04-25T13:34:00.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:00 smithi043 ceph-mon[28818]: from='client.? 172.21.15.43:0/2913800570' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:34:00.475 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:00 smithi043 systemd[1]: Stopping Ceph mon.a for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:34:00.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:00 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-a[28814]: 2024-04-25T13:34:00.473+0000 7fd5a3479700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:34:00.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:00 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-a[28814]: 2024-04-25T13:34:00.473+0000 7fd5a3479700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-25T13:34:00.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:00 smithi043 podman[29064]: 2024-04-25 13:34:00.484898232 +0000 UTC m=+0.122405547 container died cbcb9ee807fab9b5987f56a1a168537f077205b7cb3741e03d97a8ab952bb204 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-a, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-25T13:34:01.108 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:00 smithi043 podman[29064]: 2024-04-25 13:34:00.790465101 +0000 UTC m=+0.427972415 container cleanup cbcb9ee807fab9b5987f56a1a168537f077205b7cb3741e03d97a8ab952bb204 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-04-25T13:34:01.108 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:00 smithi043 bash[29064]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-a 2024-04-25T13:34:01.108 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:00 smithi043 podman[29078]: 2024-04-25 13:34:00.983310109 +0000 UTC m=+0.495076042 container remove cbcb9ee807fab9b5987f56a1a168537f077205b7cb3741e03d97a8ab952bb204 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T13:34:01.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 systemd[1]: ceph-394efb6c-0308-11ef-bc93-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-25T13:34:01.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 systemd[1]: Stopped Ceph mon.a for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:34:01.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 systemd[1]: Starting Ceph mon.a for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:34:01.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 podman[29175]: 2024-04-25 13:34:01.247505469 +0000 UTC m=+0.018800881 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:34:01.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 podman[29175]: 2024-04-25 13:34:01.350709744 +0000 UTC m=+0.122005129 container create 7b328ba066183ad3cc0c3bd28d4771a41df5460d4cb3a6388e79753ed4737bfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-25T13:34:01.632 INFO:teuthology.orchestra.run.smithi043.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-25T13:34:01.757 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 podman[29175]: 2024-04-25 13:34:01.561424468 +0000 UTC m=+0.332719866 container init 7b328ba066183ad3cc0c3bd28d4771a41df5460d4cb3a6388e79753ed4737bfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-25T13:34:01.757 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 podman[29175]: 2024-04-25 13:34:01.564380872 +0000 UTC m=+0.335676258 container start 7b328ba066183ad3cc0c3bd28d4771a41df5460d4cb3a6388e79753ed4737bfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-a, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-25T13:34:01.757 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T13:34:01.757 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev), process ceph-mon, pid 2 2024-04-25T13:34:01.757 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: pidfile_write: ignore empty --pid-file 2024-04-25T13:34:01.757 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: load: jerasure load: lrc 2024-04-25T13:34:01.758 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: RocksDB version: 7.9.2 2024-04-25T13:34:01.758 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Git sha 0 2024-04-25T13:34:01.758 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Compile date 2024-04-25 02:57:34 2024-04-25T13:34:01.758 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: DB SUMMARY 2024-04-25T13:34:01.758 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: DB Session ID: KJDYYCYO3FF3Z8GRFVGM 2024-04-25T13:34:01.758 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: CURRENT file: CURRENT 2024-04-25T13:34:01.758 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T13:34:01.758 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-25T13:34:01.758 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-25T13:34:01.758 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104550 ; 2024-04-25T13:34:01.758 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.error_if_exists: 0 2024-04-25T13:34:01.758 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.create_if_missing: 0 2024-04-25T13:34:01.759 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.paranoid_checks: 1 2024-04-25T13:34:01.759 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-25T13:34:01.759 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T13:34:01.759 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-25T13:34:01.759 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.env: 0x56544514a500 2024-04-25T13:34:01.759 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.fs: PosixFileSystem 2024-04-25T13:34:01.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.info_log: 0x565446a99fc0 2024-04-25T13:34:01.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T13:34:01.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.statistics: (nil) 2024-04-25T13:34:01.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.use_fsync: 0 2024-04-25T13:34:01.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_log_file_size: 0 2024-04-25T13:34:01.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T13:34:01.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T13:34:01.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T13:34:01.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T13:34:01.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.allow_fallocate: 1 2024-04-25T13:34:01.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T13:34:01.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T13:34:01.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.use_direct_reads: 0 2024-04-25T13:34:01.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T13:34:01.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T13:34:01.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.db_log_dir: 2024-04-25T13:34:01.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.wal_dir: 2024-04-25T13:34:01.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T13:34:01.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T13:34:01.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T13:34:01.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T13:34:01.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T13:34:01.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T13:34:01.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T13:34:01.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T13:34:01.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.write_buffer_manager: 0x565446a6a8c0 2024-04-25T13:34:01.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T13:34:01.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T13:34:01.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T13:34:01.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T13:34:01.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T13:34:01.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T13:34:01.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T13:34:01.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T13:34:01.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.unordered_write: 0 2024-04-25T13:34:01.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T13:34:01.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T13:34:01.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T13:34:01.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T13:34:01.763 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.row_cache: None 2024-04-25T13:34:01.763 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.wal_filter: None 2024-04-25T13:34:01.764 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T13:34:01.764 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T13:34:01.764 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.two_write_queues: 0 2024-04-25T13:34:01.764 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T13:34:01.764 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.wal_compression: 0 2024-04-25T13:34:01.764 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.atomic_flush: 0 2024-04-25T13:34:01.764 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T13:34:01.764 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T13:34:01.765 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T13:34:01.765 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.log_readahead_size: 0 2024-04-25T13:34:01.765 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T13:34:01.765 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T13:34:01.765 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T13:34:01.765 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T13:34:01.765 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T13:34:01.765 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T13:34:01.765 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-25T13:34:01.765 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_background_jobs: 2 2024-04-25T13:34:01.765 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_background_compactions: -1 2024-04-25T13:34:01.765 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_subcompactions: 1 2024-04-25T13:34:01.765 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T13:34:01.765 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T13:34:01.766 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T13:34:01.766 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T13:34:01.766 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T13:34:01.766 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T13:34:01.766 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T13:34:01.766 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T13:34:01.766 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_open_files: -1 2024-04-25T13:34:01.766 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T13:34:01.766 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T13:34:01.766 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T13:34:01.766 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T13:34:01.766 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_background_flushes: -1 2024-04-25T13:34:01.766 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Compression algorithms supported: 2024-04-25T13:34:01.766 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T13:34:01.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: kZSTD supported: 0 2024-04-25T13:34:01.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: kXpressCompression supported: 0 2024-04-25T13:34:01.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T13:34:01.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: kZlibCompression supported: 1 2024-04-25T13:34:01.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: kSnappyCompression supported: 1 2024-04-25T13:34:01.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: kLZ4Compression supported: 1 2024-04-25T13:34:01.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: kBZip2Compression supported: 0 2024-04-25T13:34:01.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T13:34:01.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-25T13:34:01.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-25T13:34:01.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-25T13:34:01.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T13:34:01.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.merge_operator: 2024-04-25T13:34:01.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compaction_filter: None 2024-04-25T13:34:01.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T13:34:01.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T13:34:01.768 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T13:34:01.768 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T13:34:01.768 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x565446ba01a0) 2024-04-25T13:34:01.768 INFO:journalctl@ceph.mon.a.smithi043.stdout: cache_index_and_filter_blocks: 1 2024-04-25T13:34:01.768 INFO:journalctl@ceph.mon.a.smithi043.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T13:34:01.768 INFO:journalctl@ceph.mon.a.smithi043.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T13:34:01.768 INFO:journalctl@ceph.mon.a.smithi043.stdout: pin_top_level_index_and_filter: 1 2024-04-25T13:34:01.768 INFO:journalctl@ceph.mon.a.smithi043.stdout: index_type: 0 2024-04-25T13:34:01.768 INFO:journalctl@ceph.mon.a.smithi043.stdout: data_block_index_type: 0 2024-04-25T13:34:01.768 INFO:journalctl@ceph.mon.a.smithi043.stdout: index_shortening: 1 2024-04-25T13:34:01.768 INFO:journalctl@ceph.mon.a.smithi043.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T13:34:01.768 INFO:journalctl@ceph.mon.a.smithi043.stdout: checksum: 4 2024-04-25T13:34:01.768 INFO:journalctl@ceph.mon.a.smithi043.stdout: no_block_cache: 0 2024-04-25T13:34:01.769 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_cache: 0x565446a9d1f0 2024-04-25T13:34:01.769 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_cache_name: BinnedLRUCache 2024-04-25T13:34:01.769 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_cache_options: 2024-04-25T13:34:01.769 INFO:journalctl@ceph.mon.a.smithi043.stdout: capacity : 536870912 2024-04-25T13:34:01.769 INFO:journalctl@ceph.mon.a.smithi043.stdout: num_shard_bits : 4 2024-04-25T13:34:01.769 INFO:journalctl@ceph.mon.a.smithi043.stdout: strict_capacity_limit : 0 2024-04-25T13:34:01.769 INFO:journalctl@ceph.mon.a.smithi043.stdout: high_pri_pool_ratio: 0.000 2024-04-25T13:34:01.769 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_cache_compressed: (nil) 2024-04-25T13:34:01.769 INFO:journalctl@ceph.mon.a.smithi043.stdout: persistent_cache: (nil) 2024-04-25T13:34:01.769 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_size: 4096 2024-04-25T13:34:01.769 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_size_deviation: 10 2024-04-25T13:34:01.769 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_restart_interval: 16 2024-04-25T13:34:01.769 INFO:journalctl@ceph.mon.a.smithi043.stdout: index_block_restart_interval: 1 2024-04-25T13:34:01.769 INFO:journalctl@ceph.mon.a.smithi043.stdout: metadata_block_size: 4096 2024-04-25T13:34:01.769 INFO:journalctl@ceph.mon.a.smithi043.stdout: partition_filters: 0 2024-04-25T13:34:01.769 INFO:journalctl@ceph.mon.a.smithi043.stdout: use_delta_encoding: 1 2024-04-25T13:34:01.770 INFO:journalctl@ceph.mon.a.smithi043.stdout: filter_policy: bloomfilter 2024-04-25T13:34:01.770 INFO:journalctl@ceph.mon.a.smithi043.stdout: whole_key_filtering: 1 2024-04-25T13:34:01.770 INFO:journalctl@ceph.mon.a.smithi043.stdout: verify_compression: 0 2024-04-25T13:34:01.770 INFO:journalctl@ceph.mon.a.smithi043.stdout: read_amp_bytes_per_bit: 0 2024-04-25T13:34:01.770 INFO:journalctl@ceph.mon.a.smithi043.stdout: format_version: 5 2024-04-25T13:34:01.770 INFO:journalctl@ceph.mon.a.smithi043.stdout: enable_index_compression: 1 2024-04-25T13:34:01.770 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_align: 0 2024-04-25T13:34:01.770 INFO:journalctl@ceph.mon.a.smithi043.stdout: max_auto_readahead_size: 262144 2024-04-25T13:34:01.770 INFO:journalctl@ceph.mon.a.smithi043.stdout: prepopulate_block_cache: 0 2024-04-25T13:34:01.770 INFO:journalctl@ceph.mon.a.smithi043.stdout: initial_auto_readahead_size: 8192 2024-04-25T13:34:01.770 INFO:journalctl@ceph.mon.a.smithi043.stdout: num_file_reads_for_auto_readahead: 2 2024-04-25T13:34:01.770 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T13:34:01.770 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T13:34:01.770 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compression: NoCompression 2024-04-25T13:34:01.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T13:34:01.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T13:34:01.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T13:34:01.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.num_levels: 7 2024-04-25T13:34:01.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T13:34:01.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T13:34:01.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T13:34:01.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T13:34:01.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T13:34:01.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T13:34:01.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T13:34:01.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T13:34:01.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T13:34:01.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T13:34:01.772 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-25T13:34:01.772 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-25T13:34:01.772 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T13:34:01.772 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T13:34:01.772 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T13:34:01.772 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T13:34:01.772 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T13:34:01.772 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-25T13:34:01.772 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T13:34:01.772 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T13:34:01.772 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-25T13:34:01.772 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T13:34:01.772 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T13:34:01.772 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T13:34:01.772 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T13:34:01.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T13:34:01.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T13:34:01.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T13:34:01.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T13:34:01.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T13:34:01.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T13:34:01.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T13:34:01.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T13:34:01.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T13:34:01.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T13:34:01.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T13:34:01.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T13:34:01.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T13:34:01.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-25T13:34:01.774 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.arena_block_size: 1048576 2024-04-25T13:34:01.774 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T13:34:01.774 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T13:34:01.774 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T13:34:01.774 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T13:34:01.774 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T13:34:01.774 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T13:34:01.774 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T13:34:01.774 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T13:34:01.774 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T13:34:01.774 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T13:34:01.774 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T13:34:01.775 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T13:34:01.775 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T13:34:01.775 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-25T13:34:01.775 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.inplace_update_support: 0 2024-04-25T13:34:01.775 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T13:34:01.775 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T13:34:01.775 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T13:34:01.775 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T13:34:01.775 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.bloom_locality: 0 2024-04-25T13:34:01.775 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.max_successive_merges: 0 2024-04-25T13:34:01.775 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T13:34:01.775 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T13:34:01.775 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T13:34:01.775 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T13:34:01.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.ttl: 2592000 2024-04-25T13:34:01.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T13:34:01.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-25T13:34:01.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-25T13:34:01.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.enable_blob_files: false 2024-04-25T13:34:01.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.min_blob_size: 0 2024-04-25T13:34:01.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T13:34:01.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T13:34:01.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T13:34:01.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T13:34:01.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-25T13:34:01.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-25T13:34:01.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.blob_file_starting_level: 0 2024-04-25T13:34:01.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-25T13:34:01.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-25T13:34:01.777 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-25T13:34:01.777 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 83608707-bc85-48b6-8a2b-2fbb791b2cfa 2024-04-25T13:34:01.777 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714052041604712, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-25T13:34:01.777 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-25T13:34:01.777 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714052041606658, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99789, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 324, "table_properties": {"data_size": 97671, "index_size": 310, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14036, "raw_average_key_size": 49, "raw_value_size": 90009, "raw_average_value_size": 318, "num_data_blocks": 12, "num_entries": 283, "num_filter_entries": 283, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714052041, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "83608707-bc85-48b6-8a2b-2fbb791b2cfa", "db_session_id": "KJDYYCYO3FF3Z8GRFVGM", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-25T13:34:01.777 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714052041606775, "job": 1, "event": "recovery_finished"} 2024-04-25T13:34:01.777 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-25T13:34:01.777 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T13:34:01.777 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x565446a81c00 2024-04-25T13:34:01.777 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: DB pointer 0x56544b874000 2024-04-25T13:34:01.777 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-25T13:34:01.777 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-25T13:34:01.778 INFO:journalctl@ceph.mon.a.smithi043.stdout: ** DB Stats ** 2024-04-25T13:34:01.778 INFO:journalctl@ceph.mon.a.smithi043.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T13:34:01.778 INFO:journalctl@ceph.mon.a.smithi043.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T13:34:01.778 INFO:journalctl@ceph.mon.a.smithi043.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T13:34:01.778 INFO:journalctl@ceph.mon.a.smithi043.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T13:34:01.778 INFO:journalctl@ceph.mon.a.smithi043.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T13:34:01.778 INFO:journalctl@ceph.mon.a.smithi043.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T13:34:01.778 INFO:journalctl@ceph.mon.a.smithi043.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T13:34:01.778 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-04-25T13:34:01.778 INFO:journalctl@ceph.mon.a.smithi043.stdout: ** Compaction Stats [default] ** 2024-04-25T13:34:01.778 INFO:journalctl@ceph.mon.a.smithi043.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T13:34:01.778 INFO:journalctl@ceph.mon.a.smithi043.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-25T13:34:01.779 INFO:journalctl@ceph.mon.a.smithi043.stdout: L0 2/0 99.31 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 87.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T13:34:01.779 INFO:journalctl@ceph.mon.a.smithi043.stdout: Sum 2/0 99.31 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 87.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T13:34:01.779 INFO:journalctl@ceph.mon.a.smithi043.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 87.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T13:34:01.779 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-04-25T13:34:01.779 INFO:journalctl@ceph.mon.a.smithi043.stdout: ** Compaction Stats [default] ** 2024-04-25T13:34:01.779 INFO:journalctl@ceph.mon.a.smithi043.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T13:34:01.779 INFO:journalctl@ceph.mon.a.smithi043.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T13:34:01.779 INFO:journalctl@ceph.mon.a.smithi043.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 87.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T13:34:01.779 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-04-25T13:34:01.779 INFO:journalctl@ceph.mon.a.smithi043.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-25T13:34:01.779 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-04-25T13:34:01.779 INFO:journalctl@ceph.mon.a.smithi043.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T13:34:01.779 INFO:journalctl@ceph.mon.a.smithi043.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T13:34:01.779 INFO:journalctl@ceph.mon.a.smithi043.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T13:34:01.780 INFO:journalctl@ceph.mon.a.smithi043.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T13:34:01.780 INFO:journalctl@ceph.mon.a.smithi043.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T13:34:01.780 INFO:journalctl@ceph.mon.a.smithi043.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T13:34:01.780 INFO:journalctl@ceph.mon.a.smithi043.stdout: Cumulative compaction: 0.00 GB write, 18.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T13:34:01.780 INFO:journalctl@ceph.mon.a.smithi043.stdout: Interval compaction: 0.00 GB write, 18.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T13:34:01.780 INFO:journalctl@ceph.mon.a.smithi043.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T13:34:01.780 INFO:journalctl@ceph.mon.a.smithi043.stdout: Block cache BinnedLRUCache@0x565446a9d1f0#2 capacity: 512.00 MB usage: 1.53 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-25T13:34:01.780 INFO:journalctl@ceph.mon.a.smithi043.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.03 KB,0.000196695%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-04-25T13:34:01.780 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-04-25T13:34:01.780 INFO:journalctl@ceph.mon.a.smithi043.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T13:34:01.780 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: starting mon.a rank 0 at public addrs [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] at bind addrs [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:34:01.780 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: mon.a@-1(???) e1 preinit fsid 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:34:01.780 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: mon.a@-1(???).mds e1 new map 2024-04-25T13:34:01.780 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: mon.a@-1(???).mds e1 print_map 2024-04-25T13:34:01.780 INFO:journalctl@ceph.mon.a.smithi043.stdout: e1 2024-04-25T13:34:01.781 INFO:journalctl@ceph.mon.a.smithi043.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T13:34:01.781 INFO:journalctl@ceph.mon.a.smithi043.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T13:34:01.781 INFO:journalctl@ceph.mon.a.smithi043.stdout: legacy client fscid: -1 2024-04-25T13:34:01.781 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-04-25T13:34:01.781 INFO:journalctl@ceph.mon.a.smithi043.stdout: No filesystems configured 2024-04-25T13:34:01.781 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-25T13:34:01.781 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T13:34:01.781 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T13:34:01.781 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T13:34:01.781 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-25T13:34:01.781 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 bash[29175]: 7b328ba066183ad3cc0c3bd28d4771a41df5460d4cb3a6388e79753ed4737bfc 2024-04-25T13:34:01.781 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 systemd[1]: Started Ceph mon.a for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:34:01.781 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-25T13:34:01.781 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: monmap epoch 1 2024-04-25T13:34:01.781 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: fsid 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:34:01.782 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: last_changed 2024-04-25T13:33:54.073201+0000 2024-04-25T13:34:01.782 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: created 2024-04-25T13:33:54.073201+0000 2024-04-25T13:34:01.782 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: min_mon_release 19 (squid) 2024-04-25T13:34:01.782 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: election_strategy: 1 2024-04-25T13:34:01.782 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-25T13:34:01.782 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: fsmap 2024-04-25T13:34:01.782 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: osdmap e1: 0 total, 0 up, 0 in 2024-04-25T13:34:01.782 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:01 smithi043 ceph-mon[29195]: mgrmap e1: no daemons active 2024-04-25T13:34:02.761 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.113+0000 7f5b74d3c700 1 Processor -- start 2024-04-25T13:34:02.761 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.113+0000 7f5b74d3c700 1 -- start start 2024-04-25T13:34:02.761 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.114+0000 7f5b74d3c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b7010a450 0x7f5b7010c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:02.761 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.114+0000 7f5b74d3c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7007d650 con 0x7f5b7010a450 2024-04-25T13:34:02.761 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.114+0000 7f5b6e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b7010a450 0x7f5b7010c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:02.761 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.114+0000 7f5b6e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b7010a450 0x7f5b7010c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49348/0 (socket says 172.21.15.43:49348) 2024-04-25T13:34:02.761 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.114+0000 7f5b6e59c700 1 -- 172.21.15.43:0/4108619298 learned_addr learned my addr 172.21.15.43:0/4108619298 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:02.762 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.114+0000 7f5b6e59c700 1 -- 172.21.15.43:0/4108619298 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7010cdb0 con 0x7f5b7010a450 2024-04-25T13:34:02.762 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.115+0000 7f5b6e59c700 1 --2- 172.21.15.43:0/4108619298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b7010a450 0x7f5b7010c870 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5b600098a0 tx=0x7f5b60009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bed018dda508888 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:02.762 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.115+0000 7f5b6d59a700 1 -- 172.21.15.43:0/4108619298 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b60004160 con 0x7f5b7010a450 2024-04-25T13:34:02.762 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.115+0000 7f5b6d59a700 1 -- 172.21.15.43:0/4108619298 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f5b60004300 con 0x7f5b7010a450 2024-04-25T13:34:02.762 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.115+0000 7f5b6d59a700 1 -- 172.21.15.43:0/4108619298 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b600119e0 con 0x7f5b7010a450 2024-04-25T13:34:02.762 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.115+0000 7f5b74d3c700 1 -- 172.21.15.43:0/4108619298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b7010a450 msgr2=0x7f5b7010c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:02.762 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.115+0000 7f5b74d3c700 1 --2- 172.21.15.43:0/4108619298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b7010a450 0x7f5b7010c870 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5b600098a0 tx=0x7f5b60009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:02.762 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.116+0000 7f5b74d3c700 1 -- 172.21.15.43:0/4108619298 shutdown_connections 2024-04-25T13:34:02.762 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.116+0000 7f5b74d3c700 1 --2- 172.21.15.43:0/4108619298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b7010a450 0x7f5b7010c870 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:02.762 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.116+0000 7f5b74d3c700 1 -- 172.21.15.43:0/4108619298 >> 172.21.15.43:0/4108619298 conn(0x7f5b70103e70 msgr2=0x7f5b70106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:02.762 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.116+0000 7f5b74d3c700 1 -- 172.21.15.43:0/4108619298 shutdown_connections 2024-04-25T13:34:02.762 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.116+0000 7f5b74d3c700 1 -- 172.21.15.43:0/4108619298 wait complete. 2024-04-25T13:34:02.763 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.116+0000 7f5b74d3c700 1 Processor -- start 2024-04-25T13:34:02.763 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.116+0000 7f5b74d3c700 1 -- start start 2024-04-25T13:34:02.763 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.117+0000 7f5b74d3c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b7010a450 0x7f5b70109bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:02.763 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.117+0000 7f5b74d3c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7010dc60 con 0x7f5b7010a450 2024-04-25T13:34:02.763 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.117+0000 7f5b6e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b7010a450 0x7f5b70109bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:02.763 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.117+0000 7f5b6e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b7010a450 0x7f5b70109bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49350/0 (socket says 172.21.15.43:49350) 2024-04-25T13:34:02.763 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.117+0000 7f5b6e59c700 1 -- 172.21.15.43:0/901084032 learned_addr learned my addr 172.21.15.43:0/901084032 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:02.763 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.117+0000 7f5b6e59c700 1 -- 172.21.15.43:0/901084032 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7010a110 con 0x7f5b7010a450 2024-04-25T13:34:02.763 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.117+0000 7f5b6e59c700 1 --2- 172.21.15.43:0/901084032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b7010a450 0x7f5b70109bd0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5b600119b0 tx=0x7f5b60011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:02.763 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.117+0000 7f5b677fe700 1 -- 172.21.15.43:0/901084032 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b60003af0 con 0x7f5b7010a450 2024-04-25T13:34:02.763 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.117+0000 7f5b677fe700 1 -- 172.21.15.43:0/901084032 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f5b6001a8a0 con 0x7f5b7010a450 2024-04-25T13:34:02.763 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.117+0000 7f5b74d3c700 1 -- 172.21.15.43:0/901084032 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b70108360 con 0x7f5b7010a450 2024-04-25T13:34:02.764 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.117+0000 7f5b677fe700 1 -- 172.21.15.43:0/901084032 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b60024830 con 0x7f5b7010a450 2024-04-25T13:34:02.764 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.118+0000 7f5b74d3c700 1 -- 172.21.15.43:0/901084032 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b70108840 con 0x7f5b7010a450 2024-04-25T13:34:02.764 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.118+0000 7f5b677fe700 1 -- 172.21.15.43:0/901084032 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5b60022020 con 0x7f5b7010a450 2024-04-25T13:34:02.764 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.118+0000 7f5b677fe700 1 -- 172.21.15.43:0/901084032 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5b600193c0 con 0x7f5b7010a450 2024-04-25T13:34:02.764 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.118+0000 7f5b74d3c700 1 -- 172.21.15.43:0/901084032 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b70064cf0 con 0x7f5b7010a450 2024-04-25T13:34:02.764 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.121+0000 7f5b677fe700 1 -- 172.21.15.43:0/901084032 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5b60042e50 con 0x7f5b7010a450 2024-04-25T13:34:02.764 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.192+0000 7f5b74d3c700 1 -- 172.21.15.43:0/901084032 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f5b70108ac0 con 0x7f5b7010a450 2024-04-25T13:34:02.764 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.194+0000 7f5b677fe700 1 -- 172.21.15.43:0/901084032 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f5b60031020 con 0x7f5b7010a450 2024-04-25T13:34:02.764 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.195+0000 7f5b74d3c700 1 -- 172.21.15.43:0/901084032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b7010a450 msgr2=0x7f5b70109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:02.764 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.195+0000 7f5b74d3c700 1 --2- 172.21.15.43:0/901084032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b7010a450 0x7f5b70109bd0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5b600119b0 tx=0x7f5b60011a90 comp rx=0 tx=0).stop 2024-04-25T13:34:02.764 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.195+0000 7f5b74d3c700 1 -- 172.21.15.43:0/901084032 shutdown_connections 2024-04-25T13:34:02.765 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.195+0000 7f5b74d3c700 1 --2- 172.21.15.43:0/901084032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b7010a450 0x7f5b70109bd0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:02.765 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.195+0000 7f5b74d3c700 1 -- 172.21.15.43:0/901084032 >> 172.21.15.43:0/901084032 conn(0x7f5b70103e70 msgr2=0x7f5b701046d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:02.765 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.196+0000 7f5b74d3c700 1 -- 172.21.15.43:0/901084032 shutdown_connections 2024-04-25T13:34:02.765 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:02.196+0000 7f5b74d3c700 1 -- 172.21.15.43:0/901084032 wait complete. 2024-04-25T13:34:02.765 INFO:teuthology.orchestra.run.smithi043.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-25T13:34:02.786 INFO:teuthology.orchestra.run.smithi043.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-25T13:34:02.786 INFO:teuthology.orchestra.run.smithi043.stdout:Creating mgr... 2024-04-25T13:34:02.787 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-25T13:34:02.787 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-25T13:34:03.049 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-394efb6c-0308-11ef-bc93-c7b262605968@mgr.x 2024-04-25T13:34:03.049 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Failed to reset failed state of unit ceph-394efb6c-0308-11ef-bc93-c7b262605968@mgr.x.service: Unit ceph-394efb6c-0308-11ef-bc93-c7b262605968@mgr.x.service not loaded. 2024-04-25T13:34:03.207 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-394efb6c-0308-11ef-bc93-c7b262605968.target.wants/ceph-394efb6c-0308-11ef-bc93-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-394efb6c-0308-11ef-bc93-c7b262605968@.service. 2024-04-25T13:34:03.447 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:03 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/901084032' entity='client.admin' 2024-04-25T13:34:03.448 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:03 smithi043 systemd[1]: Starting Ceph mgr.x for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:34:03.709 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:03 smithi043 podman[29411]: 2024-04-25 13:34:03.447459794 +0000 UTC m=+0.121038581 container create e53013c69ed7876d3e71f25132e62942faf8c6e168ca36eabeb11d2147e70a4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-25T13:34:03.709 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:03 smithi043 podman[29411]: 2024-04-25 13:34:03.35563951 +0000 UTC m=+0.029218269 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:34:03.709 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:03 smithi043 podman[29411]: 2024-04-25 13:34:03.633194617 +0000 UTC m=+0.306773366 container init e53013c69ed7876d3e71f25132e62942faf8c6e168ca36eabeb11d2147e70a4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T13:34:03.709 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:03 smithi043 podman[29411]: 2024-04-25 13:34:03.635911735 +0000 UTC m=+0.309490484 container start e53013c69ed7876d3e71f25132e62942faf8c6e168ca36eabeb11d2147e70a4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-25T13:34:03.722 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T13:34:03.723 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout disabled 2024-04-25T13:34:03.730 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T13:34:03.730 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-04-25T13:34:03.730 INFO:teuthology.orchestra.run.smithi043.stdout:firewalld.service is not enabled 2024-04-25T13:34:03.730 INFO:teuthology.orchestra.run.smithi043.stdout:Not possible to enable service . firewalld.service is not available 2024-04-25T13:34:03.738 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T13:34:03.739 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout disabled 2024-04-25T13:34:03.746 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T13:34:03.746 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-04-25T13:34:03.746 INFO:teuthology.orchestra.run.smithi043.stdout:firewalld.service is not enabled 2024-04-25T13:34:03.746 INFO:teuthology.orchestra.run.smithi043.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-25T13:34:03.746 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mgr to start... 2024-04-25T13:34:03.746 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mgr... 2024-04-25T13:34:03.963 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:03 smithi043 bash[29411]: e53013c69ed7876d3e71f25132e62942faf8c6e168ca36eabeb11d2147e70a4f 2024-04-25T13:34:03.963 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:03 smithi043 systemd[1]: Started Ceph mgr.x for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:34:03.964 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:03 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:03.805+0000 7fb96faab200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:34:04.284 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:04 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:04.001+0000 7fb96faab200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:34:04.284 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:04 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:04.108+0000 7fb96faab200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:34:04.582 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:04 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3340066924' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T13:34:04.582 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:04 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:04.440+0000 7fb96faab200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:34:04.582 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:04 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:04.528+0000 7fb96faab200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:34:04.845 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T13:34:04.848 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-04-25T13:34:04.848 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsid": "394efb6c-0308-11ef-bc93-c7b262605968", 2024-04-25T13:34:04.848 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T13:34:04.848 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T13:34:04.848 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T13:34:04.848 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T13:34:04.848 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:04.848 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T13:34:04.848 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T13:34:04.848 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 0 2024-04-25T13:34:04.848 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T13:34:04.849 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T13:34:04.849 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "a" 2024-04-25T13:34:04.849 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T13:34:04.849 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-04-25T13:34:04.849 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T13:34:04.849 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T13:34:04.849 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-25T13:34:04.849 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T13:34:04.849 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:04.849 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T13:34:04.849 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T13:34:04.849 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T13:34:04.849 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T13:34:04.849 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T13:34:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T13:34:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T13:34:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T13:34:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T13:34:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T13:34:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T13:34:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T13:34:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T13:34:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T13:34:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T13:34:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T13:34:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T13:34:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:04.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T13:34:04.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T13:34:04.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T13:34:04.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T13:34:04.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:04.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T13:34:04.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-25T13:34:04.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T13:34:04.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T13:34:04.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T13:34:04.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T13:34:04.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T13:34:04.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T13:34:04.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T13:34:04.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:04.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T13:34:04.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T13:34:04.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T13:33:57.051723+0000", 2024-04-25T13:34:04.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T13:34:04.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:04.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T13:34:04.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-04-25T13:34:04.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.200+0000 7f43d2c5b700 1 Processor -- start 2024-04-25T13:34:04.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.200+0000 7f43d2c5b700 1 -- start start 2024-04-25T13:34:04.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.200+0000 7f43d2c5b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43cc1087c0 0x7f43cc108bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:04.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.200+0000 7f43d2c5b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc1091c0 con 0x7f43cc1087c0 2024-04-25T13:34:04.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.200+0000 7f43d09f7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43cc1087c0 0x7f43cc108bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:04.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.201+0000 7f43d09f7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43cc1087c0 0x7f43cc108bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49388/0 (socket says 172.21.15.43:49388) 2024-04-25T13:34:04.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.201+0000 7f43d09f7700 1 -- 172.21.15.43:0/925223553 learned_addr learned my addr 172.21.15.43:0/925223553 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:04.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.201+0000 7f43d09f7700 1 -- 172.21.15.43:0/925223553 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc109990 con 0x7f43cc1087c0 2024-04-25T13:34:04.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.201+0000 7f43d09f7700 1 --2- 172.21.15.43:0/925223553 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43cc1087c0 0x7f43cc108bd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f43c00098a0 tx=0x7f43c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f73f3d96d71122 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:04.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.201+0000 7f43cb7fe700 1 -- 172.21.15.43:0/925223553 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43c0004160 con 0x7f43cc1087c0 2024-04-25T13:34:04.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.201+0000 7f43cb7fe700 1 -- 172.21.15.43:0/925223553 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f43c0004300 con 0x7f43cc1087c0 2024-04-25T13:34:04.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.201+0000 7f43cb7fe700 1 -- 172.21.15.43:0/925223553 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43c00119e0 con 0x7f43cc1087c0 2024-04-25T13:34:04.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.202+0000 7f43d2c5b700 1 -- 172.21.15.43:0/925223553 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43cc1087c0 msgr2=0x7f43cc108bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:04.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.202+0000 7f43d2c5b700 1 --2- 172.21.15.43:0/925223553 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43cc1087c0 0x7f43cc108bd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f43c00098a0 tx=0x7f43c0009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:04.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.202+0000 7f43d2c5b700 1 -- 172.21.15.43:0/925223553 shutdown_connections 2024-04-25T13:34:04.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.202+0000 7f43d2c5b700 1 --2- 172.21.15.43:0/925223553 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43cc1087c0 0x7f43cc108bd0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:04.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.202+0000 7f43d2c5b700 1 -- 172.21.15.43:0/925223553 >> 172.21.15.43:0/925223553 conn(0x7f43cc103e40 msgr2=0x7f43cc1062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:04.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.202+0000 7f43d2c5b700 1 -- 172.21.15.43:0/925223553 shutdown_connections 2024-04-25T13:34:04.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.202+0000 7f43d2c5b700 1 -- 172.21.15.43:0/925223553 wait complete. 2024-04-25T13:34:04.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.203+0000 7f43d2c5b700 1 Processor -- start 2024-04-25T13:34:04.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.203+0000 7f43d2c5b700 1 -- start start 2024-04-25T13:34:04.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.204+0000 7f43d2c5b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43cc1087c0 0x7f43cc19cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:04.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.204+0000 7f43d2c5b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc10cd40 con 0x7f43cc1087c0 2024-04-25T13:34:04.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.204+0000 7f43d09f7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43cc1087c0 0x7f43cc19cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:04.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.204+0000 7f43d09f7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43cc1087c0 0x7f43cc19cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49400/0 (socket says 172.21.15.43:49400) 2024-04-25T13:34:04.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.204+0000 7f43d09f7700 1 -- 172.21.15.43:0/3340066924 learned_addr learned my addr 172.21.15.43:0/3340066924 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:04.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.204+0000 7f43d09f7700 1 -- 172.21.15.43:0/3340066924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc19d080 con 0x7f43cc1087c0 2024-04-25T13:34:04.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.204+0000 7f43d09f7700 1 --2- 172.21.15.43:0/3340066924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43cc1087c0 0x7f43cc19cb40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009fb0 tx=0x7f43c0011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:04.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.204+0000 7f43c9ffb700 1 -- 172.21.15.43:0/3340066924 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43c00038b0 con 0x7f43cc1087c0 2024-04-25T13:34:04.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.204+0000 7f43c9ffb700 1 -- 172.21.15.43:0/3340066924 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f43c0003a50 con 0x7f43cc1087c0 2024-04-25T13:34:04.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.204+0000 7f43d2c5b700 1 -- 172.21.15.43:0/3340066924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43cc19d310 con 0x7f43cc1087c0 2024-04-25T13:34:04.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.204+0000 7f43c9ffb700 1 -- 172.21.15.43:0/3340066924 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43c0019550 con 0x7f43cc1087c0 2024-04-25T13:34:04.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.205+0000 7f43d2c5b700 1 -- 172.21.15.43:0/3340066924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43cc19ff20 con 0x7f43cc1087c0 2024-04-25T13:34:04.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.206+0000 7f43c9ffb700 1 -- 172.21.15.43:0/3340066924 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f43c0019be0 con 0x7f43cc1087c0 2024-04-25T13:34:04.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.206+0000 7f43c9ffb700 1 -- 172.21.15.43:0/3340066924 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f43c0024730 con 0x7f43cc1087c0 2024-04-25T13:34:04.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.206+0000 7f43d2c5b700 1 -- 172.21.15.43:0/3340066924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43cc064cf0 con 0x7f43cc1087c0 2024-04-25T13:34:04.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.208+0000 7f43c9ffb700 1 -- 172.21.15.43:0/3340066924 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f43c0043e50 con 0x7f43cc1087c0 2024-04-25T13:34:04.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.282+0000 7f43d2c5b700 1 -- 172.21.15.43:0/3340066924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f43cc1a00f0 con 0x7f43cc1087c0 2024-04-25T13:34:04.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.283+0000 7f43c9ffb700 1 -- 172.21.15.43:0/3340066924 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f43c0032030 con 0x7f43cc1087c0 2024-04-25T13:34:04.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.284+0000 7f43d2c5b700 1 -- 172.21.15.43:0/3340066924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43cc1087c0 msgr2=0x7f43cc19cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:04.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.284+0000 7f43d2c5b700 1 --2- 172.21.15.43:0/3340066924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43cc1087c0 0x7f43cc19cb40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009fb0 tx=0x7f43c0011a60 comp rx=0 tx=0).stop 2024-04-25T13:34:04.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.284+0000 7f43d2c5b700 1 -- 172.21.15.43:0/3340066924 shutdown_connections 2024-04-25T13:34:04.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.284+0000 7f43d2c5b700 1 --2- 172.21.15.43:0/3340066924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43cc1087c0 0x7f43cc19cb40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:04.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.284+0000 7f43d2c5b700 1 -- 172.21.15.43:0/3340066924 >> 172.21.15.43:0/3340066924 conn(0x7f43cc103e40 msgr2=0x7f43cc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:04.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.284+0000 7f43d2c5b700 1 -- 172.21.15.43:0/3340066924 shutdown_connections 2024-04-25T13:34:04.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:04.284+0000 7f43d2c5b700 1 -- 172.21.15.43:0/3340066924 wait complete. 2024-04-25T13:34:04.862 INFO:teuthology.orchestra.run.smithi043.stdout:mgr not available, waiting (1/15)... 2024-04-25T13:34:06.136 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:05 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:05.784+0000 7fb96faab200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:34:06.136 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:05 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:05.959+0000 7fb96faab200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:34:06.136 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:06 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:06.135+0000 7fb96faab200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:34:06.713 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:06 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:06.431+0000 7fb96faab200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:34:06.713 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:06 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:06.526+0000 7fb96faab200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:34:07.082 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:06 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:06.736+0000 7fb96faab200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:34:07.082 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:06 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:06.940+0000 7fb96faab200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:34:07.690 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:07 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3673509965' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T13:34:07.691 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:07 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:07.584+0000 7fb96faab200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T13:34:07.969 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T13:34:07.969 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-04-25T13:34:07.969 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsid": "394efb6c-0308-11ef-bc93-c7b262605968", 2024-04-25T13:34:07.969 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T13:34:07.969 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T13:34:07.969 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T13:34:07.969 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T13:34:07.970 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:07.970 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T13:34:07.970 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T13:34:07.970 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 0 2024-04-25T13:34:07.970 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T13:34:07.970 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T13:34:07.970 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "a" 2024-04-25T13:34:07.970 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T13:34:07.970 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-04-25T13:34:07.971 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T13:34:07.971 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T13:34:07.971 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-25T13:34:07.971 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T13:34:07.971 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:07.971 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T13:34:07.971 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T13:34:07.971 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T13:34:07.972 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T13:34:07.972 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T13:34:07.972 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T13:34:07.972 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T13:34:07.972 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T13:34:07.972 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:07.972 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T13:34:07.972 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T13:34:07.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T13:34:07.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T13:34:07.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T13:34:07.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T13:34:07.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T13:34:07.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T13:34:07.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T13:34:07.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:07.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T13:34:07.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T13:34:07.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T13:34:07.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T13:34:07.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:07.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T13:34:07.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-25T13:34:07.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T13:34:07.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T13:34:07.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T13:34:07.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T13:34:07.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T13:34:07.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T13:34:07.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T13:34:07.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:07.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T13:34:07.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T13:34:07.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T13:33:57.051723+0000", 2024-04-25T13:34:07.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T13:34:07.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:07.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T13:34:07.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-04-25T13:34:07.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.298+0000 7f9de4fe2700 1 Processor -- start 2024-04-25T13:34:07.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.298+0000 7f9de4fe2700 1 -- start start 2024-04-25T13:34:07.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.298+0000 7f9de4fe2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9de01087c0 0x7f9de0108bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:07.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.298+0000 7f9de4fe2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9de01091c0 con 0x7f9de01087c0 2024-04-25T13:34:07.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.298+0000 7f9dde59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9de01087c0 0x7f9de0108bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:07.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.298+0000 7f9dde59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9de01087c0 0x7f9de0108bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49410/0 (socket says 172.21.15.43:49410) 2024-04-25T13:34:07.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.298+0000 7f9dde59c700 1 -- 172.21.15.43:0/456296744 learned_addr learned my addr 172.21.15.43:0/456296744 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:07.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.298+0000 7f9dde59c700 1 -- 172.21.15.43:0/456296744 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de0109990 con 0x7f9de01087c0 2024-04-25T13:34:07.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.299+0000 7f9dde59c700 1 --2- 172.21.15.43:0/456296744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9de01087c0 0x7f9de0108bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00098a0 tx=0x7f9dd0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278dba36f542a4c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:07.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.299+0000 7f9dddd9b700 1 -- 172.21.15.43:0/456296744 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dd0004160 con 0x7f9de01087c0 2024-04-25T13:34:07.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.299+0000 7f9dddd9b700 1 -- 172.21.15.43:0/456296744 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f9dd0004300 con 0x7f9de01087c0 2024-04-25T13:34:07.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.299+0000 7f9dddd9b700 1 -- 172.21.15.43:0/456296744 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dd00119e0 con 0x7f9de01087c0 2024-04-25T13:34:07.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.300+0000 7f9de4fe2700 1 -- 172.21.15.43:0/456296744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9de01087c0 msgr2=0x7f9de0108bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:07.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.300+0000 7f9de4fe2700 1 --2- 172.21.15.43:0/456296744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9de01087c0 0x7f9de0108bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00098a0 tx=0x7f9dd0009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:07.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.300+0000 7f9de4fe2700 1 -- 172.21.15.43:0/456296744 shutdown_connections 2024-04-25T13:34:07.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.300+0000 7f9de4fe2700 1 --2- 172.21.15.43:0/456296744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9de01087c0 0x7f9de0108bd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:07.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.300+0000 7f9de4fe2700 1 -- 172.21.15.43:0/456296744 >> 172.21.15.43:0/456296744 conn(0x7f9de0103e40 msgr2=0x7f9de01062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:07.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.300+0000 7f9de4fe2700 1 -- 172.21.15.43:0/456296744 shutdown_connections 2024-04-25T13:34:07.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.300+0000 7f9de4fe2700 1 -- 172.21.15.43:0/456296744 wait complete. 2024-04-25T13:34:07.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.301+0000 7f9de4fe2700 1 Processor -- start 2024-04-25T13:34:07.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.301+0000 7f9de4fe2700 1 -- start start 2024-04-25T13:34:07.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.301+0000 7f9de4fe2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9de01087c0 0x7f9de019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:07.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.301+0000 7f9de4fe2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9de010cd40 con 0x7f9de01087c0 2024-04-25T13:34:07.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.301+0000 7f9dde59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9de01087c0 0x7f9de019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:07.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.301+0000 7f9dde59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9de01087c0 0x7f9de019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49412/0 (socket says 172.21.15.43:49412) 2024-04-25T13:34:07.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.301+0000 7f9dde59c700 1 -- 172.21.15.43:0/3673509965 learned_addr learned my addr 172.21.15.43:0/3673509965 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:07.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.302+0000 7f9dde59c700 1 -- 172.21.15.43:0/3673509965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de019e120 con 0x7f9de01087c0 2024-04-25T13:34:07.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.302+0000 7f9dde59c700 1 --2- 172.21.15.43:0/3673509965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9de01087c0 0x7f9de019dbe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00119b0 tx=0x7f9dd0011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:07.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.302+0000 7f9dd77fe700 1 -- 172.21.15.43:0/3673509965 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dd0003970 con 0x7f9de01087c0 2024-04-25T13:34:07.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.302+0000 7f9de4fe2700 1 -- 172.21.15.43:0/3673509965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de019e3b0 con 0x7f9de01087c0 2024-04-25T13:34:07.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.302+0000 7f9dd77fe700 1 -- 172.21.15.43:0/3673509965 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f9dd0003b10 con 0x7f9de01087c0 2024-04-25T13:34:07.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.302+0000 7f9dd77fe700 1 -- 172.21.15.43:0/3673509965 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dd0024610 con 0x7f9de01087c0 2024-04-25T13:34:07.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.302+0000 7f9de4fe2700 1 -- 172.21.15.43:0/3673509965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de01a0fc0 con 0x7f9de01087c0 2024-04-25T13:34:07.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.302+0000 7f9dd77fe700 1 -- 172.21.15.43:0/3673509965 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9dd0024c10 con 0x7f9de01087c0 2024-04-25T13:34:07.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.302+0000 7f9dd77fe700 1 -- 172.21.15.43:0/3673509965 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9dd0019700 con 0x7f9de01087c0 2024-04-25T13:34:07.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.303+0000 7f9de4fe2700 1 -- 172.21.15.43:0/3673509965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9de0064cf0 con 0x7f9de01087c0 2024-04-25T13:34:07.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.305+0000 7f9dd77fe700 1 -- 172.21.15.43:0/3673509965 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9dd001aae0 con 0x7f9de01087c0 2024-04-25T13:34:07.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.378+0000 7f9de4fe2700 1 -- 172.21.15.43:0/3673509965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f9de002e810 con 0x7f9de01087c0 2024-04-25T13:34:07.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.379+0000 7f9dd77fe700 1 -- 172.21.15.43:0/3673509965 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f9dd00094f0 con 0x7f9de01087c0 2024-04-25T13:34:07.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.380+0000 7f9de4fe2700 1 -- 172.21.15.43:0/3673509965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9de01087c0 msgr2=0x7f9de019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:07.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.380+0000 7f9de4fe2700 1 --2- 172.21.15.43:0/3673509965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9de01087c0 0x7f9de019dbe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00119b0 tx=0x7f9dd0011a90 comp rx=0 tx=0).stop 2024-04-25T13:34:07.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.380+0000 7f9de4fe2700 1 -- 172.21.15.43:0/3673509965 shutdown_connections 2024-04-25T13:34:07.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.380+0000 7f9de4fe2700 1 --2- 172.21.15.43:0/3673509965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9de01087c0 0x7f9de019dbe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:07.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.380+0000 7f9de4fe2700 1 -- 172.21.15.43:0/3673509965 >> 172.21.15.43:0/3673509965 conn(0x7f9de0103e40 msgr2=0x7f9de0194190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:07.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.380+0000 7f9de4fe2700 1 -- 172.21.15.43:0/3673509965 shutdown_connections 2024-04-25T13:34:07.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:07.380+0000 7f9de4fe2700 1 -- 172.21.15.43:0/3673509965 wait complete. 2024-04-25T13:34:07.979 INFO:teuthology.orchestra.run.smithi043.stdout:mgr not available, waiting (2/15)... 2024-04-25T13:34:08.213 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:08 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:08.025+0000 7fb96faab200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:34:08.213 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:08 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:08.123+0000 7fb96faab200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:34:08.713 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:08 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:08.330+0000 7fb96faab200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T13:34:09.213 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:08 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:08.872+0000 7fb96faab200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:34:09.214 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:08 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:08.968+0000 7fb96faab200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:34:09.580 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:09 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:09.220+0000 7fb96faab200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:34:09.581 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:09 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:09.359+0000 7fb96faab200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:34:09.581 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:09 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:09.458+0000 7fb96faab200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:34:09.581 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:09 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:09.579+0000 7fb96faab200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:34:10.213 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:09 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:09.894+0000 7fb96faab200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:34:10.806 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:10 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:10.529+0000 7fb96faab200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:34:10.806 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:10 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:10.752+0000 7fb96faab200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:34:11.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:10 smithi043 ceph-mon[29195]: Activating manager daemon x 2024-04-25T13:34:11.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:10 smithi043 ceph-mon[29195]: mgrmap e2: x(active, starting, since 0.00365554s) 2024-04-25T13:34:11.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:10 smithi043 ceph-mon[29195]: from='mgr.14100 172.21.15.43:0/4029887005' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T13:34:11.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:10 smithi043 ceph-mon[29195]: from='mgr.14100 172.21.15.43:0/4029887005' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T13:34:11.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:10 smithi043 ceph-mon[29195]: from='mgr.14100 172.21.15.43:0/4029887005' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T13:34:11.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:10 smithi043 ceph-mon[29195]: from='mgr.14100 172.21.15.43:0/4029887005' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:34:11.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:10 smithi043 ceph-mon[29195]: from='mgr.14100 172.21.15.43:0/4029887005' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T13:34:11.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:10 smithi043 ceph-mon[29195]: Manager daemon x is now available 2024-04-25T13:34:11.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:10 smithi043 ceph-mon[29195]: from='mgr.14100 172.21.15.43:0/4029887005' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T13:34:11.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:10 smithi043 ceph-mon[29195]: from='mgr.14100 172.21.15.43:0/4029887005' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T13:34:11.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:10 smithi043 ceph-mon[29195]: from='mgr.14100 172.21.15.43:0/4029887005' entity='mgr.x' 2024-04-25T13:34:11.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:10 smithi043 ceph-mon[29195]: from='mgr.14100 172.21.15.43:0/4029887005' entity='mgr.x' 2024-04-25T13:34:11.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:10 smithi043 ceph-mon[29195]: from='mgr.14100 172.21.15.43:0/4029887005' entity='mgr.x' 2024-04-25T13:34:13.026 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:12 smithi043 ceph-mon[29195]: mgrmap e3: x(active, since 1.00852s) 2024-04-25T13:34:13.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:13 smithi043 ceph-mon[29195]: mgrmap e4: x(active, since 2s) 2024-04-25T13:34:13.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:13 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2993525198' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T13:34:19.600 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T13:34:19.601 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-04-25T13:34:19.601 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsid": "394efb6c-0308-11ef-bc93-c7b262605968", 2024-04-25T13:34:19.601 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T13:34:19.601 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T13:34:19.601 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T13:34:19.601 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T13:34:19.601 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:19.601 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T13:34:19.601 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T13:34:19.601 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 0 2024-04-25T13:34:19.602 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T13:34:19.602 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T13:34:19.602 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "a" 2024-04-25T13:34:19.602 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T13:34:19.602 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-04-25T13:34:19.602 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T13:34:19.602 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T13:34:19.602 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-25T13:34:19.602 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T13:34:19.602 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:19.602 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T13:34:19.602 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T13:34:19.602 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T13:34:19.602 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T13:34:19.603 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T13:34:19.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T13:34:19.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T13:34:19.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T13:34:19.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:19.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T13:34:19.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T13:34:19.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T13:34:19.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T13:34:19.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T13:34:19.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T13:34:19.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T13:34:19.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T13:34:19.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T13:34:19.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:19.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T13:34:19.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T13:34:19.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T13:34:19.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T13:34:19.612 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T13:34:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T13:34:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T13:34:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T13:34:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T13:34:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T13:34:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T13:34:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T13:34:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T13:34:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T13:34:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T13:34:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T13:33:57.051723+0000", 2024-04-25T13:34:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T13:34:19.614 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T13:34:19.614 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T13:34:19.614 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-04-25T13:34:19.614 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.025+0000 7f91c3a96700 1 Processor -- start 2024-04-25T13:34:19.614 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.025+0000 7f91c3a96700 1 -- start start 2024-04-25T13:34:19.614 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.025+0000 7f91c3a96700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91bc07f7c0 0x7f91bc07dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:19.614 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.025+0000 7f91c3a96700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc07e180 con 0x7f91bc07f7c0 2024-04-25T13:34:19.614 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.026+0000 7f91c1832700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91bc07f7c0 0x7f91bc07dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:19.614 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.026+0000 7f91c1832700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91bc07f7c0 0x7f91bc07dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60044/0 (socket says 172.21.15.43:60044) 2024-04-25T13:34:19.614 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.026+0000 7f91c1832700 1 -- 172.21.15.43:0/3604890890 learned_addr learned my addr 172.21.15.43:0/3604890890 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:19.614 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.026+0000 7f91c1832700 1 -- 172.21.15.43:0/3604890890 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91bc07e300 con 0x7f91bc07f7c0 2024-04-25T13:34:19.614 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.026+0000 7f91c1832700 1 --2- 172.21.15.43:0/3604890890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91bc07f7c0 0x7f91bc07dc40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f91b80098a0 tx=0x7f91b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e275ce89bf75d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:19.614 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.026+0000 7f91c0830700 1 -- 172.21.15.43:0/3604890890 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b8004160 con 0x7f91bc07f7c0 2024-04-25T13:34:19.615 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.026+0000 7f91c0830700 1 -- 172.21.15.43:0/3604890890 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f91b8004300 con 0x7f91bc07f7c0 2024-04-25T13:34:19.615 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.026+0000 7f91c0830700 1 -- 172.21.15.43:0/3604890890 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b80119e0 con 0x7f91bc07f7c0 2024-04-25T13:34:19.615 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.027+0000 7f91c3a96700 1 -- 172.21.15.43:0/3604890890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91bc07f7c0 msgr2=0x7f91bc07dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:19.615 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.027+0000 7f91c3a96700 1 --2- 172.21.15.43:0/3604890890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91bc07f7c0 0x7f91bc07dc40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f91b80098a0 tx=0x7f91b8009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:19.615 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.027+0000 7f91c3a96700 1 -- 172.21.15.43:0/3604890890 shutdown_connections 2024-04-25T13:34:19.615 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.027+0000 7f91c3a96700 1 --2- 172.21.15.43:0/3604890890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91bc07f7c0 0x7f91bc07dc40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:19.615 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.027+0000 7f91c3a96700 1 -- 172.21.15.43:0/3604890890 >> 172.21.15.43:0/3604890890 conn(0x7f91bc104f90 msgr2=0x7f91bc1073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:19.615 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.027+0000 7f91c3a96700 1 -- 172.21.15.43:0/3604890890 shutdown_connections 2024-04-25T13:34:19.615 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.027+0000 7f91c3a96700 1 -- 172.21.15.43:0/3604890890 wait complete. 2024-04-25T13:34:19.615 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.028+0000 7f91c3a96700 1 Processor -- start 2024-04-25T13:34:19.615 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.028+0000 7f91c3a96700 1 -- start start 2024-04-25T13:34:19.615 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.028+0000 7f91c3a96700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91bc07f7c0 0x7f91bc19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:19.616 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.028+0000 7f91c3a96700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc10fe70 con 0x7f91bc07f7c0 2024-04-25T13:34:19.616 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.028+0000 7f91c1832700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91bc07f7c0 0x7f91bc19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:19.616 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.028+0000 7f91c1832700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91bc07f7c0 0x7f91bc19fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60046/0 (socket says 172.21.15.43:60046) 2024-04-25T13:34:19.616 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.028+0000 7f91c1832700 1 -- 172.21.15.43:0/2993525198 learned_addr learned my addr 172.21.15.43:0/2993525198 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:19.616 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.029+0000 7f91c1832700 1 -- 172.21.15.43:0/2993525198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91bc1a02a0 con 0x7f91bc07f7c0 2024-04-25T13:34:19.616 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.029+0000 7f91c1832700 1 --2- 172.21.15.43:0/2993525198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91bc07f7c0 0x7f91bc19fd60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f91b80116a0 tx=0x7f91b8011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:19.616 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.029+0000 7f91b2ffd700 1 -- 172.21.15.43:0/2993525198 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b80039f0 con 0x7f91bc07f7c0 2024-04-25T13:34:19.616 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.029+0000 7f91c3a96700 1 -- 172.21.15.43:0/2993525198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91bc1a0530 con 0x7f91bc07f7c0 2024-04-25T13:34:19.616 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.029+0000 7f91b2ffd700 1 -- 172.21.15.43:0/2993525198 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f91b8003b90 con 0x7f91bc07f7c0 2024-04-25T13:34:19.616 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.029+0000 7f91b2ffd700 1 -- 172.21.15.43:0/2993525198 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b801a600 con 0x7f91bc07f7c0 2024-04-25T13:34:19.616 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.029+0000 7f91c3a96700 1 -- 172.21.15.43:0/2993525198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91bc1a3130 con 0x7f91bc07f7c0 2024-04-25T13:34:19.616 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.030+0000 7f91b2ffd700 1 -- 172.21.15.43:0/2993525198 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) ==== 49505+0+0 (secure 0 0 0) 0x7f91b801a8b0 con 0x7f91bc07f7c0 2024-04-25T13:34:19.616 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.030+0000 7f91c3a96700 1 -- 172.21.15.43:0/2993525198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91bc064cf0 con 0x7f91bc07f7c0 2024-04-25T13:34:19.616 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.030+0000 7f91b2ffd700 1 --2- 172.21.15.43:0/2993525198 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f91a803d5e0 0x7f91a803faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:19.617 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.030+0000 7f91b2ffd700 1 -- 172.21.15.43:0/2993525198 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f91b8052990 con 0x7f91bc07f7c0 2024-04-25T13:34:19.617 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.030+0000 7f91c1031700 1 --2- 172.21.15.43:0/2993525198 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f91a803d5e0 0x7f91a803faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:19.617 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.031+0000 7f91c1031700 1 --2- 172.21.15.43:0/2993525198 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f91a803d5e0 0x7f91a803faf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f91ac006fd0 tx=0x7f91ac006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:19.617 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.036+0000 7f91b2ffd700 1 -- 172.21.15.43:0/2993525198 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f91b802c350 con 0x7f91bc07f7c0 2024-04-25T13:34:19.617 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.328+0000 7f91c3a96700 1 -- 172.21.15.43:0/2993525198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f91bc1a37b0 con 0x7f91bc07f7c0 2024-04-25T13:34:19.617 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.328+0000 7f91b2ffd700 1 -- 172.21.15.43:0/2993525198 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f91b800e260 con 0x7f91bc07f7c0 2024-04-25T13:34:19.617 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.330+0000 7f91c3a96700 1 -- 172.21.15.43:0/2993525198 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f91a803d5e0 msgr2=0x7f91a803faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:19.617 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.330+0000 7f91c3a96700 1 --2- 172.21.15.43:0/2993525198 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f91a803d5e0 0x7f91a803faf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f91ac006fd0 tx=0x7f91ac006e40 comp rx=0 tx=0).stop 2024-04-25T13:34:19.617 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.330+0000 7f91c3a96700 1 -- 172.21.15.43:0/2993525198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91bc07f7c0 msgr2=0x7f91bc19fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:19.617 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.330+0000 7f91c3a96700 1 --2- 172.21.15.43:0/2993525198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91bc07f7c0 0x7f91bc19fd60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f91b80116a0 tx=0x7f91b8011a60 comp rx=0 tx=0).stop 2024-04-25T13:34:19.617 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.330+0000 7f91c3a96700 1 -- 172.21.15.43:0/2993525198 shutdown_connections 2024-04-25T13:34:19.617 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.330+0000 7f91c3a96700 1 --2- 172.21.15.43:0/2993525198 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f91a803d5e0 0x7f91a803faf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:19.617 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.330+0000 7f91c3a96700 1 --2- 172.21.15.43:0/2993525198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91bc07f7c0 0x7f91bc19fd60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:19.617 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.330+0000 7f91c3a96700 1 -- 172.21.15.43:0/2993525198 >> 172.21.15.43:0/2993525198 conn(0x7f91bc104f90 msgr2=0x7f91bc1057d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:19.617 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.331+0000 7f91c3a96700 1 -- 172.21.15.43:0/2993525198 shutdown_connections 2024-04-25T13:34:19.618 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:13.331+0000 7f91c3a96700 1 -- 172.21.15.43:0/2993525198 wait complete. 2024-04-25T13:34:19.618 INFO:teuthology.orchestra.run.smithi043.stdout:mgr is available 2024-04-25T13:34:22.018 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:21 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3444604160' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-25T13:34:22.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T13:34:22.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [global] 2024-04-25T13:34:22.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout fsid = 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:34:22.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-25T13:34:22.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-25T13:34:22.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-25T13:34:22.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-25T13:34:22.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-25T13:34:22.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T13:34:22.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-25T13:34:22.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-25T13:34:22.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T13:34:22.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [osd] 2024-04-25T13:34:22.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-25T13:34:22.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-25T13:34:22.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-25T13:34:22.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-25T13:34:22.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-25T13:34:22.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.496+0000 7f495e4f9700 1 Processor -- start 2024-04-25T13:34:22.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.496+0000 7f495e4f9700 1 -- start start 2024-04-25T13:34:22.289 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.496+0000 7f495e4f9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49581098f0 0x7f4958109d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:22.289 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.496+0000 7f495e4f9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f495810a2f0 con 0x7f49581098f0 2024-04-25T13:34:22.289 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.496+0000 7f4957fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49581098f0 0x7f4958109d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:22.289 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.496+0000 7f4957fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49581098f0 0x7f4958109d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59698/0 (socket says 172.21.15.43:59698) 2024-04-25T13:34:22.289 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.496+0000 7f4957fff700 1 -- 172.21.15.43:0/3673759627 learned_addr learned my addr 172.21.15.43:0/3673759627 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:22.289 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.497+0000 7f4957fff700 1 -- 172.21.15.43:0/3673759627 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495810aac0 con 0x7f49581098f0 2024-04-25T13:34:22.289 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.497+0000 7f4957fff700 1 --2- 172.21.15.43:0/3673759627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49581098f0 0x7f4958109d00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f49480098a0 tx=0x7f4948009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57675bf3a7efd0c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:22.289 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.497+0000 7f4956ffd700 1 -- 172.21.15.43:0/3673759627 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4948004160 con 0x7f49581098f0 2024-04-25T13:34:22.289 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.497+0000 7f4956ffd700 1 -- 172.21.15.43:0/3673759627 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4948004300 con 0x7f49581098f0 2024-04-25T13:34:22.289 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.497+0000 7f4956ffd700 1 -- 172.21.15.43:0/3673759627 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49480119e0 con 0x7f49581098f0 2024-04-25T13:34:22.289 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.498+0000 7f495e4f9700 1 -- 172.21.15.43:0/3673759627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49581098f0 msgr2=0x7f4958109d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:22.289 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.498+0000 7f495e4f9700 1 --2- 172.21.15.43:0/3673759627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49581098f0 0x7f4958109d00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f49480098a0 tx=0x7f4948009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:22.289 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.498+0000 7f495e4f9700 1 -- 172.21.15.43:0/3673759627 shutdown_connections 2024-04-25T13:34:22.289 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.498+0000 7f495e4f9700 1 --2- 172.21.15.43:0/3673759627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49581098f0 0x7f4958109d00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:22.290 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.498+0000 7f495e4f9700 1 -- 172.21.15.43:0/3673759627 >> 172.21.15.43:0/3673759627 conn(0x7f4958104f50 msgr2=0x7f49581073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:22.290 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.498+0000 7f495e4f9700 1 -- 172.21.15.43:0/3673759627 shutdown_connections 2024-04-25T13:34:22.290 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.498+0000 7f495e4f9700 1 -- 172.21.15.43:0/3673759627 wait complete. 2024-04-25T13:34:22.290 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.498+0000 7f495e4f9700 1 Processor -- start 2024-04-25T13:34:22.290 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.499+0000 7f495e4f9700 1 -- start start 2024-04-25T13:34:22.290 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.499+0000 7f495e4f9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49581098f0 0x7f495819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:22.290 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.499+0000 7f495e4f9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f495810de70 con 0x7f49581098f0 2024-04-25T13:34:22.290 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.499+0000 7f4957fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49581098f0 0x7f495819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:22.290 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.499+0000 7f4957fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49581098f0 0x7f495819dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59706/0 (socket says 172.21.15.43:59706) 2024-04-25T13:34:22.290 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.499+0000 7f4957fff700 1 -- 172.21.15.43:0/3444604160 learned_addr learned my addr 172.21.15.43:0/3444604160 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:22.290 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.499+0000 7f4957fff700 1 -- 172.21.15.43:0/3444604160 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495819e130 con 0x7f49581098f0 2024-04-25T13:34:22.290 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.499+0000 7f4957fff700 1 --2- 172.21.15.43:0/3444604160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49581098f0 0x7f495819dbf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f49480119b0 tx=0x7f4948011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:22.290 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.500+0000 7f49557fa700 1 -- 172.21.15.43:0/3444604160 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4948003970 con 0x7f49581098f0 2024-04-25T13:34:22.290 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.500+0000 7f49557fa700 1 -- 172.21.15.43:0/3444604160 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4948003b10 con 0x7f49581098f0 2024-04-25T13:34:22.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.500+0000 7f49557fa700 1 -- 172.21.15.43:0/3444604160 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4948024610 con 0x7f49581098f0 2024-04-25T13:34:22.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.500+0000 7f495e4f9700 1 -- 172.21.15.43:0/3444604160 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495819e3c0 con 0x7f49581098f0 2024-04-25T13:34:22.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.500+0000 7f495e4f9700 1 -- 172.21.15.43:0/3444604160 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49581a0fd0 con 0x7f49581098f0 2024-04-25T13:34:22.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.501+0000 7f495e4f9700 1 -- 172.21.15.43:0/3444604160 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4958064cf0 con 0x7f49581098f0 2024-04-25T13:34:22.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.501+0000 7f49557fa700 1 -- 172.21.15.43:0/3444604160 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) ==== 49505+0+0 (secure 0 0 0) 0x7f494802d3f0 con 0x7f49581098f0 2024-04-25T13:34:22.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.501+0000 7f49557fa700 1 --2- 172.21.15.43:0/3444604160 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f494003d630 0x7f494003fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:22.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.501+0000 7f49557fa700 1 -- 172.21.15.43:0/3444604160 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f49480526f0 con 0x7f49581098f0 2024-04-25T13:34:22.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.501+0000 7f49577fe700 1 --2- 172.21.15.43:0/3444604160 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f494003d630 0x7f494003fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:22.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.502+0000 7f49577fe700 1 --2- 172.21.15.43:0/3444604160 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f494003d630 0x7f494003fb40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f494c006fd0 tx=0x7f494c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:22.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.506+0000 7f49557fa700 1 -- 172.21.15.43:0/3444604160 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f49480094f0 con 0x7f49581098f0 2024-04-25T13:34:22.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.713+0000 7f495e4f9700 1 -- 172.21.15.43:0/3444604160 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f49581a27d0 con 0x7f49581098f0 2024-04-25T13:34:22.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.715+0000 7f49557fa700 1 -- 172.21.15.43:0/3444604160 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7f4948029df0 con 0x7f49581098f0 2024-04-25T13:34:22.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.717+0000 7f495e4f9700 1 -- 172.21.15.43:0/3444604160 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f494003d630 msgr2=0x7f494003fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:22.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.717+0000 7f495e4f9700 1 --2- 172.21.15.43:0/3444604160 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f494003d630 0x7f494003fb40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f494c006fd0 tx=0x7f494c006e40 comp rx=0 tx=0).stop 2024-04-25T13:34:22.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.717+0000 7f495e4f9700 1 -- 172.21.15.43:0/3444604160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49581098f0 msgr2=0x7f495819dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:22.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.717+0000 7f495e4f9700 1 --2- 172.21.15.43:0/3444604160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49581098f0 0x7f495819dbf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f49480119b0 tx=0x7f4948011a90 comp rx=0 tx=0).stop 2024-04-25T13:34:22.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.717+0000 7f495e4f9700 1 -- 172.21.15.43:0/3444604160 shutdown_connections 2024-04-25T13:34:22.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.717+0000 7f495e4f9700 1 --2- 172.21.15.43:0/3444604160 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f494003d630 0x7f494003fb40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:22.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.717+0000 7f495e4f9700 1 --2- 172.21.15.43:0/3444604160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49581098f0 0x7f495819dbf0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:22.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.717+0000 7f495e4f9700 1 -- 172.21.15.43:0/3444604160 >> 172.21.15.43:0/3444604160 conn(0x7f4958104f50 msgr2=0x7f49581057f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:22.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.717+0000 7f495e4f9700 1 -- 172.21.15.43:0/3444604160 shutdown_connections 2024-04-25T13:34:22.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:21.717+0000 7f495e4f9700 1 -- 172.21.15.43:0/3444604160 wait complete. 2024-04-25T13:34:22.292 INFO:teuthology.orchestra.run.smithi043.stdout:Enabling cephadm module... 2024-04-25T13:34:23.223 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:23 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1154188892' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-25T13:34:23.223 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:23 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: ignoring --setuser ceph since I am not root 2024-04-25T13:34:23.223 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:23 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: ignoring --setgroup ceph since I am not root 2024-04-25T13:34:23.223 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:23 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:23.222+0000 7f376edbe200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:34:23.529 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:23 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:23.419+0000 7f376edbe200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:34:23.558 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.689+0000 7f4c143b7700 1 Processor -- start 2024-04-25T13:34:23.558 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.689+0000 7f4c143b7700 1 -- start start 2024-04-25T13:34:23.558 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.690+0000 7f4c143b7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c0c10a480 0x7f4c0c10c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:23.558 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.690+0000 7f4c143b7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c07d7e0 con 0x7f4c0c10a480 2024-04-25T13:34:23.558 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.690+0000 7f4c12153700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c0c10a480 0x7f4c0c10c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:23.558 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.690+0000 7f4c12153700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c0c10a480 0x7f4c0c10c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59722/0 (socket says 172.21.15.43:59722) 2024-04-25T13:34:23.558 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.690+0000 7f4c12153700 1 -- 172.21.15.43:0/3583484976 learned_addr learned my addr 172.21.15.43:0/3583484976 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:23.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.690+0000 7f4c12153700 1 -- 172.21.15.43:0/3583484976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0c10cde0 con 0x7f4c0c10a480 2024-04-25T13:34:23.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.690+0000 7f4c12153700 1 --2- 172.21.15.43:0/3583484976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c0c10a480 0x7f4c0c10c8a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4c080098a0 tx=0x7f4c08009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58355180c81ff35e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:23.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.691+0000 7f4c11151700 1 -- 172.21.15.43:0/3583484976 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c08004160 con 0x7f4c0c10a480 2024-04-25T13:34:23.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.691+0000 7f4c11151700 1 -- 172.21.15.43:0/3583484976 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4c08004300 con 0x7f4c0c10a480 2024-04-25T13:34:23.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.691+0000 7f4c11151700 1 -- 172.21.15.43:0/3583484976 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c080119e0 con 0x7f4c0c10a480 2024-04-25T13:34:23.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.691+0000 7f4c143b7700 1 -- 172.21.15.43:0/3583484976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c0c10a480 msgr2=0x7f4c0c10c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:23.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.691+0000 7f4c143b7700 1 --2- 172.21.15.43:0/3583484976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c0c10a480 0x7f4c0c10c8a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4c080098a0 tx=0x7f4c08009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:23.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.692+0000 7f4c143b7700 1 -- 172.21.15.43:0/3583484976 shutdown_connections 2024-04-25T13:34:23.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.692+0000 7f4c143b7700 1 --2- 172.21.15.43:0/3583484976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c0c10a480 0x7f4c0c10c8a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:23.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.692+0000 7f4c143b7700 1 -- 172.21.15.43:0/3583484976 >> 172.21.15.43:0/3583484976 conn(0x7f4c0c103e20 msgr2=0x7f4c0c1062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:23.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.692+0000 7f4c143b7700 1 -- 172.21.15.43:0/3583484976 shutdown_connections 2024-04-25T13:34:23.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.692+0000 7f4c143b7700 1 -- 172.21.15.43:0/3583484976 wait complete. 2024-04-25T13:34:23.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.692+0000 7f4c143b7700 1 Processor -- start 2024-04-25T13:34:23.559 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.692+0000 7f4c143b7700 1 -- start start 2024-04-25T13:34:23.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.693+0000 7f4c143b7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c0c10a480 0x7f4c0c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:23.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.693+0000 7f4c143b7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c10dc80 con 0x7f4c0c10a480 2024-04-25T13:34:23.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.693+0000 7f4c12153700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c0c10a480 0x7f4c0c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:23.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.693+0000 7f4c12153700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c0c10a480 0x7f4c0c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59724/0 (socket says 172.21.15.43:59724) 2024-04-25T13:34:23.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.693+0000 7f4c12153700 1 -- 172.21.15.43:0/1154188892 learned_addr learned my addr 172.21.15.43:0/1154188892 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:23.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.693+0000 7f4c12153700 1 -- 172.21.15.43:0/1154188892 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0c19e100 con 0x7f4c0c10a480 2024-04-25T13:34:23.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.693+0000 7f4c12153700 1 --2- 172.21.15.43:0/1154188892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c0c10a480 0x7f4c0c19dbc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4c080119b0 tx=0x7f4c08011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:23.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.693+0000 7f4c037fe700 1 -- 172.21.15.43:0/1154188892 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c08003af0 con 0x7f4c0c10a480 2024-04-25T13:34:23.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.693+0000 7f4c037fe700 1 -- 172.21.15.43:0/1154188892 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4c0801a8a0 con 0x7f4c0c10a480 2024-04-25T13:34:23.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.693+0000 7f4c037fe700 1 -- 172.21.15.43:0/1154188892 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c08024830 con 0x7f4c0c10a480 2024-04-25T13:34:23.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.693+0000 7f4c143b7700 1 -- 172.21.15.43:0/1154188892 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c0c19e390 con 0x7f4c0c10a480 2024-04-25T13:34:23.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.694+0000 7f4c143b7700 1 -- 172.21.15.43:0/1154188892 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c0c1a0fa0 con 0x7f4c0c10a480 2024-04-25T13:34:23.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.694+0000 7f4c037fe700 1 -- 172.21.15.43:0/1154188892 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) ==== 49505+0+0 (secure 0 0 0) 0x7f4c08022020 con 0x7f4c0c10a480 2024-04-25T13:34:23.560 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.694+0000 7f4c143b7700 1 -- 172.21.15.43:0/1154188892 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c0c064cf0 con 0x7f4c0c10a480 2024-04-25T13:34:23.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.695+0000 7f4c037fe700 1 --2- 172.21.15.43:0/1154188892 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f4bf803d630 0x7f4bf803fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:23.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.695+0000 7f4c037fe700 1 -- 172.21.15.43:0/1154188892 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4c08052420 con 0x7f4c0c10a480 2024-04-25T13:34:23.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.695+0000 7f4c11952700 1 --2- 172.21.15.43:0/1154188892 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f4bf803d630 0x7f4bf803fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:23.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.695+0000 7f4c11952700 1 --2- 172.21.15.43:0/1154188892 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f4bf803d630 0x7f4bf803fb40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc006fd0 tx=0x7f4bfc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:23.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.700+0000 7f4c037fe700 1 -- 172.21.15.43:0/1154188892 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4c0800b3e0 con 0x7f4c0c10a480 2024-04-25T13:34:23.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:22.966+0000 7f4c143b7700 1 -- 172.21.15.43:0/1154188892 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f4c0c1a1620 con 0x7f4c0c10a480 2024-04-25T13:34:23.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.018+0000 7f4c037fe700 1 -- 172.21.15.43:0/1154188892 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f4c08052180 con 0x7f4c0c10a480 2024-04-25T13:34:23.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.020+0000 7f4c037fe700 1 -- 172.21.15.43:0/1154188892 <== mon.0 v2:172.21.15.43:3300/0 8 ==== mgrmap(e 5) ==== 49516+0+0 (secure 0 0 0) 0x7f4c0801aae0 con 0x7f4c0c10a480 2024-04-25T13:34:23.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.021+0000 7f4c143b7700 1 -- 172.21.15.43:0/1154188892 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f4bf803d630 msgr2=0x7f4bf803fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:23.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.021+0000 7f4c143b7700 1 --2- 172.21.15.43:0/1154188892 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f4bf803d630 0x7f4bf803fb40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc006fd0 tx=0x7f4bfc006e40 comp rx=0 tx=0).stop 2024-04-25T13:34:23.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.021+0000 7f4c143b7700 1 -- 172.21.15.43:0/1154188892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c0c10a480 msgr2=0x7f4c0c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:23.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.021+0000 7f4c143b7700 1 --2- 172.21.15.43:0/1154188892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c0c10a480 0x7f4c0c19dbc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4c080119b0 tx=0x7f4c08011a90 comp rx=0 tx=0).stop 2024-04-25T13:34:23.561 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.021+0000 7f4c143b7700 1 -- 172.21.15.43:0/1154188892 shutdown_connections 2024-04-25T13:34:23.562 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.021+0000 7f4c143b7700 1 --2- 172.21.15.43:0/1154188892 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f4bf803d630 0x7f4bf803fb40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:23.562 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.021+0000 7f4c143b7700 1 --2- 172.21.15.43:0/1154188892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c0c10a480 0x7f4c0c19dbc0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:23.562 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.021+0000 7f4c143b7700 1 -- 172.21.15.43:0/1154188892 >> 172.21.15.43:0/1154188892 conn(0x7f4c0c103e20 msgr2=0x7f4c0c104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:23.562 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.021+0000 7f4c143b7700 1 -- 172.21.15.43:0/1154188892 shutdown_connections 2024-04-25T13:34:23.562 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.021+0000 7f4c143b7700 1 -- 172.21.15.43:0/1154188892 wait complete. 2024-04-25T13:34:23.836 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:23 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:23.528+0000 7f376edbe200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:34:24.156 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:24 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1154188892' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-25T13:34:24.156 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:24 smithi043 ceph-mon[29195]: mgrmap e5: x(active, since 12s) 2024-04-25T13:34:24.156 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:23 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:23.861+0000 7f376edbe200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:34:24.156 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:23 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:23.957+0000 7f376edbe200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:34:24.782 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-04-25T13:34:24.782 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-25T13:34:24.782 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T13:34:24.782 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-25T13:34:24.782 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-25T13:34:24.782 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-04-25T13:34:24.783 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.949+0000 7f0059f36700 1 Processor -- start 2024-04-25T13:34:24.783 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.949+0000 7f0059f36700 1 -- start start 2024-04-25T13:34:24.783 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.949+0000 7f0059f36700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f005410a420 0x7f005410c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:24.783 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.949+0000 7f0059f36700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f005407ce10 con 0x7f005410a420 2024-04-25T13:34:24.783 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.949+0000 7f00537fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f005410a420 0x7f005410c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:24.783 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.949+0000 7f00537fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f005410a420 0x7f005410c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59758/0 (socket says 172.21.15.43:59758) 2024-04-25T13:34:24.783 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.949+0000 7f00537fe700 1 -- 172.21.15.43:0/3192948966 learned_addr learned my addr 172.21.15.43:0/3192948966 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:24.783 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.949+0000 7f00537fe700 1 -- 172.21.15.43:0/3192948966 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005410cd80 con 0x7f005410a420 2024-04-25T13:34:24.783 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.950+0000 7f00537fe700 1 --2- 172.21.15.43:0/3192948966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f005410a420 0x7f005410c840 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f00440098a0 tx=0x7f0044009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8b17dfcb6ffc8a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:24.783 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.950+0000 7f00527fc700 1 -- 172.21.15.43:0/3192948966 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0044004160 con 0x7f005410a420 2024-04-25T13:34:24.783 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.950+0000 7f00527fc700 1 -- 172.21.15.43:0/3192948966 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0044004300 con 0x7f005410a420 2024-04-25T13:34:24.783 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.950+0000 7f00527fc700 1 -- 172.21.15.43:0/3192948966 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00440119e0 con 0x7f005410a420 2024-04-25T13:34:24.783 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.951+0000 7f0059f36700 1 -- 172.21.15.43:0/3192948966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f005410a420 msgr2=0x7f005410c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:24.783 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.951+0000 7f0059f36700 1 --2- 172.21.15.43:0/3192948966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f005410a420 0x7f005410c840 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f00440098a0 tx=0x7f0044009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:24.783 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.951+0000 7f0059f36700 1 -- 172.21.15.43:0/3192948966 shutdown_connections 2024-04-25T13:34:24.784 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.951+0000 7f0059f36700 1 --2- 172.21.15.43:0/3192948966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f005410a420 0x7f005410c840 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:24.784 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.951+0000 7f0059f36700 1 -- 172.21.15.43:0/3192948966 >> 172.21.15.43:0/3192948966 conn(0x7f0054103e60 msgr2=0x7f00541062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:24.784 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.951+0000 7f0059f36700 1 -- 172.21.15.43:0/3192948966 shutdown_connections 2024-04-25T13:34:24.784 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.951+0000 7f0059f36700 1 -- 172.21.15.43:0/3192948966 wait complete. 2024-04-25T13:34:24.784 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.951+0000 7f0059f36700 1 Processor -- start 2024-04-25T13:34:24.784 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.952+0000 7f0059f36700 1 -- start start 2024-04-25T13:34:24.784 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.952+0000 7f0059f36700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f005410a420 0x7f005419dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:24.784 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.952+0000 7f0059f36700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f005410dc80 con 0x7f005410a420 2024-04-25T13:34:24.784 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.952+0000 7f00537fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f005410a420 0x7f005419dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:24.784 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.952+0000 7f00537fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f005410a420 0x7f005419dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59768/0 (socket says 172.21.15.43:59768) 2024-04-25T13:34:24.784 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.952+0000 7f00537fe700 1 -- 172.21.15.43:0/3496648170 learned_addr learned my addr 172.21.15.43:0/3496648170 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:24.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.952+0000 7f00537fe700 1 -- 172.21.15.43:0/3496648170 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005419e1a0 con 0x7f005410a420 2024-04-25T13:34:24.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.952+0000 7f00537fe700 1 --2- 172.21.15.43:0/3496648170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f005410a420 0x7f005419dc60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f00440116a0 tx=0x7f0044011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:24.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.953+0000 7f0050ff9700 1 -- 172.21.15.43:0/3496648170 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00440039f0 con 0x7f005410a420 2024-04-25T13:34:24.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.953+0000 7f0050ff9700 1 -- 172.21.15.43:0/3496648170 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0044003b90 con 0x7f005410a420 2024-04-25T13:34:24.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.953+0000 7f0050ff9700 1 -- 172.21.15.43:0/3496648170 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f004401a600 con 0x7f005410a420 2024-04-25T13:34:24.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.953+0000 7f0059f36700 1 -- 172.21.15.43:0/3496648170 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f005419e430 con 0x7f005410a420 2024-04-25T13:34:24.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.953+0000 7f0059f36700 1 -- 172.21.15.43:0/3496648170 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00541a1040 con 0x7f005410a420 2024-04-25T13:34:24.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.954+0000 7f0059f36700 1 -- 172.21.15.43:0/3496648170 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0054064cf0 con 0x7f005410a420 2024-04-25T13:34:24.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.954+0000 7f0050ff9700 1 -- 172.21.15.43:0/3496648170 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 49516+0+0 (secure 0 0 0) 0x7f004401a900 con 0x7f005410a420 2024-04-25T13:34:24.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.954+0000 7f0050ff9700 1 --2- 172.21.15.43:0/3496648170 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f004003d5e0 0x7f004003faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:24.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.954+0000 7f0050ff9700 1 -- 172.21.15.43:0/3496648170 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0044052970 con 0x7f005410a420 2024-04-25T13:34:24.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.954+0000 7f0052ffd700 1 -- 172.21.15.43:0/3496648170 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f004003d5e0 msgr2=0x7f004003faf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/3816223875 2024-04-25T13:34:24.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.954+0000 7f0052ffd700 1 --2- 172.21.15.43:0/3496648170 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f004003d5e0 0x7f004003faf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:34:24.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:23.960+0000 7f0050ff9700 1 -- 172.21.15.43:0/3496648170 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f004402c350 con 0x7f005410a420 2024-04-25T13:34:24.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:24.155+0000 7f0052ffd700 1 -- 172.21.15.43:0/3496648170 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f004003d5e0 msgr2=0x7f004003faf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/3816223875 2024-04-25T13:34:24.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:24.155+0000 7f0052ffd700 1 --2- 172.21.15.43:0/3496648170 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f004003d5e0 0x7f004003faf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:34:24.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:24.227+0000 7f0059f36700 1 -- 172.21.15.43:0/3496648170 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f00541a1260 con 0x7f005410a420 2024-04-25T13:34:24.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:24.228+0000 7f0050ff9700 1 -- 172.21.15.43:0/3496648170 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f00541a1260 con 0x7f005410a420 2024-04-25T13:34:24.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:24.230+0000 7f0059f36700 1 -- 172.21.15.43:0/3496648170 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f004003d5e0 msgr2=0x7f004003faf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T13:34:24.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:24.230+0000 7f0059f36700 1 --2- 172.21.15.43:0/3496648170 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f004003d5e0 0x7f004003faf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:24.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:24.230+0000 7f0059f36700 1 -- 172.21.15.43:0/3496648170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f005410a420 msgr2=0x7f005419dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:24.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:24.230+0000 7f0059f36700 1 --2- 172.21.15.43:0/3496648170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f005410a420 0x7f005419dc60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f00440116a0 tx=0x7f0044011a60 comp rx=0 tx=0).stop 2024-04-25T13:34:24.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:24.230+0000 7f0059f36700 1 -- 172.21.15.43:0/3496648170 shutdown_connections 2024-04-25T13:34:24.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:24.230+0000 7f0059f36700 1 --2- 172.21.15.43:0/3496648170 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f004003d5e0 0x7f004003faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:24.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:24.230+0000 7f0059f36700 1 --2- 172.21.15.43:0/3496648170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f005410a420 0x7f005419dc60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:24.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:24.230+0000 7f0059f36700 1 -- 172.21.15.43:0/3496648170 >> 172.21.15.43:0/3496648170 conn(0x7f0054103e60 msgr2=0x7f0054104690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:24.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:24.230+0000 7f0059f36700 1 -- 172.21.15.43:0/3496648170 shutdown_connections 2024-04-25T13:34:24.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:24.230+0000 7f0059f36700 1 -- 172.21.15.43:0/3496648170 wait complete. 2024-04-25T13:34:24.787 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for the mgr to restart... 2024-04-25T13:34:24.788 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mgr epoch 5... 2024-04-25T13:34:25.208 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:25 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3496648170' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-25T13:34:25.463 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:25 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:25.229+0000 7f376edbe200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:34:25.463 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:25 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:25.411+0000 7f376edbe200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:34:25.894 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:25 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:25.589+0000 7f376edbe200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:34:25.894 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:25 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:25.893+0000 7f376edbe200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:34:26.203 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:25 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:25.990+0000 7f376edbe200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:34:26.203 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:26 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:26.202+0000 7f376edbe200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:34:26.463 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:26 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:26.404+0000 7f376edbe200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:34:27.463 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:27 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:27.036+0000 7f376edbe200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T13:34:27.797 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:27 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:27.483+0000 7f376edbe200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:34:27.797 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:27 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:27.584+0000 7f376edbe200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:34:27.798 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:27 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:27.796+0000 7f376edbe200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T13:34:28.705 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:28 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:28.344+0000 7f376edbe200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:34:28.706 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:28 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:28.442+0000 7f376edbe200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:34:28.963 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:28 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:28.704+0000 7f376edbe200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:34:28.963 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:28 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:28.843+0000 7f376edbe200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:34:28.963 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:28 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:28.943+0000 7f376edbe200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:34:29.385 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:29 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:29.069+0000 7f376edbe200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:34:29.385 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:29 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:29.384+0000 7f376edbe200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:34:30.298 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:30 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:30.016+0000 7f376edbe200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:34:30.298 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:30 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:30.243+0000 7f376edbe200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:34:30.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:30 smithi043 ceph-mon[29195]: Active manager daemon x restarted 2024-04-25T13:34:30.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:30 smithi043 ceph-mon[29195]: Activating manager daemon x 2024-04-25T13:34:30.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:30 smithi043 ceph-mon[29195]: osdmap e2: 0 total, 0 up, 0 in 2024-04-25T13:34:30.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:30 smithi043 ceph-mon[29195]: mgrmap e6: x(active, starting, since 0.00396017s) 2024-04-25T13:34:30.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:30 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:34:30.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:30 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T13:34:30.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:30 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T13:34:30.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:30 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T13:34:30.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:30 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T13:34:30.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:30 smithi043 ceph-mon[29195]: Manager daemon x is now available 2024-04-25T13:34:30.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:30 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' 2024-04-25T13:34:30.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:30 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' 2024-04-25T13:34:30.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:30 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:34:30.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:30 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:34:31.558 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:31 smithi043 ceph-mon[29195]: Found migration_current of "None". Setting to last migration. 2024-04-25T13:34:31.559 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:31 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T13:34:31.559 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:31 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T13:34:31.559 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:31 smithi043 ceph-mon[29195]: mgrmap e7: x(active, since 1.00645s) 2024-04-25T13:34:31.852 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-04-25T13:34:31.852 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-25T13:34:31.852 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-25T13:34:31.852 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-04-25T13:34:31.852 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.229+0000 7f14570bb700 1 Processor -- start 2024-04-25T13:34:31.852 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.229+0000 7f14570bb700 1 -- start start 2024-04-25T13:34:31.852 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.229+0000 7f14570bb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1450108210 0x7f1450108620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:31.852 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.229+0000 7f14570bb700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f145007cdd0 con 0x7f1450108210 2024-04-25T13:34:31.852 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.229+0000 7f1454e57700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1450108210 0x7f1450108620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:31.852 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.229+0000 7f1454e57700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1450108210 0x7f1450108620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59776/0 (socket says 172.21.15.43:59776) 2024-04-25T13:34:31.852 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.229+0000 7f1454e57700 1 -- 172.21.15.43:0/3865077484 learned_addr learned my addr 172.21.15.43:0/3865077484 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:31.852 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.230+0000 7f1454e57700 1 -- 172.21.15.43:0/3865077484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1450108b60 con 0x7f1450108210 2024-04-25T13:34:31.852 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.230+0000 7f1454e57700 1 --2- 172.21.15.43:0/3865077484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1450108210 0x7f1450108620 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f14440098a0 tx=0x7f1444009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1901cb5925bf04a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:31.853 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.230+0000 7f144f7fe700 1 -- 172.21.15.43:0/3865077484 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1444004160 con 0x7f1450108210 2024-04-25T13:34:31.853 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.230+0000 7f144f7fe700 1 -- 172.21.15.43:0/3865077484 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f1444004300 con 0x7f1450108210 2024-04-25T13:34:31.853 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.230+0000 7f144f7fe700 1 -- 172.21.15.43:0/3865077484 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14440119e0 con 0x7f1450108210 2024-04-25T13:34:31.853 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.231+0000 7f14570bb700 1 -- 172.21.15.43:0/3865077484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1450108210 msgr2=0x7f1450108620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:31.853 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.231+0000 7f14570bb700 1 --2- 172.21.15.43:0/3865077484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1450108210 0x7f1450108620 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f14440098a0 tx=0x7f1444009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:31.853 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.231+0000 7f14570bb700 1 -- 172.21.15.43:0/3865077484 shutdown_connections 2024-04-25T13:34:31.853 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.231+0000 7f14570bb700 1 --2- 172.21.15.43:0/3865077484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1450108210 0x7f1450108620 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:31.853 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.231+0000 7f14570bb700 1 -- 172.21.15.43:0/3865077484 >> 172.21.15.43:0/3865077484 conn(0x7f1450103e40 msgr2=0x7f14501062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:31.853 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.231+0000 7f14570bb700 1 -- 172.21.15.43:0/3865077484 shutdown_connections 2024-04-25T13:34:31.853 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.231+0000 7f14570bb700 1 -- 172.21.15.43:0/3865077484 wait complete. 2024-04-25T13:34:31.853 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.232+0000 7f14570bb700 1 Processor -- start 2024-04-25T13:34:31.853 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.232+0000 7f14570bb700 1 -- start start 2024-04-25T13:34:31.853 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.232+0000 7f14570bb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1450108210 0x7f145019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:31.853 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.232+0000 7f14570bb700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1450109b80 con 0x7f1450108210 2024-04-25T13:34:31.854 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.232+0000 7f1454e57700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1450108210 0x7f145019fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:31.854 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.232+0000 7f1454e57700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1450108210 0x7f145019fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59780/0 (socket says 172.21.15.43:59780) 2024-04-25T13:34:31.854 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.232+0000 7f1454e57700 1 -- 172.21.15.43:0/2010809147 learned_addr learned my addr 172.21.15.43:0/2010809147 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:31.854 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.232+0000 7f1454e57700 1 -- 172.21.15.43:0/2010809147 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14501a0320 con 0x7f1450108210 2024-04-25T13:34:31.854 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.233+0000 7f1454e57700 1 --2- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1450108210 0x7f145019fde0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f14440119b0 tx=0x7f1444011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:31.854 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.233+0000 7f144dffb700 1 -- 172.21.15.43:0/2010809147 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1444003af0 con 0x7f1450108210 2024-04-25T13:34:31.854 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.233+0000 7f144dffb700 1 -- 172.21.15.43:0/2010809147 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f144401a8a0 con 0x7f1450108210 2024-04-25T13:34:31.854 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.233+0000 7f14570bb700 1 -- 172.21.15.43:0/2010809147 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14501a05b0 con 0x7f1450108210 2024-04-25T13:34:31.854 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.233+0000 7f144dffb700 1 -- 172.21.15.43:0/2010809147 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1444024830 con 0x7f1450108210 2024-04-25T13:34:31.854 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.233+0000 7f14570bb700 1 -- 172.21.15.43:0/2010809147 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14501a3180 con 0x7f1450108210 2024-04-25T13:34:31.854 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.234+0000 7f144dffb700 1 -- 172.21.15.43:0/2010809147 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 49516+0+0 (secure 0 0 0) 0x7f1444022020 con 0x7f1450108210 2024-04-25T13:34:31.854 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.235+0000 7f144dffb700 1 --2- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f144003d630 0x7f144003fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:31.854 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.235+0000 7f144dffb700 1 -- 172.21.15.43:0/2010809147 --> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1440040250 con 0x7f144003d630 2024-04-25T13:34:31.854 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.235+0000 7f144dffb700 1 -- 172.21.15.43:0/2010809147 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1444052420 con 0x7f1450108210 2024-04-25T13:34:31.855 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.235+0000 7f144ffff700 1 -- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f144003d630 msgr2=0x7f144003fb40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/3816223875 2024-04-25T13:34:31.855 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.235+0000 7f144ffff700 1 --2- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f144003d630 0x7f144003fb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:34:31.855 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.436+0000 7f144ffff700 1 -- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f144003d630 msgr2=0x7f144003fb40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/3816223875 2024-04-25T13:34:31.855 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.436+0000 7f144ffff700 1 --2- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f144003d630 0x7f144003fb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:34:31.855 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.837+0000 7f144ffff700 1 -- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f144003d630 msgr2=0x7f144003fb40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/3816223875 2024-04-25T13:34:31.855 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:25.837+0000 7f144ffff700 1 --2- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f144003d630 0x7f144003fb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T13:34:31.855 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:26.638+0000 7f144ffff700 1 -- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f144003d630 msgr2=0x7f144003fb40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/3816223875 2024-04-25T13:34:31.855 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:26.638+0000 7f144ffff700 1 --2- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f144003d630 0x7f144003fb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T13:34:31.855 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:28.239+0000 7f144ffff700 1 -- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f144003d630 msgr2=0x7f144003fb40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/3816223875 2024-04-25T13:34:31.855 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:28.239+0000 7f144ffff700 1 --2- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f144003d630 0x7f144003fb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-25T13:34:31.855 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:30.248+0000 7f144dffb700 1 -- 172.21.15.43:0/2010809147 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mgrmap(e 6) ==== 49283+0+0 (secure 0 0 0) 0x7f144402d530 con 0x7f1450108210 2024-04-25T13:34:31.855 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:30.248+0000 7f144dffb700 1 -- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f144003d630 msgr2=0x7f144003fb40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T13:34:31.855 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:30.248+0000 7f144dffb700 1 --2- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f144003d630 0x7f144003fb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:31.855 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.249+0000 7f144dffb700 1 -- 172.21.15.43:0/2010809147 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 7) ==== 49410+0+0 (secure 0 0 0) 0x7f144401aa50 con 0x7f1450108210 2024-04-25T13:34:31.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.249+0000 7f144dffb700 1 --2- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f1440040f70 0x7f1440043390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:31.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.249+0000 7f144dffb700 1 -- 172.21.15.43:0/2010809147 --> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1444023ec0 con 0x7f1440040f70 2024-04-25T13:34:31.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.250+0000 7f144ffff700 1 --2- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f1440040f70 0x7f1440043390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:31.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.251+0000 7f144ffff700 1 --2- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f1440040f70 0x7f1440043390 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f143c003a10 tx=0x7f143c009290 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:31.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.251+0000 7f144dffb700 1 -- 172.21.15.43:0/2010809147 <== mgr.14118 v2:172.21.15.43:6800/1629086480 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f1444023ec0 con 0x7f1440040f70 2024-04-25T13:34:31.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.259+0000 7f14570bb700 1 -- 172.21.15.43:0/2010809147 --> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f1450064cf0 con 0x7f1440040f70 2024-04-25T13:34:31.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.260+0000 7f144dffb700 1 -- 172.21.15.43:0/2010809147 <== mgr.14118 v2:172.21.15.43:6800/1629086480 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f1450064cf0 con 0x7f1440040f70 2024-04-25T13:34:31.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.260+0000 7f14570bb700 1 -- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f1440040f70 msgr2=0x7f1440043390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:31.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.260+0000 7f14570bb700 1 --2- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f1440040f70 0x7f1440043390 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f143c003a10 tx=0x7f143c009290 comp rx=0 tx=0).stop 2024-04-25T13:34:31.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.260+0000 7f14570bb700 1 -- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1450108210 msgr2=0x7f145019fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:31.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.260+0000 7f14570bb700 1 --2- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1450108210 0x7f145019fde0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f14440119b0 tx=0x7f1444011a90 comp rx=0 tx=0).stop 2024-04-25T13:34:31.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.260+0000 7f14570bb700 1 -- 172.21.15.43:0/2010809147 shutdown_connections 2024-04-25T13:34:31.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.260+0000 7f14570bb700 1 --2- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1450108210 0x7f145019fde0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:31.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.260+0000 7f14570bb700 1 --2- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f1440040f70 0x7f1440043390 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:31.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.260+0000 7f14570bb700 1 --2- 172.21.15.43:0/2010809147 >> [v2:172.21.15.43:6800/3816223875,v1:172.21.15.43:6801/3816223875] conn(0x7f144003d630 0x7f144003fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:31.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.260+0000 7f14570bb700 1 -- 172.21.15.43:0/2010809147 >> 172.21.15.43:0/2010809147 conn(0x7f1450103e40 msgr2=0x7f1450193e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:31.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.260+0000 7f14570bb700 1 -- 172.21.15.43:0/2010809147 shutdown_connections 2024-04-25T13:34:31.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:31.260+0000 7f14570bb700 1 -- 172.21.15.43:0/2010809147 wait complete. 2024-04-25T13:34:31.857 INFO:teuthology.orchestra.run.smithi043.stdout:mgr epoch 5 is available 2024-04-25T13:34:31.857 INFO:teuthology.orchestra.run.smithi043.stdout:Setting orchestrator backend to cephadm... 2024-04-25T13:34:32.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:32 smithi043 ceph-mon[29195]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-25T13:34:32.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:32 smithi043 ceph-mon[29195]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-25T13:34:32.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:32 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' 2024-04-25T13:34:32.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:32 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' 2024-04-25T13:34:32.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:32 smithi043 ceph-mon[29195]: [25/Apr/2024:13:34:31] ENGINE Bus STARTING 2024-04-25T13:34:32.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:32 smithi043 ceph-mon[29195]: [25/Apr/2024:13:34:31] ENGINE Serving on http://172.21.15.43:8765 2024-04-25T13:34:32.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:32 smithi043 ceph-mon[29195]: [25/Apr/2024:13:34:31] ENGINE Serving on https://172.21.15.43:7150 2024-04-25T13:34:32.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:32 smithi043 ceph-mon[29195]: [25/Apr/2024:13:34:31] ENGINE Bus STARTED 2024-04-25T13:34:32.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:32 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:34:33.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.275+0000 7f2b31f5b700 1 Processor -- start 2024-04-25T13:34:33.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.275+0000 7f2b31f5b700 1 -- start start 2024-04-25T13:34:33.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.275+0000 7f2b31f5b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b2c108830 0x7f2b2c108c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:33.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.275+0000 7f2b31f5b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c109230 con 0x7f2b2c108830 2024-04-25T13:34:33.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.276+0000 7f2b2b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b2c108830 0x7f2b2c108c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:33.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.276+0000 7f2b2b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b2c108830 0x7f2b2c108c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59802/0 (socket says 172.21.15.43:59802) 2024-04-25T13:34:33.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.276+0000 7f2b2b7fe700 1 -- 172.21.15.43:0/1124686438 learned_addr learned my addr 172.21.15.43:0/1124686438 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:33.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.276+0000 7f2b2b7fe700 1 -- 172.21.15.43:0/1124686438 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c1099b0 con 0x7f2b2c108830 2024-04-25T13:34:33.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.276+0000 7f2b2b7fe700 1 --2- 172.21.15.43:0/1124686438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b2c108830 0x7f2b2c108c40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009e80 tx=0x7f2b2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2890471d8e4b557 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:33.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.276+0000 7f2b2a7fc700 1 -- 172.21.15.43:0/1124686438 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b24017070 con 0x7f2b2c108830 2024-04-25T13:34:33.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.276+0000 7f2b2a7fc700 1 -- 172.21.15.43:0/1124686438 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f2b2400b8c0 con 0x7f2b2c108830 2024-04-25T13:34:33.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.276+0000 7f2b2a7fc700 1 -- 172.21.15.43:0/1124686438 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b24004420 con 0x7f2b2c108830 2024-04-25T13:34:33.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.277+0000 7f2b31f5b700 1 -- 172.21.15.43:0/1124686438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b2c108830 msgr2=0x7f2b2c108c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:33.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.277+0000 7f2b31f5b700 1 --2- 172.21.15.43:0/1124686438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b2c108830 0x7f2b2c108c40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009e80 tx=0x7f2b2400b330 comp rx=0 tx=0).stop 2024-04-25T13:34:33.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.277+0000 7f2b31f5b700 1 -- 172.21.15.43:0/1124686438 shutdown_connections 2024-04-25T13:34:33.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.277+0000 7f2b31f5b700 1 --2- 172.21.15.43:0/1124686438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b2c108830 0x7f2b2c108c40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:33.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.277+0000 7f2b31f5b700 1 -- 172.21.15.43:0/1124686438 >> 172.21.15.43:0/1124686438 conn(0x7f2b2c103e70 msgr2=0x7f2b2c106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:33.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.277+0000 7f2b31f5b700 1 -- 172.21.15.43:0/1124686438 shutdown_connections 2024-04-25T13:34:33.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.277+0000 7f2b31f5b700 1 -- 172.21.15.43:0/1124686438 wait complete. 2024-04-25T13:34:33.092 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.278+0000 7f2b31f5b700 1 Processor -- start 2024-04-25T13:34:33.092 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.278+0000 7f2b31f5b700 1 -- start start 2024-04-25T13:34:33.092 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.278+0000 7f2b31f5b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b2c108830 0x7f2b2c07d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:33.092 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.278+0000 7f2b31f5b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c10cd60 con 0x7f2b2c108830 2024-04-25T13:34:33.092 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.279+0000 7f2b2b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b2c108830 0x7f2b2c07d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:33.092 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.279+0000 7f2b2b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b2c108830 0x7f2b2c07d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59814/0 (socket says 172.21.15.43:59814) 2024-04-25T13:34:33.092 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.279+0000 7f2b2b7fe700 1 -- 172.21.15.43:0/1808532605 learned_addr learned my addr 172.21.15.43:0/1808532605 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:33.092 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.279+0000 7f2b2b7fe700 1 -- 172.21.15.43:0/1808532605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c07d710 con 0x7f2b2c108830 2024-04-25T13:34:33.092 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.279+0000 7f2b2b7fe700 1 --2- 172.21.15.43:0/1808532605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b2c108830 0x7f2b2c07d1d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400bca0 tx=0x7f2b2400bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:33.092 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.279+0000 7f2b28ff9700 1 -- 172.21.15.43:0/1808532605 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b24020020 con 0x7f2b2c108830 2024-04-25T13:34:33.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.279+0000 7f2b28ff9700 1 -- 172.21.15.43:0/1808532605 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f2b24012430 con 0x7f2b2c108830 2024-04-25T13:34:33.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.279+0000 7f2b31f5b700 1 -- 172.21.15.43:0/1808532605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2c1a09a0 con 0x7f2b2c108830 2024-04-25T13:34:33.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.279+0000 7f2b28ff9700 1 -- 172.21.15.43:0/1808532605 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b24017040 con 0x7f2b2c108830 2024-04-25T13:34:33.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.279+0000 7f2b31f5b700 1 -- 172.21.15.43:0/1808532605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b2c1a0e80 con 0x7f2b2c108830 2024-04-25T13:34:33.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.280+0000 7f2b28ff9700 1 -- 172.21.15.43:0/1808532605 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 7) ==== 49410+0+0 (secure 0 0 0) 0x7f2b24023020 con 0x7f2b2c108830 2024-04-25T13:34:33.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.280+0000 7f2b28ff9700 1 --2- 172.21.15.43:0/1808532605 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f2b1803d4d0 0x7f2b1803f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:33.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.280+0000 7f2b28ff9700 1 -- 172.21.15.43:0/1808532605 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2b2400f050 con 0x7f2b2c108830 2024-04-25T13:34:33.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.281+0000 7f2b2affd700 1 --2- 172.21.15.43:0/1808532605 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f2b1803d4d0 0x7f2b1803f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:33.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.281+0000 7f2b31f5b700 1 -- 172.21.15.43:0/1808532605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b2c064cf0 con 0x7f2b2c108830 2024-04-25T13:34:33.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.281+0000 7f2b2affd700 1 --2- 172.21.15.43:0/1808532605 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f2b1803d4d0 0x7f2b1803f9e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2b14006fd0 tx=0x7f2b14006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:33.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.286+0000 7f2b28ff9700 1 -- 172.21.15.43:0/1808532605 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2b2402a020 con 0x7f2b2c108830 2024-04-25T13:34:33.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.358+0000 7f2b28ff9700 1 -- 172.21.15.43:0/1808532605 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7f2b24024cd0 con 0x7f2b2c108830 2024-04-25T13:34:33.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.511+0000 7f2b31f5b700 1 -- 172.21.15.43:0/1808532605 --> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f2b2c104e20 con 0x7f2b1803d4d0 2024-04-25T13:34:33.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.516+0000 7f2b28ff9700 1 -- 172.21.15.43:0/1808532605 <== mgr.14118 v2:172.21.15.43:6800/1629086480 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2b2c104e20 con 0x7f2b1803d4d0 2024-04-25T13:34:33.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.518+0000 7f2b31f5b700 1 -- 172.21.15.43:0/1808532605 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f2b1803d4d0 msgr2=0x7f2b1803f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:33.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.518+0000 7f2b31f5b700 1 --2- 172.21.15.43:0/1808532605 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f2b1803d4d0 0x7f2b1803f9e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2b14006fd0 tx=0x7f2b14006e40 comp rx=0 tx=0).stop 2024-04-25T13:34:33.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.518+0000 7f2b31f5b700 1 -- 172.21.15.43:0/1808532605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b2c108830 msgr2=0x7f2b2c07d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:33.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.518+0000 7f2b31f5b700 1 --2- 172.21.15.43:0/1808532605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b2c108830 0x7f2b2c07d1d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400bca0 tx=0x7f2b2400bd80 comp rx=0 tx=0).stop 2024-04-25T13:34:33.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.518+0000 7f2b31f5b700 1 -- 172.21.15.43:0/1808532605 shutdown_connections 2024-04-25T13:34:33.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.518+0000 7f2b31f5b700 1 --2- 172.21.15.43:0/1808532605 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f2b1803d4d0 0x7f2b1803f9e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:33.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.518+0000 7f2b31f5b700 1 --2- 172.21.15.43:0/1808532605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b2c108830 0x7f2b2c07d1d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:33.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.518+0000 7f2b31f5b700 1 -- 172.21.15.43:0/1808532605 >> 172.21.15.43:0/1808532605 conn(0x7f2b2c103e70 msgr2=0x7f2b2c104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:33.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.518+0000 7f2b31f5b700 1 -- 172.21.15.43:0/1808532605 shutdown_connections 2024-04-25T13:34:33.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:32.518+0000 7f2b31f5b700 1 -- 172.21.15.43:0/1808532605 wait complete. 2024-04-25T13:34:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:33 smithi043 ceph-mon[29195]: mgrmap e8: x(active, since 2s) 2024-04-25T13:34:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:33 smithi043 ceph-mon[29195]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:34:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:33 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' 2024-04-25T13:34:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:33 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:34:34.306 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-25T13:34:34.306 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.497+0000 7f15cb1b0700 1 Processor -- start 2024-04-25T13:34:34.306 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.497+0000 7f15cb1b0700 1 -- start start 2024-04-25T13:34:34.306 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.497+0000 7f15cb1b0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c410a3c0 0x7f15c410c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:34.306 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.497+0000 7f15cb1b0700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f15c407d880 con 0x7f15c410a3c0 2024-04-25T13:34:34.306 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.497+0000 7f15c8f4c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c410a3c0 0x7f15c410c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:34.306 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.497+0000 7f15c8f4c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c410a3c0 0x7f15c410c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59824/0 (socket says 172.21.15.43:59824) 2024-04-25T13:34:34.306 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.497+0000 7f15c8f4c700 1 -- 172.21.15.43:0/3336567415 learned_addr learned my addr 172.21.15.43:0/3336567415 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:34.306 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.498+0000 7f15c8f4c700 1 -- 172.21.15.43:0/3336567415 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c410cd20 con 0x7f15c410a3c0 2024-04-25T13:34:34.306 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.498+0000 7f15c8f4c700 1 --2- 172.21.15.43:0/3336567415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c410a3c0 0x7f15c410c7e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f15b80098a0 tx=0x7f15b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd624237a64cedb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:34.307 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.498+0000 7f15c37fe700 1 -- 172.21.15.43:0/3336567415 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15b8004160 con 0x7f15c410a3c0 2024-04-25T13:34:34.307 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.498+0000 7f15c37fe700 1 -- 172.21.15.43:0/3336567415 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f15b8004300 con 0x7f15c410a3c0 2024-04-25T13:34:34.307 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.498+0000 7f15c37fe700 1 -- 172.21.15.43:0/3336567415 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15b80119e0 con 0x7f15c410a3c0 2024-04-25T13:34:34.307 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.499+0000 7f15cb1b0700 1 -- 172.21.15.43:0/3336567415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c410a3c0 msgr2=0x7f15c410c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:34.307 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.499+0000 7f15cb1b0700 1 --2- 172.21.15.43:0/3336567415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c410a3c0 0x7f15c410c7e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f15b80098a0 tx=0x7f15b8009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:34.307 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.499+0000 7f15cb1b0700 1 -- 172.21.15.43:0/3336567415 shutdown_connections 2024-04-25T13:34:34.307 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.499+0000 7f15cb1b0700 1 --2- 172.21.15.43:0/3336567415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c410a3c0 0x7f15c410c7e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:34.307 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.499+0000 7f15cb1b0700 1 -- 172.21.15.43:0/3336567415 >> 172.21.15.43:0/3336567415 conn(0x7f15c4103e40 msgr2=0x7f15c41062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:34.307 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.499+0000 7f15cb1b0700 1 -- 172.21.15.43:0/3336567415 shutdown_connections 2024-04-25T13:34:34.307 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.499+0000 7f15cb1b0700 1 -- 172.21.15.43:0/3336567415 wait complete. 2024-04-25T13:34:34.307 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.500+0000 7f15cb1b0700 1 Processor -- start 2024-04-25T13:34:34.307 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.500+0000 7f15cb1b0700 1 -- start start 2024-04-25T13:34:34.307 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.500+0000 7f15cb1b0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c410a3c0 0x7f15c419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:34.308 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.500+0000 7f15cb1b0700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f15c410dc80 con 0x7f15c410a3c0 2024-04-25T13:34:34.308 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.500+0000 7f15c8f4c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c410a3c0 0x7f15c419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:34.308 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.500+0000 7f15c8f4c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c410a3c0 0x7f15c419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59832/0 (socket says 172.21.15.43:59832) 2024-04-25T13:34:34.308 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.500+0000 7f15c8f4c700 1 -- 172.21.15.43:0/2893276561 learned_addr learned my addr 172.21.15.43:0/2893276561 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:34.308 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.500+0000 7f15c8f4c700 1 -- 172.21.15.43:0/2893276561 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c419e0d0 con 0x7f15c410a3c0 2024-04-25T13:34:34.308 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.500+0000 7f15c8f4c700 1 --2- 172.21.15.43:0/2893276561 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c410a3c0 0x7f15c419db90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f15b80119b0 tx=0x7f15b8011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:34.308 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.501+0000 7f15c1ffb700 1 -- 172.21.15.43:0/2893276561 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15b8003af0 con 0x7f15c410a3c0 2024-04-25T13:34:34.308 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.501+0000 7f15c1ffb700 1 -- 172.21.15.43:0/2893276561 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f15b801a8a0 con 0x7f15c410a3c0 2024-04-25T13:34:34.308 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.501+0000 7f15cb1b0700 1 -- 172.21.15.43:0/2893276561 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c419e360 con 0x7f15c410a3c0 2024-04-25T13:34:34.308 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.501+0000 7f15c1ffb700 1 -- 172.21.15.43:0/2893276561 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15b8024830 con 0x7f15c410a3c0 2024-04-25T13:34:34.308 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.501+0000 7f15cb1b0700 1 -- 172.21.15.43:0/2893276561 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c41a0f70 con 0x7f15c410a3c0 2024-04-25T13:34:34.308 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.502+0000 7f15cb1b0700 1 -- 172.21.15.43:0/2893276561 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c4064cf0 con 0x7f15c410a3c0 2024-04-25T13:34:34.308 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.502+0000 7f15c1ffb700 1 -- 172.21.15.43:0/2893276561 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7f15b8022020 con 0x7f15c410a3c0 2024-04-25T13:34:34.308 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.502+0000 7f15c1ffb700 1 --2- 172.21.15.43:0/2893276561 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f15b403d680 0x7f15b403fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:34.309 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.502+0000 7f15c1ffb700 1 -- 172.21.15.43:0/2893276561 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f15b80526b0 con 0x7f15c410a3c0 2024-04-25T13:34:34.309 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.502+0000 7f15c3fff700 1 --2- 172.21.15.43:0/2893276561 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f15b403d680 0x7f15b403fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:34.309 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.503+0000 7f15c3fff700 1 --2- 172.21.15.43:0/2893276561 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f15b403d680 0x7f15b403fb90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f15b0006fd0 tx=0x7f15b0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:34.309 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.507+0000 7f15c1ffb700 1 -- 172.21.15.43:0/2893276561 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f15b8029df0 con 0x7f15c410a3c0 2024-04-25T13:34:34.309 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.716+0000 7f15cb1b0700 1 -- 172.21.15.43:0/2893276561 --> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f15c4104d10 con 0x7f15b403d680 2024-04-25T13:34:34.309 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.717+0000 7f15c1ffb700 1 -- 172.21.15.43:0/2893276561 <== mgr.14118 v2:172.21.15.43:6800/1629086480 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f15c4104d10 con 0x7f15b403d680 2024-04-25T13:34:34.309 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.719+0000 7f15cb1b0700 1 -- 172.21.15.43:0/2893276561 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f15b403d680 msgr2=0x7f15b403fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:34.309 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.719+0000 7f15cb1b0700 1 --2- 172.21.15.43:0/2893276561 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f15b403d680 0x7f15b403fb90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f15b0006fd0 tx=0x7f15b0006e40 comp rx=0 tx=0).stop 2024-04-25T13:34:34.309 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.719+0000 7f15cb1b0700 1 -- 172.21.15.43:0/2893276561 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c410a3c0 msgr2=0x7f15c419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:34.309 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.719+0000 7f15cb1b0700 1 --2- 172.21.15.43:0/2893276561 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c410a3c0 0x7f15c419db90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f15b80119b0 tx=0x7f15b8011a90 comp rx=0 tx=0).stop 2024-04-25T13:34:34.309 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.719+0000 7f15cb1b0700 1 -- 172.21.15.43:0/2893276561 shutdown_connections 2024-04-25T13:34:34.309 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.719+0000 7f15cb1b0700 1 --2- 172.21.15.43:0/2893276561 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f15b403d680 0x7f15b403fb90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:34.309 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.719+0000 7f15cb1b0700 1 --2- 172.21.15.43:0/2893276561 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c410a3c0 0x7f15c419db90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:34.309 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.719+0000 7f15cb1b0700 1 -- 172.21.15.43:0/2893276561 >> 172.21.15.43:0/2893276561 conn(0x7f15c4103e40 msgr2=0x7f15c4104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:34.310 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.720+0000 7f15cb1b0700 1 -- 172.21.15.43:0/2893276561 shutdown_connections 2024-04-25T13:34:34.310 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:33.720+0000 7f15cb1b0700 1 -- 172.21.15.43:0/2893276561 wait complete. 2024-04-25T13:34:34.310 INFO:teuthology.orchestra.run.smithi043.stdout:Generating ssh key... 2024-04-25T13:34:34.674 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:34 smithi043 ceph-mon[29195]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:34:35.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-mon[29195]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:34:35.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-mon[29195]: Generating ssh key... 2024-04-25T13:34:35.713 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: Generating public/private rsa key pair. 2024-04-25T13:34:35.714 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: Your identification has been saved in /tmp/tmp2us6sz71/key. 2024-04-25T13:34:35.714 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: Your public key has been saved in /tmp/tmp2us6sz71/key.pub. 2024-04-25T13:34:35.714 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: The key fingerprint is: 2024-04-25T13:34:35.714 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: SHA256:SxUpRK61JxyzYfvK9Uwb9e4ZK0BMqbrvSPl6ukhW9IY ceph-394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:34:35.714 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: The key's randomart image is: 2024-04-25T13:34:35.714 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: +---[RSA 3072]----+ 2024-04-25T13:34:35.714 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: | oo ... | 2024-04-25T13:34:35.714 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: | .. .+ | 2024-04-25T13:34:35.714 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: | .B.= | 2024-04-25T13:34:35.714 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: | .=oX o | 2024-04-25T13:34:35.714 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: | .ESoo . | 2024-04-25T13:34:35.714 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: | .oo= . . . | 2024-04-25T13:34:35.714 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: | o oo o + ..| 2024-04-25T13:34:35.714 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: | o ooo+ + + .+| 2024-04-25T13:34:35.715 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: | . =X+ + .+o| 2024-04-25T13:34:35.715 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: +----[SHA256]-----+ 2024-04-25T13:34:36.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.719+0000 7fd49be6b700 1 Processor -- start 2024-04-25T13:34:36.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.719+0000 7fd49be6b700 1 -- start start 2024-04-25T13:34:36.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.719+0000 7fd49be6b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494108280 0x7fd494108690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:36.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.719+0000 7fd49be6b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd49407d660 con 0x7fd494108280 2024-04-25T13:34:36.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.719+0000 7fd499c07700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494108280 0x7fd494108690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:36.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.719+0000 7fd499c07700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494108280 0x7fd494108690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59848/0 (socket says 172.21.15.43:59848) 2024-04-25T13:34:36.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.719+0000 7fd499c07700 1 -- 172.21.15.43:0/775087951 learned_addr learned my addr 172.21.15.43:0/775087951 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:36.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.720+0000 7fd499c07700 1 -- 172.21.15.43:0/775087951 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd494108bd0 con 0x7fd494108280 2024-04-25T13:34:36.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.720+0000 7fd499c07700 1 --2- 172.21.15.43:0/775087951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494108280 0x7fd494108690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd4900098a0 tx=0x7fd490009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878f3b02fa9bee76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:36.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.720+0000 7fd498c05700 1 -- 172.21.15.43:0/775087951 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd490004160 con 0x7fd494108280 2024-04-25T13:34:36.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.720+0000 7fd498c05700 1 -- 172.21.15.43:0/775087951 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fd490004300 con 0x7fd494108280 2024-04-25T13:34:36.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.720+0000 7fd498c05700 1 -- 172.21.15.43:0/775087951 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4900119e0 con 0x7fd494108280 2024-04-25T13:34:36.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.721+0000 7fd49be6b700 1 -- 172.21.15.43:0/775087951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494108280 msgr2=0x7fd494108690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:36.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.721+0000 7fd49be6b700 1 --2- 172.21.15.43:0/775087951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494108280 0x7fd494108690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd4900098a0 tx=0x7fd490009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:36.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.721+0000 7fd49be6b700 1 -- 172.21.15.43:0/775087951 shutdown_connections 2024-04-25T13:34:36.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.721+0000 7fd49be6b700 1 --2- 172.21.15.43:0/775087951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494108280 0x7fd494108690 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:36.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.721+0000 7fd49be6b700 1 -- 172.21.15.43:0/775087951 >> 172.21.15.43:0/775087951 conn(0x7fd494103e90 msgr2=0x7fd494106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:36.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.721+0000 7fd49be6b700 1 -- 172.21.15.43:0/775087951 shutdown_connections 2024-04-25T13:34:36.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.721+0000 7fd49be6b700 1 -- 172.21.15.43:0/775087951 wait complete. 2024-04-25T13:34:36.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.722+0000 7fd49be6b700 1 Processor -- start 2024-04-25T13:34:36.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.722+0000 7fd49be6b700 1 -- start start 2024-04-25T13:34:36.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.722+0000 7fd49be6b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494108280 0x7fd49419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:36.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.722+0000 7fd49be6b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd494109bf0 con 0x7fd494108280 2024-04-25T13:34:36.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.722+0000 7fd499c07700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494108280 0x7fd49419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:36.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.722+0000 7fd499c07700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494108280 0x7fd49419fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59856/0 (socket says 172.21.15.43:59856) 2024-04-25T13:34:36.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.722+0000 7fd499c07700 1 -- 172.21.15.43:0/834919964 learned_addr learned my addr 172.21.15.43:0/834919964 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:36.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.722+0000 7fd499c07700 1 -- 172.21.15.43:0/834919964 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4941a02d0 con 0x7fd494108280 2024-04-25T13:34:36.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.722+0000 7fd499c07700 1 --2- 172.21.15.43:0/834919964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494108280 0x7fd49419fd90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd4900119b0 tx=0x7fd490011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:36.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.722+0000 7fd48affd700 1 -- 172.21.15.43:0/834919964 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd490003af0 con 0x7fd494108280 2024-04-25T13:34:36.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.723+0000 7fd48affd700 1 -- 172.21.15.43:0/834919964 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fd49001a8a0 con 0x7fd494108280 2024-04-25T13:34:36.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.723+0000 7fd49be6b700 1 -- 172.21.15.43:0/834919964 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4941a0560 con 0x7fd494108280 2024-04-25T13:34:36.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.723+0000 7fd48affd700 1 -- 172.21.15.43:0/834919964 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd490024830 con 0x7fd494108280 2024-04-25T13:34:36.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.723+0000 7fd49be6b700 1 -- 172.21.15.43:0/834919964 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4941a3170 con 0x7fd494108280 2024-04-25T13:34:36.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.724+0000 7fd49be6b700 1 -- 172.21.15.43:0/834919964 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd494064cf0 con 0x7fd494108280 2024-04-25T13:34:36.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.724+0000 7fd48affd700 1 -- 172.21.15.43:0/834919964 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7fd490022020 con 0x7fd494108280 2024-04-25T13:34:36.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.724+0000 7fd48affd700 1 --2- 172.21.15.43:0/834919964 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fd48003d630 0x7fd48003fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:36.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.724+0000 7fd48affd700 1 -- 172.21.15.43:0/834919964 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd490052940 con 0x7fd494108280 2024-04-25T13:34:36.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.724+0000 7fd499406700 1 --2- 172.21.15.43:0/834919964 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fd48003d630 0x7fd48003fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:36.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.725+0000 7fd499406700 1 --2- 172.21.15.43:0/834919964 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fd48003d630 0x7fd48003fb40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd484006fd0 tx=0x7fd484006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:36.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.729+0000 7fd48affd700 1 -- 172.21.15.43:0/834919964 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd49000b3e0 con 0x7fd494108280 2024-04-25T13:34:36.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:34.936+0000 7fd49be6b700 1 -- 172.21.15.43:0/834919964 --> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fd494063ad0 con 0x7fd48003d630 2024-04-25T13:34:36.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:35.426+0000 7fd48affd700 1 -- 172.21.15.43:0/834919964 <== mgr.14118 v2:172.21.15.43:6800/1629086480 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd494063ad0 con 0x7fd48003d630 2024-04-25T13:34:36.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:35.428+0000 7fd49be6b700 1 -- 172.21.15.43:0/834919964 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fd48003d630 msgr2=0x7fd48003fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:36.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:35.428+0000 7fd49be6b700 1 --2- 172.21.15.43:0/834919964 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fd48003d630 0x7fd48003fb40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd484006fd0 tx=0x7fd484006e40 comp rx=0 tx=0).stop 2024-04-25T13:34:36.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:35.428+0000 7fd49be6b700 1 -- 172.21.15.43:0/834919964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494108280 msgr2=0x7fd49419fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:36.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:35.428+0000 7fd49be6b700 1 --2- 172.21.15.43:0/834919964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494108280 0x7fd49419fd90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd4900119b0 tx=0x7fd490011a90 comp rx=0 tx=0).stop 2024-04-25T13:34:36.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:35.428+0000 7fd49be6b700 1 -- 172.21.15.43:0/834919964 shutdown_connections 2024-04-25T13:34:36.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:35.428+0000 7fd49be6b700 1 --2- 172.21.15.43:0/834919964 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fd48003d630 0x7fd48003fb40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:36.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:35.428+0000 7fd49be6b700 1 --2- 172.21.15.43:0/834919964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494108280 0x7fd49419fd90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:36.065 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:35.428+0000 7fd49be6b700 1 -- 172.21.15.43:0/834919964 >> 172.21.15.43:0/834919964 conn(0x7fd494103e90 msgr2=0x7fd494193ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:36.065 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:35.428+0000 7fd49be6b700 1 -- 172.21.15.43:0/834919964 shutdown_connections 2024-04-25T13:34:36.065 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:35.428+0000 7fd49be6b700 1 -- 172.21.15.43:0/834919964 wait complete. 2024-04-25T13:34:36.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:36 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' 2024-04-25T13:34:36.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:36 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' 2024-04-25T13:34:37.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaaCWbSr8SpQOm5BsyCB/qFZmR+LBJalnUfmRV8zg7EOCUyMZzTA/uq8YjIAj7tFlzis2X49rDieAEuvQAuaES3xTsBd+diA8szQffK9SM3D7a3WuE3cECbEuawtfX+bCH92CEq/sxD9eOah21rLVmYKcvGkS6CPRMzYUFrHz+VG4bSlS6VL0cyXfPbHsn0/9U9C+Mzn3VMGeKurKeGOZUK9AInvFuyac5s9axwjhRMe//gkCqAx2A5wljZNIbrCQZZZpA/xcF5lgyrLFCfPAKWhu/C7kX6ihg+NNmR/L0XQ9DduDXVglI+ywddP98iLAo3lRmdXEW9wtFimrDgnJWcbK3vxMfd1v7mLdsDMj2L8AzcZemuTMGEAFfVVFYqxeagTYCpu8TcXktEbvpX0iElc2AVl0L/uo8khdvgcHGTigGrbJRW17R8dB+ek6EqCdA7PbhR3mgu4wBOtB7TJC4hwKPg++RS9x6nfDhuzWk4R9uHYlVWnKhA3yl9nVyYbM= ceph-394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:34:37.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.504+0000 7f00234b7700 1 Processor -- start 2024-04-25T13:34:37.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.504+0000 7f00234b7700 1 -- start start 2024-04-25T13:34:37.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.504+0000 7f00234b7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f001c10a3e0 0x7f001c10c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:37.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.504+0000 7f00234b7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f001c07ce10 con 0x7f001c10a3e0 2024-04-25T13:34:37.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.505+0000 7f0021253700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f001c10a3e0 0x7f001c10c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:37.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.505+0000 7f0021253700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f001c10a3e0 0x7f001c10c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59870/0 (socket says 172.21.15.43:59870) 2024-04-25T13:34:37.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.505+0000 7f0021253700 1 -- 172.21.15.43:0/1372456368 learned_addr learned my addr 172.21.15.43:0/1372456368 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:37.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.505+0000 7f0021253700 1 -- 172.21.15.43:0/1372456368 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c10cd40 con 0x7f001c10a3e0 2024-04-25T13:34:37.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.505+0000 7f0021253700 1 --2- 172.21.15.43:0/1372456368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f001c10a3e0 0x7f001c10c800 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f00100098a0 tx=0x7f0010009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a0a6fd41e50819 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:37.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.505+0000 7f000ffff700 1 -- 172.21.15.43:0/1372456368 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0010004160 con 0x7f001c10a3e0 2024-04-25T13:34:37.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.505+0000 7f000ffff700 1 -- 172.21.15.43:0/1372456368 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0010004300 con 0x7f001c10a3e0 2024-04-25T13:34:37.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.505+0000 7f000ffff700 1 -- 172.21.15.43:0/1372456368 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00100119e0 con 0x7f001c10a3e0 2024-04-25T13:34:37.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.506+0000 7f00234b7700 1 -- 172.21.15.43:0/1372456368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f001c10a3e0 msgr2=0x7f001c10c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:37.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.506+0000 7f00234b7700 1 --2- 172.21.15.43:0/1372456368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f001c10a3e0 0x7f001c10c800 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f00100098a0 tx=0x7f0010009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:37.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.506+0000 7f00234b7700 1 -- 172.21.15.43:0/1372456368 shutdown_connections 2024-04-25T13:34:37.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.506+0000 7f00234b7700 1 --2- 172.21.15.43:0/1372456368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f001c10a3e0 0x7f001c10c800 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:37.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.506+0000 7f00234b7700 1 -- 172.21.15.43:0/1372456368 >> 172.21.15.43:0/1372456368 conn(0x7f001c103e40 msgr2=0x7f001c1062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:37.286 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.506+0000 7f00234b7700 1 -- 172.21.15.43:0/1372456368 shutdown_connections 2024-04-25T13:34:37.286 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.506+0000 7f00234b7700 1 -- 172.21.15.43:0/1372456368 wait complete. 2024-04-25T13:34:37.286 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.507+0000 7f00234b7700 1 Processor -- start 2024-04-25T13:34:37.286 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.507+0000 7f00234b7700 1 -- start start 2024-04-25T13:34:37.286 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.507+0000 7f00234b7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f001c10a3e0 0x7f001c19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:37.286 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.507+0000 7f00234b7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f001c10dc40 con 0x7f001c10a3e0 2024-04-25T13:34:37.286 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.507+0000 7f0021253700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f001c10a3e0 0x7f001c19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:37.286 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.507+0000 7f0021253700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f001c10a3e0 0x7f001c19dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59874/0 (socket says 172.21.15.43:59874) 2024-04-25T13:34:37.286 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.507+0000 7f0021253700 1 -- 172.21.15.43:0/1208583581 learned_addr learned my addr 172.21.15.43:0/1208583581 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:37.286 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.507+0000 7f0021253700 1 -- 172.21.15.43:0/1208583581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c19e0f0 con 0x7f001c10a3e0 2024-04-25T13:34:37.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.508+0000 7f0021253700 1 --2- 172.21.15.43:0/1208583581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f001c10a3e0 0x7f001c19dbb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00100116a0 tx=0x7f0010011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:37.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.508+0000 7f000e7fc700 1 -- 172.21.15.43:0/1208583581 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00100039f0 con 0x7f001c10a3e0 2024-04-25T13:34:37.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.508+0000 7f000e7fc700 1 -- 172.21.15.43:0/1208583581 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0010003b90 con 0x7f001c10a3e0 2024-04-25T13:34:37.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.508+0000 7f00234b7700 1 -- 172.21.15.43:0/1208583581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001c19e380 con 0x7f001c10a3e0 2024-04-25T13:34:37.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.508+0000 7f000e7fc700 1 -- 172.21.15.43:0/1208583581 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f001001a600 con 0x7f001c10a3e0 2024-04-25T13:34:37.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.508+0000 7f00234b7700 1 -- 172.21.15.43:0/1208583581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001c1a0f90 con 0x7f001c10a3e0 2024-04-25T13:34:37.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.509+0000 7f000e7fc700 1 -- 172.21.15.43:0/1208583581 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7f001001a930 con 0x7f001c10a3e0 2024-04-25T13:34:37.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.509+0000 7f00234b7700 1 -- 172.21.15.43:0/1208583581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001c064cf0 con 0x7f001c10a3e0 2024-04-25T13:34:37.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.509+0000 7f000e7fc700 1 --2- 172.21.15.43:0/1208583581 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f000803d630 0x7f000803fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:37.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.509+0000 7f000e7fc700 1 -- 172.21.15.43:0/1208583581 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0010052bd0 con 0x7f001c10a3e0 2024-04-25T13:34:37.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.509+0000 7f0020a52700 1 --2- 172.21.15.43:0/1208583581 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f000803d630 0x7f000803fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:37.287 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.510+0000 7f0020a52700 1 --2- 172.21.15.43:0/1208583581 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f000803d630 0x7f000803fb40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0018006fd0 tx=0x7f0018006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:37.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.515+0000 7f000e7fc700 1 -- 172.21.15.43:0/1208583581 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f001002c350 con 0x7f001c10a3e0 2024-04-25T13:34:37.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.723+0000 7f00234b7700 1 -- 172.21.15.43:0/1208583581 --> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f001c104d70 con 0x7f000803d630 2024-04-25T13:34:37.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.724+0000 7f000e7fc700 1 -- 172.21.15.43:0/1208583581 <== mgr.14118 v2:172.21.15.43:6800/1629086480 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f001c104d70 con 0x7f000803d630 2024-04-25T13:34:37.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.725+0000 7f00234b7700 1 -- 172.21.15.43:0/1208583581 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f000803d630 msgr2=0x7f000803fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:37.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.725+0000 7f00234b7700 1 --2- 172.21.15.43:0/1208583581 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f000803d630 0x7f000803fb40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0018006fd0 tx=0x7f0018006e40 comp rx=0 tx=0).stop 2024-04-25T13:34:37.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.725+0000 7f00234b7700 1 -- 172.21.15.43:0/1208583581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f001c10a3e0 msgr2=0x7f001c19dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:37.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.725+0000 7f00234b7700 1 --2- 172.21.15.43:0/1208583581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f001c10a3e0 0x7f001c19dbb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00100116a0 tx=0x7f0010011a60 comp rx=0 tx=0).stop 2024-04-25T13:34:37.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.726+0000 7f00234b7700 1 -- 172.21.15.43:0/1208583581 shutdown_connections 2024-04-25T13:34:37.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.726+0000 7f00234b7700 1 --2- 172.21.15.43:0/1208583581 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f000803d630 0x7f000803fb40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:37.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.726+0000 7f00234b7700 1 --2- 172.21.15.43:0/1208583581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f001c10a3e0 0x7f001c19dbb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:37.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.726+0000 7f00234b7700 1 -- 172.21.15.43:0/1208583581 >> 172.21.15.43:0/1208583581 conn(0x7f001c103e40 msgr2=0x7f001c104660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:37.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.726+0000 7f00234b7700 1 -- 172.21.15.43:0/1208583581 shutdown_connections 2024-04-25T13:34:37.288 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:36.726+0000 7f00234b7700 1 -- 172.21.15.43:0/1208583581 wait complete. 2024-04-25T13:34:37.288 INFO:teuthology.orchestra.run.smithi043.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-25T13:34:37.288 INFO:teuthology.orchestra.run.smithi043.stdout:Adding key to root@localhost authorized_keys... 2024-04-25T13:34:37.289 INFO:teuthology.orchestra.run.smithi043.stdout:Adding host smithi043... 2024-04-25T13:34:37.578 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:37 smithi043 ceph-mon[29195]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:34:38.538 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:38 smithi043 ceph-mon[29195]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi043", "addr": "172.21.15.43", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:34:39.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:39 smithi043 ceph-mon[29195]: Deploying cephadm binary to smithi043 2024-04-25T13:34:42.733 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Added host 'smithi043' with addr '172.21.15.43' 2024-04-25T13:34:42.733 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.700+0000 7f1fb1742700 1 Processor -- start 2024-04-25T13:34:42.733 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.701+0000 7f1fb1742700 1 -- start start 2024-04-25T13:34:42.733 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.701+0000 7f1fb1742700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fac107bd0 0x7f1fac107fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:42.733 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.701+0000 7f1fb1742700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac1085b0 con 0x7f1fac107bd0 2024-04-25T13:34:42.733 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.701+0000 7f1faaffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fac107bd0 0x7f1fac107fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:42.734 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.701+0000 7f1faaffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fac107bd0 0x7f1fac107fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59890/0 (socket says 172.21.15.43:59890) 2024-04-25T13:34:42.734 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.701+0000 7f1faaffd700 1 -- 172.21.15.43:0/979504641 learned_addr learned my addr 172.21.15.43:0/979504641 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:42.734 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.701+0000 7f1faaffd700 1 -- 172.21.15.43:0/979504641 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fac10abd0 con 0x7f1fac107bd0 2024-04-25T13:34:42.734 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.701+0000 7f1faaffd700 1 --2- 172.21.15.43:0/979504641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fac107bd0 0x7f1fac107fe0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0098a0 tx=0x7f1f9c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7577a84a2fef73c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:42.734 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.702+0000 7f1fa9ffb700 1 -- 172.21.15.43:0/979504641 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f9c004160 con 0x7f1fac107bd0 2024-04-25T13:34:42.734 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.702+0000 7f1fa9ffb700 1 -- 172.21.15.43:0/979504641 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f1f9c004300 con 0x7f1fac107bd0 2024-04-25T13:34:42.734 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.702+0000 7f1fa9ffb700 1 -- 172.21.15.43:0/979504641 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f9c0119e0 con 0x7f1fac107bd0 2024-04-25T13:34:42.734 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.702+0000 7f1fb1742700 1 -- 172.21.15.43:0/979504641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fac107bd0 msgr2=0x7f1fac107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:42.734 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.702+0000 7f1fb1742700 1 --2- 172.21.15.43:0/979504641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fac107bd0 0x7f1fac107fe0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0098a0 tx=0x7f1f9c009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:42.734 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.702+0000 7f1fb1742700 1 -- 172.21.15.43:0/979504641 shutdown_connections 2024-04-25T13:34:42.734 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.702+0000 7f1fb1742700 1 --2- 172.21.15.43:0/979504641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fac107bd0 0x7f1fac107fe0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:42.735 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.702+0000 7f1fb1742700 1 -- 172.21.15.43:0/979504641 >> 172.21.15.43:0/979504641 conn(0x7f1fac1035c0 msgr2=0x7f1fac105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:42.735 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.702+0000 7f1fb1742700 1 -- 172.21.15.43:0/979504641 shutdown_connections 2024-04-25T13:34:42.735 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.703+0000 7f1fb1742700 1 -- 172.21.15.43:0/979504641 wait complete. 2024-04-25T13:34:42.735 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.703+0000 7f1fb1742700 1 Processor -- start 2024-04-25T13:34:42.735 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.703+0000 7f1fb1742700 1 -- start start 2024-04-25T13:34:42.735 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.704+0000 7f1fb1742700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fac107bd0 0x7f1fac10a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:42.735 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.704+0000 7f1fb1742700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac10de00 con 0x7f1fac107bd0 2024-04-25T13:34:42.735 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.704+0000 7f1faaffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fac107bd0 0x7f1fac10a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:42.735 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.704+0000 7f1faaffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fac107bd0 0x7f1fac10a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59892/0 (socket says 172.21.15.43:59892) 2024-04-25T13:34:42.735 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.704+0000 7f1faaffd700 1 -- 172.21.15.43:0/640556009 learned_addr learned my addr 172.21.15.43:0/640556009 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:42.735 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.704+0000 7f1faaffd700 1 -- 172.21.15.43:0/640556009 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fac10a890 con 0x7f1fac107bd0 2024-04-25T13:34:42.736 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.704+0000 7f1faaffd700 1 --2- 172.21.15.43:0/640556009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fac107bd0 0x7f1fac10a350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0119b0 tx=0x7f1f9c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:42.736 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.704+0000 7f1f93fff700 1 -- 172.21.15.43:0/640556009 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f9c003af0 con 0x7f1fac107bd0 2024-04-25T13:34:42.736 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.704+0000 7f1f93fff700 1 -- 172.21.15.43:0/640556009 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f1f9c01a8a0 con 0x7f1fac107bd0 2024-04-25T13:34:42.736 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.704+0000 7f1f93fff700 1 -- 172.21.15.43:0/640556009 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f9c024780 con 0x7f1fac107bd0 2024-04-25T13:34:42.736 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.704+0000 7f1fb1742700 1 -- 172.21.15.43:0/640556009 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fac108ae0 con 0x7f1fac107bd0 2024-04-25T13:34:42.736 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.705+0000 7f1fb1742700 1 -- 172.21.15.43:0/640556009 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fac108fc0 con 0x7f1fac107bd0 2024-04-25T13:34:42.736 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.705+0000 7f1f93fff700 1 -- 172.21.15.43:0/640556009 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7f1f9c022020 con 0x7f1fac107bd0 2024-04-25T13:34:42.736 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.705+0000 7f1fb1742700 1 -- 172.21.15.43:0/640556009 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fac064cf0 con 0x7f1fac107bd0 2024-04-25T13:34:42.736 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.706+0000 7f1f93fff700 1 --2- 172.21.15.43:0/640556009 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f1f9403d630 0x7f1f9403fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:42.736 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.706+0000 7f1f93fff700 1 -- 172.21.15.43:0/640556009 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1f9c052720 con 0x7f1fac107bd0 2024-04-25T13:34:42.736 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.706+0000 7f1faa7fc700 1 --2- 172.21.15.43:0/640556009 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f1f9403d630 0x7f1f9403fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:42.737 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.706+0000 7f1faa7fc700 1 --2- 172.21.15.43:0/640556009 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f1f9403d630 0x7f1f9403fb40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0006fd0 tx=0x7f1fa0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:42.737 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.711+0000 7f1f93fff700 1 -- 172.21.15.43:0/640556009 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1f9c00b3e0 con 0x7f1fac107bd0 2024-04-25T13:34:42.737 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:37.929+0000 7f1fb1742700 1 -- 172.21.15.43:0/640556009 --> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi043", "addr": "172.21.15.43", "target": ["mon-mgr", ""]}) -- 0x7f1fac109600 con 0x7f1f9403d630 2024-04-25T13:34:42.737 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:42.158+0000 7f1f93fff700 1 -- 172.21.15.43:0/640556009 <== mgr.14118 v2:172.21.15.43:6800/1629086480 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f1fac109600 con 0x7f1f9403d630 2024-04-25T13:34:42.737 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:42.160+0000 7f1fb1742700 1 -- 172.21.15.43:0/640556009 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f1f9403d630 msgr2=0x7f1f9403fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:42.737 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:42.160+0000 7f1fb1742700 1 --2- 172.21.15.43:0/640556009 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f1f9403d630 0x7f1f9403fb40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0006fd0 tx=0x7f1fa0006e40 comp rx=0 tx=0).stop 2024-04-25T13:34:42.737 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:42.160+0000 7f1fb1742700 1 -- 172.21.15.43:0/640556009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fac107bd0 msgr2=0x7f1fac10a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:42.737 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:42.160+0000 7f1fb1742700 1 --2- 172.21.15.43:0/640556009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fac107bd0 0x7f1fac10a350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0119b0 tx=0x7f1f9c011a90 comp rx=0 tx=0).stop 2024-04-25T13:34:42.737 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:42.160+0000 7f1fb1742700 1 -- 172.21.15.43:0/640556009 shutdown_connections 2024-04-25T13:34:42.737 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:42.160+0000 7f1fb1742700 1 --2- 172.21.15.43:0/640556009 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f1f9403d630 0x7f1f9403fb40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:42.737 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:42.160+0000 7f1fb1742700 1 --2- 172.21.15.43:0/640556009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fac107bd0 0x7f1fac10a350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:42.738 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:42.160+0000 7f1fb1742700 1 -- 172.21.15.43:0/640556009 >> 172.21.15.43:0/640556009 conn(0x7f1fac1035c0 msgr2=0x7f1fac103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:42.738 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:42.160+0000 7f1fb1742700 1 -- 172.21.15.43:0/640556009 shutdown_connections 2024-04-25T13:34:42.738 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:42.160+0000 7f1fb1742700 1 -- 172.21.15.43:0/640556009 wait complete. 2024-04-25T13:34:42.738 INFO:teuthology.orchestra.run.smithi043.stdout:Deploying unmanaged mon service... 2024-04-25T13:34:43.365 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:43 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' 2024-04-25T13:34:43.365 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:43 smithi043 ceph-mon[29195]: Added host smithi043 2024-04-25T13:34:43.365 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:43 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:34:44.245 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-25T13:34:44.245 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.194+0000 7f30acf4f700 1 Processor -- start 2024-04-25T13:34:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.194+0000 7f30acf4f700 1 -- start start 2024-04-25T13:34:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.194+0000 7f30acf4f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a8108800 0x7f30a8108c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.194+0000 7f30acf4f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30a8109200 con 0x7f30a8108800 2024-04-25T13:34:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.195+0000 7f30a659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a8108800 0x7f30a8108c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.195+0000 7f30a659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a8108800 0x7f30a8108c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42100/0 (socket says 172.21.15.43:42100) 2024-04-25T13:34:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.195+0000 7f30a659c700 1 -- 172.21.15.43:0/167965567 learned_addr learned my addr 172.21.15.43:0/167965567 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.195+0000 7f30a659c700 1 -- 172.21.15.43:0/167965567 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a81099d0 con 0x7f30a8108800 2024-04-25T13:34:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.195+0000 7f30a659c700 1 --2- 172.21.15.43:0/167965567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a8108800 0x7f30a8108c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f30980098a0 tx=0x7f3098009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3eabf31a1bb097 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.195+0000 7f30a559a700 1 -- 172.21.15.43:0/167965567 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3098004160 con 0x7f30a8108800 2024-04-25T13:34:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.195+0000 7f30a559a700 1 -- 172.21.15.43:0/167965567 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f3098004300 con 0x7f30a8108800 2024-04-25T13:34:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.195+0000 7f30a559a700 1 -- 172.21.15.43:0/167965567 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30980119e0 con 0x7f30a8108800 2024-04-25T13:34:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.196+0000 7f30acf4f700 1 -- 172.21.15.43:0/167965567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a8108800 msgr2=0x7f30a8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.196+0000 7f30acf4f700 1 --2- 172.21.15.43:0/167965567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a8108800 0x7f30a8108c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f30980098a0 tx=0x7f3098009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.196+0000 7f30acf4f700 1 -- 172.21.15.43:0/167965567 shutdown_connections 2024-04-25T13:34:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.196+0000 7f30acf4f700 1 --2- 172.21.15.43:0/167965567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a8108800 0x7f30a8108c10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.196+0000 7f30acf4f700 1 -- 172.21.15.43:0/167965567 >> 172.21.15.43:0/167965567 conn(0x7f30a8103e60 msgr2=0x7f30a81062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.196+0000 7f30acf4f700 1 -- 172.21.15.43:0/167965567 shutdown_connections 2024-04-25T13:34:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.196+0000 7f30acf4f700 1 -- 172.21.15.43:0/167965567 wait complete. 2024-04-25T13:34:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.197+0000 7f30acf4f700 1 Processor -- start 2024-04-25T13:34:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.197+0000 7f30acf4f700 1 -- start start 2024-04-25T13:34:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.197+0000 7f30acf4f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a8108800 0x7f30a819dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.197+0000 7f30acf4f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30a810cd80 con 0x7f30a8108800 2024-04-25T13:34:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.197+0000 7f30a659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a8108800 0x7f30a819dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.197+0000 7f30a659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a8108800 0x7f30a819dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42114/0 (socket says 172.21.15.43:42114) 2024-04-25T13:34:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.197+0000 7f30a659c700 1 -- 172.21.15.43:0/3945087479 learned_addr learned my addr 172.21.15.43:0/3945087479 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.198+0000 7f30a659c700 1 -- 172.21.15.43:0/3945087479 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a819e190 con 0x7f30a8108800 2024-04-25T13:34:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.198+0000 7f30a659c700 1 --2- 172.21.15.43:0/3945087479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a8108800 0x7f30a819dc50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3098009fb0 tx=0x7f3098011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.198+0000 7f309f7fe700 1 -- 172.21.15.43:0/3945087479 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30980038b0 con 0x7f30a8108800 2024-04-25T13:34:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.198+0000 7f309f7fe700 1 -- 172.21.15.43:0/3945087479 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f3098003a50 con 0x7f30a8108800 2024-04-25T13:34:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.198+0000 7f309f7fe700 1 -- 172.21.15.43:0/3945087479 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3098019550 con 0x7f30a8108800 2024-04-25T13:34:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.198+0000 7f30acf4f700 1 -- 172.21.15.43:0/3945087479 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a819e420 con 0x7f30a8108800 2024-04-25T13:34:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.198+0000 7f30acf4f700 1 -- 172.21.15.43:0/3945087479 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a81a1030 con 0x7f30a8108800 2024-04-25T13:34:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.199+0000 7f309f7fe700 1 -- 172.21.15.43:0/3945087479 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7f3098019800 con 0x7f30a8108800 2024-04-25T13:34:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.199+0000 7f30acf4f700 1 -- 172.21.15.43:0/3945087479 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a8064cf0 con 0x7f30a8108800 2024-04-25T13:34:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.199+0000 7f309f7fe700 1 --2- 172.21.15.43:0/3945087479 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f309403d630 0x7f309403fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.199+0000 7f309f7fe700 1 -- 172.21.15.43:0/3945087479 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3098052970 con 0x7f30a8108800 2024-04-25T13:34:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.200+0000 7f30a5d9b700 1 --2- 172.21.15.43:0/3945087479 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f309403d630 0x7f309403fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.200+0000 7f30a5d9b700 1 --2- 172.21.15.43:0/3945087479 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f309403d630 0x7f309403fb40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3090006fd0 tx=0x7f3090006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.205+0000 7f309f7fe700 1 -- 172.21.15.43:0/3945087479 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3098017e90 con 0x7f30a8108800 2024-04-25T13:34:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.440+0000 7f30acf4f700 1 -- 172.21.15.43:0/3945087479 --> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f30a802e880 con 0x7f309403d630 2024-04-25T13:34:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.445+0000 7f309f7fe700 1 -- 172.21.15.43:0/3945087479 <== mgr.14118 v2:172.21.15.43:6800/1629086480 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f30a802e880 con 0x7f309403d630 2024-04-25T13:34:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.447+0000 7f30acf4f700 1 -- 172.21.15.43:0/3945087479 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f309403d630 msgr2=0x7f309403fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.447+0000 7f30acf4f700 1 --2- 172.21.15.43:0/3945087479 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f309403d630 0x7f309403fb40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3090006fd0 tx=0x7f3090006e40 comp rx=0 tx=0).stop 2024-04-25T13:34:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.447+0000 7f30acf4f700 1 -- 172.21.15.43:0/3945087479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a8108800 msgr2=0x7f30a819dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.447+0000 7f30acf4f700 1 --2- 172.21.15.43:0/3945087479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a8108800 0x7f30a819dc50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3098009fb0 tx=0x7f3098011a60 comp rx=0 tx=0).stop 2024-04-25T13:34:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.448+0000 7f30acf4f700 1 -- 172.21.15.43:0/3945087479 shutdown_connections 2024-04-25T13:34:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.448+0000 7f30acf4f700 1 --2- 172.21.15.43:0/3945087479 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f309403d630 0x7f309403fb40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.448+0000 7f30acf4f700 1 --2- 172.21.15.43:0/3945087479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a8108800 0x7f30a819dc50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.448+0000 7f30acf4f700 1 -- 172.21.15.43:0/3945087479 >> 172.21.15.43:0/3945087479 conn(0x7f30a8103e60 msgr2=0x7f30a8194200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.448+0000 7f30acf4f700 1 -- 172.21.15.43:0/3945087479 shutdown_connections 2024-04-25T13:34:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:43.448+0000 7f30acf4f700 1 -- 172.21.15.43:0/3945087479 wait complete. 2024-04-25T13:34:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:Deploying unmanaged mgr service... 2024-04-25T13:34:44.514 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:44 smithi043 ceph-mon[29195]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:34:44.515 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:44 smithi043 ceph-mon[29195]: Saving service mon spec with placement count:5 2024-04-25T13:34:44.515 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:44 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' 2024-04-25T13:34:46.053 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:45 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' 2024-04-25T13:34:46.053 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:45 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' 2024-04-25T13:34:46.053 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:45 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' 2024-04-25T13:34:46.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-25T13:34:46.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.231+0000 7fc51408a700 1 Processor -- start 2024-04-25T13:34:46.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.231+0000 7fc51408a700 1 -- start start 2024-04-25T13:34:46.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.231+0000 7fc51408a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc50c10a3e0 0x7fc50c10c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:46.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.231+0000 7fc51408a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c07ce10 con 0x7fc50c10a3e0 2024-04-25T13:34:46.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.231+0000 7fc511e26700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc50c10a3e0 0x7fc50c10c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:46.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.231+0000 7fc511e26700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc50c10a3e0 0x7fc50c10c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42130/0 (socket says 172.21.15.43:42130) 2024-04-25T13:34:46.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.231+0000 7fc511e26700 1 -- 172.21.15.43:0/854230288 learned_addr learned my addr 172.21.15.43:0/854230288 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:46.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.232+0000 7fc511e26700 1 -- 172.21.15.43:0/854230288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c10cd40 con 0x7fc50c10a3e0 2024-04-25T13:34:46.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.232+0000 7fc511e26700 1 --2- 172.21.15.43:0/854230288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc50c10a3e0 0x7fc50c10c800 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc5080098a0 tx=0x7fc508009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8a6d80420f352e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:46.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.232+0000 7fc510e24700 1 -- 172.21.15.43:0/854230288 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc508004160 con 0x7fc50c10a3e0 2024-04-25T13:34:46.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.232+0000 7fc510e24700 1 -- 172.21.15.43:0/854230288 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc508004300 con 0x7fc50c10a3e0 2024-04-25T13:34:46.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.232+0000 7fc510e24700 1 -- 172.21.15.43:0/854230288 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc508011960 con 0x7fc50c10a3e0 2024-04-25T13:34:46.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.233+0000 7fc51408a700 1 -- 172.21.15.43:0/854230288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc50c10a3e0 msgr2=0x7fc50c10c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:46.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.233+0000 7fc51408a700 1 --2- 172.21.15.43:0/854230288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc50c10a3e0 0x7fc50c10c800 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc5080098a0 tx=0x7fc508009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:46.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.233+0000 7fc51408a700 1 -- 172.21.15.43:0/854230288 shutdown_connections 2024-04-25T13:34:46.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.233+0000 7fc51408a700 1 --2- 172.21.15.43:0/854230288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc50c10a3e0 0x7fc50c10c800 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:46.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.233+0000 7fc51408a700 1 -- 172.21.15.43:0/854230288 >> 172.21.15.43:0/854230288 conn(0x7fc50c103e40 msgr2=0x7fc50c1062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:46.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.233+0000 7fc51408a700 1 -- 172.21.15.43:0/854230288 shutdown_connections 2024-04-25T13:34:46.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.233+0000 7fc51408a700 1 -- 172.21.15.43:0/854230288 wait complete. 2024-04-25T13:34:46.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.234+0000 7fc51408a700 1 Processor -- start 2024-04-25T13:34:46.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.234+0000 7fc51408a700 1 -- start start 2024-04-25T13:34:46.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.234+0000 7fc51408a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc50c10a3e0 0x7fc50c19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:46.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.234+0000 7fc51408a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c10dc80 con 0x7fc50c10a3e0 2024-04-25T13:34:46.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.234+0000 7fc511e26700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc50c10a3e0 0x7fc50c19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:46.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.234+0000 7fc511e26700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc50c10a3e0 0x7fc50c19fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42140/0 (socket says 172.21.15.43:42140) 2024-04-25T13:34:46.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.234+0000 7fc511e26700 1 -- 172.21.15.43:0/695547018 learned_addr learned my addr 172.21.15.43:0/695547018 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:46.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.234+0000 7fc511e26700 1 -- 172.21.15.43:0/695547018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c1a0330 con 0x7fc50c10a3e0 2024-04-25T13:34:46.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.235+0000 7fc511e26700 1 --2- 172.21.15.43:0/695547018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc50c10a3e0 0x7fc50c19fdf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc508011670 tx=0x7fc508011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:46.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.235+0000 7fc4feffd700 1 -- 172.21.15.43:0/695547018 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc508003a60 con 0x7fc50c10a3e0 2024-04-25T13:34:46.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.235+0000 7fc4feffd700 1 -- 172.21.15.43:0/695547018 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc50801b8d0 con 0x7fc50c10a3e0 2024-04-25T13:34:46.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.235+0000 7fc51408a700 1 -- 172.21.15.43:0/695547018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50c1a05c0 con 0x7fc50c10a3e0 2024-04-25T13:34:46.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.235+0000 7fc51408a700 1 -- 172.21.15.43:0/695547018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50c1a31d0 con 0x7fc50c10a3e0 2024-04-25T13:34:46.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.235+0000 7fc4feffd700 1 -- 172.21.15.43:0/695547018 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc508023750 con 0x7fc50c10a3e0 2024-04-25T13:34:46.062 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.236+0000 7fc51408a700 1 -- 172.21.15.43:0/695547018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc50c064cf0 con 0x7fc50c10a3e0 2024-04-25T13:34:46.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.236+0000 7fc4feffd700 1 -- 172.21.15.43:0/695547018 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7fc508023a00 con 0x7fc50c10a3e0 2024-04-25T13:34:46.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.236+0000 7fc4feffd700 1 --2- 172.21.15.43:0/695547018 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fc4f803d630 0x7fc4f803fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:46.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.236+0000 7fc4feffd700 1 -- 172.21.15.43:0/695547018 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc508052dc0 con 0x7fc50c10a3e0 2024-04-25T13:34:46.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.236+0000 7fc511625700 1 --2- 172.21.15.43:0/695547018 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fc4f803d630 0x7fc4f803fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:46.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.237+0000 7fc511625700 1 --2- 172.21.15.43:0/695547018 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fc4f803d630 0x7fc4f803fb40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc500006fd0 tx=0x7fc500006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:46.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.241+0000 7fc4feffd700 1 -- 172.21.15.43:0/695547018 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc50801f030 con 0x7fc50c10a3e0 2024-04-25T13:34:46.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.484+0000 7fc51408a700 1 -- 172.21.15.43:0/695547018 --> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fc50c02e850 con 0x7fc4f803d630 2024-04-25T13:34:46.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.490+0000 7fc4feffd700 1 -- 172.21.15.43:0/695547018 <== mgr.14118 v2:172.21.15.43:6800/1629086480 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc50c02e850 con 0x7fc4f803d630 2024-04-25T13:34:46.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.493+0000 7fc51408a700 1 -- 172.21.15.43:0/695547018 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fc4f803d630 msgr2=0x7fc4f803fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:46.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.493+0000 7fc51408a700 1 --2- 172.21.15.43:0/695547018 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fc4f803d630 0x7fc4f803fb40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc500006fd0 tx=0x7fc500006e40 comp rx=0 tx=0).stop 2024-04-25T13:34:46.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.493+0000 7fc51408a700 1 -- 172.21.15.43:0/695547018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc50c10a3e0 msgr2=0x7fc50c19fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:46.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.493+0000 7fc51408a700 1 --2- 172.21.15.43:0/695547018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc50c10a3e0 0x7fc50c19fdf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc508011670 tx=0x7fc508011a30 comp rx=0 tx=0).stop 2024-04-25T13:34:46.063 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.493+0000 7fc51408a700 1 -- 172.21.15.43:0/695547018 shutdown_connections 2024-04-25T13:34:46.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.493+0000 7fc51408a700 1 --2- 172.21.15.43:0/695547018 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fc4f803d630 0x7fc4f803fb40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:46.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.493+0000 7fc51408a700 1 --2- 172.21.15.43:0/695547018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc50c10a3e0 0x7fc50c19fdf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:46.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.493+0000 7fc51408a700 1 -- 172.21.15.43:0/695547018 >> 172.21.15.43:0/695547018 conn(0x7fc50c103e40 msgr2=0x7fc50c108380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:46.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.493+0000 7fc51408a700 1 -- 172.21.15.43:0/695547018 shutdown_connections 2024-04-25T13:34:46.064 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:45.493+0000 7fc51408a700 1 -- 172.21.15.43:0/695547018 wait complete. 2024-04-25T13:34:47.101 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:46 smithi043 ceph-mon[29195]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:34:47.101 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:46 smithi043 ceph-mon[29195]: Saving service mgr spec with placement count:2 2024-04-25T13:34:47.101 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:46 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/686778319' entity='client.admin' 2024-04-25T13:34:47.838 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.543+0000 7f3878d0d700 1 Processor -- start 2024-04-25T13:34:47.838 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.543+0000 7f3878d0d700 1 -- start start 2024-04-25T13:34:47.838 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.543+0000 7f3878d0d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3874108250 0x7f3874108660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:47.838 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.543+0000 7f3878d0d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f387407cdd0 con 0x7f3874108250 2024-04-25T13:34:47.838 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.544+0000 7f387259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3874108250 0x7f3874108660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:47.838 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.544+0000 7f387259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3874108250 0x7f3874108660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42152/0 (socket says 172.21.15.43:42152) 2024-04-25T13:34:47.838 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.544+0000 7f387259c700 1 -- 172.21.15.43:0/3170423891 learned_addr learned my addr 172.21.15.43:0/3170423891 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:47.838 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.544+0000 7f387259c700 1 -- 172.21.15.43:0/3170423891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3874108ba0 con 0x7f3874108250 2024-04-25T13:34:47.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.544+0000 7f387259c700 1 --2- 172.21.15.43:0/3170423891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3874108250 0x7f3874108660 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f38640098a0 tx=0x7f3864009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3c7c6ffb2bb741 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:47.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.544+0000 7f3871d9b700 1 -- 172.21.15.43:0/3170423891 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3864004160 con 0x7f3874108250 2024-04-25T13:34:47.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.544+0000 7f3871d9b700 1 -- 172.21.15.43:0/3170423891 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3864004300 con 0x7f3874108250 2024-04-25T13:34:47.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.544+0000 7f3871d9b700 1 -- 172.21.15.43:0/3170423891 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3864011960 con 0x7f3874108250 2024-04-25T13:34:47.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.545+0000 7f3878d0d700 1 -- 172.21.15.43:0/3170423891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3874108250 msgr2=0x7f3874108660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:47.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.545+0000 7f3878d0d700 1 --2- 172.21.15.43:0/3170423891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3874108250 0x7f3874108660 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f38640098a0 tx=0x7f3864009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:47.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.545+0000 7f3878d0d700 1 -- 172.21.15.43:0/3170423891 shutdown_connections 2024-04-25T13:34:47.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.545+0000 7f3878d0d700 1 --2- 172.21.15.43:0/3170423891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3874108250 0x7f3874108660 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:47.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.545+0000 7f3878d0d700 1 -- 172.21.15.43:0/3170423891 >> 172.21.15.43:0/3170423891 conn(0x7f3874103e60 msgr2=0x7f38741062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:47.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.545+0000 7f3878d0d700 1 -- 172.21.15.43:0/3170423891 shutdown_connections 2024-04-25T13:34:47.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.545+0000 7f3878d0d700 1 -- 172.21.15.43:0/3170423891 wait complete. 2024-04-25T13:34:47.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.546+0000 7f3878d0d700 1 Processor -- start 2024-04-25T13:34:47.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.546+0000 7f3878d0d700 1 -- start start 2024-04-25T13:34:47.839 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.547+0000 7f3878d0d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3874108250 0x7f387419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:47.840 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.547+0000 7f3878d0d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3874109c00 con 0x7f3874108250 2024-04-25T13:34:47.840 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.547+0000 7f387259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3874108250 0x7f387419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:47.840 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.547+0000 7f387259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3874108250 0x7f387419fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42154/0 (socket says 172.21.15.43:42154) 2024-04-25T13:34:47.840 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.547+0000 7f387259c700 1 -- 172.21.15.43:0/686778319 learned_addr learned my addr 172.21.15.43:0/686778319 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:47.840 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.547+0000 7f387259c700 1 -- 172.21.15.43:0/686778319 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38741a0320 con 0x7f3874108250 2024-04-25T13:34:47.840 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.547+0000 7f387259c700 1 --2- 172.21.15.43:0/686778319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3874108250 0x7f387419fde0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3864011670 tx=0x7f3864011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:47.840 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.547+0000 7f386bfff700 1 -- 172.21.15.43:0/686778319 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3864003a60 con 0x7f3874108250 2024-04-25T13:34:47.840 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.547+0000 7f3878d0d700 1 -- 172.21.15.43:0/686778319 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38741a05b0 con 0x7f3874108250 2024-04-25T13:34:47.840 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.547+0000 7f386bfff700 1 -- 172.21.15.43:0/686778319 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f386401b8d0 con 0x7f3874108250 2024-04-25T13:34:47.840 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.547+0000 7f386bfff700 1 -- 172.21.15.43:0/686778319 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3864023750 con 0x7f3874108250 2024-04-25T13:34:47.840 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.548+0000 7f3878d0d700 1 -- 172.21.15.43:0/686778319 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38741a31c0 con 0x7f3874108250 2024-04-25T13:34:47.840 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.549+0000 7f3878d0d700 1 -- 172.21.15.43:0/686778319 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3874064cf0 con 0x7f3874108250 2024-04-25T13:34:47.840 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.549+0000 7f386bfff700 1 -- 172.21.15.43:0/686778319 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7f3864023a50 con 0x7f3874108250 2024-04-25T13:34:47.840 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.549+0000 7f386bfff700 1 --2- 172.21.15.43:0/686778319 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f386003d5e0 0x7f386003faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:47.840 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.549+0000 7f386bfff700 1 -- 172.21.15.43:0/686778319 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3864052e20 con 0x7f3874108250 2024-04-25T13:34:47.841 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.549+0000 7f3869d9b700 1 --2- 172.21.15.43:0/686778319 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f386003d5e0 0x7f386003faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:47.841 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.550+0000 7f3869d9b700 1 --2- 172.21.15.43:0/686778319 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f386003d5e0 0x7f386003faf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f385c006fd0 tx=0x7f385c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:47.841 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.554+0000 7f386bfff700 1 -- 172.21.15.43:0/686778319 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f386401f030 con 0x7f3874108250 2024-04-25T13:34:47.841 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.772+0000 7f3878d0d700 1 -- 172.21.15.43:0/686778319 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f387402e780 con 0x7f3874108250 2024-04-25T13:34:47.841 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.774+0000 7f386bfff700 1 -- 172.21.15.43:0/686778319 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f3864019e20 con 0x7f3874108250 2024-04-25T13:34:47.841 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.777+0000 7f3878d0d700 1 -- 172.21.15.43:0/686778319 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f386003d5e0 msgr2=0x7f386003faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:47.841 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.777+0000 7f3878d0d700 1 --2- 172.21.15.43:0/686778319 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f386003d5e0 0x7f386003faf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f385c006fd0 tx=0x7f385c006e40 comp rx=0 tx=0).stop 2024-04-25T13:34:47.841 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.777+0000 7f3878d0d700 1 -- 172.21.15.43:0/686778319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3874108250 msgr2=0x7f387419fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:47.841 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.777+0000 7f3878d0d700 1 --2- 172.21.15.43:0/686778319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3874108250 0x7f387419fde0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3864011670 tx=0x7f3864011a30 comp rx=0 tx=0).stop 2024-04-25T13:34:47.841 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.777+0000 7f3878d0d700 1 -- 172.21.15.43:0/686778319 shutdown_connections 2024-04-25T13:34:47.841 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.777+0000 7f3878d0d700 1 --2- 172.21.15.43:0/686778319 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f386003d5e0 0x7f386003faf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:47.841 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.777+0000 7f3878d0d700 1 --2- 172.21.15.43:0/686778319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3874108250 0x7f387419fde0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:47.841 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.777+0000 7f3878d0d700 1 -- 172.21.15.43:0/686778319 >> 172.21.15.43:0/686778319 conn(0x7f3874103e60 msgr2=0x7f3874193d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:47.841 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.777+0000 7f3878d0d700 1 -- 172.21.15.43:0/686778319 shutdown_connections 2024-04-25T13:34:47.841 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:46.777+0000 7f3878d0d700 1 -- 172.21.15.43:0/686778319 wait complete. 2024-04-25T13:34:48.641 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:48 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' 2024-04-25T13:34:49.235 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.418+0000 7fa4bb5c2700 1 Processor -- start 2024-04-25T13:34:49.235 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.418+0000 7fa4bb5c2700 1 -- start start 2024-04-25T13:34:49.235 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.419+0000 7fa4bb5c2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b410a3e0 0x7fa4b410c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:49.236 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.419+0000 7fa4bb5c2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b407ce50 con 0x7fa4b410a3e0 2024-04-25T13:34:49.236 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.419+0000 7fa4b935e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b410a3e0 0x7fa4b410c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:49.236 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.419+0000 7fa4b935e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b410a3e0 0x7fa4b410c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42156/0 (socket says 172.21.15.43:42156) 2024-04-25T13:34:49.236 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.419+0000 7fa4b935e700 1 -- 172.21.15.43:0/2399277581 learned_addr learned my addr 172.21.15.43:0/2399277581 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:49.236 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.419+0000 7fa4b935e700 1 -- 172.21.15.43:0/2399277581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b410cd40 con 0x7fa4b410a3e0 2024-04-25T13:34:49.236 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.420+0000 7fa4b935e700 1 --2- 172.21.15.43:0/2399277581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b410a3e0 0x7fa4b410c800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00098a0 tx=0x7fa4b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba77e318bfe03cb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:49.236 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.420+0000 7fa4abfff700 1 -- 172.21.15.43:0/2399277581 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4b0004160 con 0x7fa4b410a3e0 2024-04-25T13:34:49.236 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.420+0000 7fa4abfff700 1 -- 172.21.15.43:0/2399277581 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4b0004300 con 0x7fa4b410a3e0 2024-04-25T13:34:49.236 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.420+0000 7fa4abfff700 1 -- 172.21.15.43:0/2399277581 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4b0011960 con 0x7fa4b410a3e0 2024-04-25T13:34:49.236 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.421+0000 7fa4bb5c2700 1 -- 172.21.15.43:0/2399277581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b410a3e0 msgr2=0x7fa4b410c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:49.236 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.421+0000 7fa4bb5c2700 1 --2- 172.21.15.43:0/2399277581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b410a3e0 0x7fa4b410c800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00098a0 tx=0x7fa4b0009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:49.236 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.421+0000 7fa4bb5c2700 1 -- 172.21.15.43:0/2399277581 shutdown_connections 2024-04-25T13:34:49.236 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.421+0000 7fa4bb5c2700 1 --2- 172.21.15.43:0/2399277581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b410a3e0 0x7fa4b410c800 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:49.237 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.421+0000 7fa4bb5c2700 1 -- 172.21.15.43:0/2399277581 >> 172.21.15.43:0/2399277581 conn(0x7fa4b4103e60 msgr2=0x7fa4b41062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:49.237 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.421+0000 7fa4bb5c2700 1 -- 172.21.15.43:0/2399277581 shutdown_connections 2024-04-25T13:34:49.237 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.421+0000 7fa4bb5c2700 1 -- 172.21.15.43:0/2399277581 wait complete. 2024-04-25T13:34:49.237 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.422+0000 7fa4bb5c2700 1 Processor -- start 2024-04-25T13:34:49.237 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.422+0000 7fa4bb5c2700 1 -- start start 2024-04-25T13:34:49.237 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.422+0000 7fa4bb5c2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b410a3e0 0x7fa4b4109b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:49.237 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.422+0000 7fa4bb5c2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b410dce0 con 0x7fa4b410a3e0 2024-04-25T13:34:49.237 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.422+0000 7fa4b935e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b410a3e0 0x7fa4b4109b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:49.237 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.422+0000 7fa4b935e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b410a3e0 0x7fa4b4109b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42166/0 (socket says 172.21.15.43:42166) 2024-04-25T13:34:49.237 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.422+0000 7fa4b935e700 1 -- 172.21.15.43:0/2859462577 learned_addr learned my addr 172.21.15.43:0/2859462577 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:49.237 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.423+0000 7fa4b935e700 1 -- 172.21.15.43:0/2859462577 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b410a0a0 con 0x7fa4b410a3e0 2024-04-25T13:34:49.237 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.423+0000 7fa4b935e700 1 --2- 172.21.15.43:0/2859462577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b410a3e0 0x7fa4b4109b60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0011670 tx=0x7fa4b0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:49.237 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.423+0000 7fa4aa7fc700 1 -- 172.21.15.43:0/2859462577 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4b0003a60 con 0x7fa4b410a3e0 2024-04-25T13:34:49.238 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.423+0000 7fa4aa7fc700 1 -- 172.21.15.43:0/2859462577 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4b001b8d0 con 0x7fa4b410a3e0 2024-04-25T13:34:49.238 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.423+0000 7fa4bb5c2700 1 -- 172.21.15.43:0/2859462577 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b41082f0 con 0x7fa4b410a3e0 2024-04-25T13:34:49.238 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.423+0000 7fa4aa7fc700 1 -- 172.21.15.43:0/2859462577 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4b0023750 con 0x7fa4b410a3e0 2024-04-25T13:34:49.238 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.423+0000 7fa4bb5c2700 1 -- 172.21.15.43:0/2859462577 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b41087d0 con 0x7fa4b410a3e0 2024-04-25T13:34:49.238 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.424+0000 7fa4bb5c2700 1 -- 172.21.15.43:0/2859462577 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b4064cf0 con 0x7fa4b410a3e0 2024-04-25T13:34:49.238 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.425+0000 7fa4aa7fc700 1 -- 172.21.15.43:0/2859462577 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7fa4b0023a50 con 0x7fa4b410a3e0 2024-04-25T13:34:49.238 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.425+0000 7fa4aa7fc700 1 --2- 172.21.15.43:0/2859462577 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fa4a003d5e0 0x7fa4a003faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:49.238 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.425+0000 7fa4aa7fc700 1 -- 172.21.15.43:0/2859462577 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa4b0052ed0 con 0x7fa4b410a3e0 2024-04-25T13:34:49.238 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.425+0000 7fa4b8b5d700 1 --2- 172.21.15.43:0/2859462577 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fa4a003d5e0 0x7fa4a003faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:49.238 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.425+0000 7fa4b8b5d700 1 --2- 172.21.15.43:0/2859462577 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fa4a003d5e0 0x7fa4a003faf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4006fd0 tx=0x7fa4a4006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:49.238 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.434+0000 7fa4aa7fc700 1 -- 172.21.15.43:0/2859462577 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa4b001f030 con 0x7fa4b410a3e0 2024-04-25T13:34:49.238 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.665+0000 7fa4bb5c2700 1 -- 172.21.15.43:0/2859462577 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fa4b4108ef0 con 0x7fa4b410a3e0 2024-04-25T13:34:49.238 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.668+0000 7fa4aa7fc700 1 -- 172.21.15.43:0/2859462577 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fa4b0019e20 con 0x7fa4b410a3e0 2024-04-25T13:34:49.239 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.671+0000 7fa4bb5c2700 1 -- 172.21.15.43:0/2859462577 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fa4a003d5e0 msgr2=0x7fa4a003faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:49.239 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.671+0000 7fa4bb5c2700 1 --2- 172.21.15.43:0/2859462577 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fa4a003d5e0 0x7fa4a003faf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4006fd0 tx=0x7fa4a4006e40 comp rx=0 tx=0).stop 2024-04-25T13:34:49.239 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.671+0000 7fa4bb5c2700 1 -- 172.21.15.43:0/2859462577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b410a3e0 msgr2=0x7fa4b4109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:49.239 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.671+0000 7fa4bb5c2700 1 --2- 172.21.15.43:0/2859462577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b410a3e0 0x7fa4b4109b60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0011670 tx=0x7fa4b0011a30 comp rx=0 tx=0).stop 2024-04-25T13:34:49.239 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.671+0000 7fa4bb5c2700 1 -- 172.21.15.43:0/2859462577 shutdown_connections 2024-04-25T13:34:49.239 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.671+0000 7fa4bb5c2700 1 --2- 172.21.15.43:0/2859462577 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fa4a003d5e0 0x7fa4a003faf0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:49.239 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.671+0000 7fa4bb5c2700 1 --2- 172.21.15.43:0/2859462577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b410a3e0 0x7fa4b4109b60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:49.239 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.671+0000 7fa4bb5c2700 1 -- 172.21.15.43:0/2859462577 >> 172.21.15.43:0/2859462577 conn(0x7fa4b4103e60 msgr2=0x7fa4b41046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:49.239 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.671+0000 7fa4bb5c2700 1 -- 172.21.15.43:0/2859462577 shutdown_connections 2024-04-25T13:34:49.239 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:48.671+0000 7fa4bb5c2700 1 -- 172.21.15.43:0/2859462577 wait complete. 2024-04-25T13:34:49.239 INFO:teuthology.orchestra.run.smithi043.stdout:Enabling the dashboard module... 2024-04-25T13:34:49.856 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:49 smithi043 ceph-mon[29195]: from='mgr.14118 172.21.15.43:0/591770904' entity='mgr.x' 2024-04-25T13:34:49.856 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:49 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2859462577' entity='client.admin' 2024-04-25T13:34:50.820 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:50 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/950688670' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-25T13:34:50.821 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:50 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: ignoring --setuser ceph since I am not root 2024-04-25T13:34:50.821 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:50 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: ignoring --setgroup ceph since I am not root 2024-04-25T13:34:50.821 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:50 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:50.758+0000 7f62f62a1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:34:51.207 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:50 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:50.953+0000 7f62f62a1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:34:51.207 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:51 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:51.062+0000 7f62f62a1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:34:51.463 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:51 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:51.391+0000 7f62f62a1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:34:51.514 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.661+0000 7f809c910700 1 Processor -- start 2024-04-25T13:34:51.514 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.661+0000 7f809c910700 1 -- start start 2024-04-25T13:34:51.514 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.661+0000 7f809c910700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80981087c0 0x7f8098108bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:51.515 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.661+0000 7f809c910700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f80981091c0 con 0x7f80981087c0 2024-04-25T13:34:51.515 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.661+0000 7f809659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80981087c0 0x7f8098108bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:51.515 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.662+0000 7f809659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80981087c0 0x7f8098108bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34492/0 (socket says 172.21.15.43:34492) 2024-04-25T13:34:51.515 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.662+0000 7f809659c700 1 -- 172.21.15.43:0/2138189582 learned_addr learned my addr 172.21.15.43:0/2138189582 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:51.515 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.662+0000 7f809659c700 1 -- 172.21.15.43:0/2138189582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8098109990 con 0x7f80981087c0 2024-04-25T13:34:51.515 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.662+0000 7f809659c700 1 --2- 172.21.15.43:0/2138189582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80981087c0 0x7f8098108bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f80880098a0 tx=0x7f8088009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130cd8699474e030 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:51.515 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.662+0000 7f809559a700 1 -- 172.21.15.43:0/2138189582 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8088004160 con 0x7f80981087c0 2024-04-25T13:34:51.515 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.662+0000 7f809559a700 1 -- 172.21.15.43:0/2138189582 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8088004300 con 0x7f80981087c0 2024-04-25T13:34:51.515 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.662+0000 7f809559a700 1 -- 172.21.15.43:0/2138189582 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8088011960 con 0x7f80981087c0 2024-04-25T13:34:51.515 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.663+0000 7f809c910700 1 -- 172.21.15.43:0/2138189582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80981087c0 msgr2=0x7f8098108bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:51.515 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.663+0000 7f809c910700 1 --2- 172.21.15.43:0/2138189582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80981087c0 0x7f8098108bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f80880098a0 tx=0x7f8088009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:51.515 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.663+0000 7f809c910700 1 -- 172.21.15.43:0/2138189582 shutdown_connections 2024-04-25T13:34:51.515 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.663+0000 7f809c910700 1 --2- 172.21.15.43:0/2138189582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80981087c0 0x7f8098108bd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:51.516 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.663+0000 7f809c910700 1 -- 172.21.15.43:0/2138189582 >> 172.21.15.43:0/2138189582 conn(0x7f8098103e40 msgr2=0x7f80981062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:51.516 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.663+0000 7f809c910700 1 -- 172.21.15.43:0/2138189582 shutdown_connections 2024-04-25T13:34:51.516 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.663+0000 7f809c910700 1 -- 172.21.15.43:0/2138189582 wait complete. 2024-04-25T13:34:51.516 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.664+0000 7f809c910700 1 Processor -- start 2024-04-25T13:34:51.516 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.664+0000 7f809c910700 1 -- start start 2024-04-25T13:34:51.516 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.664+0000 7f809c910700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80981087c0 0x7f809819bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:51.516 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.664+0000 7f809c910700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f809807bfa0 con 0x7f80981087c0 2024-04-25T13:34:51.516 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.664+0000 7f809659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80981087c0 0x7f809819bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:51.516 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.664+0000 7f809659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80981087c0 0x7f809819bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34504/0 (socket says 172.21.15.43:34504) 2024-04-25T13:34:51.516 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.664+0000 7f809659c700 1 -- 172.21.15.43:0/950688670 learned_addr learned my addr 172.21.15.43:0/950688670 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:51.516 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.665+0000 7f809659c700 1 -- 172.21.15.43:0/950688670 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809819c090 con 0x7f80981087c0 2024-04-25T13:34:51.516 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.665+0000 7f809659c700 1 --2- 172.21.15.43:0/950688670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80981087c0 0x7f809819bb50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8088000c00 tx=0x7f8088011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:51.516 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.665+0000 7f80877fe700 1 -- 172.21.15.43:0/950688670 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8088003a60 con 0x7f80981087c0 2024-04-25T13:34:51.516 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.665+0000 7f809c910700 1 -- 172.21.15.43:0/950688670 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809819c320 con 0x7f80981087c0 2024-04-25T13:34:51.517 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.665+0000 7f80877fe700 1 -- 172.21.15.43:0/950688670 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f808801b8d0 con 0x7f80981087c0 2024-04-25T13:34:51.517 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.665+0000 7f80877fe700 1 -- 172.21.15.43:0/950688670 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8088019780 con 0x7f80981087c0 2024-04-25T13:34:51.517 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.665+0000 7f809c910700 1 -- 172.21.15.43:0/950688670 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809819ef30 con 0x7f80981087c0 2024-04-25T13:34:51.517 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.666+0000 7f80877fe700 1 -- 172.21.15.43:0/950688670 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 49516+0+0 (secure 0 0 0) 0x7f80880199c0 con 0x7f80981087c0 2024-04-25T13:34:51.517 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.666+0000 7f809c910700 1 -- 172.21.15.43:0/950688670 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8098064cf0 con 0x7f80981087c0 2024-04-25T13:34:51.517 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.666+0000 7f80877fe700 1 --2- 172.21.15.43:0/950688670 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f808003d680 0x7f808003fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:51.517 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.666+0000 7f80877fe700 1 -- 172.21.15.43:0/950688670 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8088052ba0 con 0x7f80981087c0 2024-04-25T13:34:51.517 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.666+0000 7f8095d9b700 1 --2- 172.21.15.43:0/950688670 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f808003d680 0x7f808003fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:51.517 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.667+0000 7f8095d9b700 1 --2- 172.21.15.43:0/950688670 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f808003d680 0x7f808003fb90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f808c006fd0 tx=0x7f808c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:51.517 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.671+0000 7f80877fe700 1 -- 172.21.15.43:0/950688670 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f808801f030 con 0x7f80981087c0 2024-04-25T13:34:51.517 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:49.948+0000 7f809c910700 1 -- 172.21.15.43:0/950688670 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f8098194db0 con 0x7f80981087c0 2024-04-25T13:34:51.517 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:50.543+0000 7f80877fe700 1 -- 172.21.15.43:0/950688670 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f808802b350 con 0x7f80981087c0 2024-04-25T13:34:51.517 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:50.544+0000 7f80877fe700 1 -- 172.21.15.43:0/950688670 <== mon.0 v2:172.21.15.43:3300/0 8 ==== mgrmap(e 9) ==== 49529+0+0 (secure 0 0 0) 0x7f808801ba80 con 0x7f80981087c0 2024-04-25T13:34:51.517 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:50.546+0000 7f809c910700 1 -- 172.21.15.43:0/950688670 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f808003d680 msgr2=0x7f808003fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:51.517 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:50.546+0000 7f809c910700 1 --2- 172.21.15.43:0/950688670 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f808003d680 0x7f808003fb90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f808c006fd0 tx=0x7f808c006e40 comp rx=0 tx=0).stop 2024-04-25T13:34:51.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:50.546+0000 7f809c910700 1 -- 172.21.15.43:0/950688670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80981087c0 msgr2=0x7f809819bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:51.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:50.546+0000 7f809c910700 1 --2- 172.21.15.43:0/950688670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80981087c0 0x7f809819bb50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8088000c00 tx=0x7f8088011a30 comp rx=0 tx=0).stop 2024-04-25T13:34:51.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:50.546+0000 7f809c910700 1 -- 172.21.15.43:0/950688670 shutdown_connections 2024-04-25T13:34:51.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:50.546+0000 7f809c910700 1 --2- 172.21.15.43:0/950688670 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7f808003d680 0x7f808003fb90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:51.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:50.546+0000 7f809c910700 1 --2- 172.21.15.43:0/950688670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80981087c0 0x7f809819bb50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:51.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:50.546+0000 7f809c910700 1 -- 172.21.15.43:0/950688670 >> 172.21.15.43:0/950688670 conn(0x7f8098103e40 msgr2=0x7f8098191e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:51.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:50.546+0000 7f809c910700 1 -- 172.21.15.43:0/950688670 shutdown_connections 2024-04-25T13:34:51.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:50.546+0000 7f809c910700 1 -- 172.21.15.43:0/950688670 wait complete. 2024-04-25T13:34:51.779 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:51 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/950688670' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-25T13:34:51.779 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:51 smithi043 ceph-mon[29195]: mgrmap e9: x(active, since 20s) 2024-04-25T13:34:51.780 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:51 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:51.482+0000 7f62f62a1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:34:52.661 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:52 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2343429123' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-25T13:34:52.951 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:52 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:52.768+0000 7f62f62a1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:34:52.951 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:52 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:52.950+0000 7f62f62a1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:34:52.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-04-25T13:34:52.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-25T13:34:52.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T13:34:52.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-25T13:34:52.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-25T13:34:52.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-04-25T13:34:52.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.034+0000 7fd26a4d1700 1 Processor -- start 2024-04-25T13:34:52.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.034+0000 7fd26a4d1700 1 -- start start 2024-04-25T13:34:52.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.034+0000 7fd26a4d1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd26410a420 0x7fd26410c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:52.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.034+0000 7fd26a4d1700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd26407ce10 con 0x7fd26410a420 2024-04-25T13:34:52.973 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.034+0000 7fd263fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd26410a420 0x7fd26410c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:52.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.034+0000 7fd263fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd26410a420 0x7fd26410c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34528/0 (socket says 172.21.15.43:34528) 2024-04-25T13:34:52.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.034+0000 7fd263fff700 1 -- 172.21.15.43:0/1261902060 learned_addr learned my addr 172.21.15.43:0/1261902060 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:52.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.035+0000 7fd263fff700 1 -- 172.21.15.43:0/1261902060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26410cd80 con 0x7fd26410a420 2024-04-25T13:34:52.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.035+0000 7fd263fff700 1 --2- 172.21.15.43:0/1261902060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd26410a420 0x7fd26410c840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd2540098a0 tx=0x7fd254009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b24d56e1204852 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:52.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.035+0000 7fd262ffd700 1 -- 172.21.15.43:0/1261902060 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd254004160 con 0x7fd26410a420 2024-04-25T13:34:52.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.035+0000 7fd262ffd700 1 -- 172.21.15.43:0/1261902060 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd254004300 con 0x7fd26410a420 2024-04-25T13:34:52.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.035+0000 7fd262ffd700 1 -- 172.21.15.43:0/1261902060 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd254011960 con 0x7fd26410a420 2024-04-25T13:34:52.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.036+0000 7fd26a4d1700 1 -- 172.21.15.43:0/1261902060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd26410a420 msgr2=0x7fd26410c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:52.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.036+0000 7fd26a4d1700 1 --2- 172.21.15.43:0/1261902060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd26410a420 0x7fd26410c840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd2540098a0 tx=0x7fd254009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:52.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.036+0000 7fd26a4d1700 1 -- 172.21.15.43:0/1261902060 shutdown_connections 2024-04-25T13:34:52.974 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.037+0000 7fd26a4d1700 1 --2- 172.21.15.43:0/1261902060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd26410a420 0x7fd26410c840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:52.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.037+0000 7fd26a4d1700 1 -- 172.21.15.43:0/1261902060 >> 172.21.15.43:0/1261902060 conn(0x7fd264103e60 msgr2=0x7fd2641062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:52.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.037+0000 7fd26a4d1700 1 -- 172.21.15.43:0/1261902060 shutdown_connections 2024-04-25T13:34:52.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.037+0000 7fd26a4d1700 1 -- 172.21.15.43:0/1261902060 wait complete. 2024-04-25T13:34:52.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.037+0000 7fd26a4d1700 1 Processor -- start 2024-04-25T13:34:52.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.037+0000 7fd26a4d1700 1 -- start start 2024-04-25T13:34:52.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.038+0000 7fd26a4d1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd26410a420 0x7fd26419dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:52.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.038+0000 7fd26a4d1700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd26410dcc0 con 0x7fd26410a420 2024-04-25T13:34:52.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.038+0000 7fd263fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd26410a420 0x7fd26419dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:52.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.038+0000 7fd263fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd26410a420 0x7fd26419dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34540/0 (socket says 172.21.15.43:34540) 2024-04-25T13:34:52.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.038+0000 7fd263fff700 1 -- 172.21.15.43:0/2343429123 learned_addr learned my addr 172.21.15.43:0/2343429123 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:52.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.038+0000 7fd263fff700 1 -- 172.21.15.43:0/2343429123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26419e1c0 con 0x7fd26410a420 2024-04-25T13:34:52.975 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.038+0000 7fd263fff700 1 --2- 172.21.15.43:0/2343429123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd26410a420 0x7fd26419dc80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd254011670 tx=0x7fd254011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:52.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.038+0000 7fd2617fa700 1 -- 172.21.15.43:0/2343429123 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd254003a60 con 0x7fd26410a420 2024-04-25T13:34:52.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.039+0000 7fd2617fa700 1 -- 172.21.15.43:0/2343429123 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd25401b8d0 con 0x7fd26410a420 2024-04-25T13:34:52.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.039+0000 7fd26a4d1700 1 -- 172.21.15.43:0/2343429123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd26419e450 con 0x7fd26410a420 2024-04-25T13:34:52.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.039+0000 7fd26a4d1700 1 -- 172.21.15.43:0/2343429123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2641a1060 con 0x7fd26410a420 2024-04-25T13:34:52.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.039+0000 7fd2617fa700 1 -- 172.21.15.43:0/2343429123 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd254023790 con 0x7fd26410a420 2024-04-25T13:34:52.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.040+0000 7fd2617fa700 1 -- 172.21.15.43:0/2343429123 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 9) ==== 49529+0+0 (secure 0 0 0) 0x7fd254023ab0 con 0x7fd26410a420 2024-04-25T13:34:52.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.040+0000 7fd26a4d1700 1 -- 172.21.15.43:0/2343429123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd264064cf0 con 0x7fd26410a420 2024-04-25T13:34:52.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.040+0000 7fd2617fa700 1 --2- 172.21.15.43:0/2343429123 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fd25003d680 0x7fd25003fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:52.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.040+0000 7fd2617fa700 1 -- 172.21.15.43:0/2343429123 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd254052d30 con 0x7fd26410a420 2024-04-25T13:34:52.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.040+0000 7fd2637fe700 1 -- 172.21.15.43:0/2343429123 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fd25003d680 msgr2=0x7fd25003fb90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1629086480 2024-04-25T13:34:52.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.040+0000 7fd2637fe700 1 --2- 172.21.15.43:0/2343429123 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fd25003d680 0x7fd25003fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:34:52.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.050+0000 7fd2617fa700 1 -- 172.21.15.43:0/2343429123 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd25401f030 con 0x7fd26410a420 2024-04-25T13:34:52.976 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.241+0000 7fd2637fe700 1 -- 172.21.15.43:0/2343429123 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fd25003d680 msgr2=0x7fd25003fb90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1629086480 2024-04-25T13:34:52.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.241+0000 7fd2637fe700 1 --2- 172.21.15.43:0/2343429123 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fd25003d680 0x7fd25003fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:34:52.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.321+0000 7fd26a4d1700 1 -- 172.21.15.43:0/2343429123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fd2641a1230 con 0x7fd26410a420 2024-04-25T13:34:52.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.321+0000 7fd2617fa700 1 -- 172.21.15.43:0/2343429123 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fd2641a1230 con 0x7fd26410a420 2024-04-25T13:34:52.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.323+0000 7fd26a4d1700 1 -- 172.21.15.43:0/2343429123 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fd25003d680 msgr2=0x7fd25003fb90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T13:34:52.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.323+0000 7fd26a4d1700 1 --2- 172.21.15.43:0/2343429123 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fd25003d680 0x7fd25003fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:52.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.323+0000 7fd26a4d1700 1 -- 172.21.15.43:0/2343429123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd26410a420 msgr2=0x7fd26419dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:52.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.323+0000 7fd26a4d1700 1 --2- 172.21.15.43:0/2343429123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd26410a420 0x7fd26419dc80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd254011670 tx=0x7fd254011a30 comp rx=0 tx=0).stop 2024-04-25T13:34:52.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.324+0000 7fd26a4d1700 1 -- 172.21.15.43:0/2343429123 shutdown_connections 2024-04-25T13:34:52.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.324+0000 7fd26a4d1700 1 --2- 172.21.15.43:0/2343429123 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7fd25003d680 0x7fd25003fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:52.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.324+0000 7fd26a4d1700 1 --2- 172.21.15.43:0/2343429123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd26410a420 0x7fd26419dc80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:52.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.324+0000 7fd26a4d1700 1 -- 172.21.15.43:0/2343429123 >> 172.21.15.43:0/2343429123 conn(0x7fd264103e60 msgr2=0x7fd264104690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:52.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.324+0000 7fd26a4d1700 1 -- 172.21.15.43:0/2343429123 shutdown_connections 2024-04-25T13:34:52.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:52.324+0000 7fd26a4d1700 1 -- 172.21.15.43:0/2343429123 wait complete. 2024-04-25T13:34:52.978 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for the mgr to restart... 2024-04-25T13:34:52.978 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mgr epoch 9... 2024-04-25T13:34:53.213 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:53 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:53.132+0000 7f62f62a1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:34:53.629 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:53 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:53.453+0000 7f62f62a1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:34:53.629 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:53 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:53.551+0000 7f62f62a1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:34:53.963 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:53 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:53.764+0000 7f62f62a1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:34:54.463 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:53 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:53.969+0000 7f62f62a1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:34:54.963 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:54 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:54.605+0000 7f62f62a1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T13:34:55.373 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:55 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:55.056+0000 7f62f62a1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:34:55.373 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:55 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:55.158+0000 7f62f62a1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:34:55.373 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:55 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:55.373+0000 7f62f62a1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T13:34:56.213 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:55 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:55.924+0000 7f62f62a1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:34:56.213 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:56 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:56.023+0000 7f62f62a1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:34:56.650 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:56 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:56.282+0000 7f62f62a1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:34:56.650 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:56 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:56.425+0000 7f62f62a1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:34:56.650 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:56 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:56.526+0000 7f62f62a1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:34:56.650 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:56 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:56.649+0000 7f62f62a1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:34:57.463 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:56 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:56.966+0000 7f62f62a1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:34:57.887 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:57 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:57.602+0000 7f62f62a1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:34:57.887 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:34:57 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:34:57.833+0000 7f62f62a1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:34:58.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:57 smithi043 ceph-mon[29195]: Active manager daemon x restarted 2024-04-25T13:34:58.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:57 smithi043 ceph-mon[29195]: Activating manager daemon x 2024-04-25T13:34:58.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:57 smithi043 ceph-mon[29195]: osdmap e3: 0 total, 0 up, 0 in 2024-04-25T13:34:58.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:57 smithi043 ceph-mon[29195]: mgrmap e10: x(active, starting, since 0.00410781s) 2024-04-25T13:34:58.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:34:58.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T13:34:58.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T13:34:58.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T13:34:58.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T13:34:58.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:57 smithi043 ceph-mon[29195]: Manager daemon x is now available 2024-04-25T13:34:58.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:34:58.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T13:34:58.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T13:34:58.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:58 smithi043 ceph-mon[29195]: mgrmap e11: x(active, since 1.00728s) 2024-04-25T13:34:59.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-04-25T13:34:59.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-25T13:34:59.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-25T13:34:59.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-04-25T13:34:59.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.421+0000 7eff23d70700 1 Processor -- start 2024-04-25T13:34:59.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.421+0000 7eff23d70700 1 -- start start 2024-04-25T13:34:59.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.422+0000 7eff23d70700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff1c108210 0x7eff1c108620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:59.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.422+0000 7eff23d70700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c07cdd0 con 0x7eff1c108210 2024-04-25T13:34:59.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.422+0000 7eff21b0c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff1c108210 0x7eff1c108620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:59.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.422+0000 7eff21b0c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff1c108210 0x7eff1c108620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34544/0 (socket says 172.21.15.43:34544) 2024-04-25T13:34:59.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.422+0000 7eff21b0c700 1 -- 172.21.15.43:0/1565916398 learned_addr learned my addr 172.21.15.43:0/1565916398 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:59.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.422+0000 7eff21b0c700 1 -- 172.21.15.43:0/1565916398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c108b60 con 0x7eff1c108210 2024-04-25T13:34:59.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.423+0000 7eff21b0c700 1 --2- 172.21.15.43:0/1565916398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff1c108210 0x7eff1c108620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff100098a0 tx=0x7eff10009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824ca382e1d55c6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:59.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.423+0000 7eff20b0a700 1 -- 172.21.15.43:0/1565916398 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff10004160 con 0x7eff1c108210 2024-04-25T13:34:59.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.423+0000 7eff20b0a700 1 -- 172.21.15.43:0/1565916398 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff10004300 con 0x7eff1c108210 2024-04-25T13:34:59.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.423+0000 7eff20b0a700 1 -- 172.21.15.43:0/1565916398 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff10011960 con 0x7eff1c108210 2024-04-25T13:34:59.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.424+0000 7eff23d70700 1 -- 172.21.15.43:0/1565916398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff1c108210 msgr2=0x7eff1c108620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:59.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.424+0000 7eff23d70700 1 --2- 172.21.15.43:0/1565916398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff1c108210 0x7eff1c108620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff100098a0 tx=0x7eff10009bb0 comp rx=0 tx=0).stop 2024-04-25T13:34:59.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.424+0000 7eff23d70700 1 -- 172.21.15.43:0/1565916398 shutdown_connections 2024-04-25T13:34:59.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.424+0000 7eff23d70700 1 --2- 172.21.15.43:0/1565916398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff1c108210 0x7eff1c108620 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:59.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.424+0000 7eff23d70700 1 -- 172.21.15.43:0/1565916398 >> 172.21.15.43:0/1565916398 conn(0x7eff1c103e40 msgr2=0x7eff1c1062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:59.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.424+0000 7eff23d70700 1 -- 172.21.15.43:0/1565916398 shutdown_connections 2024-04-25T13:34:59.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.424+0000 7eff23d70700 1 -- 172.21.15.43:0/1565916398 wait complete. 2024-04-25T13:34:59.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.424+0000 7eff23d70700 1 Processor -- start 2024-04-25T13:34:59.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.424+0000 7eff23d70700 1 -- start start 2024-04-25T13:34:59.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.425+0000 7eff23d70700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff1c108210 0x7eff1c19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:59.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.425+0000 7eff23d70700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c109bc0 con 0x7eff1c108210 2024-04-25T13:34:59.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.425+0000 7eff21b0c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff1c108210 0x7eff1c19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:59.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.425+0000 7eff21b0c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff1c108210 0x7eff1c19fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34560/0 (socket says 172.21.15.43:34560) 2024-04-25T13:34:59.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.425+0000 7eff21b0c700 1 -- 172.21.15.43:0/3475501925 learned_addr learned my addr 172.21.15.43:0/3475501925 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:34:59.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.425+0000 7eff21b0c700 1 -- 172.21.15.43:0/3475501925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c1a0320 con 0x7eff1c108210 2024-04-25T13:34:59.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.425+0000 7eff21b0c700 1 --2- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff1c108210 0x7eff1c19fde0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7eff10011670 tx=0x7eff10011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:59.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.425+0000 7eff0effd700 1 -- 172.21.15.43:0/3475501925 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff10003a60 con 0x7eff1c108210 2024-04-25T13:34:59.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.426+0000 7eff0effd700 1 -- 172.21.15.43:0/3475501925 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff1001b8d0 con 0x7eff1c108210 2024-04-25T13:34:59.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.426+0000 7eff23d70700 1 -- 172.21.15.43:0/3475501925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c1a05b0 con 0x7eff1c108210 2024-04-25T13:34:59.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.426+0000 7eff0effd700 1 -- 172.21.15.43:0/3475501925 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff10023790 con 0x7eff1c108210 2024-04-25T13:34:59.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.426+0000 7eff23d70700 1 -- 172.21.15.43:0/3475501925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c1a3180 con 0x7eff1c108210 2024-04-25T13:34:59.860 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.426+0000 7eff0effd700 1 -- 172.21.15.43:0/3475501925 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 9) ==== 49529+0+0 (secure 0 0 0) 0x7eff10023a60 con 0x7eff1c108210 2024-04-25T13:34:59.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.427+0000 7eff0effd700 1 --2- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7eff0803d6e0 0x7eff0803fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:59.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.427+0000 7eff23d70700 1 -- 172.21.15.43:0/3475501925 --> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7eff1c064cf0 con 0x7eff0803d6e0 2024-04-25T13:34:59.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.427+0000 7eff0effd700 1 -- 172.21.15.43:0/3475501925 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7eff10053bd0 con 0x7eff1c108210 2024-04-25T13:34:59.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.427+0000 7eff2130b700 1 -- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7eff0803d6e0 msgr2=0x7eff0803fbf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1629086480 2024-04-25T13:34:59.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.427+0000 7eff2130b700 1 --2- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7eff0803d6e0 0x7eff0803fbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:34:59.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.628+0000 7eff2130b700 1 -- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7eff0803d6e0 msgr2=0x7eff0803fbf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1629086480 2024-04-25T13:34:59.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:53.628+0000 7eff2130b700 1 --2- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7eff0803d6e0 0x7eff0803fbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:34:59.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:54.029+0000 7eff2130b700 1 -- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7eff0803d6e0 msgr2=0x7eff0803fbf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1629086480 2024-04-25T13:34:59.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:54.029+0000 7eff2130b700 1 --2- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7eff0803d6e0 0x7eff0803fbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T13:34:59.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:54.830+0000 7eff2130b700 1 -- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7eff0803d6e0 msgr2=0x7eff0803fbf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1629086480 2024-04-25T13:34:59.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:54.830+0000 7eff2130b700 1 --2- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7eff0803d6e0 0x7eff0803fbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T13:34:59.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:56.432+0000 7eff2130b700 1 -- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7eff0803d6e0 msgr2=0x7eff0803fbf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1629086480 2024-04-25T13:34:59.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:56.432+0000 7eff2130b700 1 --2- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7eff0803d6e0 0x7eff0803fbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-25T13:34:59.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:57.837+0000 7eff0effd700 1 -- 172.21.15.43:0/3475501925 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mgrmap(e 10) ==== 49296+0+0 (secure 0 0 0) 0x7eff1002c3f0 con 0x7eff1c108210 2024-04-25T13:34:59.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:57.838+0000 7eff0effd700 1 -- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7eff0803d6e0 msgr2=0x7eff0803fbf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T13:34:59.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:57.838+0000 7eff0effd700 1 --2- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7eff0803d6e0 0x7eff0803fbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:59.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.839+0000 7eff0effd700 1 -- 172.21.15.43:0/3475501925 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 11) ==== 49423+0+0 (secure 0 0 0) 0x7eff1002b350 con 0x7eff1c108210 2024-04-25T13:34:59.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.840+0000 7eff0effd700 1 --2- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7eff10053780 0x7eff08042ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:34:59.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.840+0000 7eff0effd700 1 -- 172.21.15.43:0/3475501925 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7eff1000bd30 con 0x7eff10053780 2024-04-25T13:34:59.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.840+0000 7eff2130b700 1 --2- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7eff10053780 0x7eff08042ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:34:59.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.841+0000 7eff2130b700 1 --2- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7eff10053780 0x7eff08042ff0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7eff18003a10 tx=0x7eff18009270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:34:59.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.842+0000 7eff0effd700 1 -- 172.21.15.43:0/3475501925 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7eff1000bd30 con 0x7eff10053780 2024-04-25T13:34:59.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.859+0000 7eff23d70700 1 -- 172.21.15.43:0/3475501925 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7eff1c063ad0 con 0x7eff10053780 2024-04-25T13:34:59.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.859+0000 7eff0effd700 1 -- 172.21.15.43:0/3475501925 <== mgr.14150 v2:172.21.15.43:6800/2478639579 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7eff1c063ad0 con 0x7eff10053780 2024-04-25T13:34:59.862 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.859+0000 7eff23d70700 1 -- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7eff10053780 msgr2=0x7eff08042ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:59.863 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.859+0000 7eff23d70700 1 --2- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7eff10053780 0x7eff08042ff0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7eff18003a10 tx=0x7eff18009270 comp rx=0 tx=0).stop 2024-04-25T13:34:59.863 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.859+0000 7eff23d70700 1 -- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff1c108210 msgr2=0x7eff1c19fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:34:59.863 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.859+0000 7eff23d70700 1 --2- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff1c108210 0x7eff1c19fde0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7eff10011670 tx=0x7eff10011a30 comp rx=0 tx=0).stop 2024-04-25T13:34:59.863 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.860+0000 7eff23d70700 1 -- 172.21.15.43:0/3475501925 shutdown_connections 2024-04-25T13:34:59.863 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.860+0000 7eff23d70700 1 --2- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7eff10053780 0x7eff08042ff0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:59.863 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.860+0000 7eff23d70700 1 --2- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff1c108210 0x7eff1c19fde0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:59.863 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.860+0000 7eff23d70700 1 --2- 172.21.15.43:0/3475501925 >> [v2:172.21.15.43:6800/1629086480,v1:172.21.15.43:6801/1629086480] conn(0x7eff0803d6e0 0x7eff0803fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:34:59.863 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.860+0000 7eff23d70700 1 -- 172.21.15.43:0/3475501925 >> 172.21.15.43:0/3475501925 conn(0x7eff1c103e40 msgr2=0x7eff1c193d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:34:59.863 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.860+0000 7eff23d70700 1 -- 172.21.15.43:0/3475501925 shutdown_connections 2024-04-25T13:34:59.863 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:34:58.860+0000 7eff23d70700 1 -- 172.21.15.43:0/3475501925 wait complete. 2024-04-25T13:34:59.863 INFO:teuthology.orchestra.run.smithi043.stdout:mgr epoch 9 is available 2024-04-25T13:34:59.863 INFO:teuthology.orchestra.run.smithi043.stdout:Generating a dashboard self-signed certificate... 2024-04-25T13:35:00.103 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:59 smithi043 ceph-mon[29195]: [25/Apr/2024:13:34:58] ENGINE Bus STARTING 2024-04-25T13:35:00.103 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:59 smithi043 ceph-mon[29195]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-25T13:35:00.103 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:59 smithi043 ceph-mon[29195]: [25/Apr/2024:13:34:58] ENGINE Serving on http://172.21.15.43:8765 2024-04-25T13:35:00.103 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:59 smithi043 ceph-mon[29195]: [25/Apr/2024:13:34:59] ENGINE Serving on https://172.21.15.43:7150 2024-04-25T13:35:00.103 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:34:59 smithi043 ceph-mon[29195]: [25/Apr/2024:13:34:59] ENGINE Bus STARTED 2024-04-25T13:35:00.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:00 smithi043 ceph-mon[29195]: mgrmap e12: x(active, since 2s) 2024-04-25T13:35:00.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:00.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:00 smithi043 ceph-mon[29195]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:35:00.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:00.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:01.254 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-25T13:35:01.254 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.348+0000 7fc81b338700 1 Processor -- start 2024-04-25T13:35:01.254 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.348+0000 7fc81b338700 1 -- start start 2024-04-25T13:35:01.254 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.349+0000 7fc81b338700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc814109910 0x7fc814109d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:01.255 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.349+0000 7fc81b338700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc81410a310 con 0x7fc814109910 2024-04-25T13:35:01.255 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.349+0000 7fc8190d4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc814109910 0x7fc814109d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:01.255 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.349+0000 7fc8190d4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc814109910 0x7fc814109d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49446/0 (socket says 172.21.15.43:49446) 2024-04-25T13:35:01.255 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.349+0000 7fc8190d4700 1 -- 172.21.15.43:0/525421423 learned_addr learned my addr 172.21.15.43:0/525421423 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:01.255 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.349+0000 7fc8190d4700 1 -- 172.21.15.43:0/525421423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81410aae0 con 0x7fc814109910 2024-04-25T13:35:01.255 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.349+0000 7fc8190d4700 1 --2- 172.21.15.43:0/525421423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc814109910 0x7fc814109d20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc8040098a0 tx=0x7fc804009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd65464f925db77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:01.255 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.349+0000 7fc80bfff700 1 -- 172.21.15.43:0/525421423 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc804004160 con 0x7fc814109910 2024-04-25T13:35:01.255 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.350+0000 7fc80bfff700 1 -- 172.21.15.43:0/525421423 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc804004300 con 0x7fc814109910 2024-04-25T13:35:01.255 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.350+0000 7fc80bfff700 1 -- 172.21.15.43:0/525421423 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc804011960 con 0x7fc814109910 2024-04-25T13:35:01.255 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.350+0000 7fc81b338700 1 -- 172.21.15.43:0/525421423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc814109910 msgr2=0x7fc814109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:01.255 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.350+0000 7fc81b338700 1 --2- 172.21.15.43:0/525421423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc814109910 0x7fc814109d20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc8040098a0 tx=0x7fc804009bb0 comp rx=0 tx=0).stop 2024-04-25T13:35:01.255 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.350+0000 7fc81b338700 1 -- 172.21.15.43:0/525421423 shutdown_connections 2024-04-25T13:35:01.255 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.350+0000 7fc81b338700 1 --2- 172.21.15.43:0/525421423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc814109910 0x7fc814109d20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:01.256 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.350+0000 7fc81b338700 1 -- 172.21.15.43:0/525421423 >> 172.21.15.43:0/525421423 conn(0x7fc814104f90 msgr2=0x7fc814107400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:01.256 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.351+0000 7fc81b338700 1 -- 172.21.15.43:0/525421423 shutdown_connections 2024-04-25T13:35:01.256 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.351+0000 7fc81b338700 1 -- 172.21.15.43:0/525421423 wait complete. 2024-04-25T13:35:01.256 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.351+0000 7fc81b338700 1 Processor -- start 2024-04-25T13:35:01.256 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.351+0000 7fc81b338700 1 -- start start 2024-04-25T13:35:01.256 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.352+0000 7fc81b338700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc814109910 0x7fc81419dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:01.256 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.352+0000 7fc81b338700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc81410de90 con 0x7fc814109910 2024-04-25T13:35:01.256 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.352+0000 7fc8190d4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc814109910 0x7fc81419dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:01.256 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.352+0000 7fc8190d4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc814109910 0x7fc81419dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49448/0 (socket says 172.21.15.43:49448) 2024-04-25T13:35:01.256 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.352+0000 7fc8190d4700 1 -- 172.21.15.43:0/76479051 learned_addr learned my addr 172.21.15.43:0/76479051 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:01.256 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.352+0000 7fc8190d4700 1 -- 172.21.15.43:0/76479051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81419e1a0 con 0x7fc814109910 2024-04-25T13:35:01.257 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.352+0000 7fc8190d4700 1 --2- 172.21.15.43:0/76479051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc814109910 0x7fc81419dc60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc804006af0 tx=0x7fc804011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:01.257 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.352+0000 7fc80a7fc700 1 -- 172.21.15.43:0/76479051 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc804003af0 con 0x7fc814109910 2024-04-25T13:35:01.257 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.353+0000 7fc80a7fc700 1 -- 172.21.15.43:0/76479051 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc80401b8d0 con 0x7fc814109910 2024-04-25T13:35:01.257 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.353+0000 7fc81b338700 1 -- 172.21.15.43:0/76479051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81419e430 con 0x7fc814109910 2024-04-25T13:35:01.257 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.353+0000 7fc80a7fc700 1 -- 172.21.15.43:0/76479051 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc804023820 con 0x7fc814109910 2024-04-25T13:35:01.257 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.353+0000 7fc81b338700 1 -- 172.21.15.43:0/76479051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8141a1040 con 0x7fc814109910 2024-04-25T13:35:01.257 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.354+0000 7fc81b338700 1 -- 172.21.15.43:0/76479051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc814064cf0 con 0x7fc814109910 2024-04-25T13:35:01.257 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.354+0000 7fc80a7fc700 1 -- 172.21.15.43:0/76479051 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 12) ==== 49529+0+0 (secure 0 0 0) 0x7fc80402c3f0 con 0x7fc814109910 2024-04-25T13:35:01.257 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.354+0000 7fc80a7fc700 1 --2- 172.21.15.43:0/76479051 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc80003d6e0 0x7fc80003fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:01.257 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.354+0000 7fc80a7fc700 1 -- 172.21.15.43:0/76479051 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc80402cd90 con 0x7fc814109910 2024-04-25T13:35:01.257 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.354+0000 7fc8188d3700 1 --2- 172.21.15.43:0/76479051 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc80003d6e0 0x7fc80003fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:01.257 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.355+0000 7fc8188d3700 1 --2- 172.21.15.43:0/76479051 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc80003d6e0 0x7fc80003fbf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc810006fd0 tx=0x7fc810006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:01.257 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.360+0000 7fc80a7fc700 1 -- 172.21.15.43:0/76479051 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc80401f030 con 0x7fc814109910 2024-04-25T13:35:01.258 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.580+0000 7fc81b338700 1 -- 172.21.15.43:0/76479051 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fc814105f00 con 0x7fc80003d6e0 2024-04-25T13:35:01.258 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.665+0000 7fc80a7fc700 1 -- 172.21.15.43:0/76479051 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fc814105f00 con 0x7fc80003d6e0 2024-04-25T13:35:01.258 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.667+0000 7fc81b338700 1 -- 172.21.15.43:0/76479051 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc80003d6e0 msgr2=0x7fc80003fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:01.258 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.667+0000 7fc81b338700 1 --2- 172.21.15.43:0/76479051 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc80003d6e0 0x7fc80003fbf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc810006fd0 tx=0x7fc810006e40 comp rx=0 tx=0).stop 2024-04-25T13:35:01.258 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.668+0000 7fc81b338700 1 -- 172.21.15.43:0/76479051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc814109910 msgr2=0x7fc81419dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:01.258 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.668+0000 7fc81b338700 1 --2- 172.21.15.43:0/76479051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc814109910 0x7fc81419dc60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc804006af0 tx=0x7fc804011a30 comp rx=0 tx=0).stop 2024-04-25T13:35:01.258 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.668+0000 7fc81b338700 1 -- 172.21.15.43:0/76479051 shutdown_connections 2024-04-25T13:35:01.258 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.668+0000 7fc81b338700 1 --2- 172.21.15.43:0/76479051 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc80003d6e0 0x7fc80003fbf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:01.258 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.668+0000 7fc81b338700 1 --2- 172.21.15.43:0/76479051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc814109910 0x7fc81419dc60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:01.258 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.668+0000 7fc81b338700 1 -- 172.21.15.43:0/76479051 >> 172.21.15.43:0/76479051 conn(0x7fc814104f90 msgr2=0x7fc8141057f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:01.258 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.668+0000 7fc81b338700 1 -- 172.21.15.43:0/76479051 shutdown_connections 2024-04-25T13:35:01.259 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:00.668+0000 7fc81b338700 1 -- 172.21.15.43:0/76479051 wait complete. 2024-04-25T13:35:01.259 INFO:teuthology.orchestra.run.smithi043.stdout:Creating initial admin user... 2024-04-25T13:35:02.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:02 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:02.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:02 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:02.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$i.lfRlNhtJ06STo.yPFfMORqHblmDGAwa/egcxzCJU037Mz/qCm0G", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714052102, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-25T13:35:02.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.724+0000 7fe14ccec700 1 Processor -- start 2024-04-25T13:35:02.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.724+0000 7fe14ccec700 1 -- start start 2024-04-25T13:35:02.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.724+0000 7fe14ccec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe148109940 0x7fe148109d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:03.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.724+0000 7fe14ccec700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe14810a340 con 0x7fe148109940 2024-04-25T13:35:03.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.725+0000 7fe14659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe148109940 0x7fe148109d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:03.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.725+0000 7fe14659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe148109940 0x7fe148109d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49452/0 (socket says 172.21.15.43:49452) 2024-04-25T13:35:03.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.725+0000 7fe14659c700 1 -- 172.21.15.43:0/1977552132 learned_addr learned my addr 172.21.15.43:0/1977552132 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:03.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.725+0000 7fe14659c700 1 -- 172.21.15.43:0/1977552132 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14810aac0 con 0x7fe148109940 2024-04-25T13:35:03.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.725+0000 7fe14659c700 1 --2- 172.21.15.43:0/1977552132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe148109940 0x7fe148109d50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0098a0 tx=0x7fe13c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197e328df259a2d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:03.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.725+0000 7fe14559a700 1 -- 172.21.15.43:0/1977552132 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe13c004160 con 0x7fe148109940 2024-04-25T13:35:03.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.725+0000 7fe14559a700 1 -- 172.21.15.43:0/1977552132 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe13c004300 con 0x7fe148109940 2024-04-25T13:35:03.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.725+0000 7fe14559a700 1 -- 172.21.15.43:0/1977552132 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe13c011960 con 0x7fe148109940 2024-04-25T13:35:03.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.726+0000 7fe14ccec700 1 -- 172.21.15.43:0/1977552132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe148109940 msgr2=0x7fe148109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:03.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.726+0000 7fe14ccec700 1 --2- 172.21.15.43:0/1977552132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe148109940 0x7fe148109d50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0098a0 tx=0x7fe13c009bb0 comp rx=0 tx=0).stop 2024-04-25T13:35:03.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.726+0000 7fe14ccec700 1 -- 172.21.15.43:0/1977552132 shutdown_connections 2024-04-25T13:35:03.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.726+0000 7fe14ccec700 1 --2- 172.21.15.43:0/1977552132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe148109940 0x7fe148109d50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:03.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.726+0000 7fe14ccec700 1 -- 172.21.15.43:0/1977552132 >> 172.21.15.43:0/1977552132 conn(0x7fe148104f60 msgr2=0x7fe148107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:03.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.726+0000 7fe14ccec700 1 -- 172.21.15.43:0/1977552132 shutdown_connections 2024-04-25T13:35:03.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.726+0000 7fe14ccec700 1 -- 172.21.15.43:0/1977552132 wait complete. 2024-04-25T13:35:03.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.727+0000 7fe14ccec700 1 Processor -- start 2024-04-25T13:35:03.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.727+0000 7fe14ccec700 1 -- start start 2024-04-25T13:35:03.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.727+0000 7fe14ccec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe148109940 0x7fe14819dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:03.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.727+0000 7fe14ccec700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe14810de70 con 0x7fe148109940 2024-04-25T13:35:03.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.728+0000 7fe14659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe148109940 0x7fe14819dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:03.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.728+0000 7fe14659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe148109940 0x7fe14819dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49458/0 (socket says 172.21.15.43:49458) 2024-04-25T13:35:03.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.728+0000 7fe14659c700 1 -- 172.21.15.43:0/2794481092 learned_addr learned my addr 172.21.15.43:0/2794481092 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:03.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.728+0000 7fe14659c700 1 -- 172.21.15.43:0/2794481092 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14819e1d0 con 0x7fe148109940 2024-04-25T13:35:03.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.728+0000 7fe14659c700 1 --2- 172.21.15.43:0/2794481092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe148109940 0x7fe14819dc90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0119b0 tx=0x7fe13c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:03.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.728+0000 7fe1377fe700 1 -- 172.21.15.43:0/2794481092 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe13c003aa0 con 0x7fe148109940 2024-04-25T13:35:03.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.728+0000 7fe1377fe700 1 -- 172.21.15.43:0/2794481092 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe13c01b8d0 con 0x7fe148109940 2024-04-25T13:35:03.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.728+0000 7fe1377fe700 1 -- 172.21.15.43:0/2794481092 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe13c023860 con 0x7fe148109940 2024-04-25T13:35:03.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.728+0000 7fe14ccec700 1 -- 172.21.15.43:0/2794481092 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14819e460 con 0x7fe148109940 2024-04-25T13:35:03.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.728+0000 7fe14ccec700 1 -- 172.21.15.43:0/2794481092 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1481a1070 con 0x7fe148109940 2024-04-25T13:35:03.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.730+0000 7fe14ccec700 1 -- 172.21.15.43:0/2794481092 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe148064cf0 con 0x7fe148109940 2024-04-25T13:35:03.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.730+0000 7fe1377fe700 1 -- 172.21.15.43:0/2794481092 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 12) ==== 49529+0+0 (secure 0 0 0) 0x7fe13c02c3f0 con 0x7fe148109940 2024-04-25T13:35:03.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.730+0000 7fe1377fe700 1 --2- 172.21.15.43:0/2794481092 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe13003d690 0x7fe13003fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:03.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.730+0000 7fe1377fe700 1 -- 172.21.15.43:0/2794481092 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe13c052df0 con 0x7fe148109940 2024-04-25T13:35:03.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.730+0000 7fe145d9b700 1 --2- 172.21.15.43:0/2794481092 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe13003d690 0x7fe13003fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:03.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.731+0000 7fe145d9b700 1 --2- 172.21.15.43:0/2794481092 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe13003d690 0x7fe13003fba0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe138006fd0 tx=0x7fe138006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:03.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.735+0000 7fe1377fe700 1 -- 172.21.15.43:0/2794481092 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe13c01f030 con 0x7fe148109940 2024-04-25T13:35:03.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:01.979+0000 7fe14ccec700 1 -- 172.21.15.43:0/2794481092 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fe1481a1240 con 0x7fe13003d690 2024-04-25T13:35:03.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:02.228+0000 7fe1377fe700 1 -- 172.21.15.43:0/2794481092 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fe1481a1240 con 0x7fe13003d690 2024-04-25T13:35:03.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:02.230+0000 7fe14ccec700 1 -- 172.21.15.43:0/2794481092 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe13003d690 msgr2=0x7fe13003fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:03.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:02.230+0000 7fe14ccec700 1 --2- 172.21.15.43:0/2794481092 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe13003d690 0x7fe13003fba0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe138006fd0 tx=0x7fe138006e40 comp rx=0 tx=0).stop 2024-04-25T13:35:03.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:02.230+0000 7fe14ccec700 1 -- 172.21.15.43:0/2794481092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe148109940 msgr2=0x7fe14819dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:03.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:02.230+0000 7fe14ccec700 1 --2- 172.21.15.43:0/2794481092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe148109940 0x7fe14819dc90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0119b0 tx=0x7fe13c011a90 comp rx=0 tx=0).stop 2024-04-25T13:35:03.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:02.231+0000 7fe14ccec700 1 -- 172.21.15.43:0/2794481092 shutdown_connections 2024-04-25T13:35:03.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:02.231+0000 7fe14ccec700 1 --2- 172.21.15.43:0/2794481092 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe13003d690 0x7fe13003fba0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:03.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:02.231+0000 7fe14ccec700 1 --2- 172.21.15.43:0/2794481092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe148109940 0x7fe14819dc90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:03.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:02.231+0000 7fe14ccec700 1 -- 172.21.15.43:0/2794481092 >> 172.21.15.43:0/2794481092 conn(0x7fe148104f60 msgr2=0x7fe148105820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:03.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:02.231+0000 7fe14ccec700 1 -- 172.21.15.43:0/2794481092 shutdown_connections 2024-04-25T13:35:03.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:02.231+0000 7fe14ccec700 1 -- 172.21.15.43:0/2794481092 wait complete. 2024-04-25T13:35:03.003 INFO:teuthology.orchestra.run.smithi043.stdout:Fetching dashboard port number... 2024-04-25T13:35:03.672 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:03 smithi043 ceph-mon[29195]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:35:04.422 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:04 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3719773300' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-25T13:35:04.673 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 8443 2024-04-25T13:35:04.673 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.898+0000 7f044aa72700 1 Processor -- start 2024-04-25T13:35:04.673 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.898+0000 7f044aa72700 1 -- start start 2024-04-25T13:35:04.674 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.899+0000 7f044aa72700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0444108250 0x7f0444108660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:04.674 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.899+0000 7f044aa72700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f044407cdd0 con 0x7f0444108250 2024-04-25T13:35:04.674 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.899+0000 7f044880e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0444108250 0x7f0444108660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:04.674 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.899+0000 7f044880e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0444108250 0x7f0444108660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49472/0 (socket says 172.21.15.43:49472) 2024-04-25T13:35:04.674 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.899+0000 7f044880e700 1 -- 172.21.15.43:0/3195901703 learned_addr learned my addr 172.21.15.43:0/3195901703 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:04.674 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.899+0000 7f044880e700 1 -- 172.21.15.43:0/3195901703 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0444108ba0 con 0x7f0444108250 2024-04-25T13:35:04.674 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.899+0000 7f044880e700 1 --2- 172.21.15.43:0/3195901703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0444108250 0x7f0444108660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f04380098a0 tx=0x7f0438009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f641c230d6466d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:04.674 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.899+0000 7f04437fe700 1 -- 172.21.15.43:0/3195901703 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0438004160 con 0x7f0444108250 2024-04-25T13:35:04.674 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.900+0000 7f04437fe700 1 -- 172.21.15.43:0/3195901703 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0438004300 con 0x7f0444108250 2024-04-25T13:35:04.674 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.900+0000 7f04437fe700 1 -- 172.21.15.43:0/3195901703 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0438011960 con 0x7f0444108250 2024-04-25T13:35:04.674 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.900+0000 7f044aa72700 1 -- 172.21.15.43:0/3195901703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0444108250 msgr2=0x7f0444108660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:04.675 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.900+0000 7f044aa72700 1 --2- 172.21.15.43:0/3195901703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0444108250 0x7f0444108660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f04380098a0 tx=0x7f0438009bb0 comp rx=0 tx=0).stop 2024-04-25T13:35:04.675 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.900+0000 7f044aa72700 1 -- 172.21.15.43:0/3195901703 shutdown_connections 2024-04-25T13:35:04.675 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.900+0000 7f044aa72700 1 --2- 172.21.15.43:0/3195901703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0444108250 0x7f0444108660 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:04.675 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.900+0000 7f044aa72700 1 -- 172.21.15.43:0/3195901703 >> 172.21.15.43:0/3195901703 conn(0x7f0444103e60 msgr2=0x7f04441062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:04.675 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.900+0000 7f044aa72700 1 -- 172.21.15.43:0/3195901703 shutdown_connections 2024-04-25T13:35:04.675 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.900+0000 7f044aa72700 1 -- 172.21.15.43:0/3195901703 wait complete. 2024-04-25T13:35:04.675 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.901+0000 7f044aa72700 1 Processor -- start 2024-04-25T13:35:04.675 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.901+0000 7f044aa72700 1 -- start start 2024-04-25T13:35:04.676 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.901+0000 7f044aa72700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0444108250 0x7f044419fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:04.676 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.901+0000 7f044aa72700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0444109c00 con 0x7f0444108250 2024-04-25T13:35:04.676 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.901+0000 7f044880e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0444108250 0x7f044419fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:04.676 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.901+0000 7f044880e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0444108250 0x7f044419fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49474/0 (socket says 172.21.15.43:49474) 2024-04-25T13:35:04.676 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.901+0000 7f044880e700 1 -- 172.21.15.43:0/3719773300 learned_addr learned my addr 172.21.15.43:0/3719773300 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:04.676 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.902+0000 7f044880e700 1 -- 172.21.15.43:0/3719773300 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04441a0350 con 0x7f0444108250 2024-04-25T13:35:04.676 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.902+0000 7f044880e700 1 --2- 172.21.15.43:0/3719773300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0444108250 0x7f044419fe10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0438011670 tx=0x7f0438011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:04.676 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.902+0000 7f0441ffb700 1 -- 172.21.15.43:0/3719773300 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0438003a60 con 0x7f0444108250 2024-04-25T13:35:04.676 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.902+0000 7f0441ffb700 1 -- 172.21.15.43:0/3719773300 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f043801b8d0 con 0x7f0444108250 2024-04-25T13:35:04.676 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.902+0000 7f044aa72700 1 -- 172.21.15.43:0/3719773300 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04441a05e0 con 0x7f0444108250 2024-04-25T13:35:04.676 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.902+0000 7f0441ffb700 1 -- 172.21.15.43:0/3719773300 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0438023790 con 0x7f0444108250 2024-04-25T13:35:04.676 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.902+0000 7f044aa72700 1 -- 172.21.15.43:0/3719773300 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04441a31f0 con 0x7f0444108250 2024-04-25T13:35:04.676 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.903+0000 7f044aa72700 1 -- 172.21.15.43:0/3719773300 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0444064cf0 con 0x7f0444108250 2024-04-25T13:35:04.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.903+0000 7f0441ffb700 1 -- 172.21.15.43:0/3719773300 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 12) ==== 49529+0+0 (secure 0 0 0) 0x7f0438023a40 con 0x7f0444108250 2024-04-25T13:35:04.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.904+0000 7f0441ffb700 1 --2- 172.21.15.43:0/3719773300 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f043403d6e0 0x7f043403fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:04.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.904+0000 7f0441ffb700 1 -- 172.21.15.43:0/3719773300 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0438052e10 con 0x7f0444108250 2024-04-25T13:35:04.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.904+0000 7f0443fff700 1 --2- 172.21.15.43:0/3719773300 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f043403d6e0 0x7f043403fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:04.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.904+0000 7f0443fff700 1 --2- 172.21.15.43:0/3719773300 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f043403d6e0 0x7f043403fbf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0430006fd0 tx=0x7f0430006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:04.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:03.909+0000 7f0441ffb700 1 -- 172.21.15.43:0/3719773300 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f043801f030 con 0x7f0444108250 2024-04-25T13:35:04.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:04.117+0000 7f044aa72700 1 -- 172.21.15.43:0/3719773300 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f044402e7e0 con 0x7f0444108250 2024-04-25T13:35:04.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:04.117+0000 7f0441ffb700 1 -- 172.21.15.43:0/3719773300 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f0438019e20 con 0x7f0444108250 2024-04-25T13:35:04.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:04.119+0000 7f044aa72700 1 -- 172.21.15.43:0/3719773300 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f043403d6e0 msgr2=0x7f043403fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:04.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:04.119+0000 7f044aa72700 1 --2- 172.21.15.43:0/3719773300 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f043403d6e0 0x7f043403fbf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0430006fd0 tx=0x7f0430006e40 comp rx=0 tx=0).stop 2024-04-25T13:35:04.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:04.119+0000 7f044aa72700 1 -- 172.21.15.43:0/3719773300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0444108250 msgr2=0x7f044419fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:04.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:04.119+0000 7f044aa72700 1 --2- 172.21.15.43:0/3719773300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0444108250 0x7f044419fe10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0438011670 tx=0x7f0438011a30 comp rx=0 tx=0).stop 2024-04-25T13:35:04.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:04.119+0000 7f044aa72700 1 -- 172.21.15.43:0/3719773300 shutdown_connections 2024-04-25T13:35:04.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:04.119+0000 7f044aa72700 1 --2- 172.21.15.43:0/3719773300 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f043403d6e0 0x7f043403fbf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:04.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:04.119+0000 7f044aa72700 1 --2- 172.21.15.43:0/3719773300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0444108250 0x7f044419fe10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:04.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:04.119+0000 7f044aa72700 1 -- 172.21.15.43:0/3719773300 >> 172.21.15.43:0/3719773300 conn(0x7f0444103e60 msgr2=0x7f0444193e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:04.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:04.119+0000 7f044aa72700 1 -- 172.21.15.43:0/3719773300 shutdown_connections 2024-04-25T13:35:04.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:04.119+0000 7f044aa72700 1 -- 172.21.15.43:0/3719773300 wait complete. 2024-04-25T13:35:04.680 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T13:35:04.680 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout disabled 2024-04-25T13:35:04.688 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T13:35:04.688 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-04-25T13:35:04.688 INFO:teuthology.orchestra.run.smithi043.stdout:firewalld.service is not enabled 2024-04-25T13:35:04.688 INFO:teuthology.orchestra.run.smithi043.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-25T13:35:04.690 INFO:teuthology.orchestra.run.smithi043.stdout:Ceph Dashboard is now available at: 2024-04-25T13:35:04.690 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:35:04.690 INFO:teuthology.orchestra.run.smithi043.stdout: URL: https://smithi043:8443/ 2024-04-25T13:35:04.690 INFO:teuthology.orchestra.run.smithi043.stdout: User: admin 2024-04-25T13:35:04.690 INFO:teuthology.orchestra.run.smithi043.stdout: Password: ekfo6wrrxc 2024-04-25T13:35:04.690 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:35:04.690 INFO:teuthology.orchestra.run.smithi043.stdout:Saving cluster configuration to /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config directory 2024-04-25T13:35:04.691 INFO:teuthology.orchestra.run.smithi043.stdout:Enabling autotune for osd_memory_target 2024-04-25T13:35:05.611 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:05 smithi043 ceph-mon[29195]: mgrmap e13: x(active, since 6s) 2024-04-25T13:35:05.896 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.112+0000 7f1a40b60700 1 Processor -- start 2024-04-25T13:35:05.896 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.112+0000 7f1a40b60700 1 -- start start 2024-04-25T13:35:05.896 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.112+0000 7f1a40b60700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c10a410 0x7f1a3c10c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:05.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.112+0000 7f1a40b60700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c07d690 con 0x7f1a3c10a410 2024-04-25T13:35:05.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.113+0000 7f1a3a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c10a410 0x7f1a3c10c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:05.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.113+0000 7f1a3a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c10a410 0x7f1a3c10c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49490/0 (socket says 172.21.15.43:49490) 2024-04-25T13:35:05.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.113+0000 7f1a3a59c700 1 -- 172.21.15.43:0/8706334 learned_addr learned my addr 172.21.15.43:0/8706334 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:05.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.113+0000 7f1a3a59c700 1 -- 172.21.15.43:0/8706334 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3c10cd70 con 0x7f1a3c10a410 2024-04-25T13:35:05.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.113+0000 7f1a3a59c700 1 --2- 172.21.15.43:0/8706334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c10a410 0x7f1a3c10c830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009e80 tx=0x7f1a3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b65a5e0ef4680fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:05.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.113+0000 7f1a3959a700 1 -- 172.21.15.43:0/8706334 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a34017070 con 0x7f1a3c10a410 2024-04-25T13:35:05.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.113+0000 7f1a3959a700 1 -- 172.21.15.43:0/8706334 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a3400b8c0 con 0x7f1a3c10a410 2024-04-25T13:35:05.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.113+0000 7f1a3959a700 1 -- 172.21.15.43:0/8706334 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a34004420 con 0x7f1a3c10a410 2024-04-25T13:35:05.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.114+0000 7f1a40b60700 1 -- 172.21.15.43:0/8706334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c10a410 msgr2=0x7f1a3c10c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:05.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.114+0000 7f1a40b60700 1 --2- 172.21.15.43:0/8706334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c10a410 0x7f1a3c10c830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009e80 tx=0x7f1a3400b330 comp rx=0 tx=0).stop 2024-04-25T13:35:05.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.114+0000 7f1a40b60700 1 -- 172.21.15.43:0/8706334 shutdown_connections 2024-04-25T13:35:05.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.114+0000 7f1a40b60700 1 --2- 172.21.15.43:0/8706334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c10a410 0x7f1a3c10c830 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:05.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.114+0000 7f1a40b60700 1 -- 172.21.15.43:0/8706334 >> 172.21.15.43:0/8706334 conn(0x7f1a3c103e70 msgr2=0x7f1a3c106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:05.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.114+0000 7f1a40b60700 1 -- 172.21.15.43:0/8706334 shutdown_connections 2024-04-25T13:35:05.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.114+0000 7f1a40b60700 1 -- 172.21.15.43:0/8706334 wait complete. 2024-04-25T13:35:05.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.115+0000 7f1a40b60700 1 Processor -- start 2024-04-25T13:35:05.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.115+0000 7f1a40b60700 1 -- start start 2024-04-25T13:35:05.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.115+0000 7f1a40b60700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c10a410 0x7f1a3c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:05.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.115+0000 7f1a40b60700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c10dcb0 con 0x7f1a3c10a410 2024-04-25T13:35:05.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.115+0000 7f1a3a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c10a410 0x7f1a3c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:05.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.115+0000 7f1a3a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c10a410 0x7f1a3c19dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49498/0 (socket says 172.21.15.43:49498) 2024-04-25T13:35:05.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.115+0000 7f1a3a59c700 1 -- 172.21.15.43:0/1661241046 learned_addr learned my addr 172.21.15.43:0/1661241046 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:05.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.116+0000 7f1a3a59c700 1 -- 172.21.15.43:0/1661241046 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3c19e110 con 0x7f1a3c10a410 2024-04-25T13:35:05.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.116+0000 7f1a3a59c700 1 --2- 172.21.15.43:0/1661241046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c10a410 0x7f1a3c19dbd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009e50 tx=0x7f1a3400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:05.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.116+0000 7f1a337fe700 1 -- 172.21.15.43:0/1661241046 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a34020020 con 0x7f1a3c10a410 2024-04-25T13:35:05.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.116+0000 7f1a337fe700 1 -- 172.21.15.43:0/1661241046 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a340128c0 con 0x7f1a3c10a410 2024-04-25T13:35:05.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.116+0000 7f1a337fe700 1 -- 172.21.15.43:0/1661241046 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a34017040 con 0x7f1a3c10a410 2024-04-25T13:35:05.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.116+0000 7f1a40b60700 1 -- 172.21.15.43:0/1661241046 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3c19e3a0 con 0x7f1a3c10a410 2024-04-25T13:35:05.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.116+0000 7f1a40b60700 1 -- 172.21.15.43:0/1661241046 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a3c1a0fb0 con 0x7f1a3c10a410 2024-04-25T13:35:05.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.117+0000 7f1a337fe700 1 -- 172.21.15.43:0/1661241046 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f1a34023020 con 0x7f1a3c10a410 2024-04-25T13:35:05.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.117+0000 7f1a40b60700 1 -- 172.21.15.43:0/1661241046 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a3c064cf0 con 0x7f1a3c10a410 2024-04-25T13:35:05.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.117+0000 7f1a337fe700 1 --2- 172.21.15.43:0/1661241046 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f1a2803d780 0x7f1a2803fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:05.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.118+0000 7f1a337fe700 1 -- 172.21.15.43:0/1661241046 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1a3400f050 con 0x7f1a3c10a410 2024-04-25T13:35:05.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.118+0000 7f1a39d9b700 1 --2- 172.21.15.43:0/1661241046 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f1a2803d780 0x7f1a2803fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:05.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.118+0000 7f1a39d9b700 1 --2- 172.21.15.43:0/1661241046 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f1a2803d780 0x7f1a2803fc90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1a24006fd0 tx=0x7f1a24006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:05.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.123+0000 7f1a337fe700 1 -- 172.21.15.43:0/1661241046 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1a3402a020 con 0x7f1a3c10a410 2024-04-25T13:35:05.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.329+0000 7f1a40b60700 1 -- 172.21.15.43:0/1661241046 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f1a3c1a1180 con 0x7f1a3c10a410 2024-04-25T13:35:05.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.329+0000 7f1a337fe700 1 -- 172.21.15.43:0/1661241046 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f1a3c1a1180 con 0x7f1a3c10a410 2024-04-25T13:35:05.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.331+0000 7f1a40b60700 1 -- 172.21.15.43:0/1661241046 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f1a2803d780 msgr2=0x7f1a2803fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:05.900 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.331+0000 7f1a40b60700 1 --2- 172.21.15.43:0/1661241046 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f1a2803d780 0x7f1a2803fc90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1a24006fd0 tx=0x7f1a24006e40 comp rx=0 tx=0).stop 2024-04-25T13:35:05.900 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.331+0000 7f1a40b60700 1 -- 172.21.15.43:0/1661241046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c10a410 msgr2=0x7f1a3c19dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:05.900 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.331+0000 7f1a40b60700 1 --2- 172.21.15.43:0/1661241046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c10a410 0x7f1a3c19dbd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009e50 tx=0x7f1a3400bd50 comp rx=0 tx=0).stop 2024-04-25T13:35:05.900 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.331+0000 7f1a40b60700 1 -- 172.21.15.43:0/1661241046 shutdown_connections 2024-04-25T13:35:05.900 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.331+0000 7f1a40b60700 1 --2- 172.21.15.43:0/1661241046 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f1a2803d780 0x7f1a2803fc90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:05.900 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.331+0000 7f1a40b60700 1 --2- 172.21.15.43:0/1661241046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a3c10a410 0x7f1a3c19dbd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:05.900 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.331+0000 7f1a40b60700 1 -- 172.21.15.43:0/1661241046 >> 172.21.15.43:0/1661241046 conn(0x7f1a3c103e70 msgr2=0x7f1a3c104750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:05.900 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.332+0000 7f1a40b60700 1 -- 172.21.15.43:0/1661241046 shutdown_connections 2024-04-25T13:35:05.900 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:05.332+0000 7f1a40b60700 1 -- 172.21.15.43:0/1661241046 wait complete. 2024-04-25T13:35:07.137 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.290+0000 7f731231e700 1 Processor -- start 2024-04-25T13:35:07.137 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.290+0000 7f731231e700 1 -- start start 2024-04-25T13:35:07.137 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.290+0000 7f731231e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f730c07d6d0 0x7f730c10c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:07.137 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.290+0000 7f731231e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f730c10cb10 con 0x7f730c07d6d0 2024-04-25T13:35:07.137 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.291+0000 7f730bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f730c07d6d0 0x7f730c10c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:07.138 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.291+0000 7f730bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f730c07d6d0 0x7f730c10c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49514/0 (socket says 172.21.15.43:49514) 2024-04-25T13:35:07.138 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.291+0000 7f730bfff700 1 -- 172.21.15.43:0/4155040071 learned_addr learned my addr 172.21.15.43:0/4155040071 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:07.138 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.291+0000 7f730bfff700 1 -- 172.21.15.43:0/4155040071 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c10cc90 con 0x7f730c07d6d0 2024-04-25T13:35:07.138 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.291+0000 7f730bfff700 1 --2- 172.21.15.43:0/4155040071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f730c07d6d0 0x7f730c10c500 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0098a0 tx=0x7f72fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f47c21a832b90f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:07.138 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.291+0000 7f730affd700 1 -- 172.21.15.43:0/4155040071 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc004160 con 0x7f730c07d6d0 2024-04-25T13:35:07.138 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.291+0000 7f730affd700 1 -- 172.21.15.43:0/4155040071 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72fc004300 con 0x7f730c07d6d0 2024-04-25T13:35:07.138 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.291+0000 7f730affd700 1 -- 172.21.15.43:0/4155040071 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc011960 con 0x7f730c07d6d0 2024-04-25T13:35:07.138 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.292+0000 7f731231e700 1 -- 172.21.15.43:0/4155040071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f730c07d6d0 msgr2=0x7f730c10c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:07.138 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.292+0000 7f731231e700 1 --2- 172.21.15.43:0/4155040071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f730c07d6d0 0x7f730c10c500 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0098a0 tx=0x7f72fc009bb0 comp rx=0 tx=0).stop 2024-04-25T13:35:07.138 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.292+0000 7f731231e700 1 -- 172.21.15.43:0/4155040071 shutdown_connections 2024-04-25T13:35:07.138 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.292+0000 7f731231e700 1 --2- 172.21.15.43:0/4155040071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f730c07d6d0 0x7f730c10c500 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:07.139 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.292+0000 7f731231e700 1 -- 172.21.15.43:0/4155040071 >> 172.21.15.43:0/4155040071 conn(0x7f730c103e70 msgr2=0x7f730c106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:07.139 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.292+0000 7f731231e700 1 -- 172.21.15.43:0/4155040071 shutdown_connections 2024-04-25T13:35:07.139 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.292+0000 7f731231e700 1 -- 172.21.15.43:0/4155040071 wait complete. 2024-04-25T13:35:07.139 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.293+0000 7f731231e700 1 Processor -- start 2024-04-25T13:35:07.139 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.293+0000 7f731231e700 1 -- start start 2024-04-25T13:35:07.139 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.293+0000 7f731231e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f730c07d6d0 0x7f730c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:07.139 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.293+0000 7f731231e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f730c10dcf0 con 0x7f730c07d6d0 2024-04-25T13:35:07.139 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.293+0000 7f730bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f730c07d6d0 0x7f730c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:07.139 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.293+0000 7f730bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f730c07d6d0 0x7f730c109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49518/0 (socket says 172.21.15.43:49518) 2024-04-25T13:35:07.139 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.293+0000 7f730bfff700 1 -- 172.21.15.43:0/1103731162 learned_addr learned my addr 172.21.15.43:0/1103731162 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:07.139 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.294+0000 7f730bfff700 1 -- 172.21.15.43:0/1103731162 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c10a1b0 con 0x7f730c07d6d0 2024-04-25T13:35:07.139 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.294+0000 7f730bfff700 1 --2- 172.21.15.43:0/1103731162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f730c07d6d0 0x7f730c109c70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f72fc011670 tx=0x7f72fc011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:07.139 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.294+0000 7f73097fa700 1 -- 172.21.15.43:0/1103731162 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc003a60 con 0x7f730c07d6d0 2024-04-25T13:35:07.139 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.294+0000 7f73097fa700 1 -- 172.21.15.43:0/1103731162 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72fc01b8d0 con 0x7f730c07d6d0 2024-04-25T13:35:07.140 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.294+0000 7f73097fa700 1 -- 172.21.15.43:0/1103731162 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc023790 con 0x7f730c07d6d0 2024-04-25T13:35:07.140 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.294+0000 7f731231e700 1 -- 172.21.15.43:0/1103731162 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730c108400 con 0x7f730c07d6d0 2024-04-25T13:35:07.140 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.294+0000 7f731231e700 1 -- 172.21.15.43:0/1103731162 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730c1088e0 con 0x7f730c07d6d0 2024-04-25T13:35:07.140 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.295+0000 7f731231e700 1 -- 172.21.15.43:0/1103731162 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f730c064cf0 con 0x7f730c07d6d0 2024-04-25T13:35:07.140 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.295+0000 7f73097fa700 1 -- 172.21.15.43:0/1103731162 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f72fc023a40 con 0x7f730c07d6d0 2024-04-25T13:35:07.140 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.295+0000 7f73097fa700 1 --2- 172.21.15.43:0/1103731162 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f72f403d780 0x7f72f403fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:07.140 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.295+0000 7f73097fa700 1 -- 172.21.15.43:0/1103731162 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f72fc052f30 con 0x7f730c07d6d0 2024-04-25T13:35:07.140 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.295+0000 7f730b7fe700 1 --2- 172.21.15.43:0/1103731162 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f72f403d780 0x7f72f403fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:07.140 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.296+0000 7f730b7fe700 1 --2- 172.21.15.43:0/1103731162 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f72f403d780 0x7f72f403fc90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7300006fd0 tx=0x7f7300006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:07.140 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.300+0000 7f73097fa700 1 -- 172.21.15.43:0/1103731162 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f72fc01f030 con 0x7f730c07d6d0 2024-04-25T13:35:07.140 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.626+0000 7f731231e700 1 -- 172.21.15.43:0/1103731162 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f730c108f90 con 0x7f730c07d6d0 2024-04-25T13:35:07.140 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.628+0000 7f73097fa700 1 -- 172.21.15.43:0/1103731162 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f72fc00b3e0 con 0x7f730c07d6d0 2024-04-25T13:35:07.140 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.630+0000 7f731231e700 1 -- 172.21.15.43:0/1103731162 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f72f403d780 msgr2=0x7f72f403fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:07.140 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.630+0000 7f731231e700 1 --2- 172.21.15.43:0/1103731162 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f72f403d780 0x7f72f403fc90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7300006fd0 tx=0x7f7300006e40 comp rx=0 tx=0).stop 2024-04-25T13:35:07.141 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.631+0000 7f731231e700 1 -- 172.21.15.43:0/1103731162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f730c07d6d0 msgr2=0x7f730c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:07.141 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.631+0000 7f731231e700 1 --2- 172.21.15.43:0/1103731162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f730c07d6d0 0x7f730c109c70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f72fc011670 tx=0x7f72fc011a30 comp rx=0 tx=0).stop 2024-04-25T13:35:07.141 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.631+0000 7f731231e700 1 -- 172.21.15.43:0/1103731162 shutdown_connections 2024-04-25T13:35:07.141 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.631+0000 7f731231e700 1 --2- 172.21.15.43:0/1103731162 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f72f403d780 0x7f72f403fc90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:07.141 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.631+0000 7f731231e700 1 --2- 172.21.15.43:0/1103731162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f730c07d6d0 0x7f730c109c70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:07.141 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.631+0000 7f731231e700 1 -- 172.21.15.43:0/1103731162 >> 172.21.15.43:0/1103731162 conn(0x7f730c103e70 msgr2=0x7f730c1046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:07.141 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.631+0000 7f731231e700 1 -- 172.21.15.43:0/1103731162 shutdown_connections 2024-04-25T13:35:07.141 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T13:35:06.631+0000 7f731231e700 1 -- 172.21.15.43:0/1103731162 wait complete. 2024-04-25T13:35:07.141 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-25T13:35:07.141 INFO:teuthology.orchestra.run.smithi043.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-25T13:35:07.141 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:35:07.142 INFO:teuthology.orchestra.run.smithi043.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-25T13:35:07.142 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:35:07.142 INFO:teuthology.orchestra.run.smithi043.stdout:Or, if you are only running a single cluster on this host: 2024-04-25T13:35:07.142 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:35:07.142 INFO:teuthology.orchestra.run.smithi043.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-25T13:35:07.142 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:35:07.142 INFO:teuthology.orchestra.run.smithi043.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-25T13:35:07.142 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:35:07.142 INFO:teuthology.orchestra.run.smithi043.stdout: ceph telemetry on 2024-04-25T13:35:07.142 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:35:07.142 INFO:teuthology.orchestra.run.smithi043.stdout:For more information see: 2024-04-25T13:35:07.143 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:35:07.143 INFO:teuthology.orchestra.run.smithi043.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-25T13:35:07.143 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:35:07.143 INFO:teuthology.orchestra.run.smithi043.stdout:Bootstrap complete. 2024-04-25T13:35:07.176 INFO:tasks.cephadm:Fetching config... 2024-04-25T13:35:07.177 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:35:07.177 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-25T13:35:07.193 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-25T13:35:07.194 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:35:07.194 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-25T13:35:07.249 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-25T13:35:07.249 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:35:07.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/keyring of=/dev/stdout 2024-04-25T13:35:07.315 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-25T13:35:07.316 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:35:07.316 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-25T13:35:07.371 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-25T13:35:07.371 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaaCWbSr8SpQOm5BsyCB/qFZmR+LBJalnUfmRV8zg7EOCUyMZzTA/uq8YjIAj7tFlzis2X49rDieAEuvQAuaES3xTsBd+diA8szQffK9SM3D7a3WuE3cECbEuawtfX+bCH92CEq/sxD9eOah21rLVmYKcvGkS6CPRMzYUFrHz+VG4bSlS6VL0cyXfPbHsn0/9U9C+Mzn3VMGeKurKeGOZUK9AInvFuyac5s9axwjhRMe//gkCqAx2A5wljZNIbrCQZZZpA/xcF5lgyrLFCfPAKWhu/C7kX6ihg+NNmR/L0XQ9DduDXVglI+ywddP98iLAo3lRmdXEW9wtFimrDgnJWcbK3vxMfd1v7mLdsDMj2L8AzcZemuTMGEAFfVVFYqxeagTYCpu8TcXktEbvpX0iElc2AVl0L/uo8khdvgcHGTigGrbJRW17R8dB+ek6EqCdA7PbhR3mgu4wBOtB7TJC4hwKPg++RS9x6nfDhuzWk4R9uHYlVWnKhA3yl9nVyYbM= ceph-394efb6c-0308-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-25T13:35:07.453 INFO:teuthology.orchestra.run.smithi043.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaaCWbSr8SpQOm5BsyCB/qFZmR+LBJalnUfmRV8zg7EOCUyMZzTA/uq8YjIAj7tFlzis2X49rDieAEuvQAuaES3xTsBd+diA8szQffK9SM3D7a3WuE3cECbEuawtfX+bCH92CEq/sxD9eOah21rLVmYKcvGkS6CPRMzYUFrHz+VG4bSlS6VL0cyXfPbHsn0/9U9C+Mzn3VMGeKurKeGOZUK9AInvFuyac5s9axwjhRMe//gkCqAx2A5wljZNIbrCQZZZpA/xcF5lgyrLFCfPAKWhu/C7kX6ihg+NNmR/L0XQ9DduDXVglI+ywddP98iLAo3lRmdXEW9wtFimrDgnJWcbK3vxMfd1v7mLdsDMj2L8AzcZemuTMGEAFfVVFYqxeagTYCpu8TcXktEbvpX0iElc2AVl0L/uo8khdvgcHGTigGrbJRW17R8dB+ek6EqCdA7PbhR3mgu4wBOtB7TJC4hwKPg++RS9x6nfDhuzWk4R9uHYlVWnKhA3yl9nVyYbM= ceph-394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:35:07.464 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaaCWbSr8SpQOm5BsyCB/qFZmR+LBJalnUfmRV8zg7EOCUyMZzTA/uq8YjIAj7tFlzis2X49rDieAEuvQAuaES3xTsBd+diA8szQffK9SM3D7a3WuE3cECbEuawtfX+bCH92CEq/sxD9eOah21rLVmYKcvGkS6CPRMzYUFrHz+VG4bSlS6VL0cyXfPbHsn0/9U9C+Mzn3VMGeKurKeGOZUK9AInvFuyac5s9axwjhRMe//gkCqAx2A5wljZNIbrCQZZZpA/xcF5lgyrLFCfPAKWhu/C7kX6ihg+NNmR/L0XQ9DduDXVglI+ywddP98iLAo3lRmdXEW9wtFimrDgnJWcbK3vxMfd1v7mLdsDMj2L8AzcZemuTMGEAFfVVFYqxeagTYCpu8TcXktEbvpX0iElc2AVl0L/uo8khdvgcHGTigGrbJRW17R8dB+ek6EqCdA7PbhR3mgu4wBOtB7TJC4hwKPg++RS9x6nfDhuzWk4R9uHYlVWnKhA3yl9nVyYbM= ceph-394efb6c-0308-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-25T13:35:07.504 INFO:teuthology.orchestra.run.smithi161.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaaCWbSr8SpQOm5BsyCB/qFZmR+LBJalnUfmRV8zg7EOCUyMZzTA/uq8YjIAj7tFlzis2X49rDieAEuvQAuaES3xTsBd+diA8szQffK9SM3D7a3WuE3cECbEuawtfX+bCH92CEq/sxD9eOah21rLVmYKcvGkS6CPRMzYUFrHz+VG4bSlS6VL0cyXfPbHsn0/9U9C+Mzn3VMGeKurKeGOZUK9AInvFuyac5s9axwjhRMe//gkCqAx2A5wljZNIbrCQZZZpA/xcF5lgyrLFCfPAKWhu/C7kX6ihg+NNmR/L0XQ9DduDXVglI+ywddP98iLAo3lRmdXEW9wtFimrDgnJWcbK3vxMfd1v7mLdsDMj2L8AzcZemuTMGEAFfVVFYqxeagTYCpu8TcXktEbvpX0iElc2AVl0L/uo8khdvgcHGTigGrbJRW17R8dB+ek6EqCdA7PbhR3mgu4wBOtB7TJC4hwKPg++RS9x6nfDhuzWk4R9uHYlVWnKhA3yl9nVyYbM= ceph-394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:35:07.515 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaaCWbSr8SpQOm5BsyCB/qFZmR+LBJalnUfmRV8zg7EOCUyMZzTA/uq8YjIAj7tFlzis2X49rDieAEuvQAuaES3xTsBd+diA8szQffK9SM3D7a3WuE3cECbEuawtfX+bCH92CEq/sxD9eOah21rLVmYKcvGkS6CPRMzYUFrHz+VG4bSlS6VL0cyXfPbHsn0/9U9C+Mzn3VMGeKurKeGOZUK9AInvFuyac5s9axwjhRMe//gkCqAx2A5wljZNIbrCQZZZpA/xcF5lgyrLFCfPAKWhu/C7kX6ihg+NNmR/L0XQ9DduDXVglI+ywddP98iLAo3lRmdXEW9wtFimrDgnJWcbK3vxMfd1v7mLdsDMj2L8AzcZemuTMGEAFfVVFYqxeagTYCpu8TcXktEbvpX0iElc2AVl0L/uo8khdvgcHGTigGrbJRW17R8dB+ek6EqCdA7PbhR3mgu4wBOtB7TJC4hwKPg++RS9x6nfDhuzWk4R9uHYlVWnKhA3yl9nVyYbM= ceph-394efb6c-0308-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-25T13:35:07.554 INFO:teuthology.orchestra.run.smithi175.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaaCWbSr8SpQOm5BsyCB/qFZmR+LBJalnUfmRV8zg7EOCUyMZzTA/uq8YjIAj7tFlzis2X49rDieAEuvQAuaES3xTsBd+diA8szQffK9SM3D7a3WuE3cECbEuawtfX+bCH92CEq/sxD9eOah21rLVmYKcvGkS6CPRMzYUFrHz+VG4bSlS6VL0cyXfPbHsn0/9U9C+Mzn3VMGeKurKeGOZUK9AInvFuyac5s9axwjhRMe//gkCqAx2A5wljZNIbrCQZZZpA/xcF5lgyrLFCfPAKWhu/C7kX6ihg+NNmR/L0XQ9DduDXVglI+ywddP98iLAo3lRmdXEW9wtFimrDgnJWcbK3vxMfd1v7mLdsDMj2L8AzcZemuTMGEAFfVVFYqxeagTYCpu8TcXktEbvpX0iElc2AVl0L/uo8khdvgcHGTigGrbJRW17R8dB+ek6EqCdA7PbhR3mgu4wBOtB7TJC4hwKPg++RS9x6nfDhuzWk4R9uHYlVWnKhA3yl9nVyYbM= ceph-394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:35:07.566 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-25T13:35:07.807 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:35:07.928 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:07 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1103731162' entity='client.admin' 2024-04-25T13:35:10.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.904+0000 7f8634ffd700 1 -- 172.21.15.43:0/2582666878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8630102980 msgr2=0x7f8630102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:10.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.904+0000 7f8634ffd700 1 --2- 172.21.15.43:0/2582666878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8630102980 0x7f8630102d90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8620009910 tx=0x7f8620009c20 comp rx=0 tx=0).stop 2024-04-25T13:35:10.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.904+0000 7f8634ffd700 1 -- 172.21.15.43:0/2582666878 shutdown_connections 2024-04-25T13:35:10.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.904+0000 7f8634ffd700 1 --2- 172.21.15.43:0/2582666878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8630102980 0x7f8630102d90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:10.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.904+0000 7f8634ffd700 1 -- 172.21.15.43:0/2582666878 >> 172.21.15.43:0/2582666878 conn(0x7f86300fdfe0 msgr2=0x7f8630100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:10.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.904+0000 7f8634ffd700 1 -- 172.21.15.43:0/2582666878 shutdown_connections 2024-04-25T13:35:10.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.904+0000 7f8634ffd700 1 -- 172.21.15.43:0/2582666878 wait complete. 2024-04-25T13:35:10.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.905+0000 7f8634ffd700 1 Processor -- start 2024-04-25T13:35:10.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.905+0000 7f8634ffd700 1 -- start start 2024-04-25T13:35:10.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.905+0000 7f8634ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8630102980 0x7f86301983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:10.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.905+0000 7f8634ffd700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f86301087f0 con 0x7f8630102980 2024-04-25T13:35:10.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.905+0000 7f862e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8630102980 0x7f86301983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:10.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.905+0000 7f862e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8630102980 0x7f86301983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36652/0 (socket says 172.21.15.43:36652) 2024-04-25T13:35:10.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.905+0000 7f862e59c700 1 -- 172.21.15.43:0/2591614640 learned_addr learned my addr 172.21.15.43:0/2591614640 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:10.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.905+0000 7f862e59c700 1 -- 172.21.15.43:0/2591614640 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8630198900 con 0x7f8630102980 2024-04-25T13:35:10.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.905+0000 7f862e59c700 1 --2- 172.21.15.43:0/2591614640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8630102980 0x7f86301983c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8620005950 tx=0x7f8620005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:10.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.906+0000 7f861f7fe700 1 -- 172.21.15.43:0/2591614640 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8620027070 con 0x7f8630102980 2024-04-25T13:35:10.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.906+0000 7f861f7fe700 1 -- 172.21.15.43:0/2591614640 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f862000bdf0 con 0x7f8630102980 2024-04-25T13:35:10.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.906+0000 7f8634ffd700 1 -- 172.21.15.43:0/2591614640 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8630198b90 con 0x7f8630102980 2024-04-25T13:35:10.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.906+0000 7f861f7fe700 1 -- 172.21.15.43:0/2591614640 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f862000fdb0 con 0x7f8630102980 2024-04-25T13:35:10.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.906+0000 7f8634ffd700 1 -- 172.21.15.43:0/2591614640 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f863019b7a0 con 0x7f8630102980 2024-04-25T13:35:10.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.907+0000 7f8634ffd700 1 -- 172.21.15.43:0/2591614640 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8630108f70 con 0x7f8630102980 2024-04-25T13:35:10.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.907+0000 7f861f7fe700 1 -- 172.21.15.43:0/2591614640 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f862002a070 con 0x7f8630102980 2024-04-25T13:35:10.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.907+0000 7f861f7fe700 1 --2- 172.21.15.43:0/2591614640 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f861803d670 0x7f861803fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:10.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.907+0000 7f861f7fe700 1 -- 172.21.15.43:0/2591614640 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8620052660 con 0x7f8630102980 2024-04-25T13:35:10.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.907+0000 7f862dd9b700 1 --2- 172.21.15.43:0/2591614640 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f861803d670 0x7f861803fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:10.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.908+0000 7f862dd9b700 1 --2- 172.21.15.43:0/2591614640 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f861803d670 0x7f861803fb80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8624006fd0 tx=0x7f8624006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:10.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:10.912+0000 7f861f7fe700 1 -- 172.21.15.43:0/2591614640 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8620013070 con 0x7f8630102980 2024-04-25T13:35:11.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:11.122+0000 7f8634ffd700 1 -- 172.21.15.43:0/2591614640 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f863002e620 con 0x7f8630102980 2024-04-25T13:35:11.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:11.125+0000 7f861f7fe700 1 -- 172.21.15.43:0/2591614640 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f86200310c0 con 0x7f8630102980 2024-04-25T13:35:11.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:11.127+0000 7f8634ffd700 1 -- 172.21.15.43:0/2591614640 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f861803d670 msgr2=0x7f861803fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:11.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:11.127+0000 7f8634ffd700 1 --2- 172.21.15.43:0/2591614640 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f861803d670 0x7f861803fb80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8624006fd0 tx=0x7f8624006e40 comp rx=0 tx=0).stop 2024-04-25T13:35:11.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:11.127+0000 7f8634ffd700 1 -- 172.21.15.43:0/2591614640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8630102980 msgr2=0x7f86301983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:11.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:11.127+0000 7f8634ffd700 1 --2- 172.21.15.43:0/2591614640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8630102980 0x7f86301983c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8620005950 tx=0x7f8620005810 comp rx=0 tx=0).stop 2024-04-25T13:35:11.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:11.127+0000 7f8634ffd700 1 -- 172.21.15.43:0/2591614640 shutdown_connections 2024-04-25T13:35:11.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:11.127+0000 7f8634ffd700 1 --2- 172.21.15.43:0/2591614640 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f861803d670 0x7f861803fb80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:11.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:11.127+0000 7f8634ffd700 1 --2- 172.21.15.43:0/2591614640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8630102980 0x7f86301983c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:11.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:11.127+0000 7f8634ffd700 1 -- 172.21.15.43:0/2591614640 >> 172.21.15.43:0/2591614640 conn(0x7f86300fdfe0 msgr2=0x7f86300fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:11.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:11.127+0000 7f8634ffd700 1 -- 172.21.15.43:0/2591614640 shutdown_connections 2024-04-25T13:35:11.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:11.127+0000 7f8634ffd700 1 -- 172.21.15.43:0/2591614640 wait complete. 2024-04-25T13:35:11.746 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-25T13:35:11.746 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-25T13:35:11.990 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:35:12.112 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:12.113 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:12.113 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi043", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:35:12.113 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:12.113 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:35:12.113 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:12.113 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:11 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2591614640' entity='client.admin' 2024-04-25T13:35:12.113 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:35:12.113 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.538+0000 7f1823760700 1 -- 172.21.15.43:0/275192088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181c104580 msgr2=0x7f181c1069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.538+0000 7f1823760700 1 --2- 172.21.15.43:0/275192088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181c104580 0x7f181c1069a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1818009910 tx=0x7f1818009c20 comp rx=0 tx=0).stop 2024-04-25T13:35:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.538+0000 7f1823760700 1 -- 172.21.15.43:0/275192088 shutdown_connections 2024-04-25T13:35:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.538+0000 7f1823760700 1 --2- 172.21.15.43:0/275192088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181c104580 0x7f181c1069a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.538+0000 7f1823760700 1 -- 172.21.15.43:0/275192088 >> 172.21.15.43:0/275192088 conn(0x7f181c0fdfe0 msgr2=0x7f181c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.538+0000 7f1823760700 1 -- 172.21.15.43:0/275192088 shutdown_connections 2024-04-25T13:35:13.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.538+0000 7f1823760700 1 -- 172.21.15.43:0/275192088 wait complete. 2024-04-25T13:35:13.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.538+0000 7f1823760700 1 Processor -- start 2024-04-25T13:35:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.538+0000 7f1823760700 1 -- start start 2024-04-25T13:35:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.539+0000 7f1823760700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181c104580 0x7f181c1994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.539+0000 7f1823760700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f181c1098f0 con 0x7f181c104580 2024-04-25T13:35:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.539+0000 7f18214fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181c104580 0x7f181c1994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.539+0000 7f18214fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181c104580 0x7f181c1994e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36670/0 (socket says 172.21.15.43:36670) 2024-04-25T13:35:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.539+0000 7f18214fc700 1 -- 172.21.15.43:0/3308708219 learned_addr learned my addr 172.21.15.43:0/3308708219 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.539+0000 7f18214fc700 1 -- 172.21.15.43:0/3308708219 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c199a20 con 0x7f181c104580 2024-04-25T13:35:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.539+0000 7f18214fc700 1 --2- 172.21.15.43:0/3308708219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181c104580 0x7f181c1994e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1818005790 tx=0x7f1818004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.539+0000 7f18127fc700 1 -- 172.21.15.43:0/3308708219 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1818027070 con 0x7f181c104580 2024-04-25T13:35:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.539+0000 7f18127fc700 1 -- 172.21.15.43:0/3308708219 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f181800bdf0 con 0x7f181c104580 2024-04-25T13:35:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.540+0000 7f1823760700 1 -- 172.21.15.43:0/3308708219 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181c199cb0 con 0x7f181c104580 2024-04-25T13:35:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.540+0000 7f18127fc700 1 -- 172.21.15.43:0/3308708219 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f181800fd90 con 0x7f181c104580 2024-04-25T13:35:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.540+0000 7f1823760700 1 -- 172.21.15.43:0/3308708219 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f181c19c8c0 con 0x7f181c104580 2024-04-25T13:35:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.540+0000 7f18127fc700 1 -- 172.21.15.43:0/3308708219 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f181802a070 con 0x7f181c104580 2024-04-25T13:35:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.540+0000 7f1823760700 1 -- 172.21.15.43:0/3308708219 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f181c10a070 con 0x7f181c104580 2024-04-25T13:35:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.541+0000 7f18127fc700 1 --2- 172.21.15.43:0/3308708219 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f180803d670 0x7f180803fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.541+0000 7f18127fc700 1 -- 172.21.15.43:0/3308708219 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1818052710 con 0x7f181c104580 2024-04-25T13:35:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.541+0000 7f1820cfb700 1 --2- 172.21.15.43:0/3308708219 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f180803d670 0x7f180803fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:13.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.541+0000 7f1820cfb700 1 --2- 172.21.15.43:0/3308708219 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f180803d670 0x7f180803fb80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f180c006fd0 tx=0x7f180c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:13.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.546+0000 7f18127fc700 1 -- 172.21.15.43:0/3308708219 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1818013070 con 0x7f181c104580 2024-04-25T13:35:13.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.759+0000 7f1823760700 1 -- 172.21.15.43:0/3308708219 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f181c02e5b0 con 0x7f180803d670 2024-04-25T13:35:13.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.763+0000 7f18127fc700 1 -- 172.21.15.43:0/3308708219 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f181c02e5b0 con 0x7f180803d670 2024-04-25T13:35:13.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.765+0000 7f1823760700 1 -- 172.21.15.43:0/3308708219 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f180803d670 msgr2=0x7f180803fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:13.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.765+0000 7f1823760700 1 --2- 172.21.15.43:0/3308708219 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f180803d670 0x7f180803fb80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f180c006fd0 tx=0x7f180c006e40 comp rx=0 tx=0).stop 2024-04-25T13:35:13.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.765+0000 7f1823760700 1 -- 172.21.15.43:0/3308708219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181c104580 msgr2=0x7f181c1994e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:13.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.765+0000 7f1823760700 1 --2- 172.21.15.43:0/3308708219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181c104580 0x7f181c1994e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1818005790 tx=0x7f1818004f60 comp rx=0 tx=0).stop 2024-04-25T13:35:13.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.765+0000 7f1823760700 1 -- 172.21.15.43:0/3308708219 shutdown_connections 2024-04-25T13:35:13.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.765+0000 7f1823760700 1 --2- 172.21.15.43:0/3308708219 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f180803d670 0x7f180803fb80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:13.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.765+0000 7f1823760700 1 --2- 172.21.15.43:0/3308708219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181c104580 0x7f181c1994e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:13.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.765+0000 7f1823760700 1 -- 172.21.15.43:0/3308708219 >> 172.21.15.43:0/3308708219 conn(0x7f181c0fdfe0 msgr2=0x7f181c0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:13.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.765+0000 7f1823760700 1 -- 172.21.15.43:0/3308708219 shutdown_connections 2024-04-25T13:35:13.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:13.765+0000 7f1823760700 1 -- 172.21.15.43:0/3308708219 wait complete. 2024-04-25T13:35:14.517 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi161 2024-04-25T13:35:14.518 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-04-25T13:35:14.518 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/etc/ceph/ceph.conf 2024-04-25T13:35:14.536 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-04-25T13:35:14.536 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:35:14.594 INFO:tasks.cephadm:Adding host smithi161 to orchestrator... 2024-04-25T13:35:14.594 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch host add smithi161 2024-04-25T13:35:14.837 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:35:15.029 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:14 smithi043 ceph-mon[29195]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:35:15.029 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:14 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:15.029 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:14 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:35:15.029 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:14 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:35:15.029 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:14 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:35:15.030 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:14 smithi043 ceph-mon[29195]: Updating smithi043:/etc/ceph/ceph.conf 2024-04-25T13:35:15.030 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:14 smithi043 ceph-mon[29195]: Updating smithi043:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:35:15.030 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:14 smithi043 ceph-mon[29195]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:35:15.030 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:14 smithi043 ceph-mon[29195]: Updating smithi043:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T13:35:15.030 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:14 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:15.030 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:14 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:15.030 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:14 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:16.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.352+0000 7f271f526700 1 -- 172.21.15.43:0/1570940035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2718108910 msgr2=0x7f2718108d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:16.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.352+0000 7f271f526700 1 --2- 172.21.15.43:0/1570940035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2718108910 0x7f2718108d20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2714009910 tx=0x7f2714009c20 comp rx=0 tx=0).stop 2024-04-25T13:35:16.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.352+0000 7f271f526700 1 -- 172.21.15.43:0/1570940035 shutdown_connections 2024-04-25T13:35:16.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.352+0000 7f271f526700 1 --2- 172.21.15.43:0/1570940035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2718108910 0x7f2718108d20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:16.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.352+0000 7f271f526700 1 -- 172.21.15.43:0/1570940035 >> 172.21.15.43:0/1570940035 conn(0x7f27180fe440 msgr2=0x7f2718100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:16.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.352+0000 7f271f526700 1 -- 172.21.15.43:0/1570940035 shutdown_connections 2024-04-25T13:35:16.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.352+0000 7f271f526700 1 -- 172.21.15.43:0/1570940035 wait complete. 2024-04-25T13:35:16.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.353+0000 7f271f526700 1 Processor -- start 2024-04-25T13:35:16.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.353+0000 7f271f526700 1 -- start start 2024-04-25T13:35:16.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.353+0000 7f271f526700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2718108910 0x7f271819f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.353+0000 7f271f526700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f271810cd10 con 0x7f2718108910 2024-04-25T13:35:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.353+0000 7f271d2c2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2718108910 0x7f271819f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.353+0000 7f271d2c2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2718108910 0x7f271819f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36696/0 (socket says 172.21.15.43:36696) 2024-04-25T13:35:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.353+0000 7f271d2c2700 1 -- 172.21.15.43:0/12916087 learned_addr learned my addr 172.21.15.43:0/12916087 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.354+0000 7f271d2c2700 1 -- 172.21.15.43:0/12916087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271819fa00 con 0x7f2718108910 2024-04-25T13:35:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.354+0000 7f271d2c2700 1 --2- 172.21.15.43:0/12916087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2718108910 0x7f271819f4c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2714005660 tx=0x7f2714005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.354+0000 7f270e7fc700 1 -- 172.21.15.43:0/12916087 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2714026070 con 0x7f2718108910 2024-04-25T13:35:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.354+0000 7f270e7fc700 1 -- 172.21.15.43:0/12916087 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f271400b6f0 con 0x7f2718108910 2024-04-25T13:35:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.354+0000 7f270e7fc700 1 -- 172.21.15.43:0/12916087 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27140037d0 con 0x7f2718108910 2024-04-25T13:35:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.354+0000 7f271f526700 1 -- 172.21.15.43:0/12916087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271819fcf0 con 0x7f2718108910 2024-04-25T13:35:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.354+0000 7f271f526700 1 -- 172.21.15.43:0/12916087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2718199820 con 0x7f2718108910 2024-04-25T13:35:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.355+0000 7f270e7fc700 1 -- 172.21.15.43:0/12916087 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f2714029070 con 0x7f2718108910 2024-04-25T13:35:16.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.355+0000 7f270e7fc700 1 --2- 172.21.15.43:0/12916087 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f270403d670 0x7f270403fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:16.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.355+0000 7f270e7fc700 1 -- 172.21.15.43:0/12916087 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f271401e070 con 0x7f2718108910 2024-04-25T13:35:16.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.355+0000 7f271f526700 1 -- 172.21.15.43:0/12916087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2718104020 con 0x7f2718108910 2024-04-25T13:35:16.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.355+0000 7f271cac1700 1 --2- 172.21.15.43:0/12916087 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f270403d670 0x7f270403fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:16.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.356+0000 7f271cac1700 1 --2- 172.21.15.43:0/12916087 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f270403d670 0x7f270403fb80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2708006fd0 tx=0x7f2708006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:16.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.361+0000 7f270e7fc700 1 -- 172.21.15.43:0/12916087 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2714013070 con 0x7f2718108910 2024-04-25T13:35:16.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:16.572+0000 7f271f526700 1 -- 172.21.15.43:0/12916087 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi161", "target": ["mon-mgr", ""]}) -- 0x7f271819ff20 con 0x7f270403d670 2024-04-25T13:35:16.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:16 smithi043 ceph-mon[29195]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi161", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:35:17.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:17 smithi043 ceph-mon[29195]: Deploying cephadm binary to smithi161 2024-04-25T13:35:18.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:18 smithi043 ceph-mon[29195]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:20.788 INFO:teuthology.orchestra.run.smithi043.stdout:Added host 'smithi161' with addr '172.21.15.161' 2024-04-25T13:35:20.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:20.787+0000 7f270e7fc700 1 -- 172.21.15.43:0/12916087 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f271819ff20 con 0x7f270403d670 2024-04-25T13:35:20.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:20.789+0000 7f271f526700 1 -- 172.21.15.43:0/12916087 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f270403d670 msgr2=0x7f270403fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:20.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:20.789+0000 7f271f526700 1 --2- 172.21.15.43:0/12916087 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f270403d670 0x7f270403fb80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2708006fd0 tx=0x7f2708006e40 comp rx=0 tx=0).stop 2024-04-25T13:35:20.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:20.789+0000 7f271f526700 1 -- 172.21.15.43:0/12916087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2718108910 msgr2=0x7f271819f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:20.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:20.789+0000 7f271f526700 1 --2- 172.21.15.43:0/12916087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2718108910 0x7f271819f4c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2714005660 tx=0x7f2714005740 comp rx=0 tx=0).stop 2024-04-25T13:35:20.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:20.789+0000 7f271f526700 1 -- 172.21.15.43:0/12916087 shutdown_connections 2024-04-25T13:35:20.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:20.789+0000 7f271f526700 1 --2- 172.21.15.43:0/12916087 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f270403d670 0x7f270403fb80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:20.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:20.789+0000 7f271f526700 1 --2- 172.21.15.43:0/12916087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2718108910 0x7f271819f4c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:20.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:20.789+0000 7f271f526700 1 -- 172.21.15.43:0/12916087 >> 172.21.15.43:0/12916087 conn(0x7f27180fe440 msgr2=0x7f27181063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:20.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:20.790+0000 7f271f526700 1 -- 172.21.15.43:0/12916087 shutdown_connections 2024-04-25T13:35:20.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:20.790+0000 7f271f526700 1 -- 172.21.15.43:0/12916087 wait complete. 2024-04-25T13:35:21.141 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:20 smithi043 ceph-mon[29195]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:21.141 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:20 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:21.141 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:20 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:35:21.466 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-25T13:35:21.713 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:35:22.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:22 smithi043 ceph-mon[29195]: Added host smithi161 2024-04-25T13:35:22.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:22 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:22.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:22 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:23.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.077+0000 7f9eca9e7700 1 -- 172.21.15.43:0/3966685845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ec4108930 msgr2=0x7f9ec4108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:23.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.077+0000 7f9eca9e7700 1 --2- 172.21.15.43:0/3966685845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ec4108930 0x7f9ec4108d40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009910 tx=0x7f9eb4009c20 comp rx=0 tx=0).stop 2024-04-25T13:35:23.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.077+0000 7f9eca9e7700 1 -- 172.21.15.43:0/3966685845 shutdown_connections 2024-04-25T13:35:23.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.077+0000 7f9eca9e7700 1 --2- 172.21.15.43:0/3966685845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ec4108930 0x7f9ec4108d40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:23.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.077+0000 7f9eca9e7700 1 -- 172.21.15.43:0/3966685845 >> 172.21.15.43:0/3966685845 conn(0x7f9ec40fe480 msgr2=0x7f9ec41008d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:23.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.077+0000 7f9eca9e7700 1 -- 172.21.15.43:0/3966685845 shutdown_connections 2024-04-25T13:35:23.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.077+0000 7f9eca9e7700 1 -- 172.21.15.43:0/3966685845 wait complete. 2024-04-25T13:35:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.078+0000 7f9eca9e7700 1 Processor -- start 2024-04-25T13:35:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.078+0000 7f9eca9e7700 1 -- start start 2024-04-25T13:35:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.078+0000 7f9eca9e7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ec4108930 0x7f9ec41983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.078+0000 7f9eca9e7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec410cd30 con 0x7f9ec4108930 2024-04-25T13:35:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.078+0000 7f9ec3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ec4108930 0x7f9ec41983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.079+0000 7f9ec3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ec4108930 0x7f9ec41983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46422/0 (socket says 172.21.15.43:46422) 2024-04-25T13:35:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.079+0000 7f9ec3fff700 1 -- 172.21.15.43:0/4011536986 learned_addr learned my addr 172.21.15.43:0/4011536986 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.079+0000 7f9ec3fff700 1 -- 172.21.15.43:0/4011536986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec406c810 con 0x7f9ec4108930 2024-04-25T13:35:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.079+0000 7f9ec3fff700 1 --2- 172.21.15.43:0/4011536986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ec4108930 0x7f9ec41983b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4005660 tx=0x7f9eb4005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.079+0000 7f9ec17fa700 1 -- 172.21.15.43:0/4011536986 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9eb4026070 con 0x7f9ec4108930 2024-04-25T13:35:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.079+0000 7f9ec17fa700 1 -- 172.21.15.43:0/4011536986 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9eb400b6f0 con 0x7f9ec4108930 2024-04-25T13:35:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.079+0000 7f9eca9e7700 1 -- 172.21.15.43:0/4011536986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec41988f0 con 0x7f9ec4108930 2024-04-25T13:35:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.079+0000 7f9eca9e7700 1 -- 172.21.15.43:0/4011536986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec4198db0 con 0x7f9ec4108930 2024-04-25T13:35:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.079+0000 7f9ec17fa700 1 -- 172.21.15.43:0/4011536986 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9eb40037d0 con 0x7f9ec4108930 2024-04-25T13:35:23.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.080+0000 7f9eca9e7700 1 -- 172.21.15.43:0/4011536986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ec4104040 con 0x7f9ec4108930 2024-04-25T13:35:23.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.080+0000 7f9ec17fa700 1 -- 172.21.15.43:0/4011536986 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f9eb4029070 con 0x7f9ec4108930 2024-04-25T13:35:23.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.081+0000 7f9ec17fa700 1 --2- 172.21.15.43:0/4011536986 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9eac03d670 0x7f9eac03fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:23.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.081+0000 7f9ec17fa700 1 -- 172.21.15.43:0/4011536986 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9eb401e070 con 0x7f9ec4108930 2024-04-25T13:35:23.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.081+0000 7f9ec37fe700 1 --2- 172.21.15.43:0/4011536986 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9eac03d670 0x7f9eac03fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:23.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.081+0000 7f9ec37fe700 1 --2- 172.21.15.43:0/4011536986 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9eac03d670 0x7f9eac03fb80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8006fd0 tx=0x7f9eb8006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:23.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.086+0000 7f9ec17fa700 1 -- 172.21.15.43:0/4011536986 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9eb4013070 con 0x7f9ec4108930 2024-04-25T13:35:23.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.300+0000 7f9eca9e7700 1 -- 172.21.15.43:0/4011536986 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9ec406c0a0 con 0x7f9eac03d670 2024-04-25T13:35:23.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.301+0000 7f9ec17fa700 1 -- 172.21.15.43:0/4011536986 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f9ec406c0a0 con 0x7f9eac03d670 2024-04-25T13:35:23.302 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:35:23.302 INFO:teuthology.orchestra.run.smithi043.stdout:[{"addr": "172.21.15.43", "hostname": "smithi043", "labels": [], "status": ""}, {"addr": "172.21.15.161", "hostname": "smithi161", "labels": [], "status": ""}] 2024-04-25T13:35:23.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.304+0000 7f9eca9e7700 1 -- 172.21.15.43:0/4011536986 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9eac03d670 msgr2=0x7f9eac03fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:23.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.304+0000 7f9eca9e7700 1 --2- 172.21.15.43:0/4011536986 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9eac03d670 0x7f9eac03fb80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8006fd0 tx=0x7f9eb8006e40 comp rx=0 tx=0).stop 2024-04-25T13:35:23.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.304+0000 7f9eca9e7700 1 -- 172.21.15.43:0/4011536986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ec4108930 msgr2=0x7f9ec41983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:23.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.304+0000 7f9eca9e7700 1 --2- 172.21.15.43:0/4011536986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ec4108930 0x7f9ec41983b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4005660 tx=0x7f9eb4005740 comp rx=0 tx=0).stop 2024-04-25T13:35:23.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.304+0000 7f9eca9e7700 1 -- 172.21.15.43:0/4011536986 shutdown_connections 2024-04-25T13:35:23.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.304+0000 7f9eca9e7700 1 --2- 172.21.15.43:0/4011536986 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9eac03d670 0x7f9eac03fb80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:23.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.304+0000 7f9eca9e7700 1 --2- 172.21.15.43:0/4011536986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ec4108930 0x7f9ec41983b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:23.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.304+0000 7f9eca9e7700 1 -- 172.21.15.43:0/4011536986 >> 172.21.15.43:0/4011536986 conn(0x7f9ec40fe480 msgr2=0x7f9ec40ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:23.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.304+0000 7f9eca9e7700 1 -- 172.21.15.43:0/4011536986 shutdown_connections 2024-04-25T13:35:23.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:23.304+0000 7f9eca9e7700 1 -- 172.21.15.43:0/4011536986 wait complete. 2024-04-25T13:35:23.653 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:23 smithi043 ceph-mon[29195]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:23.898 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi175 2024-04-25T13:35:23.898 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T13:35:23.898 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.conf 2024-04-25T13:35:23.918 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T13:35:23.918 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:35:23.974 INFO:tasks.cephadm:Adding host smithi175 to orchestrator... 2024-04-25T13:35:23.975 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch host add smithi175 2024-04-25T13:35:24.215 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:35:24.615 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:24 smithi043 ceph-mon[29195]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T13:35:24.615 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:24 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:25.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:25 smithi043 ceph-mon[29195]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:25.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.619+0000 7f578d3dc700 1 -- 172.21.15.43:0/1980986908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5788075ba0 msgr2=0x7f5788075fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:25.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.619+0000 7f578d3dc700 1 --2- 172.21.15.43:0/1980986908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5788075ba0 0x7f5788075fb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f578000b0a0 tx=0x7f578000b3b0 comp rx=0 tx=0).stop 2024-04-25T13:35:25.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.619+0000 7f578d3dc700 1 -- 172.21.15.43:0/1980986908 shutdown_connections 2024-04-25T13:35:25.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.619+0000 7f578d3dc700 1 --2- 172.21.15.43:0/1980986908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5788075ba0 0x7f5788075fb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:25.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.619+0000 7f578d3dc700 1 -- 172.21.15.43:0/1980986908 >> 172.21.15.43:0/1980986908 conn(0x7f57880ff550 msgr2=0x7f57881019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:25.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.619+0000 7f578d3dc700 1 -- 172.21.15.43:0/1980986908 shutdown_connections 2024-04-25T13:35:25.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.619+0000 7f578d3dc700 1 -- 172.21.15.43:0/1980986908 wait complete. 2024-04-25T13:35:25.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.620+0000 7f578d3dc700 1 Processor -- start 2024-04-25T13:35:25.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.620+0000 7f578d3dc700 1 -- start start 2024-04-25T13:35:25.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.620+0000 7f578d3dc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5788075ba0 0x7f57881a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:25.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.620+0000 7f578d3dc700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f57881100a0 con 0x7f5788075ba0 2024-04-25T13:35:25.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.620+0000 7f5786ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5788075ba0 0x7f57881a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:25.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.620+0000 7f5786ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5788075ba0 0x7f57881a15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46434/0 (socket says 172.21.15.43:46434) 2024-04-25T13:35:25.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.620+0000 7f5786ffd700 1 -- 172.21.15.43:0/799448041 learned_addr learned my addr 172.21.15.43:0/799448041 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:25.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.621+0000 7f5786ffd700 1 -- 172.21.15.43:0/799448041 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57881a1b00 con 0x7f5788075ba0 2024-04-25T13:35:25.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.621+0000 7f5786ffd700 1 --2- 172.21.15.43:0/799448041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5788075ba0 0x7f57881a15c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f57800062a0 tx=0x7f5780009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:25.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.621+0000 7f577ffff700 1 -- 172.21.15.43:0/799448041 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5780017040 con 0x7f5788075ba0 2024-04-25T13:35:25.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.621+0000 7f577ffff700 1 -- 172.21.15.43:0/799448041 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5780022070 con 0x7f5788075ba0 2024-04-25T13:35:25.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.621+0000 7f578d3dc700 1 -- 172.21.15.43:0/799448041 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57881a1d90 con 0x7f5788075ba0 2024-04-25T13:35:25.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.621+0000 7f577ffff700 1 -- 172.21.15.43:0/799448041 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5780004850 con 0x7f5788075ba0 2024-04-25T13:35:25.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.621+0000 7f578d3dc700 1 -- 172.21.15.43:0/799448041 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f578819b800 con 0x7f5788075ba0 2024-04-25T13:35:25.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.622+0000 7f577ffff700 1 -- 172.21.15.43:0/799448041 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f5780027460 con 0x7f5788075ba0 2024-04-25T13:35:25.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.622+0000 7f578d3dc700 1 -- 172.21.15.43:0/799448041 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5788077110 con 0x7f5788075ba0 2024-04-25T13:35:25.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.622+0000 7f577ffff700 1 --2- 172.21.15.43:0/799448041 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f577403d670 0x7f577403fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:25.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.623+0000 7f577ffff700 1 -- 172.21.15.43:0/799448041 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f578000f050 con 0x7f5788075ba0 2024-04-25T13:35:25.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.623+0000 7f57867fc700 1 --2- 172.21.15.43:0/799448041 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f577403d670 0x7f577403fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:25.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.623+0000 7f57867fc700 1 --2- 172.21.15.43:0/799448041 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f577403d670 0x7f577403fb80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5770006fd0 tx=0x7f5770006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:25.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.628+0000 7f577ffff700 1 -- 172.21.15.43:0/799448041 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5780025c20 con 0x7f5788075ba0 2024-04-25T13:35:25.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:25.839+0000 7f578d3dc700 1 -- 172.21.15.43:0/799448041 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}) -- 0x7f578819cd10 con 0x7f577403d670 2024-04-25T13:35:27.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:27 smithi043 ceph-mon[29195]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:35:27.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:27 smithi043 ceph-mon[29195]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:27.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:27 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:27.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:27 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:27.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:27 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:27.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:27 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:27.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:27 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:35:27.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:27 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:35:27.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:27 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:35:27.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:27 smithi043 ceph-mon[29195]: Updating smithi161:/etc/ceph/ceph.conf 2024-04-25T13:35:27.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:27 smithi043 ceph-mon[29195]: Deploying cephadm binary to smithi175 2024-04-25T13:35:28.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:28 smithi043 ceph-mon[29195]: Updating smithi161:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:35:28.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:28 smithi043 ceph-mon[29195]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:35:28.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:28 smithi043 ceph-mon[29195]: Updating smithi161:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T13:35:29.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:29 smithi043 ceph-mon[29195]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:30.271 INFO:teuthology.orchestra.run.smithi043.stdout:Added host 'smithi175' with addr '172.21.15.175' 2024-04-25T13:35:30.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:30.270+0000 7f577ffff700 1 -- 172.21.15.43:0/799448041 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f578819cd10 con 0x7f577403d670 2024-04-25T13:35:30.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:30.273+0000 7f578d3dc700 1 -- 172.21.15.43:0/799448041 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f577403d670 msgr2=0x7f577403fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:30.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:30.273+0000 7f578d3dc700 1 --2- 172.21.15.43:0/799448041 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f577403d670 0x7f577403fb80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5770006fd0 tx=0x7f5770006e40 comp rx=0 tx=0).stop 2024-04-25T13:35:30.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:30.273+0000 7f578d3dc700 1 -- 172.21.15.43:0/799448041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5788075ba0 msgr2=0x7f57881a15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:30.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:30.273+0000 7f578d3dc700 1 --2- 172.21.15.43:0/799448041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5788075ba0 0x7f57881a15c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f57800062a0 tx=0x7f5780009810 comp rx=0 tx=0).stop 2024-04-25T13:35:30.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:30.273+0000 7f578d3dc700 1 -- 172.21.15.43:0/799448041 shutdown_connections 2024-04-25T13:35:30.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:30.273+0000 7f578d3dc700 1 --2- 172.21.15.43:0/799448041 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f577403d670 0x7f577403fb80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:30.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:30.273+0000 7f578d3dc700 1 --2- 172.21.15.43:0/799448041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5788075ba0 0x7f57881a15c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:30.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:30.273+0000 7f578d3dc700 1 -- 172.21.15.43:0/799448041 >> 172.21.15.43:0/799448041 conn(0x7f57880ff550 msgr2=0x7f578810c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:30.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:30.273+0000 7f578d3dc700 1 -- 172.21.15.43:0/799448041 shutdown_connections 2024-04-25T13:35:30.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:30.273+0000 7f578d3dc700 1 -- 172.21.15.43:0/799448041 wait complete. 2024-04-25T13:35:30.851 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-25T13:35:31.098 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:35:31.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:30 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:31.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:30 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:31.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:30 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:31.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:30 smithi043 ceph-mon[29195]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:31.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:30 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:31.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:30 smithi043 ceph-mon[29195]: Added host smithi175 2024-04-25T13:35:31.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:30 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:35:32.121 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:31 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:32.122 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:31 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:32.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.658+0000 7f50ae864700 1 -- 172.21.15.43:0/287504939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a8108930 msgr2=0x7f50a8108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:32.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.658+0000 7f50ae864700 1 --2- 172.21.15.43:0/287504939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a8108930 0x7f50a8108d40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5090009910 tx=0x7f5090009c20 comp rx=0 tx=0).stop 2024-04-25T13:35:32.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.658+0000 7f50ae864700 1 -- 172.21.15.43:0/287504939 shutdown_connections 2024-04-25T13:35:32.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.658+0000 7f50ae864700 1 --2- 172.21.15.43:0/287504939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a8108930 0x7f50a8108d40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:32.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.658+0000 7f50ae864700 1 -- 172.21.15.43:0/287504939 >> 172.21.15.43:0/287504939 conn(0x7f50a80fe440 msgr2=0x7f50a8100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:32.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.659+0000 7f50ae864700 1 -- 172.21.15.43:0/287504939 shutdown_connections 2024-04-25T13:35:32.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.659+0000 7f50ae864700 1 -- 172.21.15.43:0/287504939 wait complete. 2024-04-25T13:35:32.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.659+0000 7f50ae864700 1 Processor -- start 2024-04-25T13:35:32.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.659+0000 7f50ae864700 1 -- start start 2024-04-25T13:35:32.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.660+0000 7f50ae864700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a8108930 0x7f50a819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:32.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.660+0000 7f50ae864700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f50a810cd30 con 0x7f50a8108930 2024-04-25T13:35:32.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.660+0000 7f50a7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a8108930 0x7f50a819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:32.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.660+0000 7f50a7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a8108930 0x7f50a819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43040/0 (socket says 172.21.15.43:43040) 2024-04-25T13:35:32.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.660+0000 7f50a7fff700 1 -- 172.21.15.43:0/569749910 learned_addr learned my addr 172.21.15.43:0/569749910 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:32.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.660+0000 7f50a7fff700 1 -- 172.21.15.43:0/569749910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a806c940 con 0x7f50a8108930 2024-04-25T13:35:32.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.660+0000 7f50a7fff700 1 --2- 172.21.15.43:0/569749910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a8108930 0x7f50a819a5a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f50900092e0 tx=0x7f5090005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:32.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.660+0000 7f50a57fa700 1 -- 172.21.15.43:0/569749910 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5090026070 con 0x7f50a8108930 2024-04-25T13:35:32.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.660+0000 7f50a57fa700 1 -- 172.21.15.43:0/569749910 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f509000b750 con 0x7f50a8108930 2024-04-25T13:35:32.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.661+0000 7f50ae864700 1 -- 172.21.15.43:0/569749910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a819aba0 con 0x7f50a8108930 2024-04-25T13:35:32.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.661+0000 7f50a57fa700 1 -- 172.21.15.43:0/569749910 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5090003810 con 0x7f50a8108930 2024-04-25T13:35:32.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.661+0000 7f50ae864700 1 -- 172.21.15.43:0/569749910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a819b060 con 0x7f50a8108930 2024-04-25T13:35:32.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.662+0000 7f50a57fa700 1 -- 172.21.15.43:0/569749910 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f5090029070 con 0x7f50a8108930 2024-04-25T13:35:32.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.662+0000 7f50ae864700 1 -- 172.21.15.43:0/569749910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50a819b3a0 con 0x7f50a8108930 2024-04-25T13:35:32.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.662+0000 7f50a57fa700 1 --2- 172.21.15.43:0/569749910 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f509403d610 0x7f509403fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:32.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.662+0000 7f50a57fa700 1 -- 172.21.15.43:0/569749910 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f509001e070 con 0x7f50a8108930 2024-04-25T13:35:32.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.662+0000 7f50a77fe700 1 --2- 172.21.15.43:0/569749910 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f509403d610 0x7f509403fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:32.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.662+0000 7f50a77fe700 1 --2- 172.21.15.43:0/569749910 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f509403d610 0x7f509403fb20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5098006fd0 tx=0x7f5098006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:32.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.667+0000 7f50a57fa700 1 -- 172.21.15.43:0/569749910 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f50a806c940 con 0x7f50a8108930 2024-04-25T13:35:32.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.885+0000 7f50ae864700 1 -- 172.21.15.43:0/569749910 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50a806c020 con 0x7f509403d610 2024-04-25T13:35:32.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.887+0000 7f50a57fa700 1 -- 172.21.15.43:0/569749910 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f50a806c020 con 0x7f509403d610 2024-04-25T13:35:32.887 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:35:32.887 INFO:teuthology.orchestra.run.smithi043.stdout:[{"addr": "172.21.15.43", "hostname": "smithi043", "labels": [], "status": ""}, {"addr": "172.21.15.161", "hostname": "smithi161", "labels": [], "status": ""}, {"addr": "172.21.15.175", "hostname": "smithi175", "labels": [], "status": ""}] 2024-04-25T13:35:32.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.889+0000 7f50ae864700 1 -- 172.21.15.43:0/569749910 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f509403d610 msgr2=0x7f509403fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:32.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.889+0000 7f50ae864700 1 --2- 172.21.15.43:0/569749910 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f509403d610 0x7f509403fb20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5098006fd0 tx=0x7f5098006e40 comp rx=0 tx=0).stop 2024-04-25T13:35:32.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.889+0000 7f50ae864700 1 -- 172.21.15.43:0/569749910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a8108930 msgr2=0x7f50a819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:32.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.889+0000 7f50ae864700 1 --2- 172.21.15.43:0/569749910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a8108930 0x7f50a819a5a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f50900092e0 tx=0x7f5090005710 comp rx=0 tx=0).stop 2024-04-25T13:35:32.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.889+0000 7f50ae864700 1 -- 172.21.15.43:0/569749910 shutdown_connections 2024-04-25T13:35:32.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.889+0000 7f50ae864700 1 --2- 172.21.15.43:0/569749910 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f509403d610 0x7f509403fb20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:32.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.889+0000 7f50ae864700 1 --2- 172.21.15.43:0/569749910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a8108930 0x7f50a819a5a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:32.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.889+0000 7f50ae864700 1 -- 172.21.15.43:0/569749910 >> 172.21.15.43:0/569749910 conn(0x7f50a80fe440 msgr2=0x7f50a8100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:32.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.889+0000 7f50ae864700 1 -- 172.21.15.43:0/569749910 shutdown_connections 2024-04-25T13:35:32.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:32.889+0000 7f50ae864700 1 -- 172.21.15.43:0/569749910 wait complete. 2024-04-25T13:35:32.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:32 smithi043 ceph-mon[29195]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:33.414 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-25T13:35:33.415 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-25T13:35:33.655 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:35:34.031 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:34.031 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:33 smithi043 ceph-mon[29195]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T13:35:34.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:34 smithi043 ceph-mon[29195]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:35.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.043+0000 7efdfa8d3700 1 -- 172.21.15.43:0/3591049618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdf4109a60 msgr2=0x7efdf4109e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:35.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.043+0000 7efdfa8d3700 1 --2- 172.21.15.43:0/3591049618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdf4109a60 0x7efdf4109e70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efde4009910 tx=0x7efde4009c20 comp rx=0 tx=0).stop 2024-04-25T13:35:35.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.043+0000 7efdfa8d3700 1 -- 172.21.15.43:0/3591049618 shutdown_connections 2024-04-25T13:35:35.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.043+0000 7efdfa8d3700 1 --2- 172.21.15.43:0/3591049618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdf4109a60 0x7efdf4109e70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:35.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.043+0000 7efdfa8d3700 1 -- 172.21.15.43:0/3591049618 >> 172.21.15.43:0/3591049618 conn(0x7efdf40ff570 msgr2=0x7efdf41019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:35.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.043+0000 7efdfa8d3700 1 -- 172.21.15.43:0/3591049618 shutdown_connections 2024-04-25T13:35:35.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.043+0000 7efdfa8d3700 1 -- 172.21.15.43:0/3591049618 wait complete. 2024-04-25T13:35:35.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.044+0000 7efdfa8d3700 1 Processor -- start 2024-04-25T13:35:35.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.044+0000 7efdfa8d3700 1 -- start start 2024-04-25T13:35:35.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.044+0000 7efdfa8d3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdf4109a60 0x7efdf4075990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:35.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.044+0000 7efdfa8d3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efdf410de60 con 0x7efdf4109a60 2024-04-25T13:35:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.044+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdf4109a60 0x7efdf4075990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.044+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdf4109a60 0x7efdf4075990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43058/0 (socket says 172.21.15.43:43058) 2024-04-25T13:35:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.044+0000 7efdf3fff700 1 -- 172.21.15.43:0/4292129920 learned_addr learned my addr 172.21.15.43:0/4292129920 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:35:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.045+0000 7efdf3fff700 1 -- 172.21.15.43:0/4292129920 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf40777e0 con 0x7efdf4109a60 2024-04-25T13:35:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.045+0000 7efdf3fff700 1 --2- 172.21.15.43:0/4292129920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdf4109a60 0x7efdf4075990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efde40092e0 tx=0x7efde4005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.045+0000 7efdf17fa700 1 -- 172.21.15.43:0/4292129920 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efde4026070 con 0x7efdf4109a60 2024-04-25T13:35:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.045+0000 7efdf17fa700 1 -- 172.21.15.43:0/4292129920 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efde400b6f0 con 0x7efdf4109a60 2024-04-25T13:35:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.045+0000 7efdf17fa700 1 -- 172.21.15.43:0/4292129920 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efde4003810 con 0x7efdf4109a60 2024-04-25T13:35:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.045+0000 7efdfa8d3700 1 -- 172.21.15.43:0/4292129920 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf4075ed0 con 0x7efdf4109a60 2024-04-25T13:35:35.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.045+0000 7efdfa8d3700 1 -- 172.21.15.43:0/4292129920 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf4076390 con 0x7efdf4109a60 2024-04-25T13:35:35.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.046+0000 7efdf17fa700 1 -- 172.21.15.43:0/4292129920 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7efde4029070 con 0x7efdf4109a60 2024-04-25T13:35:35.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.046+0000 7efdfa8d3700 1 -- 172.21.15.43:0/4292129920 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf4105170 con 0x7efdf4109a60 2024-04-25T13:35:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.046+0000 7efdf17fa700 1 --2- 172.21.15.43:0/4292129920 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efde003d670 0x7efde003fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.046+0000 7efdf17fa700 1 -- 172.21.15.43:0/4292129920 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efde401e070 con 0x7efdf4109a60 2024-04-25T13:35:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.047+0000 7efdf37fe700 1 --2- 172.21.15.43:0/4292129920 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efde003d670 0x7efde003fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.047+0000 7efdf37fe700 1 --2- 172.21.15.43:0/4292129920 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efde003d670 0x7efde003fb80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efddc006fd0 tx=0x7efddc006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:35.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.052+0000 7efdf17fa700 1 -- 172.21.15.43:0/4292129920 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efde4013070 con 0x7efdf4109a60 2024-04-25T13:35:35.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.266+0000 7efdfa8d3700 1 -- 172.21.15.43:0/4292129920 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7efdf4076ef0 con 0x7efdf4109a60 2024-04-25T13:35:35.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.860+0000 7efdf17fa700 1 -- 172.21.15.43:0/4292129920 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7efde4029e30 con 0x7efdf4109a60 2024-04-25T13:35:35.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.863+0000 7efdfa8d3700 1 -- 172.21.15.43:0/4292129920 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efde003d670 msgr2=0x7efde003fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:35.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.863+0000 7efdfa8d3700 1 --2- 172.21.15.43:0/4292129920 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efde003d670 0x7efde003fb80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efddc006fd0 tx=0x7efddc006e40 comp rx=0 tx=0).stop 2024-04-25T13:35:35.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.863+0000 7efdfa8d3700 1 -- 172.21.15.43:0/4292129920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdf4109a60 msgr2=0x7efdf4075990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:35.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.863+0000 7efdfa8d3700 1 --2- 172.21.15.43:0/4292129920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdf4109a60 0x7efdf4075990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efde40092e0 tx=0x7efde4005710 comp rx=0 tx=0).stop 2024-04-25T13:35:35.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.863+0000 7efdfa8d3700 1 -- 172.21.15.43:0/4292129920 shutdown_connections 2024-04-25T13:35:35.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.863+0000 7efdfa8d3700 1 --2- 172.21.15.43:0/4292129920 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efde003d670 0x7efde003fb80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:35.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.863+0000 7efdfa8d3700 1 --2- 172.21.15.43:0/4292129920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdf4109a60 0x7efdf4075990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:35.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.863+0000 7efdfa8d3700 1 -- 172.21.15.43:0/4292129920 >> 172.21.15.43:0/4292129920 conn(0x7efdf40ff570 msgr2=0x7efdf4101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:35.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.863+0000 7efdfa8d3700 1 -- 172.21.15.43:0/4292129920 shutdown_connections 2024-04-25T13:35:35.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:35:35.863+0000 7efdfa8d3700 1 -- 172.21.15.43:0/4292129920 wait complete. 2024-04-25T13:35:35.865 INFO:teuthology.orchestra.run.smithi043.stderr:adjusted tunables profile to default 2024-04-25T13:35:36.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:35 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/4292129920' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-25T13:35:36.582 INFO:tasks.cephadm:Adding mon.a on smithi043 2024-04-25T13:35:36.582 INFO:tasks.cephadm:Adding mon.b on smithi161 2024-04-25T13:35:36.583 INFO:tasks.cephadm:Adding mon.c on smithi175 2024-04-25T13:35:36.583 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch apply mon '3;smithi043:172.21.15.43=a;smithi161:172.21.15.161=b;smithi175:172.21.15.175=c' 2024-04-25T13:35:36.815 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:35:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/4292129920' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-25T13:35:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T13:35:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:37.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:37.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:37.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:35:37.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:35:37.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:35:37.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: Updating smithi175:/etc/ceph/ceph.conf 2024-04-25T13:35:37.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: Updating smithi175:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:35:37.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:35:37.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: Updating smithi175:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T13:35:37.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:37.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:37.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:38.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.269+0000 7fe6594b4700 1 -- 172.21.15.175:0/344959183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe654108930 msgr2=0x7fe654108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:38.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.269+0000 7fe6594b4700 1 --2- 172.21.15.175:0/344959183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe654108930 0x7fe654108d40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe648009910 tx=0x7fe648009c20 comp rx=0 tx=0).stop 2024-04-25T13:35:38.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.269+0000 7fe6594b4700 1 -- 172.21.15.175:0/344959183 shutdown_connections 2024-04-25T13:35:38.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.269+0000 7fe6594b4700 1 --2- 172.21.15.175:0/344959183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe654108930 0x7fe654108d40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:38.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.269+0000 7fe6594b4700 1 -- 172.21.15.175:0/344959183 >> 172.21.15.175:0/344959183 conn(0x7fe6540fe480 msgr2=0x7fe6541008d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:38.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.269+0000 7fe6594b4700 1 -- 172.21.15.175:0/344959183 shutdown_connections 2024-04-25T13:35:38.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.269+0000 7fe6594b4700 1 -- 172.21.15.175:0/344959183 wait complete. 2024-04-25T13:35:38.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.270+0000 7fe6594b4700 1 Processor -- start 2024-04-25T13:35:38.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.270+0000 7fe6594b4700 1 -- start start 2024-04-25T13:35:38.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.270+0000 7fe6594b4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe654108930 0x7fe65419f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:38.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.270+0000 7fe6594b4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe65410cd30 con 0x7fe654108930 2024-04-25T13:35:38.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.271+0000 7fe652ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe654108930 0x7fe65419f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:38.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.271+0000 7fe652ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe654108930 0x7fe65419f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.175:37776/0 (socket says 172.21.15.175:37776) 2024-04-25T13:35:38.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.271+0000 7fe652ffd700 1 -- 172.21.15.175:0/2225600346 learned_addr learned my addr 172.21.15.175:0/2225600346 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T13:35:38.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.271+0000 7fe652ffd700 1 -- 172.21.15.175:0/2225600346 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65419f9c0 con 0x7fe654108930 2024-04-25T13:35:38.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.271+0000 7fe652ffd700 1 --2- 172.21.15.175:0/2225600346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe654108930 0x7fe65419f480 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6480092e0 tx=0x7fe648005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:38.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.272+0000 7fe63bfff700 1 -- 172.21.15.175:0/2225600346 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe648026070 con 0x7fe654108930 2024-04-25T13:35:38.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.272+0000 7fe63bfff700 1 -- 172.21.15.175:0/2225600346 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe64800b6f0 con 0x7fe654108930 2024-04-25T13:35:38.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.272+0000 7fe6594b4700 1 -- 172.21.15.175:0/2225600346 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe65419fcb0 con 0x7fe654108930 2024-04-25T13:35:38.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.272+0000 7fe63bfff700 1 -- 172.21.15.175:0/2225600346 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6480036c0 con 0x7fe654108930 2024-04-25T13:35:38.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.272+0000 7fe6594b4700 1 -- 172.21.15.175:0/2225600346 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe654199660 con 0x7fe654108930 2024-04-25T13:35:38.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.273+0000 7fe6594b4700 1 -- 172.21.15.175:0/2225600346 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe654104040 con 0x7fe654108930 2024-04-25T13:35:38.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.273+0000 7fe63bfff700 1 -- 172.21.15.175:0/2225600346 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7fe648029070 con 0x7fe654108930 2024-04-25T13:35:38.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.273+0000 7fe63bfff700 1 --2- 172.21.15.175:0/2225600346 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe63c03d610 0x7fe63c03fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:38.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.273+0000 7fe63bfff700 1 -- 172.21.15.175:0/2225600346 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe64801e070 con 0x7fe654108930 2024-04-25T13:35:38.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.273+0000 7fe6527fc700 1 --2- 172.21.15.175:0/2225600346 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe63c03d610 0x7fe63c03fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:38.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.274+0000 7fe6527fc700 1 --2- 172.21.15.175:0/2225600346 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe63c03d610 0x7fe63c03fb20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe644006fd0 tx=0x7fe644006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:38.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.279+0000 7fe63bfff700 1 -- 172.21.15.175:0/2225600346 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe648013070 con 0x7fe654108930 2024-04-25T13:35:38.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.486+0000 7fe6594b4700 1 -- 172.21.15.175:0/2225600346 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi043:172.21.15.43=a;smithi161:172.21.15.161=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}) -- 0x7fe65419ab70 con 0x7fe63c03d610 2024-04-25T13:35:38.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.493+0000 7fe63bfff700 1 -- 172.21.15.175:0/2225600346 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe65419ab70 con 0x7fe63c03d610 2024-04-25T13:35:38.494 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mon update... 2024-04-25T13:35:38.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.495+0000 7fe6594b4700 1 -- 172.21.15.175:0/2225600346 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe63c03d610 msgr2=0x7fe63c03fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:38.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.495+0000 7fe6594b4700 1 --2- 172.21.15.175:0/2225600346 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe63c03d610 0x7fe63c03fb20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe644006fd0 tx=0x7fe644006e40 comp rx=0 tx=0).stop 2024-04-25T13:35:38.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.495+0000 7fe6594b4700 1 -- 172.21.15.175:0/2225600346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe654108930 msgr2=0x7fe65419f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:38.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.495+0000 7fe6594b4700 1 --2- 172.21.15.175:0/2225600346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe654108930 0x7fe65419f480 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6480092e0 tx=0x7fe648005710 comp rx=0 tx=0).stop 2024-04-25T13:35:38.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.495+0000 7fe6594b4700 1 -- 172.21.15.175:0/2225600346 shutdown_connections 2024-04-25T13:35:38.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.495+0000 7fe6594b4700 1 --2- 172.21.15.175:0/2225600346 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe63c03d610 0x7fe63c03fb20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:38.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.495+0000 7fe6594b4700 1 --2- 172.21.15.175:0/2225600346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe654108930 0x7fe65419f480 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:38.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.495+0000 7fe6594b4700 1 -- 172.21.15.175:0/2225600346 >> 172.21.15.175:0/2225600346 conn(0x7fe6540fe480 msgr2=0x7fe654106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:38.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.495+0000 7fe6594b4700 1 -- 172.21.15.175:0/2225600346 shutdown_connections 2024-04-25T13:35:38.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:38.496+0000 7fe6594b4700 1 -- 172.21.15.175:0/2225600346 wait complete. 2024-04-25T13:35:39.106 DEBUG:teuthology.orchestra.run.smithi161:mon.b> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mon.b.service 2024-04-25T13:35:39.109 DEBUG:teuthology.orchestra.run.smithi175:mon.c> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mon.c.service 2024-04-25T13:35:39.111 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-25T13:35:39.111 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T13:35:39.891 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:35:39.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:39 smithi043 ceph-mon[29195]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:39.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:39 smithi043 ceph-mon[29195]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi043:172.21.15.43=a;smithi161:172.21.15.161=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:35:39.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:39 smithi043 ceph-mon[29195]: Saving service mon spec with placement smithi043:172.21.15.43=a;smithi161:172.21.15.161=b;smithi175:172.21.15.175=c;count:3 2024-04-25T13:35:39.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:39 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:39.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:39 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:35:39.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:39 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:35:39.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:39 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:35:39.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:39 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:39.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:39 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T13:35:39.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:39 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:35:39.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:39 smithi043 ceph-mon[29195]: Deploying daemon mon.c on smithi175 2024-04-25T13:35:41.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:41 smithi043 ceph-mon[29195]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:42.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.725+0000 7f6eca102700 1 -- 172.21.15.175:0/3343136504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ec4109a40 msgr2=0x7f6ec4109e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:42.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.725+0000 7f6eca102700 1 --2- 172.21.15.175:0/3343136504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ec4109a40 0x7f6ec4109e50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009910 tx=0x7f6eb4009c20 comp rx=0 tx=0).stop 2024-04-25T13:35:42.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.725+0000 7f6eca102700 1 -- 172.21.15.175:0/3343136504 shutdown_connections 2024-04-25T13:35:42.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.725+0000 7f6eca102700 1 --2- 172.21.15.175:0/3343136504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ec4109a40 0x7f6ec4109e50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:42.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.725+0000 7f6eca102700 1 -- 172.21.15.175:0/3343136504 >> 172.21.15.175:0/3343136504 conn(0x7f6ec40ff530 msgr2=0x7f6ec4101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:42.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.725+0000 7f6eca102700 1 -- 172.21.15.175:0/3343136504 shutdown_connections 2024-04-25T13:35:42.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.725+0000 7f6eca102700 1 -- 172.21.15.175:0/3343136504 wait complete. 2024-04-25T13:35:42.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.725+0000 7f6eca102700 1 Processor -- start 2024-04-25T13:35:42.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.726+0000 7f6eca102700 1 -- start start 2024-04-25T13:35:42.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.726+0000 7f6eca102700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ec4109a40 0x7f6ec41a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:42.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.726+0000 7f6eca102700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec410de40 con 0x7f6ec4109a40 2024-04-25T13:35:42.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.726+0000 7f6ec37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ec4109a40 0x7f6ec41a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:42.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.726+0000 7f6ec37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ec4109a40 0x7f6ec41a48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.175:47656/0 (socket says 172.21.15.175:47656) 2024-04-25T13:35:42.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.726+0000 7f6ec37fe700 1 -- 172.21.15.175:0/4107743574 learned_addr learned my addr 172.21.15.175:0/4107743574 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T13:35:42.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.727+0000 7f6ec37fe700 1 -- 172.21.15.175:0/4107743574 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec41a4e20 con 0x7f6ec4109a40 2024-04-25T13:35:42.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.727+0000 7f6ec37fe700 1 --2- 172.21.15.175:0/4107743574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ec4109a40 0x7f6ec41a48e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4005660 tx=0x7f6eb4005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:42.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.727+0000 7f6ec0ff9700 1 -- 172.21.15.175:0/4107743574 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eb4026070 con 0x7f6ec4109a40 2024-04-25T13:35:42.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.727+0000 7f6eca102700 1 -- 172.21.15.175:0/4107743574 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec41a5110 con 0x7f6ec4109a40 2024-04-25T13:35:42.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.727+0000 7f6ec0ff9700 1 -- 172.21.15.175:0/4107743574 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6eb400b6f0 con 0x7f6ec4109a40 2024-04-25T13:35:42.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.727+0000 7f6ec0ff9700 1 -- 172.21.15.175:0/4107743574 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eb40037d0 con 0x7f6ec4109a40 2024-04-25T13:35:42.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.727+0000 7f6eca102700 1 -- 172.21.15.175:0/4107743574 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec419fef0 con 0x7f6ec4109a40 2024-04-25T13:35:42.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.728+0000 7f6eca102700 1 -- 172.21.15.175:0/4107743574 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec4105150 con 0x7f6ec4109a40 2024-04-25T13:35:42.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.728+0000 7f6ec0ff9700 1 -- 172.21.15.175:0/4107743574 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f6eb4029070 con 0x7f6ec4109a40 2024-04-25T13:35:42.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.729+0000 7f6ec0ff9700 1 --2- 172.21.15.175:0/4107743574 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6eac03d670 0x7f6eac03fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:42.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.729+0000 7f6ec0ff9700 1 -- 172.21.15.175:0/4107743574 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6eb401e070 con 0x7f6ec4109a40 2024-04-25T13:35:42.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.729+0000 7f6ec2ffd700 1 --2- 172.21.15.175:0/4107743574 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6eac03d670 0x7f6eac03fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:42.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.730+0000 7f6ec2ffd700 1 --2- 172.21.15.175:0/4107743574 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6eac03d670 0x7f6eac03fb80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8006fd0 tx=0x7f6eb8006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:42.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:42.735+0000 7f6ec0ff9700 1 -- 172.21.15.175:0/4107743574 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6eb4013070 con 0x7f6ec4109a40 2024-04-25T13:35:43.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:43.045+0000 7f6eca102700 1 -- 172.21.15.175:0/4107743574 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f6ec41a10b0 con 0x7f6ec4109a40 2024-04-25T13:35:43.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:43.046+0000 7f6ec0ff9700 1 -- 172.21.15.175:0/4107743574 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f6eb404ae20 con 0x7f6ec4109a40 2024-04-25T13:35:43.047 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:35:43.047 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":1,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","modified":"2024-04-25T13:33:54.073201Z","created":"2024-04-25T13:33:54.073201Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T13:35:43.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:43.048+0000 7f6eca102700 1 -- 172.21.15.175:0/4107743574 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6eac03d670 msgr2=0x7f6eac03fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:43.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:43.048+0000 7f6eca102700 1 --2- 172.21.15.175:0/4107743574 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6eac03d670 0x7f6eac03fb80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8006fd0 tx=0x7f6eb8006e40 comp rx=0 tx=0).stop 2024-04-25T13:35:43.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:43.048+0000 7f6eca102700 1 -- 172.21.15.175:0/4107743574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ec4109a40 msgr2=0x7f6ec41a48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:43.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:43.048+0000 7f6eca102700 1 --2- 172.21.15.175:0/4107743574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ec4109a40 0x7f6ec41a48e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4005660 tx=0x7f6eb4005740 comp rx=0 tx=0).stop 2024-04-25T13:35:43.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:43.048+0000 7f6eca102700 1 -- 172.21.15.175:0/4107743574 shutdown_connections 2024-04-25T13:35:43.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:43.048+0000 7f6eca102700 1 --2- 172.21.15.175:0/4107743574 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6eac03d670 0x7f6eac03fb80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:43.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:43.048+0000 7f6eca102700 1 --2- 172.21.15.175:0/4107743574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ec4109a40 0x7f6ec41a48e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:43.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:43.048+0000 7f6eca102700 1 -- 172.21.15.175:0/4107743574 >> 172.21.15.175:0/4107743574 conn(0x7f6ec40ff530 msgr2=0x7f6ec41004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:43.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:43.048+0000 7f6eca102700 1 -- 172.21.15.175:0/4107743574 shutdown_connections 2024-04-25T13:35:43.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:43.048+0000 7f6eca102700 1 -- 172.21.15.175:0/4107743574 wait complete. 2024-04-25T13:35:43.051 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 1 2024-04-25T13:35:43.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 podman[32617]: 2024-04-25 13:35:43.153608558 +0000 UTC m=+0.339758890 container start e114fb4bd2be29ad39d25d28fcb771addedadee2d7f9de21dbd0caf2c5af68d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-c, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-25T13:35:43.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T13:35:43.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev), process ceph-mon, pid 2 2024-04-25T13:35:43.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: pidfile_write: ignore empty --pid-file 2024-04-25T13:35:43.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: load: jerasure load: lrc 2024-04-25T13:35:43.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: RocksDB version: 7.9.2 2024-04-25T13:35:43.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Git sha 0 2024-04-25T13:35:43.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Compile date 2024-04-25 02:57:34 2024-04-25T13:35:43.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: DB SUMMARY 2024-04-25T13:35:43.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: DB Session ID: MTPUACPJC6OZ3I72ZUQK 2024-04-25T13:35:43.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: CURRENT file: CURRENT 2024-04-25T13:35:43.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T13:35:43.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-25T13:35:43.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-04-25T13:35:43.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-04-25T13:35:43.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.error_if_exists: 0 2024-04-25T13:35:43.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.create_if_missing: 0 2024-04-25T13:35:43.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.paranoid_checks: 1 2024-04-25T13:35:43.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-25T13:35:43.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T13:35:43.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-25T13:35:43.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.env: 0x556c16c28500 2024-04-25T13:35:43.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.fs: PosixFileSystem 2024-04-25T13:35:43.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.info_log: 0x556c1901ffc0 2024-04-25T13:35:43.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T13:35:43.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.statistics: (nil) 2024-04-25T13:35:43.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.use_fsync: 0 2024-04-25T13:35:43.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_log_file_size: 0 2024-04-25T13:35:43.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T13:35:43.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T13:35:43.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T13:35:43.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T13:35:43.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.allow_fallocate: 1 2024-04-25T13:35:43.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T13:35:43.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T13:35:43.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.use_direct_reads: 0 2024-04-25T13:35:43.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T13:35:43.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T13:35:43.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.db_log_dir: 2024-04-25T13:35:43.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.wal_dir: 2024-04-25T13:35:43.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T13:35:43.686 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T13:35:43.686 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T13:35:43.686 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T13:35:43.686 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T13:35:43.686 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T13:35:43.686 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T13:35:43.686 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T13:35:43.686 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.write_buffer_manager: 0x556c18ff08c0 2024-04-25T13:35:43.687 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T13:35:43.687 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T13:35:43.687 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T13:35:43.687 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T13:35:43.687 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T13:35:43.687 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T13:35:43.687 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T13:35:43.687 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T13:35:43.687 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.unordered_write: 0 2024-04-25T13:35:43.687 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T13:35:43.687 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T13:35:43.687 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T13:35:43.687 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T13:35:43.688 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.row_cache: None 2024-04-25T13:35:43.688 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.wal_filter: None 2024-04-25T13:35:43.688 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T13:35:43.688 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T13:35:43.688 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.two_write_queues: 0 2024-04-25T13:35:43.688 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T13:35:43.688 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.wal_compression: 0 2024-04-25T13:35:43.688 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.atomic_flush: 0 2024-04-25T13:35:43.688 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T13:35:43.688 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T13:35:43.688 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T13:35:43.688 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.log_readahead_size: 0 2024-04-25T13:35:43.688 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T13:35:43.688 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T13:35:43.689 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T13:35:43.689 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T13:35:43.689 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T13:35:43.689 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T13:35:43.689 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-25T13:35:43.689 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_background_jobs: 2 2024-04-25T13:35:43.689 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_background_compactions: -1 2024-04-25T13:35:43.689 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_subcompactions: 1 2024-04-25T13:35:43.689 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T13:35:43.689 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T13:35:43.689 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T13:35:43.689 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T13:35:43.689 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T13:35:43.690 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T13:35:43.690 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T13:35:43.690 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T13:35:43.690 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_open_files: -1 2024-04-25T13:35:43.690 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T13:35:43.690 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T13:35:43.690 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T13:35:43.690 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T13:35:43.690 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_background_flushes: -1 2024-04-25T13:35:43.690 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Compression algorithms supported: 2024-04-25T13:35:43.690 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T13:35:43.690 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: kZSTD supported: 0 2024-04-25T13:35:43.690 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: kXpressCompression supported: 0 2024-04-25T13:35:43.690 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T13:35:43.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: kZlibCompression supported: 1 2024-04-25T13:35:43.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: kSnappyCompression supported: 1 2024-04-25T13:35:43.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: kLZ4Compression supported: 1 2024-04-25T13:35:43.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: kBZip2Compression supported: 0 2024-04-25T13:35:43.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T13:35:43.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-25T13:35:43.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-04-25T13:35:43.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-25T13:35:43.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T13:35:43.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.merge_operator: 2024-04-25T13:35:43.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compaction_filter: None 2024-04-25T13:35:43.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T13:35:43.691 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T13:35:43.692 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T13:35:43.692 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T13:35:43.692 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556c191261a0) 2024-04-25T13:35:43.692 INFO:journalctl@ceph.mon.c.smithi175.stdout: cache_index_and_filter_blocks: 1 2024-04-25T13:35:43.692 INFO:journalctl@ceph.mon.c.smithi175.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T13:35:43.692 INFO:journalctl@ceph.mon.c.smithi175.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T13:35:43.692 INFO:journalctl@ceph.mon.c.smithi175.stdout: pin_top_level_index_and_filter: 1 2024-04-25T13:35:43.692 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_type: 0 2024-04-25T13:35:43.692 INFO:journalctl@ceph.mon.c.smithi175.stdout: data_block_index_type: 0 2024-04-25T13:35:43.692 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_shortening: 1 2024-04-25T13:35:43.692 INFO:journalctl@ceph.mon.c.smithi175.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T13:35:43.692 INFO:journalctl@ceph.mon.c.smithi175.stdout: checksum: 4 2024-04-25T13:35:43.692 INFO:journalctl@ceph.mon.c.smithi175.stdout: no_block_cache: 0 2024-04-25T13:35:43.692 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache: 0x556c190231f0 2024-04-25T13:35:43.693 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_name: BinnedLRUCache 2024-04-25T13:35:43.693 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_options: 2024-04-25T13:35:43.693 INFO:journalctl@ceph.mon.c.smithi175.stdout: capacity : 536870912 2024-04-25T13:35:43.693 INFO:journalctl@ceph.mon.c.smithi175.stdout: num_shard_bits : 4 2024-04-25T13:35:43.693 INFO:journalctl@ceph.mon.c.smithi175.stdout: strict_capacity_limit : 0 2024-04-25T13:35:43.693 INFO:journalctl@ceph.mon.c.smithi175.stdout: high_pri_pool_ratio: 0.000 2024-04-25T13:35:43.693 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_compressed: (nil) 2024-04-25T13:35:43.693 INFO:journalctl@ceph.mon.c.smithi175.stdout: persistent_cache: (nil) 2024-04-25T13:35:43.693 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_size: 4096 2024-04-25T13:35:43.693 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_size_deviation: 10 2024-04-25T13:35:43.693 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_restart_interval: 16 2024-04-25T13:35:43.693 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_block_restart_interval: 1 2024-04-25T13:35:43.693 INFO:journalctl@ceph.mon.c.smithi175.stdout: metadata_block_size: 4096 2024-04-25T13:35:43.693 INFO:journalctl@ceph.mon.c.smithi175.stdout: partition_filters: 0 2024-04-25T13:35:43.694 INFO:journalctl@ceph.mon.c.smithi175.stdout: use_delta_encoding: 1 2024-04-25T13:35:43.694 INFO:journalctl@ceph.mon.c.smithi175.stdout: filter_policy: bloomfilter 2024-04-25T13:35:43.694 INFO:journalctl@ceph.mon.c.smithi175.stdout: whole_key_filtering: 1 2024-04-25T13:35:43.694 INFO:journalctl@ceph.mon.c.smithi175.stdout: verify_compression: 0 2024-04-25T13:35:43.694 INFO:journalctl@ceph.mon.c.smithi175.stdout: read_amp_bytes_per_bit: 0 2024-04-25T13:35:43.694 INFO:journalctl@ceph.mon.c.smithi175.stdout: format_version: 5 2024-04-25T13:35:43.694 INFO:journalctl@ceph.mon.c.smithi175.stdout: enable_index_compression: 1 2024-04-25T13:35:43.694 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_align: 0 2024-04-25T13:35:43.694 INFO:journalctl@ceph.mon.c.smithi175.stdout: max_auto_readahead_size: 262144 2024-04-25T13:35:43.694 INFO:journalctl@ceph.mon.c.smithi175.stdout: prepopulate_block_cache: 0 2024-04-25T13:35:43.694 INFO:journalctl@ceph.mon.c.smithi175.stdout: initial_auto_readahead_size: 8192 2024-04-25T13:35:43.694 INFO:journalctl@ceph.mon.c.smithi175.stdout: num_file_reads_for_auto_readahead: 2 2024-04-25T13:35:43.694 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T13:35:43.694 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T13:35:43.695 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compression: NoCompression 2024-04-25T13:35:43.695 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T13:35:43.695 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T13:35:43.695 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T13:35:43.695 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.num_levels: 7 2024-04-25T13:35:43.695 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T13:35:43.695 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T13:35:43.695 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T13:35:43.695 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T13:35:43.695 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T13:35:43.695 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T13:35:43.695 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T13:35:43.695 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T13:35:43.695 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T13:35:43.696 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T13:35:43.696 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-25T13:35:43.696 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-25T13:35:43.696 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T13:35:43.696 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T13:35:43.696 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T13:35:43.696 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T13:35:43.696 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T13:35:43.696 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-25T13:35:43.696 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T13:35:43.696 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T13:35:43.696 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-25T13:35:43.696 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T13:35:43.696 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T13:35:43.697 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T13:35:43.697 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T13:35:43.697 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T13:35:43.697 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T13:35:43.697 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T13:35:43.697 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T13:35:43.697 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T13:35:43.697 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T13:35:43.697 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T13:35:43.697 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T13:35:43.697 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T13:35:43.697 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T13:35:43.697 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T13:35:43.697 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T13:35:43.698 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T13:35:43.698 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-25T13:35:43.698 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.arena_block_size: 1048576 2024-04-25T13:35:43.698 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T13:35:43.698 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T13:35:43.698 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T13:35:43.698 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T13:35:43.698 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T13:35:43.698 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T13:35:43.698 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T13:35:43.698 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T13:35:43.699 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T13:35:43.699 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T13:35:43.699 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T13:35:43.699 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T13:35:43.699 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T13:35:43.699 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-25T13:35:43.699 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.inplace_update_support: 0 2024-04-25T13:35:43.699 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T13:35:43.699 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T13:35:43.699 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T13:35:43.699 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T13:35:43.699 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.bloom_locality: 0 2024-04-25T13:35:43.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.max_successive_merges: 0 2024-04-25T13:35:43.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T13:35:43.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T13:35:43.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T13:35:43.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T13:35:43.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.ttl: 2592000 2024-04-25T13:35:43.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T13:35:43.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-25T13:35:43.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-25T13:35:43.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.enable_blob_files: false 2024-04-25T13:35:43.701 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.min_blob_size: 0 2024-04-25T13:35:43.701 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T13:35:43.701 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T13:35:43.702 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T13:35:43.702 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T13:35:43.702 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-25T13:35:43.702 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-25T13:35:43.702 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.blob_file_starting_level: 0 2024-04-25T13:35:43.702 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-25T13:35:43.702 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-25T13:35:43.702 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-25T13:35:43.702 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 28412fc6-53d2-4ca5-9ccf-d9b2d6dff2fe 2024-04-25T13:35:43.702 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714052143194226, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-25T13:35:43.702 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-25T13:35:43.702 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714052143194658, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714052143, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "28412fc6-53d2-4ca5-9ccf-d9b2d6dff2fe", "db_session_id": "MTPUACPJC6OZ3I72ZUQK", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-25T13:35:43.703 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714052143194739, "job": 1, "event": "recovery_finished"} 2024-04-25T13:35:43.703 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-25T13:35:43.703 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T13:35:43.703 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556c19007c00 2024-04-25T13:35:43.703 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: DB pointer 0x556c1ddfa000 2024-04-25T13:35:43.703 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-25T13:35:43.703 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-25T13:35:43.703 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** DB Stats ** 2024-04-25T13:35:43.703 INFO:journalctl@ceph.mon.c.smithi175.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T13:35:43.703 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T13:35:43.703 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T13:35:43.703 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T13:35:43.703 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T13:35:43.703 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T13:35:43.703 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T13:35:43.704 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-04-25T13:35:43.704 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** Compaction Stats [default] ** 2024-04-25T13:35:43.704 INFO:journalctl@ceph.mon.c.smithi175.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T13:35:43.704 INFO:journalctl@ceph.mon.c.smithi175.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-25T13:35:43.704 INFO:journalctl@ceph.mon.c.smithi175.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T13:35:43.704 INFO:journalctl@ceph.mon.c.smithi175.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T13:35:43.704 INFO:journalctl@ceph.mon.c.smithi175.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T13:35:43.704 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-04-25T13:35:43.704 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** Compaction Stats [default] ** 2024-04-25T13:35:43.704 INFO:journalctl@ceph.mon.c.smithi175.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T13:35:43.704 INFO:journalctl@ceph.mon.c.smithi175.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T13:35:43.704 INFO:journalctl@ceph.mon.c.smithi175.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T13:35:43.704 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-04-25T13:35:43.705 INFO:journalctl@ceph.mon.c.smithi175.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-25T13:35:43.705 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-04-25T13:35:43.705 INFO:journalctl@ceph.mon.c.smithi175.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T13:35:43.705 INFO:journalctl@ceph.mon.c.smithi175.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T13:35:43.705 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T13:35:43.705 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T13:35:43.705 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T13:35:43.705 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T13:35:43.705 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T13:35:43.705 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T13:35:43.705 INFO:journalctl@ceph.mon.c.smithi175.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T13:35:43.705 INFO:journalctl@ceph.mon.c.smithi175.stdout: Block cache BinnedLRUCache@0x556c190231f0#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 7e-06 secs_since: 0 2024-04-25T13:35:43.705 INFO:journalctl@ceph.mon.c.smithi175.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-25T13:35:43.706 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-04-25T13:35:43.706 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T13:35:43.706 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-04-25T13:35:43.706 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: using public_addr v2:172.21.15.175:0/0 -> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] 2024-04-25T13:35:43.706 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: starting mon.c rank -1 at public addrs [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] at bind addrs [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:35:43.706 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: mon.c@-1(???) e0 preinit fsid 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:35:43.706 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: mon.c@-1(synchronizing).mds e1 new map 2024-04-25T13:35:43.706 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: mon.c@-1(synchronizing).mds e1 print_map 2024-04-25T13:35:43.706 INFO:journalctl@ceph.mon.c.smithi175.stdout: e1 2024-04-25T13:35:43.706 INFO:journalctl@ceph.mon.c.smithi175.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T13:35:43.706 INFO:journalctl@ceph.mon.c.smithi175.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T13:35:43.706 INFO:journalctl@ceph.mon.c.smithi175.stdout: legacy client fscid: -1 2024-04-25T13:35:43.706 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-04-25T13:35:43.707 INFO:journalctl@ceph.mon.c.smithi175.stdout: No filesystems configured 2024-04-25T13:35:43.707 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-25T13:35:43.707 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-25T13:35:43.707 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-25T13:35:43.707 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-25T13:35:43.707 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-25T13:35:43.707 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-25T13:35:43.707 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-25T13:35:43.707 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T13:35:43.707 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T13:35:43.707 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T13:35:43.707 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:43.707 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T13:35:43.707 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.708 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:43.708 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:35:43.708 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:43.708 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.708 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.708 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.708 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.708 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:35:43.708 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:35:43.708 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:35:43.708 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: Updating smithi161:/etc/ceph/ceph.conf 2024-04-25T13:35:43.708 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: Deploying cephadm binary to smithi175 2024-04-25T13:35:43.708 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: Updating smithi161:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:35:43.708 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:35:43.709 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: Updating smithi161:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T13:35:43.709 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:43.709 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.709 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.709 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.709 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:43.709 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.709 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: Added host smithi175 2024-04-25T13:35:43.709 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:35:43.709 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.709 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.709 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:43.709 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T13:35:43.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:43.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/4292129920' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-25T13:35:43.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:43.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/4292129920' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-25T13:35:43.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T13:35:43.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:35:43.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:35:43.710 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:35:43.711 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: Updating smithi175:/etc/ceph/ceph.conf 2024-04-25T13:35:43.711 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: Updating smithi175:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:35:43.711 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:35:43.711 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: Updating smithi175:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T13:35:43.711 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.711 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.711 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.711 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:43.711 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi043:172.21.15.43=a;smithi161:172.21.15.161=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:35:43.711 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: Saving service mon spec with placement smithi043:172.21.15.43=a;smithi161:172.21.15.161=b;smithi175:172.21.15.175=c;count:3 2024-04-25T13:35:43.711 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.711 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:35:43.711 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:35:43.712 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:35:43.712 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:43.712 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T13:35:43.712 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:35:43.712 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: Deploying daemon mon.c on smithi175 2024-04-25T13:35:43.712 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:43.712 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 ceph-mon[32649]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-25T13:35:43.712 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 bash[32617]: e114fb4bd2be29ad39d25d28fcb771addedadee2d7f9de21dbd0caf2c5af68d3 2024-04-25T13:35:43.712 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:43 smithi175 systemd[1]: Started Ceph mon.c for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:35:44.757 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-25T13:35:44.758 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T13:35:45.016 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T13:35:48.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:35:48.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:48.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: mon.a calling monitor election 2024-04-25T13:35:48.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:48.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:48.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:48.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: mon.c calling monitor election 2024-04-25T13:35:48.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:48.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:48.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:48.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:48.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-25T13:35:48.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: monmap epoch 2 2024-04-25T13:35:48.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: fsid 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:35:48.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: last_changed 2024-04-25T13:35:43.219628+0000 2024-04-25T13:35:48.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: created 2024-04-25T13:33:54.073201+0000 2024-04-25T13:35:48.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: min_mon_release 19 (squid) 2024-04-25T13:35:48.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: election_strategy: 1 2024-04-25T13:35:48.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-25T13:35:48.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-04-25T13:35:48.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: fsmap 2024-04-25T13:35:48.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T13:35:48.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: mgrmap e13: x(active, since 50s) 2024-04-25T13:35:48.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: overall HEALTH_OK 2024-04-25T13:35:48.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:48.683 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:48.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:35:48.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:48.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: mon.a calling monitor election 2024-04-25T13:35:48.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:48.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:48.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:48.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: mon.c calling monitor election 2024-04-25T13:35:48.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:48.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:48.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:48.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:48.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-25T13:35:48.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: monmap epoch 2 2024-04-25T13:35:48.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: fsid 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:35:48.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: last_changed 2024-04-25T13:35:43.219628+0000 2024-04-25T13:35:48.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: created 2024-04-25T13:33:54.073201+0000 2024-04-25T13:35:48.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: min_mon_release 19 (squid) 2024-04-25T13:35:48.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: election_strategy: 1 2024-04-25T13:35:48.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-25T13:35:48.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-04-25T13:35:48.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: fsmap 2024-04-25T13:35:48.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T13:35:48.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: mgrmap e13: x(active, since 50s) 2024-04-25T13:35:48.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: overall HEALTH_OK 2024-04-25T13:35:48.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:48.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:49.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.548+0000 7f37f54ed700 1 -- 172.21.15.175:0/3160711638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d80035c0 msgr2=0x7f37d8005aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:49.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.548+0000 7f37f54ed700 1 --2- 172.21.15.175:0/3160711638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d80035c0 0x7f37d8005aa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f37f0103a10 tx=0x7f37e000feb0 comp rx=0 tx=0).stop 2024-04-25T13:35:49.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.548+0000 7f37f54ed700 1 -- 172.21.15.175:0/3160711638 shutdown_connections 2024-04-25T13:35:49.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.548+0000 7f37f54ed700 1 --2- 172.21.15.175:0/3160711638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d80035c0 0x7f37d8005aa0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:49.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.548+0000 7f37f54ed700 1 -- 172.21.15.175:0/3160711638 >> 172.21.15.175:0/3160711638 conn(0x7f37f00ff5c0 msgr2=0x7f37f0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:49.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.548+0000 7f37f54ed700 1 -- 172.21.15.175:0/3160711638 shutdown_connections 2024-04-25T13:35:49.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.548+0000 7f37f54ed700 1 -- 172.21.15.175:0/3160711638 wait complete. 2024-04-25T13:35:49.551 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:49 smithi175 ceph-mon[32649]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:49.551 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:49 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:49.551 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:49 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T13:35:49.551 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:49 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:35:49.551 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:49 smithi175 ceph-mon[32649]: Deploying daemon mon.b on smithi161 2024-04-25T13:35:49.551 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:49 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:49.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.549+0000 7f37f54ed700 1 Processor -- start 2024-04-25T13:35:49.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.550+0000 7f37f54ed700 1 -- start start 2024-04-25T13:35:49.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.550+0000 7f37f54ed700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d80035c0 0x7f37f019f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:49.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.550+0000 7f37f54ed700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f019faa0 0x7f37f01996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:49.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.550+0000 7f37f54ed700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f37f010b970 con 0x7f37d80035c0 2024-04-25T13:35:49.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.550+0000 7f37f54ed700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f37f010b7f0 con 0x7f37f019faa0 2024-04-25T13:35:49.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.551+0000 7f37eeffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d80035c0 0x7f37f019f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:49.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.551+0000 7f37eeffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d80035c0 0x7f37f019f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.175:47722/0 (socket says 172.21.15.175:47722) 2024-04-25T13:35:49.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.551+0000 7f37eeffd700 1 -- 172.21.15.175:0/611866809 learned_addr learned my addr 172.21.15.175:0/611866809 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T13:35:49.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.551+0000 7f37ee7fc700 1 --2- 172.21.15.175:0/611866809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f019faa0 0x7f37f01996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:49.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.551+0000 7f37ee7fc700 1 -- 172.21.15.175:0/611866809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f019faa0 msgr2=0x7f37f01996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-25T13:35:49.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.551+0000 7f37ee7fc700 1 -- 172.21.15.175:0/611866809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f019faa0 msgr2=0x7f37f01996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T13:35:49.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.551+0000 7f37ee7fc700 1 --2- 172.21.15.175:0/611866809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f019faa0 0x7f37f01996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:35:49.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.551+0000 7f37ee7fc700 1 --2- 172.21.15.175:0/611866809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f019faa0 0x7f37f01996f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:35:49.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.551+0000 7f37eeffd700 1 -- 172.21.15.175:0/611866809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f019faa0 msgr2=0x7f37f01996f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T13:35:49.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.551+0000 7f37eeffd700 1 --2- 172.21.15.175:0/611866809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f019faa0 0x7f37f01996f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:49.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.551+0000 7f37eeffd700 1 -- 172.21.15.175:0/611866809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f01a0040 con 0x7f37d80035c0 2024-04-25T13:35:49.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.551+0000 7f37eeffd700 1 --2- 172.21.15.175:0/611866809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d80035c0 0x7f37f019f560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f37e0010010 tx=0x7f37e0013c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:49.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.551+0000 7f37d7fff700 1 -- 172.21.15.175:0/611866809 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f37e00053b0 con 0x7f37d80035c0 2024-04-25T13:35:49.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.552+0000 7f37d7fff700 1 -- 172.21.15.175:0/611866809 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37e00044c0 con 0x7f37d80035c0 2024-04-25T13:35:49.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.552+0000 7f37d7fff700 1 -- 172.21.15.175:0/611866809 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f37e0003d10 con 0x7f37d80035c0 2024-04-25T13:35:49.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.552+0000 7f37f54ed700 1 -- 172.21.15.175:0/611866809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f0199cf0 con 0x7f37d80035c0 2024-04-25T13:35:49.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.552+0000 7f37f54ed700 1 -- 172.21.15.175:0/611866809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f019a280 con 0x7f37d80035c0 2024-04-25T13:35:49.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.553+0000 7f37d7fff700 1 -- 172.21.15.175:0/611866809 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f37e0023070 con 0x7f37d80035c0 2024-04-25T13:35:49.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.553+0000 7f37f54ed700 1 -- 172.21.15.175:0/611866809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37f01051e0 con 0x7f37d80035c0 2024-04-25T13:35:49.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.554+0000 7f37d7fff700 1 --2- 172.21.15.175:0/611866809 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f37dc03d400 0x7f37dc03f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:49.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.554+0000 7f37d7fff700 1 -- 172.21.15.175:0/611866809 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f37e0020050 con 0x7f37d80035c0 2024-04-25T13:35:49.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.554+0000 7f37ee7fc700 1 --2- 172.21.15.175:0/611866809 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f37dc03d400 0x7f37dc03f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:49.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.554+0000 7f37ee7fc700 1 --2- 172.21.15.175:0/611866809 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f37dc03d400 0x7f37dc03f910 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f37f019ae90 tx=0x7f37e4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:49.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.559+0000 7f37d7fff700 1 -- 172.21.15.175:0/611866809 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f37e0028020 con 0x7f37d80035c0 2024-04-25T13:35:49.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:49 smithi043 ceph-mon[29195]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:49.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:49 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:49.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:49 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T13:35:49.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:49 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:35:49.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:49 smithi043 ceph-mon[29195]: Deploying daemon mon.b on smithi161 2024-04-25T13:35:49.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:49 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:49.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.841+0000 7f37f54ed700 1 -- 172.21.15.175:0/611866809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f37f019a530 con 0x7f37d80035c0 2024-04-25T13:35:49.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.842+0000 7f37d7fff700 1 -- 172.21.15.175:0/611866809 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f37e0005670 con 0x7f37d80035c0 2024-04-25T13:35:49.843 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:35:49.843 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":2,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","modified":"2024-04-25T13:35:43.219628Z","created":"2024-04-25T13:33:54.073201Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-25T13:35:49.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.844+0000 7f37f54ed700 1 -- 172.21.15.175:0/611866809 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f37dc03d400 msgr2=0x7f37dc03f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:49.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.844+0000 7f37f54ed700 1 --2- 172.21.15.175:0/611866809 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f37dc03d400 0x7f37dc03f910 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f37f019ae90 tx=0x7f37e4008040 comp rx=0 tx=0).stop 2024-04-25T13:35:49.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.844+0000 7f37f54ed700 1 -- 172.21.15.175:0/611866809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d80035c0 msgr2=0x7f37f019f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:49.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.844+0000 7f37f54ed700 1 --2- 172.21.15.175:0/611866809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d80035c0 0x7f37f019f560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f37e0010010 tx=0x7f37e0013c40 comp rx=0 tx=0).stop 2024-04-25T13:35:49.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.844+0000 7f37f54ed700 1 -- 172.21.15.175:0/611866809 shutdown_connections 2024-04-25T13:35:49.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.844+0000 7f37f54ed700 1 --2- 172.21.15.175:0/611866809 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f37dc03d400 0x7f37dc03f910 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:49.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.844+0000 7f37f54ed700 1 --2- 172.21.15.175:0/611866809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d80035c0 0x7f37f019f560 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:49.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.844+0000 7f37f54ed700 1 --2- 172.21.15.175:0/611866809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f019faa0 0x7f37f01996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:49.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.844+0000 7f37f54ed700 1 -- 172.21.15.175:0/611866809 >> 172.21.15.175:0/611866809 conn(0x7f37f00ff5c0 msgr2=0x7f37f0102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:49.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.844+0000 7f37f54ed700 1 -- 172.21.15.175:0/611866809 shutdown_connections 2024-04-25T13:35:49.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:49.844+0000 7f37f54ed700 1 -- 172.21.15.175:0/611866809 wait complete. 2024-04-25T13:35:49.846 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 2 2024-04-25T13:35:50.412 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:50 smithi175 ceph-mon[32649]: from='client.? 172.21.15.175:0/611866809' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T13:35:50.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:50 smithi043 ceph-mon[29195]: from='client.? 172.21.15.175:0/611866809' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T13:35:51.414 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-25T13:35:51.414 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T13:35:51.658 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T13:35:51.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:51 smithi175 ceph-mon[32649]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:51.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:51 smithi043 ceph-mon[29195]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:52 smithi161 systemd[1]: Started Ceph mon.b for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:35:57.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.524+0000 7f92f71f7700 1 -- 172.21.15.175:0/2360393120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92d80035c0 msgr2=0x7f92d8005aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:57.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.524+0000 7f92f71f7700 1 --2- 172.21.15.175:0/2360393120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92d80035c0 0x7f92d8005aa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f92f0103a10 tx=0x7f92e8009e80 comp rx=0 tx=0).stop 2024-04-25T13:35:57.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.524+0000 7f92f71f7700 1 -- 172.21.15.175:0/2360393120 shutdown_connections 2024-04-25T13:35:57.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.524+0000 7f92f71f7700 1 --2- 172.21.15.175:0/2360393120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92d80035c0 0x7f92d8005aa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:57.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.524+0000 7f92f71f7700 1 -- 172.21.15.175:0/2360393120 >> 172.21.15.175:0/2360393120 conn(0x7f92f00ff620 msgr2=0x7f92f0101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:57.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.524+0000 7f92f71f7700 1 -- 172.21.15.175:0/2360393120 shutdown_connections 2024-04-25T13:35:57.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.524+0000 7f92f71f7700 1 -- 172.21.15.175:0/2360393120 wait complete. 2024-04-25T13:35:57.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.525+0000 7f92f71f7700 1 Processor -- start 2024-04-25T13:35:57.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.525+0000 7f92f71f7700 1 -- start start 2024-04-25T13:35:57.527 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:57.527 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:35:57.527 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: mon.a calling monitor election 2024-04-25T13:35:57.527 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: mon.c calling monitor election 2024-04-25T13:35:57.527 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.527 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:57.528 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.528 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:57.528 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.528 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: mon.b calling monitor election 2024-04-25T13:35:57.528 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.528 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:57.528 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.528 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.528 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-25T13:35:57.528 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: monmap epoch 3 2024-04-25T13:35:57.528 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: fsid 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:35:57.528 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: last_changed 2024-04-25T13:35:52.193927+0000 2024-04-25T13:35:57.528 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: created 2024-04-25T13:33:54.073201+0000 2024-04-25T13:35:57.528 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: min_mon_release 19 (squid) 2024-04-25T13:35:57.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: election_strategy: 1 2024-04-25T13:35:57.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-25T13:35:57.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-04-25T13:35:57.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: 2: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.b 2024-04-25T13:35:57.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: fsmap 2024-04-25T13:35:57.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T13:35:57.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: mgrmap e13: x(active, since 59s) 2024-04-25T13:35:57.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: overall HEALTH_OK 2024-04-25T13:35:57.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:57.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:57.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:57.529 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:57.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.525+0000 7f92f71f7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92d80035c0 0x7f92f019f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:57.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.525+0000 7f92f71f7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92f019fad0 0x7f92f01997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:57.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.525+0000 7f92f71f7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0199d10 0x7f92f019a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:57.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.525+0000 7f92f71f7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f92f010b920 con 0x7f92f0199d10 2024-04-25T13:35:57.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.525+0000 7f92f71f7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f92f010b7a0 con 0x7f92d80035c0 2024-04-25T13:35:57.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.525+0000 7f92f71f7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f92f010baa0 con 0x7f92f019fad0 2024-04-25T13:35:57.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.525+0000 7f92effff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92f019fad0 0x7f92f01997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:57.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.525+0000 7f92f5794700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0199d10 0x7f92f019a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:57.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.525+0000 7f92f5794700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0199d10 0x7f92f019a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.175:33228/0 (socket says 172.21.15.175:33228) 2024-04-25T13:35:57.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.525+0000 7f92f5794700 1 -- 172.21.15.175:0/3078050779 learned_addr learned my addr 172.21.15.175:0/3078050779 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T13:35:57.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.525+0000 7f92effff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92f019fad0 0x7f92f01997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50740/0 (socket says 172.21.15.175:50740) 2024-04-25T13:35:57.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.525+0000 7f92f4f93700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92d80035c0 0x7f92f019f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:57.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92effff700 1 -- 172.21.15.175:0/3078050779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92f019fad0 msgr2=0x7f92f01997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-25T13:35:57.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92f4f93700 1 -- 172.21.15.175:0/3078050779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92d80035c0 msgr2=0x7f92f019f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-25T13:35:57.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92f4f93700 1 -- 172.21.15.175:0/3078050779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92d80035c0 msgr2=0x7f92f019f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T13:35:57.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92effff700 1 -- 172.21.15.175:0/3078050779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92f019fad0 msgr2=0x7f92f01997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T13:35:57.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92f4f93700 1 --2- 172.21.15.175:0/3078050779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92d80035c0 0x7f92f019f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:35:57.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92effff700 1 --2- 172.21.15.175:0/3078050779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92f019fad0 0x7f92f01997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:35:57.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92f4f93700 1 --2- 172.21.15.175:0/3078050779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92d80035c0 0x7f92f019f590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:35:57.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92effff700 1 --2- 172.21.15.175:0/3078050779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92f019fad0 0x7f92f01997d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:35:57.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92f5794700 1 -- 172.21.15.175:0/3078050779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92f019fad0 msgr2=0x7f92f01997d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T13:35:57.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92f5794700 1 --2- 172.21.15.175:0/3078050779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92f019fad0 0x7f92f01997d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:57.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92f5794700 1 -- 172.21.15.175:0/3078050779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92d80035c0 msgr2=0x7f92f019f590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T13:35:57.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92f5794700 1 --2- 172.21.15.175:0/3078050779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92d80035c0 0x7f92f019f590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:57.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92f5794700 1 -- 172.21.15.175:0/3078050779 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f01a63f0 con 0x7f92f0199d10 2024-04-25T13:35:57.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92f5794700 1 --2- 172.21.15.175:0/3078050779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0199d10 0x7f92f019a120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f92e000b550 tx=0x7f92e000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:57.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92edffb700 1 -- 172.21.15.175:0/3078050779 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0015020 con 0x7f92f0199d10 2024-04-25T13:35:57.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92edffb700 1 -- 172.21.15.175:0/3078050779 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92e0011cc0 con 0x7f92f0199d10 2024-04-25T13:35:57.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92edffb700 1 -- 172.21.15.175:0/3078050779 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0010ce0 con 0x7f92f0199d10 2024-04-25T13:35:57.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.526+0000 7f92f71f7700 1 -- 172.21.15.175:0/3078050779 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f01a66e0 con 0x7f92f0199d10 2024-04-25T13:35:57.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.527+0000 7f92f71f7700 1 -- 172.21.15.175:0/3078050779 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f01a6c40 con 0x7f92f0199d10 2024-04-25T13:35:57.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.527+0000 7f92edffb700 1 -- 172.21.15.175:0/3078050779 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f92e0018020 con 0x7f92f0199d10 2024-04-25T13:35:57.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.528+0000 7f92f71f7700 1 -- 172.21.15.175:0/3078050779 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f01051e0 con 0x7f92f0199d10 2024-04-25T13:35:57.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.528+0000 7f92edffb700 1 --2- 172.21.15.175:0/3078050779 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f92dc03daa0 0x7f92dc03ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:35:57.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.528+0000 7f92edffb700 1 -- 172.21.15.175:0/3078050779 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f92e0010410 con 0x7f92f0199d10 2024-04-25T13:35:57.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.528+0000 7f92f4f93700 1 --2- 172.21.15.175:0/3078050779 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f92dc03daa0 0x7f92dc03ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:35:57.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.529+0000 7f92f4f93700 1 --2- 172.21.15.175:0/3078050779 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f92dc03daa0 0x7f92dc03ffb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f92e80098a0 tx=0x7f92e800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:35:57.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.534+0000 7f92edffb700 1 -- 172.21.15.175:0/3078050779 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f92e001f020 con 0x7f92f0199d10 2024-04-25T13:35:57.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:57.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:35:57.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: mon.a calling monitor election 2024-04-25T13:35:57.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: mon.c calling monitor election 2024-04-25T13:35:57.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:57.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:57.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: mon.b calling monitor election 2024-04-25T13:35:57.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:57.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-25T13:35:57.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: monmap epoch 3 2024-04-25T13:35:57.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: fsid 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:35:57.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: last_changed 2024-04-25T13:35:52.193927+0000 2024-04-25T13:35:57.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: created 2024-04-25T13:33:54.073201+0000 2024-04-25T13:35:57.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: min_mon_release 19 (squid) 2024-04-25T13:35:57.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: election_strategy: 1 2024-04-25T13:35:57.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-25T13:35:57.605 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-04-25T13:35:57.605 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: 2: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.b 2024-04-25T13:35:57.605 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: fsmap 2024-04-25T13:35:57.605 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T13:35:57.605 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: mgrmap e13: x(active, since 59s) 2024-04-25T13:35:57.605 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: overall HEALTH_OK 2024-04-25T13:35:57.605 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:57.605 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:57.605 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:57.605 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:57.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:57.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:35:57.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: mon.a calling monitor election 2024-04-25T13:35:57.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: mon.c calling monitor election 2024-04-25T13:35:57.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:35:57.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:57.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: mon.b calling monitor election 2024-04-25T13:35:57.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:57.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:57.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-25T13:35:57.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: monmap epoch 3 2024-04-25T13:35:57.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: fsid 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:35:57.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: last_changed 2024-04-25T13:35:52.193927+0000 2024-04-25T13:35:57.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: created 2024-04-25T13:33:54.073201+0000 2024-04-25T13:35:57.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: min_mon_release 19 (squid) 2024-04-25T13:35:57.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: election_strategy: 1 2024-04-25T13:35:57.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-25T13:35:57.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-04-25T13:35:57.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: 2: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.b 2024-04-25T13:35:57.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: fsmap 2024-04-25T13:35:57.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T13:35:57.716 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: mgrmap e13: x(active, since 59s) 2024-04-25T13:35:57.716 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: overall HEALTH_OK 2024-04-25T13:35:57.716 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:57.716 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:57.716 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:57.716 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:57.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.820+0000 7f92f71f7700 1 -- 172.21.15.175:0/3078050779 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f92f01a6f30 con 0x7f92f0199d10 2024-04-25T13:35:57.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.821+0000 7f92edffb700 1 -- 172.21.15.175:0/3078050779 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1285 (secure 0 0 0) 0x7f92e00187b0 con 0x7f92f0199d10 2024-04-25T13:35:57.822 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T13:35:57.822 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":3,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","modified":"2024-04-25T13:35:52.193927Z","created":"2024-04-25T13:33:54.073201Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3300","nonce":0},{"type":"v1","addr":"172.21.15.161:6789","nonce":0}]},"addr":"172.21.15.161:6789/0","public_addr":"172.21.15.161:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-04-25T13:35:57.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.823+0000 7f92f71f7700 1 -- 172.21.15.175:0/3078050779 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f92dc03daa0 msgr2=0x7f92dc03ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:57.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.823+0000 7f92f71f7700 1 --2- 172.21.15.175:0/3078050779 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f92dc03daa0 0x7f92dc03ffb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f92e80098a0 tx=0x7f92e800b040 comp rx=0 tx=0).stop 2024-04-25T13:35:57.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.823+0000 7f92f71f7700 1 -- 172.21.15.175:0/3078050779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0199d10 msgr2=0x7f92f019a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:35:57.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.823+0000 7f92f71f7700 1 --2- 172.21.15.175:0/3078050779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0199d10 0x7f92f019a120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f92e000b550 tx=0x7f92e000b910 comp rx=0 tx=0).stop 2024-04-25T13:35:57.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.823+0000 7f92f71f7700 1 -- 172.21.15.175:0/3078050779 shutdown_connections 2024-04-25T13:35:57.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.823+0000 7f92f71f7700 1 --2- 172.21.15.175:0/3078050779 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f92dc03daa0 0x7f92dc03ffb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:57.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.823+0000 7f92f71f7700 1 --2- 172.21.15.175:0/3078050779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0199d10 0x7f92f019a120 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:57.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.823+0000 7f92f71f7700 1 --2- 172.21.15.175:0/3078050779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92d80035c0 0x7f92f019f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:57.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.823+0000 7f92f71f7700 1 --2- 172.21.15.175:0/3078050779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92f019fad0 0x7f92f01997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:35:57.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.823+0000 7f92f71f7700 1 -- 172.21.15.175:0/3078050779 >> 172.21.15.175:0/3078050779 conn(0x7f92f00ff620 msgr2=0x7f92f0106cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:35:57.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.823+0000 7f92f71f7700 1 -- 172.21.15.175:0/3078050779 shutdown_connections 2024-04-25T13:35:57.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:35:57.823+0000 7f92f71f7700 1 -- 172.21.15.175:0/3078050779 wait complete. 2024-04-25T13:35:57.825 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 3 2024-04-25T13:35:58.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:35:58.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:58 smithi175 ceph-mon[32649]: from='client.? 172.21.15.175:0/3078050779' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T13:35:58.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:58.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:58.432 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-25T13:35:58.432 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-25T13:35:58.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:35:58.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:58 smithi161 ceph-mon[32696]: from='client.? 172.21.15.175:0/3078050779' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T13:35:58.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:58.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:58.691 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:35:58.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:35:58.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:58 smithi043 ceph-mon[29195]: from='client.? 172.21.15.175:0/3078050779' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T13:35:58.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:58.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:35:59.445 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:35:59 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:35:59.193+0000 7f62bbd55700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T13:35:59.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:59 smithi043 ceph-mon[29195]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:59.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:59.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:59.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:59.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:59.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:35:59.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:35:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:35:59.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:59 smithi175 ceph-mon[32649]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:35:59.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:59.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:59.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:59.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:35:59.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:35:59.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:35:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:00.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:59 smithi161 ceph-mon[32696]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:00.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:00.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:35:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:00.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.333+0000 7f1720e6e700 1 -- 172.21.15.43:0/3693096880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f171c1088f0 msgr2=0x7f171c108d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:00.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.333+0000 7f1720e6e700 1 --2- 172.21.15.43:0/3693096880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f171c1088f0 0x7f171c108d00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f170c009910 tx=0x7f170c009c20 comp rx=0 tx=0).stop 2024-04-25T13:36:00.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.333+0000 7f1720e6e700 1 -- 172.21.15.43:0/3693096880 shutdown_connections 2024-04-25T13:36:00.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.333+0000 7f1720e6e700 1 --2- 172.21.15.43:0/3693096880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f171c1088f0 0x7f171c108d00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:00.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.333+0000 7f1720e6e700 1 -- 172.21.15.43:0/3693096880 >> 172.21.15.43:0/3693096880 conn(0x7f171c0fe440 msgr2=0x7f171c100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:36:00.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.333+0000 7f1720e6e700 1 -- 172.21.15.43:0/3693096880 shutdown_connections 2024-04-25T13:36:00.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.333+0000 7f1720e6e700 1 -- 172.21.15.43:0/3693096880 wait complete. 2024-04-25T13:36:00.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.334+0000 7f1720e6e700 1 Processor -- start 2024-04-25T13:36:00.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.334+0000 7f1720e6e700 1 -- start start 2024-04-25T13:36:00.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.334+0000 7f1720e6e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f171c1088f0 0x7f171c19a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:36:00.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f1720e6e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f171c19ae40 0x7f171c19b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:36:00.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f1720e6e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f171c1a3970 0x7f171c1a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:36:00.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f1720e6e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f171c10ccf0 con 0x7f171c1a3970 2024-04-25T13:36:00.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f1720e6e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f171c10cb70 con 0x7f171c1088f0 2024-04-25T13:36:00.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f1720e6e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f171c10ce70 con 0x7f171c19ae40 2024-04-25T13:36:00.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f171ad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f171c1a3970 0x7f171c1a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:36:00.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f171ad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f171c1a3970 0x7f171c1a5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55830/0 (socket says 172.21.15.43:55830) 2024-04-25T13:36:00.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f171a59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f171c1088f0 0x7f171c19a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:36:00.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f171ad9d700 1 -- 172.21.15.43:0/3432137192 learned_addr learned my addr 172.21.15.43:0/3432137192 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:36:00.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f1719d9b700 1 --2- 172.21.15.43:0/3432137192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f171c19ae40 0x7f171c19b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:36:00.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f171a59c700 1 -- 172.21.15.43:0/3432137192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f171c19ae40 msgr2=0x7f171c19b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:00.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f171a59c700 1 --2- 172.21.15.43:0/3432137192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f171c19ae40 0x7f171c19b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:00.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f171a59c700 1 -- 172.21.15.43:0/3432137192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f171c1a3970 msgr2=0x7f171c1a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:00.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f171a59c700 1 --2- 172.21.15.43:0/3432137192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f171c1a3970 0x7f171c1a5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:00.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f171a59c700 1 -- 172.21.15.43:0/3432137192 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171c1a6520 con 0x7f171c1088f0 2024-04-25T13:36:00.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f171ad9d700 1 --2- 172.21.15.43:0/3432137192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f171c1a3970 0x7f171c1a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:36:00.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.335+0000 7f171a59c700 1 --2- 172.21.15.43:0/3432137192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f171c1088f0 0x7f171c19a900 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f171c103a00 tx=0x7f170c00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:36:00.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.336+0000 7f170b7fe700 1 -- 172.21.15.43:0/3432137192 <== mon.2 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c027070 con 0x7f171c1088f0 2024-04-25T13:36:00.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.336+0000 7f170b7fe700 1 -- 172.21.15.43:0/3432137192 <== mon.2 v2:172.21.15.161:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f170c005da0 con 0x7f171c1088f0 2024-04-25T13:36:00.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.336+0000 7f1720e6e700 1 -- 172.21.15.43:0/3432137192 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f171c1a6810 con 0x7f171c1088f0 2024-04-25T13:36:00.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.336+0000 7f170b7fe700 1 -- 172.21.15.43:0/3432137192 <== mon.2 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c022cc0 con 0x7f171c1088f0 2024-04-25T13:36:00.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.336+0000 7f1720e6e700 1 -- 172.21.15.43:0/3432137192 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f171c1a6da0 con 0x7f171c1088f0 2024-04-25T13:36:00.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.337+0000 7f170b7fe700 1 -- 172.21.15.43:0/3432137192 <== mon.2 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f170c02a070 con 0x7f171c1088f0 2024-04-25T13:36:00.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.337+0000 7f1720e6e700 1 -- 172.21.15.43:0/3432137192 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f171c064cf0 con 0x7f171c1088f0 2024-04-25T13:36:00.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.337+0000 7f170b7fe700 1 --2- 172.21.15.43:0/3432137192 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f170403daa0 0x7f170403ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:36:00.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.337+0000 7f170b7fe700 1 -- 172.21.15.43:0/3432137192 <== mon.2 v2:172.21.15.161:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f170c0526a0 con 0x7f171c1088f0 2024-04-25T13:36:00.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.337+0000 7f1719d9b700 1 --2- 172.21.15.43:0/3432137192 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f170403daa0 0x7f170403ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:36:00.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.338+0000 7f1719d9b700 1 --2- 172.21.15.43:0/3432137192 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f170403daa0 0x7f170403ffb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f171c0fea40 tx=0x7f1710009210 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:36:00.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.343+0000 7f170b7fe700 1 -- 172.21.15.43:0/3432137192 <== mon.2 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f170c013070 con 0x7f171c1088f0 2024-04-25T13:36:00.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.587+0000 7f1720e6e700 1 -- 172.21.15.43:0/3432137192 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f171c1a6fa0 con 0x7f171c1088f0 2024-04-25T13:36:00.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.587+0000 7f170b7fe700 1 -- 172.21.15.43:0/3432137192 <== mon.2 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f170c031130 con 0x7f171c1088f0 2024-04-25T13:36:00.588 INFO:teuthology.orchestra.run.smithi043.stdout:# minimal ceph.conf for 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:36:00.589 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-04-25T13:36:00.589 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:36:00.589 INFO:teuthology.orchestra.run.smithi043.stdout: mon_host = [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] 2024-04-25T13:36:00.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.589+0000 7f1720e6e700 1 -- 172.21.15.43:0/3432137192 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f170403daa0 msgr2=0x7f170403ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.589+0000 7f1720e6e700 1 --2- 172.21.15.43:0/3432137192 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f170403daa0 0x7f170403ffb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f171c0fea40 tx=0x7f1710009210 comp rx=0 tx=0).stop 2024-04-25T13:36:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.589+0000 7f1720e6e700 1 -- 172.21.15.43:0/3432137192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f171c1088f0 msgr2=0x7f171c19a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.589+0000 7f1720e6e700 1 --2- 172.21.15.43:0/3432137192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f171c1088f0 0x7f171c19a900 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f171c103a00 tx=0x7f170c00f690 comp rx=0 tx=0).stop 2024-04-25T13:36:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.590+0000 7f1720e6e700 1 -- 172.21.15.43:0/3432137192 shutdown_connections 2024-04-25T13:36:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.590+0000 7f1720e6e700 1 --2- 172.21.15.43:0/3432137192 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f170403daa0 0x7f170403ffb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.590+0000 7f1720e6e700 1 --2- 172.21.15.43:0/3432137192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f171c1a3970 0x7f171c1a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.590+0000 7f1720e6e700 1 --2- 172.21.15.43:0/3432137192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f171c1088f0 0x7f171c19a900 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.590+0000 7f1720e6e700 1 --2- 172.21.15.43:0/3432137192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f171c19ae40 0x7f171c19b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.590+0000 7f1720e6e700 1 -- 172.21.15.43:0/3432137192 >> 172.21.15.43:0/3432137192 conn(0x7f171c0fe440 msgr2=0x7f171c0ff480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:36:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.590+0000 7f1720e6e700 1 -- 172.21.15.43:0/3432137192 shutdown_connections 2024-04-25T13:36:00.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:00.590+0000 7f1720e6e700 1 -- 172.21.15.43:0/3432137192 wait complete. 2024-04-25T13:36:00.898 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: Updating smithi043:/etc/ceph/ceph.conf 2024-04-25T13:36:00.898 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: Updating smithi161:/etc/ceph/ceph.conf 2024-04-25T13:36:00.898 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: Updating smithi175:/etc/ceph/ceph.conf 2024-04-25T13:36:00.898 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: Updating smithi175:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:36:00.898 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: Updating smithi043:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:36:00.898 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: Updating smithi161:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:36:00.898 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.899 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.899 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.899 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.899 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.899 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.899 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.899 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.899 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.899 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.899 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.899 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T13:36:00.899 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T13:36:00.900 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:00.900 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:00 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3432137192' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:00.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: Updating smithi043:/etc/ceph/ceph.conf 2024-04-25T13:36:00.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: Updating smithi161:/etc/ceph/ceph.conf 2024-04-25T13:36:00.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: Updating smithi175:/etc/ceph/ceph.conf 2024-04-25T13:36:00.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: Updating smithi175:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:36:00.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: Updating smithi043:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:36:00.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: Updating smithi161:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:36:00.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:00.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T13:36:00.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T13:36:00.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:00.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:00 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3432137192' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: Updating smithi043:/etc/ceph/ceph.conf 2024-04-25T13:36:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: Updating smithi161:/etc/ceph/ceph.conf 2024-04-25T13:36:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: Updating smithi175:/etc/ceph/ceph.conf 2024-04-25T13:36:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: Updating smithi175:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:36:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: Updating smithi043:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:36:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: Updating smithi161:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:36:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T13:36:01.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T13:36:01.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:01.105 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:00 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3432137192' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:01.900 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:01 smithi043 ceph-mon[29195]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:01.900 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:01 smithi043 ceph-mon[29195]: Reconfiguring mon.a (unknown last config time)... 2024-04-25T13:36:01.900 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:01 smithi043 ceph-mon[29195]: Reconfiguring daemon mon.a on smithi043 2024-04-25T13:36:01.900 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.900 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.900 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T13:36:01.900 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T13:36:01.900 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:01.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:01 smithi161 ceph-mon[32696]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:01.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:01 smithi161 ceph-mon[32696]: Reconfiguring mon.a (unknown last config time)... 2024-04-25T13:36:01.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:01 smithi161 ceph-mon[32696]: Reconfiguring daemon mon.a on smithi043 2024-04-25T13:36:01.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T13:36:01.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T13:36:01.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:01.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:01 smithi175 ceph-mon[32649]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:01.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:01 smithi175 ceph-mon[32649]: Reconfiguring mon.a (unknown last config time)... 2024-04-25T13:36:01.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:01 smithi175 ceph-mon[32649]: Reconfiguring daemon mon.a on smithi043 2024-04-25T13:36:01.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:01.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T13:36:01.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T13:36:01.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:01.962 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-25T13:36:01.962 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:36:01.962 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.conf 2024-04-25T13:36:01.989 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:36:01.989 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:36:02.053 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-04-25T13:36:02.054 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.conf 2024-04-25T13:36:02.080 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-04-25T13:36:02.080 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:36:02.143 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T13:36:02.144 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.conf 2024-04-25T13:36:02.175 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T13:36:02.176 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:36:02.245 INFO:tasks.cephadm:Adding mgr.x on smithi043 2024-04-25T13:36:02.245 INFO:tasks.cephadm:Adding mgr.y on smithi161 2024-04-25T13:36:02.245 INFO:tasks.cephadm:Adding mgr.z on smithi175 2024-04-25T13:36:02.245 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch apply mgr '3;smithi043=x;smithi161=y;smithi175=z' 2024-04-25T13:36:02.523 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T13:36:02.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:02 smithi161 ceph-mon[32696]: Reconfiguring mon.b (monmap changed)... 2024-04-25T13:36:02.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:02 smithi161 ceph-mon[32696]: Reconfiguring daemon mon.b on smithi161 2024-04-25T13:36:02.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:02 smithi161 ceph-mon[32696]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:02.894 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:02 smithi175 ceph-mon[32649]: Reconfiguring mon.b (monmap changed)... 2024-04-25T13:36:02.894 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:02 smithi175 ceph-mon[32649]: Reconfiguring daemon mon.b on smithi161 2024-04-25T13:36:02.894 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:02 smithi175 ceph-mon[32649]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:02.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:02 smithi043 ceph-mon[29195]: Reconfiguring mon.b (monmap changed)... 2024-04-25T13:36:02.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:02 smithi043 ceph-mon[29195]: Reconfiguring daemon mon.b on smithi161 2024-04-25T13:36:02.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:02 smithi043 ceph-mon[29195]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:04.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:04.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:04.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:04 smithi175 ceph-mon[32649]: Reconfiguring mon.c (monmap changed)... 2024-04-25T13:36:04.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T13:36:04.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T13:36:04.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:04.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:04 smithi175 ceph-mon[32649]: Reconfiguring daemon mon.c on smithi175 2024-04-25T13:36:04.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:04.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:04.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:04 smithi043 ceph-mon[29195]: Reconfiguring mon.c (monmap changed)... 2024-04-25T13:36:04.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T13:36:04.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T13:36:04.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:04.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:04 smithi043 ceph-mon[29195]: Reconfiguring daemon mon.c on smithi175 2024-04-25T13:36:04.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:04.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:04.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:04 smithi161 ceph-mon[32696]: Reconfiguring mon.c (monmap changed)... 2024-04-25T13:36:04.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T13:36:04.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T13:36:04.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:04.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:04 smithi161 ceph-mon[32696]: Reconfiguring daemon mon.c on smithi175 2024-04-25T13:36:04.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.166+0000 7f24d8084700 1 -- 172.21.15.175:0/2534484778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d0104710 msgr2=0x7f24d0106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:04.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.166+0000 7f24d8084700 1 --2- 172.21.15.175:0/2534484778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d0104710 0x7f24d0106b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009910 tx=0x7f24cc009c20 comp rx=0 tx=0).stop 2024-04-25T13:36:04.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.166+0000 7f24d8084700 1 -- 172.21.15.175:0/2534484778 shutdown_connections 2024-04-25T13:36:04.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.166+0000 7f24d8084700 1 --2- 172.21.15.175:0/2534484778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d0104710 0x7f24d0106b30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:04.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.166+0000 7f24d8084700 1 -- 172.21.15.175:0/2534484778 >> 172.21.15.175:0/2534484778 conn(0x7f24d00fe0f0 msgr2=0x7f24d01005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:36:04.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.166+0000 7f24d8084700 1 -- 172.21.15.175:0/2534484778 shutdown_connections 2024-04-25T13:36:04.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.166+0000 7f24d8084700 1 -- 172.21.15.175:0/2534484778 wait complete. 2024-04-25T13:36:04.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.167+0000 7f24d8084700 1 Processor -- start 2024-04-25T13:36:04.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.167+0000 7f24d8084700 1 -- start start 2024-04-25T13:36:04.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.167+0000 7f24d8084700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24d0104710 0x7f24d0199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:36:04.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.167+0000 7f24d8084700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d0199c90 0x7f24d019ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:36:04.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.167+0000 7f24d8084700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24d019f160 0x7f24d01a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:36:04.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.167+0000 7f24d8084700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f24d01099d0 con 0x7f24d0199c90 2024-04-25T13:36:04.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.167+0000 7f24d8084700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f24d0109850 con 0x7f24d019f160 2024-04-25T13:36:04.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.167+0000 7f24d8084700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f24d0109b50 con 0x7f24d0104710 2024-04-25T13:36:04.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.167+0000 7f24d5e20700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24d0104710 0x7f24d0199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:36:04.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.167+0000 7f24d5e20700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24d0104710 0x7f24d0199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50094/0 (socket says 172.21.15.175:50094) 2024-04-25T13:36:04.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.167+0000 7f24d5e20700 1 -- 172.21.15.175:0/2077558835 learned_addr learned my addr 172.21.15.175:0/2077558835 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T13:36:04.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.167+0000 7f24d561f700 1 --2- 172.21.15.175:0/2077558835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d0199c90 0x7f24d019ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:36:04.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.168+0000 7f24d6621700 1 --2- 172.21.15.175:0/2077558835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24d019f160 0x7f24d01a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:36:04.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.168+0000 7f24d5e20700 1 -- 172.21.15.175:0/2077558835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24d019f160 msgr2=0x7f24d01a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:04.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.168+0000 7f24d5e20700 1 --2- 172.21.15.175:0/2077558835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24d019f160 0x7f24d01a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:04.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.168+0000 7f24d5e20700 1 -- 172.21.15.175:0/2077558835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d0199c90 msgr2=0x7f24d019ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:04.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.168+0000 7f24d5e20700 1 --2- 172.21.15.175:0/2077558835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d0199c90 0x7f24d019ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:04.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.168+0000 7f24d5e20700 1 -- 172.21.15.175:0/2077558835 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d01a1af0 con 0x7f24d0104710 2024-04-25T13:36:04.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.168+0000 7f24d5e20700 1 --2- 172.21.15.175:0/2077558835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24d0104710 0x7f24d0199750 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f24cc004f90 tx=0x7f24cc004fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:36:04.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.168+0000 7f24c6ffd700 1 -- 172.21.15.175:0/2077558835 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc027070 con 0x7f24d0104710 2024-04-25T13:36:04.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.168+0000 7f24d8084700 1 -- 172.21.15.175:0/2077558835 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d01a1d80 con 0x7f24d0104710 2024-04-25T13:36:04.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.168+0000 7f24c6ffd700 1 -- 172.21.15.175:0/2077558835 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24cc005da0 con 0x7f24d0104710 2024-04-25T13:36:04.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.168+0000 7f24c6ffd700 1 -- 172.21.15.175:0/2077558835 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc022c70 con 0x7f24d0104710 2024-04-25T13:36:04.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.168+0000 7f24d8084700 1 -- 172.21.15.175:0/2077558835 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d01a2270 con 0x7f24d0104710 2024-04-25T13:36:04.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.169+0000 7f24d8084700 1 -- 172.21.15.175:0/2077558835 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d0064cf0 con 0x7f24d0104710 2024-04-25T13:36:04.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.169+0000 7f24c6ffd700 1 -- 172.21.15.175:0/2077558835 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7f24cc02a070 con 0x7f24d0104710 2024-04-25T13:36:04.884 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mgr update... 2024-04-25T13:36:04.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.170+0000 7f24c6ffd700 1 --2- 172.21.15.175:0/2077558835 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f24bc03daa0 0x7f24bc03ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:36:04.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.170+0000 7f24c6ffd700 1 -- 172.21.15.175:0/2077558835 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f24cc0528b0 con 0x7f24d0104710 2024-04-25T13:36:04.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.170+0000 7f24d561f700 1 --2- 172.21.15.175:0/2077558835 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f24bc03daa0 0x7f24bc03ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:36:04.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.171+0000 7f24d561f700 1 --2- 172.21.15.175:0/2077558835 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f24bc03daa0 0x7f24bc03ffb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f24d019a800 tx=0x7f24c0009210 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:36:04.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.175+0000 7f24c6ffd700 1 -- 172.21.15.175:0/2077558835 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f24cc013070 con 0x7f24d0104710 2024-04-25T13:36:04.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.391+0000 7f24d8084700 1 -- 172.21.15.175:0/2077558835 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi043=x;smithi161=y;smithi175=z", "target": ["mon-mgr", ""]}) -- 0x7f24d00fffb0 con 0x7f24bc03daa0 2024-04-25T13:36:04.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.398+0000 7f24c6ffd700 1 -- 172.21.15.175:0/2077558835 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f24d00fffb0 con 0x7f24bc03daa0 2024-04-25T13:36:04.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.401+0000 7f24d8084700 1 -- 172.21.15.175:0/2077558835 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f24bc03daa0 msgr2=0x7f24bc03ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:04.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.401+0000 7f24d8084700 1 --2- 172.21.15.175:0/2077558835 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f24bc03daa0 0x7f24bc03ffb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f24d019a800 tx=0x7f24c0009210 comp rx=0 tx=0).stop 2024-04-25T13:36:04.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.401+0000 7f24d8084700 1 -- 172.21.15.175:0/2077558835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24d0104710 msgr2=0x7f24d0199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:04.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.401+0000 7f24d8084700 1 --2- 172.21.15.175:0/2077558835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24d0104710 0x7f24d0199750 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f24cc004f90 tx=0x7f24cc004fc0 comp rx=0 tx=0).stop 2024-04-25T13:36:04.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.401+0000 7f24d8084700 1 -- 172.21.15.175:0/2077558835 shutdown_connections 2024-04-25T13:36:04.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.401+0000 7f24d8084700 1 --2- 172.21.15.175:0/2077558835 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f24bc03daa0 0x7f24bc03ffb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:04.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.401+0000 7f24d8084700 1 --2- 172.21.15.175:0/2077558835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24d019f160 0x7f24d01a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:04.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.401+0000 7f24d8084700 1 --2- 172.21.15.175:0/2077558835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24d0104710 0x7f24d0199750 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:04.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.401+0000 7f24d8084700 1 --2- 172.21.15.175:0/2077558835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24d0199c90 0x7f24d019ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:04.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.401+0000 7f24d8084700 1 -- 172.21.15.175:0/2077558835 >> 172.21.15.175:0/2077558835 conn(0x7f24d00fe0f0 msgr2=0x7f24d00ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:36:04.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.401+0000 7f24d8084700 1 -- 172.21.15.175:0/2077558835 shutdown_connections 2024-04-25T13:36:04.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:36:04.401+0000 7f24d8084700 1 -- 172.21.15.175:0/2077558835 wait complete. 2024-04-25T13:36:05.437 DEBUG:teuthology.orchestra.run.smithi161:mgr.y> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mgr.y.service 2024-04-25T13:36:05.440 DEBUG:teuthology.orchestra.run.smithi175:mgr.z> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mgr.z.service 2024-04-25T13:36:05.443 INFO:tasks.cephadm:Deploying OSDs... 2024-04-25T13:36:05.443 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:36:05.443 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T13:36:05.459 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T13:36:05.459 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_1 2024-04-25T13:36:05.462 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:05 smithi175 ceph-mon[32649]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:05.462 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:05 smithi175 ceph-mon[32649]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi043=x;smithi161=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:36:05.462 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:05 smithi175 ceph-mon[32649]: Saving service mgr spec with placement smithi043=x;smithi161=y;smithi175=z;count:3 2024-04-25T13:36:05.462 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:05 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:05.462 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:05 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:05.462 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:05 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:05.462 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:05 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:05.516 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T13:36:05.516 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:36:05.516 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T13:36:05.516 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:36:05.516 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:36:05.516 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-25 13:35:09.898902825 +0000 2024-04-25T13:36:05.516 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-25 13:29:57.035658388 +0000 2024-04-25T13:36:05.516 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-25 13:29:57.035658388 +0000 2024-04-25T13:36:05.517 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-04-25 13:29:57.035658388 +0000 2024-04-25T13:36:05.517 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T13:36:05.580 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-04-25T13:36:05.580 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-04-25T13:36:05.580 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000111938 s, 4.6 MB/s 2024-04-25T13:36:05.581 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T13:36:05.637 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_2 2024-04-25T13:36:05.692 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T13:36:05.693 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:36:05.693 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-25T13:36:05.693 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:36:05.693 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:36:05.693 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-25 13:35:09.929902453 +0000 2024-04-25T13:36:05.693 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-25 13:29:57.368654329 +0000 2024-04-25T13:36:05.693 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-25 13:29:57.368654329 +0000 2024-04-25T13:36:05.693 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-04-25 13:29:57.368654329 +0000 2024-04-25T13:36:05.693 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T13:36:05.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:05 smithi043 ceph-mon[29195]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:05.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:05 smithi043 ceph-mon[29195]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi043=x;smithi161=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:36:05.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:05 smithi043 ceph-mon[29195]: Saving service mgr spec with placement smithi043=x;smithi161=y;smithi175=z;count:3 2024-04-25T13:36:05.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:05 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:05.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:05 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:05.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:05 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:05.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:05 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:05.735 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-04-25T13:36:05.735 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-04-25T13:36:05.735 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000109629 s, 4.7 MB/s 2024-04-25T13:36:05.736 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T13:36:05.792 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_3 2024-04-25T13:36:05.848 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T13:36:05.848 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:36:05.848 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-25T13:36:05.848 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:36:05.848 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:36:05.848 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-25 13:35:09.965902021 +0000 2024-04-25T13:36:05.849 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-25 13:29:57.705650221 +0000 2024-04-25T13:36:05.849 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-25 13:29:57.705650221 +0000 2024-04-25T13:36:05.849 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-04-25 13:29:57.705650221 +0000 2024-04-25T13:36:05.849 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T13:36:05.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:05 smithi161 ceph-mon[32696]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:05.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:05 smithi161 ceph-mon[32696]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi043=x;smithi161=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:36:05.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:05 smithi161 ceph-mon[32696]: Saving service mgr spec with placement smithi043=x;smithi161=y;smithi175=z;count:3 2024-04-25T13:36:05.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:05 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:05.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:05 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:05.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:05 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:05.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:05 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:05.912 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-04-25T13:36:05.912 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-04-25T13:36:05.912 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000109494 s, 4.7 MB/s 2024-04-25T13:36:05.913 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T13:36:05.969 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_4 2024-04-25T13:36:06.024 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T13:36:06.024 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:36:06.024 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-25T13:36:06.024 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:36:06.024 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:36:06.024 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-25 13:35:09.994901672 +0000 2024-04-25T13:36:06.024 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-25 13:29:58.044646089 +0000 2024-04-25T13:36:06.025 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-25 13:29:58.044646089 +0000 2024-04-25T13:36:06.025 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-04-25 13:29:58.044646089 +0000 2024-04-25T13:36:06.025 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T13:36:06.087 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-04-25T13:36:06.087 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-04-25T13:36:06.087 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000101313 s, 5.1 MB/s 2024-04-25T13:36:06.088 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T13:36:06.144 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-04-25T13:36:06.144 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T13:36:06.163 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T13:36:06.163 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2024-04-25T13:36:06.221 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T13:36:06.221 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:36:06.221 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-25T13:36:06.221 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:36:06.221 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:36:06.221 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-04-25 13:35:51.538355055 +0000 2024-04-25T13:36:06.221 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-04-25 13:29:54.838329751 +0000 2024-04-25T13:36:06.221 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-04-25 13:29:54.838329751 +0000 2024-04-25T13:36:06.221 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-04-25 13:29:54.838329751 +0000 2024-04-25T13:36:06.222 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T13:36:06.287 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-04-25T13:36:06.288 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-04-25T13:36:06.288 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000289073 s, 1.8 MB/s 2024-04-25T13:36:06.289 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T13:36:06.347 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2024-04-25T13:36:06.403 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T13:36:06.404 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:36:06.404 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-25T13:36:06.404 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:36:06.404 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:36:06.404 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-04-25 13:35:51.538355055 +0000 2024-04-25T13:36:06.404 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-04-25 13:29:55.178322009 +0000 2024-04-25T13:36:06.404 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-04-25 13:29:55.178322009 +0000 2024-04-25T13:36:06.404 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-04-25 13:29:55.178322009 +0000 2024-04-25T13:36:06.404 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T13:36:06.468 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-04-25T13:36:06.469 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-04-25T13:36:06.469 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000278984 s, 1.8 MB/s 2024-04-25T13:36:06.470 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T13:36:06.527 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2024-04-25T13:36:06.583 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T13:36:06.583 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:36:06.583 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-25T13:36:06.584 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:36:06.584 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:36:06.584 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-04-25 13:35:51.539355035 +0000 2024-04-25T13:36:06.584 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-04-25 13:29:55.513314382 +0000 2024-04-25T13:36:06.584 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-04-25 13:29:55.513314382 +0000 2024-04-25T13:36:06.584 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-04-25 13:29:55.513314382 +0000 2024-04-25T13:36:06.584 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T13:36:06.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:06 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:06.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:06 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:06.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:06 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:06.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:06 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T13:36:06.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:06 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T13:36:06.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:06 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T13:36:06.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:06 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:06.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:06 smithi161 ceph-mon[32696]: Deploying daemon mgr.z on smithi175 2024-04-25T13:36:06.626 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-04-25T13:36:06.626 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-04-25T13:36:06.626 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000217112 s, 2.4 MB/s 2024-04-25T13:36:06.627 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T13:36:06.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:06 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:06.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:06 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:06.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:06 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:06.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:06 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T13:36:06.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:06 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T13:36:06.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:06 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T13:36:06.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:06 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:06.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:06 smithi175 ceph-mon[32649]: Deploying daemon mgr.z on smithi175 2024-04-25T13:36:06.685 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2024-04-25T13:36:06.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:06 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:06.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:06 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:06.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:06 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:06.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:06 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T13:36:06.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:06 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T13:36:06.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:06 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T13:36:06.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:06 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:06.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:06 smithi043 ceph-mon[29195]: Deploying daemon mgr.z on smithi175 2024-04-25T13:36:06.741 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T13:36:06.741 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:36:06.741 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-25T13:36:06.741 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:36:06.741 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:36:06.741 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-04-25 13:35:51.539355035 +0000 2024-04-25T13:36:06.741 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-04-25 13:29:55.851306686 +0000 2024-04-25T13:36:06.741 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-04-25 13:29:55.851306686 +0000 2024-04-25T13:36:06.741 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-04-25 13:29:55.851306686 +0000 2024-04-25T13:36:06.742 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T13:36:06.805 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-04-25T13:36:06.805 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-04-25T13:36:06.805 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000197236 s, 2.6 MB/s 2024-04-25T13:36:06.806 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T13:36:06.862 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T13:36:06.862 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T13:36:06.878 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T13:36:06.878 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-04-25T13:36:06.934 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T13:36:06.934 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:36:06.934 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 659 Links: 1 2024-04-25T13:36:06.934 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:36:06.934 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:36:06.935 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-25 13:35:42.424727266 +0000 2024-04-25T13:36:06.935 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-25 13:29:54.841446885 +0000 2024-04-25T13:36:06.935 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-25 13:29:54.841446885 +0000 2024-04-25T13:36:06.935 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-25 13:29:54.841446885 +0000 2024-04-25T13:36:06.935 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T13:36:06.997 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-25T13:36:06.997 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-25T13:36:06.997 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000192327 s, 2.7 MB/s 2024-04-25T13:36:06.999 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T13:36:07.054 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-04-25T13:36:07.109 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T13:36:07.109 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:36:07.109 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 680 Links: 1 2024-04-25T13:36:07.109 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:36:07.109 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:36:07.109 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-25 13:35:42.424727266 +0000 2024-04-25T13:36:07.110 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-25 13:29:55.185441219 +0000 2024-04-25T13:36:07.110 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-25 13:29:55.185441219 +0000 2024-04-25T13:36:07.110 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-25 13:29:55.185441219 +0000 2024-04-25T13:36:07.110 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T13:36:07.312 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-25T13:36:07.312 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-25T13:36:07.312 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000170294 s, 3.0 MB/s 2024-04-25T13:36:07.314 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T13:36:07.329 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-04-25T13:36:07.388 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T13:36:07.388 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:36:07.388 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 699 Links: 1 2024-04-25T13:36:07.388 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:36:07.388 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:36:07.388 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-25 13:36:07.268343426 +0000 2024-04-25T13:36:07.388 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-25 13:29:55.515435783 +0000 2024-04-25T13:36:07.388 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-25 13:29:55.515435783 +0000 2024-04-25T13:36:07.389 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-25 13:29:55.515435783 +0000 2024-04-25T13:36:07.389 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T13:36:07.490 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-25T13:36:07.490 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-25T13:36:07.490 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000199162 s, 2.6 MB/s 2024-04-25T13:36:07.491 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T13:36:07.506 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-04-25T13:36:07.562 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T13:36:07.562 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:36:07.563 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 715 Links: 1 2024-04-25T13:36:07.563 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:36:07.563 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:36:07.563 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-25 13:36:07.447340660 +0000 2024-04-25T13:36:07.563 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-25 13:29:55.864430034 +0000 2024-04-25T13:36:07.563 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-25 13:29:55.864430034 +0000 2024-04-25T13:36:07.563 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-25 13:29:55.864430034 +0000 2024-04-25T13:36:07.563 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T13:36:07.624 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:07 smithi175 ceph-mon[32649]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:07.624 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:07 smithi175 systemd[1]: Starting Ceph mgr.z for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:36:07.627 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-25T13:36:07.627 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-25T13:36:07.627 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000200099 s, 2.6 MB/s 2024-04-25T13:36:07.629 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T13:36:07.685 INFO:tasks.cephadm:Deploying osd.0 on smithi043 with /dev/vg_nvme/lv_4... 2024-04-25T13:36:07.685 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-25T13:36:07.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:07 smithi161 ceph-mon[32696]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:07.877 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:07 smithi175 podman[34452]: 2024-04-25 13:36:07.717154435 +0000 UTC m=+0.107529365 container create 9fc3d5ee637af315479522fa78977c37c218383536a5fdbdcc27c25ff8c8f572 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-25T13:36:07.877 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:07 smithi175 podman[34452]: 2024-04-25 13:36:07.628364271 +0000 UTC m=+0.018739168 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:36:07.877 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:07 smithi175 podman[34452]: 2024-04-25 13:36:07.87762536 +0000 UTC m=+0.268000249 container init 9fc3d5ee637af315479522fa78977c37c218383536a5fdbdcc27c25ff8c8f572 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-25T13:36:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:36:07.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:07 smithi043 ceph-mon[29195]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:08.181 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:07 smithi175 podman[34452]: 2024-04-25 13:36:07.880247678 +0000 UTC m=+0.270622569 container start 9fc3d5ee637af315479522fa78977c37c218383536a5fdbdcc27c25ff8c8f572 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-25T13:36:08.181 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:07 smithi175 ceph-mgr[34508]: -- 172.21.15.175:0/1242332620 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e21270a5a0 con 0x55e217494000 2024-04-25T13:36:08.181 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:07 smithi175 bash[34452]: 9fc3d5ee637af315479522fa78977c37c218383536a5fdbdcc27c25ff8c8f572 2024-04-25T13:36:08.181 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:07 smithi175 systemd[1]: Started Ceph mgr.z for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:36:08.181 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:08 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:08.055+0000 7efcf5be4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:36:08.647 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:08 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:08.239+0000 7efcf5be4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:36:08.647 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:08 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:08.341+0000 7efcf5be4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:36:08.647 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:08 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:08.647+0000 7efcf5be4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:36:08.930 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:08 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:08.732+0000 7efcf5be4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:36:09.246 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:09 smithi043 ceph-mon[29195]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:09.246 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:09 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:09.246 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:09 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:09.246 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:09 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:09.246 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:09 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T13:36:09.246 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:09 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T13:36:09.247 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:09 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T13:36:09.247 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:09 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:09.247 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:09 smithi043 ceph-mon[29195]: Deploying daemon mgr.y on smithi161 2024-04-25T13:36:09.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:09 smithi161 ceph-mon[32696]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:09.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:09 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:09.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:09 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:09.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:09 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:09.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:09 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T13:36:09.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:09 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T13:36:09.287 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:09 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T13:36:09.287 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:09 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:09.287 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:09 smithi161 ceph-mon[32696]: Deploying daemon mgr.y on smithi161 2024-04-25T13:36:09.335 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:09 smithi175 ceph-mon[32649]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:09.335 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:09 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:09.335 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:09 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:09.335 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:09 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:09.335 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:09 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T13:36:09.335 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:09 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T13:36:09.335 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:09 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T13:36:09.335 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:09 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:09.335 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:09 smithi175 ceph-mon[32649]: Deploying daemon mgr.y on smithi161 2024-04-25T13:36:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-25T13:36:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-25T13:36:09.841 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10+0 records in 2024-04-25T13:36:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:10+0 records out 2024-04-25T13:36:09.841 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00859167 s, 1.2 GB/s 2024-04-25T13:36:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping successful for: 2024-04-25T13:36:10.263 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:10 smithi161 systemd[1]: Starting Ceph mgr.y for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:36:10.282 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:09 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:09.976+0000 7efcf5be4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:36:10.282 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:10 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:10.149+0000 7efcf5be4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:36:10.515 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:10 smithi161 podman[34069]: 2024-04-25 13:36:10.263299556 +0000 UTC m=+0.110857050 container create 82c31b9b38fbbe31830349c57bcf35dc0be7e60a43fdeedcf66864388e187c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-04-25T13:36:10.515 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:10 smithi161 podman[34069]: 2024-04-25 13:36:10.171458533 +0000 UTC m=+0.019016041 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:36:10.515 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:10 smithi161 podman[34069]: 2024-04-25 13:36:10.440810118 +0000 UTC m=+0.288367624 container init 82c31b9b38fbbe31830349c57bcf35dc0be7e60a43fdeedcf66864388e187c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-25T13:36:10.515 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:10 smithi161 podman[34069]: 2024-04-25 13:36:10.443956244 +0000 UTC m=+0.291513741 container start 82c31b9b38fbbe31830349c57bcf35dc0be7e60a43fdeedcf66864388e187c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T13:36:10.515 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:10 smithi161 ceph-mgr[34091]: -- 172.21.15.161:0/269912740 <== mon.2 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5629a74965a0 con 0x5629ac220000 2024-04-25T13:36:10.516 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:10 smithi161 bash[34069]: 82c31b9b38fbbe31830349c57bcf35dc0be7e60a43fdeedcf66864388e187c72 2024-04-25T13:36:10.523 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_4 2024-04-25T13:36:10.612 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:10 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:10.326+0000 7efcf5be4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:36:10.612 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:10 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:10.612+0000 7efcf5be4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:36:10.773 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:36:10.806 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:10 smithi161 systemd[1]: Started Ceph mgr.y for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:36:10.806 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:10 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:10.612+0000 7f41e1fca200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:36:10.806 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:10 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:10.804+0000 7f41e1fca200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:36:10.916 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:10 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:10.704+0000 7efcf5be4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:36:10.916 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:10 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:10.916+0000 7efcf5be4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:36:11.103 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:10 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:10.915+0000 7f41e1fca200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:36:11.180 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:11 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:11.115+0000 7efcf5be4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:36:11.564 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:11 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:11.246+0000 7f41e1fca200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:36:11.564 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:11 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:11.346+0000 7f41e1fca200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:36:11.822 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:11 smithi043 ceph-mon[29195]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:11.822 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:11.822 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:11.822 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:11.822 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:11.822 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:11.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:11 smithi161 ceph-mon[32696]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:11.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:11 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:11.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:11 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:11.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:11 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:11.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:11 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:11.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:11 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:11.931 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:11 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:11.757+0000 7efcf5be4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T13:36:11.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:11 smithi175 ceph-mon[32649]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:11.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:11 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:11.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:11 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:11.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:11 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:11.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:11 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:11.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:11 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:12.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.352+0000 7fd39d9d4700 1 -- 172.21.15.43:0/748747701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd398104210 msgr2=0x7fd398104620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:12.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.352+0000 7fd39d9d4700 1 --2- 172.21.15.43:0/748747701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd398104210 0x7fd398104620 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd388009990 tx=0x7fd388009ca0 comp rx=0 tx=0).stop 2024-04-25T13:36:12.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.352+0000 7fd39d9d4700 1 -- 172.21.15.43:0/748747701 shutdown_connections 2024-04-25T13:36:12.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.352+0000 7fd39d9d4700 1 --2- 172.21.15.43:0/748747701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd398104bb0 0x7fd39810b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:12.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.352+0000 7fd39d9d4700 1 --2- 172.21.15.43:0/748747701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3981030e0 0x7fd3981034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:12.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.352+0000 7fd39d9d4700 1 --2- 172.21.15.43:0/748747701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd398104210 0x7fd398104620 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:12.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.352+0000 7fd39d9d4700 1 -- 172.21.15.43:0/748747701 >> 172.21.15.43:0/748747701 conn(0x7fd3980fe740 msgr2=0x7fd398100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:36:12.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.353+0000 7fd39d9d4700 1 -- 172.21.15.43:0/748747701 shutdown_connections 2024-04-25T13:36:12.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.353+0000 7fd39d9d4700 1 -- 172.21.15.43:0/748747701 wait complete. 2024-04-25T13:36:12.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.353+0000 7fd39d9d4700 1 Processor -- start 2024-04-25T13:36:12.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.353+0000 7fd39d9d4700 1 -- start start 2024-04-25T13:36:12.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd39d9d4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3981030e0 0x7fd39819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:36:12.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd39d9d4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd398104210 0x7fd39819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:36:12.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd39d9d4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd398104bb0 0x7fd3981a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:36:12.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd39d9d4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd39810ea10 con 0x7fd398104bb0 2024-04-25T13:36:12.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd39d9d4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fd39810e890 con 0x7fd3981030e0 2024-04-25T13:36:12.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd39d9d4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd39810eb90 con 0x7fd398104210 2024-04-25T13:36:12.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd3977fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd398104bb0 0x7fd3981a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:36:12.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd3967fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd398104210 0x7fd39819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:36:12.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd3967fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd398104210 0x7fd39819ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.43:36094/0 (socket says 172.21.15.43:36094) 2024-04-25T13:36:12.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd396ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3981030e0 0x7fd39819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:36:12.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd3967fc700 1 -- 172.21.15.43:0/73070743 learned_addr learned my addr 172.21.15.43:0/73070743 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:36:12.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd3977fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd398104bb0 0x7fd3981a1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50846/0 (socket says 172.21.15.43:50846) 2024-04-25T13:36:12.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd3967fc700 1 -- 172.21.15.43:0/73070743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3981030e0 msgr2=0x7fd39819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:12.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd3967fc700 1 --2- 172.21.15.43:0/73070743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3981030e0 0x7fd39819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:12.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd3967fc700 1 -- 172.21.15.43:0/73070743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd398104bb0 msgr2=0x7fd3981a1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:12.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd3967fc700 1 --2- 172.21.15.43:0/73070743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd398104bb0 0x7fd3981a1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:12.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd3967fc700 1 -- 172.21.15.43:0/73070743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3981a2290 con 0x7fd398104210 2024-04-25T13:36:12.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.354+0000 7fd3977fe700 1 --2- 172.21.15.43:0/73070743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd398104bb0 0x7fd3981a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:36:12.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.355+0000 7fd3967fc700 1 --2- 172.21.15.43:0/73070743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd398104210 0x7fd39819ac70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd3880098e0 tx=0x7fd38800b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:36:12.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.355+0000 7fd39c9d2700 1 -- 172.21.15.43:0/73070743 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388026070 con 0x7fd398104210 2024-04-25T13:36:12.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.355+0000 7fd39c9d2700 1 -- 172.21.15.43:0/73070743 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd388003d20 con 0x7fd398104210 2024-04-25T13:36:12.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.355+0000 7fd39c9d2700 1 -- 172.21.15.43:0/73070743 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38800fe10 con 0x7fd398104210 2024-04-25T13:36:12.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.355+0000 7fd39d9d4700 1 -- 172.21.15.43:0/73070743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd398105430 con 0x7fd398104210 2024-04-25T13:36:12.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.355+0000 7fd39d9d4700 1 -- 172.21.15.43:0/73070743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd398105910 con 0x7fd398104210 2024-04-25T13:36:12.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.356+0000 7fd39d9d4700 1 -- 172.21.15.43:0/73070743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd398051190 con 0x7fd398104210 2024-04-25T13:36:12.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.356+0000 7fd39c9d2700 1 -- 172.21.15.43:0/73070743 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 13) ==== 49572+0+0 (secure 0 0 0) 0x7fd388029070 con 0x7fd398104210 2024-04-25T13:36:12.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.356+0000 7fd39c9d2700 1 --2- 172.21.15.43:0/73070743 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd38403d850 0x7fd38403fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:36:12.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.356+0000 7fd39c9d2700 1 -- 172.21.15.43:0/73070743 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd388052800 con 0x7fd398104210 2024-04-25T13:36:12.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.357+0000 7fd396ffd700 1 --2- 172.21.15.43:0/73070743 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd38403d850 0x7fd38403fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:36:12.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.357+0000 7fd396ffd700 1 --2- 172.21.15.43:0/73070743 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd38403d850 0x7fd38403fd60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd398104110 tx=0x7fd380009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:36:12.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.362+0000 7fd39c9d2700 1 -- 172.21.15.43:0/73070743 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd388013070 con 0x7fd398104210 2024-04-25T13:36:12.486 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:12 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:12.189+0000 7efcf5be4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:36:12.486 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:12 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:12.287+0000 7efcf5be4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:36:12.486 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:12 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:12.486+0000 7efcf5be4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T13:36:12.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:12.581+0000 7fd39d9d4700 1 -- 172.21.15.43:0/73070743 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd3981007f0 con 0x7fd38403d850 2024-04-25T13:36:12.852 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:12 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:12.565+0000 7f41e1fca200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:36:12.853 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:12 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:12.731+0000 7f41e1fca200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:36:13.183 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:12 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:12.901+0000 7f41e1fca200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:36:13.183 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:13.183 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.183 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.183 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.183 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.183 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:13.183 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:13.184 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.184 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: Reconfiguring mgr.x (unknown last config time)... 2024-04-25T13:36:13.184 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T13:36:13.184 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T13:36:13.184 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:13.184 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: Reconfiguring daemon mgr.x on smithi043 2024-04-25T13:36:13.184 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:36:13.184 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:36:13.184 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:36:13.184 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:13.184 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:13.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:13.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:13.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: Reconfiguring mgr.x (unknown last config time)... 2024-04-25T13:36:13.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T13:36:13.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T13:36:13.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:13.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: Reconfiguring daemon mgr.x on smithi043 2024-04-25T13:36:13.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:36:13.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:36:13.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:36:13.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:13.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:13 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.340 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:13.006+0000 7efcf5be4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:36:13.340 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:13.099+0000 7efcf5be4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:36:13.340 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:13.340 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.340 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.341 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.341 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.341 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:13.341 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:13.341 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.341 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: Reconfiguring mgr.x (unknown last config time)... 2024-04-25T13:36:13.341 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T13:36:13.341 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T13:36:13.341 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:13.341 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: Reconfiguring daemon mgr.x on smithi043 2024-04-25T13:36:13.341 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:36:13.341 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:36:13.341 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:36:13.341 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:13.342 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:13.473 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:13.182+0000 7f41e1fca200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:36:13.473 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:13.272+0000 7f41e1fca200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:36:13.473 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:13.472+0000 7f41e1fca200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:36:13.680 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:13.340+0000 7efcf5be4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:36:13.680 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:13.472+0000 7efcf5be4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:36:13.680 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:13.565+0000 7efcf5be4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:36:13.680 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:13.680+0000 7efcf5be4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:36:13.853 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:13 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:13.659+0000 7f41e1fca200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:36:14.431 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:13.983+0000 7efcf5be4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:36:14.603 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:14 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:14.257+0000 7f41e1fca200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T13:36:14.905 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:14 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:14.580+0000 7efcf5be4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:36:14.906 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:36:14 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:36:14.794+0000 7efcf5be4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:36:14.956 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:14 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:14.667+0000 7f41e1fca200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:36:14.956 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:14 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:14.760+0000 7f41e1fca200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:36:14.957 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:14 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:14.955+0000 7f41e1fca200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T13:36:14.957 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:14 smithi161 ceph-mon[32696]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:14.957 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:14 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:14.957 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:14 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:14.957 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:14 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:14.957 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:14 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:14.957 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:14 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:14.957 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:14 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:14.957 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:14 smithi161 ceph-mon[32696]: Standby manager daemon z started 2024-04-25T13:36:14.957 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:14 smithi161 ceph-mon[32696]: from='mgr.? 172.21.15.175:0/64478776' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T13:36:14.957 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:14 smithi161 ceph-mon[32696]: from='mgr.? 172.21.15.175:0/64478776' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T13:36:14.958 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:14 smithi161 ceph-mon[32696]: from='mgr.? 172.21.15.175:0/64478776' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T13:36:14.958 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:14 smithi161 ceph-mon[32696]: from='mgr.? 172.21.15.175:0/64478776' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T13:36:14.995 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:14 smithi043 ceph-mon[29195]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:14.995 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:14 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:14.995 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:14 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:14.996 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:14 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:14.996 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:14 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:14.996 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:14 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:14.996 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:14 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:14.996 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:14 smithi043 ceph-mon[29195]: Standby manager daemon z started 2024-04-25T13:36:14.996 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:14 smithi043 ceph-mon[29195]: from='mgr.? 172.21.15.175:0/64478776' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T13:36:14.996 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:14 smithi043 ceph-mon[29195]: from='mgr.? 172.21.15.175:0/64478776' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T13:36:14.996 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:14 smithi043 ceph-mon[29195]: from='mgr.? 172.21.15.175:0/64478776' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T13:36:14.996 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:14 smithi043 ceph-mon[29195]: from='mgr.? 172.21.15.175:0/64478776' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T13:36:15.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:15.051+0000 7fd39c9d2700 1 -- 172.21.15.43:0/73070743 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mgrmap(e 14) ==== 98518+0+0 (secure 0 0 0) 0x7fd388009d10 con 0x7fd398104210 2024-04-25T13:36:15.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:14 smithi175 ceph-mon[32649]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:15.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:14 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:15.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:14 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:15.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:14 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:15.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:14 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:15.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:14 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:15.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:14 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:15.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:14 smithi175 ceph-mon[32649]: Standby manager daemon z started 2024-04-25T13:36:15.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:14 smithi175 ceph-mon[32649]: from='mgr.? 172.21.15.175:0/64478776' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T13:36:15.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:14 smithi175 ceph-mon[32649]: from='mgr.? 172.21.15.175:0/64478776' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T13:36:15.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:14 smithi175 ceph-mon[32649]: from='mgr.? 172.21.15.175:0/64478776' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T13:36:15.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:14 smithi175 ceph-mon[32649]: from='mgr.? 172.21.15.175:0/64478776' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T13:36:15.796 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:15 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:15.471+0000 7f41e1fca200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:36:15.796 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:15 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:15.561+0000 7f41e1fca200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:36:16.055 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:15 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:15.795+0000 7f41e1fca200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:36:16.056 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:15 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:15.924+0000 7f41e1fca200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:36:16.056 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:16 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:16.016+0000 7f41e1fca200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:36:16.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:16 smithi161 ceph-mon[32696]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-25T13:36:16.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:16 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T13:36:16.353 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:16 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:16.130+0000 7f41e1fca200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:36:16.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:16 smithi175 ceph-mon[32649]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-25T13:36:16.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:16 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T13:36:16.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:16 smithi043 ceph-mon[29195]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-25T13:36:16.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:16 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T13:36:16.853 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:16 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:16.432+0000 7f41e1fca200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:36:17.353 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:17 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:17.018+0000 7f41e1fca200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:36:17.353 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:36:17 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:36:17.228+0000 7f41e1fca200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:36:17.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:17 smithi161 ceph-mon[32696]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:17.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:17 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/688253789' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8e639a2-eae9-4bfb-8f2c-f94cc7d86943"}]: dispatch 2024-04-25T13:36:17.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:17 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/688253789' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8e639a2-eae9-4bfb-8f2c-f94cc7d86943"}]': finished 2024-04-25T13:36:17.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:17 smithi161 ceph-mon[32696]: osdmap e5: 1 total, 0 up, 1 in 2024-04-25T13:36:17.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:17 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:17.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:17 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/59827206' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:36:17.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:17 smithi175 ceph-mon[32649]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:17.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:17 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/688253789' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8e639a2-eae9-4bfb-8f2c-f94cc7d86943"}]: dispatch 2024-04-25T13:36:17.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:17 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/688253789' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8e639a2-eae9-4bfb-8f2c-f94cc7d86943"}]': finished 2024-04-25T13:36:17.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:17 smithi175 ceph-mon[32649]: osdmap e5: 1 total, 0 up, 1 in 2024-04-25T13:36:17.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:17 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:17.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:17 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/59827206' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:36:17.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:17 smithi043 ceph-mon[29195]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:17.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:17 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/688253789' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8e639a2-eae9-4bfb-8f2c-f94cc7d86943"}]: dispatch 2024-04-25T13:36:17.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:17 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/688253789' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8e639a2-eae9-4bfb-8f2c-f94cc7d86943"}]': finished 2024-04-25T13:36:17.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:17 smithi043 ceph-mon[29195]: osdmap e5: 1 total, 0 up, 1 in 2024-04-25T13:36:17.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:17 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:17.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:17 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/59827206' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:36:18.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:18.067+0000 7fd39c9d2700 1 -- 172.21.15.43:0/73070743 <== mon.1 v2:172.21.15.175:3300/0 8 ==== mgrmap(e 15) ==== 147464+0+0 (secure 0 0 0) 0x7fd388029360 con 0x7fd398104210 2024-04-25T13:36:18.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:18 smithi161 ceph-mon[32696]: Standby manager daemon y started 2024-04-25T13:36:18.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:18 smithi161 ceph-mon[32696]: from='mgr.? 172.21.15.161:0/2397963806' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T13:36:18.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:18 smithi161 ceph-mon[32696]: from='mgr.? 172.21.15.161:0/2397963806' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T13:36:18.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:18 smithi161 ceph-mon[32696]: from='mgr.? 172.21.15.161:0/2397963806' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T13:36:18.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:18 smithi161 ceph-mon[32696]: from='mgr.? 172.21.15.161:0/2397963806' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T13:36:18.365 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:18 smithi043 ceph-mon[29195]: Standby manager daemon y started 2024-04-25T13:36:18.365 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:18 smithi043 ceph-mon[29195]: from='mgr.? 172.21.15.161:0/2397963806' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T13:36:18.365 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:18 smithi043 ceph-mon[29195]: from='mgr.? 172.21.15.161:0/2397963806' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T13:36:18.365 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:18 smithi043 ceph-mon[29195]: from='mgr.? 172.21.15.161:0/2397963806' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T13:36:18.365 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:18 smithi043 ceph-mon[29195]: from='mgr.? 172.21.15.161:0/2397963806' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T13:36:18.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:18 smithi175 ceph-mon[32649]: Standby manager daemon y started 2024-04-25T13:36:18.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:18 smithi175 ceph-mon[32649]: from='mgr.? 172.21.15.161:0/2397963806' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T13:36:18.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:18 smithi175 ceph-mon[32649]: from='mgr.? 172.21.15.161:0/2397963806' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T13:36:18.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:18 smithi175 ceph-mon[32649]: from='mgr.? 172.21.15.161:0/2397963806' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T13:36:18.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:18 smithi175 ceph-mon[32649]: from='mgr.? 172.21.15.161:0/2397963806' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T13:36:19.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:19 smithi161 ceph-mon[32696]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:19.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:19 smithi161 ceph-mon[32696]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-04-25T13:36:19.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:19 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T13:36:19.381 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:19 smithi043 ceph-mon[29195]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:19.381 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:19 smithi043 ceph-mon[29195]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-04-25T13:36:19.381 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:19 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T13:36:19.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:19 smithi175 ceph-mon[32649]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:19.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:19 smithi175 ceph-mon[32649]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-04-25T13:36:19.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:19 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T13:36:21.347 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:21 smithi043 ceph-mon[29195]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:21.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:21 smithi161 ceph-mon[32696]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:21.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:21 smithi175 ceph-mon[32649]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:23.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:23 smithi161 ceph-mon[32696]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:23.382 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:23 smithi043 ceph-mon[29195]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:23.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:23 smithi175 ceph-mon[32649]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:24.318 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:24 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T13:36:24.318 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:24 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:24.318 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:24 smithi043 ceph-mon[29195]: Deploying daemon osd.0 on smithi043 2024-04-25T13:36:24.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:24 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T13:36:24.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:24 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:24.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:24 smithi161 ceph-mon[32696]: Deploying daemon osd.0 on smithi043 2024-04-25T13:36:24.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:24 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T13:36:24.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:24 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:24.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:24 smithi175 ceph-mon[32649]: Deploying daemon osd.0 on smithi043 2024-04-25T13:36:25.340 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:25 smithi043 ceph-mon[29195]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:25.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:25 smithi161 ceph-mon[32696]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:25.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:25 smithi175 ceph-mon[32649]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:27.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:27 smithi043 ceph-mon[29195]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:27.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:27 smithi161 ceph-mon[32696]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:27.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:27 smithi175 ceph-mon[32649]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:29.341 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:29 smithi043 ceph-mon[29195]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:29.342 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:29 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:29.342 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:29 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:29.342 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:29 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:29.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:29 smithi161 ceph-mon[32696]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:29.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:29 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:29.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:29 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:29.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:29 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:29.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:29 smithi175 ceph-mon[32649]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:29.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:29 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:29.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:29 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:29.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:29 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:31.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:31 smithi161 ceph-mon[32696]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:31.368 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:31 smithi043 ceph-mon[29195]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:31.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:31 smithi175 ceph-mon[32649]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:32.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:32.741+0000 7fd39c9d2700 1 -- 172.21.15.43:0/73070743 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd3981007f0 con 0x7fd38403d850 2024-04-25T13:36:32.743 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 0 on host 'smithi043' 2024-04-25T13:36:32.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:32.743+0000 7fd39d9d4700 1 -- 172.21.15.43:0/73070743 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd38403d850 msgr2=0x7fd38403fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:32.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:32.743+0000 7fd39d9d4700 1 --2- 172.21.15.43:0/73070743 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd38403d850 0x7fd38403fd60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd398104110 tx=0x7fd380009260 comp rx=0 tx=0).stop 2024-04-25T13:36:32.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:32.743+0000 7fd39d9d4700 1 -- 172.21.15.43:0/73070743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd398104210 msgr2=0x7fd39819ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:32.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:32.743+0000 7fd39d9d4700 1 --2- 172.21.15.43:0/73070743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd398104210 0x7fd39819ac70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd3880098e0 tx=0x7fd38800b9e0 comp rx=0 tx=0).stop 2024-04-25T13:36:32.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:32.743+0000 7fd39d9d4700 1 -- 172.21.15.43:0/73070743 shutdown_connections 2024-04-25T13:36:32.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:32.743+0000 7fd39d9d4700 1 --2- 172.21.15.43:0/73070743 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd38403d850 0x7fd38403fd60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:32.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:32.743+0000 7fd39d9d4700 1 --2- 172.21.15.43:0/73070743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd398104bb0 0x7fd3981a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:32.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:32.743+0000 7fd39d9d4700 1 --2- 172.21.15.43:0/73070743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3981030e0 0x7fd39819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:32.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:32.743+0000 7fd39d9d4700 1 --2- 172.21.15.43:0/73070743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd398104210 0x7fd39819ac70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:32.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:32.743+0000 7fd39d9d4700 1 -- 172.21.15.43:0/73070743 >> 172.21.15.43:0/73070743 conn(0x7fd3980fe740 msgr2=0x7fd3981000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:36:32.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:32.743+0000 7fd39d9d4700 1 -- 172.21.15.43:0/73070743 shutdown_connections 2024-04-25T13:36:32.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:36:32.743+0000 7fd39d9d4700 1 -- 172.21.15.43:0/73070743 wait complete. 2024-04-25T13:36:32.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:32 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:32.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:32 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:32.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:32 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:32.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:32 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:32.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:32 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:32.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:32 smithi175 ceph-mon[32649]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:32.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:32 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:32.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:32 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:32.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:32 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:32.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:32 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:32.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:32 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:32.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:32 smithi043 ceph-mon[29195]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:33.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:32 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:33.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:32 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:33.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:32 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:33.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:32 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:33.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:32 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:33.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:32 smithi161 ceph-mon[32696]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:33.417 DEBUG:teuthology.orchestra.run.smithi043:osd.0> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.0.service 2024-04-25T13:36:33.419 INFO:tasks.cephadm:Deploying osd.1 on smithi161 with /dev/vg_nvme/lv_4... 2024-04-25T13:36:33.420 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-25T13:36:33.660 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T13:36:33.782 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:33.782 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:33.782 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:33.782 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:33 smithi161 ceph-mon[32696]: from='osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T13:36:33.942 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:33.942 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:33.942 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:33.943 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:33 smithi043 ceph-mon[29195]: from='osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T13:36:34.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:34.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:34.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:34.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:33 smithi175 ceph-mon[32649]: from='osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T13:36:34.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:34 smithi043 ceph-mon[29195]: from='osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T13:36:34.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:34 smithi043 ceph-mon[29195]: osdmap e6: 1 total, 0 up, 1 in 2024-04-25T13:36:34.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:34 smithi043 ceph-mon[29195]: from='osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T13:36:34.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:34 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:34.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:34 smithi043 ceph-mon[29195]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:35.012 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:34 smithi161 ceph-mon[32696]: from='osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T13:36:35.012 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:34 smithi161 ceph-mon[32696]: osdmap e6: 1 total, 0 up, 1 in 2024-04-25T13:36:35.013 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:34 smithi161 ceph-mon[32696]: from='osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T13:36:35.013 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:34 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:35.013 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:34 smithi161 ceph-mon[32696]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:34 smithi175 ceph-mon[32649]: from='osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T13:36:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:34 smithi175 ceph-mon[32649]: osdmap e6: 1 total, 0 up, 1 in 2024-04-25T13:36:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:34 smithi175 ceph-mon[32649]: from='osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T13:36:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:34 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:34 smithi175 ceph-mon[32649]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:35.573 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-25T13:36:35.573 INFO:teuthology.orchestra.run.smithi161.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-25T13:36:35.574 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10+0 records in 2024-04-25T13:36:35.574 INFO:teuthology.orchestra.run.smithi161.stderr:10+0 records out 2024-04-25T13:36:35.574 INFO:teuthology.orchestra.run.smithi161.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114385 s, 917 MB/s 2024-04-25T13:36:35.574 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping successful for: 2024-04-25T13:36:35.711 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:36:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-0[44092]: 2024-04-25T13:36:35.309+0000 7f31505d8700 -1 osd.0 0 waiting for initial osdmap 2024-04-25T13:36:35.711 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:36:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-0[44092]: 2024-04-25T13:36:35.313+0000 7f3148385700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:36:35.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:35 smithi043 ceph-mon[29195]: from='osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T13:36:35.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:35 smithi043 ceph-mon[29195]: osdmap e7: 1 total, 0 up, 1 in 2024-04-25T13:36:35.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:35 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:35.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:35 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:35.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:35 smithi043 ceph-mon[29195]: from='osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348]' entity='osd.0' 2024-04-25T13:36:36.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:35 smithi161 ceph-mon[32696]: from='osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T13:36:36.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:35 smithi161 ceph-mon[32696]: osdmap e7: 1 total, 0 up, 1 in 2024-04-25T13:36:36.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:35 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:36.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:35 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:36.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:35 smithi161 ceph-mon[32696]: from='osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348]' entity='osd.0' 2024-04-25T13:36:36.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:35 smithi175 ceph-mon[32649]: from='osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T13:36:36.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:35 smithi175 ceph-mon[32649]: osdmap e7: 1 total, 0 up, 1 in 2024-04-25T13:36:36.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:35 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:36.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:35 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:36.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:35 smithi175 ceph-mon[32649]: from='osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348]' entity='osd.0' 2024-04-25T13:36:36.207 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi161:vg_nvme/lv_4 2024-04-25T13:36:36.461 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T13:36:36.829 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:36 smithi161 ceph-mon[32696]: purged_snaps scrub starts 2024-04-25T13:36:36.829 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:36 smithi161 ceph-mon[32696]: purged_snaps scrub ok 2024-04-25T13:36:36.830 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:36.830 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:36 smithi161 ceph-mon[32696]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:36.830 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:36 smithi161 ceph-mon[32696]: osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348] boot 2024-04-25T13:36:36.830 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:36 smithi161 ceph-mon[32696]: osdmap e8: 1 total, 1 up, 1 in 2024-04-25T13:36:36.830 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:36.830 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:36 smithi161 ceph-mon[32696]: Detected new or changed devices on smithi043 2024-04-25T13:36:36.830 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:36.830 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:36.830 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:36:36.830 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:36 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi043 to 17093M 2024-04-25T13:36:36.830 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:36.830 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:36.830 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:36.830 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:36.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:36 smithi043 ceph-mon[29195]: purged_snaps scrub starts 2024-04-25T13:36:36.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:36 smithi043 ceph-mon[29195]: purged_snaps scrub ok 2024-04-25T13:36:36.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:36.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:36 smithi043 ceph-mon[29195]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:36.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:36 smithi043 ceph-mon[29195]: osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348] boot 2024-04-25T13:36:36.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:36 smithi043 ceph-mon[29195]: osdmap e8: 1 total, 1 up, 1 in 2024-04-25T13:36:36.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:36.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:36 smithi043 ceph-mon[29195]: Detected new or changed devices on smithi043 2024-04-25T13:36:36.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:36.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:36.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:36:36.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:36 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi043 to 17093M 2024-04-25T13:36:36.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:36.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:36.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:36.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:37.082 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:36 smithi175 ceph-mon[32649]: purged_snaps scrub starts 2024-04-25T13:36:37.082 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:36 smithi175 ceph-mon[32649]: purged_snaps scrub ok 2024-04-25T13:36:37.082 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:37.082 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:36 smithi175 ceph-mon[32649]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T13:36:37.083 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:36 smithi175 ceph-mon[32649]: osd.0 [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348] boot 2024-04-25T13:36:37.083 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:36 smithi175 ceph-mon[32649]: osdmap e8: 1 total, 1 up, 1 in 2024-04-25T13:36:37.083 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:36:37.083 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:36 smithi175 ceph-mon[32649]: Detected new or changed devices on smithi043 2024-04-25T13:36:37.083 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:37.083 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:37.083 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:36:37.083 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:36 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi043 to 17093M 2024-04-25T13:36:37.083 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:37.083 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:37.083 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:36:37.083 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:38.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.030+0000 7ff84db36700 1 -- 172.21.15.161:0/3030793419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff848105d10 msgr2=0x7ff84810c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:38.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.030+0000 7ff84db36700 1 --2- 172.21.15.161:0/3030793419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff848105d10 0x7ff84810c5c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff84000b0a0 tx=0x7ff84000b3b0 comp rx=0 tx=0).stop 2024-04-25T13:36:38.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.030+0000 7ff84db36700 1 -- 172.21.15.161:0/3030793419 shutdown_connections 2024-04-25T13:36:38.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.030+0000 7ff84db36700 1 --2- 172.21.15.161:0/3030793419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff848105d10 0x7ff84810c5c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:38.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.030+0000 7ff84db36700 1 --2- 172.21.15.161:0/3030793419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff848104240 0x7ff848104650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:38.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.030+0000 7ff84db36700 1 --2- 172.21.15.161:0/3030793419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff848105370 0x7ff848105780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:38.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.030+0000 7ff84db36700 1 -- 172.21.15.161:0/3030793419 >> 172.21.15.161:0/3030793419 conn(0x7ff8480ff8a0 msgr2=0x7ff848101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:36:38.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.030+0000 7ff84db36700 1 -- 172.21.15.161:0/3030793419 shutdown_connections 2024-04-25T13:36:38.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.030+0000 7ff84db36700 1 -- 172.21.15.161:0/3030793419 wait complete. 2024-04-25T13:36:38.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.031+0000 7ff84db36700 1 Processor -- start 2024-04-25T13:36:38.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.031+0000 7ff84db36700 1 -- start start 2024-04-25T13:36:38.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.031+0000 7ff84db36700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff848104240 0x7ff84819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:36:38.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.031+0000 7ff84db36700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff848105370 0x7ff84819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:36:38.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.031+0000 7ff84db36700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff848105d10 0x7ff8481a1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:36:38.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.031+0000 7ff84db36700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff84810fba0 con 0x7ff848105370 2024-04-25T13:36:38.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.031+0000 7ff84db36700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ff84810fa20 con 0x7ff848105d10 2024-04-25T13:36:38.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.031+0000 7ff84db36700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff84810fd20 con 0x7ff848104240 2024-04-25T13:36:38.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.031+0000 7ff847fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff848105d10 0x7ff8481a1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:36:38.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.031+0000 7ff847fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff848105d10 0x7ff8481a1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36144/0 (socket says 172.21.15.161:36144) 2024-04-25T13:36:38.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.031+0000 7ff847fff700 1 -- 172.21.15.161:0/316052585 learned_addr learned my addr 172.21.15.161:0/316052585 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-04-25T13:36:38.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.031+0000 7ff8477fe700 1 --2- 172.21.15.161:0/316052585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff848104240 0x7ff84819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:36:38.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.031+0000 7ff846ffd700 1 --2- 172.21.15.161:0/316052585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff848105370 0x7ff84819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:36:38.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.032+0000 7ff847fff700 1 -- 172.21.15.161:0/316052585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff848104240 msgr2=0x7ff84819a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:38.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.032+0000 7ff847fff700 1 --2- 172.21.15.161:0/316052585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff848104240 0x7ff84819a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:38.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.032+0000 7ff847fff700 1 -- 172.21.15.161:0/316052585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff848105370 msgr2=0x7ff84819ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:38.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.032+0000 7ff847fff700 1 --2- 172.21.15.161:0/316052585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff848105370 0x7ff84819ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:38.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.032+0000 7ff847fff700 1 -- 172.21.15.161:0/316052585 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8481a2220 con 0x7ff848105d10 2024-04-25T13:36:38.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.032+0000 7ff847fff700 1 --2- 172.21.15.161:0/316052585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff848105d10 0x7ff8481a1ba0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff84000b830 tx=0x7ff840009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:36:38.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.032+0000 7ff844ff9700 1 -- 172.21.15.161:0/316052585 <== mon.2 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840021070 con 0x7ff848105d10 2024-04-25T13:36:38.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.032+0000 7ff84db36700 1 -- 172.21.15.161:0/316052585 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8481a24b0 con 0x7ff848105d10 2024-04-25T13:36:38.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.032+0000 7ff844ff9700 1 -- 172.21.15.161:0/316052585 <== mon.2 v2:172.21.15.161:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff840007b80 con 0x7ff848105d10 2024-04-25T13:36:38.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.032+0000 7ff844ff9700 1 -- 172.21.15.161:0/316052585 <== mon.2 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84001b690 con 0x7ff848105d10 2024-04-25T13:36:38.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.032+0000 7ff84db36700 1 -- 172.21.15.161:0/316052585 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8481a2910 con 0x7ff848105d10 2024-04-25T13:36:38.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.033+0000 7ff84db36700 1 -- 172.21.15.161:0/316052585 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff848051190 con 0x7ff848105d10 2024-04-25T13:36:38.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.035+0000 7ff844ff9700 1 -- 172.21.15.161:0/316052585 <== mon.2 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 15) ==== 147464+0+0 (secure 0 0 0) 0x7ff840024070 con 0x7ff848105d10 2024-04-25T13:36:38.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.035+0000 7ff844ff9700 1 --2- 172.21.15.161:0/316052585 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff8300afaf0 0x7ff8300b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:36:38.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.035+0000 7ff844ff9700 1 -- 172.21.15.161:0/316052585 <== mon.2 v2:172.21.15.161:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7ff84000f020 con 0x7ff848105d10 2024-04-25T13:36:38.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.035+0000 7ff8477fe700 1 --2- 172.21.15.161:0/316052585 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff8300afaf0 0x7ff8300b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:36:38.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.036+0000 7ff8477fe700 1 --2- 172.21.15.161:0/316052585 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff8300afaf0 0x7ff8300b2000 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff848105270 tx=0x7ff838007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:36:38.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.039+0000 7ff844ff9700 1 -- 172.21.15.161:0/316052585 <== mon.2 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff84002b020 con 0x7ff848105d10 2024-04-25T13:36:38.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:38.248+0000 7ff84db36700 1 -- 172.21.15.161:0/316052585 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ff848063ad0 con 0x7ff8300afaf0 2024-04-25T13:36:39.062 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:38 smithi161 ceph-mon[32696]: osdmap e9: 1 total, 1 up, 1 in 2024-04-25T13:36:39.062 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:38 smithi161 ceph-mon[32696]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:39.062 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:38 smithi161 ceph-mon[32696]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:36:39.062 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:38 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:36:39.062 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:38 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:36:39.063 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:38 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:39.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:38 smithi175 ceph-mon[32649]: osdmap e9: 1 total, 1 up, 1 in 2024-04-25T13:36:39.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:38 smithi175 ceph-mon[32649]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:39.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:38 smithi175 ceph-mon[32649]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:36:39.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:38 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:36:39.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:38 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:36:39.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:38 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:39.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:38 smithi043 ceph-mon[29195]: osdmap e9: 1 total, 1 up, 1 in 2024-04-25T13:36:39.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:38 smithi043 ceph-mon[29195]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:39.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:38 smithi043 ceph-mon[29195]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:36:39.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:38 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:36:39.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:38 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:36:39.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:38 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:40 smithi175 ceph-mon[32649]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:40 smithi175 ceph-mon[32649]: from='client.? 172.21.15.161:0/3260635918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "060783b1-704f-4e3a-ba2b-b07d8e6b8946"}]: dispatch 2024-04-25T13:36:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:40 smithi175 ceph-mon[32649]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "060783b1-704f-4e3a-ba2b-b07d8e6b8946"}]: dispatch 2024-04-25T13:36:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:40 smithi175 ceph-mon[32649]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "060783b1-704f-4e3a-ba2b-b07d8e6b8946"}]': finished 2024-04-25T13:36:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:40 smithi175 ceph-mon[32649]: osdmap e10: 2 total, 1 up, 2 in 2024-04-25T13:36:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:40 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:36:41.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:40 smithi043 ceph-mon[29195]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:41.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:40 smithi043 ceph-mon[29195]: from='client.? 172.21.15.161:0/3260635918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "060783b1-704f-4e3a-ba2b-b07d8e6b8946"}]: dispatch 2024-04-25T13:36:41.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:40 smithi043 ceph-mon[29195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "060783b1-704f-4e3a-ba2b-b07d8e6b8946"}]: dispatch 2024-04-25T13:36:41.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:40 smithi043 ceph-mon[29195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "060783b1-704f-4e3a-ba2b-b07d8e6b8946"}]': finished 2024-04-25T13:36:41.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:40 smithi043 ceph-mon[29195]: osdmap e10: 2 total, 1 up, 2 in 2024-04-25T13:36:41.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:40 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:36:41.218 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:40 smithi161 ceph-mon[32696]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:41.218 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:40 smithi161 ceph-mon[32696]: from='client.? 172.21.15.161:0/3260635918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "060783b1-704f-4e3a-ba2b-b07d8e6b8946"}]: dispatch 2024-04-25T13:36:41.218 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:40 smithi161 ceph-mon[32696]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "060783b1-704f-4e3a-ba2b-b07d8e6b8946"}]: dispatch 2024-04-25T13:36:41.218 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:40 smithi161 ceph-mon[32696]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "060783b1-704f-4e3a-ba2b-b07d8e6b8946"}]': finished 2024-04-25T13:36:41.218 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:40 smithi161 ceph-mon[32696]: osdmap e10: 2 total, 1 up, 2 in 2024-04-25T13:36:41.218 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:40 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:36:42.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:41 smithi175 ceph-mon[32649]: from='client.? 172.21.15.161:0/1638854517' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:36:42.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:41 smithi043 ceph-mon[29195]: from='client.? 172.21.15.161:0/1638854517' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:36:42.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:41 smithi161 ceph-mon[32696]: from='client.? 172.21.15.161:0/1638854517' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:36:43.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:42 smithi175 ceph-mon[32649]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:43.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:42 smithi043 ceph-mon[29195]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:43.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:42 smithi161 ceph-mon[32696]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:45.139 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:44 smithi161 ceph-mon[32696]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:45.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:44 smithi175 ceph-mon[32649]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:45.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:44 smithi043 ceph-mon[29195]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:46.995 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:46 smithi161 ceph-mon[32696]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:47.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:46 smithi175 ceph-mon[32649]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:47.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:46 smithi043 ceph-mon[29195]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:48.979 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:48 smithi161 ceph-mon[32696]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:48.980 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T13:36:48.980 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:48.980 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:48 smithi161 ceph-mon[32696]: Deploying daemon osd.1 on smithi161 2024-04-25T13:36:49.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:48 smithi175 ceph-mon[32649]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:49.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T13:36:49.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:49.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:48 smithi175 ceph-mon[32649]: Deploying daemon osd.1 on smithi161 2024-04-25T13:36:49.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:48 smithi043 ceph-mon[29195]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:49.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T13:36:49.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:36:49.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:48 smithi043 ceph-mon[29195]: Deploying daemon osd.1 on smithi161 2024-04-25T13:36:51.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:50 smithi175 ceph-mon[32649]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:51.192 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:50 smithi161 ceph-mon[32696]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:51.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:50 smithi043 ceph-mon[29195]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:53.096 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:52 smithi161 ceph-mon[32696]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:53.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:52 smithi175 ceph-mon[32649]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:53.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:52 smithi043 ceph-mon[29195]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:54.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:54 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:54.854 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:54 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:54.854 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:54 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:54.854 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:54 smithi161 ceph-mon[32696]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:54.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:54 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:54.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:54 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:54.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:54 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:54.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:54 smithi175 ceph-mon[32649]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:54.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:54 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:54.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:54 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:54.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:54 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:36:54.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:54 smithi043 ceph-mon[29195]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:56.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:56.813+0000 7ff844ff9700 1 -- 172.21.15.161:0/316052585 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff848063ad0 con 0x7ff8300afaf0 2024-04-25T13:36:56.816 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 1 on host 'smithi161' 2024-04-25T13:36:56.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:56.817+0000 7ff84db36700 1 -- 172.21.15.161:0/316052585 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff8300afaf0 msgr2=0x7ff8300b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:56.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:56.817+0000 7ff84db36700 1 --2- 172.21.15.161:0/316052585 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff8300afaf0 0x7ff8300b2000 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff848105270 tx=0x7ff838007400 comp rx=0 tx=0).stop 2024-04-25T13:36:56.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:56.817+0000 7ff84db36700 1 -- 172.21.15.161:0/316052585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff848105d10 msgr2=0x7ff8481a1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:36:56.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:56.817+0000 7ff84db36700 1 --2- 172.21.15.161:0/316052585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff848105d10 0x7ff8481a1ba0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff84000b830 tx=0x7ff840009bf0 comp rx=0 tx=0).stop 2024-04-25T13:36:56.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:56.817+0000 7ff84db36700 1 -- 172.21.15.161:0/316052585 shutdown_connections 2024-04-25T13:36:56.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:56.817+0000 7ff84db36700 1 --2- 172.21.15.161:0/316052585 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff8300afaf0 0x7ff8300b2000 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:56.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:56.817+0000 7ff84db36700 1 --2- 172.21.15.161:0/316052585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff848105d10 0x7ff8481a1ba0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:56.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:56.817+0000 7ff84db36700 1 --2- 172.21.15.161:0/316052585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff848104240 0x7ff84819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:56.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:56.817+0000 7ff84db36700 1 --2- 172.21.15.161:0/316052585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff848105370 0x7ff84819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:36:56.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:56.817+0000 7ff84db36700 1 -- 172.21.15.161:0/316052585 >> 172.21.15.161:0/316052585 conn(0x7ff8480ff8a0 msgr2=0x7ff8481085a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:36:56.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:56.817+0000 7ff84db36700 1 -- 172.21.15.161:0/316052585 shutdown_connections 2024-04-25T13:36:56.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:36:56.817+0000 7ff84db36700 1 -- 172.21.15.161:0/316052585 wait complete. 2024-04-25T13:36:57.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:56 smithi161 ceph-mon[32696]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:57.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:56 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:57.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:56 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:57.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:56 smithi175 ceph-mon[32649]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:57.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:56 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:57.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:56 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:57.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:56 smithi043 ceph-mon[29195]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:57.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:56 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:57.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:56 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:57.430 DEBUG:teuthology.orchestra.run.smithi161:osd.1> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.1.service 2024-04-25T13:36:57.432 INFO:tasks.cephadm:Deploying osd.2 on smithi175 with /dev/vg_nvme/lv_4... 2024-04-25T13:36:57.432 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-25T13:36:57.678 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T13:36:57.727 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:36:57 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-1[37301]: 2024-04-25T13:36:57.598+0000 7fa37c1ef7c0 -1 osd.1 0 log_to_monitors true 2024-04-25T13:36:58.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:58.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:58.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:58 smithi161 ceph-mon[32696]: from='osd.1 [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T13:36:58.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:58 smithi161 ceph-mon[32696]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T13:36:58.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:58.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:58.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:58 smithi175 ceph-mon[32649]: from='osd.1 [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T13:36:58.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:58 smithi175 ceph-mon[32649]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T13:36:58.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:58.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:36:58.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:58 smithi043 ceph-mon[29195]: from='osd.1 [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T13:36:58.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:58 smithi043 ceph-mon[29195]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T13:36:59.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:59 smithi161 ceph-mon[32696]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:59.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:59 smithi161 ceph-mon[32696]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T13:36:59.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:59 smithi161 ceph-mon[32696]: from='osd.1 [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:36:59.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:59 smithi161 ceph-mon[32696]: osdmap e11: 2 total, 1 up, 2 in 2024-04-25T13:36:59.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:36:59.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:36:59 smithi161 ceph-mon[32696]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:36:59.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:59 smithi175 ceph-mon[32649]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:59.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:59 smithi175 ceph-mon[32649]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T13:36:59.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:59 smithi175 ceph-mon[32649]: from='osd.1 [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:36:59.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:59 smithi175 ceph-mon[32649]: osdmap e11: 2 total, 1 up, 2 in 2024-04-25T13:36:59.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:36:59.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:36:59 smithi175 ceph-mon[32649]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:36:59.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:59 smithi043 ceph-mon[29195]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:36:59.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:59 smithi043 ceph-mon[29195]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T13:36:59.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:59 smithi043 ceph-mon[29195]: from='osd.1 [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:36:59.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:59 smithi043 ceph-mon[29195]: osdmap e11: 2 total, 1 up, 2 in 2024-04-25T13:36:59.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:36:59.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:36:59 smithi043 ceph-mon[29195]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:36:59.542 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-25T13:36:59.542 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-25T13:36:59.542 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2024-04-25T13:36:59.543 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2024-04-25T13:36:59.543 INFO:teuthology.orchestra.run.smithi175.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0121722 s, 861 MB/s 2024-04-25T13:36:59.543 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2024-04-25T13:37:00.114 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:36:59 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-1[37301]: 2024-04-25T13:36:59.855+0000 7fa371854700 -1 osd.1 0 waiting for initial osdmap 2024-04-25T13:37:00.114 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:36:59 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-1[37301]: 2024-04-25T13:36:59.860+0000 7fa369601700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:37:00.200 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_4 2024-04-25T13:37:00.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:00 smithi175 ceph-mon[32649]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-04-25T13:37:00.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:00 smithi175 ceph-mon[32649]: osdmap e12: 2 total, 1 up, 2 in 2024-04-25T13:37:00.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:37:00.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:37:00.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:00 smithi175 ceph-mon[32649]: from='osd.1 ' entity='osd.1' 2024-04-25T13:37:00.443 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T13:37:00.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:00 smithi043 ceph-mon[29195]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-04-25T13:37:00.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:00 smithi043 ceph-mon[29195]: osdmap e12: 2 total, 1 up, 2 in 2024-04-25T13:37:00.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:37:00.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:37:00.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:00 smithi043 ceph-mon[29195]: from='osd.1 ' entity='osd.1' 2024-04-25T13:37:00.546 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:00 smithi161 ceph-mon[32696]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-04-25T13:37:00.547 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:00 smithi161 ceph-mon[32696]: osdmap e12: 2 total, 1 up, 2 in 2024-04-25T13:37:00.547 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:37:00.547 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:37:00.547 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:00 smithi161 ceph-mon[32696]: from='osd.1 ' entity='osd.1' 2024-04-25T13:37:01.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: purged_snaps scrub starts 2024-04-25T13:37:01.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: purged_snaps scrub ok 2024-04-25T13:37:01.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:37:01.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:37:01.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: Detected new or changed devices on smithi161 2024-04-25T13:37:01.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:01.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:01.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:37:01.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi161 to 17088M 2024-04-25T13:37:01.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:01.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:01.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:01.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:01.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:37:01.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:01.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:01.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:01.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: osd.1 [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337] boot 2024-04-25T13:37:01.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: osdmap e13: 2 total, 2 up, 2 in 2024-04-25T13:37:01.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:01 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:37:01.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: purged_snaps scrub starts 2024-04-25T13:37:01.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: purged_snaps scrub ok 2024-04-25T13:37:01.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:37:01.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:37:01.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: Detected new or changed devices on smithi161 2024-04-25T13:37:01.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:01.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:01.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:37:01.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi161 to 17088M 2024-04-25T13:37:01.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:01.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:01.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:01.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:01.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:37:01.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:01.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:01.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:01.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: osd.1 [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337] boot 2024-04-25T13:37:01.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: osdmap e13: 2 total, 2 up, 2 in 2024-04-25T13:37:01.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:01 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:37:01.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: purged_snaps scrub starts 2024-04-25T13:37:01.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: purged_snaps scrub ok 2024-04-25T13:37:01.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T13:37:01.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:37:01.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: Detected new or changed devices on smithi161 2024-04-25T13:37:01.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:01.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:01.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:37:01.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi161 to 17088M 2024-04-25T13:37:01.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:01.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:01.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:01.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:01.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:37:01.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:01.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:01.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:01.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: osd.1 [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337] boot 2024-04-25T13:37:01.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: osdmap e13: 2 total, 2 up, 2 in 2024-04-25T13:37:01.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:01 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:37:01.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.865+0000 7fdfaa4d7700 1 -- 172.21.15.175:0/2804270522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa4105d10 msgr2=0x7fdfa410c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:37:01.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.865+0000 7fdfaa4d7700 1 --2- 172.21.15.175:0/2804270522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa4105d10 0x7fdfa410c5c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00b0a0 tx=0x7fdf9c00b3b0 comp rx=0 tx=0).stop 2024-04-25T13:37:01.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.865+0000 7fdfaa4d7700 1 -- 172.21.15.175:0/2804270522 shutdown_connections 2024-04-25T13:37:01.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.865+0000 7fdfaa4d7700 1 --2- 172.21.15.175:0/2804270522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa4105d10 0x7fdfa410c5c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:01.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.865+0000 7fdfaa4d7700 1 --2- 172.21.15.175:0/2804270522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfa4104240 0x7fdfa4104650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:01.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.865+0000 7fdfaa4d7700 1 --2- 172.21.15.175:0/2804270522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfa4105370 0x7fdfa4105780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:01.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.865+0000 7fdfaa4d7700 1 -- 172.21.15.175:0/2804270522 >> 172.21.15.175:0/2804270522 conn(0x7fdfa40ff8a0 msgr2=0x7fdfa4101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:37:01.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.866+0000 7fdfaa4d7700 1 -- 172.21.15.175:0/2804270522 shutdown_connections 2024-04-25T13:37:01.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.866+0000 7fdfaa4d7700 1 -- 172.21.15.175:0/2804270522 wait complete. 2024-04-25T13:37:01.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.866+0000 7fdfaa4d7700 1 Processor -- start 2024-04-25T13:37:01.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.866+0000 7fdfaa4d7700 1 -- start start 2024-04-25T13:37:01.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfaa4d7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfa4104240 0x7fdfa419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:37:01.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfaa4d7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa4105370 0x7fdfa419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:37:01.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfaa4d7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfa4105d10 0x7fdfa41a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:37:01.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfaa4d7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa410fb50 con 0x7fdfa4104240 2024-04-25T13:37:01.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfaa4d7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa410f9d0 con 0x7fdfa4105d10 2024-04-25T13:37:01.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfaa4d7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa410fcd0 con 0x7fdfa4105370 2024-04-25T13:37:01.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfa37fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa4105370 0x7fdfa419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:37:01.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfa37fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa4105370 0x7fdfa419abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51884/0 (socket says 172.21.15.175:51884) 2024-04-25T13:37:01.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfa37fe700 1 -- 172.21.15.175:0/4217151472 learned_addr learned my addr 172.21.15.175:0/4217151472 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T13:37:01.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfa3fff700 1 --2- 172.21.15.175:0/4217151472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfa4104240 0x7fdfa419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:37:01.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfa8a74700 1 --2- 172.21.15.175:0/4217151472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfa4105d10 0x7fdfa41a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:37:01.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfa37fe700 1 -- 172.21.15.175:0/4217151472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfa4105d10 msgr2=0x7fdfa41a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:37:01.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfa37fe700 1 --2- 172.21.15.175:0/4217151472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfa4105d10 0x7fdfa41a1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:01.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfa37fe700 1 -- 172.21.15.175:0/4217151472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfa4104240 msgr2=0x7fdfa419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:37:01.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfa37fe700 1 --2- 172.21.15.175:0/4217151472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfa4104240 0x7fdfa419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:01.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfa37fe700 1 -- 172.21.15.175:0/4217151472 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa41a21f0 con 0x7fdfa4105370 2024-04-25T13:37:01.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfa8a74700 1 --2- 172.21.15.175:0/4217151472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfa4105d10 0x7fdfa41a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:37:01.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfa37fe700 1 --2- 172.21.15.175:0/4217151472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa4105370 0x7fdfa419abd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400d980 tx=0x7fdf9400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:37:01.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfa17fa700 1 -- 172.21.15.175:0/4217151472 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf94016070 con 0x7fdfa4105370 2024-04-25T13:37:01.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfa17fa700 1 -- 172.21.15.175:0/4217151472 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf94004830 con 0x7fdfa4105370 2024-04-25T13:37:01.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfa17fa700 1 -- 172.21.15.175:0/4217151472 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf94005440 con 0x7fdfa4105370 2024-04-25T13:37:01.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.867+0000 7fdfaa4d7700 1 -- 172.21.15.175:0/4217151472 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa41a24e0 con 0x7fdfa4105370 2024-04-25T13:37:01.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.868+0000 7fdfaa4d7700 1 -- 172.21.15.175:0/4217151472 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa41a2a70 con 0x7fdfa4105370 2024-04-25T13:37:01.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.869+0000 7fdfaa4d7700 1 -- 172.21.15.175:0/4217151472 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa4051190 con 0x7fdfa4105370 2024-04-25T13:37:01.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.871+0000 7fdfa17fa700 1 -- 172.21.15.175:0/4217151472 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) ==== 147464+0+0 (secure 0 0 0) 0x7fdf940055e0 con 0x7fdfa4105370 2024-04-25T13:37:01.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.871+0000 7fdfa17fa700 1 --2- 172.21.15.175:0/4217151472 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdf8c0afb70 0x7fdf8c0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:37:01.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.871+0000 7fdfa17fa700 1 -- 172.21.15.175:0/4217151472 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2309+0+0 (secure 0 0 0) 0x7fdf940dd670 con 0x7fdfa4105370 2024-04-25T13:37:01.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.872+0000 7fdfa3fff700 1 --2- 172.21.15.175:0/4217151472 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdf8c0afb70 0x7fdf8c0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:37:01.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.872+0000 7fdfa3fff700 1 --2- 172.21.15.175:0/4217151472 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdf8c0afb70 0x7fdf8c0b2080 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4105270 tx=0x7fdf98009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:37:01.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:01.875+0000 7fdfa17fa700 1 -- 172.21.15.175:0/4217151472 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdf9401f020 con 0x7fdfa4105370 2024-04-25T13:37:02.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:02.083+0000 7fdfaa4d7700 1 -- 172.21.15.175:0/4217151472 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fdfa4063ad0 con 0x7fdf8c0afb70 2024-04-25T13:37:02.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:02 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:37:02.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:02 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:37:02.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:02 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:02.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:02 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:37:02.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:02 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:37:02.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:02 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:02.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:02 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:37:02.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:02 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:37:02.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:02 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:03.293 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:03 smithi175 ceph-mon[32649]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:03.293 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:03 smithi175 ceph-mon[32649]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:37:03.293 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:03 smithi175 ceph-mon[32649]: osdmap e14: 2 total, 2 up, 2 in 2024-04-25T13:37:03.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:03 smithi043 ceph-mon[29195]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:03.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:03 smithi043 ceph-mon[29195]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:37:03.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:03 smithi043 ceph-mon[29195]: osdmap e14: 2 total, 2 up, 2 in 2024-04-25T13:37:03.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:03 smithi161 ceph-mon[32696]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:03.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:03 smithi161 ceph-mon[32696]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:37:03.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:03 smithi161 ceph-mon[32696]: osdmap e14: 2 total, 2 up, 2 in 2024-04-25T13:37:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:05 smithi175 ceph-mon[32649]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:05 smithi175 ceph-mon[32649]: from='client.? 172.21.15.175:0/3384587121' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89fff4e4-9a15-4baf-830e-53c0b1dd33fc"}]: dispatch 2024-04-25T13:37:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:05 smithi175 ceph-mon[32649]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89fff4e4-9a15-4baf-830e-53c0b1dd33fc"}]: dispatch 2024-04-25T13:37:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:05 smithi175 ceph-mon[32649]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89fff4e4-9a15-4baf-830e-53c0b1dd33fc"}]': finished 2024-04-25T13:37:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:05 smithi175 ceph-mon[32649]: osdmap e15: 3 total, 2 up, 3 in 2024-04-25T13:37:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:05 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:37:05.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:05 smithi043 ceph-mon[29195]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:05.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:05 smithi043 ceph-mon[29195]: from='client.? 172.21.15.175:0/3384587121' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89fff4e4-9a15-4baf-830e-53c0b1dd33fc"}]: dispatch 2024-04-25T13:37:05.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:05 smithi043 ceph-mon[29195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89fff4e4-9a15-4baf-830e-53c0b1dd33fc"}]: dispatch 2024-04-25T13:37:05.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:05 smithi043 ceph-mon[29195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89fff4e4-9a15-4baf-830e-53c0b1dd33fc"}]': finished 2024-04-25T13:37:05.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:05 smithi043 ceph-mon[29195]: osdmap e15: 3 total, 2 up, 3 in 2024-04-25T13:37:05.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:05 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:37:05.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:05 smithi161 ceph-mon[32696]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:05.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:05 smithi161 ceph-mon[32696]: from='client.? 172.21.15.175:0/3384587121' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89fff4e4-9a15-4baf-830e-53c0b1dd33fc"}]: dispatch 2024-04-25T13:37:05.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:05 smithi161 ceph-mon[32696]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89fff4e4-9a15-4baf-830e-53c0b1dd33fc"}]: dispatch 2024-04-25T13:37:05.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:05 smithi161 ceph-mon[32696]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89fff4e4-9a15-4baf-830e-53c0b1dd33fc"}]': finished 2024-04-25T13:37:05.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:05 smithi161 ceph-mon[32696]: osdmap e15: 3 total, 2 up, 3 in 2024-04-25T13:37:05.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:05 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:37:06.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:06 smithi175 ceph-mon[32649]: from='client.? 172.21.15.175:0/3065006549' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:37:06.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:06 smithi043 ceph-mon[29195]: from='client.? 172.21.15.175:0/3065006549' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:37:06.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:06 smithi161 ceph-mon[32696]: from='client.? 172.21.15.175:0/3065006549' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:37:07.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:07 smithi175 ceph-mon[32649]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:07.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:07 smithi043 ceph-mon[29195]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:07.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:07 smithi161 ceph-mon[32696]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:09.404 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:09 smithi161 ceph-mon[32696]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:09.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:09 smithi175 ceph-mon[32649]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:09.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:09 smithi043 ceph-mon[29195]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:11.151 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:11 smithi175 ceph-mon[32649]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:11.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:11 smithi043 ceph-mon[29195]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:11.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:11 smithi161 ceph-mon[32696]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:12.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:12 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T13:37:12.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:12 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:12.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:12 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T13:37:12.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:12 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:12.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:12 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T13:37:12.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:12 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:13.251 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:13 smithi175 ceph-mon[32649]: Deploying daemon osd.2 on smithi175 2024-04-25T13:37:13.251 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:13 smithi175 ceph-mon[32649]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:13.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:13 smithi043 ceph-mon[29195]: Deploying daemon osd.2 on smithi175 2024-04-25T13:37:13.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:13 smithi043 ceph-mon[29195]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:13.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:13 smithi161 ceph-mon[32696]: Deploying daemon osd.2 on smithi175 2024-04-25T13:37:13.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:13 smithi161 ceph-mon[32696]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:15.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:15 smithi175 ceph-mon[32649]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:15.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:15 smithi043 ceph-mon[29195]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:15.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:15 smithi161 ceph-mon[32696]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:17.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:17 smithi175 ceph-mon[32649]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:17.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:17 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:17.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:17 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:17.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:17 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:37:17.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:17 smithi043 ceph-mon[29195]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:17.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:17 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:17.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:17 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:17.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:17 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:37:17.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:17 smithi161 ceph-mon[32696]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:17.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:17 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:17.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:17 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:17.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:17 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:37:19.344 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:19 smithi175 ceph-mon[32649]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:19.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:19 smithi043 ceph-mon[29195]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:19.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:19 smithi161 ceph-mon[32696]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:20.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:20.402+0000 7fdfa17fa700 1 -- 172.21.15.175:0/4217151472 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdfa4063ad0 con 0x7fdf8c0afb70 2024-04-25T13:37:20.402 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 2 on host 'smithi175' 2024-04-25T13:37:20.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:20.404+0000 7fdfaa4d7700 1 -- 172.21.15.175:0/4217151472 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdf8c0afb70 msgr2=0x7fdf8c0b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:37:20.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:20.404+0000 7fdfaa4d7700 1 --2- 172.21.15.175:0/4217151472 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdf8c0afb70 0x7fdf8c0b2080 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4105270 tx=0x7fdf98009260 comp rx=0 tx=0).stop 2024-04-25T13:37:20.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:20.405+0000 7fdfaa4d7700 1 -- 172.21.15.175:0/4217151472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa4105370 msgr2=0x7fdfa419abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:37:20.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:20.405+0000 7fdfaa4d7700 1 --2- 172.21.15.175:0/4217151472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa4105370 0x7fdfa419abd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400d980 tx=0x7fdf9400dc90 comp rx=0 tx=0).stop 2024-04-25T13:37:20.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:20.405+0000 7fdfaa4d7700 1 -- 172.21.15.175:0/4217151472 shutdown_connections 2024-04-25T13:37:20.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:20.405+0000 7fdfaa4d7700 1 --2- 172.21.15.175:0/4217151472 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdf8c0afb70 0x7fdf8c0b2080 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:20.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:20.405+0000 7fdfaa4d7700 1 --2- 172.21.15.175:0/4217151472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfa4105d10 0x7fdfa41a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:20.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:20.405+0000 7fdfaa4d7700 1 --2- 172.21.15.175:0/4217151472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfa4104240 0x7fdfa419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:20.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:20.405+0000 7fdfaa4d7700 1 --2- 172.21.15.175:0/4217151472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa4105370 0x7fdfa419abd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:20.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:20.405+0000 7fdfaa4d7700 1 -- 172.21.15.175:0/4217151472 >> 172.21.15.175:0/4217151472 conn(0x7fdfa40ff8a0 msgr2=0x7fdfa41085a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:37:20.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:20.405+0000 7fdfaa4d7700 1 -- 172.21.15.175:0/4217151472 shutdown_connections 2024-04-25T13:37:20.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:37:20.405+0000 7fdfaa4d7700 1 -- 172.21.15.175:0/4217151472 wait complete. 2024-04-25T13:37:21.055 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:21 smithi175 ceph-mon[32649]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:21.055 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:21 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:21.055 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:21 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:21.056 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:21 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:21.056 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:21 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:21.056 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:21 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:21.056 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:21 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:21.056 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:21 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:37:21.056 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:21 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:21.103 DEBUG:teuthology.orchestra.run.smithi175:osd.2> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.2.service 2024-04-25T13:37:21.106 INFO:tasks.cephadm:Deploying osd.3 on smithi043 with /dev/vg_nvme/lv_3... 2024-04-25T13:37:21.106 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-25T13:37:21.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:21 smithi161 ceph-mon[32696]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:21.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:21 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:21.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:21 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:21.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:21 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:21.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:21 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:21.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:21 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:21.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:21 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:21.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:21 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:37:21.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:21 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:21.360 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:37:21.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:21 smithi043 ceph-mon[29195]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:21.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:21 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:21.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:21 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:21.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:21 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:21.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:21 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:21.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:21 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:21.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:21 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:21.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:21 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:37:21.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:21 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:22.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:22 smithi043 ceph-mon[29195]: from='osd.2 [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T13:37:22.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:22 smithi043 ceph-mon[29195]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T13:37:22.308 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:22 smithi175 ceph-mon[32649]: from='osd.2 [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T13:37:22.308 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:22 smithi175 ceph-mon[32649]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T13:37:22.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:22 smithi161 ceph-mon[32696]: from='osd.2 [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T13:37:22.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:22 smithi161 ceph-mon[32696]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T13:37:23.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:23 smithi161 ceph-mon[32696]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:23.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:23 smithi161 ceph-mon[32696]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T13:37:23.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:23 smithi161 ceph-mon[32696]: from='osd.2 [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:37:23.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:23 smithi161 ceph-mon[32696]: osdmap e16: 3 total, 2 up, 3 in 2024-04-25T13:37:23.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:23 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:37:23.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:23 smithi161 ceph-mon[32696]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:37:23.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:23 smithi175 ceph-mon[32649]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:23.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:23 smithi175 ceph-mon[32649]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T13:37:23.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:23 smithi175 ceph-mon[32649]: from='osd.2 [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:37:23.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:23 smithi175 ceph-mon[32649]: osdmap e16: 3 total, 2 up, 3 in 2024-04-25T13:37:23.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:23 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:37:23.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:23 smithi175 ceph-mon[32649]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:37:23.431 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:37:23 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-2[37797]: 2024-04-25T13:37:23.033+0000 7f873a7e3700 -1 osd.2 0 waiting for initial osdmap 2024-04-25T13:37:23.431 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:37:23 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-2[37797]: 2024-04-25T13:37:23.041+0000 7f8736598700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:37:23.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:23 smithi043 ceph-mon[29195]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:23.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:23 smithi043 ceph-mon[29195]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T13:37:23.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:23 smithi043 ceph-mon[29195]: from='osd.2 [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:37:23.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:23 smithi043 ceph-mon[29195]: osdmap e16: 3 total, 2 up, 3 in 2024-04-25T13:37:23.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:23 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:37:23.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:23 smithi043 ceph-mon[29195]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:37:23.464 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-25T13:37:23.464 INFO:teuthology.orchestra.run.smithi043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-25T13:37:23.464 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10+0 records in 2024-04-25T13:37:23.464 INFO:teuthology.orchestra.run.smithi043.stderr:10+0 records out 2024-04-25T13:37:23.464 INFO:teuthology.orchestra.run.smithi043.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00838512 s, 1.3 GB/s 2024-04-25T13:37:23.464 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping successful for: 2024-04-25T13:37:24.120 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_3 2024-04-25T13:37:24.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:24 smithi161 ceph-mon[32696]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-04-25T13:37:24.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:24 smithi161 ceph-mon[32696]: osdmap e17: 3 total, 2 up, 3 in 2024-04-25T13:37:24.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:24 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:37:24.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:24 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:37:24.372 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:37:24.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:24 smithi175 ceph-mon[32649]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-04-25T13:37:24.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:24 smithi175 ceph-mon[32649]: osdmap e17: 3 total, 2 up, 3 in 2024-04-25T13:37:24.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:24 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:37:24.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:24 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:37:24.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:24 smithi043 ceph-mon[29195]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-04-25T13:37:24.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:24 smithi043 ceph-mon[29195]: osdmap e17: 3 total, 2 up, 3 in 2024-04-25T13:37:24.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:24 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:37:24.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:24 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:37:25.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:25 smithi161 ceph-mon[32696]: purged_snaps scrub starts 2024-04-25T13:37:25.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:25 smithi161 ceph-mon[32696]: purged_snaps scrub ok 2024-04-25T13:37:25.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:25 smithi161 ceph-mon[32696]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:25.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:25 smithi161 ceph-mon[32696]: osd.2 [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698] boot 2024-04-25T13:37:25.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:25 smithi161 ceph-mon[32696]: osdmap e18: 3 total, 3 up, 3 in 2024-04-25T13:37:25.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:25 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:37:25.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:25 smithi161 ceph-mon[32696]: Detected new or changed devices on smithi175 2024-04-25T13:37:25.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:25 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:25.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:25 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:25.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:25 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:37:25.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:25 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi175 to 17088M 2024-04-25T13:37:25.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:25 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:25.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:25 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:25.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:25 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:25.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:25 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:25.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:25 smithi175 ceph-mon[32649]: purged_snaps scrub starts 2024-04-25T13:37:25.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:25 smithi175 ceph-mon[32649]: purged_snaps scrub ok 2024-04-25T13:37:25.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:25 smithi175 ceph-mon[32649]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:25.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:25 smithi175 ceph-mon[32649]: osd.2 [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698] boot 2024-04-25T13:37:25.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:25 smithi175 ceph-mon[32649]: osdmap e18: 3 total, 3 up, 3 in 2024-04-25T13:37:25.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:25 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:37:25.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:25 smithi175 ceph-mon[32649]: Detected new or changed devices on smithi175 2024-04-25T13:37:25.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:25 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:25.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:25 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:25.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:25 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:37:25.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:25 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi175 to 17088M 2024-04-25T13:37:25.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:25 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:25.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:25 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:25.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:25 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:25.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:25 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:25.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:25 smithi043 ceph-mon[29195]: purged_snaps scrub starts 2024-04-25T13:37:25.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:25 smithi043 ceph-mon[29195]: purged_snaps scrub ok 2024-04-25T13:37:25.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:25 smithi043 ceph-mon[29195]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T13:37:25.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:25 smithi043 ceph-mon[29195]: osd.2 [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698] boot 2024-04-25T13:37:25.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:25 smithi043 ceph-mon[29195]: osdmap e18: 3 total, 3 up, 3 in 2024-04-25T13:37:25.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:25 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:37:25.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:25 smithi043 ceph-mon[29195]: Detected new or changed devices on smithi175 2024-04-25T13:37:25.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:25 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:25.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:25 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:25.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:25 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:37:25.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:25 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi175 to 17088M 2024-04-25T13:37:25.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:25 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:25.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:25 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:25.459 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:25 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:25.459 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:25 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.988+0000 7f34d4421700 1 -- 172.21.15.43:0/164876798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34cc104bb0 msgr2=0x7f34cc10b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.988+0000 7f34d4421700 1 --2- 172.21.15.43:0/164876798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34cc104bb0 0x7f34cc10b460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f34c400b0a0 tx=0x7f34c400b3b0 comp rx=0 tx=0).stop 2024-04-25T13:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.988+0000 7f34d4421700 1 -- 172.21.15.43:0/164876798 shutdown_connections 2024-04-25T13:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.988+0000 7f34d4421700 1 --2- 172.21.15.43:0/164876798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34cc104bb0 0x7f34cc10b460 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.988+0000 7f34d4421700 1 --2- 172.21.15.43:0/164876798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34cc1030e0 0x7f34cc1034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.988+0000 7f34d4421700 1 --2- 172.21.15.43:0/164876798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34cc104210 0x7f34cc104620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.988+0000 7f34d4421700 1 -- 172.21.15.43:0/164876798 >> 172.21.15.43:0/164876798 conn(0x7f34cc0fe740 msgr2=0x7f34cc100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.988+0000 7f34d4421700 1 -- 172.21.15.43:0/164876798 shutdown_connections 2024-04-25T13:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.988+0000 7f34d4421700 1 -- 172.21.15.43:0/164876798 wait complete. 2024-04-25T13:37:25.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d4421700 1 Processor -- start 2024-04-25T13:37:25.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d4421700 1 -- start start 2024-04-25T13:37:25.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d4421700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34cc1030e0 0x7f34cc076320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:37:25.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d4421700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34cc104210 0x7f34cc19f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:37:25.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d4421700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34cc104bb0 0x7f34cc1a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:37:25.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d4421700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc10ea10 con 0x7f34cc104bb0 2024-04-25T13:37:25.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d4421700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc10e890 con 0x7f34cc104210 2024-04-25T13:37:25.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d4421700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc10eb90 con 0x7f34cc1030e0 2024-04-25T13:37:25.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d29be700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34cc104bb0 0x7f34cc1a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:37:25.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d29be700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34cc104bb0 0x7f34cc1a19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55252/0 (socket says 172.21.15.43:55252) 2024-04-25T13:37:25.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d29be700 1 -- 172.21.15.43:0/3264149556 learned_addr learned my addr 172.21.15.43:0/3264149556 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:37:25.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d19bc700 1 --2- 172.21.15.43:0/3264149556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34cc104210 0x7f34cc19f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:37:25.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d21bd700 1 --2- 172.21.15.43:0/3264149556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34cc1030e0 0x7f34cc076320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:37:25.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d29be700 1 -- 172.21.15.43:0/3264149556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34cc1030e0 msgr2=0x7f34cc076320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:37:25.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d29be700 1 --2- 172.21.15.43:0/3264149556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34cc1030e0 0x7f34cc076320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:25.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d29be700 1 -- 172.21.15.43:0/3264149556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34cc104210 msgr2=0x7f34cc19f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:37:25.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.989+0000 7f34d29be700 1 --2- 172.21.15.43:0/3264149556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34cc104210 0x7f34cc19f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:25.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.990+0000 7f34d29be700 1 -- 172.21.15.43:0/3264149556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc1a2210 con 0x7f34cc104bb0 2024-04-25T13:37:25.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.990+0000 7f34d19bc700 1 --2- 172.21.15.43:0/3264149556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34cc104210 0x7f34cc19f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:37:25.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.990+0000 7f34d29be700 1 --2- 172.21.15.43:0/3264149556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34cc104bb0 0x7f34cc1a19e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009850 tx=0x7f34c4004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:37:25.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.990+0000 7f34c37fe700 1 -- 172.21.15.43:0/3264149556 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4021070 con 0x7f34cc104bb0 2024-04-25T13:37:25.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.990+0000 7f34d4421700 1 -- 172.21.15.43:0/3264149556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34cc1a24a0 con 0x7f34cc104bb0 2024-04-25T13:37:25.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.990+0000 7f34c37fe700 1 -- 172.21.15.43:0/3264149556 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34c4007b80 con 0x7f34cc104bb0 2024-04-25T13:37:25.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.990+0000 7f34c37fe700 1 -- 172.21.15.43:0/3264149556 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c40052a0 con 0x7f34cc104bb0 2024-04-25T13:37:25.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.990+0000 7f34d4421700 1 -- 172.21.15.43:0/3264149556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34cc1a2950 con 0x7f34cc104bb0 2024-04-25T13:37:25.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.991+0000 7f34d4421700 1 -- 172.21.15.43:0/3264149556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34cc051190 con 0x7f34cc104bb0 2024-04-25T13:37:25.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.993+0000 7f34c37fe700 1 -- 172.21.15.43:0/3264149556 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 15) ==== 147464+0+0 (secure 0 0 0) 0x7f34c4024070 con 0x7f34cc104bb0 2024-04-25T13:37:25.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.994+0000 7f34c37fe700 1 --2- 172.21.15.43:0/3264149556 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f34b80afaf0 0x7f34b80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:37:25.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.994+0000 7f34d21bd700 1 --2- 172.21.15.43:0/3264149556 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f34b80afaf0 0x7f34b80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:37:25.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.994+0000 7f34c37fe700 1 -- 172.21.15.43:0/3264149556 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2851+0+0 (secure 0 0 0) 0x7f34c400f020 con 0x7f34cc104bb0 2024-04-25T13:37:25.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.994+0000 7f34d21bd700 1 --2- 172.21.15.43:0/3264149556 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f34b80afaf0 0x7f34b80b2000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f34c8005fd0 tx=0x7f34c8005dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:37:25.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:25.998+0000 7f34c37fe700 1 -- 172.21.15.43:0/3264149556 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f34c402b020 con 0x7f34cc104bb0 2024-04-25T13:37:26.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:26.215+0000 7f34d4421700 1 -- 172.21.15.43:0/3264149556 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f34cc063ad0 con 0x7f34b80afaf0 2024-04-25T13:37:26.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:26 smithi175 ceph-mon[32649]: osdmap e19: 3 total, 3 up, 3 in 2024-04-25T13:37:26.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:26 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-25T13:37:26.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:26 smithi043 ceph-mon[29195]: osdmap e19: 3 total, 3 up, 3 in 2024-04-25T13:37:26.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:26 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-25T13:37:26.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:26 smithi161 ceph-mon[32696]: osdmap e19: 3 total, 3 up, 3 in 2024-04-25T13:37:26.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:26 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-25T13:37:27.415 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:37:27 smithi043 sudo[48500]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T13:37:27.415 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:37:27 smithi043 sudo[48500]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T13:37:27.415 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:37:27 smithi043 sudo[48500]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T13:37:27.415 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:37:27 smithi043 sudo[48500]: pam_unix(sudo:session): session closed for user root 2024-04-25T13:37:27.415 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:37:27 smithi043 sudo[48503]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T13:37:27.415 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:37:27 smithi043 sudo[48503]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T13:37:27.415 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:37:27 smithi043 sudo[48503]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T13:37:27.415 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:37:27 smithi043 sudo[48503]: pam_unix(sudo:session): session closed for user root 2024-04-25T13:37:27.416 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:27 smithi043 ceph-mon[29195]: pgmap v83: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:27.416 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:27 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-25T13:37:27.416 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:27 smithi043 ceph-mon[29195]: osdmap e20: 3 total, 3 up, 3 in 2024-04-25T13:37:27.416 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:27 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T13:37:27.416 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:27 smithi043 ceph-mon[29195]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:37:27.416 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:27 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:37:27.416 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:27 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:37:27.416 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:27 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:27.416 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:27 smithi043 sudo[48508]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T13:37:27.431 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:37:27 smithi175 sudo[41413]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T13:37:27.431 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:37:27 smithi175 sudo[41413]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T13:37:27.431 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:37:27 smithi175 sudo[41413]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T13:37:27.431 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:37:27 smithi175 sudo[41413]: pam_unix(sudo:session): session closed for user root 2024-04-25T13:37:27.431 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:37:27 smithi175 sudo[41416]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T13:37:27.431 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:37:27 smithi175 sudo[41416]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T13:37:27.431 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:37:27 smithi175 sudo[41416]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T13:37:27.431 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:37:27 smithi175 sudo[41416]: pam_unix(sudo:session): session closed for user root 2024-04-25T13:37:27.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:27 smithi175 ceph-mon[32649]: pgmap v83: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:27.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:27 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-25T13:37:27.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:27 smithi175 ceph-mon[32649]: osdmap e20: 3 total, 3 up, 3 in 2024-04-25T13:37:27.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:27 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T13:37:27.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:27 smithi175 ceph-mon[32649]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:37:27.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:27 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:37:27.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:27 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:37:27.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:27 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:27.490 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:37:27 smithi161 sudo[40998]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T13:37:27.490 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:37:27 smithi161 sudo[40998]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T13:37:27.490 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:37:27 smithi161 sudo[40998]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T13:37:27.490 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:37:27 smithi161 sudo[40998]: pam_unix(sudo:session): session closed for user root 2024-04-25T13:37:27.490 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:37:27 smithi161 sudo[41001]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T13:37:27.490 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:37:27 smithi161 sudo[41001]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T13:37:27.490 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:37:27 smithi161 sudo[41001]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T13:37:27.491 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:37:27 smithi161 sudo[41001]: pam_unix(sudo:session): session closed for user root 2024-04-25T13:37:27.491 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:27 smithi161 ceph-mon[32696]: pgmap v83: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:27.491 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:27 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-25T13:37:27.491 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:27 smithi161 ceph-mon[32696]: osdmap e20: 3 total, 3 up, 3 in 2024-04-25T13:37:27.491 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:27 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T13:37:27.491 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:27 smithi161 ceph-mon[32696]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:37:27.491 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:27 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:37:27.491 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:27 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:37:27.491 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:27 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:27.491 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:27 smithi161 sudo[41004]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T13:37:27.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:27 smithi043 sudo[48508]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T13:37:27.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:27 smithi043 sudo[48508]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T13:37:27.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:27 smithi043 sudo[48508]: pam_unix(sudo:session): session closed for user root 2024-04-25T13:37:27.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:27 smithi043 sudo[48511]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T13:37:27.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:27 smithi043 sudo[48511]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T13:37:27.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:27 smithi043 sudo[48511]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T13:37:27.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:27 smithi043 sudo[48511]: pam_unix(sudo:session): session closed for user root 2024-04-25T13:37:27.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:27 smithi161 sudo[41004]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T13:37:27.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:27 smithi161 sudo[41004]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T13:37:27.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:27 smithi161 sudo[41004]: pam_unix(sudo:session): session closed for user root 2024-04-25T13:37:27.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:27 smithi161 sudo[41007]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T13:37:27.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:27 smithi161 sudo[41007]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T13:37:27.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:27 smithi161 sudo[41007]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T13:37:27.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:27 smithi161 sudo[41007]: pam_unix(sudo:session): session closed for user root 2024-04-25T13:37:27.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:27 smithi175 sudo[41419]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T13:37:27.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:27 smithi175 sudo[41419]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T13:37:27.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:27 smithi175 sudo[41419]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T13:37:27.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:27 smithi175 sudo[41419]: pam_unix(sudo:session): session closed for user root 2024-04-25T13:37:27.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:27 smithi175 sudo[41422]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T13:37:27.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:27 smithi175 sudo[41422]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T13:37:27.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:27 smithi175 sudo[41422]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T13:37:27.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:27 smithi175 sudo[41422]: pam_unix(sudo:session): session closed for user root 2024-04-25T13:37:28.418 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-25T13:37:28.419 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: osdmap e21: 3 total, 3 up, 3 in 2024-04-25T13:37:28.419 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:28.419 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:28.419 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:28.419 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T13:37:28.419 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T13:37:28.419 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:37:28.419 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:37:28.419 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:37:28.419 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T13:37:28.419 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:37:28.419 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:37:28.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:37:28.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T13:37:28.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T13:37:28.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:37:28.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:37:28.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:37:28.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:28 smithi043 ceph-mon[29195]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T13:37:28.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:28.417+0000 7f34c37fe700 1 -- 172.21.15.43:0/3264149556 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f34c40a4f10 con 0x7f34cc104bb0 2024-04-25T13:37:28.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-25T13:37:28.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: osdmap e21: 3 total, 3 up, 3 in 2024-04-25T13:37:28.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:28.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:28.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:28.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T13:37:28.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T13:37:28.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:37:28.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:37:28.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:37:28.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T13:37:28.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:37:28.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:37:28.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:37:28.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T13:37:28.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T13:37:28.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:37:28.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:37:28.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:37:28.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:28 smithi175 ceph-mon[32649]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T13:37:28.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-25T13:37:28.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: osdmap e21: 3 total, 3 up, 3 in 2024-04-25T13:37:28.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:28.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:28.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:28.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T13:37:28.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T13:37:28.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:37:28.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:37:28.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:37:28.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T13:37:28.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:37:28.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:37:28.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:37:28.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T13:37:28.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T13:37:28.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:37:28.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:37:28.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:37:28.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:28 smithi161 ceph-mon[32696]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T13:37:29.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:29 smithi175 ceph-mon[32649]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:29.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:29 smithi175 ceph-mon[32649]: osdmap e22: 3 total, 3 up, 3 in 2024-04-25T13:37:29.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:29 smithi175 ceph-mon[32649]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-25T13:37:29.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:29 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1403693046' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86d23f16-1b89-475e-9700-03a3f131daa2"}]: dispatch 2024-04-25T13:37:29.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:29 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1403693046' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86d23f16-1b89-475e-9700-03a3f131daa2"}]': finished 2024-04-25T13:37:29.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:29 smithi175 ceph-mon[32649]: osdmap e23: 4 total, 3 up, 4 in 2024-04-25T13:37:29.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:29 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:29.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:29 smithi043 ceph-mon[29195]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:29.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:29 smithi043 ceph-mon[29195]: osdmap e22: 3 total, 3 up, 3 in 2024-04-25T13:37:29.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:29 smithi043 ceph-mon[29195]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-25T13:37:29.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:29 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1403693046' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86d23f16-1b89-475e-9700-03a3f131daa2"}]: dispatch 2024-04-25T13:37:29.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:29 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1403693046' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86d23f16-1b89-475e-9700-03a3f131daa2"}]': finished 2024-04-25T13:37:29.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:29 smithi043 ceph-mon[29195]: osdmap e23: 4 total, 3 up, 4 in 2024-04-25T13:37:29.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:29 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:29.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:29 smithi161 ceph-mon[32696]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:29.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:29 smithi161 ceph-mon[32696]: osdmap e22: 3 total, 3 up, 3 in 2024-04-25T13:37:29.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:29 smithi161 ceph-mon[32696]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-25T13:37:29.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:29 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1403693046' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86d23f16-1b89-475e-9700-03a3f131daa2"}]: dispatch 2024-04-25T13:37:29.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:29 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1403693046' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86d23f16-1b89-475e-9700-03a3f131daa2"}]': finished 2024-04-25T13:37:29.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:29 smithi161 ceph-mon[32696]: osdmap e23: 4 total, 3 up, 4 in 2024-04-25T13:37:29.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:29 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:30.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:30 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3185265602' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:37:30.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:30 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3185265602' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:37:30.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:30 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3185265602' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:37:31.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:31 smithi175 ceph-mon[32649]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:31.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:31 smithi043 ceph-mon[29195]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:31.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:31 smithi161 ceph-mon[32696]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:33.383 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:33 smithi043 ceph-mon[29195]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:33.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:33 smithi175 ceph-mon[32649]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:33.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:33 smithi161 ceph-mon[32696]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:35.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:35 smithi175 ceph-mon[32649]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:35.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:35 smithi043 ceph-mon[29195]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:35.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:35 smithi161 ceph-mon[32696]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:37.334 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:37 smithi043 ceph-mon[29195]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:37.334 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:37 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T13:37:37.334 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:37 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:37.334 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:37 smithi043 ceph-mon[29195]: Deploying daemon osd.3 on smithi043 2024-04-25T13:37:37.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:37 smithi161 ceph-mon[32696]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:37.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:37 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T13:37:37.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:37 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:37.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:37 smithi161 ceph-mon[32696]: Deploying daemon osd.3 on smithi043 2024-04-25T13:37:37.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:37 smithi175 ceph-mon[32649]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:37.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:37 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T13:37:37.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:37 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:37.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:37 smithi175 ceph-mon[32649]: Deploying daemon osd.3 on smithi043 2024-04-25T13:37:39.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:39 smithi043 ceph-mon[29195]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:39.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:39 smithi161 ceph-mon[32696]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:39.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:39 smithi175 ceph-mon[32649]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:41.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:41 smithi043 ceph-mon[29195]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:41.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:41 smithi161 ceph-mon[32696]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:41.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:41 smithi175 ceph-mon[32649]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:43.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:43 smithi175 ceph-mon[32649]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:43.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:43.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:43.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:37:43.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:43 smithi043 ceph-mon[29195]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:43.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:43 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:43.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:43 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:43.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:43 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:37:43.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:43 smithi161 ceph-mon[32696]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:43.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:43 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:43.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:43 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:43.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:43 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:37:45.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:45 smithi175 ceph-mon[32649]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:45.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:45.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:45.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:45.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:45.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:45.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:45 smithi043 ceph-mon[29195]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:45.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:45.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:45.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:45.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:45.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:45.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:45 smithi161 ceph-mon[32696]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:45.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:45.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:45.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:45.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:45.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:46.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:46.073+0000 7f34c37fe700 1 -- 172.21.15.43:0/3264149556 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f34cc063ad0 con 0x7f34b80afaf0 2024-04-25T13:37:46.074 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 3 on host 'smithi043' 2024-04-25T13:37:46.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:46.076+0000 7f34d4421700 1 -- 172.21.15.43:0/3264149556 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f34b80afaf0 msgr2=0x7f34b80b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:37:46.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:46.076+0000 7f34d4421700 1 --2- 172.21.15.43:0/3264149556 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f34b80afaf0 0x7f34b80b2000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f34c8005fd0 tx=0x7f34c8005dd0 comp rx=0 tx=0).stop 2024-04-25T13:37:46.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:46.076+0000 7f34d4421700 1 -- 172.21.15.43:0/3264149556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34cc104bb0 msgr2=0x7f34cc1a19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:37:46.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:46.076+0000 7f34d4421700 1 --2- 172.21.15.43:0/3264149556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34cc104bb0 0x7f34cc1a19e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009850 tx=0x7f34c4004db0 comp rx=0 tx=0).stop 2024-04-25T13:37:46.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:46.076+0000 7f34d4421700 1 -- 172.21.15.43:0/3264149556 shutdown_connections 2024-04-25T13:37:46.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:46.076+0000 7f34d4421700 1 --2- 172.21.15.43:0/3264149556 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f34b80afaf0 0x7f34b80b2000 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:46.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:46.076+0000 7f34d4421700 1 --2- 172.21.15.43:0/3264149556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34cc104bb0 0x7f34cc1a19e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:46.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:46.076+0000 7f34d4421700 1 --2- 172.21.15.43:0/3264149556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34cc1030e0 0x7f34cc076320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:46.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:46.076+0000 7f34d4421700 1 --2- 172.21.15.43:0/3264149556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34cc104210 0x7f34cc19f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:46.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:46.076+0000 7f34d4421700 1 -- 172.21.15.43:0/3264149556 >> 172.21.15.43:0/3264149556 conn(0x7f34cc0fe740 msgr2=0x7f34cc107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:37:46.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:46.076+0000 7f34d4421700 1 -- 172.21.15.43:0/3264149556 shutdown_connections 2024-04-25T13:37:46.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:37:46.076+0000 7f34d4421700 1 -- 172.21.15.43:0/3264149556 wait complete. 2024-04-25T13:37:46.754 DEBUG:teuthology.orchestra.run.smithi043:osd.3> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.3.service 2024-04-25T13:37:46.756 INFO:tasks.cephadm:Deploying osd.4 on smithi161 with /dev/vg_nvme/lv_3... 2024-04-25T13:37:46.756 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-25T13:37:47.002 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T13:37:47.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:47 smithi161 ceph-mon[32696]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:47.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:47 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:47.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:47 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:47.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:47 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:37:47.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:47 smithi161 ceph-mon[32696]: from='osd.3 [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T13:37:47.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:47 smithi175 ceph-mon[32649]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:47.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:47 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:47.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:47 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:47.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:47 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:37:47.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:47 smithi175 ceph-mon[32649]: from='osd.3 [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T13:37:47.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:47 smithi043 ceph-mon[29195]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:47.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:47 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:47.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:47 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:47.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:47 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:37:47.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:47 smithi043 ceph-mon[29195]: from='osd.3 [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T13:37:48.206 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:48 smithi043 ceph-mon[29195]: from='osd.3 [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T13:37:48.206 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:48 smithi043 ceph-mon[29195]: osdmap e24: 4 total, 3 up, 4 in 2024-04-25T13:37:48.206 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:48 smithi043 ceph-mon[29195]: from='osd.3 [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T13:37:48.206 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:48.206 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:37:48 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-3[50642]: 2024-04-25T13:37:48.077+0000 7fe6e3bbb700 -1 osd.3 0 waiting for initial osdmap 2024-04-25T13:37:48.206 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:37:48 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-3[50642]: 2024-04-25T13:37:48.084+0000 7fe6df970700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:37:48.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:48 smithi161 ceph-mon[32696]: from='osd.3 [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T13:37:48.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:48 smithi161 ceph-mon[32696]: osdmap e24: 4 total, 3 up, 4 in 2024-04-25T13:37:48.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:48 smithi161 ceph-mon[32696]: from='osd.3 [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T13:37:48.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:48.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:48 smithi175 ceph-mon[32649]: from='osd.3 [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T13:37:48.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:48 smithi175 ceph-mon[32649]: osdmap e24: 4 total, 3 up, 4 in 2024-04-25T13:37:48.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:48 smithi175 ceph-mon[32649]: from='osd.3 [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T13:37:48.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:48.948 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-25T13:37:48.948 INFO:teuthology.orchestra.run.smithi161.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-25T13:37:48.948 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10+0 records in 2024-04-25T13:37:48.948 INFO:teuthology.orchestra.run.smithi161.stderr:10+0 records out 2024-04-25T13:37:48.948 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113458 s, 924 MB/s 2024-04-25T13:37:48.948 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping successful for: 2024-04-25T13:37:49.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:49 smithi175 ceph-mon[32649]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:49.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:49 smithi175 ceph-mon[32649]: from='osd.3 [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T13:37:49.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:49 smithi175 ceph-mon[32649]: osdmap e25: 4 total, 3 up, 4 in 2024-04-25T13:37:49.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:49 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:49.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:49 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:49.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:49 smithi161 ceph-mon[32696]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:49.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:49 smithi161 ceph-mon[32696]: from='osd.3 [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T13:37:49.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:49 smithi161 ceph-mon[32696]: osdmap e25: 4 total, 3 up, 4 in 2024-04-25T13:37:49.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:49 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:49.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:49 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:49.334 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:49 smithi043 ceph-mon[29195]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:49.334 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:49 smithi043 ceph-mon[29195]: from='osd.3 [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T13:37:49.335 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:49 smithi043 ceph-mon[29195]: osdmap e25: 4 total, 3 up, 4 in 2024-04-25T13:37:49.335 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:49 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:49.335 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:49 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:49.601 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi161:vg_nvme/lv_3 2024-04-25T13:37:49.846 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T13:37:50.192 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:50 smithi161 ceph-mon[32696]: purged_snaps scrub starts 2024-04-25T13:37:50.193 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:50 smithi161 ceph-mon[32696]: purged_snaps scrub ok 2024-04-25T13:37:50.193 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:50 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:50.193 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:50 smithi161 ceph-mon[32696]: osd.3 [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514] boot 2024-04-25T13:37:50.193 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:50 smithi161 ceph-mon[32696]: osdmap e26: 4 total, 4 up, 4 in 2024-04-25T13:37:50.193 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:50 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:50.193 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:50 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:50.193 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:50 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:50.193 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:50 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:37:50.193 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:50 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:37:50.193 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:50 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:50.193 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:50 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:50.193 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:50 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:50.193 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:50 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:50 smithi175 ceph-mon[32649]: purged_snaps scrub starts 2024-04-25T13:37:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:50 smithi175 ceph-mon[32649]: purged_snaps scrub ok 2024-04-25T13:37:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:50 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:50 smithi175 ceph-mon[32649]: osd.3 [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514] boot 2024-04-25T13:37:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:50 smithi175 ceph-mon[32649]: osdmap e26: 4 total, 4 up, 4 in 2024-04-25T13:37:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:50 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:50 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:50 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:50 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:37:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:50 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:37:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:50 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:50 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:50 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:50.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:50 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:50.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:50 smithi043 ceph-mon[29195]: purged_snaps scrub starts 2024-04-25T13:37:50.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:50 smithi043 ceph-mon[29195]: purged_snaps scrub ok 2024-04-25T13:37:50.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:50 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:50.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:50 smithi043 ceph-mon[29195]: osd.3 [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514] boot 2024-04-25T13:37:50.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:50 smithi043 ceph-mon[29195]: osdmap e26: 4 total, 4 up, 4 in 2024-04-25T13:37:50.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:50 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:37:50.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:50 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:50.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:50 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:50.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:50 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:37:50.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:50 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:37:50.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:50 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:50.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:50 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:50.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:50 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:37:50.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:50 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:37:51.252 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:51 smithi161 ceph-mon[32696]: Detected new or changed devices on smithi043 2024-04-25T13:37:51.252 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:51 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi043 to 8546M 2024-04-25T13:37:51.253 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:51 smithi161 ceph-mon[32696]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:51.253 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:51 smithi161 ceph-mon[32696]: osdmap e27: 4 total, 4 up, 4 in 2024-04-25T13:37:51.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:51 smithi175 ceph-mon[32649]: Detected new or changed devices on smithi043 2024-04-25T13:37:51.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:51 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi043 to 8546M 2024-04-25T13:37:51.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:51 smithi175 ceph-mon[32649]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:51.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:51 smithi175 ceph-mon[32649]: osdmap e27: 4 total, 4 up, 4 in 2024-04-25T13:37:51.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:51 smithi043 ceph-mon[29195]: Detected new or changed devices on smithi043 2024-04-25T13:37:51.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:51 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi043 to 8546M 2024-04-25T13:37:51.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:51 smithi043 ceph-mon[29195]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-25T13:37:51.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:51 smithi043 ceph-mon[29195]: osdmap e27: 4 total, 4 up, 4 in 2024-04-25T13:37:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.495+0000 7f94bff46700 1 -- 172.21.15.161:0/2025013644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b8105850 msgr2=0x7f94b8105c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:37:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.495+0000 7f94bff46700 1 --2- 172.21.15.161:0/2025013644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b8105850 0x7f94b8105c60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009990 tx=0x7f94b4009ca0 comp rx=0 tx=0).stop 2024-04-25T13:37:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.495+0000 7f94bff46700 1 -- 172.21.15.161:0/2025013644 shutdown_connections 2024-04-25T13:37:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.495+0000 7f94bff46700 1 --2- 172.21.15.161:0/2025013644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94b8104880 0x7f94b810c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.495+0000 7f94bff46700 1 --2- 172.21.15.161:0/2025013644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b8105850 0x7f94b8105c60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.495+0000 7f94bff46700 1 --2- 172.21.15.161:0/2025013644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94b8103e00 0x7f94b8104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.495+0000 7f94bff46700 1 -- 172.21.15.161:0/2025013644 >> 172.21.15.161:0/2025013644 conn(0x7f94b80ff870 msgr2=0x7f94b8101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:37:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.495+0000 7f94bff46700 1 -- 172.21.15.161:0/2025013644 shutdown_connections 2024-04-25T13:37:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.495+0000 7f94bff46700 1 -- 172.21.15.161:0/2025013644 wait complete. 2024-04-25T13:37:51.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bff46700 1 Processor -- start 2024-04-25T13:37:51.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bff46700 1 -- start start 2024-04-25T13:37:51.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bff46700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94b8103e00 0x7f94b819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:37:51.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bff46700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b8104880 0x7f94b819ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:37:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bff46700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94b8105850 0x7f94b81a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:37:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bff46700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f94b810fc20 con 0x7f94b8105850 2024-04-25T13:37:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bff46700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f94b810faa0 con 0x7f94b8104880 2024-04-25T13:37:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bff46700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f94b810fda0 con 0x7f94b8103e00 2024-04-25T13:37:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bd4e1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b8104880 0x7f94b819ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:37:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bdce2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94b8103e00 0x7f94b819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:37:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bd4e1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b8104880 0x7f94b819ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:42624/0 (socket says 172.21.15.161:42624) 2024-04-25T13:37:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bd4e1700 1 -- 172.21.15.161:0/886368881 learned_addr learned my addr 172.21.15.161:0/886368881 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-04-25T13:37:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94be4e3700 1 --2- 172.21.15.161:0/886368881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94b8105850 0x7f94b81a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:37:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bd4e1700 1 -- 172.21.15.161:0/886368881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94b8103e00 msgr2=0x7f94b819a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:37:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bd4e1700 1 --2- 172.21.15.161:0/886368881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94b8103e00 0x7f94b819a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bd4e1700 1 -- 172.21.15.161:0/886368881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94b8105850 msgr2=0x7f94b81a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:37:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bd4e1700 1 --2- 172.21.15.161:0/886368881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94b8105850 0x7f94b81a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:37:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.496+0000 7f94bd4e1700 1 -- 172.21.15.161:0/886368881 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b81a2270 con 0x7f94b8104880 2024-04-25T13:37:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.497+0000 7f94bd4e1700 1 --2- 172.21.15.161:0/886368881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b8104880 0x7f94b819ace0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f94a800c9b0 tx=0x7f94a800ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:37:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.497+0000 7f94aeffd700 1 -- 172.21.15.161:0/886368881 <== mon.2 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8007b00 con 0x7f94b8104880 2024-04-25T13:37:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.497+0000 7f94aeffd700 1 -- 172.21.15.161:0/886368881 <== mon.2 v2:172.21.15.161:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94a800ce50 con 0x7f94b8104880 2024-04-25T13:37:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.497+0000 7f94bff46700 1 -- 172.21.15.161:0/886368881 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b81a2560 con 0x7f94b8104880 2024-04-25T13:37:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.497+0000 7f94aeffd700 1 -- 172.21.15.161:0/886368881 <== mon.2 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8018660 con 0x7f94b8104880 2024-04-25T13:37:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.497+0000 7f94bff46700 1 -- 172.21.15.161:0/886368881 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b81a2aa0 con 0x7f94b8104880 2024-04-25T13:37:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.498+0000 7f94bff46700 1 -- 172.21.15.161:0/886368881 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b8051190 con 0x7f94b8104880 2024-04-25T13:37:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.499+0000 7f94aeffd700 1 -- 172.21.15.161:0/886368881 <== mon.2 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f94a800f450 con 0x7f94b8104880 2024-04-25T13:37:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.500+0000 7f94aeffd700 1 --2- 172.21.15.161:0/886368881 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f94a40afb80 0x7f94a40b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:37:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.500+0000 7f94aeffd700 1 -- 172.21.15.161:0/886368881 <== mon.2 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3669+0+0 (secure 0 0 0) 0x7f94a80ddbb0 con 0x7f94b8104880 2024-04-25T13:37:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.500+0000 7f94bdce2700 1 --2- 172.21.15.161:0/886368881 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f94a40afb80 0x7f94a40b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:37:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.500+0000 7f94bdce2700 1 --2- 172.21.15.161:0/886368881 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f94a40afb80 0x7f94a40b2090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f94b40098e0 tx=0x7f94b401a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:37:51.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.504+0000 7f94aeffd700 1 -- 172.21.15.161:0/886368881 <== mon.2 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f94a8014030 con 0x7f94b8104880 2024-04-25T13:37:51.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:37:51.707+0000 7f94bff46700 1 -- 172.21.15.161:0/886368881 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f94b802e8f0 con 0x7f94a40afb80 2024-04-25T13:37:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:52 smithi161 ceph-mon[32696]: osdmap e28: 4 total, 4 up, 4 in 2024-04-25T13:37:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:52 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:37:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:52 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:37:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:52 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:52.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:52 smithi175 ceph-mon[32649]: osdmap e28: 4 total, 4 up, 4 in 2024-04-25T13:37:52.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:52 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:37:52.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:52 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:37:52.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:52 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:52.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:52 smithi043 ceph-mon[29195]: osdmap e28: 4 total, 4 up, 4 in 2024-04-25T13:37:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:52 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:37:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:52 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:37:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:52 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:37:53.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:53 smithi161 ceph-mon[32696]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:37:53.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:53 smithi161 ceph-mon[32696]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-25T13:37:53.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:53 smithi175 ceph-mon[32649]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:37:53.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:53 smithi175 ceph-mon[32649]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-25T13:37:53.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:53 smithi043 ceph-mon[29195]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:37:53.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:53 smithi043 ceph-mon[29195]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-25T13:37:55.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:55 smithi161 ceph-mon[32696]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-04-25T13:37:55.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:55 smithi161 ceph-mon[32696]: from='client.? 172.21.15.161:0/3680547553' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efd85b77-da0c-48de-9338-6d8f5493aef8"}]: dispatch 2024-04-25T13:37:55.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:55 smithi161 ceph-mon[32696]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efd85b77-da0c-48de-9338-6d8f5493aef8"}]: dispatch 2024-04-25T13:37:55.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:55 smithi161 ceph-mon[32696]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efd85b77-da0c-48de-9338-6d8f5493aef8"}]': finished 2024-04-25T13:37:55.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:55 smithi161 ceph-mon[32696]: osdmap e29: 5 total, 4 up, 5 in 2024-04-25T13:37:55.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:55 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:37:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:55 smithi175 ceph-mon[32649]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-04-25T13:37:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:55 smithi175 ceph-mon[32649]: from='client.? 172.21.15.161:0/3680547553' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efd85b77-da0c-48de-9338-6d8f5493aef8"}]: dispatch 2024-04-25T13:37:55.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:55 smithi175 ceph-mon[32649]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efd85b77-da0c-48de-9338-6d8f5493aef8"}]: dispatch 2024-04-25T13:37:55.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:55 smithi175 ceph-mon[32649]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efd85b77-da0c-48de-9338-6d8f5493aef8"}]': finished 2024-04-25T13:37:55.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:55 smithi175 ceph-mon[32649]: osdmap e29: 5 total, 4 up, 5 in 2024-04-25T13:37:55.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:55 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:37:55.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:55 smithi043 ceph-mon[29195]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-04-25T13:37:55.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:55 smithi043 ceph-mon[29195]: from='client.? 172.21.15.161:0/3680547553' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efd85b77-da0c-48de-9338-6d8f5493aef8"}]: dispatch 2024-04-25T13:37:55.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:55 smithi043 ceph-mon[29195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efd85b77-da0c-48de-9338-6d8f5493aef8"}]: dispatch 2024-04-25T13:37:55.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:55 smithi043 ceph-mon[29195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efd85b77-da0c-48de-9338-6d8f5493aef8"}]': finished 2024-04-25T13:37:55.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:55 smithi043 ceph-mon[29195]: osdmap e29: 5 total, 4 up, 5 in 2024-04-25T13:37:55.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:55 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:37:56.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:56 smithi175 ceph-mon[32649]: from='client.? 172.21.15.161:0/2568475198' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:37:56.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:56 smithi043 ceph-mon[29195]: from='client.? 172.21.15.161:0/2568475198' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:37:56.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:56 smithi161 ceph-mon[32696]: from='client.? 172.21.15.161:0/2568475198' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:37:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:57 smithi175 ceph-mon[32649]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T13:37:57.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:57 smithi043 ceph-mon[29195]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T13:37:57.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:57 smithi161 ceph-mon[32696]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T13:37:59.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:37:59 smithi175 ceph-mon[32649]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-25T13:37:59.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:37:59 smithi043 ceph-mon[29195]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-25T13:37:59.541 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:37:59 smithi161 ceph-mon[32696]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-25T13:38:01.157 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:01 smithi161 ceph-mon[32696]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-25T13:38:01.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:01 smithi175 ceph-mon[32649]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-25T13:38:01.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:01 smithi043 ceph-mon[29195]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-25T13:38:02.402 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:02 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T13:38:02.402 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:02 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:02.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:02 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T13:38:02.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:02 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:02.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:02 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T13:38:02.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:02 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:03.417 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:03 smithi161 ceph-mon[32696]: Deploying daemon osd.4 on smithi161 2024-04-25T13:38:03.418 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:03 smithi161 ceph-mon[32696]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:03.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:03 smithi175 ceph-mon[32649]: Deploying daemon osd.4 on smithi161 2024-04-25T13:38:03.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:03 smithi175 ceph-mon[32649]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:03.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:03 smithi043 ceph-mon[29195]: Deploying daemon osd.4 on smithi161 2024-04-25T13:38:03.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:03 smithi043 ceph-mon[29195]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:05.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:05 smithi161 ceph-mon[32696]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:05.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:05 smithi175 ceph-mon[32649]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:05.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:05 smithi043 ceph-mon[29195]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:07.246 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:07 smithi161 ceph-mon[32696]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:07.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:07 smithi175 ceph-mon[32649]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:07.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:07 smithi043 ceph-mon[29195]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:08.500 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:08 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:08.500 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:08 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:08.501 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:08 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:38:08.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:08 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:08.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:08 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:08.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:08 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:38:08.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:08 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:08.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:08 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:08.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:08 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:38:09.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:09 smithi175 ceph-mon[32649]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:09.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:09 smithi161 ceph-mon[32696]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:09.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:09 smithi043 ceph-mon[29195]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:11.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:38:11.325+0000 7f94aeffd700 1 -- 172.21.15.161:0/886368881 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f94b802e8f0 con 0x7f94a40afb80 2024-04-25T13:38:11.326 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 4 on host 'smithi161' 2024-04-25T13:38:11.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:38:11.328+0000 7f94bff46700 1 -- 172.21.15.161:0/886368881 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f94a40afb80 msgr2=0x7f94a40b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:38:11.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:38:11.328+0000 7f94bff46700 1 --2- 172.21.15.161:0/886368881 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f94a40afb80 0x7f94a40b2090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f94b40098e0 tx=0x7f94b401a040 comp rx=0 tx=0).stop 2024-04-25T13:38:11.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:38:11.328+0000 7f94bff46700 1 -- 172.21.15.161:0/886368881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b8104880 msgr2=0x7f94b819ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:38:11.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:38:11.328+0000 7f94bff46700 1 --2- 172.21.15.161:0/886368881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b8104880 0x7f94b819ace0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f94a800c9b0 tx=0x7f94a800ccc0 comp rx=0 tx=0).stop 2024-04-25T13:38:11.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:38:11.328+0000 7f94bff46700 1 -- 172.21.15.161:0/886368881 shutdown_connections 2024-04-25T13:38:11.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:38:11.328+0000 7f94bff46700 1 --2- 172.21.15.161:0/886368881 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f94a40afb80 0x7f94a40b2090 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:11.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:38:11.328+0000 7f94bff46700 1 --2- 172.21.15.161:0/886368881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94b8105850 0x7f94b81a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:11.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:38:11.328+0000 7f94bff46700 1 --2- 172.21.15.161:0/886368881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94b8103e00 0x7f94b819a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:11.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:38:11.328+0000 7f94bff46700 1 --2- 172.21.15.161:0/886368881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94b8104880 0x7f94b819ace0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:11.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:38:11.328+0000 7f94bff46700 1 -- 172.21.15.161:0/886368881 >> 172.21.15.161:0/886368881 conn(0x7f94b80ff870 msgr2=0x7f94b8108570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:38:11.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:38:11.328+0000 7f94bff46700 1 -- 172.21.15.161:0/886368881 shutdown_connections 2024-04-25T13:38:11.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:38:11.328+0000 7f94bff46700 1 -- 172.21.15.161:0/886368881 wait complete. 2024-04-25T13:38:11.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:11 smithi161 ceph-mon[32696]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:11.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:11 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:11.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:11 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:11.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:11 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:11.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:11 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:38:11.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:11 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:11.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:11 smithi175 ceph-mon[32649]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:11.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:11 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:11.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:11 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:11.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:11 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:11.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:11 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:38:11.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:11 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:11.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:11 smithi043 ceph-mon[29195]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:11.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:11.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:11.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:11.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:38:11.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:11.979 DEBUG:teuthology.orchestra.run.smithi161:osd.4> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.4.service 2024-04-25T13:38:11.981 INFO:tasks.cephadm:Deploying osd.5 on smithi175 with /dev/vg_nvme/lv_3... 2024-04-25T13:38:11.981 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-25T13:38:12.226 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T13:38:12.522 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:12 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:12.522 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:12 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:12.523 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:12 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:38:12.523 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:12 smithi175 ceph-mon[32649]: from='osd.4 [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T13:38:12.523 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:12 smithi175 ceph-mon[32649]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T13:38:12.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:12 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:12.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:12 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:12.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:12 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:38:12.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:12 smithi161 ceph-mon[32696]: from='osd.4 [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T13:38:12.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:12 smithi161 ceph-mon[32696]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T13:38:12.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:12 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:12.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:12 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:12.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:12 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:38:12.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:12 smithi043 ceph-mon[29195]: from='osd.4 [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T13:38:12.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:12 smithi043 ceph-mon[29195]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T13:38:13.432 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:13 smithi161 ceph-mon[32696]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:13.433 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:13 smithi161 ceph-mon[32696]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T13:38:13.433 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:13 smithi161 ceph-mon[32696]: osdmap e30: 5 total, 4 up, 5 in 2024-04-25T13:38:13.433 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:13 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:38:13.433 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:13 smithi161 ceph-mon[32696]: from='osd.4 [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:38:13.433 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:13 smithi161 ceph-mon[32696]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:38:13.433 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:38:13 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4[43822]: 2024-04-25T13:38:13.296+0000 7fbf1dbef700 -1 osd.4 0 waiting for initial osdmap 2024-04-25T13:38:13.433 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:38:13 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4[43822]: 2024-04-25T13:38:13.303+0000 7fbf199a4700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:38:13.491 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:13 smithi175 ceph-mon[32649]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:13.491 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:13 smithi175 ceph-mon[32649]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T13:38:13.491 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:13 smithi175 ceph-mon[32649]: osdmap e30: 5 total, 4 up, 5 in 2024-04-25T13:38:13.492 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:13 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:38:13.492 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:13 smithi175 ceph-mon[32649]: from='osd.4 [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:38:13.492 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:13 smithi175 ceph-mon[32649]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:38:13.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:13 smithi043 ceph-mon[29195]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:13.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:13 smithi043 ceph-mon[29195]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T13:38:13.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:13 smithi043 ceph-mon[29195]: osdmap e30: 5 total, 4 up, 5 in 2024-04-25T13:38:13.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:13 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:38:13.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:13 smithi043 ceph-mon[29195]: from='osd.4 [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:38:13.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:13 smithi043 ceph-mon[29195]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:38:14.097 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-25T13:38:14.097 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-25T13:38:14.097 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2024-04-25T13:38:14.097 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2024-04-25T13:38:14.098 INFO:teuthology.orchestra.run.smithi175.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124144 s, 845 MB/s 2024-04-25T13:38:14.098 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2024-04-25T13:38:14.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:14 smithi175 ceph-mon[32649]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-04-25T13:38:14.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:14 smithi175 ceph-mon[32649]: osdmap e31: 5 total, 4 up, 5 in 2024-04-25T13:38:14.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:14 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:38:14.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:14 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:38:14.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:14 smithi161 ceph-mon[32696]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-04-25T13:38:14.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:14 smithi161 ceph-mon[32696]: osdmap e31: 5 total, 4 up, 5 in 2024-04-25T13:38:14.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:14 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:38:14.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:14 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:38:14.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:14 smithi043 ceph-mon[29195]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-04-25T13:38:14.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:14 smithi043 ceph-mon[29195]: osdmap e31: 5 total, 4 up, 5 in 2024-04-25T13:38:14.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:14 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:38:14.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:14 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:38:14.783 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_3 2024-04-25T13:38:15.016 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T13:38:15.418 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:15 smithi175 ceph-mon[32649]: purged_snaps scrub starts 2024-04-25T13:38:15.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:15 smithi175 ceph-mon[32649]: purged_snaps scrub ok 2024-04-25T13:38:15.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:15 smithi175 ceph-mon[32649]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:15.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:15 smithi175 ceph-mon[32649]: osd.4 [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010] boot 2024-04-25T13:38:15.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:15 smithi175 ceph-mon[32649]: osdmap e32: 5 total, 5 up, 5 in 2024-04-25T13:38:15.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:38:15.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:15.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:15.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:38:15.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:38:15.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:15.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:15.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:38:15.419 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:15.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:15 smithi161 ceph-mon[32696]: purged_snaps scrub starts 2024-04-25T13:38:15.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:15 smithi161 ceph-mon[32696]: purged_snaps scrub ok 2024-04-25T13:38:15.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:15 smithi161 ceph-mon[32696]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:15.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:15 smithi161 ceph-mon[32696]: osd.4 [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010] boot 2024-04-25T13:38:15.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:15 smithi161 ceph-mon[32696]: osdmap e32: 5 total, 5 up, 5 in 2024-04-25T13:38:15.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:38:15.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:15.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:15.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:38:15.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:38:15.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:15.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:15.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:38:15.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:15.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:15 smithi043 ceph-mon[29195]: purged_snaps scrub starts 2024-04-25T13:38:15.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:15 smithi043 ceph-mon[29195]: purged_snaps scrub ok 2024-04-25T13:38:15.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:15 smithi043 ceph-mon[29195]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-25T13:38:15.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:15 smithi043 ceph-mon[29195]: osd.4 [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010] boot 2024-04-25T13:38:15.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:15 smithi043 ceph-mon[29195]: osdmap e32: 5 total, 5 up, 5 in 2024-04-25T13:38:15.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:38:15.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:15.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:15.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:38:15.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:38:15.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:15.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:15.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:38:15.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:16.514 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:16 smithi175 ceph-mon[32649]: Detected new or changed devices on smithi161 2024-04-25T13:38:16.514 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:16 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi161 to 8544M 2024-04-25T13:38:16.514 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:16 smithi175 ceph-mon[32649]: osdmap e33: 5 total, 5 up, 5 in 2024-04-25T13:38:16.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:16 smithi161 ceph-mon[32696]: Detected new or changed devices on smithi161 2024-04-25T13:38:16.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:16 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi161 to 8544M 2024-04-25T13:38:16.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:16 smithi161 ceph-mon[32696]: osdmap e33: 5 total, 5 up, 5 in 2024-04-25T13:38:16.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:16 smithi043 ceph-mon[29195]: Detected new or changed devices on smithi161 2024-04-25T13:38:16.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:16 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi161 to 8544M 2024-04-25T13:38:16.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:16 smithi043 ceph-mon[29195]: osdmap e33: 5 total, 5 up, 5 in 2024-04-25T13:38:16.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.745+0000 7fa55de12700 1 -- 172.21.15.175:0/1966674114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa558104bd0 msgr2=0x7fa55810b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:38:16.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.745+0000 7fa55de12700 1 --2- 172.21.15.175:0/1966674114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa558104bd0 0x7fa55810b480 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa55000b0a0 tx=0x7fa55000b3b0 comp rx=0 tx=0).stop 2024-04-25T13:38:16.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.745+0000 7fa55de12700 1 -- 172.21.15.175:0/1966674114 shutdown_connections 2024-04-25T13:38:16.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.745+0000 7fa55de12700 1 --2- 172.21.15.175:0/1966674114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa558104bd0 0x7fa55810b480 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:16.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.745+0000 7fa55de12700 1 --2- 172.21.15.175:0/1966674114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa558103100 0x7fa558103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:16.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.745+0000 7fa55de12700 1 --2- 172.21.15.175:0/1966674114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa558104230 0x7fa558104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:16.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.745+0000 7fa55de12700 1 -- 172.21.15.175:0/1966674114 >> 172.21.15.175:0/1966674114 conn(0x7fa5580fe740 msgr2=0x7fa558100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:38:16.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.745+0000 7fa55de12700 1 -- 172.21.15.175:0/1966674114 shutdown_connections 2024-04-25T13:38:16.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.745+0000 7fa55de12700 1 -- 172.21.15.175:0/1966674114 wait complete. 2024-04-25T13:38:16.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.745+0000 7fa55de12700 1 Processor -- start 2024-04-25T13:38:16.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa55de12700 1 -- start start 2024-04-25T13:38:16.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa55de12700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa558103100 0x7fa558076320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:38:16.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa55de12700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa558104230 0x7fa55819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:38:16.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa55de12700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa558104bd0 0x7fa5581a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:38:16.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa55de12700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa55810ea80 con 0x7fa558103100 2024-04-25T13:38:16.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa55de12700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fa55810e900 con 0x7fa558104230 2024-04-25T13:38:16.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa55de12700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa55810ec00 con 0x7fa558104bd0 2024-04-25T13:38:16.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa557fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa558104bd0 0x7fa5581a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:38:16.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa557fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa558104bd0 0x7fa5581a19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51486/0 (socket says 172.21.15.175:51486) 2024-04-25T13:38:16.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa557fff700 1 -- 172.21.15.175:0/108213569 learned_addr learned my addr 172.21.15.175:0/108213569 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T13:38:16.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa556ffd700 1 --2- 172.21.15.175:0/108213569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa558104230 0x7fa55819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:38:16.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa5577fe700 1 --2- 172.21.15.175:0/108213569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa558103100 0x7fa558076320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:38:16.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa557fff700 1 -- 172.21.15.175:0/108213569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa558104230 msgr2=0x7fa55819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:38:16.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa557fff700 1 --2- 172.21.15.175:0/108213569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa558104230 0x7fa55819f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:16.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa557fff700 1 -- 172.21.15.175:0/108213569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa558103100 msgr2=0x7fa558076320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:38:16.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa557fff700 1 --2- 172.21.15.175:0/108213569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa558103100 0x7fa558076320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:16.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa557fff700 1 -- 172.21.15.175:0/108213569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5581a2220 con 0x7fa558104bd0 2024-04-25T13:38:16.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa5577fe700 1 --2- 172.21.15.175:0/108213569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa558103100 0x7fa558076320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:38:16.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.746+0000 7fa557fff700 1 --2- 172.21.15.175:0/108213569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa558104bd0 0x7fa5581a19f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa55000b830 tx=0x7fa550009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:38:16.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.747+0000 7fa554ff9700 1 -- 172.21.15.175:0/108213569 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550021070 con 0x7fa558104bd0 2024-04-25T13:38:16.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.747+0000 7fa55de12700 1 -- 172.21.15.175:0/108213569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5581a24b0 con 0x7fa558104bd0 2024-04-25T13:38:16.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.747+0000 7fa554ff9700 1 -- 172.21.15.175:0/108213569 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa550007b80 con 0x7fa558104bd0 2024-04-25T13:38:16.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.747+0000 7fa554ff9700 1 -- 172.21.15.175:0/108213569 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55001b690 con 0x7fa558104bd0 2024-04-25T13:38:16.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.747+0000 7fa55de12700 1 -- 172.21.15.175:0/108213569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5581a2900 con 0x7fa558104bd0 2024-04-25T13:38:16.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.748+0000 7fa55de12700 1 -- 172.21.15.175:0/108213569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa558051190 con 0x7fa558104bd0 2024-04-25T13:38:16.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.749+0000 7fa554ff9700 1 -- 172.21.15.175:0/108213569 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fa550024070 con 0x7fa558104bd0 2024-04-25T13:38:16.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.750+0000 7fa554ff9700 1 --2- 172.21.15.175:0/108213569 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa5400afb80 0x7fa5400b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:38:16.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.750+0000 7fa554ff9700 1 -- 172.21.15.175:0/108213569 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4101+0+0 (secure 0 0 0) 0x7fa55000f020 con 0x7fa558104bd0 2024-04-25T13:38:16.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.750+0000 7fa5577fe700 1 --2- 172.21.15.175:0/108213569 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa5400afb80 0x7fa5400b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:38:16.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.751+0000 7fa5577fe700 1 --2- 172.21.15.175:0/108213569 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa5400afb80 0x7fa5400b2090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa548005fd0 tx=0x7fa548005dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:38:16.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.754+0000 7fa554ff9700 1 -- 172.21.15.175:0/108213569 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa55002b020 con 0x7fa558104bd0 2024-04-25T13:38:16.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:16.967+0000 7fa55de12700 1 -- 172.21.15.175:0/108213569 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa558063b90 con 0x7fa5400afb80 2024-04-25T13:38:17.577 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:17 smithi175 ceph-mon[32649]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:17.577 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:17 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:38:17.577 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:17 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:38:17.577 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:17 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:17.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:17 smithi161 ceph-mon[32696]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:17.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:17 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:38:17.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:17 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:38:17.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:17 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:17.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:17 smithi043 ceph-mon[29195]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:17.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:17 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:38:17.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:17 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:38:17.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:17 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:18.572 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:18 smithi175 ceph-mon[32649]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:38:18.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:18 smithi161 ceph-mon[32696]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:38:18.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:18 smithi043 ceph-mon[29195]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:38:19.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:19 smithi161 ceph-mon[32696]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:19.614 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:19 smithi043 ceph-mon[29195]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:19.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:19 smithi175 ceph-mon[32649]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:20.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:20 smithi175 ceph-mon[32649]: from='client.? 172.21.15.175:0/2912123062' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41a6e540-aec0-48a6-a114-8dc9e0a8c0cd"}]: dispatch 2024-04-25T13:38:20.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:20 smithi175 ceph-mon[32649]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41a6e540-aec0-48a6-a114-8dc9e0a8c0cd"}]: dispatch 2024-04-25T13:38:20.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:20 smithi175 ceph-mon[32649]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41a6e540-aec0-48a6-a114-8dc9e0a8c0cd"}]': finished 2024-04-25T13:38:20.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:20 smithi175 ceph-mon[32649]: osdmap e34: 6 total, 5 up, 6 in 2024-04-25T13:38:20.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:20 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:20.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:20 smithi161 ceph-mon[32696]: from='client.? 172.21.15.175:0/2912123062' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41a6e540-aec0-48a6-a114-8dc9e0a8c0cd"}]: dispatch 2024-04-25T13:38:20.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:20 smithi161 ceph-mon[32696]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41a6e540-aec0-48a6-a114-8dc9e0a8c0cd"}]: dispatch 2024-04-25T13:38:20.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:20 smithi161 ceph-mon[32696]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41a6e540-aec0-48a6-a114-8dc9e0a8c0cd"}]': finished 2024-04-25T13:38:20.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:20 smithi161 ceph-mon[32696]: osdmap e34: 6 total, 5 up, 6 in 2024-04-25T13:38:20.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:20 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:20.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:20 smithi043 ceph-mon[29195]: from='client.? 172.21.15.175:0/2912123062' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41a6e540-aec0-48a6-a114-8dc9e0a8c0cd"}]: dispatch 2024-04-25T13:38:20.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:20 smithi043 ceph-mon[29195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41a6e540-aec0-48a6-a114-8dc9e0a8c0cd"}]: dispatch 2024-04-25T13:38:20.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:20 smithi043 ceph-mon[29195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41a6e540-aec0-48a6-a114-8dc9e0a8c0cd"}]': finished 2024-04-25T13:38:20.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:20 smithi043 ceph-mon[29195]: osdmap e34: 6 total, 5 up, 6 in 2024-04-25T13:38:20.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:20 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:21.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:21 smithi161 ceph-mon[32696]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:21.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:21 smithi161 ceph-mon[32696]: from='client.? 172.21.15.175:0/1119456150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:38:21.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:21 smithi175 ceph-mon[32649]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:21.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:21 smithi175 ceph-mon[32649]: from='client.? 172.21.15.175:0/1119456150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:38:21.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:21 smithi043 ceph-mon[29195]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:21.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:21 smithi043 ceph-mon[29195]: from='client.? 172.21.15.175:0/1119456150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:38:23.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:23 smithi161 ceph-mon[32696]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:23.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:23 smithi175 ceph-mon[32649]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:23.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:23 smithi043 ceph-mon[29195]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:25.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:25 smithi161 ceph-mon[32696]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:25.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:25 smithi175 ceph-mon[32649]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:25.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:25 smithi043 ceph-mon[29195]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:27.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:27 smithi175 ceph-mon[32649]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:27.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:27 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T13:38:27.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:27 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:27.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:27 smithi161 ceph-mon[32696]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:27.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:27 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T13:38:27.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:27 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:27.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:27 smithi043 ceph-mon[29195]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:27.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:27 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T13:38:27.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:27 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:28.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:28 smithi161 ceph-mon[32696]: Deploying daemon osd.5 on smithi175 2024-04-25T13:38:28.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:28 smithi175 ceph-mon[32649]: Deploying daemon osd.5 on smithi175 2024-04-25T13:38:28.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:28 smithi043 ceph-mon[29195]: Deploying daemon osd.5 on smithi175 2024-04-25T13:38:29.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:29 smithi161 ceph-mon[32696]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:29.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:29 smithi175 ceph-mon[32649]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:29.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:29 smithi043 ceph-mon[29195]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:31.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:31 smithi175 ceph-mon[32649]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:31.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:31 smithi161 ceph-mon[32696]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:31.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:31 smithi043 ceph-mon[29195]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:33.587 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:33 smithi175 ceph-mon[32649]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:33.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:33.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:33.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:38:33.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:33 smithi161 ceph-mon[32696]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:33.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:33.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:33.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:38:33.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:33 smithi043 ceph-mon[29195]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:33.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:33.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:33.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:38:35.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:35 smithi175 ceph-mon[32649]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:35.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:35 smithi161 ceph-mon[32696]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:35.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:35 smithi043 ceph-mon[29195]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:36.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:36.787+0000 7fa554ff9700 1 -- 172.21.15.175:0/108213569 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa558063b90 con 0x7fa5400afb80 2024-04-25T13:38:36.787 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 5 on host 'smithi175' 2024-04-25T13:38:36.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:36.790+0000 7fa55de12700 1 -- 172.21.15.175:0/108213569 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa5400afb80 msgr2=0x7fa5400b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:38:36.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:36.790+0000 7fa55de12700 1 --2- 172.21.15.175:0/108213569 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa5400afb80 0x7fa5400b2090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa548005fd0 tx=0x7fa548005dc0 comp rx=0 tx=0).stop 2024-04-25T13:38:36.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:36.790+0000 7fa55de12700 1 -- 172.21.15.175:0/108213569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa558104bd0 msgr2=0x7fa5581a19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:38:36.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:36.790+0000 7fa55de12700 1 --2- 172.21.15.175:0/108213569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa558104bd0 0x7fa5581a19f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa55000b830 tx=0x7fa550009bf0 comp rx=0 tx=0).stop 2024-04-25T13:38:36.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:36.790+0000 7fa55de12700 1 -- 172.21.15.175:0/108213569 shutdown_connections 2024-04-25T13:38:36.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:36.790+0000 7fa55de12700 1 --2- 172.21.15.175:0/108213569 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa5400afb80 0x7fa5400b2090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:36.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:36.790+0000 7fa55de12700 1 --2- 172.21.15.175:0/108213569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa558104bd0 0x7fa5581a19f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:36.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:36.790+0000 7fa55de12700 1 --2- 172.21.15.175:0/108213569 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa558103100 0x7fa558076320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:36.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:36.790+0000 7fa55de12700 1 --2- 172.21.15.175:0/108213569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa558104230 0x7fa55819f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:36.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:36.790+0000 7fa55de12700 1 -- 172.21.15.175:0/108213569 >> 172.21.15.175:0/108213569 conn(0x7fa5580fe740 msgr2=0x7fa558107460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:38:36.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:36.790+0000 7fa55de12700 1 -- 172.21.15.175:0/108213569 shutdown_connections 2024-04-25T13:38:36.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:38:36.790+0000 7fa55de12700 1 -- 172.21.15.175:0/108213569 wait complete. 2024-04-25T13:38:37.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:36 smithi175 ceph-mon[32649]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:37.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:37.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:37.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:37.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:38:37.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:37.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:36 smithi175 ceph-mon[32649]: from='osd.5 [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T13:38:37.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:36 smithi175 ceph-mon[32649]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T13:38:37.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:37.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:37.091 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:38:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:36 smithi043 ceph-mon[29195]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:38:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:36 smithi043 ceph-mon[29195]: from='osd.5 [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T13:38:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:36 smithi043 ceph-mon[29195]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T13:38:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:38:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:36 smithi161 ceph-mon[32696]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:38:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:36 smithi161 ceph-mon[32696]: from='osd.5 [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T13:38:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:36 smithi161 ceph-mon[32696]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T13:38:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:38:37.450 DEBUG:teuthology.orchestra.run.smithi175:osd.5> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.5.service 2024-04-25T13:38:37.452 INFO:tasks.cephadm:Deploying osd.6 on smithi043 with /dev/vg_nvme/lv_2... 2024-04-25T13:38:37.452 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-25T13:38:37.708 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:38:38.082 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:37 smithi043 ceph-mon[29195]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T13:38:38.083 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:37 smithi043 ceph-mon[29195]: osdmap e35: 6 total, 5 up, 6 in 2024-04-25T13:38:38.083 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:37 smithi043 ceph-mon[29195]: from='osd.5 [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:38:38.083 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:37 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:38.083 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:37 smithi043 ceph-mon[29195]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:38:38.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:37 smithi175 ceph-mon[32649]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T13:38:38.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:37 smithi175 ceph-mon[32649]: osdmap e35: 6 total, 5 up, 6 in 2024-04-25T13:38:38.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:37 smithi175 ceph-mon[32649]: from='osd.5 [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:38:38.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:37 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:38.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:37 smithi175 ceph-mon[32649]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:38:38.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:37 smithi161 ceph-mon[32696]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T13:38:38.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:37 smithi161 ceph-mon[32696]: osdmap e35: 6 total, 5 up, 6 in 2024-04-25T13:38:38.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:37 smithi161 ceph-mon[32696]: from='osd.5 [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:38:38.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:37 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:38.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:37 smithi161 ceph-mon[32696]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:38:38.886 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:38:38 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:38:38.598+0000 7f721fb10700 -1 osd.5 0 waiting for initial osdmap 2024-04-25T13:38:38.886 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:38:38 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:38:38.607+0000 7f72178bd700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:38:39.143 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:38 smithi175 ceph-mon[32649]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:39.143 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:38 smithi175 ceph-mon[32649]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-04-25T13:38:39.143 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:38 smithi175 ceph-mon[32649]: osdmap e36: 6 total, 5 up, 6 in 2024-04-25T13:38:39.143 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:38 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:39.143 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:38 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:39.143 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:38 smithi175 ceph-mon[32649]: from='osd.5 ' entity='osd.5' 2024-04-25T13:38:39.184 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:38 smithi043 ceph-mon[29195]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:39.184 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:38 smithi043 ceph-mon[29195]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-04-25T13:38:39.184 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:38 smithi043 ceph-mon[29195]: osdmap e36: 6 total, 5 up, 6 in 2024-04-25T13:38:39.184 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:38 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:39.184 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:38 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:39.184 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:38 smithi043 ceph-mon[29195]: from='osd.5 ' entity='osd.5' 2024-04-25T13:38:39.254 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:38 smithi161 ceph-mon[32696]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:39.254 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:38 smithi161 ceph-mon[32696]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-04-25T13:38:39.254 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:38 smithi161 ceph-mon[32696]: osdmap e36: 6 total, 5 up, 6 in 2024-04-25T13:38:39.254 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:38 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:39.254 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:38 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:39.254 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:38 smithi161 ceph-mon[32696]: from='osd.5 ' entity='osd.5' 2024-04-25T13:38:39.778 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-25T13:38:39.778 INFO:teuthology.orchestra.run.smithi043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-25T13:38:39.779 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10+0 records in 2024-04-25T13:38:39.779 INFO:teuthology.orchestra.run.smithi043.stderr:10+0 records out 2024-04-25T13:38:39.779 INFO:teuthology.orchestra.run.smithi043.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.008416 s, 1.2 GB/s 2024-04-25T13:38:39.779 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping successful for: 2024-04-25T13:38:40.104 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:39 smithi043 ceph-mon[29195]: purged_snaps scrub starts 2024-04-25T13:38:40.105 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:39 smithi043 ceph-mon[29195]: purged_snaps scrub ok 2024-04-25T13:38:40.105 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:39 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:40.105 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:39 smithi043 ceph-mon[29195]: osd.5 [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329] boot 2024-04-25T13:38:40.105 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:39 smithi043 ceph-mon[29195]: osdmap e37: 6 total, 6 up, 6 in 2024-04-25T13:38:40.105 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:39 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:40.166 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:39 smithi175 ceph-mon[32649]: purged_snaps scrub starts 2024-04-25T13:38:40.166 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:39 smithi175 ceph-mon[32649]: purged_snaps scrub ok 2024-04-25T13:38:40.166 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:39 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:40.166 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:39 smithi175 ceph-mon[32649]: osd.5 [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329] boot 2024-04-25T13:38:40.166 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:39 smithi175 ceph-mon[32649]: osdmap e37: 6 total, 6 up, 6 in 2024-04-25T13:38:40.166 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:39 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:40.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:39 smithi161 ceph-mon[32696]: purged_snaps scrub starts 2024-04-25T13:38:40.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:39 smithi161 ceph-mon[32696]: purged_snaps scrub ok 2024-04-25T13:38:40.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:39 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:40.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:39 smithi161 ceph-mon[32696]: osd.5 [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329] boot 2024-04-25T13:38:40.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:39 smithi161 ceph-mon[32696]: osdmap e37: 6 total, 6 up, 6 in 2024-04-25T13:38:40.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:39 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:38:40.377 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_2 2024-04-25T13:38:40.628 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:38:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:40 smithi043 ceph-mon[29195]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:40 smithi043 ceph-mon[29195]: osdmap e38: 6 total, 6 up, 6 in 2024-04-25T13:38:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:40 smithi043 ceph-mon[29195]: Detected new or changed devices on smithi175 2024-04-25T13:38:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:40 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:40 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:40 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:38:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:40 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:38:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:40 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi175 to 8544M 2024-04-25T13:38:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:40 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:40.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:40 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:40.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:40 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:38:40.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:40 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:41.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:40 smithi175 ceph-mon[32649]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:40 smithi175 ceph-mon[32649]: osdmap e38: 6 total, 6 up, 6 in 2024-04-25T13:38:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:40 smithi175 ceph-mon[32649]: Detected new or changed devices on smithi175 2024-04-25T13:38:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:40 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:40 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:40 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:38:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:40 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:38:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:40 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi175 to 8544M 2024-04-25T13:38:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:40 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:40 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:40 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:38:41.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:40 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:41.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:40 smithi161 ceph-mon[32696]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-04-25T13:38:41.373 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:40 smithi161 ceph-mon[32696]: osdmap e38: 6 total, 6 up, 6 in 2024-04-25T13:38:41.373 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:40 smithi161 ceph-mon[32696]: Detected new or changed devices on smithi175 2024-04-25T13:38:41.373 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:40 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:41.373 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:40 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:41.373 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:40 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:38:41.374 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:40 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:38:41.374 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:40 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi175 to 8544M 2024-04-25T13:38:41.374 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:40 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:41.374 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:40 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:41.374 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:40 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:38:41.374 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:40 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:38:42.095 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:41 smithi043 ceph-mon[29195]: osdmap e39: 6 total, 6 up, 6 in 2024-04-25T13:38:42.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:41 smithi175 ceph-mon[32649]: osdmap e39: 6 total, 6 up, 6 in 2024-04-25T13:38:42.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.343+0000 7fe199049700 1 -- 172.21.15.43:0/4028658934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe194105880 msgr2=0x7fe194105c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:38:42.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.343+0000 7fe199049700 1 --2- 172.21.15.43:0/4028658934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe194105880 0x7fe194105c90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00b0a0 tx=0x7fe18c00b3b0 comp rx=0 tx=0).stop 2024-04-25T13:38:42.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.343+0000 7fe199049700 1 -- 172.21.15.43:0/4028658934 shutdown_connections 2024-04-25T13:38:42.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.343+0000 7fe199049700 1 --2- 172.21.15.43:0/4028658934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1941048b0 0x7fe19410c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:42.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.343+0000 7fe199049700 1 --2- 172.21.15.43:0/4028658934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe194105880 0x7fe194105c90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:42.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.343+0000 7fe199049700 1 --2- 172.21.15.43:0/4028658934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe194103e30 0x7fe194104240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:42.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.343+0000 7fe199049700 1 -- 172.21.15.43:0/4028658934 >> 172.21.15.43:0/4028658934 conn(0x7fe1940ff8a0 msgr2=0x7fe194101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:38:42.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.343+0000 7fe199049700 1 -- 172.21.15.43:0/4028658934 shutdown_connections 2024-04-25T13:38:42.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.343+0000 7fe199049700 1 -- 172.21.15.43:0/4028658934 wait complete. 2024-04-25T13:38:42.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.344+0000 7fe199049700 1 Processor -- start 2024-04-25T13:38:42.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.344+0000 7fe199049700 1 -- start start 2024-04-25T13:38:42.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.344+0000 7fe199049700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe194103e30 0x7fe19419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:38:42.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.344+0000 7fe199049700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1941048b0 0x7fe19419ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:38:42.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.344+0000 7fe199049700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe194105880 0x7fe1941a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:38:42.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.344+0000 7fe199049700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe19410fc50 con 0x7fe1941048b0 2024-04-25T13:38:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.344+0000 7fe199049700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe19410fad0 con 0x7fe194105880 2024-04-25T13:38:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.344+0000 7fe199049700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe19410fdd0 con 0x7fe194103e30 2024-04-25T13:38:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.345+0000 7fe19259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1941048b0 0x7fe19419ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:38:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.345+0000 7fe19259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1941048b0 0x7fe19419ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47460/0 (socket says 172.21.15.43:47460) 2024-04-25T13:38:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.345+0000 7fe19259c700 1 -- 172.21.15.43:0/3852857381 learned_addr learned my addr 172.21.15.43:0/3852857381 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:38:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.345+0000 7fe192d9d700 1 --2- 172.21.15.43:0/3852857381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe194103e30 0x7fe19419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:38:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.345+0000 7fe19359e700 1 --2- 172.21.15.43:0/3852857381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe194105880 0x7fe1941a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:38:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.345+0000 7fe19259c700 1 -- 172.21.15.43:0/3852857381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe194103e30 msgr2=0x7fe19419a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:38:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.345+0000 7fe19259c700 1 --2- 172.21.15.43:0/3852857381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe194103e30 0x7fe19419a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.345+0000 7fe19259c700 1 -- 172.21.15.43:0/3852857381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe194105880 msgr2=0x7fe1941a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:38:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.345+0000 7fe19259c700 1 --2- 172.21.15.43:0/3852857381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe194105880 0x7fe1941a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:38:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.345+0000 7fe19259c700 1 -- 172.21.15.43:0/3852857381 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1941a2350 con 0x7fe1941048b0 2024-04-25T13:38:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.345+0000 7fe19259c700 1 --2- 172.21.15.43:0/3852857381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1941048b0 0x7fe19419ad30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe17c00d950 tx=0x7fe17c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:38:42.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.345+0000 7fe18bfff700 1 -- 172.21.15.43:0/3852857381 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c016070 con 0x7fe1941048b0 2024-04-25T13:38:42.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.345+0000 7fe199049700 1 -- 172.21.15.43:0/3852857381 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1941a2640 con 0x7fe1941048b0 2024-04-25T13:38:42.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.346+0000 7fe199049700 1 -- 172.21.15.43:0/3852857381 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1941a2bd0 con 0x7fe1941048b0 2024-04-25T13:38:42.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.346+0000 7fe18bfff700 1 -- 172.21.15.43:0/3852857381 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe17c010460 con 0x7fe1941048b0 2024-04-25T13:38:42.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.346+0000 7fe18bfff700 1 -- 172.21.15.43:0/3852857381 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c00f620 con 0x7fe1941048b0 2024-04-25T13:38:42.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.347+0000 7fe199049700 1 -- 172.21.15.43:0/3852857381 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe174005360 con 0x7fe1941048b0 2024-04-25T13:38:42.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.348+0000 7fe18bfff700 1 -- 172.21.15.43:0/3852857381 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fe17c019070 con 0x7fe1941048b0 2024-04-25T13:38:42.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.349+0000 7fe18bfff700 1 --2- 172.21.15.43:0/3852857381 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe1800afc00 0x7fe1800b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:38:42.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.349+0000 7fe192d9d700 1 --2- 172.21.15.43:0/3852857381 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe1800afc00 0x7fe1800b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:38:42.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.349+0000 7fe18bfff700 1 -- 172.21.15.43:0/3852857381 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4533+0+0 (secure 0 0 0) 0x7fe17c0ddba0 con 0x7fe1941048b0 2024-04-25T13:38:42.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.349+0000 7fe192d9d700 1 --2- 172.21.15.43:0/3852857381 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe1800afc00 0x7fe1800b2110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009fd0 tx=0x7fe18c00b7b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:38:42.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:41 smithi161 ceph-mon[32696]: osdmap e39: 6 total, 6 up, 6 in 2024-04-25T13:38:42.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.353+0000 7fe18bfff700 1 -- 172.21.15.43:0/3852857381 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe17c0a7640 con 0x7fe1941048b0 2024-04-25T13:38:42.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:38:42.570+0000 7fe199049700 1 -- 172.21.15.43:0/3852857381 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe174000bf0 con 0x7fe1800afc00 2024-04-25T13:38:43.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:42 smithi175 ceph-mon[32649]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-25T13:38:43.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:42 smithi175 ceph-mon[32649]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:38:43.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:42 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:38:43.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:42 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:38:43.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:42 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:43.207 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:42 smithi043 ceph-mon[29195]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-25T13:38:43.207 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:42 smithi043 ceph-mon[29195]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:38:43.207 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:42 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:38:43.207 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:42 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:38:43.207 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:42 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:43.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:42 smithi161 ceph-mon[32696]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-25T13:38:43.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:42 smithi161 ceph-mon[32696]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:38:43.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:42 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:38:43.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:42 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:38:43.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:42 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:45.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:44 smithi043 ceph-mon[29195]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T13:38:45.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:44 smithi161 ceph-mon[32696]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T13:38:45.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:44 smithi175 ceph-mon[32649]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T13:38:46.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:45 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2755336986' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42edbda7-0a4e-467b-8432-fd2fed66e115"}]: dispatch 2024-04-25T13:38:46.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:45 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2755336986' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42edbda7-0a4e-467b-8432-fd2fed66e115"}]': finished 2024-04-25T13:38:46.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:45 smithi043 ceph-mon[29195]: osdmap e40: 7 total, 6 up, 7 in 2024-04-25T13:38:46.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:38:46.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:45 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2755336986' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42edbda7-0a4e-467b-8432-fd2fed66e115"}]: dispatch 2024-04-25T13:38:46.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:45 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2755336986' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42edbda7-0a4e-467b-8432-fd2fed66e115"}]': finished 2024-04-25T13:38:46.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:45 smithi161 ceph-mon[32696]: osdmap e40: 7 total, 6 up, 7 in 2024-04-25T13:38:46.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:38:46.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:45 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2755336986' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42edbda7-0a4e-467b-8432-fd2fed66e115"}]: dispatch 2024-04-25T13:38:46.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:45 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2755336986' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42edbda7-0a4e-467b-8432-fd2fed66e115"}]': finished 2024-04-25T13:38:46.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:45 smithi175 ceph-mon[32649]: osdmap e40: 7 total, 6 up, 7 in 2024-04-25T13:38:46.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:38:47.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:46 smithi043 ceph-mon[29195]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T13:38:47.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:46 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/744033851' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:38:47.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:46 smithi161 ceph-mon[32696]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T13:38:47.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:46 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/744033851' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:38:47.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:46 smithi175 ceph-mon[32649]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T13:38:47.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:46 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/744033851' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:38:49.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:48 smithi043 ceph-mon[29195]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T13:38:49.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:48 smithi161 ceph-mon[32696]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T13:38:49.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:48 smithi175 ceph-mon[32649]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T13:38:50.989 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:50 smithi043 ceph-mon[29195]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-25T13:38:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:50 smithi161 ceph-mon[32696]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-25T13:38:51.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:50 smithi175 ceph-mon[32649]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-25T13:38:53.206 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:52 smithi043 ceph-mon[29195]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:38:53.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:52 smithi161 ceph-mon[32696]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:38:53.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:52 smithi175 ceph-mon[32649]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:38:54.177 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:53 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-25T13:38:54.177 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:53 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:54.177 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:53 smithi043 ceph-mon[29195]: Deploying daemon osd.6 on smithi043 2024-04-25T13:38:54.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:53 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-25T13:38:54.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:53 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:54.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:53 smithi161 ceph-mon[32696]: Deploying daemon osd.6 on smithi043 2024-04-25T13:38:54.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:53 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-25T13:38:54.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:53 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:38:54.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:53 smithi175 ceph-mon[32649]: Deploying daemon osd.6 on smithi043 2024-04-25T13:38:55.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:54 smithi043 ceph-mon[29195]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:38:55.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:54 smithi161 ceph-mon[32696]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:38:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:54 smithi175 ceph-mon[32649]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:38:57.209 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:56 smithi043 ceph-mon[29195]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:38:57.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:56 smithi161 ceph-mon[32696]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:38:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:56 smithi175 ceph-mon[32649]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:38:59.001 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:38:58 smithi043 ceph-mon[29195]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:38:59.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:38:58 smithi161 ceph-mon[32696]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:38:59.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:38:58 smithi175 ceph-mon[32649]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:39:00.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:00.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:00.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:00.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:00.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:00.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:00.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:00.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:00.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:01.651 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:01 smithi043 ceph-mon[29195]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:39:01.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:01 smithi175 ceph-mon[32649]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:39:01.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:01 smithi161 ceph-mon[32696]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:39:03.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:39:03.180+0000 7fe18bfff700 1 -- 172.21.15.43:0/3852857381 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe174000bf0 con 0x7fe1800afc00 2024-04-25T13:39:03.180 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 6 on host 'smithi043' 2024-04-25T13:39:03.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:39:03.183+0000 7fe199049700 1 -- 172.21.15.43:0/3852857381 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe1800afc00 msgr2=0x7fe1800b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:39:03.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:39:03.183+0000 7fe199049700 1 --2- 172.21.15.43:0/3852857381 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe1800afc00 0x7fe1800b2110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009fd0 tx=0x7fe18c00b7b0 comp rx=0 tx=0).stop 2024-04-25T13:39:03.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:39:03.183+0000 7fe199049700 1 -- 172.21.15.43:0/3852857381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1941048b0 msgr2=0x7fe19419ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:39:03.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:39:03.183+0000 7fe199049700 1 --2- 172.21.15.43:0/3852857381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1941048b0 0x7fe19419ad30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe17c00d950 tx=0x7fe17c00dd10 comp rx=0 tx=0).stop 2024-04-25T13:39:03.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:39:03.183+0000 7fe199049700 1 -- 172.21.15.43:0/3852857381 shutdown_connections 2024-04-25T13:39:03.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:39:03.183+0000 7fe199049700 1 --2- 172.21.15.43:0/3852857381 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe1800afc00 0x7fe1800b2110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:03.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:39:03.183+0000 7fe199049700 1 --2- 172.21.15.43:0/3852857381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe194105880 0x7fe1941a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:03.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:39:03.183+0000 7fe199049700 1 --2- 172.21.15.43:0/3852857381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe194103e30 0x7fe19419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:03.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:39:03.183+0000 7fe199049700 1 --2- 172.21.15.43:0/3852857381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1941048b0 0x7fe19419ad30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:03.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:39:03.183+0000 7fe199049700 1 -- 172.21.15.43:0/3852857381 >> 172.21.15.43:0/3852857381 conn(0x7fe1940ff8a0 msgr2=0x7fe1941085a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:39:03.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:39:03.183+0000 7fe199049700 1 -- 172.21.15.43:0/3852857381 shutdown_connections 2024-04-25T13:39:03.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:39:03.183+0000 7fe199049700 1 -- 172.21.15.43:0/3852857381 wait complete. 2024-04-25T13:39:03.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:03 smithi175 ceph-mon[32649]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:39:03.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:03 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:03.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:03 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:03.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:03 smithi175 ceph-mon[32649]: from='osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-25T13:39:03.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:03 smithi043 ceph-mon[29195]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:39:03.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:03 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:03.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:03 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:03.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:03 smithi043 ceph-mon[29195]: from='osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-25T13:39:03.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:03 smithi161 ceph-mon[32696]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:39:03.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:03 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:03.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:03 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:03.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:03 smithi161 ceph-mon[32696]: from='osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-25T13:39:03.868 DEBUG:teuthology.orchestra.run.smithi043:osd.6> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.6.service 2024-04-25T13:39:03.870 INFO:tasks.cephadm:Deploying osd.7 on smithi161 with /dev/vg_nvme/lv_2... 2024-04-25T13:39:03.870 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-25T13:39:04.120 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T13:39:05.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:04 smithi043 ceph-mon[29195]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:39:05.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:05.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:05.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:04 smithi043 ceph-mon[29195]: from='osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-25T13:39:05.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:04 smithi043 ceph-mon[29195]: osdmap e41: 7 total, 6 up, 7 in 2024-04-25T13:39:05.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:04 smithi043 ceph-mon[29195]: from='osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T13:39:05.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:39:05.278 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:04 smithi161 ceph-mon[32696]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:39:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:04 smithi161 ceph-mon[32696]: from='osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-25T13:39:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:04 smithi161 ceph-mon[32696]: osdmap e41: 7 total, 6 up, 7 in 2024-04-25T13:39:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:04 smithi161 ceph-mon[32696]: from='osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T13:39:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:39:05.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:04 smithi175 ceph-mon[32649]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:39:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:04 smithi175 ceph-mon[32649]: from='osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-25T13:39:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:04 smithi175 ceph-mon[32649]: osdmap e41: 7 total, 6 up, 7 in 2024-04-25T13:39:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:04 smithi175 ceph-mon[32649]: from='osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T13:39:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:39:06.150 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:39:05 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:39:05.746+0000 7f496d030700 -1 osd.6 0 waiting for initial osdmap 2024-04-25T13:39:06.150 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:39:05 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:39:05.754+0000 7f4964ddd700 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:39:06.260 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-25T13:39:06.260 INFO:teuthology.orchestra.run.smithi161.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-25T13:39:06.260 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10+0 records in 2024-04-25T13:39:06.260 INFO:teuthology.orchestra.run.smithi161.stderr:10+0 records out 2024-04-25T13:39:06.260 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.013063 s, 803 MB/s 2024-04-25T13:39:06.260 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping successful for: 2024-04-25T13:39:06.419 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:06 smithi043 ceph-mon[29195]: from='osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T13:39:06.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:06 smithi043 ceph-mon[29195]: osdmap e42: 7 total, 6 up, 7 in 2024-04-25T13:39:06.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:06 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:39:06.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:06 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:39:06.420 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:06 smithi043 ceph-mon[29195]: from='osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261]' entity='osd.6' 2024-04-25T13:39:06.563 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:06 smithi161 ceph-mon[32696]: from='osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T13:39:06.563 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:06 smithi161 ceph-mon[32696]: osdmap e42: 7 total, 6 up, 7 in 2024-04-25T13:39:06.564 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:06 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:39:06.564 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:06 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:39:06.564 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:06 smithi161 ceph-mon[32696]: from='osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261]' entity='osd.6' 2024-04-25T13:39:06.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:06 smithi175 ceph-mon[32649]: from='osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T13:39:06.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:06 smithi175 ceph-mon[32649]: osdmap e42: 7 total, 6 up, 7 in 2024-04-25T13:39:06.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:06 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:39:06.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:06 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:39:06.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:06 smithi175 ceph-mon[32649]: from='osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261]' entity='osd.6' 2024-04-25T13:39:06.929 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi161:vg_nvme/lv_2 2024-04-25T13:39:07.175 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T13:39:07.182 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:07 smithi161 ceph-mon[32696]: purged_snaps scrub starts 2024-04-25T13:39:07.183 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:07 smithi161 ceph-mon[32696]: purged_snaps scrub ok 2024-04-25T13:39:07.183 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:07 smithi161 ceph-mon[32696]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:39:07.183 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:07 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:39:07.441 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:07 smithi161 ceph-mon[32696]: osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261] boot 2024-04-25T13:39:07.441 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:07 smithi161 ceph-mon[32696]: osdmap e43: 7 total, 7 up, 7 in 2024-04-25T13:39:07.441 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:07 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:39:07.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:07 smithi043 ceph-mon[29195]: purged_snaps scrub starts 2024-04-25T13:39:07.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:07 smithi043 ceph-mon[29195]: purged_snaps scrub ok 2024-04-25T13:39:07.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:07 smithi043 ceph-mon[29195]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:39:07.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:07 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:39:07.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:07 smithi043 ceph-mon[29195]: osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261] boot 2024-04-25T13:39:07.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:07 smithi043 ceph-mon[29195]: osdmap e43: 7 total, 7 up, 7 in 2024-04-25T13:39:07.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:07 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:39:07.582 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:07 smithi175 ceph-mon[32649]: purged_snaps scrub starts 2024-04-25T13:39:07.582 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:07 smithi175 ceph-mon[32649]: purged_snaps scrub ok 2024-04-25T13:39:07.582 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:07 smithi175 ceph-mon[32649]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-25T13:39:07.582 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:07 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:39:07.582 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:07 smithi175 ceph-mon[32649]: osd.6 [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261] boot 2024-04-25T13:39:07.582 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:07 smithi175 ceph-mon[32649]: osdmap e43: 7 total, 7 up, 7 in 2024-04-25T13:39:07.582 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:07 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:39:08.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.896+0000 7fac5b41f700 1 -- 172.21.15.161:0/3342842246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac54103110 msgr2=0x7fac54103520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:39:08.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.896+0000 7fac5b41f700 1 --2- 172.21.15.161:0/3342842246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac54103110 0x7fac54103520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fac50009990 tx=0x7fac50009ca0 comp rx=0 tx=0).stop 2024-04-25T13:39:08.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.896+0000 7fac5b41f700 1 -- 172.21.15.161:0/3342842246 shutdown_connections 2024-04-25T13:39:08.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.896+0000 7fac5b41f700 1 --2- 172.21.15.161:0/3342842246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac54104be0 0x7fac5410b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:08.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.896+0000 7fac5b41f700 1 --2- 172.21.15.161:0/3342842246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac54103110 0x7fac54103520 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:08.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.896+0000 7fac5b41f700 1 --2- 172.21.15.161:0/3342842246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac54104240 0x7fac54104650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:08.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.896+0000 7fac5b41f700 1 -- 172.21.15.161:0/3342842246 >> 172.21.15.161:0/3342842246 conn(0x7fac540fe750 msgr2=0x7fac54100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:39:08.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.896+0000 7fac5b41f700 1 -- 172.21.15.161:0/3342842246 shutdown_connections 2024-04-25T13:39:08.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.896+0000 7fac5b41f700 1 -- 172.21.15.161:0/3342842246 wait complete. 2024-04-25T13:39:08.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.897+0000 7fac5b41f700 1 Processor -- start 2024-04-25T13:39:08.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.897+0000 7fac5b41f700 1 -- start start 2024-04-25T13:39:08.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.897+0000 7fac5b41f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac54103110 0x7fac54199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:39:08.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.897+0000 7fac5b41f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac54104240 0x7fac54199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:39:08.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac5b41f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac54104be0 0x7fac541a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:39:08.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac5b41f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fac5410ea80 con 0x7fac54104240 2024-04-25T13:39:08.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac5b41f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fac5410e900 con 0x7fac54104be0 2024-04-25T13:39:08.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac5b41f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fac5410ec00 con 0x7fac54103110 2024-04-25T13:39:08.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac599bc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac54104be0 0x7fac541a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:39:08.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac599bc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac54104be0 0x7fac541a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53974/0 (socket says 172.21.15.161:53974) 2024-04-25T13:39:08.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac599bc700 1 -- 172.21.15.161:0/2199753365 learned_addr learned my addr 172.21.15.161:0/2199753365 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-04-25T13:39:08.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac591bb700 1 --2- 172.21.15.161:0/2199753365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac54103110 0x7fac54199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:39:08.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac589ba700 1 --2- 172.21.15.161:0/2199753365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac54104240 0x7fac54199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:39:08.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac599bc700 1 -- 172.21.15.161:0/2199753365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac54103110 msgr2=0x7fac54199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:39:08.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac599bc700 1 --2- 172.21.15.161:0/2199753365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac54103110 0x7fac54199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:08.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac599bc700 1 -- 172.21.15.161:0/2199753365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac54104240 msgr2=0x7fac54199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:39:08.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac599bc700 1 --2- 172.21.15.161:0/2199753365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac54104240 0x7fac54199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:08.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac599bc700 1 -- 172.21.15.161:0/2199753365 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac541a11e0 con 0x7fac54104be0 2024-04-25T13:39:08.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac599bc700 1 --2- 172.21.15.161:0/2199753365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac54104be0 0x7fac541a0b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00b970 tx=0x7fac4c00bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:39:08.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac4a7fc700 1 -- 172.21.15.161:0/2199753365 <== mon.2 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c019070 con 0x7fac54104be0 2024-04-25T13:39:08.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.898+0000 7fac5b41f700 1 -- 172.21.15.161:0/2199753365 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac541a14d0 con 0x7fac54104be0 2024-04-25T13:39:08.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.899+0000 7fac4a7fc700 1 -- 172.21.15.161:0/2199753365 <== mon.2 v2:172.21.15.161:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac4c00cdc0 con 0x7fac54104be0 2024-04-25T13:39:08.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.899+0000 7fac4a7fc700 1 -- 172.21.15.161:0/2199753365 <== mon.2 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c014e30 con 0x7fac54104be0 2024-04-25T13:39:08.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.899+0000 7fac5b41f700 1 -- 172.21.15.161:0/2199753365 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac541a1a90 con 0x7fac54104be0 2024-04-25T13:39:08.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.900+0000 7fac5b41f700 1 -- 172.21.15.161:0/2199753365 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac54051190 con 0x7fac54104be0 2024-04-25T13:39:08.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.901+0000 7fac4a7fc700 1 -- 172.21.15.161:0/2199753365 <== mon.2 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fac4c01c070 con 0x7fac54104be0 2024-04-25T13:39:08.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.902+0000 7fac4a7fc700 1 --2- 172.21.15.161:0/2199753365 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fac400afc00 0x7fac400b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:39:08.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.902+0000 7fac4a7fc700 1 -- 172.21.15.161:0/2199753365 <== mon.2 v2:172.21.15.161:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7fac4c0dd670 con 0x7fac54104be0 2024-04-25T13:39:08.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.902+0000 7fac591bb700 1 --2- 172.21.15.161:0/2199753365 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fac400afc00 0x7fac400b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:39:08.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.903+0000 7fac591bb700 1 --2- 172.21.15.161:0/2199753365 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fac400afc00 0x7fac400b2110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fac5000b2e0 tx=0x7fac5001a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:39:08.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:08.906+0000 7fac4a7fc700 1 -- 172.21.15.161:0/2199753365 <== mon.2 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fac4c0a6f60 con 0x7fac54104be0 2024-04-25T13:39:09.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:09.116+0000 7fac5b41f700 1 -- 172.21.15.161:0/2199753365 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fac54063ad0 con 0x7fac400afc00 2024-04-25T13:39:09.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:09.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: Detected new or changed devices on smithi043 2024-04-25T13:39:09.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:09.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:09.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:09.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:09.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:09.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi043 to 5697M 2024-04-25T13:39:09.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:09.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:09.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:09.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:09.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:09.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:09.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:09.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:09.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:08 smithi175 ceph-mon[32649]: osdmap e44: 7 total, 7 up, 7 in 2024-04-25T13:39:09.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: Detected new or changed devices on smithi043 2024-04-25T13:39:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi043 to 5697M 2024-04-25T13:39:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:09.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:09.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:09.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:09.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:08 smithi161 ceph-mon[32696]: osdmap e44: 7 total, 7 up, 7 in 2024-04-25T13:39:09.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:09.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: Detected new or changed devices on smithi043 2024-04-25T13:39:09.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:09.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:09.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:09.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:09.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:09.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi043 to 5697M 2024-04-25T13:39:09.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:09.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:09.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:09.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:09.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:09.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:09.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:09.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:09.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:08 smithi043 ceph-mon[29195]: osdmap e44: 7 total, 7 up, 7 in 2024-04-25T13:39:10.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:09 smithi161 ceph-mon[32696]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:39:10.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:09 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:39:10.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:09 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:39:10.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:09 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:10.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:09 smithi175 ceph-mon[32649]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:39:10.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:09 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:39:10.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:09 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:39:10.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:09 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:10.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:09 smithi043 ceph-mon[29195]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:39:10.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:09 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:39:10.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:09 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:39:10.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:09 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:11.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:10 smithi161 ceph-mon[32696]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:11.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:10 smithi175 ceph-mon[32649]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:11.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:10 smithi043 ceph-mon[29195]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:12.246 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:11 smithi161 ceph-mon[32696]: from='client.? 172.21.15.161:0/1275632475' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2ddcb6f-9e91-4c87-a504-c1182a462b89"}]: dispatch 2024-04-25T13:39:12.246 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:11 smithi161 ceph-mon[32696]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2ddcb6f-9e91-4c87-a504-c1182a462b89"}]: dispatch 2024-04-25T13:39:12.247 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:11 smithi161 ceph-mon[32696]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2ddcb6f-9e91-4c87-a504-c1182a462b89"}]': finished 2024-04-25T13:39:12.247 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:11 smithi161 ceph-mon[32696]: osdmap e45: 8 total, 7 up, 8 in 2024-04-25T13:39:12.247 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:11 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:39:12.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:11 smithi175 ceph-mon[32649]: from='client.? 172.21.15.161:0/1275632475' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2ddcb6f-9e91-4c87-a504-c1182a462b89"}]: dispatch 2024-04-25T13:39:12.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:11 smithi175 ceph-mon[32649]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2ddcb6f-9e91-4c87-a504-c1182a462b89"}]: dispatch 2024-04-25T13:39:12.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:11 smithi175 ceph-mon[32649]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2ddcb6f-9e91-4c87-a504-c1182a462b89"}]': finished 2024-04-25T13:39:12.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:11 smithi175 ceph-mon[32649]: osdmap e45: 8 total, 7 up, 8 in 2024-04-25T13:39:12.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:11 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:39:12.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:11 smithi043 ceph-mon[29195]: from='client.? 172.21.15.161:0/1275632475' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2ddcb6f-9e91-4c87-a504-c1182a462b89"}]: dispatch 2024-04-25T13:39:12.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:11 smithi043 ceph-mon[29195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2ddcb6f-9e91-4c87-a504-c1182a462b89"}]: dispatch 2024-04-25T13:39:12.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:11 smithi043 ceph-mon[29195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2ddcb6f-9e91-4c87-a504-c1182a462b89"}]': finished 2024-04-25T13:39:12.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:11 smithi043 ceph-mon[29195]: osdmap e45: 8 total, 7 up, 8 in 2024-04-25T13:39:12.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:39:13.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:12 smithi161 ceph-mon[32696]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:13.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:12 smithi161 ceph-mon[32696]: from='client.? 172.21.15.161:0/3362212996' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:39:13.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:12 smithi175 ceph-mon[32649]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:13.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:12 smithi175 ceph-mon[32649]: from='client.? 172.21.15.161:0/3362212996' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:39:13.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:12 smithi043 ceph-mon[29195]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:13.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:12 smithi043 ceph-mon[29195]: from='client.? 172.21.15.161:0/3362212996' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:39:15.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:14 smithi161 ceph-mon[32696]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:15.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:14 smithi175 ceph-mon[32649]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:15.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:14 smithi043 ceph-mon[29195]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:17.259 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:16 smithi161 ceph-mon[32696]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:17.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:16 smithi175 ceph-mon[32649]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:17.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:16 smithi043 ceph-mon[29195]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:19.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:18 smithi175 ceph-mon[32649]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:19.265 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:18 smithi043 ceph-mon[29195]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:19.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:18 smithi161 ceph-mon[32696]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:20.332 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:20 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-25T13:39:20.332 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:20 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:20.332 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:20 smithi161 ceph-mon[32696]: Deploying daemon osd.7 on smithi161 2024-04-25T13:39:20.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:20 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-25T13:39:20.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:20 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:20.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:20 smithi175 ceph-mon[32649]: Deploying daemon osd.7 on smithi161 2024-04-25T13:39:20.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:20 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-25T13:39:20.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:20 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:20.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:20 smithi043 ceph-mon[29195]: Deploying daemon osd.7 on smithi161 2024-04-25T13:39:21.294 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:21 smithi161 ceph-mon[32696]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:21.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:21 smithi175 ceph-mon[32649]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:21.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:21 smithi043 ceph-mon[29195]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:23.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:23 smithi161 ceph-mon[32696]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:23.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:23 smithi175 ceph-mon[32649]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:23.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:23 smithi043 ceph-mon[29195]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:25.096 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:25 smithi161 ceph-mon[32696]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:25.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:25 smithi175 ceph-mon[32649]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:25.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:25 smithi043 ceph-mon[29195]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:26.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:26 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:26.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:26 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:26.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:26 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:26.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:26 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:26.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:26 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:26.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:26 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:26.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:26 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:26.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:26 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:26.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:26 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:27.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:27 smithi161 ceph-mon[32696]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:27.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:27 smithi175 ceph-mon[32649]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:27.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:27 smithi043 ceph-mon[29195]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:28.785 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 7 on host 'smithi161' 2024-04-25T13:39:28.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:28.785+0000 7fac4a7fc700 1 -- 172.21.15.161:0/2199753365 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fac54063ad0 con 0x7fac400afc00 2024-04-25T13:39:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:28.787+0000 7fac5b41f700 1 -- 172.21.15.161:0/2199753365 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fac400afc00 msgr2=0x7fac400b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:39:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:28.787+0000 7fac5b41f700 1 --2- 172.21.15.161:0/2199753365 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fac400afc00 0x7fac400b2110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fac5000b2e0 tx=0x7fac5001a040 comp rx=0 tx=0).stop 2024-04-25T13:39:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:28.787+0000 7fac5b41f700 1 -- 172.21.15.161:0/2199753365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac54104be0 msgr2=0x7fac541a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:39:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:28.787+0000 7fac5b41f700 1 --2- 172.21.15.161:0/2199753365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac54104be0 0x7fac541a0b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00b970 tx=0x7fac4c00bc80 comp rx=0 tx=0).stop 2024-04-25T13:39:28.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:28.787+0000 7fac5b41f700 1 -- 172.21.15.161:0/2199753365 shutdown_connections 2024-04-25T13:39:28.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:28.787+0000 7fac5b41f700 1 --2- 172.21.15.161:0/2199753365 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fac400afc00 0x7fac400b2110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:28.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:28.787+0000 7fac5b41f700 1 --2- 172.21.15.161:0/2199753365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac54104be0 0x7fac541a0b60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:28.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:28.787+0000 7fac5b41f700 1 --2- 172.21.15.161:0/2199753365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac54103110 0x7fac54199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:28.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:28.787+0000 7fac5b41f700 1 --2- 172.21.15.161:0/2199753365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac54104240 0x7fac54199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:28.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:28.787+0000 7fac5b41f700 1 -- 172.21.15.161:0/2199753365 >> 172.21.15.161:0/2199753365 conn(0x7fac540fe750 msgr2=0x7fac541074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:39:28.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:28.787+0000 7fac5b41f700 1 -- 172.21.15.161:0/2199753365 shutdown_connections 2024-04-25T13:39:28.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:39:28.787+0000 7fac5b41f700 1 -- 172.21.15.161:0/2199753365 wait complete. 2024-04-25T13:39:29.434 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:29 smithi161 ceph-mon[32696]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:29.434 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:29 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:29.434 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:29 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:29.434 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:29 smithi161 ceph-mon[32696]: from='osd.7 [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T13:39:29.434 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:29 smithi161 ceph-mon[32696]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T13:39:29.460 DEBUG:teuthology.orchestra.run.smithi161:osd.7> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.7.service 2024-04-25T13:39:29.462 INFO:tasks.cephadm:Deploying osd.8 on smithi175 with /dev/vg_nvme/lv_2... 2024-04-25T13:39:29.462 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-25T13:39:29.490 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:29 smithi175 ceph-mon[32649]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:29.490 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:29 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:29.490 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:29 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:29.490 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:29 smithi175 ceph-mon[32649]: from='osd.7 [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T13:39:29.490 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:29 smithi175 ceph-mon[32649]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T13:39:29.712 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T13:39:29.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:29 smithi043 ceph-mon[29195]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:29.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:29 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:29.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:29 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:29.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:29 smithi043 ceph-mon[29195]: from='osd.7 [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T13:39:29.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:29 smithi043 ceph-mon[29195]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T13:39:30.762 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:30 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:30.762 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:30 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:30.762 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:30 smithi161 ceph-mon[32696]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-25T13:39:30.762 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:30 smithi161 ceph-mon[32696]: osdmap e46: 8 total, 7 up, 8 in 2024-04-25T13:39:30.763 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:30 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:39:30.763 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:30 smithi161 ceph-mon[32696]: from='osd.7 [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:39:30.763 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:30 smithi161 ceph-mon[32696]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:39:30.763 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:39:30 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:39:30.749+0000 7f2fa6200700 -1 osd.7 0 waiting for initial osdmap 2024-04-25T13:39:30.763 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:39:30 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:39:30.762+0000 7f2fa1fb5700 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:39:30.902 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:30 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:30.902 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:30 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:30.903 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:30 smithi175 ceph-mon[32649]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-25T13:39:30.903 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:30 smithi175 ceph-mon[32649]: osdmap e46: 8 total, 7 up, 8 in 2024-04-25T13:39:30.903 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:30 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:39:30.903 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:30 smithi175 ceph-mon[32649]: from='osd.7 [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:39:30.903 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:30 smithi175 ceph-mon[32649]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:39:30.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:30 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:30.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:30 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:30.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:30 smithi043 ceph-mon[29195]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-25T13:39:30.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:30 smithi043 ceph-mon[29195]: osdmap e46: 8 total, 7 up, 8 in 2024-04-25T13:39:30.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:30 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:39:30.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:30 smithi043 ceph-mon[29195]: from='osd.7 [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:39:30.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:30 smithi043 ceph-mon[29195]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:39:31.738 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-25T13:39:31.738 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-25T13:39:31.738 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2024-04-25T13:39:31.738 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2024-04-25T13:39:31.738 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0140278 s, 748 MB/s 2024-04-25T13:39:31.738 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2024-04-25T13:39:31.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:31 smithi175 ceph-mon[32649]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:31.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:31 smithi175 ceph-mon[32649]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-04-25T13:39:31.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:31 smithi175 ceph-mon[32649]: osdmap e47: 8 total, 7 up, 8 in 2024-04-25T13:39:31.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:31 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:39:31.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:31 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:39:31.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:31 smithi043 ceph-mon[29195]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:31.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:31 smithi043 ceph-mon[29195]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-04-25T13:39:31.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:31 smithi043 ceph-mon[29195]: osdmap e47: 8 total, 7 up, 8 in 2024-04-25T13:39:31.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:31 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:39:31.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:31 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:39:32.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:31 smithi161 ceph-mon[32696]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T13:39:32.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:31 smithi161 ceph-mon[32696]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-04-25T13:39:32.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:31 smithi161 ceph-mon[32696]: osdmap e47: 8 total, 7 up, 8 in 2024-04-25T13:39:32.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:31 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:39:32.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:31 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:39:32.413 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_2 2024-04-25T13:39:32.698 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T13:39:32.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:32 smithi043 ceph-mon[29195]: purged_snaps scrub starts 2024-04-25T13:39:32.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:32 smithi043 ceph-mon[29195]: purged_snaps scrub ok 2024-04-25T13:39:32.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:32 smithi043 ceph-mon[29195]: osd.7 [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149] boot 2024-04-25T13:39:32.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:32 smithi043 ceph-mon[29195]: osdmap e48: 8 total, 8 up, 8 in 2024-04-25T13:39:32.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:32 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:39:32.979 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:32 smithi175 ceph-mon[32649]: purged_snaps scrub starts 2024-04-25T13:39:32.979 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:32 smithi175 ceph-mon[32649]: purged_snaps scrub ok 2024-04-25T13:39:32.979 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:32 smithi175 ceph-mon[32649]: osd.7 [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149] boot 2024-04-25T13:39:32.980 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:32 smithi175 ceph-mon[32649]: osdmap e48: 8 total, 8 up, 8 in 2024-04-25T13:39:32.980 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:32 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:39:33.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:32 smithi161 ceph-mon[32696]: purged_snaps scrub starts 2024-04-25T13:39:33.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:32 smithi161 ceph-mon[32696]: purged_snaps scrub ok 2024-04-25T13:39:33.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:32 smithi161 ceph-mon[32696]: osd.7 [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149] boot 2024-04-25T13:39:33.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:32 smithi161 ceph-mon[32696]: osdmap e48: 8 total, 8 up, 8 in 2024-04-25T13:39:33.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:32 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:39:33.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:33 smithi175 ceph-mon[32649]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:33.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:33 smithi175 ceph-mon[32649]: osdmap e49: 8 total, 8 up, 8 in 2024-04-25T13:39:33.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:33.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:33.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:33.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:33.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:33.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:33.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:33.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:33.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:33.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:33.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:33.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:33.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:33 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:33.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:33 smithi043 ceph-mon[29195]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:33.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:33 smithi043 ceph-mon[29195]: osdmap e49: 8 total, 8 up, 8 in 2024-04-25T13:39:33.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:33.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:33.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:33.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:33.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:33.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:33.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:33.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:33.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:33.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:33.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:33.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:33.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:33 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:34.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:33 smithi161 ceph-mon[32696]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:34.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:33 smithi161 ceph-mon[32696]: osdmap e49: 8 total, 8 up, 8 in 2024-04-25T13:39:34.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:34.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:34.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:34.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:34.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:34.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:34.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:34.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:34.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:34.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:34.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:34.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:34.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:33 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:34.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.469+0000 7f9986fe8700 1 -- 172.21.15.175:0/3182165278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99801030e0 msgr2=0x7f99801034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:39:34.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.469+0000 7f9986fe8700 1 --2- 172.21.15.175:0/3182165278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99801030e0 0x7f99801034f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9974009990 tx=0x7f9974009ca0 comp rx=0 tx=0).stop 2024-04-25T13:39:34.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.469+0000 7f9986fe8700 1 -- 172.21.15.175:0/3182165278 shutdown_connections 2024-04-25T13:39:34.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.469+0000 7f9986fe8700 1 --2- 172.21.15.175:0/3182165278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9980104bb0 0x7f998010b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:34.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.469+0000 7f9986fe8700 1 --2- 172.21.15.175:0/3182165278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99801030e0 0x7f99801034f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:34.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.469+0000 7f9986fe8700 1 --2- 172.21.15.175:0/3182165278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9980104210 0x7f9980104620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:34.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.469+0000 7f9986fe8700 1 -- 172.21.15.175:0/3182165278 >> 172.21.15.175:0/3182165278 conn(0x7f99800fe740 msgr2=0x7f9980100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:39:34.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.470+0000 7f9986fe8700 1 -- 172.21.15.175:0/3182165278 shutdown_connections 2024-04-25T13:39:34.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.470+0000 7f9986fe8700 1 -- 172.21.15.175:0/3182165278 wait complete. 2024-04-25T13:39:34.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.470+0000 7f9986fe8700 1 Processor -- start 2024-04-25T13:39:34.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.470+0000 7f9986fe8700 1 -- start start 2024-04-25T13:39:34.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.470+0000 7f9986fe8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99801030e0 0x7f998019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:39:34.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.470+0000 7f9986fe8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9980104210 0x7f998019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:39:34.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.470+0000 7f9986fe8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9980104bb0 0x7f99801a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:39:34.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.470+0000 7f9986fe8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f998010fb70 con 0x7f9980104210 2024-04-25T13:39:34.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.470+0000 7f9986fe8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f998010f9f0 con 0x7f99801030e0 2024-04-25T13:39:34.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.470+0000 7f9986fe8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f998010fcf0 con 0x7f9980104bb0 2024-04-25T13:39:34.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.471+0000 7f9985585700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9980104bb0 0x7f99801a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:39:34.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.471+0000 7f9985585700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9980104bb0 0x7f99801a1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60182/0 (socket says 172.21.15.175:60182) 2024-04-25T13:39:34.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.471+0000 7f9985585700 1 -- 172.21.15.175:0/1395492504 learned_addr learned my addr 172.21.15.175:0/1395492504 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T13:39:34.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.471+0000 7f9984d84700 1 --2- 172.21.15.175:0/1395492504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99801030e0 0x7f998019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:39:34.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.471+0000 7f997ffff700 1 --2- 172.21.15.175:0/1395492504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9980104210 0x7f998019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:39:34.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.471+0000 7f9985585700 1 -- 172.21.15.175:0/1395492504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99801030e0 msgr2=0x7f998019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:39:34.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.471+0000 7f9985585700 1 --2- 172.21.15.175:0/1395492504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99801030e0 0x7f998019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:34.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.471+0000 7f9985585700 1 -- 172.21.15.175:0/1395492504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9980104210 msgr2=0x7f998019ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:39:34.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.471+0000 7f9985585700 1 --2- 172.21.15.175:0/1395492504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9980104210 0x7f998019ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:34.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.471+0000 7f9985585700 1 -- 172.21.15.175:0/1395492504 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99801a2290 con 0x7f9980104bb0 2024-04-25T13:39:34.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.471+0000 7f9984d84700 1 --2- 172.21.15.175:0/1395492504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99801030e0 0x7f998019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:39:34.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.471+0000 7f9985585700 1 --2- 172.21.15.175:0/1395492504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9980104bb0 0x7f99801a1c10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f997800ef30 tx=0x7f997800c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:39:34.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.471+0000 7f997dffb700 1 -- 172.21.15.175:0/1395492504 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99780092e0 con 0x7f9980104bb0 2024-04-25T13:39:34.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.471+0000 7f997dffb700 1 -- 172.21.15.175:0/1395492504 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9978004bb0 con 0x7f9980104bb0 2024-04-25T13:39:34.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.471+0000 7f9986fe8700 1 -- 172.21.15.175:0/1395492504 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99801a2520 con 0x7f9980104bb0 2024-04-25T13:39:34.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.471+0000 7f997dffb700 1 -- 172.21.15.175:0/1395492504 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978004080 con 0x7f9980104bb0 2024-04-25T13:39:34.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.472+0000 7f9986fe8700 1 -- 172.21.15.175:0/1395492504 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99801a2a10 con 0x7f9980104bb0 2024-04-25T13:39:34.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.472+0000 7f9986fe8700 1 -- 172.21.15.175:0/1395492504 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9980051190 con 0x7f9980104bb0 2024-04-25T13:39:34.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.474+0000 7f997dffb700 1 -- 172.21.15.175:0/1395492504 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f997801b030 con 0x7f9980104bb0 2024-04-25T13:39:34.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.474+0000 7f997dffb700 1 --2- 172.21.15.175:0/1395492504 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f99700afb80 0x7f99700b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:39:34.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.474+0000 7f997dffb700 1 -- 172.21.15.175:0/1395492504 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5397+0+0 (secure 0 0 0) 0x7f99780ddc30 con 0x7f9980104bb0 2024-04-25T13:39:34.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.474+0000 7f9984d84700 1 --2- 172.21.15.175:0/1395492504 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f99700afb80 0x7f99700b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:39:34.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.475+0000 7f9984d84700 1 --2- 172.21.15.175:0/1395492504 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f99700afb80 0x7f99700b2090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f997400b650 tx=0x7f997401a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:39:34.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.479+0000 7f997dffb700 1 -- 172.21.15.175:0/1395492504 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9978022020 con 0x7f9980104bb0 2024-04-25T13:39:34.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:34.687+0000 7f9986fe8700 1 -- 172.21.15.175:0/1395492504 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9980063ad0 con 0x7f99700afb80 2024-04-25T13:39:34.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:34 smithi043 ceph-mon[29195]: Detected new or changed devices on smithi161 2024-04-25T13:39:34.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:34 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi161 to 5696M 2024-04-25T13:39:34.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:34 smithi043 ceph-mon[29195]: osdmap e50: 8 total, 8 up, 8 in 2024-04-25T13:39:35.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:34 smithi161 ceph-mon[32696]: Detected new or changed devices on smithi161 2024-04-25T13:39:35.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:34 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi161 to 5696M 2024-04-25T13:39:35.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:34 smithi161 ceph-mon[32696]: osdmap e50: 8 total, 8 up, 8 in 2024-04-25T13:39:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:34 smithi175 ceph-mon[32649]: Detected new or changed devices on smithi161 2024-04-25T13:39:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:34 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi161 to 5696M 2024-04-25T13:39:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:34 smithi175 ceph-mon[32649]: osdmap e50: 8 total, 8 up, 8 in 2024-04-25T13:39:35.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:35 smithi175 ceph-mon[32649]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:35.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:35 smithi175 ceph-mon[32649]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:39:35.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:35 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:39:35.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:35 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:39:35.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:35 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:35.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:35 smithi043 ceph-mon[29195]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:35.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:35 smithi043 ceph-mon[29195]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:39:35.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:35 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:39:35.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:35 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:39:35.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:35 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:36.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:35 smithi161 ceph-mon[32696]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:36.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:35 smithi161 ceph-mon[32696]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:39:36.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:35 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:39:36.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:35 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:39:36.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:35 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:36.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:36 smithi175 ceph-mon[32649]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:36.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:36 smithi043 ceph-mon[29195]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:37.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:36 smithi161 ceph-mon[32696]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:37.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:37 smithi043 ceph-mon[29195]: from='client.? 172.21.15.175:0/214410119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edadbbdb-521a-4daf-ac1b-8dbed78b06fd"}]: dispatch 2024-04-25T13:39:37.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:37 smithi043 ceph-mon[29195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edadbbdb-521a-4daf-ac1b-8dbed78b06fd"}]: dispatch 2024-04-25T13:39:37.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:37 smithi043 ceph-mon[29195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edadbbdb-521a-4daf-ac1b-8dbed78b06fd"}]': finished 2024-04-25T13:39:37.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:37 smithi043 ceph-mon[29195]: osdmap e51: 9 total, 8 up, 9 in 2024-04-25T13:39:37.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:37 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:39:38.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:37 smithi161 ceph-mon[32696]: from='client.? 172.21.15.175:0/214410119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edadbbdb-521a-4daf-ac1b-8dbed78b06fd"}]: dispatch 2024-04-25T13:39:38.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:37 smithi161 ceph-mon[32696]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edadbbdb-521a-4daf-ac1b-8dbed78b06fd"}]: dispatch 2024-04-25T13:39:38.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:37 smithi161 ceph-mon[32696]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edadbbdb-521a-4daf-ac1b-8dbed78b06fd"}]': finished 2024-04-25T13:39:38.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:37 smithi161 ceph-mon[32696]: osdmap e51: 9 total, 8 up, 9 in 2024-04-25T13:39:38.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:37 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:39:38.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:37 smithi175 ceph-mon[32649]: from='client.? 172.21.15.175:0/214410119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edadbbdb-521a-4daf-ac1b-8dbed78b06fd"}]: dispatch 2024-04-25T13:39:38.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:37 smithi175 ceph-mon[32649]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edadbbdb-521a-4daf-ac1b-8dbed78b06fd"}]: dispatch 2024-04-25T13:39:38.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:37 smithi175 ceph-mon[32649]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edadbbdb-521a-4daf-ac1b-8dbed78b06fd"}]': finished 2024-04-25T13:39:38.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:37 smithi175 ceph-mon[32649]: osdmap e51: 9 total, 8 up, 9 in 2024-04-25T13:39:38.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:37 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:39:38.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:38 smithi043 ceph-mon[29195]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T13:39:38.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:38 smithi043 ceph-mon[29195]: from='client.? 172.21.15.175:0/2735133041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:39:39.004 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:38 smithi161 ceph-mon[32696]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T13:39:39.004 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:38 smithi161 ceph-mon[32696]: from='client.? 172.21.15.175:0/2735133041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:39:39.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:38 smithi175 ceph-mon[32649]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T13:39:39.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:38 smithi175 ceph-mon[32649]: from='client.? 172.21.15.175:0/2735133041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:39:41.211 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:40 smithi175 ceph-mon[32649]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-25T13:39:41.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:40 smithi043 ceph-mon[29195]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-25T13:39:41.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:40 smithi161 ceph-mon[32696]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-25T13:39:43.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:42 smithi175 ceph-mon[32649]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T13:39:43.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:42 smithi043 ceph-mon[29195]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T13:39:43.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:42 smithi161 ceph-mon[32696]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T13:39:45.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:44 smithi175 ceph-mon[32649]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-25T13:39:45.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:44 smithi043 ceph-mon[29195]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-25T13:39:45.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:44 smithi161 ceph-mon[32696]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-25T13:39:46.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-25T13:39:46.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:46.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:45 smithi175 ceph-mon[32649]: Deploying daemon osd.8 on smithi175 2024-04-25T13:39:46.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-25T13:39:46.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:46.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:45 smithi043 ceph-mon[29195]: Deploying daemon osd.8 on smithi175 2024-04-25T13:39:46.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-25T13:39:46.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:46.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:45 smithi161 ceph-mon[32696]: Deploying daemon osd.8 on smithi175 2024-04-25T13:39:47.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:46 smithi175 ceph-mon[32649]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T13:39:47.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:46 smithi043 ceph-mon[29195]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T13:39:47.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:46 smithi161 ceph-mon[32696]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T13:39:49.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:48 smithi175 ceph-mon[32649]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:49.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:48 smithi161 ceph-mon[32696]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:49.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:48 smithi043 ceph-mon[29195]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:51.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:50 smithi175 ceph-mon[32649]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:51.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:50 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:51.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:50 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:51.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:50 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:50 smithi161 ceph-mon[32696]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:50 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:50 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:50 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:51.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:50 smithi043 ceph-mon[29195]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:51.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:50 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:51.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:50 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:51.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:50 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:53.204 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:52 smithi175 ceph-mon[32649]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:53.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:52 smithi161 ceph-mon[32696]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:53.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:52 smithi043 ceph-mon[29195]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:54.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:54.359+0000 7f997dffb700 1 -- 172.21.15.175:0/1395492504 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9980063ad0 con 0x7f99700afb80 2024-04-25T13:39:54.360 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 8 on host 'smithi175' 2024-04-25T13:39:54.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:54.362+0000 7f9986fe8700 1 -- 172.21.15.175:0/1395492504 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f99700afb80 msgr2=0x7f99700b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:39:54.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:54.362+0000 7f9986fe8700 1 --2- 172.21.15.175:0/1395492504 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f99700afb80 0x7f99700b2090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f997400b650 tx=0x7f997401a040 comp rx=0 tx=0).stop 2024-04-25T13:39:54.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:54.362+0000 7f9986fe8700 1 -- 172.21.15.175:0/1395492504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9980104bb0 msgr2=0x7f99801a1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:39:54.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:54.362+0000 7f9986fe8700 1 --2- 172.21.15.175:0/1395492504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9980104bb0 0x7f99801a1c10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f997800ef30 tx=0x7f997800c450 comp rx=0 tx=0).stop 2024-04-25T13:39:54.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:54.362+0000 7f9986fe8700 1 -- 172.21.15.175:0/1395492504 shutdown_connections 2024-04-25T13:39:54.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:54.362+0000 7f9986fe8700 1 --2- 172.21.15.175:0/1395492504 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f99700afb80 0x7f99700b2090 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:54.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:54.362+0000 7f9986fe8700 1 --2- 172.21.15.175:0/1395492504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9980104bb0 0x7f99801a1c10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:54.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:54.362+0000 7f9986fe8700 1 --2- 172.21.15.175:0/1395492504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99801030e0 0x7f998019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:54.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:54.362+0000 7f9986fe8700 1 --2- 172.21.15.175:0/1395492504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9980104210 0x7f998019ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:39:54.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:54.362+0000 7f9986fe8700 1 -- 172.21.15.175:0/1395492504 >> 172.21.15.175:0/1395492504 conn(0x7f99800fe740 msgr2=0x7f99801074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:39:54.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:54.362+0000 7f9986fe8700 1 -- 172.21.15.175:0/1395492504 shutdown_connections 2024-04-25T13:39:54.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:39:54.362+0000 7f9986fe8700 1 -- 172.21.15.175:0/1395492504 wait complete. 2024-04-25T13:39:55.065 DEBUG:teuthology.orchestra.run.smithi175:osd.8> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.8.service 2024-04-25T13:39:55.067 INFO:tasks.cephadm:Deploying osd.9 on smithi043 with /dev/vg_nvme/lv_1... 2024-04-25T13:39:55.067 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-25T13:39:55.324 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:39:55.446 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:55 smithi043 ceph-mon[29195]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:55.446 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:55 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:55.447 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:55 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:55.447 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:55 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:55.447 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:55 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:55.447 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:55 smithi043 ceph-mon[29195]: from='osd.8 [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T13:39:55.447 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:55 smithi043 ceph-mon[29195]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T13:39:55.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:55 smithi161 ceph-mon[32696]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:55.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:55 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:55.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:55 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:55.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:55 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:55.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:55 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:55.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:55 smithi161 ceph-mon[32696]: from='osd.8 [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T13:39:55.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:55 smithi161 ceph-mon[32696]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T13:39:55.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:55 smithi175 ceph-mon[32649]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:55.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:55 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:55.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:55 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:55.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:55 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:55.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:55 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:55.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:55 smithi175 ceph-mon[32649]: from='osd.8 [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T13:39:55.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:55 smithi175 ceph-mon[32649]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T13:39:56.576 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:56 smithi175 ceph-mon[32649]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-25T13:39:56.576 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:56 smithi175 ceph-mon[32649]: osdmap e52: 9 total, 8 up, 9 in 2024-04-25T13:39:56.576 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:56 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:39:56.576 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:56 smithi175 ceph-mon[32649]: from='osd.8 [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:39:56.576 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:56 smithi175 ceph-mon[32649]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:39:56.576 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:39:56 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:39:56.452+0000 7efdc0a4e700 -1 osd.8 0 waiting for initial osdmap 2024-04-25T13:39:56.576 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:39:56 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:39:56.462+0000 7efdbc803700 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:39:56.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:56 smithi043 ceph-mon[29195]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-25T13:39:56.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:56 smithi043 ceph-mon[29195]: osdmap e52: 9 total, 8 up, 9 in 2024-04-25T13:39:56.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:56 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:39:56.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:56 smithi043 ceph-mon[29195]: from='osd.8 [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:39:56.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:56 smithi043 ceph-mon[29195]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:39:56.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:56 smithi161 ceph-mon[32696]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-25T13:39:56.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:56 smithi161 ceph-mon[32696]: osdmap e52: 9 total, 8 up, 9 in 2024-04-25T13:39:56.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:56 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:39:56.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:56 smithi161 ceph-mon[32696]: from='osd.8 [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:39:56.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:56 smithi161 ceph-mon[32696]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:39:57.475 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-25T13:39:57.475 INFO:teuthology.orchestra.run.smithi043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-25T13:39:57.475 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10+0 records in 2024-04-25T13:39:57.475 INFO:teuthology.orchestra.run.smithi043.stderr:10+0 records out 2024-04-25T13:39:57.475 INFO:teuthology.orchestra.run.smithi043.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00868111 s, 1.2 GB/s 2024-04-25T13:39:57.475 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping successful for: 2024-04-25T13:39:57.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:57 smithi175 ceph-mon[32649]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:57.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:57 smithi175 ceph-mon[32649]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-04-25T13:39:57.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:57 smithi175 ceph-mon[32649]: osdmap e53: 9 total, 8 up, 9 in 2024-04-25T13:39:57.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:39:57.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:39:57.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:57 smithi175 ceph-mon[32649]: osd.8 [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282] boot 2024-04-25T13:39:57.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:57 smithi175 ceph-mon[32649]: osdmap e54: 9 total, 9 up, 9 in 2024-04-25T13:39:57.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:39:57.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:57 smithi043 ceph-mon[29195]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:57.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:57 smithi043 ceph-mon[29195]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-04-25T13:39:57.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:57 smithi043 ceph-mon[29195]: osdmap e53: 9 total, 8 up, 9 in 2024-04-25T13:39:57.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:39:57.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:39:57.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:57 smithi043 ceph-mon[29195]: osd.8 [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282] boot 2024-04-25T13:39:57.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:57 smithi043 ceph-mon[29195]: osdmap e54: 9 total, 9 up, 9 in 2024-04-25T13:39:57.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:39:57.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:57 smithi161 ceph-mon[32696]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-04-25T13:39:57.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:57 smithi161 ceph-mon[32696]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-04-25T13:39:57.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:57 smithi161 ceph-mon[32696]: osdmap e53: 9 total, 8 up, 9 in 2024-04-25T13:39:57.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:39:57.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:39:57.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:57 smithi161 ceph-mon[32696]: osd.8 [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282] boot 2024-04-25T13:39:57.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:57 smithi161 ceph-mon[32696]: osdmap e54: 9 total, 9 up, 9 in 2024-04-25T13:39:57.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:39:58.106 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_1 2024-04-25T13:39:58.362 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:39:58.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:58 smithi043 ceph-mon[29195]: purged_snaps scrub starts 2024-04-25T13:39:58.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:58 smithi043 ceph-mon[29195]: purged_snaps scrub ok 2024-04-25T13:39:58.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:58 smithi043 ceph-mon[29195]: osdmap e55: 9 total, 9 up, 9 in 2024-04-25T13:39:58.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:58.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:58.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:58.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:58.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:58.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:58.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:58.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:58.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:58.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:58.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:58.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:58.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:58.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:58 smithi161 ceph-mon[32696]: purged_snaps scrub starts 2024-04-25T13:39:58.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:58 smithi161 ceph-mon[32696]: purged_snaps scrub ok 2024-04-25T13:39:58.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:58 smithi161 ceph-mon[32696]: osdmap e55: 9 total, 9 up, 9 in 2024-04-25T13:39:58.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:58.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:58.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:58.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:58.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:58.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:58.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:58.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:58.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:58.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:58.854 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:58.854 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:58.854 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:58.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:58 smithi175 ceph-mon[32649]: purged_snaps scrub starts 2024-04-25T13:39:58.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:58 smithi175 ceph-mon[32649]: purged_snaps scrub ok 2024-04-25T13:39:58.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:58 smithi175 ceph-mon[32649]: osdmap e55: 9 total, 9 up, 9 in 2024-04-25T13:39:58.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:58.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:58.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:58.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:58.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:39:58.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:58.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:58.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:58.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:58.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:39:58.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:39:58.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:39:58.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:39:59.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:59 smithi043 ceph-mon[29195]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:39:59.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:59 smithi043 ceph-mon[29195]: Detected new or changed devices on smithi175 2024-04-25T13:39:59.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:59 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi175 to 5696M 2024-04-25T13:39:59.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:39:59 smithi043 ceph-mon[29195]: osdmap e56: 9 total, 9 up, 9 in 2024-04-25T13:40:00.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:59 smithi161 ceph-mon[32696]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:00.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:59 smithi161 ceph-mon[32696]: Detected new or changed devices on smithi175 2024-04-25T13:40:00.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:59 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi175 to 5696M 2024-04-25T13:40:00.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:39:59 smithi161 ceph-mon[32696]: osdmap e56: 9 total, 9 up, 9 in 2024-04-25T13:40:00.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:59 smithi175 ceph-mon[32649]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:00.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:59 smithi175 ceph-mon[32649]: Detected new or changed devices on smithi175 2024-04-25T13:40:00.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:59 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi175 to 5696M 2024-04-25T13:40:00.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:39:59 smithi175 ceph-mon[32649]: osdmap e56: 9 total, 9 up, 9 in 2024-04-25T13:40:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.192+0000 7f39b783e700 1 -- 172.21.15.43:0/1016551485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39b0104210 msgr2=0x7f39b0104620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.192+0000 7f39b783e700 1 --2- 172.21.15.43:0/1016551485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39b0104210 0x7f39b0104620 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009990 tx=0x7f39a0009ca0 comp rx=0 tx=0).stop 2024-04-25T13:40:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.192+0000 7f39b783e700 1 -- 172.21.15.43:0/1016551485 shutdown_connections 2024-04-25T13:40:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.192+0000 7f39b783e700 1 --2- 172.21.15.43:0/1016551485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39b0104bb0 0x7f39b010b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.192+0000 7f39b783e700 1 --2- 172.21.15.43:0/1016551485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b01030e0 0x7f39b01034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.192+0000 7f39b783e700 1 --2- 172.21.15.43:0/1016551485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39b0104210 0x7f39b0104620 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.192+0000 7f39b783e700 1 -- 172.21.15.43:0/1016551485 >> 172.21.15.43:0/1016551485 conn(0x7f39b00fe740 msgr2=0x7f39b0100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.192+0000 7f39b783e700 1 -- 172.21.15.43:0/1016551485 shutdown_connections 2024-04-25T13:40:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.193+0000 7f39b783e700 1 -- 172.21.15.43:0/1016551485 wait complete. 2024-04-25T13:40:00.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.193+0000 7f39b783e700 1 Processor -- start 2024-04-25T13:40:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.193+0000 7f39b783e700 1 -- start start 2024-04-25T13:40:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.193+0000 7f39b783e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39b01030e0 0x7f39b019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.193+0000 7f39b783e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b0104210 0x7f39b019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.193+0000 7f39b783e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39b0104bb0 0x7f39b01a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.193+0000 7f39b783e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f39b010ea00 con 0x7f39b0104bb0 2024-04-25T13:40:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.193+0000 7f39b783e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f39b010e880 con 0x7f39b0104210 2024-04-25T13:40:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39b783e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f39b010eb80 con 0x7f39b01030e0 2024-04-25T13:40:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39b5ddb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39b0104bb0 0x7f39b01a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39b5ddb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39b0104bb0 0x7f39b01a1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47356/0 (socket says 172.21.15.43:47356) 2024-04-25T13:40:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39b5ddb700 1 -- 172.21.15.43:0/85053120 learned_addr learned my addr 172.21.15.43:0/85053120 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:40:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39b4dd9700 1 --2- 172.21.15.43:0/85053120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b0104210 0x7f39b019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39b55da700 1 --2- 172.21.15.43:0/85053120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39b01030e0 0x7f39b019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:00.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39b5ddb700 1 -- 172.21.15.43:0/85053120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39b01030e0 msgr2=0x7f39b019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:00.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39b5ddb700 1 --2- 172.21.15.43:0/85053120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39b01030e0 0x7f39b019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:00.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39b5ddb700 1 -- 172.21.15.43:0/85053120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b0104210 msgr2=0x7f39b019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:00.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39b5ddb700 1 --2- 172.21.15.43:0/85053120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b0104210 0x7f39b019ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:00.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39b5ddb700 1 -- 172.21.15.43:0/85053120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b01a21c0 con 0x7f39b0104bb0 2024-04-25T13:40:00.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39b5ddb700 1 --2- 172.21.15.43:0/85053120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39b0104bb0 0x7f39b01a1bd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39a8007d70 tx=0x7f39a800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:00.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39a67fc700 1 -- 172.21.15.43:0/85053120 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a8016020 con 0x7f39b0104bb0 2024-04-25T13:40:00.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39b783e700 1 -- 172.21.15.43:0/85053120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b01a24b0 con 0x7f39b0104bb0 2024-04-25T13:40:00.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39a67fc700 1 -- 172.21.15.43:0/85053120 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39a800ad40 con 0x7f39b0104bb0 2024-04-25T13:40:00.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39a67fc700 1 -- 172.21.15.43:0/85053120 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a80115e0 con 0x7f39b0104bb0 2024-04-25T13:40:00.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.194+0000 7f39b783e700 1 -- 172.21.15.43:0/85053120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b0105430 con 0x7f39b0104bb0 2024-04-25T13:40:00.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.196+0000 7f39b783e700 1 -- 172.21.15.43:0/85053120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b0051190 con 0x7f39b0104bb0 2024-04-25T13:40:00.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.198+0000 7f39a67fc700 1 -- 172.21.15.43:0/85053120 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f39a8019020 con 0x7f39b0104bb0 2024-04-25T13:40:00.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.199+0000 7f39a67fc700 1 --2- 172.21.15.43:0/85053120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f399c0b3f90 0x7f399c0b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:00.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.199+0000 7f39b55da700 1 --2- 172.21.15.43:0/85053120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f399c0b3f90 0x7f399c0b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:00.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.199+0000 7f39a67fc700 1 -- 172.21.15.43:0/85053120 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5829+0+0 (secure 0 0 0) 0x7f39a80de760 con 0x7f39b0104bb0 2024-04-25T13:40:00.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.199+0000 7f39b55da700 1 --2- 172.21.15.43:0/85053120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f399c0b3f90 0x7f399c0b64a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39ac005950 tx=0x7f39ac0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:00.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.202+0000 7f39a67fc700 1 -- 172.21.15.43:0/85053120 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f39a8020020 con 0x7f39b0104bb0 2024-04-25T13:40:00.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:00.422+0000 7f39b783e700 1 -- 172.21.15.43:0/85053120 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f39b0100820 con 0x7f399c0b3f90 2024-04-25T13:40:00.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:00 smithi043 ceph-mon[29195]: overall HEALTH_OK 2024-04-25T13:40:00.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:40:00.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:40:00.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:01.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:00 smithi161 ceph-mon[32696]: overall HEALTH_OK 2024-04-25T13:40:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:40:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:40:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:01.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:00 smithi175 ceph-mon[32649]: overall HEALTH_OK 2024-04-25T13:40:01.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:40:01.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:40:01.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:01.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:01 smithi043 ceph-mon[29195]: pgmap v197: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:01.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:01 smithi043 ceph-mon[29195]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:40:02.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:01 smithi161 ceph-mon[32696]: pgmap v197: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:02.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:01 smithi161 ceph-mon[32696]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:40:02.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:01 smithi175 ceph-mon[32649]: pgmap v197: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:02.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:01 smithi175 ceph-mon[32649]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:40:02.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:02 smithi043 ceph-mon[29195]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-04-25T13:40:03.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:02 smithi161 ceph-mon[32696]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-04-25T13:40:03.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:02 smithi175 ceph-mon[32649]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-04-25T13:40:03.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:03 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/414651726' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "424f05d6-5bc6-411f-86be-25a4cfe48ae7"}]: dispatch 2024-04-25T13:40:03.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:03 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/414651726' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "424f05d6-5bc6-411f-86be-25a4cfe48ae7"}]': finished 2024-04-25T13:40:03.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:03 smithi043 ceph-mon[29195]: osdmap e57: 10 total, 9 up, 10 in 2024-04-25T13:40:03.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:03 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:04.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:03 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/414651726' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "424f05d6-5bc6-411f-86be-25a4cfe48ae7"}]: dispatch 2024-04-25T13:40:04.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:03 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/414651726' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "424f05d6-5bc6-411f-86be-25a4cfe48ae7"}]': finished 2024-04-25T13:40:04.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:03 smithi161 ceph-mon[32696]: osdmap e57: 10 total, 9 up, 10 in 2024-04-25T13:40:04.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:03 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:04.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:03 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/414651726' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "424f05d6-5bc6-411f-86be-25a4cfe48ae7"}]: dispatch 2024-04-25T13:40:04.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:03 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/414651726' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "424f05d6-5bc6-411f-86be-25a4cfe48ae7"}]': finished 2024-04-25T13:40:04.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:03 smithi175 ceph-mon[32649]: osdmap e57: 10 total, 9 up, 10 in 2024-04-25T13:40:04.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:03 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:04.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:04 smithi043 ceph-mon[29195]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-04-25T13:40:04.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:04 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2447709130' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:40:05.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:04 smithi161 ceph-mon[32696]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-04-25T13:40:05.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:04 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2447709130' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:40:05.157 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:04 smithi175 ceph-mon[32649]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-04-25T13:40:05.158 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:04 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2447709130' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:40:07.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:06 smithi043 ceph-mon[29195]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T13:40:07.233 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:06 smithi175 ceph-mon[32649]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T13:40:07.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:06 smithi161 ceph-mon[32696]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T13:40:09.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:08 smithi043 ceph-mon[29195]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-04-25T13:40:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:08 smithi161 ceph-mon[32696]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-04-25T13:40:09.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:08 smithi175 ceph-mon[32649]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-04-25T13:40:11.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:10 smithi043 ceph-mon[29195]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T13:40:11.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:10 smithi161 ceph-mon[32696]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T13:40:11.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:10 smithi175 ceph-mon[32649]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T13:40:12.211 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-25T13:40:12.211 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:11 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:12.211 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:11 smithi043 ceph-mon[29195]: Deploying daemon osd.9 on smithi043 2024-04-25T13:40:12.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:11 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-25T13:40:12.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:11 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:12.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:11 smithi161 ceph-mon[32696]: Deploying daemon osd.9 on smithi043 2024-04-25T13:40:12.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:11 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-25T13:40:12.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:11 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:12.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:11 smithi175 ceph-mon[32649]: Deploying daemon osd.9 on smithi043 2024-04-25T13:40:13.330 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:12 smithi043 ceph-mon[29195]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:13.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:12 smithi161 ceph-mon[32696]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:13.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:12 smithi175 ceph-mon[32649]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:15.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:14 smithi161 ceph-mon[32696]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:15.365 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:14 smithi043 ceph-mon[29195]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:15.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:14 smithi175 ceph-mon[32649]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:17.288 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:16 smithi043 ceph-mon[29195]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:17.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:16 smithi161 ceph-mon[32696]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:17.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:16 smithi175 ceph-mon[32649]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:18.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:18 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:18.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:18 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:18.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:18 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:40:18.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:18 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:18.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:18 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:18.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:18 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:40:18.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:18 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:18.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:18 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:18.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:18 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:40:19.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:19 smithi161 ceph-mon[32696]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:19.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:19 smithi175 ceph-mon[32649]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:19.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:19 smithi043 ceph-mon[29195]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:21.740 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 9 on host 'smithi043' 2024-04-25T13:40:21.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:21.740+0000 7f39a67fc700 1 -- 172.21.15.43:0/85053120 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f39b0100820 con 0x7f399c0b3f90 2024-04-25T13:40:21.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:21.742+0000 7f39b783e700 1 -- 172.21.15.43:0/85053120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f399c0b3f90 msgr2=0x7f399c0b64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:21.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:21.742+0000 7f39b783e700 1 --2- 172.21.15.43:0/85053120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f399c0b3f90 0x7f399c0b64a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39ac005950 tx=0x7f39ac0058e0 comp rx=0 tx=0).stop 2024-04-25T13:40:21.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:21.742+0000 7f39b783e700 1 -- 172.21.15.43:0/85053120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39b0104bb0 msgr2=0x7f39b01a1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:21.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:21.742+0000 7f39b783e700 1 --2- 172.21.15.43:0/85053120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39b0104bb0 0x7f39b01a1bd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39a8007d70 tx=0x7f39a800a340 comp rx=0 tx=0).stop 2024-04-25T13:40:21.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:21.742+0000 7f39b783e700 1 -- 172.21.15.43:0/85053120 shutdown_connections 2024-04-25T13:40:21.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:21.742+0000 7f39b783e700 1 --2- 172.21.15.43:0/85053120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f399c0b3f90 0x7f399c0b64a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:21.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:21.743+0000 7f39b783e700 1 --2- 172.21.15.43:0/85053120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39b0104bb0 0x7f39b01a1bd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:21.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:21.743+0000 7f39b783e700 1 --2- 172.21.15.43:0/85053120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39b01030e0 0x7f39b019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:21.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:21.743+0000 7f39b783e700 1 --2- 172.21.15.43:0/85053120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b0104210 0x7f39b019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:21.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:21.743+0000 7f39b783e700 1 -- 172.21.15.43:0/85053120 >> 172.21.15.43:0/85053120 conn(0x7f39b00fe740 msgr2=0x7f39b0100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:21.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:21.743+0000 7f39b783e700 1 -- 172.21.15.43:0/85053120 shutdown_connections 2024-04-25T13:40:21.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:40:21.743+0000 7f39b783e700 1 -- 172.21.15.43:0/85053120 wait complete. 2024-04-25T13:40:21.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:21 smithi175 ceph-mon[32649]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:21.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:21 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:21.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:21 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:21.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:21 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:21.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:21 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:40:21.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:21 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:21.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:21 smithi175 ceph-mon[32649]: from='osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-25T13:40:21.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:21 smithi043 ceph-mon[29195]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:21.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:21 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:21.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:21 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:21.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:21 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:21.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:21 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:40:21.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:21 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:21.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:21 smithi043 ceph-mon[29195]: from='osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-25T13:40:22.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:21 smithi161 ceph-mon[32696]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:22.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:21 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:22.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:21 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:22.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:21 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:22.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:21 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:40:22.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:21 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:22.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:21 smithi161 ceph-mon[32696]: from='osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-25T13:40:22.483 DEBUG:teuthology.orchestra.run.smithi043:osd.9> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.9.service 2024-04-25T13:40:22.485 INFO:tasks.cephadm:Deploying osd.10 on smithi161 with /dev/vg_nvme/lv_1... 2024-04-25T13:40:22.485 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-25T13:40:22.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:22 smithi043 ceph-mon[29195]: from='osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-25T13:40:22.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:22 smithi043 ceph-mon[29195]: osdmap e58: 10 total, 9 up, 10 in 2024-04-25T13:40:22.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:22 smithi043 ceph-mon[29195]: from='osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T13:40:22.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:22 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:22.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:22 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:22.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:22 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:22.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:22 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:40:22.737 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T13:40:22.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:22 smithi161 ceph-mon[32696]: from='osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-25T13:40:22.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:22 smithi161 ceph-mon[32696]: osdmap e58: 10 total, 9 up, 10 in 2024-04-25T13:40:22.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:22 smithi161 ceph-mon[32696]: from='osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T13:40:22.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:22 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:22.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:22 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:22.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:22 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:22.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:22 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:40:23.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:22 smithi175 ceph-mon[32649]: from='osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-25T13:40:23.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:22 smithi175 ceph-mon[32649]: osdmap e58: 10 total, 9 up, 10 in 2024-04-25T13:40:23.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:22 smithi175 ceph-mon[32649]: from='osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T13:40:23.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:22 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:23.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:22 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:23.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:22 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:23.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:22 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:40:23.463 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:40:23 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:40:23.254+0000 7f7eb8c4d700 -1 osd.9 0 waiting for initial osdmap 2024-04-25T13:40:23.463 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:40:23 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:40:23.266+0000 7f7eb09fa700 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:40:23.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:23 smithi043 ceph-mon[29195]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:23.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:23 smithi043 ceph-mon[29195]: from='osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T13:40:23.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:23 smithi043 ceph-mon[29195]: osdmap e59: 10 total, 9 up, 10 in 2024-04-25T13:40:23.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:23 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:23.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:23 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:23.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:23 smithi043 ceph-mon[29195]: from='osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677]' entity='osd.9' 2024-04-25T13:40:23.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:23 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:24.099 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:23 smithi161 ceph-mon[32696]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:24.099 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:23 smithi161 ceph-mon[32696]: from='osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T13:40:24.099 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:23 smithi161 ceph-mon[32696]: osdmap e59: 10 total, 9 up, 10 in 2024-04-25T13:40:24.099 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:23 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:24.099 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:23 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:24.099 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:23 smithi161 ceph-mon[32696]: from='osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677]' entity='osd.9' 2024-04-25T13:40:24.099 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:23 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:24.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:23 smithi175 ceph-mon[32649]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:24.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:23 smithi175 ceph-mon[32649]: from='osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T13:40:24.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:23 smithi175 ceph-mon[32649]: osdmap e59: 10 total, 9 up, 10 in 2024-04-25T13:40:24.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:23 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:24.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:23 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:24.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:23 smithi175 ceph-mon[32649]: from='osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677]' entity='osd.9' 2024-04-25T13:40:24.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:23 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:24.852 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-25T13:40:24.853 INFO:teuthology.orchestra.run.smithi161.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-25T13:40:24.853 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10+0 records in 2024-04-25T13:40:24.853 INFO:teuthology.orchestra.run.smithi161.stderr:10+0 records out 2024-04-25T13:40:24.853 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113956 s, 920 MB/s 2024-04-25T13:40:24.853 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping successful for: 2024-04-25T13:40:25.540 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:25 smithi043 ceph-mon[29195]: purged_snaps scrub starts 2024-04-25T13:40:25.540 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:25 smithi043 ceph-mon[29195]: purged_snaps scrub ok 2024-04-25T13:40:25.540 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:25 smithi043 ceph-mon[29195]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:25.540 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:25 smithi043 ceph-mon[29195]: osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677] boot 2024-04-25T13:40:25.540 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:25 smithi043 ceph-mon[29195]: osdmap e60: 10 total, 10 up, 10 in 2024-04-25T13:40:25.540 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:25 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:25.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:25 smithi161 ceph-mon[32696]: purged_snaps scrub starts 2024-04-25T13:40:25.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:25 smithi161 ceph-mon[32696]: purged_snaps scrub ok 2024-04-25T13:40:25.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:25 smithi161 ceph-mon[32696]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:25.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:25 smithi161 ceph-mon[32696]: osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677] boot 2024-04-25T13:40:25.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:25 smithi161 ceph-mon[32696]: osdmap e60: 10 total, 10 up, 10 in 2024-04-25T13:40:25.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:25 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:25.672 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi161:vg_nvme/lv_1 2024-04-25T13:40:25.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:25 smithi175 ceph-mon[32649]: purged_snaps scrub starts 2024-04-25T13:40:25.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:25 smithi175 ceph-mon[32649]: purged_snaps scrub ok 2024-04-25T13:40:25.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:25 smithi175 ceph-mon[32649]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-25T13:40:25.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:25 smithi175 ceph-mon[32649]: osd.9 [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677] boot 2024-04-25T13:40:25.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:25 smithi175 ceph-mon[32649]: osdmap e60: 10 total, 10 up, 10 in 2024-04-25T13:40:25.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:25 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:40:25.922 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T13:40:26.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:26 smithi161 ceph-mon[32696]: osdmap e61: 10 total, 10 up, 10 in 2024-04-25T13:40:26.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:26 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:26.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:26 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:26.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:26 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:26.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:26 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:26.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:26 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:26.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:26 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:26.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:26 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:26.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:26 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:26.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:26 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:40:26.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:26 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:26.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:26 smithi175 ceph-mon[32649]: osdmap e61: 10 total, 10 up, 10 in 2024-04-25T13:40:26.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:26 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:26.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:26 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:26.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:26 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:26.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:26 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:26.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:26 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:26.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:26 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:26.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:26 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:26.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:26 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:26.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:26 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:40:26.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:26 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:26.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:26 smithi043 ceph-mon[29195]: osdmap e61: 10 total, 10 up, 10 in 2024-04-25T13:40:26.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:26 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:26.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:26 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:26.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:26 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:26.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:26 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:26.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:26 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:26.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:26 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:26.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:26 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:26.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:26 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:26.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:26 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:40:26.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:26 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:27.490 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:27 smithi161 ceph-mon[32696]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:27.490 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:27 smithi161 ceph-mon[32696]: Detected new or changed devices on smithi043 2024-04-25T13:40:27.490 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:27 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi043 to 4273M 2024-04-25T13:40:27.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.604+0000 7f0ab7a5a700 1 -- 172.21.15.161:0/1345648661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab0103e10 msgr2=0x7f0ab0104220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:27.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.604+0000 7f0ab7a5a700 1 --2- 172.21.15.161:0/1345648661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab0103e10 0x7f0ab0104220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009990 tx=0x7f0aa0009ca0 comp rx=0 tx=0).stop 2024-04-25T13:40:27.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.604+0000 7f0ab7a5a700 1 -- 172.21.15.161:0/1345648661 shutdown_connections 2024-04-25T13:40:27.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.604+0000 7f0ab7a5a700 1 --2- 172.21.15.161:0/1345648661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab0104890 0x7f0ab010c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:27.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.604+0000 7f0ab7a5a700 1 --2- 172.21.15.161:0/1345648661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ab0105860 0x7f0ab0105c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:27.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.604+0000 7f0ab7a5a700 1 --2- 172.21.15.161:0/1345648661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab0103e10 0x7f0ab0104220 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:27.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.604+0000 7f0ab7a5a700 1 -- 172.21.15.161:0/1345648661 >> 172.21.15.161:0/1345648661 conn(0x7f0ab00ff8a0 msgr2=0x7f0ab0101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:27.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.604+0000 7f0ab7a5a700 1 -- 172.21.15.161:0/1345648661 shutdown_connections 2024-04-25T13:40:27.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.604+0000 7f0ab7a5a700 1 -- 172.21.15.161:0/1345648661 wait complete. 2024-04-25T13:40:27.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab7a5a700 1 Processor -- start 2024-04-25T13:40:27.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab7a5a700 1 -- start start 2024-04-25T13:40:27.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab7a5a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ab0103e10 0x7f0ab019a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:27.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab7a5a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab0104890 0x7f0ab019adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:27.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab7a5a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab0105860 0x7f0ab01a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:27.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab7a5a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab010fc50 con 0x7f0ab0103e10 2024-04-25T13:40:27.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab7a5a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab010fad0 con 0x7f0ab0105860 2024-04-25T13:40:27.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab7a5a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab010fdd0 con 0x7f0ab0104890 2024-04-25T13:40:27.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab5ff7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab0105860 0x7f0ab01a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:27.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab5ff7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab0105860 0x7f0ab01a1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49712/0 (socket says 172.21.15.161:49712) 2024-04-25T13:40:27.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab5ff7700 1 -- 172.21.15.161:0/3794566653 learned_addr learned my addr 172.21.15.161:0/3794566653 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-04-25T13:40:27.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab4ff5700 1 --2- 172.21.15.161:0/3794566653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab0104890 0x7f0ab019adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:27.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab57f6700 1 --2- 172.21.15.161:0/3794566653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ab0103e10 0x7f0ab019a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:27.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab5ff7700 1 -- 172.21.15.161:0/3794566653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab0104890 msgr2=0x7f0ab019adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:27.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab5ff7700 1 --2- 172.21.15.161:0/3794566653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab0104890 0x7f0ab019adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:27.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab5ff7700 1 -- 172.21.15.161:0/3794566653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ab0103e10 msgr2=0x7f0ab019a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:27.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab5ff7700 1 --2- 172.21.15.161:0/3794566653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ab0103e10 0x7f0ab019a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:27.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.605+0000 7f0ab5ff7700 1 -- 172.21.15.161:0/3794566653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab01a2350 con 0x7f0ab0105860 2024-04-25T13:40:27.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.606+0000 7f0ab5ff7700 1 --2- 172.21.15.161:0/3794566653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab0105860 0x7f0ab01a1d60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8007d70 tx=0x7f0aa800a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:27.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.606+0000 7f0aa67fc700 1 -- 172.21.15.161:0/3794566653 <== mon.2 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8016020 con 0x7f0ab0105860 2024-04-25T13:40:27.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.606+0000 7f0aa67fc700 1 -- 172.21.15.161:0/3794566653 <== mon.2 v2:172.21.15.161:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0aa800ac90 con 0x7f0ab0105860 2024-04-25T13:40:27.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.606+0000 7f0ab7a5a700 1 -- 172.21.15.161:0/3794566653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab01a2640 con 0x7f0ab0105860 2024-04-25T13:40:27.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.606+0000 7f0aa67fc700 1 -- 172.21.15.161:0/3794566653 <== mon.2 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa80115e0 con 0x7f0ab0105860 2024-04-25T13:40:27.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.606+0000 7f0ab7a5a700 1 -- 172.21.15.161:0/3794566653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab01a2b30 con 0x7f0ab0105860 2024-04-25T13:40:27.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.607+0000 7f0ab7a5a700 1 -- 172.21.15.161:0/3794566653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ab0051190 con 0x7f0ab0105860 2024-04-25T13:40:27.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.608+0000 7f0aa67fc700 1 -- 172.21.15.161:0/3794566653 <== mon.2 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f0aa8019020 con 0x7f0ab0105860 2024-04-25T13:40:27.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.609+0000 7f0aa67fc700 1 --2- 172.21.15.161:0/3794566653 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0a9c0afb80 0x7f0a9c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:27.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.609+0000 7f0aa67fc700 1 -- 172.21.15.161:0/3794566653 <== mon.2 v2:172.21.15.161:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6261+0+0 (secure 0 0 0) 0x7f0aa80de8f0 con 0x7f0ab0105860 2024-04-25T13:40:27.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.609+0000 7f0ab57f6700 1 --2- 172.21.15.161:0/3794566653 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0a9c0afb80 0x7f0a9c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:27.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.610+0000 7f0ab57f6700 1 --2- 172.21.15.161:0/3794566653 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0a9c0afb80 0x7f0a9c0b2090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0105250 tx=0x7f0aac00a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:27.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.613+0000 7f0aa67fc700 1 -- 172.21.15.161:0/3794566653 <== mon.2 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0aa8020020 con 0x7f0ab0105860 2024-04-25T13:40:27.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:27 smithi175 ceph-mon[32649]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:27.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:27 smithi175 ceph-mon[32649]: Detected new or changed devices on smithi043 2024-04-25T13:40:27.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:27 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi043 to 4273M 2024-04-25T13:40:27.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:27 smithi043 ceph-mon[29195]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:27.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:27 smithi043 ceph-mon[29195]: Detected new or changed devices on smithi043 2024-04-25T13:40:27.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:27 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi043 to 4273M 2024-04-25T13:40:27.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:27.817+0000 7f0ab7a5a700 1 -- 172.21.15.161:0/3794566653 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f0ab002e8e0 con 0x7f0a9c0afb80 2024-04-25T13:40:28.575 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:40:28.575 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:40:28.575 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:28.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:40:28.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:40:28.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:28.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:40:28.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:40:28.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:29.455 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:29 smithi161 ceph-mon[32696]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:40:29.455 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:29 smithi161 ceph-mon[32696]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:29.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:29 smithi175 ceph-mon[32649]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:40:29.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:29 smithi175 ceph-mon[32649]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:29.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:29 smithi043 ceph-mon[29195]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:40:29.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:29 smithi043 ceph-mon[29195]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:31.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:31 smithi161 ceph-mon[32696]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:31.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:31 smithi161 ceph-mon[32696]: from='client.? 172.21.15.161:0/2065620821' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e36b0893-8620-4ece-a175-b86a0f944f79"}]: dispatch 2024-04-25T13:40:31.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:31 smithi161 ceph-mon[32696]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e36b0893-8620-4ece-a175-b86a0f944f79"}]: dispatch 2024-04-25T13:40:31.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:31 smithi161 ceph-mon[32696]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e36b0893-8620-4ece-a175-b86a0f944f79"}]': finished 2024-04-25T13:40:31.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:31 smithi161 ceph-mon[32696]: osdmap e62: 11 total, 10 up, 11 in 2024-04-25T13:40:31.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:31 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:40:31.586 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:31 smithi043 ceph-mon[29195]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:31.586 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:31 smithi043 ceph-mon[29195]: from='client.? 172.21.15.161:0/2065620821' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e36b0893-8620-4ece-a175-b86a0f944f79"}]: dispatch 2024-04-25T13:40:31.586 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:31 smithi043 ceph-mon[29195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e36b0893-8620-4ece-a175-b86a0f944f79"}]: dispatch 2024-04-25T13:40:31.586 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:31 smithi043 ceph-mon[29195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e36b0893-8620-4ece-a175-b86a0f944f79"}]': finished 2024-04-25T13:40:31.586 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:31 smithi043 ceph-mon[29195]: osdmap e62: 11 total, 10 up, 11 in 2024-04-25T13:40:31.586 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:31 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:40:31.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:31 smithi175 ceph-mon[32649]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:31.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:31 smithi175 ceph-mon[32649]: from='client.? 172.21.15.161:0/2065620821' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e36b0893-8620-4ece-a175-b86a0f944f79"}]: dispatch 2024-04-25T13:40:31.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:31 smithi175 ceph-mon[32649]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e36b0893-8620-4ece-a175-b86a0f944f79"}]: dispatch 2024-04-25T13:40:31.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:31 smithi175 ceph-mon[32649]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e36b0893-8620-4ece-a175-b86a0f944f79"}]': finished 2024-04-25T13:40:31.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:31 smithi175 ceph-mon[32649]: osdmap e62: 11 total, 10 up, 11 in 2024-04-25T13:40:31.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:31 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:40:32.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:32 smithi161 ceph-mon[32696]: from='client.? 172.21.15.161:0/3814042203' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:40:32.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:32 smithi175 ceph-mon[32649]: from='client.? 172.21.15.161:0/3814042203' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:40:32.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:32 smithi043 ceph-mon[29195]: from='client.? 172.21.15.161:0/3814042203' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:40:33.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:33 smithi161 ceph-mon[32696]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:33.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:33 smithi175 ceph-mon[32649]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:33.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:33 smithi043 ceph-mon[29195]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:35.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:35 smithi161 ceph-mon[32696]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:35.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:35 smithi175 ceph-mon[32649]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:35.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:35 smithi043 ceph-mon[29195]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:37.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:37 smithi161 ceph-mon[32696]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:37.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:37 smithi175 ceph-mon[32649]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:37.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:37 smithi043 ceph-mon[29195]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:38.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:38 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-25T13:40:38.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:38 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:38.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:38 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-25T13:40:38.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:38 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:38.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:38 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-25T13:40:38.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:38 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:39.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:39 smithi161 ceph-mon[32696]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:39.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:39 smithi161 ceph-mon[32696]: Deploying daemon osd.10 on smithi161 2024-04-25T13:40:39.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:39 smithi175 ceph-mon[32649]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:39.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:39 smithi175 ceph-mon[32649]: Deploying daemon osd.10 on smithi161 2024-04-25T13:40:39.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:39 smithi043 ceph-mon[29195]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:39.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:39 smithi043 ceph-mon[29195]: Deploying daemon osd.10 on smithi161 2024-04-25T13:40:41.575 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:41 smithi161 ceph-mon[32696]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:41.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:41 smithi175 ceph-mon[32649]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:41.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:41 smithi043 ceph-mon[29195]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:43.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:43 smithi161 ceph-mon[32696]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:43.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:43 smithi175 ceph-mon[32649]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:43.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:43 smithi043 ceph-mon[29195]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:45.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:45 smithi161 ceph-mon[32696]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:45.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:45.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:45.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:40:45.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:45 smithi175 ceph-mon[32649]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:45.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:45.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:45.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:40:45.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:45 smithi043 ceph-mon[29195]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:45.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:45.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:45.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:40:47.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:47 smithi175 ceph-mon[32649]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:47.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:47 smithi043 ceph-mon[29195]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:47.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:47 smithi161 ceph-mon[32696]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:47.989 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 10 on host 'smithi161' 2024-04-25T13:40:47.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:47.988+0000 7f0aa67fc700 1 -- 172.21.15.161:0/3794566653 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f0ab002e8e0 con 0x7f0a9c0afb80 2024-04-25T13:40:47.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:47.991+0000 7f0ab7a5a700 1 -- 172.21.15.161:0/3794566653 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0a9c0afb80 msgr2=0x7f0a9c0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:47.991+0000 7f0ab7a5a700 1 --2- 172.21.15.161:0/3794566653 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0a9c0afb80 0x7f0a9c0b2090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0105250 tx=0x7f0aac00a380 comp rx=0 tx=0).stop 2024-04-25T13:40:47.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:47.991+0000 7f0ab7a5a700 1 -- 172.21.15.161:0/3794566653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab0105860 msgr2=0x7f0ab01a1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:47.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:47.991+0000 7f0ab7a5a700 1 --2- 172.21.15.161:0/3794566653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab0105860 0x7f0ab01a1d60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8007d70 tx=0x7f0aa800a340 comp rx=0 tx=0).stop 2024-04-25T13:40:47.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:47.991+0000 7f0ab7a5a700 1 -- 172.21.15.161:0/3794566653 shutdown_connections 2024-04-25T13:40:47.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:47.991+0000 7f0ab7a5a700 1 --2- 172.21.15.161:0/3794566653 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0a9c0afb80 0x7f0a9c0b2090 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:47.991+0000 7f0ab7a5a700 1 --2- 172.21.15.161:0/3794566653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ab0105860 0x7f0ab01a1d60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:47.991+0000 7f0ab7a5a700 1 --2- 172.21.15.161:0/3794566653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ab0103e10 0x7f0ab019a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:47.991+0000 7f0ab7a5a700 1 --2- 172.21.15.161:0/3794566653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab0104890 0x7f0ab019adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:47.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:47.991+0000 7f0ab7a5a700 1 -- 172.21.15.161:0/3794566653 >> 172.21.15.161:0/3794566653 conn(0x7f0ab00ff8a0 msgr2=0x7f0ab0108580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:47.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:47.991+0000 7f0ab7a5a700 1 -- 172.21.15.161:0/3794566653 shutdown_connections 2024-04-25T13:40:47.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-04-25T13:40:47.991+0000 7f0ab7a5a700 1 -- 172.21.15.161:0/3794566653 wait complete. 2024-04-25T13:40:48.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:48.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:48.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:48.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:40:48.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:48.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:48.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:48.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:40:48.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:48 smithi043 ceph-mon[29195]: from='osd.10 [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T13:40:48.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:48 smithi043 ceph-mon[29195]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T13:40:48.554 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:48.554 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:48.554 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:48.554 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:40:48.555 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:48.555 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:48.555 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:48.555 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:40:48.555 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:48 smithi161 ceph-mon[32696]: from='osd.10 [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T13:40:48.555 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:48 smithi161 ceph-mon[32696]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T13:40:48.580 DEBUG:teuthology.orchestra.run.smithi161:osd.10> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.10.service 2024-04-25T13:40:48.582 INFO:tasks.cephadm:Deploying osd.11 on smithi175 with /dev/vg_nvme/lv_1... 2024-04-25T13:40:48.582 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-25T13:40:48.609 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:48.609 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:48.609 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:48.609 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:40:48.609 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:48.610 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:48.610 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:48.610 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:40:48.610 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:48 smithi175 ceph-mon[32649]: from='osd.10 [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T13:40:48.610 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:48 smithi175 ceph-mon[32649]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T13:40:48.829 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T13:40:49.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:49 smithi161 ceph-mon[32696]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:49.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:49 smithi161 ceph-mon[32696]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-25T13:40:49.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:49 smithi161 ceph-mon[32696]: osdmap e63: 11 total, 10 up, 11 in 2024-04-25T13:40:49.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:49 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:40:49.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:49 smithi161 ceph-mon[32696]: from='osd.10 [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:40:49.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:49 smithi161 ceph-mon[32696]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:40:49.609 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:49 smithi175 ceph-mon[32649]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:49.609 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:49 smithi175 ceph-mon[32649]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-25T13:40:49.609 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:49 smithi175 ceph-mon[32649]: osdmap e63: 11 total, 10 up, 11 in 2024-04-25T13:40:49.609 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:49 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:40:49.609 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:49 smithi175 ceph-mon[32649]: from='osd.10 [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:40:49.609 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:49 smithi175 ceph-mon[32649]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:40:49.652 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:49 smithi043 ceph-mon[29195]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:49.653 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:49 smithi043 ceph-mon[29195]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-25T13:40:49.653 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:49 smithi043 ceph-mon[29195]: osdmap e63: 11 total, 10 up, 11 in 2024-04-25T13:40:49.653 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:49 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:40:49.653 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:49 smithi043 ceph-mon[29195]: from='osd.10 [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:40:49.653 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:49 smithi043 ceph-mon[29195]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-04-25T13:40:50.917 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-25T13:40:50.917 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-25T13:40:50.917 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2024-04-25T13:40:50.917 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2024-04-25T13:40:50.917 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113376 s, 925 MB/s 2024-04-25T13:40:50.917 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2024-04-25T13:40:50.989 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:40:50 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:40:50.708+0000 7ff5d253a700 -1 osd.10 0 waiting for initial osdmap 2024-04-25T13:40:50.990 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:40:50 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:40:50.719+0000 7ff5ca2e7700 -1 osd.10 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:40:51.310 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:50 smithi175 ceph-mon[32649]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:51.310 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:50 smithi175 ceph-mon[32649]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-04-25T13:40:51.310 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:50 smithi175 ceph-mon[32649]: osdmap e64: 11 total, 10 up, 11 in 2024-04-25T13:40:51.310 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:50 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:40:51.310 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:50 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:40:51.310 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:50 smithi175 ceph-mon[32649]: from='osd.10 ' entity='osd.10' 2024-04-25T13:40:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:50 smithi161 ceph-mon[32696]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:50 smithi161 ceph-mon[32696]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-04-25T13:40:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:50 smithi161 ceph-mon[32696]: osdmap e64: 11 total, 10 up, 11 in 2024-04-25T13:40:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:50 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:40:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:50 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:40:51.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:50 smithi161 ceph-mon[32696]: from='osd.10 ' entity='osd.10' 2024-04-25T13:40:51.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:50 smithi043 ceph-mon[29195]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-04-25T13:40:51.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:50 smithi043 ceph-mon[29195]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-04-25T13:40:51.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:50 smithi043 ceph-mon[29195]: osdmap e64: 11 total, 10 up, 11 in 2024-04-25T13:40:51.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:50 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:40:51.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:50 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:40:51.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:50 smithi043 ceph-mon[29195]: from='osd.10 ' entity='osd.10' 2024-04-25T13:40:51.656 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_1 2024-04-25T13:40:51.944 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T13:40:52.251 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:51 smithi175 ceph-mon[32649]: purged_snaps scrub starts 2024-04-25T13:40:52.251 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:51 smithi175 ceph-mon[32649]: purged_snaps scrub ok 2024-04-25T13:40:52.251 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:51 smithi175 ceph-mon[32649]: osd.10 [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800] boot 2024-04-25T13:40:52.251 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:51 smithi175 ceph-mon[32649]: osdmap e65: 11 total, 11 up, 11 in 2024-04-25T13:40:52.251 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:40:52.251 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:51 smithi175 ceph-mon[32649]: osdmap e66: 11 total, 11 up, 11 in 2024-04-25T13:40:52.251 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:52.251 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:52.251 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:52.252 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:52.252 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:52.252 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:52.252 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:52.252 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:52.252 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:40:52.252 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:52.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:51 smithi161 ceph-mon[32696]: purged_snaps scrub starts 2024-04-25T13:40:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:51 smithi161 ceph-mon[32696]: purged_snaps scrub ok 2024-04-25T13:40:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:51 smithi161 ceph-mon[32696]: osd.10 [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800] boot 2024-04-25T13:40:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:51 smithi161 ceph-mon[32696]: osdmap e65: 11 total, 11 up, 11 in 2024-04-25T13:40:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:40:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:51 smithi161 ceph-mon[32696]: osdmap e66: 11 total, 11 up, 11 in 2024-04-25T13:40:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:52.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:52.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:40:52.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:52.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:51 smithi043 ceph-mon[29195]: purged_snaps scrub starts 2024-04-25T13:40:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:51 smithi043 ceph-mon[29195]: purged_snaps scrub ok 2024-04-25T13:40:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:51 smithi043 ceph-mon[29195]: osd.10 [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800] boot 2024-04-25T13:40:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:51 smithi043 ceph-mon[29195]: osdmap e65: 11 total, 11 up, 11 in 2024-04-25T13:40:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:40:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:51 smithi043 ceph-mon[29195]: osdmap e66: 11 total, 11 up, 11 in 2024-04-25T13:40:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:40:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:52.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:40:52.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:40:53.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.781+0000 7f849aec6700 1 -- 172.21.15.175:0/1951028376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84941028b0 msgr2=0x7f8494102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:53.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.781+0000 7f849aec6700 1 --2- 172.21.15.175:0/1951028376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84941028b0 0x7f8494102cc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8490009990 tx=0x7f8490009ca0 comp rx=0 tx=0).stop 2024-04-25T13:40:53.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.781+0000 7f849aec6700 1 -- 172.21.15.175:0/1951028376 shutdown_connections 2024-04-25T13:40:53.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.781+0000 7f849aec6700 1 --2- 172.21.15.175:0/1951028376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8494104380 0x7f849410ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:53.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.781+0000 7f849aec6700 1 --2- 172.21.15.175:0/1951028376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84941028b0 0x7f8494102cc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:53.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.781+0000 7f849aec6700 1 --2- 172.21.15.175:0/1951028376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84941039e0 0x7f8494103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:53.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.781+0000 7f849aec6700 1 -- 172.21.15.175:0/1951028376 >> 172.21.15.175:0/1951028376 conn(0x7f84940fdef0 msgr2=0x7f84941003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:40:53.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.781+0000 7f849aec6700 1 -- 172.21.15.175:0/1951028376 shutdown_connections 2024-04-25T13:40:53.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.781+0000 7f849aec6700 1 -- 172.21.15.175:0/1951028376 wait complete. 2024-04-25T13:40:53.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.782+0000 7f849aec6700 1 Processor -- start 2024-04-25T13:40:53.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.782+0000 7f849aec6700 1 -- start start 2024-04-25T13:40:53.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.782+0000 7f849aec6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84941028b0 0x7f8494106670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:53.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.782+0000 7f849aec6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84941039e0 0x7f8494104d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:53.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.782+0000 7f849aec6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8494104380 0x7f8494105260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:53.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.782+0000 7f849aec6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f849410e220 con 0x7f84941039e0 2024-04-25T13:40:53.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.782+0000 7f849aec6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f849410e0a0 con 0x7f84941028b0 2024-04-25T13:40:53.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.782+0000 7f849aec6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f849410e3a0 con 0x7f8494104380 2024-04-25T13:40:53.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.782+0000 7f8499463700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8494104380 0x7f8494105260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:53.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.782+0000 7f8499463700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8494104380 0x7f8494105260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50540/0 (socket says 172.21.15.175:50540) 2024-04-25T13:40:53.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.782+0000 7f8499463700 1 -- 172.21.15.175:0/269510272 learned_addr learned my addr 172.21.15.175:0/269510272 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T13:40:53.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.782+0000 7f8498c62700 1 --2- 172.21.15.175:0/269510272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84941028b0 0x7f8494106670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:53.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.782+0000 7f848bfff700 1 --2- 172.21.15.175:0/269510272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84941039e0 0x7f8494104d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:53.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.783+0000 7f8499463700 1 -- 172.21.15.175:0/269510272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84941028b0 msgr2=0x7f8494106670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:53.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.783+0000 7f8499463700 1 --2- 172.21.15.175:0/269510272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84941028b0 0x7f8494106670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:53.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.783+0000 7f8499463700 1 -- 172.21.15.175:0/269510272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84941039e0 msgr2=0x7f8494104d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:40:53.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.783+0000 7f8499463700 1 --2- 172.21.15.175:0/269510272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84941039e0 0x7f8494104d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:40:53.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.783+0000 7f8499463700 1 -- 172.21.15.175:0/269510272 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84941059c0 con 0x7f8494104380 2024-04-25T13:40:53.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.783+0000 7f8498c62700 1 --2- 172.21.15.175:0/269510272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84941028b0 0x7f8494106670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:40:53.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.783+0000 7f8499463700 1 --2- 172.21.15.175:0/269510272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8494104380 0x7f8494105260 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f848c00b970 tx=0x7f848c00bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:53.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.783+0000 7f8489ffb700 1 -- 172.21.15.175:0/269510272 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c019070 con 0x7f8494104380 2024-04-25T13:40:53.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.783+0000 7f8489ffb700 1 -- 172.21.15.175:0/269510272 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f848c00cdc0 con 0x7f8494104380 2024-04-25T13:40:53.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.783+0000 7f849aec6700 1 -- 172.21.15.175:0/269510272 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84941a4920 con 0x7f8494104380 2024-04-25T13:40:53.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.783+0000 7f8489ffb700 1 -- 172.21.15.175:0/269510272 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c014e30 con 0x7f8494104380 2024-04-25T13:40:53.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.783+0000 7f849aec6700 1 -- 172.21.15.175:0/269510272 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84941a4db0 con 0x7f8494104380 2024-04-25T13:40:53.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.784+0000 7f849aec6700 1 -- 172.21.15.175:0/269510272 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8494051190 con 0x7f8494104380 2024-04-25T13:40:53.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.785+0000 7f8489ffb700 1 -- 172.21.15.175:0/269510272 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f848c01c070 con 0x7f8494104380 2024-04-25T13:40:53.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.786+0000 7f8489ffb700 1 --2- 172.21.15.175:0/269510272 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f847c0afb80 0x7f847c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:40:53.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.786+0000 7f8489ffb700 1 -- 172.21.15.175:0/269510272 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6694+0+0 (secure 0 0 0) 0x7f848c0ddd90 con 0x7f8494104380 2024-04-25T13:40:53.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.786+0000 7f8498c62700 1 --2- 172.21.15.175:0/269510272 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f847c0afb80 0x7f847c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:40:53.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.787+0000 7f8498c62700 1 --2- 172.21.15.175:0/269510272 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f847c0afb80 0x7f847c0b2090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8490003820 tx=0x7f849001a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:40:53.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.790+0000 7f8489ffb700 1 -- 172.21.15.175:0/269510272 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f848c0a6fc0 con 0x7f8494104380 2024-04-25T13:40:53.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:53 smithi175 ceph-mon[32649]: Detected new or changed devices on smithi161 2024-04-25T13:40:53.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:53 smithi175 ceph-mon[32649]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 455 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:40:53.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:53 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi161 to 4272M 2024-04-25T13:40:53.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:53 smithi175 ceph-mon[32649]: osdmap e67: 11 total, 11 up, 11 in 2024-04-25T13:40:53.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:53 smithi043 ceph-mon[29195]: Detected new or changed devices on smithi161 2024-04-25T13:40:53.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:53 smithi043 ceph-mon[29195]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 455 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:40:53.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:53 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi161 to 4272M 2024-04-25T13:40:53.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:53 smithi043 ceph-mon[29195]: osdmap e67: 11 total, 11 up, 11 in 2024-04-25T13:40:53.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:40:53.997+0000 7f849aec6700 1 -- 172.21.15.175:0/269510272 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f84941a5010 con 0x7f847c0afb80 2024-04-25T13:40:54.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:53 smithi161 ceph-mon[32696]: Detected new or changed devices on smithi161 2024-04-25T13:40:54.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:53 smithi161 ceph-mon[32696]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 455 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:40:54.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:53 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi161 to 4272M 2024-04-25T13:40:54.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:53 smithi161 ceph-mon[32696]: osdmap e67: 11 total, 11 up, 11 in 2024-04-25T13:40:54.867 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:54 smithi175 ceph-mon[32649]: pgmap v235: 1 pgs: 1 peering; 577 KiB data, 455 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:40:54.867 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:54 smithi175 ceph-mon[32649]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:40:54.867 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:54 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:40:54.867 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:54 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:40:54.867 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:54 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:54.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:54 smithi043 ceph-mon[29195]: pgmap v235: 1 pgs: 1 peering; 577 KiB data, 455 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:40:54.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:54 smithi043 ceph-mon[29195]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:40:54.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:54 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:40:54.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:54 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:40:54.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:54 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:55.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:54 smithi161 ceph-mon[32696]: pgmap v235: 1 pgs: 1 peering; 577 KiB data, 455 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:40:55.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:54 smithi161 ceph-mon[32696]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:40:55.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:54 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T13:40:55.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:54 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T13:40:55.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:54 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:40:57.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:56 smithi161 ceph-mon[32696]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 455 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:40:57.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:56 smithi161 ceph-mon[32696]: from='client.? 172.21.15.175:0/602215658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2e5f0dd-7b17-47e1-b437-933d47a399a0"}]: dispatch 2024-04-25T13:40:57.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:56 smithi161 ceph-mon[32696]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2e5f0dd-7b17-47e1-b437-933d47a399a0"}]: dispatch 2024-04-25T13:40:57.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:56 smithi161 ceph-mon[32696]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2e5f0dd-7b17-47e1-b437-933d47a399a0"}]': finished 2024-04-25T13:40:57.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:56 smithi161 ceph-mon[32696]: osdmap e68: 12 total, 11 up, 12 in 2024-04-25T13:40:57.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:56 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:40:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:56 smithi175 ceph-mon[32649]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 455 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:40:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:56 smithi175 ceph-mon[32649]: from='client.? 172.21.15.175:0/602215658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2e5f0dd-7b17-47e1-b437-933d47a399a0"}]: dispatch 2024-04-25T13:40:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:56 smithi175 ceph-mon[32649]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2e5f0dd-7b17-47e1-b437-933d47a399a0"}]: dispatch 2024-04-25T13:40:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:56 smithi175 ceph-mon[32649]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2e5f0dd-7b17-47e1-b437-933d47a399a0"}]': finished 2024-04-25T13:40:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:56 smithi175 ceph-mon[32649]: osdmap e68: 12 total, 11 up, 12 in 2024-04-25T13:40:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:56 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:40:57.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:56 smithi043 ceph-mon[29195]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 455 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:40:57.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:56 smithi043 ceph-mon[29195]: from='client.? 172.21.15.175:0/602215658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2e5f0dd-7b17-47e1-b437-933d47a399a0"}]: dispatch 2024-04-25T13:40:57.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:56 smithi043 ceph-mon[29195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2e5f0dd-7b17-47e1-b437-933d47a399a0"}]: dispatch 2024-04-25T13:40:57.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:56 smithi043 ceph-mon[29195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2e5f0dd-7b17-47e1-b437-933d47a399a0"}]': finished 2024-04-25T13:40:57.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:56 smithi043 ceph-mon[29195]: osdmap e68: 12 total, 11 up, 12 in 2024-04-25T13:40:57.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:56 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:40:58.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:57 smithi161 ceph-mon[32696]: from='client.? 172.21.15.175:0/2908454184' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:40:58.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:57 smithi175 ceph-mon[32649]: from='client.? 172.21.15.175:0/2908454184' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:40:58.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:57 smithi043 ceph-mon[29195]: from='client.? 172.21.15.175:0/2908454184' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T13:40:59.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:40:58 smithi161 ceph-mon[32696]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-04-25T13:40:59.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:40:58 smithi175 ceph-mon[32649]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-04-25T13:40:59.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:40:58 smithi043 ceph-mon[29195]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-04-25T13:41:01.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:00 smithi161 ceph-mon[32696]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T13:41:01.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:00 smithi175 ceph-mon[32649]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T13:41:01.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:00 smithi043 ceph-mon[29195]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T13:41:03.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:02 smithi161 ceph-mon[32696]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-04-25T13:41:03.366 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:02 smithi175 ceph-mon[32649]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-04-25T13:41:03.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:02 smithi043 ceph-mon[29195]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-04-25T13:41:05.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:04 smithi161 ceph-mon[32696]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T13:41:05.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-25T13:41:05.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:05.356 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:04 smithi175 ceph-mon[32649]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T13:41:05.356 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-25T13:41:05.357 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:05.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:04 smithi043 ceph-mon[29195]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T13:41:05.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-25T13:41:05.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:06.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:05 smithi161 ceph-mon[32696]: Deploying daemon osd.11 on smithi175 2024-04-25T13:41:06.398 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:05 smithi175 ceph-mon[32649]: Deploying daemon osd.11 on smithi175 2024-04-25T13:41:06.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:05 smithi043 ceph-mon[29195]: Deploying daemon osd.11 on smithi175 2024-04-25T13:41:07.214 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:06 smithi175 ceph-mon[32649]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T13:41:07.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:06 smithi161 ceph-mon[32696]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T13:41:07.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:06 smithi043 ceph-mon[29195]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T13:41:09.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:08 smithi175 ceph-mon[32649]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:09.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:08 smithi161 ceph-mon[32696]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:09.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:08 smithi043 ceph-mon[29195]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:11.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:10 smithi175 ceph-mon[32649]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:11.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:10 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:11.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:10 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:11.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:10 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:41:11.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:10 smithi161 ceph-mon[32696]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:11.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:10 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:11.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:10 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:11.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:10 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:41:11.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:10 smithi043 ceph-mon[29195]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:11.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:10 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:11.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:10 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:11.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:10 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:41:13.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:12 smithi161 ceph-mon[32696]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:13.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:12 smithi175 ceph-mon[32649]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:13.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:12 smithi043 ceph-mon[29195]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:15.022 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 11 on host 'smithi175' 2024-04-25T13:41:15.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:15.021+0000 7f8489ffb700 1 -- 172.21.15.175:0/269510272 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f84941a5010 con 0x7f847c0afb80 2024-04-25T13:41:15.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:15.024+0000 7f849aec6700 1 -- 172.21.15.175:0/269510272 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f847c0afb80 msgr2=0x7f847c0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:15.024+0000 7f849aec6700 1 --2- 172.21.15.175:0/269510272 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f847c0afb80 0x7f847c0b2090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8490003820 tx=0x7f849001a040 comp rx=0 tx=0).stop 2024-04-25T13:41:15.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:15.024+0000 7f849aec6700 1 -- 172.21.15.175:0/269510272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8494104380 msgr2=0x7f8494105260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:15.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:15.024+0000 7f849aec6700 1 --2- 172.21.15.175:0/269510272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8494104380 0x7f8494105260 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f848c00b970 tx=0x7f848c00bc80 comp rx=0 tx=0).stop 2024-04-25T13:41:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:15.024+0000 7f849aec6700 1 -- 172.21.15.175:0/269510272 shutdown_connections 2024-04-25T13:41:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:15.024+0000 7f849aec6700 1 --2- 172.21.15.175:0/269510272 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f847c0afb80 0x7f847c0b2090 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:15.024+0000 7f849aec6700 1 --2- 172.21.15.175:0/269510272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8494104380 0x7f8494105260 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:15.024+0000 7f849aec6700 1 --2- 172.21.15.175:0/269510272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84941028b0 0x7f8494106670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:15.024+0000 7f849aec6700 1 --2- 172.21.15.175:0/269510272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84941039e0 0x7f8494104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:15.024+0000 7f849aec6700 1 -- 172.21.15.175:0/269510272 >> 172.21.15.175:0/269510272 conn(0x7f84940fdef0 msgr2=0x7f849406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:15.024+0000 7f849aec6700 1 -- 172.21.15.175:0/269510272 shutdown_connections 2024-04-25T13:41:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:15.024+0000 7f849aec6700 1 -- 172.21.15.175:0/269510272 wait complete. 2024-04-25T13:41:15.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:15 smithi161 ceph-mon[32696]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:15.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:15.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:15.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:15.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:41:15.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:15.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:15 smithi161 ceph-mon[32696]: from='osd.11 [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T13:41:15.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:15 smithi161 ceph-mon[32696]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T13:41:15.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:15.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:15.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:15 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:41:15.396 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:15 smithi175 ceph-mon[32649]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:15.396 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:15.396 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:15.396 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:15.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:41:15.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:15.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:15 smithi175 ceph-mon[32649]: from='osd.11 [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T13:41:15.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:15 smithi175 ceph-mon[32649]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T13:41:15.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:15.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:15.397 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:15 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:41:15.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:15 smithi043 ceph-mon[29195]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:15.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:15.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:15.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:15.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:41:15.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:15.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:15 smithi043 ceph-mon[29195]: from='osd.11 [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T13:41:15.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:15 smithi043 ceph-mon[29195]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T13:41:15.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:15.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:15.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:15 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:41:15.731 DEBUG:teuthology.orchestra.run.smithi175:osd.11> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.11.service 2024-04-25T13:41:15.734 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-25T13:41:15.734 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-25T13:41:15.993 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:41:16.251 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:16 smithi175 ceph-mon[32649]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-25T13:41:16.251 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:16 smithi175 ceph-mon[32649]: osdmap e69: 12 total, 11 up, 12 in 2024-04-25T13:41:16.251 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:16 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:41:16.251 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:16 smithi175 ceph-mon[32649]: from='osd.11 [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:41:16.251 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:16 smithi175 ceph-mon[32649]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:41:16.399 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:16 smithi043 ceph-mon[29195]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-25T13:41:16.400 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:16 smithi043 ceph-mon[29195]: osdmap e69: 12 total, 11 up, 12 in 2024-04-25T13:41:16.400 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:16 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:41:16.400 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:16 smithi043 ceph-mon[29195]: from='osd.11 [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:41:16.400 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:16 smithi043 ceph-mon[29195]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:41:16.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:16 smithi161 ceph-mon[32696]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-25T13:41:16.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:16 smithi161 ceph-mon[32696]: osdmap e69: 12 total, 11 up, 12 in 2024-04-25T13:41:16.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:16 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:41:16.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:16 smithi161 ceph-mon[32696]: from='osd.11 [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:41:16.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:16 smithi161 ceph-mon[32696]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-04-25T13:41:17.109 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:41:16 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:41:16.793+0000 7ff21346d700 -1 osd.11 0 waiting for initial osdmap 2024-04-25T13:41:17.109 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:41:16 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:41:16.807+0000 7ff20b21a700 -1 osd.11 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:41:17.382 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:17 smithi043 ceph-mon[29195]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:17.383 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:17 smithi043 ceph-mon[29195]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-04-25T13:41:17.383 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:17 smithi043 ceph-mon[29195]: osdmap e70: 12 total, 11 up, 12 in 2024-04-25T13:41:17.383 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:17 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:41:17.383 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:17 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:41:17.383 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:17 smithi043 ceph-mon[29195]: from='osd.11 ' entity='osd.11' 2024-04-25T13:41:17.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:17 smithi175 ceph-mon[32649]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:17.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:17 smithi175 ceph-mon[32649]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-04-25T13:41:17.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:17 smithi175 ceph-mon[32649]: osdmap e70: 12 total, 11 up, 12 in 2024-04-25T13:41:17.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:17 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:41:17.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:17 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:41:17.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:17 smithi175 ceph-mon[32649]: from='osd.11 ' entity='osd.11' 2024-04-25T13:41:17.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:17 smithi161 ceph-mon[32696]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:17.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:17 smithi161 ceph-mon[32696]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-04-25T13:41:17.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:17 smithi161 ceph-mon[32696]: osdmap e70: 12 total, 11 up, 12 in 2024-04-25T13:41:17.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:17 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:41:17.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:17 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:41:17.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:17 smithi161 ceph-mon[32696]: from='osd.11 ' entity='osd.11' 2024-04-25T13:41:17.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.922+0000 7f114ed1b700 1 -- 172.21.15.43:0/245950361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1148104bf0 msgr2=0x7f114810b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:17.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.922+0000 7f114ed1b700 1 --2- 172.21.15.43:0/245950361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1148104bf0 0x7f114810b4a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f114000b0a0 tx=0x7f114000b3b0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.922+0000 7f114ed1b700 1 -- 172.21.15.43:0/245950361 shutdown_connections 2024-04-25T13:41:17.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.922+0000 7f114ed1b700 1 --2- 172.21.15.43:0/245950361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1148104bf0 0x7f114810b4a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.922+0000 7f114ed1b700 1 --2- 172.21.15.43:0/245950361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1148103120 0x7f1148103530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.922+0000 7f114ed1b700 1 --2- 172.21.15.43:0/245950361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1148104250 0x7f1148104660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.922+0000 7f114ed1b700 1 -- 172.21.15.43:0/245950361 >> 172.21.15.43:0/245950361 conn(0x7f11480fe760 msgr2=0x7f1148100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:17.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.922+0000 7f114ed1b700 1 -- 172.21.15.43:0/245950361 shutdown_connections 2024-04-25T13:41:17.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.922+0000 7f114ed1b700 1 -- 172.21.15.43:0/245950361 wait complete. 2024-04-25T13:41:17.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.923+0000 7f114ed1b700 1 Processor -- start 2024-04-25T13:41:17.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.923+0000 7f114ed1b700 1 -- start start 2024-04-25T13:41:17.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.923+0000 7f114ed1b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1148103120 0x7f1148106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:17.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.923+0000 7f114ed1b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1148104250 0x7f1148105590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:17.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.923+0000 7f114ed1b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1148104bf0 0x7f1148105ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:17.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.923+0000 7f114ed1b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f114810eab0 con 0x7f1148104bf0 2024-04-25T13:41:17.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.923+0000 7f114ed1b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f114810e930 con 0x7f1148104250 2024-04-25T13:41:17.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.923+0000 7f114ed1b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f114810ec30 con 0x7f1148103120 2024-04-25T13:41:17.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.924+0000 7f114d2b8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1148104bf0 0x7f1148105ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:17.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.924+0000 7f114cab7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1148103120 0x7f1148106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:17.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.924+0000 7f114d2b8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1148104bf0 0x7f1148105ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41894/0 (socket says 172.21.15.43:41894) 2024-04-25T13:41:17.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.924+0000 7f114d2b8700 1 -- 172.21.15.43:0/1517539813 learned_addr learned my addr 172.21.15.43:0/1517539813 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:17.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.924+0000 7f1147fff700 1 --2- 172.21.15.43:0/1517539813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1148104250 0x7f1148105590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:17.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.924+0000 7f114d2b8700 1 -- 172.21.15.43:0/1517539813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1148103120 msgr2=0x7f1148106ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:17.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.924+0000 7f114d2b8700 1 --2- 172.21.15.43:0/1517539813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1148103120 0x7f1148106ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.924+0000 7f114d2b8700 1 -- 172.21.15.43:0/1517539813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1148104250 msgr2=0x7f1148105590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:17.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.924+0000 7f114d2b8700 1 --2- 172.21.15.43:0/1517539813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1148104250 0x7f1148105590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:17.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.924+0000 7f114d2b8700 1 -- 172.21.15.43:0/1517539813 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114819e610 con 0x7f1148104bf0 2024-04-25T13:41:17.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.924+0000 7f114cab7700 1 --2- 172.21.15.43:0/1517539813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1148103120 0x7f1148106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:41:17.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.924+0000 7f114d2b8700 1 --2- 172.21.15.43:0/1517539813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1148104bf0 0x7f1148105ad0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1140009720 tx=0x7f1140004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:17.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.924+0000 7f1145ffb700 1 -- 172.21.15.43:0/1517539813 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140021070 con 0x7f1148104bf0 2024-04-25T13:41:17.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.924+0000 7f114ed1b700 1 -- 172.21.15.43:0/1517539813 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11481060d0 con 0x7f1148104bf0 2024-04-25T13:41:17.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.924+0000 7f1145ffb700 1 -- 172.21.15.43:0/1517539813 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1140007b80 con 0x7f1148104bf0 2024-04-25T13:41:17.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.924+0000 7f1145ffb700 1 -- 172.21.15.43:0/1517539813 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140004720 con 0x7f1148104bf0 2024-04-25T13:41:17.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.925+0000 7f114ed1b700 1 -- 172.21.15.43:0/1517539813 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11481a91d0 con 0x7f1148104bf0 2024-04-25T13:41:17.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.926+0000 7f114ed1b700 1 -- 172.21.15.43:0/1517539813 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1148051190 con 0x7f1148104bf0 2024-04-25T13:41:17.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.927+0000 7f1145ffb700 1 -- 172.21.15.43:0/1517539813 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f1140003a00 con 0x7f1148104bf0 2024-04-25T13:41:17.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.928+0000 7f1145ffb700 1 --2- 172.21.15.43:0/1517539813 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f11380afb80 0x7f11380b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:17.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.928+0000 7f1145ffb700 1 -- 172.21.15.43:0/1517539813 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f114000f020 con 0x7f1148104bf0 2024-04-25T13:41:17.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.928+0000 7f114cab7700 1 --2- 172.21.15.43:0/1517539813 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f11380afb80 0x7f11380b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:17.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.929+0000 7f114cab7700 1 --2- 172.21.15.43:0/1517539813 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f11380afb80 0x7f11380b2090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1148104150 tx=0x7f113c009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:17.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:17.932+0000 7f1145ffb700 1 -- 172.21.15.43:0/1517539813 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f114002a020 con 0x7f1148104bf0 2024-04-25T13:41:18.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:18.142+0000 7f114ed1b700 1 -- 172.21.15.43:0/1517539813 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f11481a93a0 con 0x7f1148104bf0 2024-04-25T13:41:18.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:18.142+0000 7f1145ffb700 1 -- 172.21.15.43:0/1517539813 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f1140004000 con 0x7f1148104bf0 2024-04-25T13:41:18.143 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:41:18.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:18.144+0000 7f114ed1b700 1 -- 172.21.15.43:0/1517539813 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f11380afb80 msgr2=0x7f11380b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:18.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:18.144+0000 7f114ed1b700 1 --2- 172.21.15.43:0/1517539813 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f11380afb80 0x7f11380b2090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1148104150 tx=0x7f113c009190 comp rx=0 tx=0).stop 2024-04-25T13:41:18.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:18.144+0000 7f114ed1b700 1 -- 172.21.15.43:0/1517539813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1148104bf0 msgr2=0x7f1148105ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:18.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:18.144+0000 7f114ed1b700 1 --2- 172.21.15.43:0/1517539813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1148104bf0 0x7f1148105ad0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1140009720 tx=0x7f1140004d00 comp rx=0 tx=0).stop 2024-04-25T13:41:18.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:18.144+0000 7f114ed1b700 1 -- 172.21.15.43:0/1517539813 shutdown_connections 2024-04-25T13:41:18.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:18.144+0000 7f114ed1b700 1 --2- 172.21.15.43:0/1517539813 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f11380afb80 0x7f11380b2090 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:18.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:18.144+0000 7f114ed1b700 1 --2- 172.21.15.43:0/1517539813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1148104bf0 0x7f1148105ad0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:18.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:18.144+0000 7f114ed1b700 1 --2- 172.21.15.43:0/1517539813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1148103120 0x7f1148106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:18.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:18.144+0000 7f114ed1b700 1 --2- 172.21.15.43:0/1517539813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1148104250 0x7f1148105590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:18.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:18.144+0000 7f114ed1b700 1 -- 172.21.15.43:0/1517539813 >> 172.21.15.43:0/1517539813 conn(0x7f11480fe760 msgr2=0x7f1148100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:18.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:18.145+0000 7f114ed1b700 1 -- 172.21.15.43:0/1517539813 shutdown_connections 2024-04-25T13:41:18.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:18.145+0000 7f114ed1b700 1 -- 172.21.15.43:0/1517539813 wait complete. 2024-04-25T13:41:18.177 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:18 smithi043 ceph-mon[29195]: purged_snaps scrub starts 2024-04-25T13:41:18.177 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:18 smithi043 ceph-mon[29195]: purged_snaps scrub ok 2024-04-25T13:41:18.177 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:18 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:41:18.177 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:18 smithi043 ceph-mon[29195]: osd.11 [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947] boot 2024-04-25T13:41:18.177 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:18 smithi043 ceph-mon[29195]: osdmap e71: 12 total, 12 up, 12 in 2024-04-25T13:41:18.177 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:18 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:41:18.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:18 smithi175 ceph-mon[32649]: purged_snaps scrub starts 2024-04-25T13:41:18.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:18 smithi175 ceph-mon[32649]: purged_snaps scrub ok 2024-04-25T13:41:18.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:18 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:41:18.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:18 smithi175 ceph-mon[32649]: osd.11 [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947] boot 2024-04-25T13:41:18.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:18 smithi175 ceph-mon[32649]: osdmap e71: 12 total, 12 up, 12 in 2024-04-25T13:41:18.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:18 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:41:18.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:18 smithi161 ceph-mon[32696]: purged_snaps scrub starts 2024-04-25T13:41:18.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:18 smithi161 ceph-mon[32696]: purged_snaps scrub ok 2024-04-25T13:41:18.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:18 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:41:18.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:18 smithi161 ceph-mon[32696]: osd.11 [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947] boot 2024-04-25T13:41:18.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:18 smithi161 ceph-mon[32696]: osdmap e71: 12 total, 12 up, 12 in 2024-04-25T13:41:18.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:18 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:41:18.815 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":71,"num_osds":12,"num_up_osds":12,"osd_up_since":1714052477,"num_in_osds":12,"osd_in_since":1714052456,"num_remapped_pgs":0} 2024-04-25T13:41:18.815 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T13:41:19.078 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:41:19.369 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:19 smithi043 ceph-mon[29195]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:19.369 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:19 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1517539813' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T13:41:19.369 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:19 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:19.370 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:19 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:19.370 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:19 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:41:19.370 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:19 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:41:19.370 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:19 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:41:19.370 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:19 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:41:19.370 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:19 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:19.370 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:19 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:19.370 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:19 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:41:19.370 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:19 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:19.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:19 smithi175 ceph-mon[32649]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:19.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:19 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1517539813' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T13:41:19.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:19 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:19.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:19 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:19.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:19 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:41:19.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:19 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:41:19.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:19 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:41:19.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:19 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:41:19.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:19 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:19.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:19 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:19.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:19 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:41:19.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:19 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:19.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:19 smithi161 ceph-mon[32696]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-04-25T13:41:19.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:19 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1517539813' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T13:41:19.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:19 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:19.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:19 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:19.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:19 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:41:19.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:19 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:41:19.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:19 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:41:19.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:19 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:41:19.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:19 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:19.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:19 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:19.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:19 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:41:19.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:19 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:20.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:20 smithi043 ceph-mon[29195]: Detected new or changed devices on smithi175 2024-04-25T13:41:20.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:20 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi175 to 4272M 2024-04-25T13:41:20.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:20 smithi043 ceph-mon[29195]: osdmap e72: 12 total, 12 up, 12 in 2024-04-25T13:41:20.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:20 smithi175 ceph-mon[32649]: Detected new or changed devices on smithi175 2024-04-25T13:41:20.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:20 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi175 to 4272M 2024-04-25T13:41:20.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:20 smithi175 ceph-mon[32649]: osdmap e72: 12 total, 12 up, 12 in 2024-04-25T13:41:20.439 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:20 smithi161 ceph-mon[32696]: Detected new or changed devices on smithi175 2024-04-25T13:41:20.439 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:20 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi175 to 4272M 2024-04-25T13:41:20.439 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:20 smithi161 ceph-mon[32696]: osdmap e72: 12 total, 12 up, 12 in 2024-04-25T13:41:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.851+0000 7fa49fd40700 1 -- 172.21.15.43:0/2362738436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa498102640 msgr2=0x7fa498102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.851+0000 7fa49fd40700 1 --2- 172.21.15.43:0/2362738436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa498102640 0x7fa498102a50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa494009990 tx=0x7fa494009ca0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.852+0000 7fa49fd40700 1 -- 172.21.15.43:0/2362738436 shutdown_connections 2024-04-25T13:41:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.852+0000 7fa49fd40700 1 --2- 172.21.15.43:0/2362738436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa498102f90 0x7fa498111020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.852+0000 7fa49fd40700 1 --2- 172.21.15.43:0/2362738436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4981091b0 0x7fa4981095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.852+0000 7fa49fd40700 1 --2- 172.21.15.43:0/2362738436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa498102640 0x7fa498102a50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.852+0000 7fa49fd40700 1 -- 172.21.15.43:0/2362738436 >> 172.21.15.43:0/2362738436 conn(0x7fa4980fe3f0 msgr2=0x7fa498100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:20.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.852+0000 7fa49fd40700 1 -- 172.21.15.43:0/2362738436 shutdown_connections 2024-04-25T13:41:20.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.852+0000 7fa49fd40700 1 -- 172.21.15.43:0/2362738436 wait complete. 2024-04-25T13:41:20.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.852+0000 7fa49fd40700 1 Processor -- start 2024-04-25T13:41:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49fd40700 1 -- start start 2024-04-25T13:41:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49fd40700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa498102640 0x7fa498103820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49fd40700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa498102f90 0x7fa498103d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49fd40700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4981091b0 0x7fa4981042a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49fd40700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa498114350 con 0x7fa4981091b0 2024-04-25T13:41:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49fd40700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fa4981141d0 con 0x7fa498102f90 2024-04-25T13:41:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49fd40700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa4981144d0 con 0x7fa498102640 2024-04-25T13:41:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49e2dd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4981091b0 0x7fa4981042a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49dadc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa498102640 0x7fa498103820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49e2dd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4981091b0 0x7fa4981042a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55898/0 (socket says 172.21.15.43:55898) 2024-04-25T13:41:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49dadc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa498102640 0x7fa498103820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.43:46208/0 (socket says 172.21.15.43:46208) 2024-04-25T13:41:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49e2dd700 1 -- 172.21.15.43:0/1453777030 learned_addr learned my addr 172.21.15.43:0/1453777030 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:20.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49d2db700 1 --2- 172.21.15.43:0/1453777030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa498102f90 0x7fa498103d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:20.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49e2dd700 1 -- 172.21.15.43:0/1453777030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa498102640 msgr2=0x7fa498103820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:20.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49e2dd700 1 --2- 172.21.15.43:0/1453777030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa498102640 0x7fa498103820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49e2dd700 1 -- 172.21.15.43:0/1453777030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa498102f90 msgr2=0x7fa498103d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:20.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49e2dd700 1 --2- 172.21.15.43:0/1453777030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa498102f90 0x7fa498103d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:20.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.853+0000 7fa49e2dd700 1 -- 172.21.15.43:0/1453777030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4981a90a0 con 0x7fa4981091b0 2024-04-25T13:41:20.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.854+0000 7fa49d2db700 1 --2- 172.21.15.43:0/1453777030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa498102f90 0x7fa498103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:20.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.854+0000 7fa49e2dd700 1 --2- 172.21.15.43:0/1453777030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4981091b0 0x7fa4981042a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa49000ada0 tx=0x7fa49000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:20.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.854+0000 7fa48effd700 1 -- 172.21.15.43:0/1453777030 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490017020 con 0x7fa4981091b0 2024-04-25T13:41:20.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.854+0000 7fa48effd700 1 -- 172.21.15.43:0/1453777030 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa49000ce10 con 0x7fa4981091b0 2024-04-25T13:41:20.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.854+0000 7fa48effd700 1 -- 172.21.15.43:0/1453777030 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490005280 con 0x7fa4981091b0 2024-04-25T13:41:20.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.854+0000 7fa49fd40700 1 -- 172.21.15.43:0/1453777030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4981a9390 con 0x7fa4981091b0 2024-04-25T13:41:20.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.854+0000 7fa49fd40700 1 -- 172.21.15.43:0/1453777030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4981a9880 con 0x7fa4981091b0 2024-04-25T13:41:20.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.855+0000 7fa49fd40700 1 -- 172.21.15.43:0/1453777030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa498051190 con 0x7fa4981091b0 2024-04-25T13:41:20.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.857+0000 7fa48effd700 1 -- 172.21.15.43:0/1453777030 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fa49000c980 con 0x7fa4981091b0 2024-04-25T13:41:20.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.857+0000 7fa48effd700 1 --2- 172.21.15.43:0/1453777030 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa4840afb80 0x7fa4840b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:20.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.857+0000 7fa49dadc700 1 --2- 172.21.15.43:0/1453777030 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa4840afb80 0x7fa4840b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:20.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.857+0000 7fa48effd700 1 -- 172.21.15.43:0/1453777030 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fa4900de470 con 0x7fa4981091b0 2024-04-25T13:41:20.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.858+0000 7fa49dadc700 1 --2- 172.21.15.43:0/1453777030 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa4840afb80 0x7fa4840b2090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa49806c960 tx=0x7fa488007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:20.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:20.861+0000 7fa48effd700 1 -- 172.21.15.43:0/1453777030 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa490021020 con 0x7fa4981091b0 2024-04-25T13:41:21.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:21.069+0000 7fa49fd40700 1 -- 172.21.15.43:0/1453777030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa49802e510 con 0x7fa4981091b0 2024-04-25T13:41:21.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:21.070+0000 7fa48effd700 1 -- 172.21.15.43:0/1453777030 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+18445 (secure 0 0 0) 0x7fa4900a7580 con 0x7fa4981091b0 2024-04-25T13:41:21.070 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:41:21.070 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":72,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:41:19.110994+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:41:21.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:21.072+0000 7fa49fd40700 1 -- 172.21.15.43:0/1453777030 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa4840afb80 msgr2=0x7fa4840b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:21.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:21.072+0000 7fa49fd40700 1 --2- 172.21.15.43:0/1453777030 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa4840afb80 0x7fa4840b2090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa49806c960 tx=0x7fa488007400 comp rx=0 tx=0).stop 2024-04-25T13:41:21.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:21.072+0000 7fa49fd40700 1 -- 172.21.15.43:0/1453777030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4981091b0 msgr2=0x7fa4981042a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:21.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:21.072+0000 7fa49fd40700 1 --2- 172.21.15.43:0/1453777030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4981091b0 0x7fa4981042a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa49000ada0 tx=0x7fa49000c330 comp rx=0 tx=0).stop 2024-04-25T13:41:21.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:21.072+0000 7fa49fd40700 1 -- 172.21.15.43:0/1453777030 shutdown_connections 2024-04-25T13:41:21.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:21.072+0000 7fa49fd40700 1 --2- 172.21.15.43:0/1453777030 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa4840afb80 0x7fa4840b2090 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:21.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:21.072+0000 7fa49fd40700 1 --2- 172.21.15.43:0/1453777030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4981091b0 0x7fa4981042a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:21.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:21.072+0000 7fa49fd40700 1 --2- 172.21.15.43:0/1453777030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa498102640 0x7fa498103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:21.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:21.072+0000 7fa49fd40700 1 --2- 172.21.15.43:0/1453777030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa498102f90 0x7fa498103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:21.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:21.072+0000 7fa49fd40700 1 -- 172.21.15.43:0/1453777030 >> 172.21.15.43:0/1453777030 conn(0x7fa4980fe3f0 msgr2=0x7fa498107070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:21.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:21.072+0000 7fa49fd40700 1 -- 172.21.15.43:0/1453777030 shutdown_connections 2024-04-25T13:41:21.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:21.072+0000 7fa49fd40700 1 -- 172.21.15.43:0/1453777030 wait complete. 2024-04-25T13:41:21.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:21 smithi175 ceph-mon[32649]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:21.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:21 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1453777030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:41:21.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:21 smithi043 ceph-mon[29195]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:21.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:21 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1453777030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:41:21.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:21 smithi161 ceph-mon[32696]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:21.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:21 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1453777030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:41:21.765 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:37:25.931659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:41:21.765 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-25T13:41:22.009 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:41:23.410 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:23 smithi043 ceph-mon[29195]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:23.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:23 smithi175 ceph-mon[32649]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:23.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:23 smithi161 ceph-mon[32696]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.829+0000 7fd45201f700 1 -- 172.21.15.43:0/2988570299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd44c103360 msgr2=0x7fd44c103770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.829+0000 7fd45201f700 1 --2- 172.21.15.43:0/2988570299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd44c103360 0x7fd44c103770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0099c0 tx=0x7fd43c009cd0 comp rx=0 tx=0).stop 2024-04-25T13:41:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.829+0000 7fd45201f700 1 -- 172.21.15.43:0/2988570299 shutdown_connections 2024-04-25T13:41:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.829+0000 7fd45201f700 1 --2- 172.21.15.43:0/2988570299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd44c1085e0 0x7fd44c10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.829+0000 7fd45201f700 1 --2- 172.21.15.43:0/2988570299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd44c103360 0x7fd44c103770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.829+0000 7fd45201f700 1 --2- 172.21.15.43:0/2988570299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd44c107c90 0x7fd44c1080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.829+0000 7fd45201f700 1 -- 172.21.15.43:0/2988570299 >> 172.21.15.43:0/2988570299 conn(0x7fd44c0fec90 msgr2=0x7fd44c1010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.829+0000 7fd45201f700 1 -- 172.21.15.43:0/2988570299 shutdown_connections 2024-04-25T13:41:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.829+0000 7fd45201f700 1 -- 172.21.15.43:0/2988570299 wait complete. 2024-04-25T13:41:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.830+0000 7fd45201f700 1 Processor -- start 2024-04-25T13:41:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.830+0000 7fd45201f700 1 -- start start 2024-04-25T13:41:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.830+0000 7fd45201f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd44c103360 0x7fd44c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.830+0000 7fd45201f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd44c107c90 0x7fd44c19d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.830+0000 7fd45201f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd44c1085e0 0x7fd44c1a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.830+0000 7fd45201f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c1130c0 con 0x7fd44c107c90 2024-04-25T13:41:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.830+0000 7fd45201f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c112f40 con 0x7fd44c103360 2024-04-25T13:41:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.830+0000 7fd45201f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c113240 con 0x7fd44c1085e0 2024-04-25T13:41:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.831+0000 7fd44affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd44c107c90 0x7fd44c19d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.831+0000 7fd44affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd44c107c90 0x7fd44c19d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55908/0 (socket says 172.21.15.43:55908) 2024-04-25T13:41:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.831+0000 7fd44affd700 1 -- 172.21.15.43:0/835724476 learned_addr learned my addr 172.21.15.43:0/835724476 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.831+0000 7fd44b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd44c103360 0x7fd44c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.831+0000 7fd44bfff700 1 --2- 172.21.15.43:0/835724476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd44c1085e0 0x7fd44c1a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.831+0000 7fd44affd700 1 -- 172.21.15.43:0/835724476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd44c1085e0 msgr2=0x7fd44c1a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.831+0000 7fd44affd700 1 --2- 172.21.15.43:0/835724476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd44c1085e0 0x7fd44c1a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.831+0000 7fd44affd700 1 -- 172.21.15.43:0/835724476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd44c103360 msgr2=0x7fd44c19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.831+0000 7fd44affd700 1 --2- 172.21.15.43:0/835724476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd44c103360 0x7fd44c19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.831+0000 7fd44affd700 1 -- 172.21.15.43:0/835724476 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44c1a1cc0 con 0x7fd44c107c90 2024-04-25T13:41:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.831+0000 7fd44affd700 1 --2- 172.21.15.43:0/835724476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd44c107c90 0x7fd44c19d390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd44000d980 tx=0x7fd44000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.831+0000 7fd448ff9700 1 -- 172.21.15.43:0/835724476 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440017070 con 0x7fd44c107c90 2024-04-25T13:41:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.831+0000 7fd448ff9700 1 -- 172.21.15.43:0/835724476 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd44000fd20 con 0x7fd44c107c90 2024-04-25T13:41:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.831+0000 7fd45201f700 1 -- 172.21.15.43:0/835724476 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44c1a1fb0 con 0x7fd44c107c90 2024-04-25T13:41:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.831+0000 7fd448ff9700 1 -- 172.21.15.43:0/835724476 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44000e3b0 con 0x7fd44c107c90 2024-04-25T13:41:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.831+0000 7fd45201f700 1 -- 172.21.15.43:0/835724476 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd44c1a98d0 con 0x7fd44c107c90 2024-04-25T13:41:23.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.833+0000 7fd45201f700 1 -- 172.21.15.43:0/835724476 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd44c051190 con 0x7fd44c107c90 2024-04-25T13:41:23.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.834+0000 7fd448ff9700 1 -- 172.21.15.43:0/835724476 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fd44000f890 con 0x7fd44c107c90 2024-04-25T13:41:23.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.835+0000 7fd448ff9700 1 --2- 172.21.15.43:0/835724476 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd4340afc00 0x7fd4340b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:23.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.835+0000 7fd44b7fe700 1 --2- 172.21.15.43:0/835724476 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd4340afc00 0x7fd4340b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:23.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.835+0000 7fd448ff9700 1 -- 172.21.15.43:0/835724476 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fd4400de550 con 0x7fd44c107c90 2024-04-25T13:41:23.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.835+0000 7fd44b7fe700 1 --2- 172.21.15.43:0/835724476 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd4340afc00 0x7fd4340b2110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd43c000c00 tx=0x7fd43c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:23.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:23.839+0000 7fd448ff9700 1 -- 172.21.15.43:0/835724476 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd4400a75b0 con 0x7fd44c107c90 2024-04-25T13:41:24.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:24.045+0000 7fd45201f700 1 -- 172.21.15.43:0/835724476 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd44c1a9aa0 con 0x7fd44c107c90 2024-04-25T13:41:24.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:24.045+0000 7fd448ff9700 1 -- 172.21.15.43:0/835724476 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7fd4400a6eb0 con 0x7fd44c107c90 2024-04-25T13:41:24.046 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T13:41:24.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:24.048+0000 7fd45201f700 1 -- 172.21.15.43:0/835724476 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd4340afc00 msgr2=0x7fd4340b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:24.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:24.048+0000 7fd45201f700 1 --2- 172.21.15.43:0/835724476 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd4340afc00 0x7fd4340b2110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd43c000c00 tx=0x7fd43c005fb0 comp rx=0 tx=0).stop 2024-04-25T13:41:24.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:24.048+0000 7fd45201f700 1 -- 172.21.15.43:0/835724476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd44c107c90 msgr2=0x7fd44c19d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:24.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:24.048+0000 7fd45201f700 1 --2- 172.21.15.43:0/835724476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd44c107c90 0x7fd44c19d390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd44000d980 tx=0x7fd44000dc90 comp rx=0 tx=0).stop 2024-04-25T13:41:24.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:24.048+0000 7fd45201f700 1 -- 172.21.15.43:0/835724476 shutdown_connections 2024-04-25T13:41:24.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:24.048+0000 7fd45201f700 1 --2- 172.21.15.43:0/835724476 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd4340afc00 0x7fd4340b2110 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:24.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:24.048+0000 7fd45201f700 1 --2- 172.21.15.43:0/835724476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd44c1085e0 0x7fd44c1a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:24.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:24.048+0000 7fd45201f700 1 --2- 172.21.15.43:0/835724476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd44c103360 0x7fd44c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:24.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:24.048+0000 7fd45201f700 1 --2- 172.21.15.43:0/835724476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd44c107c90 0x7fd44c19d390 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:24.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:24.048+0000 7fd45201f700 1 -- 172.21.15.43:0/835724476 >> 172.21.15.43:0/835724476 conn(0x7fd44c0fec90 msgr2=0x7fd44c06b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:24.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:24.048+0000 7fd45201f700 1 -- 172.21.15.43:0/835724476 shutdown_connections 2024-04-25T13:41:24.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:24.048+0000 7fd45201f700 1 -- 172.21.15.43:0/835724476 wait complete. 2024-04-25T13:41:24.354 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:24 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/835724476' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:41:24.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:24 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/835724476' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:41:24.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:24 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/835724476' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:41:24.736 INFO:tasks.cephadm:Adding mds.a on smithi043 2024-04-25T13:41:24.736 INFO:tasks.cephadm:Adding mds.d on smithi043 2024-04-25T13:41:24.736 INFO:tasks.cephadm:Adding mds.g on smithi043 2024-04-25T13:41:24.736 INFO:tasks.cephadm:Adding mds.j on smithi043 2024-04-25T13:41:24.736 INFO:tasks.cephadm:Adding mds.b on smithi161 2024-04-25T13:41:24.736 INFO:tasks.cephadm:Adding mds.e on smithi161 2024-04-25T13:41:24.736 INFO:tasks.cephadm:Adding mds.h on smithi161 2024-04-25T13:41:24.736 INFO:tasks.cephadm:Adding mds.k on smithi161 2024-04-25T13:41:24.736 INFO:tasks.cephadm:Adding mds.c on smithi175 2024-04-25T13:41:24.736 INFO:tasks.cephadm:Adding mds.f on smithi175 2024-04-25T13:41:24.737 INFO:tasks.cephadm:Adding mds.i on smithi175 2024-04-25T13:41:24.737 INFO:tasks.cephadm:Adding mds.l on smithi175 2024-04-25T13:41:24.737 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph orch apply mds all '12;smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi161=b;smithi161=e;smithi161=h;smithi161=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l' 2024-04-25T13:41:24.985 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T13:41:25.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:25 smithi175 ceph-mon[32649]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:25.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:25 smithi043 ceph-mon[29195]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:25.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:25 smithi161 ceph-mon[32696]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:26.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.707+0000 7f67bd30a700 1 -- 172.21.15.175:0/3242977420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b81057b0 msgr2=0x7f67b8105bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:26.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.707+0000 7f67bd30a700 1 --2- 172.21.15.175:0/3242977420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b81057b0 0x7f67b8105bc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009990 tx=0x7f67a8009ca0 comp rx=0 tx=0).stop 2024-04-25T13:41:26.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.707+0000 7f67bd30a700 1 -- 172.21.15.175:0/3242977420 shutdown_connections 2024-04-25T13:41:26.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.707+0000 7f67bd30a700 1 --2- 172.21.15.175:0/3242977420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67b8102b50 0x7f67b810c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:26.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.707+0000 7f67bd30a700 1 --2- 172.21.15.175:0/3242977420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b81057b0 0x7f67b8105bc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:26.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.707+0000 7f67bd30a700 1 --2- 172.21.15.175:0/3242977420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b8102200 0x7f67b8102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:26.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.707+0000 7f67bd30a700 1 -- 172.21.15.175:0/3242977420 >> 172.21.15.175:0/3242977420 conn(0x7f67b80fded0 msgr2=0x7f67b8100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:26.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.707+0000 7f67bd30a700 1 -- 172.21.15.175:0/3242977420 shutdown_connections 2024-04-25T13:41:26.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.707+0000 7f67bd30a700 1 -- 172.21.15.175:0/3242977420 wait complete. 2024-04-25T13:41:26.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.708+0000 7f67bd30a700 1 Processor -- start 2024-04-25T13:41:26.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.708+0000 7f67bd30a700 1 -- start start 2024-04-25T13:41:26.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.708+0000 7f67bd30a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b8102200 0x7f67b819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:26.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.708+0000 7f67bd30a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b8102b50 0x7f67b819acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:26.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.708+0000 7f67bd30a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67b81057b0 0x7f67b81a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:26.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.708+0000 7f67bd30a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f67b810fb10 con 0x7f67b8102b50 2024-04-25T13:41:26.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.708+0000 7f67bd30a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f67b810f990 con 0x7f67b81057b0 2024-04-25T13:41:26.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.708+0000 7f67bd30a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f67b810fc90 con 0x7f67b8102200 2024-04-25T13:41:26.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.708+0000 7f67b6ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b8102200 0x7f67b819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:26.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.708+0000 7f67b6ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b8102200 0x7f67b819a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38724/0 (socket says 172.21.15.175:38724) 2024-04-25T13:41:26.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.708+0000 7f67b6ffd700 1 -- 172.21.15.175:0/2192753332 learned_addr learned my addr 172.21.15.175:0/2192753332 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T13:41:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.708+0000 7f67b6ffd700 1 -- 172.21.15.175:0/2192753332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67b81057b0 msgr2=0x7f67b81a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.708+0000 7f67b77fe700 1 --2- 172.21.15.175:0/2192753332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67b81057b0 0x7f67b81a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.709+0000 7f67b67fc700 1 --2- 172.21.15.175:0/2192753332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b8102b50 0x7f67b819acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.709+0000 7f67b6ffd700 1 --2- 172.21.15.175:0/2192753332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67b81057b0 0x7f67b81a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.709+0000 7f67b6ffd700 1 -- 172.21.15.175:0/2192753332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b8102b50 msgr2=0x7f67b819acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.709+0000 7f67b6ffd700 1 --2- 172.21.15.175:0/2192753332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b8102b50 0x7f67b819acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.709+0000 7f67b6ffd700 1 -- 172.21.15.175:0/2192753332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b81a22d0 con 0x7f67b8102200 2024-04-25T13:41:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.709+0000 7f67b77fe700 1 --2- 172.21.15.175:0/2192753332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67b81057b0 0x7f67b81a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.709+0000 7f67b67fc700 1 --2- 172.21.15.175:0/2192753332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b8102b50 0x7f67b819acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.709+0000 7f67b6ffd700 1 --2- 172.21.15.175:0/2192753332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b8102200 0x7f67b819a770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f67a80098e0 tx=0x7f67a8009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.709+0000 7f679ffff700 1 -- 172.21.15.175:0/2192753332 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8027070 con 0x7f67b8102200 2024-04-25T13:41:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.709+0000 7f679ffff700 1 -- 172.21.15.175:0/2192753332 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67a8004210 con 0x7f67b8102200 2024-04-25T13:41:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.709+0000 7f67bd30a700 1 -- 172.21.15.175:0/2192753332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b81a2560 con 0x7f67b8102200 2024-04-25T13:41:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.709+0000 7f679ffff700 1 -- 172.21.15.175:0/2192753332 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8022e50 con 0x7f67b8102200 2024-04-25T13:41:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.709+0000 7f67bd30a700 1 -- 172.21.15.175:0/2192753332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b81a2a10 con 0x7f67b8102200 2024-04-25T13:41:26.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.710+0000 7f67bd30a700 1 -- 172.21.15.175:0/2192753332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b8051190 con 0x7f67b8102200 2024-04-25T13:41:26.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.711+0000 7f679ffff700 1 -- 172.21.15.175:0/2192753332 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f67a802a070 con 0x7f67b8102200 2024-04-25T13:41:26.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.712+0000 7f679ffff700 1 --2- 172.21.15.175:0/2192753332 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f67a00afda0 0x7f67a00b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:26.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.712+0000 7f679ffff700 1 -- 172.21.15.175:0/2192753332 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f67a80dfae0 con 0x7f67b8102200 2024-04-25T13:41:26.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.712+0000 7f67b67fc700 1 --2- 172.21.15.175:0/2192753332 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f67a00afda0 0x7f67a00b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:26.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.713+0000 7f67b67fc700 1 --2- 172.21.15.175:0/2192753332 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f67a00afda0 0x7f67a00b22b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f67ac005fd0 tx=0x7f67ac005de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:26.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.716+0000 7f679ffff700 1 -- 172.21.15.175:0/2192753332 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f67a8013070 con 0x7f67b8102200 2024-04-25T13:41:26.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.923+0000 7f67bd30a700 1 -- 172.21.15.175:0/2192753332 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi161=b;smithi161=e;smithi161=h;smithi161=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}) -- 0x7f67b8063cd0 con 0x7f67a00afda0 2024-04-25T13:41:26.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.932+0000 7f679ffff700 1 -- 172.21.15.175:0/2192753332 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f67b8063cd0 con 0x7f67a00afda0 2024-04-25T13:41:26.931 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mds.all update... 2024-04-25T13:41:26.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.934+0000 7f67bd30a700 1 -- 172.21.15.175:0/2192753332 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f67a00afda0 msgr2=0x7f67a00b22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:26.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.934+0000 7f67bd30a700 1 --2- 172.21.15.175:0/2192753332 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f67a00afda0 0x7f67a00b22b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f67ac005fd0 tx=0x7f67ac005de0 comp rx=0 tx=0).stop 2024-04-25T13:41:26.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.934+0000 7f67bd30a700 1 -- 172.21.15.175:0/2192753332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b8102200 msgr2=0x7f67b819a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:26.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.934+0000 7f67bd30a700 1 --2- 172.21.15.175:0/2192753332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b8102200 0x7f67b819a770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f67a80098e0 tx=0x7f67a8009f90 comp rx=0 tx=0).stop 2024-04-25T13:41:26.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.934+0000 7f67bd30a700 1 -- 172.21.15.175:0/2192753332 shutdown_connections 2024-04-25T13:41:26.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.934+0000 7f67bd30a700 1 --2- 172.21.15.175:0/2192753332 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f67a00afda0 0x7f67a00b22b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:26.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.934+0000 7f67bd30a700 1 --2- 172.21.15.175:0/2192753332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67b81057b0 0x7f67b81a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:26.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.934+0000 7f67bd30a700 1 --2- 172.21.15.175:0/2192753332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b8102200 0x7f67b819a770 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:26.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.934+0000 7f67bd30a700 1 --2- 172.21.15.175:0/2192753332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b8102b50 0x7f67b819acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:26.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.934+0000 7f67bd30a700 1 -- 172.21.15.175:0/2192753332 >> 172.21.15.175:0/2192753332 conn(0x7f67b80fded0 msgr2=0x7f67b8108750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:26.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.934+0000 7f67bd30a700 1 -- 172.21.15.175:0/2192753332 shutdown_connections 2024-04-25T13:41:26.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T13:41:26.934+0000 7f67bd30a700 1 -- 172.21.15.175:0/2192753332 wait complete. 2024-04-25T13:41:27.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:27 smithi175 ceph-mon[32649]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:27.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:27 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:27.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:27 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:41:27.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:27 smithi043 ceph-mon[29195]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:27.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:27 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:27.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:27 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:41:27.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:27 smithi161 ceph-mon[32696]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:27.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:27 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:27.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:27 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:41:27.631 DEBUG:teuthology.orchestra.run.smithi043:mds.a> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.a.service 2024-04-25T13:41:27.633 DEBUG:teuthology.orchestra.run.smithi043:mds.d> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.d.service 2024-04-25T13:41:27.677 DEBUG:teuthology.orchestra.run.smithi043:mds.g> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.g.service 2024-04-25T13:41:27.720 DEBUG:teuthology.orchestra.run.smithi043:mds.j> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.j.service 2024-04-25T13:41:27.763 DEBUG:teuthology.orchestra.run.smithi161:mds.b> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.b.service 2024-04-25T13:41:27.765 DEBUG:teuthology.orchestra.run.smithi161:mds.e> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.e.service 2024-04-25T13:41:27.809 DEBUG:teuthology.orchestra.run.smithi161:mds.h> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.h.service 2024-04-25T13:41:27.851 DEBUG:teuthology.orchestra.run.smithi161:mds.k> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.k.service 2024-04-25T13:41:27.894 DEBUG:teuthology.orchestra.run.smithi175:mds.c> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.c.service 2024-04-25T13:41:27.897 DEBUG:teuthology.orchestra.run.smithi175:mds.f> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.f.service 2024-04-25T13:41:27.940 DEBUG:teuthology.orchestra.run.smithi175:mds.i> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.i.service 2024-04-25T13:41:27.983 DEBUG:teuthology.orchestra.run.smithi175:mds.l> sudo journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.l.service 2024-04-25T13:41:28.026 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-04-25T13:41:28.026 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:41:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.149+0000 7f123a230640 1 -- 172.21.15.43:0/4287073639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1234109a10 msgr2=0x7f123410be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.149+0000 7f123a230640 1 --2- 172.21.15.43:0/4287073639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1234109a10 0x7f123410be30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f122c009ca0 tx=0x7f122c02a8c0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.149+0000 7f123a230640 1 -- 172.21.15.43:0/4287073639 shutdown_connections 2024-04-25T13:41:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.149+0000 7f123a230640 1 --2- 172.21.15.43:0/4287073639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1234109a10 0x7f123410be30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.149+0000 7f123a230640 1 --2- 172.21.15.43:0/4287073639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1234104d10 0x7f1234105120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.149+0000 7f123a230640 1 --2- 172.21.15.43:0/4287073639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1234103ad0 0x7f12341047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.149+0000 7f123a230640 1 -- 172.21.15.43:0/4287073639 >> 172.21.15.43:0/4287073639 conn(0x7f12340fecc0 msgr2=0x7f1234101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.149+0000 7f123a230640 1 -- 172.21.15.43:0/4287073639 shutdown_connections 2024-04-25T13:41:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.149+0000 7f123a230640 1 -- 172.21.15.43:0/4287073639 wait complete. 2024-04-25T13:41:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.150+0000 7f123a230640 1 Processor -- start 2024-04-25T13:41:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.150+0000 7f123a230640 1 -- start start 2024-04-25T13:41:28.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.150+0000 7f123a230640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1234103ad0 0x7f123419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.150+0000 7f123a230640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1234104d10 0x7f123419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.150+0000 7f123a230640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1234109a10 0x7f12341a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.150+0000 7f123a230640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f123410f4e0 con 0x7f1234109a10 2024-04-25T13:41:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.150+0000 7f123a230640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f123410f360 con 0x7f1234103ad0 2024-04-25T13:41:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.150+0000 7f123a230640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f123410f660 con 0x7f1234104d10 2024-04-25T13:41:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.150+0000 7f1233fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1234109a10 0x7f12341a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.150+0000 7f1233fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1234109a10 0x7f12341a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55916/0 (socket says 172.21.15.43:55916) 2024-04-25T13:41:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.150+0000 7f1233fff640 1 -- 172.21.15.43:0/2010793599 learned_addr learned my addr 172.21.15.43:0/2010793599 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.150+0000 7f12337fe640 1 --2- 172.21.15.43:0/2010793599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1234103ad0 0x7f123419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.150+0000 7f1232ffd640 1 --2- 172.21.15.43:0/2010793599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1234104d10 0x7f123419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.151+0000 7f1233fff640 1 -- 172.21.15.43:0/2010793599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1234104d10 msgr2=0x7f123419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.151+0000 7f1233fff640 1 --2- 172.21.15.43:0/2010793599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1234104d10 0x7f123419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.151+0000 7f1233fff640 1 -- 172.21.15.43:0/2010793599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1234103ad0 msgr2=0x7f123419a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.151+0000 7f1233fff640 1 --2- 172.21.15.43:0/2010793599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1234103ad0 0x7f123419a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.151+0000 7f1233fff640 1 -- 172.21.15.43:0/2010793599 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12341a1bf0 con 0x7f1234109a10 2024-04-25T13:41:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.151+0000 7f12337fe640 1 --2- 172.21.15.43:0/2010793599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1234103ad0 0x7f123419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:41:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.151+0000 7f1233fff640 1 --2- 172.21.15.43:0/2010793599 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1234109a10 0x7f12341a1580 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f122c031920 tx=0x7f122c009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.151+0000 7f1230ff9640 1 -- 172.21.15.43:0/2010793599 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c003c70 con 0x7f1234109a10 2024-04-25T13:41:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.151+0000 7f1230ff9640 1 -- 172.21.15.43:0/2010793599 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f122c003e10 con 0x7f1234109a10 2024-04-25T13:41:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.151+0000 7f123a230640 1 -- 172.21.15.43:0/2010793599 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12341a1e80 con 0x7f1234109a10 2024-04-25T13:41:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.151+0000 7f1230ff9640 1 -- 172.21.15.43:0/2010793599 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c030bf0 con 0x7f1234109a10 2024-04-25T13:41:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.151+0000 7f123a230640 1 -- 172.21.15.43:0/2010793599 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12341a22e0 con 0x7f1234109a10 2024-04-25T13:41:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.152+0000 7f123a230640 1 -- 172.21.15.43:0/2010793599 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1234069310 con 0x7f1234109a10 2024-04-25T13:41:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.154+0000 7f1230ff9640 1 -- 172.21.15.43:0/2010793599 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f122c004040 con 0x7f1234109a10 2024-04-25T13:41:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.155+0000 7f1230ff9640 1 --2- 172.21.15.43:0/2010793599 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f121c0afaf0 0x7f121c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.155+0000 7f12337fe640 1 --2- 172.21.15.43:0/2010793599 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f121c0afaf0 0x7f121c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.155+0000 7f1230ff9640 1 -- 172.21.15.43:0/2010793599 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f122c0ffc80 con 0x7f1234109a10 2024-04-25T13:41:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.156+0000 7f12337fe640 1 --2- 172.21.15.43:0/2010793599 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f121c0afaf0 0x7f121c0b2000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12341046d0 tx=0x7f1224005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:28.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.159+0000 7f1230ff9640 1 -- 172.21.15.43:0/2010793599 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f122c0c8c60 con 0x7f1234109a10 2024-04-25T13:41:28.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:28 smithi175 ceph-mon[32649]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi161=b;smithi161=e;smithi161=h;smithi161=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:41:28.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:28 smithi175 ceph-mon[32649]: Saving service mds.all spec with placement smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi161=b;smithi161=e;smithi161=h;smithi161=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-04-25T13:41:28.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:28.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:41:28.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:28.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:28.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:28.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:28 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:28.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.344+0000 7f123a230640 1 -- 172.21.15.43:0/2010793599 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12340637a0 con 0x7f1234109a10 2024-04-25T13:41:28.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.345+0000 7f1230ff9640 1 -- 172.21.15.43:0/2010793599 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+18445 (secure 0 0 0) 0x7f122c0c8560 con 0x7f1234109a10 2024-04-25T13:41:28.346 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:41:28.346 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":72,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:41:19.110994+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:41:28.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.347+0000 7f123a230640 1 -- 172.21.15.43:0/2010793599 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f121c0afaf0 msgr2=0x7f121c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:28.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.347+0000 7f123a230640 1 --2- 172.21.15.43:0/2010793599 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f121c0afaf0 0x7f121c0b2000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12341046d0 tx=0x7f1224005f90 comp rx=0 tx=0).stop 2024-04-25T13:41:28.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.347+0000 7f123a230640 1 -- 172.21.15.43:0/2010793599 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1234109a10 msgr2=0x7f12341a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:28.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.347+0000 7f123a230640 1 --2- 172.21.15.43:0/2010793599 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1234109a10 0x7f12341a1580 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f122c031920 tx=0x7f122c009870 comp rx=0 tx=0).stop 2024-04-25T13:41:28.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.347+0000 7f123a230640 1 -- 172.21.15.43:0/2010793599 shutdown_connections 2024-04-25T13:41:28.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.347+0000 7f123a230640 1 --2- 172.21.15.43:0/2010793599 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1234109a10 0x7f12341a1580 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.347+0000 7f123a230640 1 --2- 172.21.15.43:0/2010793599 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f121c0afaf0 0x7f121c0b2000 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.347+0000 7f123a230640 1 --2- 172.21.15.43:0/2010793599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1234104d10 0x7f123419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.347+0000 7f123a230640 1 --2- 172.21.15.43:0/2010793599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1234103ad0 0x7f123419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.347+0000 7f123a230640 1 -- 172.21.15.43:0/2010793599 >> 172.21.15.43:0/2010793599 conn(0x7f12340fecc0 msgr2=0x7f12341059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:28.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.347+0000 7f123a230640 1 -- 172.21.15.43:0/2010793599 shutdown_connections 2024-04-25T13:41:28.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.347+0000 7f123a230640 1 -- 172.21.15.43:0/2010793599 wait complete. 2024-04-25T13:41:28.357 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:28 smithi043 ceph-mon[29195]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi161=b;smithi161=e;smithi161=h;smithi161=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:41:28.358 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:28 smithi043 ceph-mon[29195]: Saving service mds.all spec with placement smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi161=b;smithi161=e;smithi161=h;smithi161=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-04-25T13:41:28.358 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:28.358 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:41:28.358 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:28.358 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:28.358 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:28.358 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:28 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:28.359 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:37:25.931659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:41:28.360 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:41:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.474+0000 7fdd1d5a8640 1 -- 172.21.15.43:0/4087322591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd18102fe0 msgr2=0x7fdd181033f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.474+0000 7fdd1d5a8640 1 --2- 172.21.15.43:0/4087322591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd18102fe0 0x7fdd181033f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd08009900 tx=0x7fdd0802a410 comp rx=0 tx=0).stop 2024-04-25T13:41:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.474+0000 7fdd1d5a8640 1 -- 172.21.15.43:0/4087322591 shutdown_connections 2024-04-25T13:41:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.474+0000 7fdd1d5a8640 1 --2- 172.21.15.43:0/4087322591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd181046a0 0x7fdd1810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.474+0000 7fdd1d5a8640 1 --2- 172.21.15.43:0/4087322591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd18103b40 0x7fdd18104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.475+0000 7fdd1d5a8640 1 --2- 172.21.15.43:0/4087322591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd18102fe0 0x7fdd181033f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.475+0000 7fdd1d5a8640 1 -- 172.21.15.43:0/4087322591 >> 172.21.15.43:0/4087322591 conn(0x7fdd180fd380 msgr2=0x7fdd180ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.475+0000 7fdd1d5a8640 1 -- 172.21.15.43:0/4087322591 shutdown_connections 2024-04-25T13:41:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.475+0000 7fdd1d5a8640 1 -- 172.21.15.43:0/4087322591 wait complete. 2024-04-25T13:41:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.475+0000 7fdd1d5a8640 1 Processor -- start 2024-04-25T13:41:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.475+0000 7fdd1d5a8640 1 -- start start 2024-04-25T13:41:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.475+0000 7fdd1d5a8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd18102fe0 0x7fdd18198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.475+0000 7fdd1d5a8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd18103b40 0x7fdd18199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.475+0000 7fdd1d5a8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd1819e3a0 0x7fdd181a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.475+0000 7fdd1d5a8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1810e640 con 0x7fdd18102fe0 2024-04-25T13:41:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.475+0000 7fdd1d5a8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1810e4c0 con 0x7fdd18103b40 2024-04-25T13:41:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.475+0000 7fdd1d5a8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1810e7c0 con 0x7fdd1819e3a0 2024-04-25T13:41:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.476+0000 7fdd16ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd18102fe0 0x7fdd18198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.476+0000 7fdd16ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd18102fe0 0x7fdd18198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55936/0 (socket says 172.21.15.43:55936) 2024-04-25T13:41:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.476+0000 7fdd16ffd640 1 -- 172.21.15.43:0/4291436328 learned_addr learned my addr 172.21.15.43:0/4291436328 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.476+0000 7fdd177fe640 1 --2- 172.21.15.43:0/4291436328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd1819e3a0 0x7fdd181a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.476+0000 7fdd0ffff640 1 --2- 172.21.15.43:0/4291436328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd18103b40 0x7fdd18199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.476+0000 7fdd16ffd640 1 -- 172.21.15.43:0/4291436328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd1819e3a0 msgr2=0x7fdd181a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.476+0000 7fdd16ffd640 1 --2- 172.21.15.43:0/4291436328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd1819e3a0 0x7fdd181a07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.476+0000 7fdd16ffd640 1 -- 172.21.15.43:0/4291436328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd18103b40 msgr2=0x7fdd18199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:28.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.476+0000 7fdd16ffd640 1 --2- 172.21.15.43:0/4291436328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd18103b40 0x7fdd18199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.476+0000 7fdd16ffd640 1 -- 172.21.15.43:0/4291436328 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd181a0e30 con 0x7fdd18102fe0 2024-04-25T13:41:28.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.476+0000 7fdd16ffd640 1 --2- 172.21.15.43:0/4291436328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd18102fe0 0x7fdd18198ee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdd08005760 tx=0x7fdd08003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:28.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.476+0000 7fdd14ff9640 1 -- 172.21.15.43:0/4291436328 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0803f070 con 0x7fdd18102fe0 2024-04-25T13:41:28.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.476+0000 7fdd14ff9640 1 -- 172.21.15.43:0/4291436328 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd08031ba0 con 0x7fdd18102fe0 2024-04-25T13:41:28.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.476+0000 7fdd14ff9640 1 -- 172.21.15.43:0/4291436328 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd08035030 con 0x7fdd18102fe0 2024-04-25T13:41:28.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.476+0000 7fdd1d5a8640 1 -- 172.21.15.43:0/4291436328 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd181a10c0 con 0x7fdd18102fe0 2024-04-25T13:41:28.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.476+0000 7fdd1d5a8640 1 -- 172.21.15.43:0/4291436328 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd181a15b0 con 0x7fdd18102fe0 2024-04-25T13:41:28.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.477+0000 7fdd1d5a8640 1 -- 172.21.15.43:0/4291436328 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd1806b350 con 0x7fdd18102fe0 2024-04-25T13:41:28.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.479+0000 7fdd14ff9640 1 -- 172.21.15.43:0/4291436328 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fdd08042070 con 0x7fdd18102fe0 2024-04-25T13:41:28.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.479+0000 7fdd14ff9640 1 --2- 172.21.15.43:0/4291436328 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdd040afaf0 0x7fdd040b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:28.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.480+0000 7fdd0ffff640 1 --2- 172.21.15.43:0/4291436328 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdd040afaf0 0x7fdd040b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:28.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.480+0000 7fdd14ff9640 1 -- 172.21.15.43:0/4291436328 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fdd080ff310 con 0x7fdd18102fe0 2024-04-25T13:41:28.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.480+0000 7fdd0ffff640 1 --2- 172.21.15.43:0/4291436328 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdd040afaf0 0x7fdd040b2000 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdd18199f80 tx=0x7fdd00005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:28.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.483+0000 7fdd14ff9640 1 -- 172.21.15.43:0/4291436328 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdd080c7d40 con 0x7fdd18102fe0 2024-04-25T13:41:28.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:28 smithi161 ceph-mon[32696]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi161=b;smithi161=e;smithi161=h;smithi161=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:41:28.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:28 smithi161 ceph-mon[32696]: Saving service mds.all spec with placement smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi161=b;smithi161=e;smithi161=h;smithi161=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-04-25T13:41:28.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:28.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:41:28.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:28.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:28.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:28.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:28 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:28.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.668+0000 7fdd1d5a8640 1 -- 172.21.15.43:0/4291436328 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdd1802dda0 con 0x7fdd18102fe0 2024-04-25T13:41:28.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.669+0000 7fdd14ff9640 1 -- 172.21.15.43:0/4291436328 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7fdd080cc040 con 0x7fdd18102fe0 2024-04-25T13:41:28.669 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T13:41:28.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.671+0000 7fdd1d5a8640 1 -- 172.21.15.43:0/4291436328 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdd040afaf0 msgr2=0x7fdd040b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:28.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.671+0000 7fdd1d5a8640 1 --2- 172.21.15.43:0/4291436328 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdd040afaf0 0x7fdd040b2000 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdd18199f80 tx=0x7fdd00005f90 comp rx=0 tx=0).stop 2024-04-25T13:41:28.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.671+0000 7fdd1d5a8640 1 -- 172.21.15.43:0/4291436328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd18102fe0 msgr2=0x7fdd18198ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:28.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.671+0000 7fdd1d5a8640 1 --2- 172.21.15.43:0/4291436328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd18102fe0 0x7fdd18198ee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdd08005760 tx=0x7fdd08003c10 comp rx=0 tx=0).stop 2024-04-25T13:41:28.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.671+0000 7fdd1d5a8640 1 -- 172.21.15.43:0/4291436328 shutdown_connections 2024-04-25T13:41:28.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.671+0000 7fdd1d5a8640 1 --2- 172.21.15.43:0/4291436328 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdd040afaf0 0x7fdd040b2000 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.671+0000 7fdd1d5a8640 1 --2- 172.21.15.43:0/4291436328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd1819e3a0 0x7fdd181a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.671+0000 7fdd1d5a8640 1 --2- 172.21.15.43:0/4291436328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd18103b40 0x7fdd18199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.671+0000 7fdd1d5a8640 1 --2- 172.21.15.43:0/4291436328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd18102fe0 0x7fdd18198ee0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.671+0000 7fdd1d5a8640 1 -- 172.21.15.43:0/4291436328 >> 172.21.15.43:0/4291436328 conn(0x7fdd180fd380 msgr2=0x7fdd180ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:28.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.671+0000 7fdd1d5a8640 1 -- 172.21.15.43:0/4291436328 shutdown_connections 2024-04-25T13:41:28.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.671+0000 7fdd1d5a8640 1 -- 172.21.15.43:0/4291436328 wait complete. 2024-04-25T13:41:28.682 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:28.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.793+0000 7f784d196640 1 -- 172.21.15.43:0/3813110545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78481045f0 msgr2=0x7f7848106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:28.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.793+0000 7f784d196640 1 --2- 172.21.15.43:0/3813110545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78481045f0 0x7f7848106a10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7838009ca0 tx=0x7f783802a8c0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.793+0000 7f784d196640 1 -- 172.21.15.43:0/3813110545 shutdown_connections 2024-04-25T13:41:28.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.793+0000 7f784d196640 1 --2- 172.21.15.43:0/3813110545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78481098b0 0x7f784810bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.793+0000 7f784d196640 1 --2- 172.21.15.43:0/3813110545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7848106f50 0x7f7848109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.793+0000 7f784d196640 1 --2- 172.21.15.43:0/3813110545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78481045f0 0x7f7848106a10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.793+0000 7f784d196640 1 -- 172.21.15.43:0/3813110545 >> 172.21.15.43:0/3813110545 conn(0x7f78480fdbf0 msgr2=0x7f78481000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:28.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.793+0000 7f784d196640 1 -- 172.21.15.43:0/3813110545 shutdown_connections 2024-04-25T13:41:28.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.793+0000 7f784d196640 1 -- 172.21.15.43:0/3813110545 wait complete. 2024-04-25T13:41:28.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.794+0000 7f784d196640 1 Processor -- start 2024-04-25T13:41:28.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.794+0000 7f784d196640 1 -- start start 2024-04-25T13:41:28.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.794+0000 7f784d196640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78481045f0 0x7f7848103a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:28.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.794+0000 7f784d196640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7848106f50 0x7f78481020e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:28.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.794+0000 7f784d196640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78481098b0 0x7f7848102620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:28.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.794+0000 7f784d196640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f784810f500 con 0x7f7848106f50 2024-04-25T13:41:28.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.794+0000 7f784d196640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f784810f380 con 0x7f78481045f0 2024-04-25T13:41:28.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.794+0000 7f784d196640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f784810f680 con 0x7f78481098b0 2024-04-25T13:41:28.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.794+0000 7f784659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7848106f50 0x7f78481020e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:28.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.794+0000 7f784659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7848106f50 0x7f78481020e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55958/0 (socket says 172.21.15.43:55958) 2024-04-25T13:41:28.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.794+0000 7f784659c640 1 -- 172.21.15.43:0/3025360161 learned_addr learned my addr 172.21.15.43:0/3025360161 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:28.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.794+0000 7f784759e640 1 --2- 172.21.15.43:0/3025360161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78481098b0 0x7f7848102620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:28.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.794+0000 7f7846d9d640 1 --2- 172.21.15.43:0/3025360161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78481045f0 0x7f7848103a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:28.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.794+0000 7f784659c640 1 -- 172.21.15.43:0/3025360161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78481098b0 msgr2=0x7f7848102620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:28.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.794+0000 7f784659c640 1 --2- 172.21.15.43:0/3025360161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78481098b0 0x7f7848102620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.795+0000 7f784659c640 1 -- 172.21.15.43:0/3025360161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78481045f0 msgr2=0x7f7848103a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:28.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.795+0000 7f784659c640 1 --2- 172.21.15.43:0/3025360161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78481045f0 0x7f7848103a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:28.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.795+0000 7f784659c640 1 -- 172.21.15.43:0/3025360161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7848102d50 con 0x7f7848106f50 2024-04-25T13:41:28.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.795+0000 7f784659c640 1 --2- 172.21.15.43:0/3025360161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7848106f50 0x7f78481020e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f783000e9f0 tx=0x7f783000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:28.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.795+0000 7f783ffff640 1 -- 172.21.15.43:0/3025360161 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783000cd80 con 0x7f7848106f50 2024-04-25T13:41:28.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.795+0000 7f783ffff640 1 -- 172.21.15.43:0/3025360161 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78300108c0 con 0x7f7848106f50 2024-04-25T13:41:28.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.795+0000 7f784d196640 1 -- 172.21.15.43:0/3025360161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78481a4200 con 0x7f7848106f50 2024-04-25T13:41:28.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.795+0000 7f783ffff640 1 -- 172.21.15.43:0/3025360161 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78300187c0 con 0x7f7848106f50 2024-04-25T13:41:28.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.795+0000 7f784d196640 1 -- 172.21.15.43:0/3025360161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78481a46c0 con 0x7f7848106f50 2024-04-25T13:41:28.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.796+0000 7f784d196640 1 -- 172.21.15.43:0/3025360161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f784806a190 con 0x7f7848106f50 2024-04-25T13:41:28.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.797+0000 7f783ffff640 1 -- 172.21.15.43:0/3025360161 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f7830010430 con 0x7f7848106f50 2024-04-25T13:41:28.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.798+0000 7f783ffff640 1 --2- 172.21.15.43:0/3025360161 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f78340afaf0 0x7f78340b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:28.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.798+0000 7f7846d9d640 1 --2- 172.21.15.43:0/3025360161 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f78340afaf0 0x7f78340b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:28.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.798+0000 7f783ffff640 1 -- 172.21.15.43:0/3025360161 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f78300df040 con 0x7f7848106f50 2024-04-25T13:41:28.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.799+0000 7f7846d9d640 1 --2- 172.21.15.43:0/3025360161 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f78340afaf0 0x7f78340b2000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7838000f80 tx=0x7f78380318e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:28.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:28.801+0000 7f783ffff640 1 -- 172.21.15.43:0/3025360161 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f78300a79d0 con 0x7f7848106f50 2024-04-25T13:41:29.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:29.028+0000 7f784d196640 1 -- 172.21.15.43:0/3025360161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f784802dec0 con 0x7f7848106f50 2024-04-25T13:41:29.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:29.028+0000 7f783ffff640 1 -- 172.21.15.43:0/3025360161 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f78300abcd0 con 0x7f7848106f50 2024-04-25T13:41:29.028 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:41:29.029 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-25T13:41:29.029 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 1 2024-04-25T13:41:29.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:29.030+0000 7f784d196640 1 -- 172.21.15.43:0/3025360161 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f78340afaf0 msgr2=0x7f78340b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:29.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:29.030+0000 7f784d196640 1 --2- 172.21.15.43:0/3025360161 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f78340afaf0 0x7f78340b2000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7838000f80 tx=0x7f78380318e0 comp rx=0 tx=0).stop 2024-04-25T13:41:29.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:29.030+0000 7f784d196640 1 -- 172.21.15.43:0/3025360161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7848106f50 msgr2=0x7f78481020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:29.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:29.030+0000 7f784d196640 1 --2- 172.21.15.43:0/3025360161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7848106f50 0x7f78481020e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f783000e9f0 tx=0x7f783000eeb0 comp rx=0 tx=0).stop 2024-04-25T13:41:29.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:29.030+0000 7f784d196640 1 -- 172.21.15.43:0/3025360161 shutdown_connections 2024-04-25T13:41:29.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:29.030+0000 7f784d196640 1 --2- 172.21.15.43:0/3025360161 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f78340afaf0 0x7f78340b2000 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:29.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:29.030+0000 7f784d196640 1 --2- 172.21.15.43:0/3025360161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78481098b0 0x7f7848102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:29.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:29.030+0000 7f784d196640 1 --2- 172.21.15.43:0/3025360161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7848106f50 0x7f78481020e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:29.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:29.030+0000 7f784d196640 1 --2- 172.21.15.43:0/3025360161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78481045f0 0x7f7848103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:29.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:29.030+0000 7f784d196640 1 -- 172.21.15.43:0/3025360161 >> 172.21.15.43:0/3025360161 conn(0x7f78480fdbf0 msgr2=0x7f7848105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:29.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:29.031+0000 7f784d196640 1 -- 172.21.15.43:0/3025360161 shutdown_connections 2024-04-25T13:41:29.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:29.031+0000 7f784d196640 1 -- 172.21.15.43:0/3025360161 wait complete. 2024-04-25T13:41:29.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:29 smithi175 ceph-mon[32649]: Deploying daemon mds.l on smithi175 2024-04-25T13:41:29.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:29 smithi175 ceph-mon[32649]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:29.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:29 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2010793599' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:41:29.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:29 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/4291436328' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:41:29.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:29 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3025360161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:29.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:29 smithi043 ceph-mon[29195]: Deploying daemon mds.l on smithi175 2024-04-25T13:41:29.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:29 smithi043 ceph-mon[29195]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:29.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:29 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2010793599' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:41:29.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:29 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/4291436328' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:41:29.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:29 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3025360161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:29.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:29 smithi161 ceph-mon[32696]: Deploying daemon mds.l on smithi175 2024-04-25T13:41:29.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:29 smithi161 ceph-mon[32696]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:29.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:29 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2010793599' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:41:29.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:29 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/4291436328' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:41:29.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:29 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3025360161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:30.181 INFO:journalctl@ceph.mds.l.smithi175.stdout:Apr 25 13:41:30 smithi175 systemd[1]: Starting Ceph mds.l for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:41:30.525 INFO:journalctl@ceph.mds.l.smithi175.stdout:Apr 25 13:41:30 smithi175 podman[62175]: 2024-04-25 13:41:30.131318164 +0000 UTC m=+0.018433413 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:41:30.526 INFO:journalctl@ceph.mds.l.smithi175.stdout:Apr 25 13:41:30 smithi175 podman[62175]: 2024-04-25 13:41:30.274055684 +0000 UTC m=+0.161170929 container create 74aee067583211b81c4bd41959843b0954ed39fea974aa41482dc123a8413083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-25T13:41:30.526 INFO:journalctl@ceph.mds.l.smithi175.stdout:Apr 25 13:41:30 smithi175 podman[62175]: 2024-04-25 13:41:30.526665308 +0000 UTC m=+0.413780548 container init 74aee067583211b81c4bd41959843b0954ed39fea974aa41482dc123a8413083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5) 2024-04-25T13:41:30.930 INFO:journalctl@ceph.mds.l.smithi175.stdout:Apr 25 13:41:30 smithi175 podman[62175]: 2024-04-25 13:41:30.529239937 +0000 UTC m=+0.416355176 container start 74aee067583211b81c4bd41959843b0954ed39fea974aa41482dc123a8413083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-l, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS) 2024-04-25T13:41:30.930 INFO:journalctl@ceph.mds.l.smithi175.stdout:Apr 25 13:41:30 smithi175 ceph-mds[62194]: -- 172.21.15.175:0/1393685990 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5575d9601a40 con 0x5575d9649600 2024-04-25T13:41:30.930 INFO:journalctl@ceph.mds.l.smithi175.stdout:Apr 25 13:41:30 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-l[62190]: starting mds.l at 2024-04-25T13:41:30.930 INFO:journalctl@ceph.mds.l.smithi175.stdout:Apr 25 13:41:30 smithi175 bash[62175]: 74aee067583211b81c4bd41959843b0954ed39fea974aa41482dc123a8413083 2024-04-25T13:41:30.931 INFO:journalctl@ceph.mds.l.smithi175.stdout:Apr 25 13:41:30 smithi175 systemd[1]: Started Ceph mds.l for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:41:31.043 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:31.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.165+0000 7fb66f7ab640 1 -- 172.21.15.43:0/2628009952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb668104d40 msgr2=0x7fb668105150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:31.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.165+0000 7fb66f7ab640 1 --2- 172.21.15.43:0/2628009952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb668104d40 0x7fb668105150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb65c009900 tx=0x7fb65c02a410 comp rx=0 tx=0).stop 2024-04-25T13:41:31.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.165+0000 7fb66f7ab640 1 -- 172.21.15.43:0/2628009952 shutdown_connections 2024-04-25T13:41:31.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.165+0000 7fb66f7ab640 1 --2- 172.21.15.43:0/2628009952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb668109a40 0x7fb66810be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:31.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.165+0000 7fb66f7ab640 1 --2- 172.21.15.43:0/2628009952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb668104d40 0x7fb668105150 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:31.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.165+0000 7fb66f7ab640 1 --2- 172.21.15.43:0/2628009952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb668103b00 0x7fb668104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:31.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.165+0000 7fb66f7ab640 1 -- 172.21.15.43:0/2628009952 >> 172.21.15.43:0/2628009952 conn(0x7fb6680fed10 msgr2=0x7fb6681011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:31.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.165+0000 7fb66f7ab640 1 -- 172.21.15.43:0/2628009952 shutdown_connections 2024-04-25T13:41:31.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.165+0000 7fb66f7ab640 1 -- 172.21.15.43:0/2628009952 wait complete. 2024-04-25T13:41:31.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.166+0000 7fb66f7ab640 1 Processor -- start 2024-04-25T13:41:31.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.166+0000 7fb66f7ab640 1 -- start start 2024-04-25T13:41:31.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.166+0000 7fb66f7ab640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb668103b00 0x7fb66819a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:31.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.166+0000 7fb66f7ab640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb668104d40 0x7fb66819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:31.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.166+0000 7fb66f7ab640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb668109a40 0x7fb6681a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:31.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.166+0000 7fb66f7ab640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb66810f4b0 con 0x7fb668109a40 2024-04-25T13:41:31.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.166+0000 7fb66f7ab640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fb66810f330 con 0x7fb668104d40 2024-04-25T13:41:31.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.166+0000 7fb66f7ab640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb66810f630 con 0x7fb668103b00 2024-04-25T13:41:31.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.166+0000 7fb66dd48640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb668109a40 0x7fb6681a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:31.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.166+0000 7fb66dd48640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb668109a40 0x7fb6681a1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40278/0 (socket says 172.21.15.43:40278) 2024-04-25T13:41:31.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.166+0000 7fb66dd48640 1 -- 172.21.15.43:0/621388954 learned_addr learned my addr 172.21.15.43:0/621388954 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:31.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.166+0000 7fb66cd46640 1 --2- 172.21.15.43:0/621388954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb668104d40 0x7fb66819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:31.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.167+0000 7fb66d547640 1 --2- 172.21.15.43:0/621388954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb668103b00 0x7fb66819a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:31.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.167+0000 7fb66dd48640 1 -- 172.21.15.43:0/621388954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb668103b00 msgr2=0x7fb66819a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:31.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.167+0000 7fb66dd48640 1 --2- 172.21.15.43:0/621388954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb668103b00 0x7fb66819a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:31.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.167+0000 7fb66dd48640 1 -- 172.21.15.43:0/621388954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb668104d40 msgr2=0x7fb66819a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:31.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.167+0000 7fb66dd48640 1 --2- 172.21.15.43:0/621388954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb668104d40 0x7fb66819a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:31.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.167+0000 7fb66dd48640 1 -- 172.21.15.43:0/621388954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6681a1cb0 con 0x7fb668109a40 2024-04-25T13:41:31.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.167+0000 7fb66cd46640 1 --2- 172.21.15.43:0/621388954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb668104d40 0x7fb66819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:41:31.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.167+0000 7fb66dd48640 1 --2- 172.21.15.43:0/621388954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb668109a40 0x7fb6681a1640 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb65800eb10 tx=0x7fb65800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:31.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.167+0000 7fb6667fc640 1 -- 172.21.15.43:0/621388954 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb658004b20 con 0x7fb668109a40 2024-04-25T13:41:31.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.167+0000 7fb6667fc640 1 -- 172.21.15.43:0/621388954 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb658004cc0 con 0x7fb668109a40 2024-04-25T13:41:31.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.167+0000 7fb66f7ab640 1 -- 172.21.15.43:0/621388954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6681a1fa0 con 0x7fb668109a40 2024-04-25T13:41:31.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.167+0000 7fb6667fc640 1 -- 172.21.15.43:0/621388954 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb658010690 con 0x7fb668109a40 2024-04-25T13:41:31.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.167+0000 7fb66f7ab640 1 -- 172.21.15.43:0/621388954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6681a2400 con 0x7fb668109a40 2024-04-25T13:41:31.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.168+0000 7fb66f7ab640 1 -- 172.21.15.43:0/621388954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb66806a1c0 con 0x7fb668109a40 2024-04-25T13:41:31.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.170+0000 7fb6667fc640 1 -- 172.21.15.43:0/621388954 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fb658005020 con 0x7fb668109a40 2024-04-25T13:41:31.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.170+0000 7fb6667fc640 1 --2- 172.21.15.43:0/621388954 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb6500afaf0 0x7fb6500b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:31.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.171+0000 7fb66d547640 1 --2- 172.21.15.43:0/621388954 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb6500afaf0 0x7fb6500b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:31.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.171+0000 7fb6667fc640 1 -- 172.21.15.43:0/621388954 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fb6580dee30 con 0x7fb668109a40 2024-04-25T13:41:31.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.171+0000 7fb66d547640 1 --2- 172.21.15.43:0/621388954 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb6500afaf0 0x7fb6500b2000 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb660005fd0 tx=0x7fb660005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:31.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.175+0000 7fb6667fc640 1 -- 172.21.15.43:0/621388954 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb66806a1c0 con 0x7fb668109a40 2024-04-25T13:41:31.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.401+0000 7fb66f7ab640 1 -- 172.21.15.43:0/621388954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6680637d0 con 0x7fb668109a40 2024-04-25T13:41:31.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.402+0000 7fb6667fc640 1 -- 172.21.15.43:0/621388954 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7fb6580a7e10 con 0x7fb668109a40 2024-04-25T13:41:31.402 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:41:31.402 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T13:41:31.402 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 2 2024-04-25T13:41:31.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.404+0000 7fb66f7ab640 1 -- 172.21.15.43:0/621388954 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb6500afaf0 msgr2=0x7fb6500b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:31.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.404+0000 7fb66f7ab640 1 --2- 172.21.15.43:0/621388954 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb6500afaf0 0x7fb6500b2000 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb660005fd0 tx=0x7fb660005850 comp rx=0 tx=0).stop 2024-04-25T13:41:31.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.404+0000 7fb66f7ab640 1 -- 172.21.15.43:0/621388954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb668109a40 msgr2=0x7fb6681a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:31.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.404+0000 7fb66f7ab640 1 --2- 172.21.15.43:0/621388954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb668109a40 0x7fb6681a1640 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb65800eb10 tx=0x7fb65800c2d0 comp rx=0 tx=0).stop 2024-04-25T13:41:31.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.404+0000 7fb66f7ab640 1 -- 172.21.15.43:0/621388954 shutdown_connections 2024-04-25T13:41:31.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.404+0000 7fb66f7ab640 1 --2- 172.21.15.43:0/621388954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb668109a40 0x7fb6681a1640 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:31.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.404+0000 7fb66f7ab640 1 --2- 172.21.15.43:0/621388954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb668104d40 0x7fb66819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:31.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.404+0000 7fb66f7ab640 1 --2- 172.21.15.43:0/621388954 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb6500afaf0 0x7fb6500b2000 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:31.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.404+0000 7fb66f7ab640 1 --2- 172.21.15.43:0/621388954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb668103b00 0x7fb66819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:31.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.404+0000 7fb66f7ab640 1 -- 172.21.15.43:0/621388954 >> 172.21.15.43:0/621388954 conn(0x7fb6680fed10 msgr2=0x7fb668105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:31.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.404+0000 7fb66f7ab640 1 -- 172.21.15.43:0/621388954 shutdown_connections 2024-04-25T13:41:31.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:31.404+0000 7fb66f7ab640 1 -- 172.21.15.43:0/621388954 wait complete. 2024-04-25T13:41:31.666 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:31 smithi161 ceph-mon[32696]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:31.666 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:31 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.175:6832/2054284229,v1:172.21.15.175:6833/2054284229] up:boot 2024-04-25T13:41:31.666 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:31 smithi161 ceph-mon[32696]: fsmap 1 up:standby 2024-04-25T13:41:31.666 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:31 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T13:41:31.666 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:31 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:31.666 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:31 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:31.666 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:31 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:31.667 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:31 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:31.667 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:31 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:31.667 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:31 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:31.667 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:31 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/621388954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:31.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:31 smithi043 ceph-mon[29195]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:31.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:31 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.175:6832/2054284229,v1:172.21.15.175:6833/2054284229] up:boot 2024-04-25T13:41:31.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:31 smithi043 ceph-mon[29195]: fsmap 1 up:standby 2024-04-25T13:41:31.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:31 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T13:41:31.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:31 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:31.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:31 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:31.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:31 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:31.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:31 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:31.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:31 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:31.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:31 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:31.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:31 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/621388954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:31.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:31 smithi175 ceph-mon[32649]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:31.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:31 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.175:6832/2054284229,v1:172.21.15.175:6833/2054284229] up:boot 2024-04-25T13:41:31.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:31 smithi175 ceph-mon[32649]: fsmap 1 up:standby 2024-04-25T13:41:31.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:31 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T13:41:31.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:31 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:31.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:31 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:31.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:31 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:31.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:31 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:31.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:31 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:31.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:31 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:31.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:31 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/621388954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:32.772 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:32 smithi161 ceph-mon[32696]: Deploying daemon mds.k on smithi161 2024-04-25T13:41:32.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:32 smithi175 ceph-mon[32649]: Deploying daemon mds.k on smithi161 2024-04-25T13:41:32.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:32 smithi043 ceph-mon[29195]: Deploying daemon mds.k on smithi161 2024-04-25T13:41:33.416 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:33.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.543+0000 7fbcf3851640 1 -- 172.21.15.43:0/1367400617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcec104d40 msgr2=0x7fbcec105150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:33.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.543+0000 7fbcf3851640 1 --2- 172.21.15.43:0/1367400617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcec104d40 0x7fbcec105150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009900 tx=0x7fbcdc02a410 comp rx=0 tx=0).stop 2024-04-25T13:41:33.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.543+0000 7fbcf3851640 1 -- 172.21.15.43:0/1367400617 shutdown_connections 2024-04-25T13:41:33.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.543+0000 7fbcf3851640 1 --2- 172.21.15.43:0/1367400617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcec109a40 0x7fbcec10be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:33.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.543+0000 7fbcf3851640 1 --2- 172.21.15.43:0/1367400617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcec104d40 0x7fbcec105150 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:33.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.543+0000 7fbcf3851640 1 --2- 172.21.15.43:0/1367400617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcec103b00 0x7fbcec104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:33.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.543+0000 7fbcf3851640 1 -- 172.21.15.43:0/1367400617 >> 172.21.15.43:0/1367400617 conn(0x7fbcec0fed10 msgr2=0x7fbcec1011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:33.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.543+0000 7fbcf3851640 1 -- 172.21.15.43:0/1367400617 shutdown_connections 2024-04-25T13:41:33.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.543+0000 7fbcf3851640 1 -- 172.21.15.43:0/1367400617 wait complete. 2024-04-25T13:41:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf3851640 1 Processor -- start 2024-04-25T13:41:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf3851640 1 -- start start 2024-04-25T13:41:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf3851640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcec103b00 0x7fbcec077960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf3851640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcec104d40 0x7fbcec076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf3851640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcec109a40 0x7fbcec076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf3851640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec10f4b0 con 0x7fbcec103b00 2024-04-25T13:41:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf3851640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec10f330 con 0x7fbcec109a40 2024-04-25T13:41:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf3851640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec10f630 con 0x7fbcec104d40 2024-04-25T13:41:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf15ed640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcec103b00 0x7fbcec077960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf15ed640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcec103b00 0x7fbcec077960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40288/0 (socket says 172.21.15.43:40288) 2024-04-25T13:41:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf15ed640 1 -- 172.21.15.43:0/1001401027 learned_addr learned my addr 172.21.15.43:0/1001401027 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf1dee640 1 --2- 172.21.15.43:0/1001401027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcec109a40 0x7fbcec076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf0dec640 1 --2- 172.21.15.43:0/1001401027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcec104d40 0x7fbcec076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:33.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf15ed640 1 -- 172.21.15.43:0/1001401027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcec104d40 msgr2=0x7fbcec076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:33.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf15ed640 1 --2- 172.21.15.43:0/1001401027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcec104d40 0x7fbcec076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:33.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf15ed640 1 -- 172.21.15.43:0/1001401027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcec109a40 msgr2=0x7fbcec076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:33.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf15ed640 1 --2- 172.21.15.43:0/1001401027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcec109a40 0x7fbcec076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:33.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf15ed640 1 -- 172.21.15.43:0/1001401027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcec076c70 con 0x7fbcec103b00 2024-04-25T13:41:33.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.544+0000 7fbcf15ed640 1 --2- 172.21.15.43:0/1001401027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcec103b00 0x7fbcec077960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbce800c970 tx=0x7fbce800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:33.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.545+0000 7fbce27fc640 1 -- 172.21.15.43:0/1001401027 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8004220 con 0x7fbcec103b00 2024-04-25T13:41:33.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.545+0000 7fbcf3851640 1 -- 172.21.15.43:0/1001401027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcec1a41b0 con 0x7fbcec103b00 2024-04-25T13:41:33.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.545+0000 7fbce27fc640 1 -- 172.21.15.43:0/1001401027 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbce8007e40 con 0x7fbcec103b00 2024-04-25T13:41:33.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.545+0000 7fbce27fc640 1 -- 172.21.15.43:0/1001401027 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce800f450 con 0x7fbcec103b00 2024-04-25T13:41:33.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.545+0000 7fbcf3851640 1 -- 172.21.15.43:0/1001401027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcec1a4670 con 0x7fbcec103b00 2024-04-25T13:41:33.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.546+0000 7fbcf3851640 1 -- 172.21.15.43:0/1001401027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcec06a190 con 0x7fbcec103b00 2024-04-25T13:41:33.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.548+0000 7fbce27fc640 1 -- 172.21.15.43:0/1001401027 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fbce80079b0 con 0x7fbcec103b00 2024-04-25T13:41:33.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.549+0000 7fbce27fc640 1 --2- 172.21.15.43:0/1001401027 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbcd80afaf0 0x7fbcd80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:33.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.549+0000 7fbcf0dec640 1 --2- 172.21.15.43:0/1001401027 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbcd80afaf0 0x7fbcd80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:33.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.549+0000 7fbce27fc640 1 -- 172.21.15.43:0/1001401027 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fbce80de810 con 0x7fbcec103b00 2024-04-25T13:41:33.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.549+0000 7fbcf0dec640 1 --2- 172.21.15.43:0/1001401027 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbcd80afaf0 0x7fbcd80b2000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbcec077300 tx=0x7fbcdc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:33.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.553+0000 7fbce27fc640 1 -- 172.21.15.43:0/1001401027 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbce8014030 con 0x7fbcec103b00 2024-04-25T13:41:33.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:33 smithi043 ceph-mon[29195]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:33.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.780+0000 7fbcf3851640 1 -- 172.21.15.43:0/1001401027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcec108850 con 0x7fbcec103b00 2024-04-25T13:41:33.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.780+0000 7fbce27fc640 1 -- 172.21.15.43:0/1001401027 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7fbce80a71a0 con 0x7fbcec103b00 2024-04-25T13:41:33.781 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:41:33.781 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T13:41:33.781 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 2 2024-04-25T13:41:33.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.783+0000 7fbcf3851640 1 -- 172.21.15.43:0/1001401027 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbcd80afaf0 msgr2=0x7fbcd80b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:33.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.783+0000 7fbcf3851640 1 --2- 172.21.15.43:0/1001401027 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbcd80afaf0 0x7fbcd80b2000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbcec077300 tx=0x7fbcdc000bc0 comp rx=0 tx=0).stop 2024-04-25T13:41:33.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.783+0000 7fbcf3851640 1 -- 172.21.15.43:0/1001401027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcec103b00 msgr2=0x7fbcec077960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:33.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.783+0000 7fbcf3851640 1 --2- 172.21.15.43:0/1001401027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcec103b00 0x7fbcec077960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbce800c970 tx=0x7fbce800ce30 comp rx=0 tx=0).stop 2024-04-25T13:41:33.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.783+0000 7fbcf3851640 1 -- 172.21.15.43:0/1001401027 shutdown_connections 2024-04-25T13:41:33.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.783+0000 7fbcf3851640 1 --2- 172.21.15.43:0/1001401027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcec109a40 0x7fbcec076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:33.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.783+0000 7fbcf3851640 1 --2- 172.21.15.43:0/1001401027 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbcd80afaf0 0x7fbcd80b2000 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:33.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.783+0000 7fbcf3851640 1 --2- 172.21.15.43:0/1001401027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcec104d40 0x7fbcec076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:33.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.783+0000 7fbcf3851640 1 --2- 172.21.15.43:0/1001401027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcec103b00 0x7fbcec077960 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:33.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.783+0000 7fbcf3851640 1 -- 172.21.15.43:0/1001401027 >> 172.21.15.43:0/1001401027 conn(0x7fbcec0fed10 msgr2=0x7fbcec105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:33.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.783+0000 7fbcf3851640 1 -- 172.21.15.43:0/1001401027 shutdown_connections 2024-04-25T13:41:33.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:33.783+0000 7fbcf3851640 1 -- 172.21.15.43:0/1001401027 wait complete. 2024-04-25T13:41:33.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:33 smithi161 ceph-mon[32696]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:33.853 INFO:journalctl@ceph.mds.k.smithi161.stdout:Apr 25 13:41:33 smithi161 systemd[1]: Started Ceph mds.k for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:41:33.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:33 smithi175 ceph-mon[32649]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:35.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:34 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:35.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:34 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:35.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:34 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1001401027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:35.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:34 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:35.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:34 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:35.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:34 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:35.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:34 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:35.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:34 smithi161 ceph-mon[32696]: Deploying daemon mds.j on smithi043 2024-04-25T13:41:35.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:34 smithi161 ceph-mon[32696]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:35.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:34 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.161:6832/519829901,v1:172.21.15.161:6833/519829901] up:boot 2024-04-25T13:41:35.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:34 smithi161 ceph-mon[32696]: fsmap 2 up:standby 2024-04-25T13:41:35.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:34 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T13:41:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:34 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:34 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:34 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1001401027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:34 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:34 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:34 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:34 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:34 smithi175 ceph-mon[32649]: Deploying daemon mds.j on smithi043 2024-04-25T13:41:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:34 smithi175 ceph-mon[32649]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:34 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.161:6832/519829901,v1:172.21.15.161:6833/519829901] up:boot 2024-04-25T13:41:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:34 smithi175 ceph-mon[32649]: fsmap 2 up:standby 2024-04-25T13:41:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:34 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T13:41:35.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:34 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:35.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:34 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:35.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:34 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1001401027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:35.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:34 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:35.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:34 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:35.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:34 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:35.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:34 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:35.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:34 smithi043 ceph-mon[29195]: Deploying daemon mds.j on smithi043 2024-04-25T13:41:35.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:34 smithi043 ceph-mon[29195]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:35.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:34 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.161:6832/519829901,v1:172.21.15.161:6833/519829901] up:boot 2024-04-25T13:41:35.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:34 smithi043 ceph-mon[29195]: fsmap 2 up:standby 2024-04-25T13:41:35.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:34 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T13:41:35.796 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:36.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.062+0000 7fc1a73a8640 1 -- 172.21.15.43:0/1905962804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1a01029e0 msgr2=0x7fc1a01036e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:36.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.062+0000 7fc1a73a8640 1 --2- 172.21.15.43:0/1905962804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1a01029e0 0x7fc1a01036e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009900 tx=0x7fc19c02a410 comp rx=0 tx=0).stop 2024-04-25T13:41:36.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.063+0000 7fc1a73a8640 1 -- 172.21.15.43:0/1905962804 shutdown_connections 2024-04-25T13:41:36.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.063+0000 7fc1a73a8640 1 --2- 172.21.15.43:0/1905962804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1a0108920 0x7fc1a010ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:36.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.063+0000 7fc1a73a8640 1 --2- 172.21.15.43:0/1905962804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1a0103c20 0x7fc1a0104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:36.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.063+0000 7fc1a73a8640 1 --2- 172.21.15.43:0/1905962804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1a01029e0 0x7fc1a01036e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:36.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.063+0000 7fc1a73a8640 1 -- 172.21.15.43:0/1905962804 >> 172.21.15.43:0/1905962804 conn(0x7fc1a00fdbd0 msgr2=0x7fc1a0100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:36.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.063+0000 7fc1a73a8640 1 -- 172.21.15.43:0/1905962804 shutdown_connections 2024-04-25T13:41:36.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.063+0000 7fc1a73a8640 1 -- 172.21.15.43:0/1905962804 wait complete. 2024-04-25T13:41:36.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a73a8640 1 Processor -- start 2024-04-25T13:41:36.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a73a8640 1 -- start start 2024-04-25T13:41:36.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a73a8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1a01029e0 0x7fc1a019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:36.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a73a8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1a0103c20 0x7fc1a019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:36.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a73a8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1a0108920 0x7fc1a01a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:36.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a73a8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a010f4c0 con 0x7fc1a0108920 2024-04-25T13:41:36.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a73a8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a010f340 con 0x7fc1a0103c20 2024-04-25T13:41:36.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a73a8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a010f640 con 0x7fc1a01029e0 2024-04-25T13:41:36.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a5945640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1a0108920 0x7fc1a01a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:36.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a5945640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1a0108920 0x7fc1a01a1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40306/0 (socket says 172.21.15.43:40306) 2024-04-25T13:41:36.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a5945640 1 -- 172.21.15.43:0/63768364 learned_addr learned my addr 172.21.15.43:0/63768364 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:36.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a4943640 1 --2- 172.21.15.43:0/63768364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1a0103c20 0x7fc1a019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:36.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a5144640 1 --2- 172.21.15.43:0/63768364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1a01029e0 0x7fc1a019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:36.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a5945640 1 -- 172.21.15.43:0/63768364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1a01029e0 msgr2=0x7fc1a019a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:36.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a5945640 1 --2- 172.21.15.43:0/63768364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1a01029e0 0x7fc1a019a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:36.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a5945640 1 -- 172.21.15.43:0/63768364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1a0103c20 msgr2=0x7fc1a019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:36.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.064+0000 7fc1a5945640 1 --2- 172.21.15.43:0/63768364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1a0103c20 0x7fc1a019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:36.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.065+0000 7fc1a5945640 1 -- 172.21.15.43:0/63768364 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a01a1c70 con 0x7fc1a0108920 2024-04-25T13:41:36.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.065+0000 7fc1a4943640 1 --2- 172.21.15.43:0/63768364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1a0103c20 0x7fc1a019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:41:36.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.065+0000 7fc1a5945640 1 --2- 172.21.15.43:0/63768364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1a0108920 0x7fc1a01a1600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc19800eb10 tx=0x7fc19800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:36.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.065+0000 7fc1967fc640 1 -- 172.21.15.43:0/63768364 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc198004b20 con 0x7fc1a0108920 2024-04-25T13:41:36.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.065+0000 7fc1967fc640 1 -- 172.21.15.43:0/63768364 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc198004cc0 con 0x7fc1a0108920 2024-04-25T13:41:36.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.065+0000 7fc1967fc640 1 -- 172.21.15.43:0/63768364 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc198010690 con 0x7fc1a0108920 2024-04-25T13:41:36.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.065+0000 7fc1a73a8640 1 -- 172.21.15.43:0/63768364 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a01a1f60 con 0x7fc1a0108920 2024-04-25T13:41:36.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.065+0000 7fc1a73a8640 1 -- 172.21.15.43:0/63768364 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a01a2370 con 0x7fc1a0108920 2024-04-25T13:41:36.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.066+0000 7fc1a73a8640 1 -- 172.21.15.43:0/63768364 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a0107730 con 0x7fc1a0108920 2024-04-25T13:41:36.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.068+0000 7fc1967fc640 1 -- 172.21.15.43:0/63768364 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fc198005000 con 0x7fc1a0108920 2024-04-25T13:41:36.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.069+0000 7fc1967fc640 1 --2- 172.21.15.43:0/63768364 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc18c0afaf0 0x7fc18c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:36.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.069+0000 7fc1967fc640 1 -- 172.21.15.43:0/63768364 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fc1980df020 con 0x7fc1a0108920 2024-04-25T13:41:36.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.069+0000 7fc1a5144640 1 --2- 172.21.15.43:0/63768364 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc18c0afaf0 0x7fc18c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:36.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.070+0000 7fc1a5144640 1 --2- 172.21.15.43:0/63768364 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc18c0afaf0 0x7fc18c0b2000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009230 tx=0x7fc19c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:36.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.072+0000 7fc1967fc640 1 -- 172.21.15.43:0/63768364 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc198053ff0 con 0x7fc1a0108920 2024-04-25T13:41:36.212 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 13:41:35 smithi043 systemd[1]: Starting Ceph mds.j for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:41:36.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.304+0000 7fc1a73a8640 1 -- 172.21.15.43:0/63768364 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1a002db50 con 0x7fc1a0108920 2024-04-25T13:41:36.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.304+0000 7fc1967fc640 1 -- 172.21.15.43:0/63768364 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7fc1980a8000 con 0x7fc1a0108920 2024-04-25T13:41:36.304 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:41:36.304 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T13:41:36.305 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 3 2024-04-25T13:41:36.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.306+0000 7fc1a73a8640 1 -- 172.21.15.43:0/63768364 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc18c0afaf0 msgr2=0x7fc18c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:36.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.306+0000 7fc1a73a8640 1 --2- 172.21.15.43:0/63768364 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc18c0afaf0 0x7fc18c0b2000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009230 tx=0x7fc19c005a20 comp rx=0 tx=0).stop 2024-04-25T13:41:36.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.306+0000 7fc1a73a8640 1 -- 172.21.15.43:0/63768364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1a0108920 msgr2=0x7fc1a01a1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:36.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.306+0000 7fc1a73a8640 1 --2- 172.21.15.43:0/63768364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1a0108920 0x7fc1a01a1600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc19800eb10 tx=0x7fc19800c2d0 comp rx=0 tx=0).stop 2024-04-25T13:41:36.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.306+0000 7fc1a73a8640 1 -- 172.21.15.43:0/63768364 shutdown_connections 2024-04-25T13:41:36.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.306+0000 7fc1a73a8640 1 --2- 172.21.15.43:0/63768364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1a0108920 0x7fc1a01a1600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:36.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.306+0000 7fc1a73a8640 1 --2- 172.21.15.43:0/63768364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1a0103c20 0x7fc1a019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:36.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.306+0000 7fc1a73a8640 1 --2- 172.21.15.43:0/63768364 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc18c0afaf0 0x7fc18c0b2000 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:36.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.306+0000 7fc1a73a8640 1 --2- 172.21.15.43:0/63768364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1a01029e0 0x7fc1a019a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:36.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.306+0000 7fc1a73a8640 1 -- 172.21.15.43:0/63768364 >> 172.21.15.43:0/63768364 conn(0x7fc1a00fdbd0 msgr2=0x7fc1a0104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:36.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.306+0000 7fc1a73a8640 1 -- 172.21.15.43:0/63768364 shutdown_connections 2024-04-25T13:41:36.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:36.306+0000 7fc1a73a8640 1 -- 172.21.15.43:0/63768364 wait complete. 2024-04-25T13:41:36.470 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 13:41:36 smithi043 podman[69501]: 2024-04-25 13:41:36.123338718 +0000 UTC m=+0.018644043 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:41:36.471 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 13:41:36 smithi043 podman[69501]: 2024-04-25 13:41:36.260414564 +0000 UTC m=+0.155719887 container create ed5e607ea94a953f8b77acc8cdc3b4d417a507c32990b98de1cbd653904237c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-25T13:41:36.471 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 13:41:36 smithi043 podman[69501]: 2024-04-25 13:41:36.471566155 +0000 UTC m=+0.366871478 container init ed5e607ea94a953f8b77acc8cdc3b4d417a507c32990b98de1cbd653904237c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-j, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T13:41:36.962 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 13:41:36 smithi043 podman[69501]: 2024-04-25 13:41:36.474345777 +0000 UTC m=+0.369651100 container start ed5e607ea94a953f8b77acc8cdc3b4d417a507c32990b98de1cbd653904237c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-j, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T13:41:36.962 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 13:41:36 smithi043 ceph-mds[69522]: -- 172.21.15.43:0/3891972904 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5588fb987a40 con 0x5588fb9cf180 2024-04-25T13:41:36.963 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 13:41:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-j[69518]: starting mds.j at 2024-04-25T13:41:36.963 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 13:41:36 smithi043 bash[69501]: ed5e607ea94a953f8b77acc8cdc3b4d417a507c32990b98de1cbd653904237c5 2024-04-25T13:41:36.963 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 13:41:36 smithi043 systemd[1]: Started Ceph mds.j for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:41:37.310 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:36 smithi043 ceph-mon[29195]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:37.310 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:36 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/63768364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:37.310 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:37.310 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:37.310 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:37.310 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:37.310 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:37.310 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:36 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:37.310 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:36 smithi043 ceph-mon[29195]: Deploying daemon mds.d on smithi043 2024-04-25T13:41:37.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:36 smithi161 ceph-mon[32696]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:37.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:36 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/63768364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:37.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:36 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:37.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:36 smithi161 ceph-mon[32696]: Deploying daemon mds.d on smithi043 2024-04-25T13:41:37.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:36 smithi175 ceph-mon[32649]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:37.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:36 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/63768364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:37.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:37.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:37.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:37.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:37.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:37.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:36 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:37.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:36 smithi175 ceph-mon[32649]: Deploying daemon mds.d on smithi043 2024-04-25T13:41:38.318 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:38.331 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:37 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.43:6834/73004272,v1:172.21.15.43:6835/73004272] up:boot 2024-04-25T13:41:38.331 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:37 smithi175 ceph-mon[32649]: fsmap 3 up:standby 2024-04-25T13:41:38.331 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:37 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T13:41:38.346 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:37 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.43:6834/73004272,v1:172.21.15.43:6835/73004272] up:boot 2024-04-25T13:41:38.346 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:37 smithi043 ceph-mon[29195]: fsmap 3 up:standby 2024-04-25T13:41:38.346 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:37 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T13:41:38.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:37 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.43:6834/73004272,v1:172.21.15.43:6835/73004272] up:boot 2024-04-25T13:41:38.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:37 smithi161 ceph-mon[32696]: fsmap 3 up:standby 2024-04-25T13:41:38.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:37 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T13:41:38.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.448+0000 7f703fe6e640 1 -- 172.21.15.43:0/3368192892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7038102160 msgr2=0x7f7038102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:38.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.448+0000 7f703fe6e640 1 --2- 172.21.15.43:0/3368192892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7038102160 0x7f7038102e60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7034009900 tx=0x7f703402a3f0 comp rx=0 tx=0).stop 2024-04-25T13:41:38.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.448+0000 7f703fe6e640 1 -- 172.21.15.43:0/3368192892 shutdown_connections 2024-04-25T13:41:38.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.448+0000 7f703fe6e640 1 --2- 172.21.15.43:0/3368192892 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70381080a0 0x7f703810a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:38.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.448+0000 7f703fe6e640 1 --2- 172.21.15.43:0/3368192892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70381033a0 0x7f70381037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:38.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.448+0000 7f703fe6e640 1 --2- 172.21.15.43:0/3368192892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7038102160 0x7f7038102e60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:38.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.448+0000 7f703fe6e640 1 -- 172.21.15.43:0/3368192892 >> 172.21.15.43:0/3368192892 conn(0x7f70380fd330 msgr2=0x7f70380ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:38.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.448+0000 7f703fe6e640 1 -- 172.21.15.43:0/3368192892 shutdown_connections 2024-04-25T13:41:38.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.448+0000 7f703fe6e640 1 -- 172.21.15.43:0/3368192892 wait complete. 2024-04-25T13:41:38.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.449+0000 7f703fe6e640 1 Processor -- start 2024-04-25T13:41:38.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.449+0000 7f703fe6e640 1 -- start start 2024-04-25T13:41:38.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.449+0000 7f703fe6e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7038102160 0x7f703819a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:38.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.449+0000 7f703fe6e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70381033a0 0x7f703819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:38.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.449+0000 7f703fe6e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70381080a0 0x7f70381a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:38.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.449+0000 7f703fe6e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f703810e3b0 con 0x7f70381080a0 2024-04-25T13:41:38.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.449+0000 7f703fe6e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f703810e230 con 0x7f70381033a0 2024-04-25T13:41:38.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.449+0000 7f703fe6e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f703810e530 con 0x7f7038102160 2024-04-25T13:41:38.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.449+0000 7f703e40b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70381080a0 0x7f70381a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:38.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.449+0000 7f703e40b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70381080a0 0x7f70381a15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40326/0 (socket says 172.21.15.43:40326) 2024-04-25T13:41:38.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.449+0000 7f703dc0a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7038102160 0x7f703819a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:38.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.449+0000 7f703e40b640 1 -- 172.21.15.43:0/3033909458 learned_addr learned my addr 172.21.15.43:0/3033909458 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:38.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.449+0000 7f703d409640 1 --2- 172.21.15.43:0/3033909458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70381033a0 0x7f703819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:38.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.450+0000 7f703e40b640 1 -- 172.21.15.43:0/3033909458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7038102160 msgr2=0x7f703819a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:38.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.450+0000 7f703e40b640 1 --2- 172.21.15.43:0/3033909458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7038102160 0x7f703819a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:38.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.450+0000 7f703e40b640 1 -- 172.21.15.43:0/3033909458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70381033a0 msgr2=0x7f703819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:38.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.450+0000 7f703e40b640 1 --2- 172.21.15.43:0/3033909458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70381033a0 0x7f703819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:38.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.450+0000 7f703e40b640 1 -- 172.21.15.43:0/3033909458 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70381a1b80 con 0x7f70381080a0 2024-04-25T13:41:38.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.450+0000 7f703e40b640 1 --2- 172.21.15.43:0/3033909458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70381080a0 0x7f70381a15c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f703000cce0 tx=0x7f703000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:38.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.450+0000 7f702effd640 1 -- 172.21.15.43:0/3033909458 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703000f450 con 0x7f70381080a0 2024-04-25T13:41:38.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.450+0000 7f702effd640 1 -- 172.21.15.43:0/3033909458 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f703000fa80 con 0x7f70381080a0 2024-04-25T13:41:38.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.450+0000 7f703fe6e640 1 -- 172.21.15.43:0/3033909458 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70381a1e70 con 0x7f70381080a0 2024-04-25T13:41:38.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.450+0000 7f702effd640 1 -- 172.21.15.43:0/3033909458 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70300189c0 con 0x7f70381080a0 2024-04-25T13:41:38.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.450+0000 7f703fe6e640 1 -- 172.21.15.43:0/3033909458 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70381a2280 con 0x7f70381080a0 2024-04-25T13:41:38.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.451+0000 7f703fe6e640 1 -- 172.21.15.43:0/3033909458 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70381a2510 con 0x7f70381080a0 2024-04-25T13:41:38.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.453+0000 7f702effd640 1 -- 172.21.15.43:0/3033909458 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f703000fc30 con 0x7f70381080a0 2024-04-25T13:41:38.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.453+0000 7f702effd640 1 --2- 172.21.15.43:0/3033909458 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f70240afaf0 0x7f70240b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:38.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.453+0000 7f702effd640 1 -- 172.21.15.43:0/3033909458 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f70300ded90 con 0x7f70381080a0 2024-04-25T13:41:38.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.453+0000 7f703dc0a640 1 --2- 172.21.15.43:0/3033909458 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f70240afaf0 0x7f70240b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:38.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.454+0000 7f703dc0a640 1 --2- 172.21.15.43:0/3033909458 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f70240afaf0 0x7f70240b2000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7034005760 tx=0x7f7034000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:38.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.457+0000 7f702effd640 1 -- 172.21.15.43:0/3033909458 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7030053ff0 con 0x7f70381080a0 2024-04-25T13:41:38.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.690+0000 7f703fe6e640 1 -- 172.21.15.43:0/3033909458 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70381a28a0 con 0x7f70381080a0 2024-04-25T13:41:38.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.690+0000 7f702effd640 1 -- 172.21.15.43:0/3033909458 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3040 (secure 0 0 0) 0x7f7030014030 con 0x7f70381080a0 2024-04-25T13:41:38.690 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:41:38.691 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T13:41:38.691 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 4 2024-04-25T13:41:38.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.693+0000 7f703fe6e640 1 -- 172.21.15.43:0/3033909458 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f70240afaf0 msgr2=0x7f70240b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:38.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.693+0000 7f703fe6e640 1 --2- 172.21.15.43:0/3033909458 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f70240afaf0 0x7f70240b2000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7034005760 tx=0x7f7034000bc0 comp rx=0 tx=0).stop 2024-04-25T13:41:38.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.693+0000 7f703fe6e640 1 -- 172.21.15.43:0/3033909458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70381080a0 msgr2=0x7f70381a15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:38.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.693+0000 7f703fe6e640 1 --2- 172.21.15.43:0/3033909458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70381080a0 0x7f70381a15c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f703000cce0 tx=0x7f703000a620 comp rx=0 tx=0).stop 2024-04-25T13:41:38.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.693+0000 7f703fe6e640 1 -- 172.21.15.43:0/3033909458 shutdown_connections 2024-04-25T13:41:38.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.693+0000 7f703fe6e640 1 --2- 172.21.15.43:0/3033909458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70381080a0 0x7f70381a15c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:38.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.693+0000 7f703fe6e640 1 --2- 172.21.15.43:0/3033909458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70381033a0 0x7f703819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:38.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.693+0000 7f703fe6e640 1 --2- 172.21.15.43:0/3033909458 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f70240afaf0 0x7f70240b2000 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:38.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.693+0000 7f703fe6e640 1 --2- 172.21.15.43:0/3033909458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7038102160 0x7f703819a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:38.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.693+0000 7f703fe6e640 1 -- 172.21.15.43:0/3033909458 >> 172.21.15.43:0/3033909458 conn(0x7f70380fd330 msgr2=0x7f7038109680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:38.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.693+0000 7f703fe6e640 1 -- 172.21.15.43:0/3033909458 shutdown_connections 2024-04-25T13:41:38.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:38.693+0000 7f703fe6e640 1 -- 172.21.15.43:0/3033909458 wait complete. 2024-04-25T13:41:38.963 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 13:41:38 smithi043 systemd[1]: Starting Ceph mds.d for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:41:39.254 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:38 smithi161 ceph-mon[32696]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:39.254 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:38 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3033909458' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:39.352 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:38 smithi043 ceph-mon[29195]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:39.352 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:38 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3033909458' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:39.352 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 13:41:39 smithi043 podman[69845]: 2024-04-25 13:41:38.97451377 +0000 UTC m=+0.018578498 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:41:39.352 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 13:41:39 smithi043 podman[69845]: 2024-04-25 13:41:39.083138153 +0000 UTC m=+0.127202928 container create 021c444aa0385f498925c735c9c62f5c3fa6fef76b63e5d268e5ca12d382043c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-25T13:41:39.352 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 13:41:39 smithi043 podman[69845]: 2024-04-25 13:41:39.353088086 +0000 UTC m=+0.397152813 container init 021c444aa0385f498925c735c9c62f5c3fa6fef76b63e5d268e5ca12d382043c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-d, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T13:41:39.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:38 smithi175 ceph-mon[32649]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:39.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:38 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3033909458' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:39.712 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 13:41:39 smithi043 podman[69845]: 2024-04-25 13:41:39.356147861 +0000 UTC m=+0.400212578 container start 021c444aa0385f498925c735c9c62f5c3fa6fef76b63e5d268e5ca12d382043c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-d, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-25T13:41:39.712 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 13:41:39 smithi043 ceph-mds[69864]: -- 172.21.15.43:0/1685646872 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5623848dba40 con 0x562384923a80 2024-04-25T13:41:39.713 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 13:41:39 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-d[69860]: starting mds.d at 2024-04-25T13:41:39.713 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 13:41:39 smithi043 bash[69845]: 021c444aa0385f498925c735c9c62f5c3fa6fef76b63e5d268e5ca12d382043c 2024-04-25T13:41:39.713 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 13:41:39 smithi043 systemd[1]: Started Ceph mds.d for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:41:40.706 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:40.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.836+0000 7f852f205640 1 -- 172.21.15.43:0/2131707654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8528103b40 msgr2=0x7f8528104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:40.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.836+0000 7f852f205640 1 --2- 172.21.15.43:0/2131707654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8528103b40 0x7f8528104010 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f851c009900 tx=0x7f851c02a410 comp rx=0 tx=0).stop 2024-04-25T13:41:40.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.836+0000 7f852f205640 1 -- 172.21.15.43:0/2131707654 shutdown_connections 2024-04-25T13:41:40.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.836+0000 7f852f205640 1 --2- 172.21.15.43:0/2131707654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85281046a0 0x7f852810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:40.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.836+0000 7f852f205640 1 --2- 172.21.15.43:0/2131707654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8528103b40 0x7f8528104010 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:40.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.836+0000 7f852f205640 1 --2- 172.21.15.43:0/2131707654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8528102fe0 0x7f85281033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:40.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.836+0000 7f852f205640 1 -- 172.21.15.43:0/2131707654 >> 172.21.15.43:0/2131707654 conn(0x7f85280fd360 msgr2=0x7f85280ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:40.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.836+0000 7f852f205640 1 -- 172.21.15.43:0/2131707654 shutdown_connections 2024-04-25T13:41:40.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.836+0000 7f852f205640 1 -- 172.21.15.43:0/2131707654 wait complete. 2024-04-25T13:41:40.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852f205640 1 Processor -- start 2024-04-25T13:41:40.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852f205640 1 -- start start 2024-04-25T13:41:40.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852f205640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8528102fe0 0x7f8528199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:40.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852f205640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8528103b40 0x7f852819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:40.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852f205640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f852819f420 0x7f85281a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:40.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852f205640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f852810e620 con 0x7f8528102fe0 2024-04-25T13:41:40.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852f205640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f852810e4a0 con 0x7f852819f420 2024-04-25T13:41:40.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852f205640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f852810e7a0 con 0x7f8528103b40 2024-04-25T13:41:40.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852cfa1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8528102fe0 0x7f8528199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:40.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852cfa1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8528102fe0 0x7f8528199f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55266/0 (socket says 172.21.15.43:55266) 2024-04-25T13:41:40.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852cfa1640 1 -- 172.21.15.43:0/317427947 learned_addr learned my addr 172.21.15.43:0/317427947 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:40.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852d7a2640 1 --2- 172.21.15.43:0/317427947 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f852819f420 0x7f85281a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:40.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f8527fff640 1 --2- 172.21.15.43:0/317427947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8528103b40 0x7f852819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:40.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852cfa1640 1 -- 172.21.15.43:0/317427947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8528103b40 msgr2=0x7f852819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:40.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852cfa1640 1 --2- 172.21.15.43:0/317427947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8528103b40 0x7f852819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:40.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852cfa1640 1 -- 172.21.15.43:0/317427947 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f852819f420 msgr2=0x7f85281a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:40.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852cfa1640 1 --2- 172.21.15.43:0/317427947 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f852819f420 0x7f85281a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:40.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f852cfa1640 1 -- 172.21.15.43:0/317427947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85281a1eb0 con 0x7f8528102fe0 2024-04-25T13:41:40.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.837+0000 7f8527fff640 1 --2- 172.21.15.43:0/317427947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8528103b40 0x7f852819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:40.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.838+0000 7f852cfa1640 1 --2- 172.21.15.43:0/317427947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8528102fe0 0x7f8528199f60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f851800d740 tx=0x7f851800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:40.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.838+0000 7f8525ffb640 1 -- 172.21.15.43:0/317427947 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518017070 con 0x7f8528102fe0 2024-04-25T13:41:40.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.838+0000 7f852f205640 1 -- 172.21.15.43:0/317427947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85281a21a0 con 0x7f8528102fe0 2024-04-25T13:41:40.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.838+0000 7f8525ffb640 1 -- 172.21.15.43:0/317427947 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f851800de50 con 0x7f8528102fe0 2024-04-25T13:41:40.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.838+0000 7f8525ffb640 1 -- 172.21.15.43:0/317427947 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518004c60 con 0x7f8528102fe0 2024-04-25T13:41:40.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.838+0000 7f852f205640 1 -- 172.21.15.43:0/317427947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85281a26a0 con 0x7f8528102fe0 2024-04-25T13:41:40.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.839+0000 7f852f205640 1 -- 172.21.15.43:0/317427947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f852806b380 con 0x7f8528102fe0 2024-04-25T13:41:40.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.841+0000 7f8525ffb640 1 -- 172.21.15.43:0/317427947 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f8518004e00 con 0x7f8528102fe0 2024-04-25T13:41:40.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.841+0000 7f8525ffb640 1 --2- 172.21.15.43:0/317427947 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f85100afaf0 0x7f85100b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:40.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.841+0000 7f8527fff640 1 --2- 172.21.15.43:0/317427947 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f85100afaf0 0x7f85100b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:40.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.841+0000 7f8525ffb640 1 -- 172.21.15.43:0/317427947 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f85180de530 con 0x7f8528102fe0 2024-04-25T13:41:40.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.842+0000 7f8527fff640 1 --2- 172.21.15.43:0/317427947 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f85100afaf0 0x7f85100b2000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f851c005f70 tx=0x7f851c005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:40.843 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:40 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:40.844 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:40 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:40.844 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:40 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:40.844 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:40 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:40.844 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:40 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:40.844 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:40 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:40.844 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:40 smithi161 ceph-mon[32696]: Deploying daemon mds.e on smithi161 2024-04-25T13:41:40.844 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:40 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.43:6836/624870499,v1:172.21.15.43:6837/624870499] up:boot 2024-04-25T13:41:40.844 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:40 smithi161 ceph-mon[32696]: fsmap 4 up:standby 2024-04-25T13:41:40.844 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:40 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T13:41:40.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:40.845+0000 7f8525ffb640 1 -- 172.21.15.43:0/317427947 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f85180a75b0 con 0x7f8528102fe0 2024-04-25T13:41:40.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:40 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:40.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:40 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:40.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:40 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:40.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:40 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:40.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:40 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:40.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:40 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:40.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:40 smithi175 ceph-mon[32649]: Deploying daemon mds.e on smithi161 2024-04-25T13:41:40.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:40 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.43:6836/624870499,v1:172.21.15.43:6837/624870499] up:boot 2024-04-25T13:41:40.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:40 smithi175 ceph-mon[32649]: fsmap 4 up:standby 2024-04-25T13:41:40.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:40 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T13:41:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:40 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:40 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:40 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:40 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:40 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:40 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:40 smithi043 ceph-mon[29195]: Deploying daemon mds.e on smithi161 2024-04-25T13:41:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:40 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.43:6836/624870499,v1:172.21.15.43:6837/624870499] up:boot 2024-04-25T13:41:40.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:40 smithi043 ceph-mon[29195]: fsmap 4 up:standby 2024-04-25T13:41:40.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:40 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T13:41:41.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:41.069+0000 7f852f205640 1 -- 172.21.15.43:0/317427947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85281083f0 con 0x7f8528102fe0 2024-04-25T13:41:41.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:41.070+0000 7f8525ffb640 1 -- 172.21.15.43:0/317427947 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3862 (secure 0 0 0) 0x7f85180a6eb0 con 0x7f8528102fe0 2024-04-25T13:41:41.071 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:41:41.071 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T13:41:41.071 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 5 2024-04-25T13:41:41.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:41.072+0000 7f852f205640 1 -- 172.21.15.43:0/317427947 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f85100afaf0 msgr2=0x7f85100b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:41.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:41.072+0000 7f852f205640 1 --2- 172.21.15.43:0/317427947 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f85100afaf0 0x7f85100b2000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f851c005f70 tx=0x7f851c005720 comp rx=0 tx=0).stop 2024-04-25T13:41:41.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:41.072+0000 7f852f205640 1 -- 172.21.15.43:0/317427947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8528102fe0 msgr2=0x7f8528199f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:41.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:41.072+0000 7f852f205640 1 --2- 172.21.15.43:0/317427947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8528102fe0 0x7f8528199f60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f851800d740 tx=0x7f851800dc00 comp rx=0 tx=0).stop 2024-04-25T13:41:41.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:41.072+0000 7f852f205640 1 -- 172.21.15.43:0/317427947 shutdown_connections 2024-04-25T13:41:41.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:41.072+0000 7f852f205640 1 --2- 172.21.15.43:0/317427947 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f852819f420 0x7f85281a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:41.072+0000 7f852f205640 1 --2- 172.21.15.43:0/317427947 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f85100afaf0 0x7f85100b2000 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:41.072+0000 7f852f205640 1 --2- 172.21.15.43:0/317427947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8528103b40 0x7f852819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:41.072+0000 7f852f205640 1 --2- 172.21.15.43:0/317427947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8528102fe0 0x7f8528199f60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:41.072+0000 7f852f205640 1 -- 172.21.15.43:0/317427947 >> 172.21.15.43:0/317427947 conn(0x7f85280fd360 msgr2=0x7f8528101e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:41.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:41.072+0000 7f852f205640 1 -- 172.21.15.43:0/317427947 shutdown_connections 2024-04-25T13:41:41.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:41.072+0000 7f852f205640 1 -- 172.21.15.43:0/317427947 wait complete. 2024-04-25T13:41:41.854 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:41 smithi161 ceph-mon[32696]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:41.854 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:41 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/317427947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:41.854 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:41:41 smithi161 systemd[1]: Starting Ceph mds.e for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:41:41.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:41 smithi175 ceph-mon[32649]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:41.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:41 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/317427947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:41.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:41 smithi043 ceph-mon[29195]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:41.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:41 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/317427947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:42.190 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:41:41 smithi161 podman[62478]: 2024-04-25 13:41:41.816259031 +0000 UTC m=+0.018209518 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:41:42.190 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:41:41 smithi161 podman[62478]: 2024-04-25 13:41:41.94081801 +0000 UTC m=+0.142768477 container create 10ebf54f12861cc3e37d87d59869b9f056dfe8a0ab2100286e6332f753fdf9bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-25T13:41:42.190 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:41:42 smithi161 podman[62478]: 2024-04-25 13:41:42.190606222 +0000 UTC m=+0.392556686 container init 10ebf54f12861cc3e37d87d59869b9f056dfe8a0ab2100286e6332f753fdf9bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424) 2024-04-25T13:41:42.603 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:41:42 smithi161 podman[62478]: 2024-04-25 13:41:42.19312606 +0000 UTC m=+0.395076524 container start 10ebf54f12861cc3e37d87d59869b9f056dfe8a0ab2100286e6332f753fdf9bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-e, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-04-25T13:41:42.603 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:41:42 smithi161 ceph-mds[62497]: -- 172.21.15.161:0/770273634 <== mon.2 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f368c5ba40 con 0x55f368ca3a80 2024-04-25T13:41:42.603 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:41:42 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-e[62493]: starting mds.e at 2024-04-25T13:41:42.603 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:41:42 smithi161 bash[62478]: 10ebf54f12861cc3e37d87d59869b9f056dfe8a0ab2100286e6332f753fdf9bb 2024-04-25T13:41:42.603 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:41:42 smithi161 systemd[1]: Started Ceph mds.e for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:41:43.085 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:43.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.212+0000 7f21b881a640 1 -- 172.21.15.43:0/4282705686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21b410bad0 msgr2=0x7f21b410def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:43.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.212+0000 7f21b881a640 1 --2- 172.21.15.43:0/4282705686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21b410bad0 0x7f21b410def0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009ca0 tx=0x7f21ac02a8c0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.212+0000 7f21b881a640 1 -- 172.21.15.43:0/4282705686 shutdown_connections 2024-04-25T13:41:43.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.212+0000 7f21b881a640 1 --2- 172.21.15.43:0/4282705686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21b410bad0 0x7f21b410def0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.212+0000 7f21b881a640 1 --2- 172.21.15.43:0/4282705686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21b4076990 0x7f21b410b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.212+0000 7f21b881a640 1 --2- 172.21.15.43:0/4282705686 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21b4076040 0x7f21b4076450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.212+0000 7f21b881a640 1 -- 172.21.15.43:0/4282705686 >> 172.21.15.43:0/4282705686 conn(0x7f21b40fed10 msgr2=0x7f21b41011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:43.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.212+0000 7f21b881a640 1 -- 172.21.15.43:0/4282705686 shutdown_connections 2024-04-25T13:41:43.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.212+0000 7f21b881a640 1 -- 172.21.15.43:0/4282705686 wait complete. 2024-04-25T13:41:43.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.213+0000 7f21b881a640 1 Processor -- start 2024-04-25T13:41:43.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.213+0000 7f21b881a640 1 -- start start 2024-04-25T13:41:43.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.213+0000 7f21b881a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21b4076040 0x7f21b419c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:43.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.213+0000 7f21b881a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21b4076990 0x7f21b419c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:43.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.213+0000 7f21b881a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21b410bad0 0x7f21b41a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:43.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.213+0000 7f21b881a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f21b4111720 con 0x7f21b4076990 2024-04-25T13:41:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.213+0000 7f21b881a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f21b41115a0 con 0x7f21b410bad0 2024-04-25T13:41:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.213+0000 7f21b881a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f21b41118a0 con 0x7f21b4076040 2024-04-25T13:41:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.214+0000 7f21b1d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21b4076990 0x7f21b419c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.214+0000 7f21b1d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21b4076990 0x7f21b419c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55290/0 (socket says 172.21.15.43:55290) 2024-04-25T13:41:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.214+0000 7f21b1d9b640 1 -- 172.21.15.43:0/960555593 learned_addr learned my addr 172.21.15.43:0/960555593 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.214+0000 7f21b2d9d640 1 --2- 172.21.15.43:0/960555593 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21b410bad0 0x7f21b41a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.214+0000 7f21b259c640 1 --2- 172.21.15.43:0/960555593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21b4076040 0x7f21b419c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.214+0000 7f21b1d9b640 1 -- 172.21.15.43:0/960555593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21b4076040 msgr2=0x7f21b419c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.214+0000 7f21b1d9b640 1 --2- 172.21.15.43:0/960555593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21b4076040 0x7f21b419c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.214+0000 7f21b1d9b640 1 -- 172.21.15.43:0/960555593 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21b410bad0 msgr2=0x7f21b41a37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.214+0000 7f21b1d9b640 1 --2- 172.21.15.43:0/960555593 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21b410bad0 0x7f21b41a37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.214+0000 7f21b1d9b640 1 -- 172.21.15.43:0/960555593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b41a3e60 con 0x7f21b4076990 2024-04-25T13:41:43.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.214+0000 7f21b1d9b640 1 --2- 172.21.15.43:0/960555593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21b4076990 0x7f21b419c860 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f21a800e9f0 tx=0x7f21a800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:43.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.214+0000 7f21a37fe640 1 -- 172.21.15.43:0/960555593 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a800cd80 con 0x7f21b4076990 2024-04-25T13:41:43.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.214+0000 7f21a37fe640 1 -- 172.21.15.43:0/960555593 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21a80054b0 con 0x7f21b4076990 2024-04-25T13:41:43.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.214+0000 7f21b881a640 1 -- 172.21.15.43:0/960555593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b41a4150 con 0x7f21b4076990 2024-04-25T13:41:43.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.214+0000 7f21a37fe640 1 -- 172.21.15.43:0/960555593 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a8010430 con 0x7f21b4076990 2024-04-25T13:41:43.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.214+0000 7f21b881a640 1 -- 172.21.15.43:0/960555593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b41a4650 con 0x7f21b4076990 2024-04-25T13:41:43.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.215+0000 7f21b881a640 1 -- 172.21.15.43:0/960555593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21b410a3a0 con 0x7f21b4076990 2024-04-25T13:41:43.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.217+0000 7f21a37fe640 1 -- 172.21.15.43:0/960555593 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f21a80046c0 con 0x7f21b4076990 2024-04-25T13:41:43.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.218+0000 7f21a37fe640 1 --2- 172.21.15.43:0/960555593 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f219c0afaf0 0x7f219c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:43.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.218+0000 7f21b259c640 1 --2- 172.21.15.43:0/960555593 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f219c0afaf0 0x7f219c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:43.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.218+0000 7f21a37fe640 1 -- 172.21.15.43:0/960555593 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f21a80dee40 con 0x7f21b4076990 2024-04-25T13:41:43.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.219+0000 7f21b259c640 1 --2- 172.21.15.43:0/960555593 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f219c0afaf0 0x7f219c0b2000 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f21a4005fd0 tx=0x7f21a4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:43.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.222+0000 7f21a37fe640 1 -- 172.21.15.43:0/960555593 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f21a8053ff0 con 0x7f21b4076990 2024-04-25T13:41:43.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.449+0000 7f21b881a640 1 -- 172.21.15.43:0/960555593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21b402db50 con 0x7f21b4076990 2024-04-25T13:41:43.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.450+0000 7f21a37fe640 1 -- 172.21.15.43:0/960555593 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4690 (secure 0 0 0) 0x7f21a80a7e20 con 0x7f21b4076990 2024-04-25T13:41:43.450 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:41:43.450 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-25T13:41:43.451 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 6 2024-04-25T13:41:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.452+0000 7f21b881a640 1 -- 172.21.15.43:0/960555593 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f219c0afaf0 msgr2=0x7f219c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.452+0000 7f21b881a640 1 --2- 172.21.15.43:0/960555593 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f219c0afaf0 0x7f219c0b2000 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f21a4005fd0 tx=0x7f21a4005850 comp rx=0 tx=0).stop 2024-04-25T13:41:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.452+0000 7f21b881a640 1 -- 172.21.15.43:0/960555593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21b4076990 msgr2=0x7f21b419c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.452+0000 7f21b881a640 1 --2- 172.21.15.43:0/960555593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21b4076990 0x7f21b419c860 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f21a800e9f0 tx=0x7f21a800edf0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.452+0000 7f21b881a640 1 -- 172.21.15.43:0/960555593 shutdown_connections 2024-04-25T13:41:43.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.452+0000 7f21b881a640 1 --2- 172.21.15.43:0/960555593 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21b410bad0 0x7f21b41a37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.452+0000 7f21b881a640 1 --2- 172.21.15.43:0/960555593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21b4076990 0x7f21b419c860 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.452+0000 7f21b881a640 1 --2- 172.21.15.43:0/960555593 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f219c0afaf0 0x7f219c0b2000 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.452+0000 7f21b881a640 1 --2- 172.21.15.43:0/960555593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21b4076040 0x7f21b419c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.452+0000 7f21b881a640 1 -- 172.21.15.43:0/960555593 >> 172.21.15.43:0/960555593 conn(0x7f21b40fed10 msgr2=0x7f21b4107570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:43.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.452+0000 7f21b881a640 1 -- 172.21.15.43:0/960555593 shutdown_connections 2024-04-25T13:41:43.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:43.452+0000 7f21b881a640 1 -- 172.21.15.43:0/960555593 wait complete. 2024-04-25T13:41:43.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:43 smithi043 ceph-mon[29195]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:43.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:43 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:43.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:43 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:43.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:43 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:43.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:43 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:43.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:43 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:43.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:43 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:43.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:43 smithi043 ceph-mon[29195]: Deploying daemon mds.f on smithi175 2024-04-25T13:41:43.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:43 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.161:6834/2378707176,v1:172.21.15.161:6835/2378707176] up:boot 2024-04-25T13:41:43.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:43 smithi043 ceph-mon[29195]: fsmap 5 up:standby 2024-04-25T13:41:43.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:43 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T13:41:43.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:43 smithi161 ceph-mon[32696]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:43.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:43 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:43.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:43 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:43.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:43 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:43.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:43 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:43.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:43 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:43.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:43 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:43.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:43 smithi161 ceph-mon[32696]: Deploying daemon mds.f on smithi175 2024-04-25T13:41:43.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:43 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.161:6834/2378707176,v1:172.21.15.161:6835/2378707176] up:boot 2024-04-25T13:41:43.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:43 smithi161 ceph-mon[32696]: fsmap 5 up:standby 2024-04-25T13:41:43.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:43 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T13:41:43.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:43 smithi175 ceph-mon[32649]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:43.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:43.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:43.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:43.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:43.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:43.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:43.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:43 smithi175 ceph-mon[32649]: Deploying daemon mds.f on smithi175 2024-04-25T13:41:43.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:43 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.161:6834/2378707176,v1:172.21.15.161:6835/2378707176] up:boot 2024-04-25T13:41:43.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:43 smithi175 ceph-mon[32649]: fsmap 5 up:standby 2024-04-25T13:41:43.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:43 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T13:41:44.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:44 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/960555593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:44.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:44 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/960555593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:44.681 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:41:44 smithi175 systemd[1]: Starting Ceph mds.f for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:41:44.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:44 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/960555593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:45.021 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:41:44 smithi175 podman[62484]: 2024-04-25 13:41:44.612364025 +0000 UTC m=+0.017606766 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:41:45.022 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:41:44 smithi175 podman[62484]: 2024-04-25 13:41:44.761292558 +0000 UTC m=+0.166535293 container create 3e9f9d20bd7cc1d5b2d9a911393706c69f6847f41acb5c09258cf3dc43ab60ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-25T13:41:45.022 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:41:45 smithi175 podman[62484]: 2024-04-25 13:41:45.022512862 +0000 UTC m=+0.427755591 container init 3e9f9d20bd7cc1d5b2d9a911393706c69f6847f41acb5c09258cf3dc43ab60ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-f, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T13:41:45.355 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:41:45 smithi175 podman[62484]: 2024-04-25 13:41:45.02532039 +0000 UTC m=+0.430563124 container start 3e9f9d20bd7cc1d5b2d9a911393706c69f6847f41acb5c09258cf3dc43ab60ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-f, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-25T13:41:45.355 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:41:45 smithi175 ceph-mds[62503]: -- 172.21.15.175:0/3286850060 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559a06a8ba40 con 0x559a06ad3a80 2024-04-25T13:41:45.355 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:41:45 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-f[62499]: starting mds.f at 2024-04-25T13:41:45.355 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:41:45 smithi175 bash[62484]: 3e9f9d20bd7cc1d5b2d9a911393706c69f6847f41acb5c09258cf3dc43ab60ee 2024-04-25T13:41:45.355 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:41:45 smithi175 systemd[1]: Started Ceph mds.f for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:41:45.464 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:45.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.591+0000 7f0ea92f2640 1 -- 172.21.15.43:0/1792990195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ea4108920 msgr2=0x7f0ea410ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:45.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.591+0000 7f0ea92f2640 1 --2- 172.21.15.43:0/1792990195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ea4108920 0x7f0ea410ad40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009ca0 tx=0x7f0e9c02a8c0 comp rx=0 tx=0).stop 2024-04-25T13:41:45.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.591+0000 7f0ea92f2640 1 -- 172.21.15.43:0/1792990195 shutdown_connections 2024-04-25T13:41:45.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.591+0000 7f0ea92f2640 1 --2- 172.21.15.43:0/1792990195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ea4108920 0x7f0ea410ad40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:45.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.591+0000 7f0ea92f2640 1 --2- 172.21.15.43:0/1792990195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ea4103c20 0x7f0ea4104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:45.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.591+0000 7f0ea92f2640 1 --2- 172.21.15.43:0/1792990195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ea41029e0 0x7f0ea41036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:45.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.591+0000 7f0ea92f2640 1 -- 172.21.15.43:0/1792990195 >> 172.21.15.43:0/1792990195 conn(0x7f0ea40fdbd0 msgr2=0x7f0ea4100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:45.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.591+0000 7f0ea92f2640 1 -- 172.21.15.43:0/1792990195 shutdown_connections 2024-04-25T13:41:45.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.591+0000 7f0ea92f2640 1 -- 172.21.15.43:0/1792990195 wait complete. 2024-04-25T13:41:45.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.591+0000 7f0ea92f2640 1 Processor -- start 2024-04-25T13:41:45.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea92f2640 1 -- start start 2024-04-25T13:41:45.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea92f2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ea41029e0 0x7f0ea410d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:45.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea92f2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ea4103c20 0x7f0ea410b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:45.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea92f2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ea4108920 0x7f0ea410be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:45.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea92f2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea410f520 con 0x7f0ea41029e0 2024-04-25T13:41:45.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea92f2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea410f3a0 con 0x7f0ea4108920 2024-04-25T13:41:45.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea92f2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea410f6a0 con 0x7f0ea4103c20 2024-04-25T13:41:45.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea2ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ea41029e0 0x7f0ea410d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:45.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea2ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ea41029e0 0x7f0ea410d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55308/0 (socket says 172.21.15.43:55308) 2024-04-25T13:41:45.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea2ffd640 1 -- 172.21.15.43:0/970401739 learned_addr learned my addr 172.21.15.43:0/970401739 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:45.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea27fc640 1 --2- 172.21.15.43:0/970401739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ea4103c20 0x7f0ea410b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:45.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea37fe640 1 --2- 172.21.15.43:0/970401739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ea4108920 0x7f0ea410be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:45.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea2ffd640 1 -- 172.21.15.43:0/970401739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ea4103c20 msgr2=0x7f0ea410b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:45.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea2ffd640 1 --2- 172.21.15.43:0/970401739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ea4103c20 0x7f0ea410b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:45.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea2ffd640 1 -- 172.21.15.43:0/970401739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ea4108920 msgr2=0x7f0ea410be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:45.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea2ffd640 1 --2- 172.21.15.43:0/970401739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ea4108920 0x7f0ea410be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:45.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea2ffd640 1 -- 172.21.15.43:0/970401739 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea410c5c0 con 0x7f0ea41029e0 2024-04-25T13:41:45.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea37fe640 1 --2- 172.21.15.43:0/970401739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ea4108920 0x7f0ea410be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:45.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.592+0000 7f0ea2ffd640 1 --2- 172.21.15.43:0/970401739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ea41029e0 0x7f0ea410d2b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400e980 tx=0x7f0e9400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:45.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.593+0000 7f0e8bfff640 1 -- 172.21.15.43:0/970401739 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400cd80 con 0x7f0ea41029e0 2024-04-25T13:41:45.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.593+0000 7f0e8bfff640 1 -- 172.21.15.43:0/970401739 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0e940108c0 con 0x7f0ea41029e0 2024-04-25T13:41:45.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.593+0000 7f0ea92f2640 1 -- 172.21.15.43:0/970401739 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea41a41d0 con 0x7f0ea41029e0 2024-04-25T13:41:45.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.593+0000 7f0e8bfff640 1 -- 172.21.15.43:0/970401739 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e94018840 con 0x7f0ea41029e0 2024-04-25T13:41:45.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.593+0000 7f0ea92f2640 1 -- 172.21.15.43:0/970401739 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea41a4690 con 0x7f0ea41029e0 2024-04-25T13:41:45.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.594+0000 7f0ea92f2640 1 -- 172.21.15.43:0/970401739 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea4107730 con 0x7f0ea41029e0 2024-04-25T13:41:45.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.595+0000 7f0e8bfff640 1 -- 172.21.15.43:0/970401739 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f0e9401f020 con 0x7f0ea41029e0 2024-04-25T13:41:45.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.596+0000 7f0e8bfff640 1 --2- 172.21.15.43:0/970401739 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0e8c0afaf0 0x7f0e8c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:45.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.596+0000 7f0ea27fc640 1 --2- 172.21.15.43:0/970401739 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0e8c0afaf0 0x7f0e8c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:45.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.596+0000 7f0e8bfff640 1 -- 172.21.15.43:0/970401739 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f0e940def30 con 0x7f0ea41029e0 2024-04-25T13:41:45.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.597+0000 7f0ea27fc640 1 --2- 172.21.15.43:0/970401739 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0e8c0afaf0 0x7f0e8c0b2000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0ea410cc50 tx=0x7f0e98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:45.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.600+0000 7f0e8bfff640 1 -- 172.21.15.43:0/970401739 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0e940a7f50 con 0x7f0ea41029e0 2024-04-25T13:41:45.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:45 smithi175 ceph-mon[32649]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:45.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:45.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:45.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:45.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:45.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:45.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:45 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:45.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:45 smithi043 ceph-mon[29195]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:45.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:45.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:45.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:45.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:45.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:45.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:45 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:45.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.825+0000 7f0ea92f2640 1 -- 172.21.15.43:0/970401739 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ea402db50 con 0x7f0ea41029e0 2024-04-25T13:41:45.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.826+0000 7f0e8bfff640 1 -- 172.21.15.43:0/970401739 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5518 (secure 0 0 0) 0x7f0e940a7850 con 0x7f0ea41029e0 2024-04-25T13:41:45.826 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:41:45.827 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-25T13:41:45.827 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 7 2024-04-25T13:41:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.828+0000 7f0ea92f2640 1 -- 172.21.15.43:0/970401739 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0e8c0afaf0 msgr2=0x7f0e8c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.828+0000 7f0ea92f2640 1 --2- 172.21.15.43:0/970401739 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0e8c0afaf0 0x7f0e8c0b2000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0ea410cc50 tx=0x7f0e98005f90 comp rx=0 tx=0).stop 2024-04-25T13:41:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.828+0000 7f0ea92f2640 1 -- 172.21.15.43:0/970401739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ea41029e0 msgr2=0x7f0ea410d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.828+0000 7f0ea92f2640 1 --2- 172.21.15.43:0/970401739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ea41029e0 0x7f0ea410d2b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400e980 tx=0x7f0e9400ee40 comp rx=0 tx=0).stop 2024-04-25T13:41:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.828+0000 7f0ea92f2640 1 -- 172.21.15.43:0/970401739 shutdown_connections 2024-04-25T13:41:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.828+0000 7f0ea92f2640 1 --2- 172.21.15.43:0/970401739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ea4108920 0x7f0ea410be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.828+0000 7f0ea92f2640 1 --2- 172.21.15.43:0/970401739 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0e8c0afaf0 0x7f0e8c0b2000 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.828+0000 7f0ea92f2640 1 --2- 172.21.15.43:0/970401739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ea4103c20 0x7f0ea410b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.828+0000 7f0ea92f2640 1 --2- 172.21.15.43:0/970401739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ea41029e0 0x7f0ea410d2b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.828+0000 7f0ea92f2640 1 -- 172.21.15.43:0/970401739 >> 172.21.15.43:0/970401739 conn(0x7f0ea40fdbd0 msgr2=0x7f0ea4104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.829+0000 7f0ea92f2640 1 -- 172.21.15.43:0/970401739 shutdown_connections 2024-04-25T13:41:45.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:45.829+0000 7f0ea92f2640 1 -- 172.21.15.43:0/970401739 wait complete. 2024-04-25T13:41:45.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:45 smithi161 ceph-mon[32696]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:45.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:45.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:45.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:45.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:45.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:45.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:45 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:46.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:46 smithi175 ceph-mon[32649]: Deploying daemon mds.c on smithi175 2024-04-25T13:41:46.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:46 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.175:6834/1225446538,v1:172.21.15.175:6835/1225446538] up:boot 2024-04-25T13:41:46.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:46 smithi175 ceph-mon[32649]: fsmap 6 up:standby 2024-04-25T13:41:46.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:46 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T13:41:46.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:46 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/970401739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:46.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:46 smithi043 ceph-mon[29195]: Deploying daemon mds.c on smithi175 2024-04-25T13:41:46.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:46 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.175:6834/1225446538,v1:172.21.15.175:6835/1225446538] up:boot 2024-04-25T13:41:46.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:46 smithi043 ceph-mon[29195]: fsmap 6 up:standby 2024-04-25T13:41:46.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:46 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T13:41:46.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:46 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/970401739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:46.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:46 smithi161 ceph-mon[32696]: Deploying daemon mds.c on smithi175 2024-04-25T13:41:46.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:46 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.175:6834/1225446538,v1:172.21.15.175:6835/1225446538] up:boot 2024-04-25T13:41:46.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:46 smithi161 ceph-mon[32696]: fsmap 6 up:standby 2024-04-25T13:41:46.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:46 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T13:41:46.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:46 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/970401739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:47.625 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:47 smithi175 ceph-mon[32649]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:47.625 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:41:47 smithi175 systemd[1]: Starting Ceph mds.c for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:41:47.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:47 smithi043 ceph-mon[29195]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:47.841 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:47.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:47 smithi161 ceph-mon[32696]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:47.930 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:41:47 smithi175 podman[62791]: 2024-04-25 13:41:47.528790104 +0000 UTC m=+0.018440014 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:41:47.930 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:41:47 smithi175 podman[62791]: 2024-04-25 13:41:47.716355129 +0000 UTC m=+0.206005025 container create d610ee93c0250e4270c869e2bb5caa38dc4fa52bc9bd6d4ca30b3d5bf559d98c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-c, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-04-25T13:41:47.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.968+0000 7fe5d0af2640 1 -- 172.21.15.43:0/495761341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc103c20 msgr2=0x7fe5cc104030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:47.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.968+0000 7fe5d0af2640 1 --2- 172.21.15.43:0/495761341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc103c20 0x7fe5cc104030 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009900 tx=0x7fe5b402a410 comp rx=0 tx=0).stop 2024-04-25T13:41:47.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.968+0000 7fe5d0af2640 1 -- 172.21.15.43:0/495761341 shutdown_connections 2024-04-25T13:41:47.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.968+0000 7fe5d0af2640 1 --2- 172.21.15.43:0/495761341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5cc108920 0x7fe5cc10ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:47.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.968+0000 7fe5d0af2640 1 --2- 172.21.15.43:0/495761341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc103c20 0x7fe5cc104030 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:47.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.968+0000 7fe5d0af2640 1 --2- 172.21.15.43:0/495761341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5cc1029e0 0x7fe5cc1036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:47.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.968+0000 7fe5d0af2640 1 -- 172.21.15.43:0/495761341 >> 172.21.15.43:0/495761341 conn(0x7fe5cc0fdbf0 msgr2=0x7fe5cc100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:47.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.968+0000 7fe5d0af2640 1 -- 172.21.15.43:0/495761341 shutdown_connections 2024-04-25T13:41:47.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.968+0000 7fe5d0af2640 1 -- 172.21.15.43:0/495761341 wait complete. 2024-04-25T13:41:47.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.968+0000 7fe5d0af2640 1 Processor -- start 2024-04-25T13:41:47.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5d0af2640 1 -- start start 2024-04-25T13:41:47.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5d0af2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5cc1029e0 0x7fe5cc19a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:47.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5d0af2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc103c20 0x7fe5cc19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:47.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5d0af2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5cc108920 0x7fe5cc1a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:47.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5d0af2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe5cc10e410 con 0x7fe5cc103c20 2024-04-25T13:41:47.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5d0af2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe5cc10e290 con 0x7fe5cc1029e0 2024-04-25T13:41:47.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5d0af2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5cc10e590 con 0x7fe5cc108920 2024-04-25T13:41:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5c3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc103c20 0x7fe5cc19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5c3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc103c20 0x7fe5cc19a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55330/0 (socket says 172.21.15.43:55330) 2024-04-25T13:41:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5cad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5cc108920 0x7fe5cc1a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5c3fff640 1 -- 172.21.15.43:0/2094392596 learned_addr learned my addr 172.21.15.43:0/2094392596 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5ca59c640 1 --2- 172.21.15.43:0/2094392596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5cc1029e0 0x7fe5cc19a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5cad9d640 1 -- 172.21.15.43:0/2094392596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5cc1029e0 msgr2=0x7fe5cc19a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5cad9d640 1 --2- 172.21.15.43:0/2094392596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5cc1029e0 0x7fe5cc19a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5cad9d640 1 -- 172.21.15.43:0/2094392596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc103c20 msgr2=0x7fe5cc19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5cad9d640 1 --2- 172.21.15.43:0/2094392596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc103c20 0x7fe5cc19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.969+0000 7fe5cad9d640 1 -- 172.21.15.43:0/2094392596 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5cc1a1ce0 con 0x7fe5cc108920 2024-04-25T13:41:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.970+0000 7fe5cad9d640 1 --2- 172.21.15.43:0/2094392596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5cc108920 0x7fe5cc1a1670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009fd0 tx=0x7fe5c400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.970+0000 7fe5c37fe640 1 -- 172.21.15.43:0/2094392596 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c400ce20 con 0x7fe5cc108920 2024-04-25T13:41:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.970+0000 7fe5c37fe640 1 -- 172.21.15.43:0/2094392596 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5c4005020 con 0x7fe5cc108920 2024-04-25T13:41:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.970+0000 7fe5d0af2640 1 -- 172.21.15.43:0/2094392596 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5cc1a1fd0 con 0x7fe5cc108920 2024-04-25T13:41:47.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.970+0000 7fe5c37fe640 1 -- 172.21.15.43:0/2094392596 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4010690 con 0x7fe5cc108920 2024-04-25T13:41:47.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.970+0000 7fe5d0af2640 1 -- 172.21.15.43:0/2094392596 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5cc1a2430 con 0x7fe5cc108920 2024-04-25T13:41:47.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.971+0000 7fe5d0af2640 1 -- 172.21.15.43:0/2094392596 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5cc1a26f0 con 0x7fe5cc108920 2024-04-25T13:41:47.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.972+0000 7fe5c37fe640 1 -- 172.21.15.43:0/2094392596 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fe5c4004a40 con 0x7fe5cc108920 2024-04-25T13:41:47.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.973+0000 7fe5c37fe640 1 --2- 172.21.15.43:0/2094392596 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5b80afaf0 0x7fe5b80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:47.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.973+0000 7fe5ca59c640 1 --2- 172.21.15.43:0/2094392596 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5b80afaf0 0x7fe5b80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:47.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.973+0000 7fe5c37fe640 1 -- 172.21.15.43:0/2094392596 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fe5c40def50 con 0x7fe5cc108920 2024-04-25T13:41:47.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.973+0000 7fe5ca59c640 1 --2- 172.21.15.43:0/2094392596 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5b80afaf0 0x7fe5b80b2000 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc1035e0 tx=0x7fe5bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:47.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:47.977+0000 7fe5c37fe640 1 -- 172.21.15.43:0/2094392596 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe5c40a7fc0 con 0x7fe5cc108920 2024-04-25T13:41:48.187 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:41:48 smithi175 podman[62791]: 2024-04-25 13:41:48.094306005 +0000 UTC m=+0.583955891 container init d610ee93c0250e4270c869e2bb5caa38dc4fa52bc9bd6d4ca30b3d5bf559d98c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.vendor=CentOS) 2024-04-25T13:41:48.187 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:41:48 smithi175 podman[62791]: 2024-04-25 13:41:48.097048495 +0000 UTC m=+0.586698387 container start d610ee93c0250e4270c869e2bb5caa38dc4fa52bc9bd6d4ca30b3d5bf559d98c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-c, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T13:41:48.187 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:41:48 smithi175 ceph-mds[62810]: -- 172.21.15.175:0/3105374009 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56432f6e3a40 con 0x56432f72b600 2024-04-25T13:41:48.187 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:41:48 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-c[62806]: starting mds.c at 2024-04-25T13:41:48.187 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:41:48 smithi175 bash[62791]: d610ee93c0250e4270c869e2bb5caa38dc4fa52bc9bd6d4ca30b3d5bf559d98c 2024-04-25T13:41:48.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:48.200+0000 7fe5d0af2640 1 -- 172.21.15.43:0/2094392596 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5cc1a28c0 con 0x7fe5cc108920 2024-04-25T13:41:48.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:48.201+0000 7fe5c37fe640 1 -- 172.21.15.43:0/2094392596 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5518 (secure 0 0 0) 0x7fe5c40a78c0 con 0x7fe5cc108920 2024-04-25T13:41:48.201 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:41:48.201 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-25T13:41:48.201 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 7 2024-04-25T13:41:48.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:48.204+0000 7fe5d0af2640 1 -- 172.21.15.43:0/2094392596 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5b80afaf0 msgr2=0x7fe5b80b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:48.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:48.204+0000 7fe5d0af2640 1 --2- 172.21.15.43:0/2094392596 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5b80afaf0 0x7fe5b80b2000 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc1035e0 tx=0x7fe5bc005f90 comp rx=0 tx=0).stop 2024-04-25T13:41:48.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:48.204+0000 7fe5d0af2640 1 -- 172.21.15.43:0/2094392596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5cc108920 msgr2=0x7fe5cc1a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:48.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:48.204+0000 7fe5d0af2640 1 --2- 172.21.15.43:0/2094392596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5cc108920 0x7fe5cc1a1670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009fd0 tx=0x7fe5c400ef10 comp rx=0 tx=0).stop 2024-04-25T13:41:48.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:48.204+0000 7fe5d0af2640 1 -- 172.21.15.43:0/2094392596 shutdown_connections 2024-04-25T13:41:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:48.204+0000 7fe5d0af2640 1 --2- 172.21.15.43:0/2094392596 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5b80afaf0 0x7fe5b80b2000 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:48.204+0000 7fe5d0af2640 1 --2- 172.21.15.43:0/2094392596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5cc108920 0x7fe5cc1a1670 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:48.204+0000 7fe5d0af2640 1 --2- 172.21.15.43:0/2094392596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc103c20 0x7fe5cc19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:48.204+0000 7fe5d0af2640 1 --2- 172.21.15.43:0/2094392596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5cc1029e0 0x7fe5cc19a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:48.204+0000 7fe5d0af2640 1 -- 172.21.15.43:0/2094392596 >> 172.21.15.43:0/2094392596 conn(0x7fe5cc0fdbf0 msgr2=0x7fe5cc074dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:48.204+0000 7fe5d0af2640 1 -- 172.21.15.43:0/2094392596 shutdown_connections 2024-04-25T13:41:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:48.204+0000 7fe5d0af2640 1 -- 172.21.15.43:0/2094392596 wait complete. 2024-04-25T13:41:48.611 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:41:48 smithi175 systemd[1]: Started Ceph mds.c for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:41:48.611 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:48 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2094392596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:48.611 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:48.611 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:48.611 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:48.611 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:48.611 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:48.612 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:48 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:48.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:48 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2094392596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:48.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:48.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:48.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:48.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:48.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:48.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:48 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:48.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:48 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2094392596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:48.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:48.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:48.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:48.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:48.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:48.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:48 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:49.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:49 smithi161 ceph-mon[32696]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:49.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:49 smithi161 ceph-mon[32696]: Deploying daemon mds.h on smithi161 2024-04-25T13:41:49.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:49 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.175:6836/2732559521,v1:172.21.15.175:6837/2732559521] up:boot 2024-04-25T13:41:49.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:49 smithi161 ceph-mon[32696]: fsmap 7 up:standby 2024-04-25T13:41:49.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:49 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T13:41:49.628 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:49 smithi043 ceph-mon[29195]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:49.628 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:49 smithi043 ceph-mon[29195]: Deploying daemon mds.h on smithi161 2024-04-25T13:41:49.628 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:49 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.175:6836/2732559521,v1:172.21.15.175:6837/2732559521] up:boot 2024-04-25T13:41:49.628 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:49 smithi043 ceph-mon[29195]: fsmap 7 up:standby 2024-04-25T13:41:49.628 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:49 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T13:41:49.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:49 smithi175 ceph-mon[32649]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:49.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:49 smithi175 ceph-mon[32649]: Deploying daemon mds.h on smithi161 2024-04-25T13:41:49.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:49 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.175:6836/2732559521,v1:172.21.15.175:6837/2732559521] up:boot 2024-04-25T13:41:49.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:49 smithi175 ceph-mon[32649]: fsmap 7 up:standby 2024-04-25T13:41:49.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:49 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T13:41:50.216 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:50.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.332+0000 7fe4364d8640 1 -- 172.21.15.43:0/4291778989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe430108900 msgr2=0x7fe43010ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:50.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.332+0000 7fe4364d8640 1 --2- 172.21.15.43:0/4291778989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe430108900 0x7fe43010ad20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe428009ca0 tx=0x7fe42802a8c0 comp rx=0 tx=0).stop 2024-04-25T13:41:50.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.332+0000 7fe4364d8640 1 -- 172.21.15.43:0/4291778989 shutdown_connections 2024-04-25T13:41:50.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.332+0000 7fe4364d8640 1 --2- 172.21.15.43:0/4291778989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe430108900 0x7fe43010ad20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:50.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.332+0000 7fe4364d8640 1 --2- 172.21.15.43:0/4291778989 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe430103c00 0x7fe430104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:50.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.332+0000 7fe4364d8640 1 --2- 172.21.15.43:0/4291778989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4301029c0 0x7fe4301036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:50.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.332+0000 7fe4364d8640 1 -- 172.21.15.43:0/4291778989 >> 172.21.15.43:0/4291778989 conn(0x7fe4300fdbd0 msgr2=0x7fe430100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:50.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.332+0000 7fe4364d8640 1 -- 172.21.15.43:0/4291778989 shutdown_connections 2024-04-25T13:41:50.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.332+0000 7fe4364d8640 1 -- 172.21.15.43:0/4291778989 wait complete. 2024-04-25T13:41:50.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.333+0000 7fe4364d8640 1 Processor -- start 2024-04-25T13:41:50.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.333+0000 7fe4364d8640 1 -- start start 2024-04-25T13:41:50.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.333+0000 7fe4364d8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4301029c0 0x7fe43006a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:50.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.333+0000 7fe4364d8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe430103c00 0x7fe43019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:50.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.333+0000 7fe4364d8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe430108900 0x7fe4301a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:50.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.333+0000 7fe4364d8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe43010e3f0 con 0x7fe4301029c0 2024-04-25T13:41:50.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.333+0000 7fe4364d8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe43010e270 con 0x7fe430108900 2024-04-25T13:41:50.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.333+0000 7fe4364d8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe43010e570 con 0x7fe430103c00 2024-04-25T13:41:50.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe42ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4301029c0 0x7fe43006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:50.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe42ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4301029c0 0x7fe43006a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37036/0 (socket says 172.21.15.43:37036) 2024-04-25T13:41:50.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe42ffff640 1 -- 172.21.15.43:0/343416460 learned_addr learned my addr 172.21.15.43:0/343416460 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:50.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe434a75640 1 --2- 172.21.15.43:0/343416460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe430108900 0x7fe4301a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:50.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe42f7fe640 1 --2- 172.21.15.43:0/343416460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe430103c00 0x7fe43019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:50.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe42ffff640 1 -- 172.21.15.43:0/343416460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe430103c00 msgr2=0x7fe43019eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:50.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe42ffff640 1 --2- 172.21.15.43:0/343416460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe430103c00 0x7fe43019eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:50.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe42ffff640 1 -- 172.21.15.43:0/343416460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe430108900 msgr2=0x7fe4301a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:50.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe42ffff640 1 --2- 172.21.15.43:0/343416460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe430108900 0x7fe4301a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:50.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe42ffff640 1 -- 172.21.15.43:0/343416460 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4301a1c10 con 0x7fe4301029c0 2024-04-25T13:41:50.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe42f7fe640 1 --2- 172.21.15.43:0/343416460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe430103c00 0x7fe43019eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:50.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe42ffff640 1 --2- 172.21.15.43:0/343416460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4301029c0 0x7fe43006a900 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe420005d00 tx=0x7fe42000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:50.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe42d7fa640 1 -- 172.21.15.43:0/343416460 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420017070 con 0x7fe4301029c0 2024-04-25T13:41:50.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe42d7fa640 1 -- 172.21.15.43:0/343416460 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe420009c30 con 0x7fe4301029c0 2024-04-25T13:41:50.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe4364d8640 1 -- 172.21.15.43:0/343416460 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4301a1f00 con 0x7fe4301029c0 2024-04-25T13:41:50.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe42d7fa640 1 -- 172.21.15.43:0/343416460 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42000f620 con 0x7fe4301029c0 2024-04-25T13:41:50.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.334+0000 7fe4364d8640 1 -- 172.21.15.43:0/343416460 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4301a2360 con 0x7fe4301029c0 2024-04-25T13:41:50.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.335+0000 7fe4364d8640 1 -- 172.21.15.43:0/343416460 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe430107710 con 0x7fe4301029c0 2024-04-25T13:41:50.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.337+0000 7fe42d7fa640 1 -- 172.21.15.43:0/343416460 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fe42001a070 con 0x7fe4301029c0 2024-04-25T13:41:50.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.338+0000 7fe42d7fa640 1 --2- 172.21.15.43:0/343416460 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe4180afaf0 0x7fe4180b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:50.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.338+0000 7fe42f7fe640 1 --2- 172.21.15.43:0/343416460 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe4180afaf0 0x7fe4180b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:50.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.338+0000 7fe42d7fa640 1 -- 172.21.15.43:0/343416460 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fe4200de250 con 0x7fe4301029c0 2024-04-25T13:41:50.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.338+0000 7fe42f7fe640 1 --2- 172.21.15.43:0/343416460 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe4180afaf0 0x7fe4180b2000 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe43006a2a0 tx=0x7fe424005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:50.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.341+0000 7fe42d7fa640 1 -- 172.21.15.43:0/343416460 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe420009de0 con 0x7fe4301029c0 2024-04-25T13:41:50.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.569+0000 7fe4364d8640 1 -- 172.21.15.43:0/343416460 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe43002db50 con 0x7fe4301029c0 2024-04-25T13:41:50.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.570+0000 7fe42d7fa640 1 -- 172.21.15.43:0/343416460 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6346 (secure 0 0 0) 0x7fe4200a7230 con 0x7fe4301029c0 2024-04-25T13:41:50.569 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:41:50.570 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-25T13:41:50.570 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 8 2024-04-25T13:41:50.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.572+0000 7fe4364d8640 1 -- 172.21.15.43:0/343416460 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe4180afaf0 msgr2=0x7fe4180b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:50.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.572+0000 7fe4364d8640 1 --2- 172.21.15.43:0/343416460 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe4180afaf0 0x7fe4180b2000 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe43006a2a0 tx=0x7fe424005f90 comp rx=0 tx=0).stop 2024-04-25T13:41:50.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.572+0000 7fe4364d8640 1 -- 172.21.15.43:0/343416460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4301029c0 msgr2=0x7fe43006a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:50.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.572+0000 7fe4364d8640 1 --2- 172.21.15.43:0/343416460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4301029c0 0x7fe43006a900 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe420005d00 tx=0x7fe42000dde0 comp rx=0 tx=0).stop 2024-04-25T13:41:50.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.573+0000 7fe4364d8640 1 -- 172.21.15.43:0/343416460 shutdown_connections 2024-04-25T13:41:50.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.573+0000 7fe4364d8640 1 --2- 172.21.15.43:0/343416460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe430108900 0x7fe4301a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:50.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.573+0000 7fe4364d8640 1 --2- 172.21.15.43:0/343416460 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe4180afaf0 0x7fe4180b2000 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:50.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.573+0000 7fe4364d8640 1 --2- 172.21.15.43:0/343416460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe430103c00 0x7fe43019eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:50.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.573+0000 7fe4364d8640 1 --2- 172.21.15.43:0/343416460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4301029c0 0x7fe43006a900 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:50.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.573+0000 7fe4364d8640 1 -- 172.21.15.43:0/343416460 >> 172.21.15.43:0/343416460 conn(0x7fe4300fdbd0 msgr2=0x7fe4301048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:50.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.573+0000 7fe4364d8640 1 -- 172.21.15.43:0/343416460 shutdown_connections 2024-04-25T13:41:50.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:50.573+0000 7fe4364d8640 1 -- 172.21.15.43:0/343416460 wait complete. 2024-04-25T13:41:50.745 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:41:50 smithi161 systemd[1]: Starting Ceph mds.h for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:41:51.032 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:41:50 smithi161 podman[62791]: 2024-04-25 13:41:50.64854257 +0000 UTC m=+0.018459018 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:41:51.032 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:41:50 smithi161 podman[62791]: 2024-04-25 13:41:50.772161899 +0000 UTC m=+0.142078377 container create a7774c16359258fcf9e6667086584dc8c221469d2faf6c5d62db0939427f9b89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-04-25T13:41:51.352 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:41:51 smithi161 podman[62791]: 2024-04-25 13:41:51.032986193 +0000 UTC m=+0.402902626 container init a7774c16359258fcf9e6667086584dc8c221469d2faf6c5d62db0939427f9b89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-25T13:41:51.352 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:41:51 smithi161 podman[62791]: 2024-04-25 13:41:51.035694452 +0000 UTC m=+0.405610892 container start a7774c16359258fcf9e6667086584dc8c221469d2faf6c5d62db0939427f9b89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-h, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T13:41:51.352 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:41:51 smithi161 ceph-mds[62810]: -- 172.21.15.161:0/4272769395 <== mon.2 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ba52d63a40 con 0x55ba52dab600 2024-04-25T13:41:51.353 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:41:51 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-h[62806]: starting mds.h at 2024-04-25T13:41:51.353 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:41:51 smithi161 bash[62791]: a7774c16359258fcf9e6667086584dc8c221469d2faf6c5d62db0939427f9b89 2024-04-25T13:41:51.353 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:41:51 smithi161 systemd[1]: Started Ceph mds.h for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:41:51.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:51 smithi175 ceph-mon[32649]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:51.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:51 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/343416460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:51.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:51.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:51.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:51.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:51.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:51.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:51 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:51.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:51 smithi043 ceph-mon[29195]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:51.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:51 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/343416460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:51.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:51.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:51.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:51.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:51.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:51.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:51 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:51.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:51 smithi161 ceph-mon[32696]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:51.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:51 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/343416460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:51.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:51.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:51.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:51.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:51.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:51.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:51 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:52.584 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:52.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:52 smithi175 ceph-mon[32649]: Deploying daemon mds.i on smithi175 2024-04-25T13:41:52.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:52 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] up:boot 2024-04-25T13:41:52.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:52 smithi175 ceph-mon[32649]: fsmap 8 up:standby 2024-04-25T13:41:52.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:52 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T13:41:52.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.711+0000 7f7cde39d640 1 -- 172.21.15.43:0/2190476777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd8102880 msgr2=0x7f7cd8103580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:52.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.711+0000 7f7cde39d640 1 --2- 172.21.15.43:0/2190476777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd8102880 0x7f7cd8103580 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009900 tx=0x7f7cd402a410 comp rx=0 tx=0).stop 2024-04-25T13:41:52.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.711+0000 7f7cde39d640 1 -- 172.21.15.43:0/2190476777 shutdown_connections 2024-04-25T13:41:52.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.711+0000 7f7cde39d640 1 --2- 172.21.15.43:0/2190476777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cd81087c0 0x7f7cd810abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:52.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.711+0000 7f7cde39d640 1 --2- 172.21.15.43:0/2190476777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd8103ac0 0x7f7cd8103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:52.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.711+0000 7f7cde39d640 1 --2- 172.21.15.43:0/2190476777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd8102880 0x7f7cd8103580 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:52.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.711+0000 7f7cde39d640 1 -- 172.21.15.43:0/2190476777 >> 172.21.15.43:0/2190476777 conn(0x7f7cd80fda70 msgr2=0x7f7cd80fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:52.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.712+0000 7f7cde39d640 1 -- 172.21.15.43:0/2190476777 shutdown_connections 2024-04-25T13:41:52.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.712+0000 7f7cde39d640 1 -- 172.21.15.43:0/2190476777 wait complete. 2024-04-25T13:41:52.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.712+0000 7f7cde39d640 1 Processor -- start 2024-04-25T13:41:52.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.712+0000 7f7cde39d640 1 -- start start 2024-04-25T13:41:52.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.712+0000 7f7cde39d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd8102880 0x7f7cd8199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:52.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.712+0000 7f7cde39d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cd8103ac0 0x7f7cd819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:52.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.712+0000 7f7cde39d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd81087c0 0x7f7cd81a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:52.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.712+0000 7f7cde39d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd810e1c0 con 0x7f7cd8102880 2024-04-25T13:41:52.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.712+0000 7f7cde39d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd810e040 con 0x7f7cd8103ac0 2024-04-25T13:41:52.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.712+0000 7f7cde39d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd810e340 con 0x7f7cd81087c0 2024-04-25T13:41:52.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.713+0000 7f7cdd39b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd8102880 0x7f7cd8199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:52.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.713+0000 7f7cdd39b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd8102880 0x7f7cd8199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37056/0 (socket says 172.21.15.43:37056) 2024-04-25T13:41:52.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.713+0000 7f7cdd39b640 1 -- 172.21.15.43:0/3246443628 learned_addr learned my addr 172.21.15.43:0/3246443628 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:52.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.713+0000 7f7cddb9c640 1 --2- 172.21.15.43:0/3246443628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd81087c0 0x7f7cd81a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:52.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.713+0000 7f7cdcb9a640 1 --2- 172.21.15.43:0/3246443628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cd8103ac0 0x7f7cd819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:52.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.713+0000 7f7cdd39b640 1 -- 172.21.15.43:0/3246443628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd81087c0 msgr2=0x7f7cd81a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:52.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.713+0000 7f7cdd39b640 1 --2- 172.21.15.43:0/3246443628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd81087c0 0x7f7cd81a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:52.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.713+0000 7f7cdd39b640 1 -- 172.21.15.43:0/3246443628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cd8103ac0 msgr2=0x7f7cd819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:52.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.713+0000 7f7cdd39b640 1 --2- 172.21.15.43:0/3246443628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cd8103ac0 0x7f7cd819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:52.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.713+0000 7f7cdd39b640 1 -- 172.21.15.43:0/3246443628 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd81a1a60 con 0x7f7cd8102880 2024-04-25T13:41:52.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.713+0000 7f7cdcb9a640 1 --2- 172.21.15.43:0/3246443628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cd8103ac0 0x7f7cd819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:52.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:52 smithi043 ceph-mon[29195]: Deploying daemon mds.i on smithi175 2024-04-25T13:41:52.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:52 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] up:boot 2024-04-25T13:41:52.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:52 smithi043 ceph-mon[29195]: fsmap 8 up:standby 2024-04-25T13:41:52.715 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:52 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T13:41:52.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.713+0000 7f7cdd39b640 1 --2- 172.21.15.43:0/3246443628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd8102880 0x7f7cd8199fd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4005760 tx=0x7f7cd4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:52.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.713+0000 7f7cce7fc640 1 -- 172.21.15.43:0/3246443628 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd403f030 con 0x7f7cd8102880 2024-04-25T13:41:52.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.713+0000 7f7cde39d640 1 -- 172.21.15.43:0/3246443628 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd81a1cf0 con 0x7f7cd8102880 2024-04-25T13:41:52.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.713+0000 7f7cce7fc640 1 -- 172.21.15.43:0/3246443628 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7cd4003a80 con 0x7f7cd8102880 2024-04-25T13:41:52.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.714+0000 7f7cce7fc640 1 -- 172.21.15.43:0/3246443628 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4035070 con 0x7f7cd8102880 2024-04-25T13:41:52.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.714+0000 7f7cde39d640 1 -- 172.21.15.43:0/3246443628 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd81a2180 con 0x7f7cd8102880 2024-04-25T13:41:52.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.715+0000 7f7cde39d640 1 -- 172.21.15.43:0/3246443628 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd81a2350 con 0x7f7cd8102880 2024-04-25T13:41:52.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.716+0000 7f7cce7fc640 1 -- 172.21.15.43:0/3246443628 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f7cd4042030 con 0x7f7cd8102880 2024-04-25T13:41:52.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.717+0000 7f7cce7fc640 1 --2- 172.21.15.43:0/3246443628 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f7cc40afae0 0x7f7cc40b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:52.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.717+0000 7f7cdcb9a640 1 --2- 172.21.15.43:0/3246443628 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f7cc40afae0 0x7f7cc40b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:52.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.717+0000 7f7cce7fc640 1 -- 172.21.15.43:0/3246443628 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f7cd40ff340 con 0x7f7cd8102880 2024-04-25T13:41:52.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.717+0000 7f7cdcb9a640 1 --2- 172.21.15.43:0/3246443628 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f7cc40afae0 0x7f7cc40b1ff0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8005fd0 tx=0x7f7cc8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:52.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.721+0000 7f7cce7fc640 1 -- 172.21.15.43:0/3246443628 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7cd40c8320 con 0x7f7cd8102880 2024-04-25T13:41:52.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:52 smithi161 ceph-mon[32696]: Deploying daemon mds.i on smithi175 2024-04-25T13:41:52.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:52 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] up:boot 2024-04-25T13:41:52.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:52 smithi161 ceph-mon[32696]: fsmap 8 up:standby 2024-04-25T13:41:52.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:52 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T13:41:52.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.947+0000 7f7cde39d640 1 -- 172.21.15.43:0/3246443628 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cd81a26e0 con 0x7f7cd8102880 2024-04-25T13:41:52.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.947+0000 7f7cce7fc640 1 -- 172.21.15.43:0/3246443628 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7174 (secure 0 0 0) 0x7f7cd40c7c20 con 0x7f7cd8102880 2024-04-25T13:41:52.947 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:41:52.947 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24509,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1464384320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1464384320},{"type":"v1","addr":"172.21.15.161:6837","nonce":1464384320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-25T13:41:52.947 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2024-04-25T13:41:52.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.950+0000 7f7cde39d640 1 -- 172.21.15.43:0/3246443628 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f7cc40afae0 msgr2=0x7f7cc40b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:52.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.950+0000 7f7cde39d640 1 --2- 172.21.15.43:0/3246443628 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f7cc40afae0 0x7f7cc40b1ff0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8005fd0 tx=0x7f7cc8005850 comp rx=0 tx=0).stop 2024-04-25T13:41:52.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.950+0000 7f7cde39d640 1 -- 172.21.15.43:0/3246443628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd8102880 msgr2=0x7f7cd8199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:52.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.950+0000 7f7cde39d640 1 --2- 172.21.15.43:0/3246443628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd8102880 0x7f7cd8199fd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4005760 tx=0x7f7cd4004270 comp rx=0 tx=0).stop 2024-04-25T13:41:52.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.950+0000 7f7cde39d640 1 -- 172.21.15.43:0/3246443628 shutdown_connections 2024-04-25T13:41:52.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.950+0000 7f7cde39d640 1 --2- 172.21.15.43:0/3246443628 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f7cc40afae0 0x7f7cc40b1ff0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:52.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.950+0000 7f7cde39d640 1 --2- 172.21.15.43:0/3246443628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd81087c0 0x7f7cd81a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:52.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.950+0000 7f7cde39d640 1 --2- 172.21.15.43:0/3246443628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cd8103ac0 0x7f7cd819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:52.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.950+0000 7f7cde39d640 1 --2- 172.21.15.43:0/3246443628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd8102880 0x7f7cd8199fd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:52.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.950+0000 7f7cde39d640 1 -- 172.21.15.43:0/3246443628 >> 172.21.15.43:0/3246443628 conn(0x7f7cd80fda70 msgr2=0x7f7cd8109e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:52.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.950+0000 7f7cde39d640 1 -- 172.21.15.43:0/3246443628 shutdown_connections 2024-04-25T13:41:52.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:52.950+0000 7f7cde39d640 1 -- 172.21.15.43:0/3246443628 wait complete. 2024-04-25T13:41:53.667 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:53 smithi175 ceph-mon[32649]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:53.667 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:53 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3246443628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:53.667 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:41:53 smithi175 systemd[1]: Starting Ceph mds.i for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:41:53.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:53 smithi043 ceph-mon[29195]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:53.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:53 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3246443628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:53.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:53 smithi161 ceph-mon[32696]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:53.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:53 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3246443628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:53.930 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:41:53 smithi175 podman[63098]: 2024-04-25 13:41:53.570594795 +0000 UTC m=+0.017774383 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:41:53.930 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:41:53 smithi175 podman[63098]: 2024-04-25 13:41:53.693822579 +0000 UTC m=+0.141002184 container create 62894fc2b3e920ff1f6c7f6fbe4f14cebd202c8ebd171bad50d8a125131a04ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-04-25T13:41:54.430 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:41:53 smithi175 podman[63098]: 2024-04-25 13:41:53.959055753 +0000 UTC m=+0.406235321 container init 62894fc2b3e920ff1f6c7f6fbe4f14cebd202c8ebd171bad50d8a125131a04ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-i, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-04-25T13:41:54.430 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:41:53 smithi175 podman[63098]: 2024-04-25 13:41:53.961658592 +0000 UTC m=+0.408838157 container start 62894fc2b3e920ff1f6c7f6fbe4f14cebd202c8ebd171bad50d8a125131a04ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-25T13:41:54.430 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:41:53 smithi175 ceph-mds[63117]: -- 172.21.15.175:0/1584073498 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d54357ba40 con 0x55d5435c3180 2024-04-25T13:41:54.431 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:41:53 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-i[63113]: starting mds.i at 2024-04-25T13:41:54.431 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:41:54 smithi175 bash[63098]: 62894fc2b3e920ff1f6c7f6fbe4f14cebd202c8ebd171bad50d8a125131a04ac 2024-04-25T13:41:54.431 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:41:54 smithi175 systemd[1]: Started Ceph mds.i for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:41:54.960 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.074+0000 7f0aeb37d640 1 -- 172.21.15.43:0/2419194717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ae40760a0 msgr2=0x7f0ae40764b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.074+0000 7f0aeb37d640 1 --2- 172.21.15.43:0/2419194717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ae40760a0 0x7f0ae40764b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009900 tx=0x7f0adc02a410 comp rx=0 tx=0).stop 2024-04-25T13:41:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.074+0000 7f0aeb37d640 1 -- 172.21.15.43:0/2419194717 shutdown_connections 2024-04-25T13:41:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.074+0000 7f0aeb37d640 1 --2- 172.21.15.43:0/2419194717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ae4110260 0x7f0ae4112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.074+0000 7f0aeb37d640 1 --2- 172.21.15.43:0/2419194717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ae40769f0 0x7f0ae410fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.074+0000 7f0aeb37d640 1 --2- 172.21.15.43:0/2419194717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ae40760a0 0x7f0ae40764b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.074+0000 7f0aeb37d640 1 -- 172.21.15.43:0/2419194717 >> 172.21.15.43:0/2419194717 conn(0x7f0ae40fed10 msgr2=0x7f0ae41011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.074+0000 7f0aeb37d640 1 -- 172.21.15.43:0/2419194717 shutdown_connections 2024-04-25T13:41:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.074+0000 7f0aeb37d640 1 -- 172.21.15.43:0/2419194717 wait complete. 2024-04-25T13:41:55.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.075+0000 7f0aeb37d640 1 Processor -- start 2024-04-25T13:41:55.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.075+0000 7f0aeb37d640 1 -- start start 2024-04-25T13:41:55.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.075+0000 7f0aeb37d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ae40760a0 0x7f0ae41a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:55.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.075+0000 7f0aeb37d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ae40769f0 0x7f0ae41a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:55.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.075+0000 7f0aeb37d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ae4110260 0x7f0ae41a7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:55.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.075+0000 7f0aeb37d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae4115af0 con 0x7f0ae4110260 2024-04-25T13:41:55.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.075+0000 7f0aeb37d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae4115970 con 0x7f0ae40769f0 2024-04-25T13:41:55.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.075+0000 7f0aeb37d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae4115c70 con 0x7f0ae40760a0 2024-04-25T13:41:55.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.075+0000 7f0ae991a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ae4110260 0x7f0ae41a7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:55.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.075+0000 7f0ae991a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ae4110260 0x7f0ae41a7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37078/0 (socket says 172.21.15.43:37078) 2024-04-25T13:41:55.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.076+0000 7f0ae991a640 1 -- 172.21.15.43:0/552391631 learned_addr learned my addr 172.21.15.43:0/552391631 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:55.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.076+0000 7f0ae8918640 1 --2- 172.21.15.43:0/552391631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ae40769f0 0x7f0ae41a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:55.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.076+0000 7f0ae9119640 1 --2- 172.21.15.43:0/552391631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ae40760a0 0x7f0ae41a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:55.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.076+0000 7f0ae991a640 1 -- 172.21.15.43:0/552391631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ae40760a0 msgr2=0x7f0ae41a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:55.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.076+0000 7f0ae991a640 1 --2- 172.21.15.43:0/552391631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ae40760a0 0x7f0ae41a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:55.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.076+0000 7f0ae991a640 1 -- 172.21.15.43:0/552391631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ae40769f0 msgr2=0x7f0ae41a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:55.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.076+0000 7f0ae991a640 1 --2- 172.21.15.43:0/552391631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ae40769f0 0x7f0ae41a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:55.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.076+0000 7f0ae991a640 1 -- 172.21.15.43:0/552391631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae41a8280 con 0x7f0ae4110260 2024-04-25T13:41:55.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.076+0000 7f0ae9119640 1 --2- 172.21.15.43:0/552391631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ae40760a0 0x7f0ae41a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:55.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.076+0000 7f0ae8918640 1 --2- 172.21.15.43:0/552391631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ae40769f0 0x7f0ae41a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:55.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.076+0000 7f0ae991a640 1 --2- 172.21.15.43:0/552391631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ae4110260 0x7f0ae41a7cc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400ccb0 tx=0x7f0ad400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:55.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.076+0000 7f0ae27fc640 1 -- 172.21.15.43:0/552391631 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400f450 con 0x7f0ae4110260 2024-04-25T13:41:55.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.076+0000 7f0ae27fc640 1 -- 172.21.15.43:0/552391631 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ad400fa80 con 0x7f0ae4110260 2024-04-25T13:41:55.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.076+0000 7f0ae27fc640 1 -- 172.21.15.43:0/552391631 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4018a40 con 0x7f0ae4110260 2024-04-25T13:41:55.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.076+0000 7f0aeb37d640 1 -- 172.21.15.43:0/552391631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae41a8570 con 0x7f0ae4110260 2024-04-25T13:41:55.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.076+0000 7f0aeb37d640 1 -- 172.21.15.43:0/552391631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae41a8b10 con 0x7f0ae4110260 2024-04-25T13:41:55.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.077+0000 7f0aeb37d640 1 -- 172.21.15.43:0/552391631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ae4105ef0 con 0x7f0ae4110260 2024-04-25T13:41:55.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.079+0000 7f0ae27fc640 1 -- 172.21.15.43:0/552391631 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f0ad400fc30 con 0x7f0ae4110260 2024-04-25T13:41:55.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.079+0000 7f0ae27fc640 1 --2- 172.21.15.43:0/552391631 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0acc0afb70 0x7f0acc0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:55.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.080+0000 7f0ae9119640 1 --2- 172.21.15.43:0/552391631 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0acc0afb70 0x7f0acc0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:55.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.080+0000 7f0ae27fc640 1 -- 172.21.15.43:0/552391631 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f0ad40deba0 con 0x7f0ae4110260 2024-04-25T13:41:55.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.080+0000 7f0ae9119640 1 --2- 172.21.15.43:0/552391631 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0acc0afb70 0x7f0acc0b2080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0adc006010 tx=0x7f0adc005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:55.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.085+0000 7f0ae27fc640 1 -- 172.21.15.43:0/552391631 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0ad4014030 con 0x7f0ae4110260 2024-04-25T13:41:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.312+0000 7f0aeb37d640 1 -- 172.21.15.43:0/552391631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ae402db50 con 0x7f0ae4110260 2024-04-25T13:41:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.313+0000 7f0ae27fc640 1 -- 172.21.15.43:0/552391631 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8004 (secure 0 0 0) 0x7f0ad40a7ca0 con 0x7f0ae4110260 2024-04-25T13:41:55.312 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:41:55.313 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/3323587585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3323587585},{"type":"v1","addr":"172.21.15.175:6839","nonce":3323587585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24509,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1464384320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1464384320},{"type":"v1","addr":"172.21.15.161:6837","nonce":1464384320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-25T13:41:55.313 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 10 2024-04-25T13:41:55.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.315+0000 7f0aeb37d640 1 -- 172.21.15.43:0/552391631 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0acc0afb70 msgr2=0x7f0acc0b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:55.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.315+0000 7f0aeb37d640 1 --2- 172.21.15.43:0/552391631 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0acc0afb70 0x7f0acc0b2080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0adc006010 tx=0x7f0adc005d50 comp rx=0 tx=0).stop 2024-04-25T13:41:55.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.315+0000 7f0aeb37d640 1 -- 172.21.15.43:0/552391631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ae4110260 msgr2=0x7f0ae41a7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:55.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.315+0000 7f0aeb37d640 1 --2- 172.21.15.43:0/552391631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ae4110260 0x7f0ae41a7cc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400ccb0 tx=0x7f0ad400a620 comp rx=0 tx=0).stop 2024-04-25T13:41:55.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.315+0000 7f0aeb37d640 1 -- 172.21.15.43:0/552391631 shutdown_connections 2024-04-25T13:41:55.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.315+0000 7f0aeb37d640 1 --2- 172.21.15.43:0/552391631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ae4110260 0x7f0ae41a7cc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:55.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.315+0000 7f0aeb37d640 1 --2- 172.21.15.43:0/552391631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ae40769f0 0x7f0ae41a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:55.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.315+0000 7f0aeb37d640 1 --2- 172.21.15.43:0/552391631 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0acc0afb70 0x7f0acc0b2080 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:55.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.315+0000 7f0aeb37d640 1 --2- 172.21.15.43:0/552391631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ae40760a0 0x7f0ae41a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:55.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.315+0000 7f0aeb37d640 1 -- 172.21.15.43:0/552391631 >> 172.21.15.43:0/552391631 conn(0x7f0ae40fed10 msgr2=0x7f0ae41030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:55.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.316+0000 7f0aeb37d640 1 -- 172.21.15.43:0/552391631 shutdown_connections 2024-04-25T13:41:55.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:55.316+0000 7f0aeb37d640 1 -- 172.21.15.43:0/552391631 wait complete. 2024-04-25T13:41:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:55 smithi175 ceph-mon[32649]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:55 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:55 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:55 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:55 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:55.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:55 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:55.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:55 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:55.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:55 smithi175 ceph-mon[32649]: Deploying daemon mds.g on smithi043 2024-04-25T13:41:55.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:55 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] up:boot 2024-04-25T13:41:55.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:55 smithi175 ceph-mon[32649]: fsmap 9 up:standby 2024-04-25T13:41:55.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:55 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T13:41:55.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:55 smithi043 ceph-mon[29195]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:55.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:55 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:55.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:55 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:55.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:55 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:55.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:55 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:55.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:55 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:55.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:55 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:55.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:55 smithi043 ceph-mon[29195]: Deploying daemon mds.g on smithi043 2024-04-25T13:41:55.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:55 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] up:boot 2024-04-25T13:41:55.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:55 smithi043 ceph-mon[29195]: fsmap 9 up:standby 2024-04-25T13:41:55.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:55 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T13:41:55.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:55 smithi161 ceph-mon[32696]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:55.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:55 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:55.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:55 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:55.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:55 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:55.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:55 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:55.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:55 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:55.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:55 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:55.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:55 smithi161 ceph-mon[32696]: Deploying daemon mds.g on smithi043 2024-04-25T13:41:55.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:55 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] up:boot 2024-04-25T13:41:55.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:55 smithi161 ceph-mon[32696]: fsmap 9 up:standby 2024-04-25T13:41:55.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:55 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T13:41:56.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:56 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/552391631' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:56.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:56 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/552391631' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:56.462 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 13:41:56 smithi043 systemd[1]: Starting Ceph mds.g for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:41:56.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:56 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/552391631' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:56.848 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 13:41:56 smithi043 podman[70452]: 2024-04-25 13:41:56.490467276 +0000 UTC m=+0.018682988 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:41:56.848 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 13:41:56 smithi043 podman[70452]: 2024-04-25 13:41:56.613132874 +0000 UTC m=+0.141348586 container create 4921775bc5ab0cc2b7fc82957996508cc433ee11fcb0f3ca361a73f63e60d951 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-g, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-25T13:41:56.848 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 13:41:56 smithi043 podman[70452]: 2024-04-25 13:41:56.849233109 +0000 UTC m=+0.377448840 container init 4921775bc5ab0cc2b7fc82957996508cc433ee11fcb0f3ca361a73f63e60d951 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-g, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T13:41:57.133 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 13:41:56 smithi043 podman[70452]: 2024-04-25 13:41:56.852422311 +0000 UTC m=+0.380638024 container start 4921775bc5ab0cc2b7fc82957996508cc433ee11fcb0f3ca361a73f63e60d951 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-g, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-04-25T13:41:57.133 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 13:41:56 smithi043 ceph-mds[70471]: -- 172.21.15.43:0/3725907552 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563702631a40 con 0x563702679600 2024-04-25T13:41:57.133 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 13:41:56 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-g[70467]: starting mds.g at 2024-04-25T13:41:57.133 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 13:41:56 smithi043 bash[70452]: 4921775bc5ab0cc2b7fc82957996508cc433ee11fcb0f3ca361a73f63e60d951 2024-04-25T13:41:57.133 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 13:41:56 smithi043 systemd[1]: Started Ceph mds.g for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:41:57.326 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:57 smithi175 ceph-mon[32649]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:57.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:57.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:57 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.442+0000 7f9cb226e640 1 -- 172.21.15.43:0/385462106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cac104d10 msgr2=0x7f9cac105120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.442+0000 7f9cb226e640 1 --2- 172.21.15.43:0/385462106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cac104d10 0x7f9cac105120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009900 tx=0x7f9c9c02a410 comp rx=0 tx=0).stop 2024-04-25T13:41:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.442+0000 7f9cb226e640 1 -- 172.21.15.43:0/385462106 shutdown_connections 2024-04-25T13:41:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.442+0000 7f9cb226e640 1 --2- 172.21.15.43:0/385462106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cac109a10 0x7f9cac10be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.442+0000 7f9cb226e640 1 --2- 172.21.15.43:0/385462106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cac104d10 0x7f9cac105120 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.442+0000 7f9cb226e640 1 --2- 172.21.15.43:0/385462106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cac103ad0 0x7f9cac1047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.442+0000 7f9cb226e640 1 -- 172.21.15.43:0/385462106 >> 172.21.15.43:0/385462106 conn(0x7f9cac0fecc0 msgr2=0x7f9cac101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.442+0000 7f9cb226e640 1 -- 172.21.15.43:0/385462106 shutdown_connections 2024-04-25T13:41:57.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.443+0000 7f9cb226e640 1 -- 172.21.15.43:0/385462106 wait complete. 2024-04-25T13:41:57.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.443+0000 7f9cb226e640 1 Processor -- start 2024-04-25T13:41:57.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.443+0000 7f9cb226e640 1 -- start start 2024-04-25T13:41:57.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cb226e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cac103ad0 0x7f9cac19a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:57.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cb226e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cac104d10 0x7f9cac19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:57.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cb226e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cac109a10 0x7f9cac1a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:57.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cb226e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9cac10f4b0 con 0x7f9cac104d10 2024-04-25T13:41:57.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cb226e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9cac10f330 con 0x7f9cac109a10 2024-04-25T13:41:57.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cb226e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9cac10f630 con 0x7f9cac103ad0 2024-04-25T13:41:57.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cab7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cac104d10 0x7f9cac19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:57.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cab7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cac104d10 0x7f9cac19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37110/0 (socket says 172.21.15.43:37110) 2024-04-25T13:41:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cab7fe640 1 -- 172.21.15.43:0/4289938222 learned_addr learned my addr 172.21.15.43:0/4289938222 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cb080b640 1 --2- 172.21.15.43:0/4289938222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cac109a10 0x7f9cac1a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cabfff640 1 --2- 172.21.15.43:0/4289938222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cac103ad0 0x7f9cac19a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cab7fe640 1 -- 172.21.15.43:0/4289938222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cac103ad0 msgr2=0x7f9cac19a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cab7fe640 1 --2- 172.21.15.43:0/4289938222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cac103ad0 0x7f9cac19a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cab7fe640 1 -- 172.21.15.43:0/4289938222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cac109a10 msgr2=0x7f9cac1a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cab7fe640 1 --2- 172.21.15.43:0/4289938222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cac109a10 0x7f9cac1a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cab7fe640 1 -- 172.21.15.43:0/4289938222 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cac1a1c60 con 0x7f9cac104d10 2024-04-25T13:41:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cabfff640 1 --2- 172.21.15.43:0/4289938222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cac103ad0 0x7f9cac19a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.444+0000 7f9cab7fe640 1 --2- 172.21.15.43:0/4289938222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cac104d10 0x7f9cac19a660 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009230 tx=0x7f9c9c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.445+0000 7f9ca97fa640 1 -- 172.21.15.43:0/4289938222 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c03f030 con 0x7f9cac104d10 2024-04-25T13:41:57.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.445+0000 7f9cb226e640 1 -- 172.21.15.43:0/4289938222 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cac1a1ef0 con 0x7f9cac104d10 2024-04-25T13:41:57.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.445+0000 7f9ca97fa640 1 -- 172.21.15.43:0/4289938222 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c9c0044c0 con 0x7f9cac104d10 2024-04-25T13:41:57.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.445+0000 7f9ca97fa640 1 -- 172.21.15.43:0/4289938222 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c035070 con 0x7f9cac104d10 2024-04-25T13:41:57.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.445+0000 7f9cb226e640 1 -- 172.21.15.43:0/4289938222 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cac1a2350 con 0x7f9cac104d10 2024-04-25T13:41:57.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.446+0000 7f9cb226e640 1 -- 172.21.15.43:0/4289938222 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cac108820 con 0x7f9cac104d10 2024-04-25T13:41:57.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.448+0000 7f9ca97fa640 1 -- 172.21.15.43:0/4289938222 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f9c9c042030 con 0x7f9cac104d10 2024-04-25T13:41:57.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.449+0000 7f9ca97fa640 1 --2- 172.21.15.43:0/4289938222 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9c980afaf0 0x7f9c980b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:57.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.449+0000 7f9cabfff640 1 --2- 172.21.15.43:0/4289938222 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9c980afaf0 0x7f9c980b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:57.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.449+0000 7f9ca97fa640 1 -- 172.21.15.43:0/4289938222 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f9c9c0ff1b0 con 0x7f9cac104d10 2024-04-25T13:41:57.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.449+0000 7f9cabfff640 1 --2- 172.21.15.43:0/4289938222 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9c980afaf0 0x7f9c980b2000 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9c940058c0 tx=0x7f9c94005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:57.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.452+0000 7f9ca97fa640 1 -- 172.21.15.43:0/4289938222 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9c9c0c8190 con 0x7f9cac104d10 2024-04-25T13:41:57.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:57 smithi043 ceph-mon[29195]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:57.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:57.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:57.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:57.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:57.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:57.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:57 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:57.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:57 smithi161 ceph-mon[32696]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:57.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:57.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:57.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:41:57.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:41:57.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:41:57.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:57 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:41:57.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.696+0000 7f9cb226e640 1 -- 172.21.15.43:0/4289938222 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cac02db50 con 0x7f9cac104d10 2024-04-25T13:41:57.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.696+0000 7f9ca97fa640 1 -- 172.21.15.43:0/4289938222 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8830 (secure 0 0 0) 0x7f9c9c0c7a90 con 0x7f9cac104d10 2024-04-25T13:41:57.696 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:41:57.697 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2642701222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2642701222},{"type":"v1","addr":"172.21.15.43:6839","nonce":2642701222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/3323587585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3323587585},{"type":"v1","addr":"172.21.15.175:6839","nonce":3323587585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24509,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1464384320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1464384320},{"type":"v1","addr":"172.21.15.161:6837","nonce":1464384320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-25T13:41:57.697 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 11 2024-04-25T13:41:57.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.698+0000 7f9cb226e640 1 -- 172.21.15.43:0/4289938222 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9c980afaf0 msgr2=0x7f9c980b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:57.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.698+0000 7f9cb226e640 1 --2- 172.21.15.43:0/4289938222 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9c980afaf0 0x7f9c980b2000 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9c940058c0 tx=0x7f9c94005850 comp rx=0 tx=0).stop 2024-04-25T13:41:57.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.698+0000 7f9cb226e640 1 -- 172.21.15.43:0/4289938222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cac104d10 msgr2=0x7f9cac19a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:57.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.698+0000 7f9cb226e640 1 --2- 172.21.15.43:0/4289938222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cac104d10 0x7f9cac19a660 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009230 tx=0x7f9c9c0040c0 comp rx=0 tx=0).stop 2024-04-25T13:41:57.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.698+0000 7f9cb226e640 1 -- 172.21.15.43:0/4289938222 shutdown_connections 2024-04-25T13:41:57.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.698+0000 7f9cb226e640 1 --2- 172.21.15.43:0/4289938222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cac109a10 0x7f9cac1a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:57.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.698+0000 7f9cb226e640 1 --2- 172.21.15.43:0/4289938222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cac104d10 0x7f9cac19a660 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:57.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.698+0000 7f9cb226e640 1 --2- 172.21.15.43:0/4289938222 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9c980afaf0 0x7f9c980b2000 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:57.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.698+0000 7f9cb226e640 1 --2- 172.21.15.43:0/4289938222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cac103ad0 0x7f9cac19a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:57.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.698+0000 7f9cb226e640 1 -- 172.21.15.43:0/4289938222 >> 172.21.15.43:0/4289938222 conn(0x7f9cac0fecc0 msgr2=0x7f9cac1059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:57.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.698+0000 7f9cb226e640 1 -- 172.21.15.43:0/4289938222 shutdown_connections 2024-04-25T13:41:57.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:57.698+0000 7f9cb226e640 1 -- 172.21.15.43:0/4289938222 wait complete. 2024-04-25T13:41:58.389 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:58 smithi043 ceph-mon[29195]: Deploying daemon mds.a on smithi043 2024-04-25T13:41:58.390 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:58 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.43:6838/2642701222,v1:172.21.15.43:6839/2642701222] up:boot 2024-04-25T13:41:58.390 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:58 smithi043 ceph-mon[29195]: fsmap 10 up:standby 2024-04-25T13:41:58.390 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T13:41:58.390 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:58 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/4289938222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:58.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:58 smithi175 ceph-mon[32649]: Deploying daemon mds.a on smithi043 2024-04-25T13:41:58.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:58 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.43:6838/2642701222,v1:172.21.15.43:6839/2642701222] up:boot 2024-04-25T13:41:58.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:58 smithi175 ceph-mon[32649]: fsmap 10 up:standby 2024-04-25T13:41:58.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T13:41:58.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:58 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/4289938222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:58.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:58 smithi161 ceph-mon[32696]: Deploying daemon mds.a on smithi043 2024-04-25T13:41:58.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:58 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.43:6838/2642701222,v1:172.21.15.43:6839/2642701222] up:boot 2024-04-25T13:41:58.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:58 smithi161 ceph-mon[32696]: fsmap 10 up:standby 2024-04-25T13:41:58.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T13:41:58.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:58 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/4289938222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:41:59.405 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:41:59 smithi043 ceph-mon[29195]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:59.406 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 13:41:59 smithi043 systemd[1]: Starting Ceph mds.a for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:41:59.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:41:59 smithi175 ceph-mon[32649]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:59.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:41:59 smithi161 ceph-mon[32696]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:41:59.674 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 13:41:59 smithi043 podman[70803]: 2024-04-25 13:41:59.30926633 +0000 UTC m=+0.018309655 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:41:59.674 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 13:41:59 smithi043 podman[70803]: 2024-04-25 13:41:59.410635536 +0000 UTC m=+0.119678823 container create 2f7c26f4bdf0627f1ebc60a65e443f677ed0df6cf09f97c2653ccbdf73e177d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-25T13:41:59.674 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 13:41:59 smithi043 podman[70803]: 2024-04-25 13:41:59.638513611 +0000 UTC m=+0.347556899 container init 2f7c26f4bdf0627f1ebc60a65e443f677ed0df6cf09f97c2653ccbdf73e177d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-a, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T13:41:59.674 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 13:41:59 smithi043 podman[70803]: 2024-04-25 13:41:59.641248489 +0000 UTC m=+0.350291778 container start 2f7c26f4bdf0627f1ebc60a65e443f677ed0df6cf09f97c2653ccbdf73e177d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-a, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T13:41:59.674 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 13:41:59 smithi043 ceph-mds[70823]: -- 172.21.15.43:0/2340688116 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55836574fa40 con 0x558365797180 2024-04-25T13:41:59.710 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:59.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.828+0000 7ff8ca0e0640 1 -- 172.21.15.43:0/2152252802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c4104d30 msgr2=0x7ff8c4105140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.828+0000 7ff8ca0e0640 1 --2- 172.21.15.43:0/2152252802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c4104d30 0x7ff8c4105140 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009900 tx=0x7ff8b802a410 comp rx=0 tx=0).stop 2024-04-25T13:41:59.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.828+0000 7ff8ca0e0640 1 -- 172.21.15.43:0/2152252802 shutdown_connections 2024-04-25T13:41:59.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.828+0000 7ff8ca0e0640 1 --2- 172.21.15.43:0/2152252802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8c4109a30 0x7ff8c410be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.828+0000 7ff8ca0e0640 1 --2- 172.21.15.43:0/2152252802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c4104d30 0x7ff8c4105140 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.828+0000 7ff8ca0e0640 1 --2- 172.21.15.43:0/2152252802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8c4103af0 0x7ff8c41047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.828+0000 7ff8ca0e0640 1 -- 172.21.15.43:0/2152252802 >> 172.21.15.43:0/2152252802 conn(0x7ff8c40fed40 msgr2=0x7ff8c4101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:59.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.828+0000 7ff8ca0e0640 1 -- 172.21.15.43:0/2152252802 shutdown_connections 2024-04-25T13:41:59.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.828+0000 7ff8ca0e0640 1 -- 172.21.15.43:0/2152252802 wait complete. 2024-04-25T13:41:59.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.829+0000 7ff8ca0e0640 1 Processor -- start 2024-04-25T13:41:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.829+0000 7ff8ca0e0640 1 -- start start 2024-04-25T13:41:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.829+0000 7ff8ca0e0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c4103af0 0x7ff8c419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.829+0000 7ff8ca0e0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8c4104d30 0x7ff8c419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.829+0000 7ff8ca0e0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8c4109a30 0x7ff8c41a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.829+0000 7ff8ca0e0640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c410f4c0 con 0x7ff8c4103af0 2024-04-25T13:41:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.829+0000 7ff8ca0e0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c410f340 con 0x7ff8c4109a30 2024-04-25T13:41:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.829+0000 7ff8ca0e0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c410f640 con 0x7ff8c4104d30 2024-04-25T13:41:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.829+0000 7ff8c37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c4103af0 0x7ff8c419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.829+0000 7ff8c37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c4103af0 0x7ff8c419a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57756/0 (socket says 172.21.15.43:57756) 2024-04-25T13:41:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.829+0000 7ff8c37fe640 1 -- 172.21.15.43:0/161918370 learned_addr learned my addr 172.21.15.43:0/161918370 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:41:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.830+0000 7ff8c3fff640 1 --2- 172.21.15.43:0/161918370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8c4109a30 0x7ff8c41a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.830+0000 7ff8c2ffd640 1 --2- 172.21.15.43:0/161918370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8c4104d30 0x7ff8c419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.830+0000 7ff8c37fe640 1 -- 172.21.15.43:0/161918370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8c4104d30 msgr2=0x7ff8c419a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.830+0000 7ff8c37fe640 1 --2- 172.21.15.43:0/161918370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8c4104d30 0x7ff8c419a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.830+0000 7ff8c37fe640 1 -- 172.21.15.43:0/161918370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8c4109a30 msgr2=0x7ff8c41a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.830+0000 7ff8c37fe640 1 --2- 172.21.15.43:0/161918370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8c4109a30 0x7ff8c41a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.830+0000 7ff8c37fe640 1 -- 172.21.15.43:0/161918370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c41a1c60 con 0x7ff8c4103af0 2024-04-25T13:41:59.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.830+0000 7ff8c3fff640 1 --2- 172.21.15.43:0/161918370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8c4109a30 0x7ff8c41a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:59.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.830+0000 7ff8c2ffd640 1 --2- 172.21.15.43:0/161918370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8c4104d30 0x7ff8c419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:59.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.830+0000 7ff8c37fe640 1 --2- 172.21.15.43:0/161918370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c4103af0 0x7ff8c419a120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400e9f0 tx=0x7ff8b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:59.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.830+0000 7ff8c0ff9640 1 -- 172.21.15.43:0/161918370 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b400ccc0 con 0x7ff8c4103af0 2024-04-25T13:41:59.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.830+0000 7ff8c0ff9640 1 -- 172.21.15.43:0/161918370 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8b40035f0 con 0x7ff8c4103af0 2024-04-25T13:41:59.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.830+0000 7ff8ca0e0640 1 -- 172.21.15.43:0/161918370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c41a1f50 con 0x7ff8c4103af0 2024-04-25T13:41:59.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.830+0000 7ff8c0ff9640 1 -- 172.21.15.43:0/161918370 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b400ce60 con 0x7ff8c4103af0 2024-04-25T13:41:59.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.830+0000 7ff8ca0e0640 1 -- 172.21.15.43:0/161918370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c41a2360 con 0x7ff8c4103af0 2024-04-25T13:41:59.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.831+0000 7ff8ca0e0640 1 -- 172.21.15.43:0/161918370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c406a1c0 con 0x7ff8c4103af0 2024-04-25T13:41:59.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.833+0000 7ff8c0ff9640 1 -- 172.21.15.43:0/161918370 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7ff8b4004000 con 0x7ff8c4103af0 2024-04-25T13:41:59.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.833+0000 7ff8c0ff9640 1 --2- 172.21.15.43:0/161918370 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff8ac0afaf0 0x7ff8ac0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.834+0000 7ff8c2ffd640 1 --2- 172.21.15.43:0/161918370 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff8ac0afaf0 0x7ff8ac0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.834+0000 7ff8c0ff9640 1 -- 172.21.15.43:0/161918370 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7ff8b40ded00 con 0x7ff8c4103af0 2024-04-25T13:41:59.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.834+0000 7ff8c2ffd640 1 --2- 172.21.15.43:0/161918370 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff8ac0afaf0 0x7ff8ac0b2000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8005f70 tx=0x7ff8b8005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:59.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:41:59.837+0000 7ff8c0ff9640 1 -- 172.21.15.43:0/161918370 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff8c406a1c0 con 0x7ff8c4103af0 2024-04-25T13:41:59.962 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 13:41:59 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-a[70819]: starting mds.a at 2024-04-25T13:41:59.962 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 13:41:59 smithi043 bash[70803]: 2f7c26f4bdf0627f1ebc60a65e443f677ed0df6cf09f97c2653ccbdf73e177d0 2024-04-25T13:41:59.962 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 13:41:59 smithi043 systemd[1]: Started Ceph mds.a for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:42:00.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:00.066+0000 7ff8ca0e0640 1 -- 172.21.15.43:0/161918370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8c402dc10 con 0x7ff8c4103af0 2024-04-25T13:42:00.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:00.066+0000 7ff8c0ff9640 1 -- 172.21.15.43:0/161918370 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8830 (secure 0 0 0) 0x7ff8b40a7d80 con 0x7ff8c4103af0 2024-04-25T13:42:00.066 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:00.067 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2642701222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2642701222},{"type":"v1","addr":"172.21.15.43:6839","nonce":2642701222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/3323587585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3323587585},{"type":"v1","addr":"172.21.15.175:6839","nonce":3323587585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24509,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1464384320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1464384320},{"type":"v1","addr":"172.21.15.161:6837","nonce":1464384320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-25T13:42:00.067 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 11 2024-04-25T13:42:00.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:00.068+0000 7ff8ca0e0640 1 -- 172.21.15.43:0/161918370 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff8ac0afaf0 msgr2=0x7ff8ac0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:00.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:00.068+0000 7ff8ca0e0640 1 --2- 172.21.15.43:0/161918370 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff8ac0afaf0 0x7ff8ac0b2000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8005f70 tx=0x7ff8b8005720 comp rx=0 tx=0).stop 2024-04-25T13:42:00.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:00.068+0000 7ff8ca0e0640 1 -- 172.21.15.43:0/161918370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c4103af0 msgr2=0x7ff8c419a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:00.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:00.068+0000 7ff8ca0e0640 1 --2- 172.21.15.43:0/161918370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c4103af0 0x7ff8c419a120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400e9f0 tx=0x7ff8b400eeb0 comp rx=0 tx=0).stop 2024-04-25T13:42:00.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:00.068+0000 7ff8ca0e0640 1 -- 172.21.15.43:0/161918370 shutdown_connections 2024-04-25T13:42:00.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:00.068+0000 7ff8ca0e0640 1 --2- 172.21.15.43:0/161918370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8c4109a30 0x7ff8c41a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:00.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:00.068+0000 7ff8ca0e0640 1 --2- 172.21.15.43:0/161918370 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff8ac0afaf0 0x7ff8ac0b2000 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:00.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:00.068+0000 7ff8ca0e0640 1 --2- 172.21.15.43:0/161918370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8c4104d30 0x7ff8c419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:00.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:00.068+0000 7ff8ca0e0640 1 --2- 172.21.15.43:0/161918370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff8c4103af0 0x7ff8c419a120 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:00.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:00.068+0000 7ff8ca0e0640 1 -- 172.21.15.43:0/161918370 >> 172.21.15.43:0/161918370 conn(0x7ff8c40fed40 msgr2=0x7ff8c4105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:00.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:00.068+0000 7ff8ca0e0640 1 -- 172.21.15.43:0/161918370 shutdown_connections 2024-04-25T13:42:00.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:00.068+0000 7ff8ca0e0640 1 -- 172.21.15.43:0/161918370 wait complete. 2024-04-25T13:42:01.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:42:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:42:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:42:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:00 smithi161 ceph-mon[32696]: Deploying daemon mds.b on smithi161 2024-04-25T13:42:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:00 smithi161 ceph-mon[32696]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:42:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:00 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/161918370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:00 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.43:6840/3777483996,v1:172.21.15.43:6841/3777483996] up:boot 2024-04-25T13:42:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:00 smithi161 ceph-mon[32696]: fsmap 11 up:standby 2024-04-25T13:42:01.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T13:42:01.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:01.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:01.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:01.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:42:01.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:42:01.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:42:01.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:00 smithi175 ceph-mon[32649]: Deploying daemon mds.b on smithi161 2024-04-25T13:42:01.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:00 smithi175 ceph-mon[32649]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:42:01.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:00 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/161918370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:01.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:00 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.43:6840/3777483996,v1:172.21.15.43:6841/3777483996] up:boot 2024-04-25T13:42:01.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:00 smithi175 ceph-mon[32649]: fsmap 11 up:standby 2024-04-25T13:42:01.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T13:42:01.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:01.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:01.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:01.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T13:42:01.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T13:42:01.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:42:01.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:00 smithi043 ceph-mon[29195]: Deploying daemon mds.b on smithi161 2024-04-25T13:42:01.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:00 smithi043 ceph-mon[29195]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:42:01.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:00 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/161918370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:01.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:00 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.43:6840/3777483996,v1:172.21.15.43:6841/3777483996] up:boot 2024-04-25T13:42:01.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:00 smithi043 ceph-mon[29195]: fsmap 11 up:standby 2024-04-25T13:42:01.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T13:42:02.080 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:42:02.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.207+0000 7f79714e0640 1 -- 172.21.15.43:0/4271019471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f796c106f10 msgr2=0x7f796c109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.207+0000 7f79714e0640 1 --2- 172.21.15.43:0/4271019471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f796c106f10 0x7f796c109330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7960009900 tx=0x7f796002a3f0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.207+0000 7f79714e0640 1 -- 172.21.15.43:0/4271019471 shutdown_connections 2024-04-25T13:42:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.207+0000 7f79714e0640 1 --2- 172.21.15.43:0/4271019471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f796c109870 0x7f796c10bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.207+0000 7f79714e0640 1 --2- 172.21.15.43:0/4271019471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f796c106f10 0x7f796c109330 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.207+0000 7f79714e0640 1 --2- 172.21.15.43:0/4271019471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f796c1045b0 0x7f796c1069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.207+0000 7f79714e0640 1 -- 172.21.15.43:0/4271019471 >> 172.21.15.43:0/4271019471 conn(0x7f796c0fdbd0 msgr2=0x7f796c100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.207+0000 7f79714e0640 1 -- 172.21.15.43:0/4271019471 shutdown_connections 2024-04-25T13:42:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.207+0000 7f79714e0640 1 -- 172.21.15.43:0/4271019471 wait complete. 2024-04-25T13:42:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.208+0000 7f79714e0640 1 Processor -- start 2024-04-25T13:42:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.208+0000 7f79714e0640 1 -- start start 2024-04-25T13:42:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.208+0000 7f79714e0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f796c1045b0 0x7f796c103a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:02.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.208+0000 7f79714e0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f796c106f10 0x7f796c1020a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:02.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.208+0000 7f79714e0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f796c109870 0x7f796c1025e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:02.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.208+0000 7f79714e0640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f796c10f510 con 0x7f796c1045b0 2024-04-25T13:42:02.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.208+0000 7f79714e0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f796c10f390 con 0x7f796c106f10 2024-04-25T13:42:02.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.208+0000 7f79714e0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f796c10f690 con 0x7f796c109870 2024-04-25T13:42:02.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.208+0000 7f796affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f796c1045b0 0x7f796c103a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:02.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.208+0000 7f796affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f796c1045b0 0x7f796c103a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57774/0 (socket says 172.21.15.43:57774) 2024-04-25T13:42:02.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.208+0000 7f796affd640 1 -- 172.21.15.43:0/2474192246 learned_addr learned my addr 172.21.15.43:0/2474192246 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:02.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.208+0000 7f796a7fc640 1 --2- 172.21.15.43:0/2474192246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f796c106f10 0x7f796c1020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:02.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.209+0000 7f796b7fe640 1 --2- 172.21.15.43:0/2474192246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f796c109870 0x7f796c1025e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:02.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.209+0000 7f796affd640 1 -- 172.21.15.43:0/2474192246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f796c109870 msgr2=0x7f796c1025e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.209+0000 7f796affd640 1 --2- 172.21.15.43:0/2474192246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f796c109870 0x7f796c1025e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.209+0000 7f796affd640 1 -- 172.21.15.43:0/2474192246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f796c106f10 msgr2=0x7f796c1020a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.209+0000 7f796affd640 1 --2- 172.21.15.43:0/2474192246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f796c106f10 0x7f796c1020a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.209+0000 7f796affd640 1 -- 172.21.15.43:0/2474192246 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f796c102c80 con 0x7f796c1045b0 2024-04-25T13:42:02.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.209+0000 7f796affd640 1 --2- 172.21.15.43:0/2474192246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f796c1045b0 0x7f796c103a00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f795c00c970 tx=0x7f795c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:02.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.209+0000 7f7953fff640 1 -- 172.21.15.43:0/2474192246 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c014070 con 0x7f796c1045b0 2024-04-25T13:42:02.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.209+0000 7f7953fff640 1 -- 172.21.15.43:0/2474192246 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f795c004440 con 0x7f796c1045b0 2024-04-25T13:42:02.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.209+0000 7f7953fff640 1 -- 172.21.15.43:0/2474192246 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c003d40 con 0x7f796c1045b0 2024-04-25T13:42:02.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.209+0000 7f79714e0640 1 -- 172.21.15.43:0/2474192246 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f796c1a4270 con 0x7f796c1045b0 2024-04-25T13:42:02.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.209+0000 7f79714e0640 1 -- 172.21.15.43:0/2474192246 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f796c1a4700 con 0x7f796c1045b0 2024-04-25T13:42:02.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.210+0000 7f79714e0640 1 -- 172.21.15.43:0/2474192246 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f796c0ff6f0 con 0x7f796c1045b0 2024-04-25T13:42:02.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.212+0000 7f7953fff640 1 -- 172.21.15.43:0/2474192246 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f795c017070 con 0x7f796c1045b0 2024-04-25T13:42:02.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.213+0000 7f7953fff640 1 --2- 172.21.15.43:0/2474192246 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f79540afaf0 0x7f79540b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:02.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.213+0000 7f796a7fc640 1 --2- 172.21.15.43:0/2474192246 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f79540afaf0 0x7f79540b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:02.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.213+0000 7f7953fff640 1 -- 172.21.15.43:0/2474192246 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f795c0dea60 con 0x7f796c1045b0 2024-04-25T13:42:02.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.213+0000 7f796a7fc640 1 --2- 172.21.15.43:0/2474192246 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f79540afaf0 0x7f79540b2000 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f796c1033a0 tx=0x7f7960000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:02.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.217+0000 7f7953fff640 1 -- 172.21.15.43:0/2474192246 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f795c01e020 con 0x7f796c1045b0 2024-04-25T13:42:02.353 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:42:02 smithi161 systemd[1]: Starting Ceph mds.b for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:42:02.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.443+0000 7f79714e0640 1 -- 172.21.15.43:0/2474192246 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f796c02db50 con 0x7f796c1045b0 2024-04-25T13:42:02.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.443+0000 7f7953fff640 1 -- 172.21.15.43:0/2474192246 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9656 (secure 0 0 0) 0x7f795c0a7ac0 con 0x7f796c1045b0 2024-04-25T13:42:02.443 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:02.444 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2642701222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2642701222},{"type":"v1","addr":"172.21.15.43:6839","nonce":2642701222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6841/3777483996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":3777483996},{"type":"v1","addr":"172.21.15.43:6841","nonce":3777483996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/3323587585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3323587585},{"type":"v1","addr":"172.21.15.175:6839","nonce":3323587585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24509,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1464384320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1464384320},{"type":"v1","addr":"172.21.15.161:6837","nonce":1464384320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-25T13:42:02.444 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 12 2024-04-25T13:42:02.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.445+0000 7f79714e0640 1 -- 172.21.15.43:0/2474192246 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f79540afaf0 msgr2=0x7f79540b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.445+0000 7f79714e0640 1 --2- 172.21.15.43:0/2474192246 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f79540afaf0 0x7f79540b2000 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f796c1033a0 tx=0x7f7960000bc0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.445+0000 7f79714e0640 1 -- 172.21.15.43:0/2474192246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f796c1045b0 msgr2=0x7f796c103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.445+0000 7f79714e0640 1 --2- 172.21.15.43:0/2474192246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f796c1045b0 0x7f796c103a00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f795c00c970 tx=0x7f795c00ce30 comp rx=0 tx=0).stop 2024-04-25T13:42:02.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.445+0000 7f79714e0640 1 -- 172.21.15.43:0/2474192246 shutdown_connections 2024-04-25T13:42:02.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.445+0000 7f79714e0640 1 --2- 172.21.15.43:0/2474192246 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f79540afaf0 0x7f79540b2000 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.445+0000 7f79714e0640 1 --2- 172.21.15.43:0/2474192246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f796c109870 0x7f796c1025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.445+0000 7f79714e0640 1 --2- 172.21.15.43:0/2474192246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f796c106f10 0x7f796c1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.445+0000 7f79714e0640 1 --2- 172.21.15.43:0/2474192246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f796c1045b0 0x7f796c103a00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.445+0000 7f79714e0640 1 -- 172.21.15.43:0/2474192246 >> 172.21.15.43:0/2474192246 conn(0x7f796c0fdbd0 msgr2=0x7f796c1065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:02.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.445+0000 7f79714e0640 1 -- 172.21.15.43:0/2474192246 shutdown_connections 2024-04-25T13:42:02.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:02.446+0000 7f79714e0640 1 -- 172.21.15.43:0/2474192246 wait complete. 2024-04-25T13:42:02.688 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:42:02 smithi161 podman[63104]: 2024-04-25 13:42:02.333748644 +0000 UTC m=+0.017935726 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:42:02.688 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:42:02 smithi161 podman[63104]: 2024-04-25 13:42:02.444853237 +0000 UTC m=+0.129040365 container create 86b9b2d5216230b6ecabf0ea77bde76edc5b42b101a1b2f17e79b41440972281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-25T13:42:02.688 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:42:02 smithi161 podman[63104]: 2024-04-25 13:42:02.689006263 +0000 UTC m=+0.373193346 container init 86b9b2d5216230b6ecabf0ea77bde76edc5b42b101a1b2f17e79b41440972281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-25T13:42:02.978 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:42:02 smithi161 podman[63104]: 2024-04-25 13:42:02.691719707 +0000 UTC m=+0.375906796 container start 86b9b2d5216230b6ecabf0ea77bde76edc5b42b101a1b2f17e79b41440972281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-25T13:42:02.978 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:42:02 smithi161 ceph-mds[63124]: -- 172.21.15.161:0/2624756549 <== mon.2 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a58f3b5a40 con 0x55a58f3fda80 2024-04-25T13:42:02.978 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:42:02 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-b[63120]: starting mds.b at 2024-04-25T13:42:02.978 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:42:02 smithi161 bash[63104]: 86b9b2d5216230b6ecabf0ea77bde76edc5b42b101a1b2f17e79b41440972281 2024-04-25T13:42:02.979 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:42:02 smithi161 systemd[1]: Started Ceph mds.b for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:42:03.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:02 smithi161 ceph-mon[32696]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:42:03.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:02 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2474192246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:03.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:02 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:02 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:02 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:02 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:02 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:02 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:02 smithi175 ceph-mon[32649]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:42:03.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:02 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2474192246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:03.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:02 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:02 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:02 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:02 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:02 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:02 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:02 smithi043 ceph-mon[29195]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:42:03.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:02 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2474192246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:03.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:02 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:02 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:02 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:02 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:02 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:03.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:02 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:04.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:03 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] up:boot 2024-04-25T13:42:04.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:03 smithi175 ceph-mon[32649]: fsmap 12 up:standby 2024-04-25T13:42:04.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:03 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T13:42:04.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:03 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:42:04.191 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:03 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] up:boot 2024-04-25T13:42:04.192 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:03 smithi043 ceph-mon[29195]: fsmap 12 up:standby 2024-04-25T13:42:04.192 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:03 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T13:42:04.192 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:03 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:42:04.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:03 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] up:boot 2024-04-25T13:42:04.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:03 smithi161 ceph-mon[32696]: fsmap 12 up:standby 2024-04-25T13:42:04.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:03 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T13:42:04.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:03 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:42:04.458 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:42:04.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.577+0000 7fae007ce640 1 -- 172.21.15.43:0/2984159054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf8108900 msgr2=0x7fadf810ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:04.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.577+0000 7fae007ce640 1 --2- 172.21.15.43:0/2984159054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf8108900 0x7fadf810ad20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009ca0 tx=0x7fadf002a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.577+0000 7fae007ce640 1 -- 172.21.15.43:0/2984159054 shutdown_connections 2024-04-25T13:42:04.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.577+0000 7fae007ce640 1 --2- 172.21.15.43:0/2984159054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf8108900 0x7fadf810ad20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.577+0000 7fae007ce640 1 --2- 172.21.15.43:0/2984159054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadf8103c00 0x7fadf8104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.577+0000 7fae007ce640 1 --2- 172.21.15.43:0/2984159054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fadf81029c0 0x7fadf81036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.577+0000 7fae007ce640 1 -- 172.21.15.43:0/2984159054 >> 172.21.15.43:0/2984159054 conn(0x7fadf80fdbd0 msgr2=0x7fadf8100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:04.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.577+0000 7fae007ce640 1 -- 172.21.15.43:0/2984159054 shutdown_connections 2024-04-25T13:42:04.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.577+0000 7fae007ce640 1 -- 172.21.15.43:0/2984159054 wait complete. 2024-04-25T13:42:04.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.578+0000 7fae007ce640 1 Processor -- start 2024-04-25T13:42:04.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.578+0000 7fae007ce640 1 -- start start 2024-04-25T13:42:04.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.578+0000 7fae007ce640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf81029c0 0x7fadf806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:04.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.578+0000 7fae007ce640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadf8103c00 0x7fadf819ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:04.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.578+0000 7fae007ce640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fadf8108900 0x7fadf81a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:04.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.578+0000 7fae007ce640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fadf810e3d0 con 0x7fadf81029c0 2024-04-25T13:42:04.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.578+0000 7fae007ce640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fadf810e250 con 0x7fadf8108900 2024-04-25T13:42:04.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.578+0000 7fae007ce640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fadf810e550 con 0x7fadf8103c00 2024-04-25T13:42:04.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.578+0000 7fadfe56a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf81029c0 0x7fadf806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:04.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.578+0000 7fadfe56a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf81029c0 0x7fadf806a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57800/0 (socket says 172.21.15.43:57800) 2024-04-25T13:42:04.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.578+0000 7fadfe56a640 1 -- 172.21.15.43:0/4081123135 learned_addr learned my addr 172.21.15.43:0/4081123135 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:04.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.579+0000 7fadfed6b640 1 --2- 172.21.15.43:0/4081123135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fadf8108900 0x7fadf81a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:04.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.579+0000 7fadfdd69640 1 --2- 172.21.15.43:0/4081123135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadf8103c00 0x7fadf819ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:04.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.579+0000 7fadfe56a640 1 -- 172.21.15.43:0/4081123135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadf8103c00 msgr2=0x7fadf819ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:04.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.579+0000 7fadfe56a640 1 --2- 172.21.15.43:0/4081123135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadf8103c00 0x7fadf819ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.579+0000 7fadfe56a640 1 -- 172.21.15.43:0/4081123135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fadf8108900 msgr2=0x7fadf81a13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:04.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.579+0000 7fadfe56a640 1 --2- 172.21.15.43:0/4081123135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fadf8108900 0x7fadf81a13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.579+0000 7fadfe56a640 1 -- 172.21.15.43:0/4081123135 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf81a1bf0 con 0x7fadf81029c0 2024-04-25T13:42:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.579+0000 7fadfe56a640 1 --2- 172.21.15.43:0/4081123135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf81029c0 0x7fadf806a960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fade800e9f0 tx=0x7fade800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.579+0000 7fadef7fe640 1 -- 172.21.15.43:0/4081123135 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade800ccc0 con 0x7fadf81029c0 2024-04-25T13:42:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.579+0000 7fadef7fe640 1 -- 172.21.15.43:0/4081123135 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fade80044b0 con 0x7fadf81029c0 2024-04-25T13:42:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.579+0000 7fadef7fe640 1 -- 172.21.15.43:0/4081123135 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade8010430 con 0x7fadf81029c0 2024-04-25T13:42:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.579+0000 7fae007ce640 1 -- 172.21.15.43:0/4081123135 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf81a1ee0 con 0x7fadf81029c0 2024-04-25T13:42:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.579+0000 7fae007ce640 1 -- 172.21.15.43:0/4081123135 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf81a2340 con 0x7fadf81029c0 2024-04-25T13:42:04.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.580+0000 7fae007ce640 1 -- 172.21.15.43:0/4081123135 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf806af80 con 0x7fadf81029c0 2024-04-25T13:42:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.582+0000 7fadef7fe640 1 -- 172.21.15.43:0/4081123135 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fade8003f90 con 0x7fadf81029c0 2024-04-25T13:42:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.583+0000 7fadef7fe640 1 --2- 172.21.15.43:0/4081123135 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fade40afaf0 0x7fade40b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.583+0000 7fadfdd69640 1 --2- 172.21.15.43:0/4081123135 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fade40afaf0 0x7fade40b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.583+0000 7fadef7fe640 1 -- 172.21.15.43:0/4081123135 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fade80deba0 con 0x7fadf81029c0 2024-04-25T13:42:04.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.583+0000 7fadfdd69640 1 --2- 172.21.15.43:0/4081123135 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fade40afaf0 0x7fade40b2000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fadf806a300 tx=0x7fadf4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:04.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.587+0000 7fadef7fe640 1 -- 172.21.15.43:0/4081123135 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fade80a7c90 con 0x7fadf81029c0 2024-04-25T13:42:04.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.852+0000 7fae007ce640 1 -- 172.21.15.43:0/4081123135 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadf8107760 con 0x7fadf81029c0 2024-04-25T13:42:04.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.853+0000 7fadef7fe640 1 -- 172.21.15.43:0/4081123135 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10485 (secure 0 0 0) 0x7fadf8107760 con 0x7fadf81029c0 2024-04-25T13:42:04.853 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:04.854 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2642701222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2642701222},{"type":"v1","addr":"172.21.15.43:6839","nonce":2642701222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6841/3777483996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":3777483996},{"type":"v1","addr":"172.21.15.43:6841","nonce":3777483996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/3323587585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3323587585},{"type":"v1","addr":"172.21.15.175:6839","nonce":3323587585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24509,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1464384320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1464384320},{"type":"v1","addr":"172.21.15.161:6837","nonce":1464384320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24542,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6839/1243414461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":1243414461},{"type":"v1","addr":"172.21.15.161:6839","nonce":1243414461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-04-25T13:42:04.854 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 13 2024-04-25T13:42:04.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.855+0000 7fae007ce640 1 -- 172.21.15.43:0/4081123135 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fade40afaf0 msgr2=0x7fade40b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:04.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.855+0000 7fae007ce640 1 --2- 172.21.15.43:0/4081123135 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fade40afaf0 0x7fade40b2000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fadf806a300 tx=0x7fadf4005f90 comp rx=0 tx=0).stop 2024-04-25T13:42:04.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.855+0000 7fae007ce640 1 -- 172.21.15.43:0/4081123135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf81029c0 msgr2=0x7fadf806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:04.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.855+0000 7fae007ce640 1 --2- 172.21.15.43:0/4081123135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf81029c0 0x7fadf806a960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fade800e9f0 tx=0x7fade800eeb0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.855+0000 7fae007ce640 1 -- 172.21.15.43:0/4081123135 shutdown_connections 2024-04-25T13:42:04.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.855+0000 7fae007ce640 1 --2- 172.21.15.43:0/4081123135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fadf8108900 0x7fadf81a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.855+0000 7fae007ce640 1 --2- 172.21.15.43:0/4081123135 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fade40afaf0 0x7fade40b2000 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.855+0000 7fae007ce640 1 --2- 172.21.15.43:0/4081123135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadf8103c00 0x7fadf819ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.855+0000 7fae007ce640 1 --2- 172.21.15.43:0/4081123135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadf81029c0 0x7fadf806a960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.855+0000 7fae007ce640 1 -- 172.21.15.43:0/4081123135 >> 172.21.15.43:0/4081123135 conn(0x7fadf80fdbd0 msgr2=0x7fadf81048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:04.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.856+0000 7fae007ce640 1 -- 172.21.15.43:0/4081123135 shutdown_connections 2024-04-25T13:42:04.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.856+0000 7fae007ce640 1 -- 172.21.15.43:0/4081123135 wait complete. 2024-04-25T13:42:04.867 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:04.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.983+0000 7f32e2eb6640 1 -- 172.21.15.43:0/1387973309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32dc103b00 msgr2=0x7f32dc104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:04.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.983+0000 7f32e2eb6640 1 --2- 172.21.15.43:0/1387973309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32dc103b00 0x7f32dc104800 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009900 tx=0x7f32d002a410 comp rx=0 tx=0).stop 2024-04-25T13:42:04.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.983+0000 7f32e2eb6640 1 -- 172.21.15.43:0/1387973309 shutdown_connections 2024-04-25T13:42:04.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.983+0000 7f32e2eb6640 1 --2- 172.21.15.43:0/1387973309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32dc109a40 0x7f32dc10be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.983+0000 7f32e2eb6640 1 --2- 172.21.15.43:0/1387973309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32dc104d40 0x7f32dc105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.983+0000 7f32e2eb6640 1 --2- 172.21.15.43:0/1387973309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32dc103b00 0x7f32dc104800 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.983+0000 7f32e2eb6640 1 -- 172.21.15.43:0/1387973309 >> 172.21.15.43:0/1387973309 conn(0x7f32dc0fed10 msgr2=0x7f32dc1011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:04.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.983+0000 7f32e2eb6640 1 -- 172.21.15.43:0/1387973309 shutdown_connections 2024-04-25T13:42:04.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.983+0000 7f32e2eb6640 1 -- 172.21.15.43:0/1387973309 wait complete. 2024-04-25T13:42:04.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e2eb6640 1 Processor -- start 2024-04-25T13:42:04.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e2eb6640 1 -- start start 2024-04-25T13:42:04.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e2eb6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32dc103b00 0x7f32dc19a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:04.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e2eb6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32dc104d40 0x7f32dc19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:04.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e2eb6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32dc109a40 0x7f32dc1a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:04.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e2eb6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc10f4b0 con 0x7f32dc103b00 2024-04-25T13:42:04.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e2eb6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc10f330 con 0x7f32dc104d40 2024-04-25T13:42:04.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e2eb6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc10f630 con 0x7f32dc109a40 2024-04-25T13:42:04.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e0c52640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32dc103b00 0x7f32dc19a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:04.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e0c52640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32dc103b00 0x7f32dc19a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57830/0 (socket says 172.21.15.43:57830) 2024-04-25T13:42:04.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e0c52640 1 -- 172.21.15.43:0/2267343637 learned_addr learned my addr 172.21.15.43:0/2267343637 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:04.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e1453640 1 --2- 172.21.15.43:0/2267343637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32dc109a40 0x7f32dc1a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:04.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e0c52640 1 -- 172.21.15.43:0/2267343637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32dc109a40 msgr2=0x7f32dc1a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:04.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e0c52640 1 --2- 172.21.15.43:0/2267343637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32dc109a40 0x7f32dc1a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e0c52640 1 -- 172.21.15.43:0/2267343637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32dc104d40 msgr2=0x7f32dc19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:04.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e0c52640 1 --2- 172.21.15.43:0/2267343637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32dc104d40 0x7f32dc19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e0c52640 1 -- 172.21.15.43:0/2267343637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32dc1a1ce0 con 0x7f32dc103b00 2024-04-25T13:42:04.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e1453640 1 --2- 172.21.15.43:0/2267343637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32dc109a40 0x7f32dc1a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:04.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32e0c52640 1 --2- 172.21.15.43:0/2267343637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32dc103b00 0x7f32dc19a1a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009230 tx=0x7f32d00040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:04.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.984+0000 7f32d9ffb640 1 -- 172.21.15.43:0/2267343637 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d003f030 con 0x7f32dc103b00 2024-04-25T13:42:04.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.985+0000 7f32d9ffb640 1 -- 172.21.15.43:0/2267343637 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32d00044c0 con 0x7f32dc103b00 2024-04-25T13:42:04.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.985+0000 7f32d9ffb640 1 -- 172.21.15.43:0/2267343637 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0035070 con 0x7f32dc103b00 2024-04-25T13:42:04.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.985+0000 7f32e2eb6640 1 -- 172.21.15.43:0/2267343637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32dc1a1f70 con 0x7f32dc103b00 2024-04-25T13:42:04.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.985+0000 7f32e2eb6640 1 -- 172.21.15.43:0/2267343637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32dc1a2380 con 0x7f32dc103b00 2024-04-25T13:42:04.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.986+0000 7f32e2eb6640 1 -- 172.21.15.43:0/2267343637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32dc108850 con 0x7f32dc103b00 2024-04-25T13:42:04.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.988+0000 7f32d9ffb640 1 -- 172.21.15.43:0/2267343637 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f32d0042030 con 0x7f32dc103b00 2024-04-25T13:42:04.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.988+0000 7f32d9ffb640 1 --2- 172.21.15.43:0/2267343637 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f32cc0afb70 0x7f32cc0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:04.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.988+0000 7f32dbfff640 1 --2- 172.21.15.43:0/2267343637 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f32cc0afb70 0x7f32cc0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:04.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.988+0000 7f32d9ffb640 1 -- 172.21.15.43:0/2267343637 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f32d00fefc0 con 0x7f32dc103b00 2024-04-25T13:42:04.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.989+0000 7f32dbfff640 1 --2- 172.21.15.43:0/2267343637 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f32cc0afb70 0x7f32cc0b2080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f32c8005fd0 tx=0x7f32c8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:04.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:04.992+0000 7f32d9ffb640 1 -- 172.21.15.43:0/2267343637 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f32d00c8020 con 0x7f32dc103b00 2024-04-25T13:42:05.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.187+0000 7f32e2eb6640 1 -- 172.21.15.43:0/2267343637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32dc02dd20 con 0x7f32dc103b00 2024-04-25T13:42:05.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.188+0000 7f32d9ffb640 1 -- 172.21.15.43:0/2267343637 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+18445 (secure 0 0 0) 0x7f32d00c7920 con 0x7f32dc103b00 2024-04-25T13:42:05.189 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:05.189 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":72,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:41:19.110994+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:05.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.191+0000 7f32e2eb6640 1 -- 172.21.15.43:0/2267343637 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f32cc0afb70 msgr2=0x7f32cc0b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.191+0000 7f32e2eb6640 1 --2- 172.21.15.43:0/2267343637 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f32cc0afb70 0x7f32cc0b2080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f32c8005fd0 tx=0x7f32c8005850 comp rx=0 tx=0).stop 2024-04-25T13:42:05.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.191+0000 7f32e2eb6640 1 -- 172.21.15.43:0/2267343637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32dc103b00 msgr2=0x7f32dc19a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.191+0000 7f32e2eb6640 1 --2- 172.21.15.43:0/2267343637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32dc103b00 0x7f32dc19a1a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009230 tx=0x7f32d00040c0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.191+0000 7f32e2eb6640 1 -- 172.21.15.43:0/2267343637 shutdown_connections 2024-04-25T13:42:05.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.191+0000 7f32e2eb6640 1 --2- 172.21.15.43:0/2267343637 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f32cc0afb70 0x7f32cc0b2080 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.191+0000 7f32e2eb6640 1 --2- 172.21.15.43:0/2267343637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32dc109a40 0x7f32dc1a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.191+0000 7f32e2eb6640 1 --2- 172.21.15.43:0/2267343637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32dc104d40 0x7f32dc19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.191+0000 7f32e2eb6640 1 --2- 172.21.15.43:0/2267343637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32dc103b00 0x7f32dc19a1a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.191+0000 7f32e2eb6640 1 -- 172.21.15.43:0/2267343637 >> 172.21.15.43:0/2267343637 conn(0x7f32dc0fed10 msgr2=0x7f32dc105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:05.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.191+0000 7f32e2eb6640 1 -- 172.21.15.43:0/2267343637 shutdown_connections 2024-04-25T13:42:05.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.191+0000 7f32e2eb6640 1 -- 172.21.15.43:0/2267343637 wait complete. 2024-04-25T13:42:05.201 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:04 smithi043 ceph-mon[29195]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:42:05.202 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.202 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.202 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.202 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.202 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:04 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/4081123135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:05.202 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.202 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.202 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:42:05.202 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:42:05.202 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:04 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.204 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:37:25.931659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:42:05.204 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:05.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.320+0000 7f6c0d267640 1 -- 172.21.15.43:0/290087892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c08103c30 msgr2=0x7f6c08104040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.320+0000 7f6c0d267640 1 --2- 172.21.15.43:0/290087892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c08103c30 0x7f6c08104040 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc009900 tx=0x7f6bfc02a410 comp rx=0 tx=0).stop 2024-04-25T13:42:05.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.320+0000 7f6c0d267640 1 -- 172.21.15.43:0/290087892 shutdown_connections 2024-04-25T13:42:05.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.320+0000 7f6c0d267640 1 --2- 172.21.15.43:0/290087892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c08108930 0x7f6c0810ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.320+0000 7f6c0d267640 1 --2- 172.21.15.43:0/290087892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c08103c30 0x7f6c08104040 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.320+0000 7f6c0d267640 1 --2- 172.21.15.43:0/290087892 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c081029f0 0x7f6c081036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.320+0000 7f6c0d267640 1 -- 172.21.15.43:0/290087892 >> 172.21.15.43:0/290087892 conn(0x7f6c080fdc00 msgr2=0x7f6c08100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:05.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.320+0000 7f6c0d267640 1 -- 172.21.15.43:0/290087892 shutdown_connections 2024-04-25T13:42:05.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.320+0000 7f6c0d267640 1 -- 172.21.15.43:0/290087892 wait complete. 2024-04-25T13:42:05.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.321+0000 7f6c0d267640 1 Processor -- start 2024-04-25T13:42:05.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.321+0000 7f6c0d267640 1 -- start start 2024-04-25T13:42:05.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.321+0000 7f6c0d267640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c081029f0 0x7f6c0806bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:05.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.321+0000 7f6c0d267640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c08103c30 0x7f6c0819ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:05.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.321+0000 7f6c0d267640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c08108930 0x7f6c081a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:05.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.321+0000 7f6c0d267640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0810e3a0 con 0x7f6c08103c30 2024-04-25T13:42:05.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.321+0000 7f6c0d267640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0810e220 con 0x7f6c081029f0 2024-04-25T13:42:05.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.321+0000 7f6c0d267640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0810e520 con 0x7f6c08108930 2024-04-25T13:42:05.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.321+0000 7f6c067fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c08103c30 0x7f6c0819ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:05.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.321+0000 7f6c06ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c081029f0 0x7f6c0806bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:05.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.321+0000 7f6c067fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c08103c30 0x7f6c0819ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57854/0 (socket says 172.21.15.43:57854) 2024-04-25T13:42:05.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.321+0000 7f6c06ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c081029f0 0x7f6c0806bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.43:40292/0 (socket says 172.21.15.43:40292) 2024-04-25T13:42:05.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.321+0000 7f6c067fc640 1 -- 172.21.15.43:0/3410907042 learned_addr learned my addr 172.21.15.43:0/3410907042 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:05.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.321+0000 7f6c077fe640 1 --2- 172.21.15.43:0/3410907042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c08108930 0x7f6c081a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:05.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.322+0000 7f6c067fc640 1 -- 172.21.15.43:0/3410907042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c08108930 msgr2=0x7f6c081a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.322+0000 7f6c067fc640 1 --2- 172.21.15.43:0/3410907042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c08108930 0x7f6c081a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.322+0000 7f6c067fc640 1 -- 172.21.15.43:0/3410907042 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c081029f0 msgr2=0x7f6c0806bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.322+0000 7f6c067fc640 1 --2- 172.21.15.43:0/3410907042 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c081029f0 0x7f6c0806bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.322+0000 7f6c067fc640 1 -- 172.21.15.43:0/3410907042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c081a1c50 con 0x7f6c08103c30 2024-04-25T13:42:05.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.322+0000 7f6c06ffd640 1 --2- 172.21.15.43:0/3410907042 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c081029f0 0x7f6c0806bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:05.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.322+0000 7f6c077fe640 1 --2- 172.21.15.43:0/3410907042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c08108930 0x7f6c081a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:05.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.322+0000 7f6c067fc640 1 --2- 172.21.15.43:0/3410907042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c08103c30 0x7f6c0819ee80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc009230 tx=0x7f6bfc005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:05.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.322+0000 7f6beffff640 1 -- 172.21.15.43:0/3410907042 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc03f030 con 0x7f6c08103c30 2024-04-25T13:42:05.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.322+0000 7f6c0d267640 1 -- 172.21.15.43:0/3410907042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c081a1ee0 con 0x7f6c08103c30 2024-04-25T13:42:05.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.322+0000 7f6beffff640 1 -- 172.21.15.43:0/3410907042 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bfc0043d0 con 0x7f6c08103c30 2024-04-25T13:42:05.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.322+0000 7f6beffff640 1 -- 172.21.15.43:0/3410907042 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc035070 con 0x7f6c08103c30 2024-04-25T13:42:05.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.322+0000 7f6c0d267640 1 -- 172.21.15.43:0/3410907042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c081a2340 con 0x7f6c08103c30 2024-04-25T13:42:05.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.323+0000 7f6c0d267640 1 -- 172.21.15.43:0/3410907042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c08107740 con 0x7f6c08103c30 2024-04-25T13:42:05.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.325+0000 7f6beffff640 1 -- 172.21.15.43:0/3410907042 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f6bfc042030 con 0x7f6c08103c30 2024-04-25T13:42:05.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.326+0000 7f6beffff640 1 --2- 172.21.15.43:0/3410907042 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6bf00afaf0 0x7f6bf00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:05.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.326+0000 7f6c06ffd640 1 --2- 172.21.15.43:0/3410907042 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6bf00afaf0 0x7f6bf00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:05.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.326+0000 7f6beffff640 1 -- 172.21.15.43:0/3410907042 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f6bfc0fef80 con 0x7f6c08103c30 2024-04-25T13:42:05.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.327+0000 7f6c06ffd640 1 --2- 172.21.15.43:0/3410907042 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6bf00afaf0 0x7f6bf00b2000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6c081035f0 tx=0x7f6bf8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:05.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.330+0000 7f6beffff640 1 -- 172.21.15.43:0/3410907042 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6bfc0c8000 con 0x7f6c08103c30 2024-04-25T13:42:05.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:04 smithi161 ceph-mon[32696]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:42:05.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:04 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/4081123135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:05.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:42:05.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:42:05.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:04 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:04 smithi175 ceph-mon[32649]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:42:05.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:04 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/4081123135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:42:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:42:05.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:04 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:05.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.525+0000 7f6c0d267640 1 -- 172.21.15.43:0/3410907042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6c0802dce0 con 0x7f6c08103c30 2024-04-25T13:42:05.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.525+0000 7f6beffff640 1 -- 172.21.15.43:0/3410907042 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7f6bfc0c7900 con 0x7f6c08103c30 2024-04-25T13:42:05.526 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T13:42:05.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.528+0000 7f6c0d267640 1 -- 172.21.15.43:0/3410907042 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6bf00afaf0 msgr2=0x7f6bf00b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.528+0000 7f6c0d267640 1 --2- 172.21.15.43:0/3410907042 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6bf00afaf0 0x7f6bf00b2000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6c081035f0 tx=0x7f6bf8009500 comp rx=0 tx=0).stop 2024-04-25T13:42:05.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.528+0000 7f6c0d267640 1 -- 172.21.15.43:0/3410907042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c08103c30 msgr2=0x7f6c0819ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.528+0000 7f6c0d267640 1 --2- 172.21.15.43:0/3410907042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c08103c30 0x7f6c0819ee80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc009230 tx=0x7f6bfc005e80 comp rx=0 tx=0).stop 2024-04-25T13:42:05.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.528+0000 7f6c0d267640 1 -- 172.21.15.43:0/3410907042 shutdown_connections 2024-04-25T13:42:05.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.528+0000 7f6c0d267640 1 --2- 172.21.15.43:0/3410907042 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6bf00afaf0 0x7f6bf00b2000 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.528+0000 7f6c0d267640 1 --2- 172.21.15.43:0/3410907042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c08108930 0x7f6c081a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.528+0000 7f6c0d267640 1 --2- 172.21.15.43:0/3410907042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c08103c30 0x7f6c0819ee80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.528+0000 7f6c0d267640 1 --2- 172.21.15.43:0/3410907042 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c081029f0 0x7f6c0806bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.528+0000 7f6c0d267640 1 -- 172.21.15.43:0/3410907042 >> 172.21.15.43:0/3410907042 conn(0x7f6c080fdc00 msgr2=0x7f6c08104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:05.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.528+0000 7f6c0d267640 1 -- 172.21.15.43:0/3410907042 shutdown_connections 2024-04-25T13:42:05.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.528+0000 7f6c0d267640 1 -- 172.21.15.43:0/3410907042 wait complete. 2024-04-25T13:42:05.540 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T13:42:05.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.658+0000 7fdbc1eb1640 1 -- 172.21.15.43:0/1238889829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdbbc106f60 msgr2=0x7fdbbc109380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.658+0000 7fdbc1eb1640 1 --2- 172.21.15.43:0/1238889829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdbbc106f60 0x7fdbbc109380 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009900 tx=0x7fdbb002a400 comp rx=0 tx=0).stop 2024-04-25T13:42:05.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.658+0000 7fdbc1eb1640 1 -- 172.21.15.43:0/1238889829 shutdown_connections 2024-04-25T13:42:05.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.658+0000 7fdbc1eb1640 1 --2- 172.21.15.43:0/1238889829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbbc1098c0 0x7fdbbc10bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.658+0000 7fdbc1eb1640 1 --2- 172.21.15.43:0/1238889829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdbbc106f60 0x7fdbbc109380 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.658+0000 7fdbc1eb1640 1 --2- 172.21.15.43:0/1238889829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdbbc104600 0x7fdbbc106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.658+0000 7fdbc1eb1640 1 -- 172.21.15.43:0/1238889829 >> 172.21.15.43:0/1238889829 conn(0x7fdbbc0fdc00 msgr2=0x7fdbbc1000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:05.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.658+0000 7fdbc1eb1640 1 -- 172.21.15.43:0/1238889829 shutdown_connections 2024-04-25T13:42:05.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.658+0000 7fdbc1eb1640 1 -- 172.21.15.43:0/1238889829 wait complete. 2024-04-25T13:42:05.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.659+0000 7fdbc1eb1640 1 Processor -- start 2024-04-25T13:42:05.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.659+0000 7fdbc1eb1640 1 -- start start 2024-04-25T13:42:05.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.659+0000 7fdbc1eb1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdbbc104600 0x7fdbbc19a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:05.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.659+0000 7fdbc1eb1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdbbc106f60 0x7fdbbc19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:05.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.659+0000 7fdbc1eb1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbbc1098c0 0x7fdbbc1a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:05.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.659+0000 7fdbc1eb1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc10f4d0 con 0x7fdbbc104600 2024-04-25T13:42:05.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.659+0000 7fdbc1eb1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc10f350 con 0x7fdbbc106f60 2024-04-25T13:42:05.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.659+0000 7fdbc1eb1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc10f650 con 0x7fdbbc1098c0 2024-04-25T13:42:05.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.659+0000 7fdbbb7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdbbc104600 0x7fdbbc19a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:05.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.659+0000 7fdbbb7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdbbc104600 0x7fdbbc19a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57874/0 (socket says 172.21.15.43:57874) 2024-04-25T13:42:05.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.659+0000 7fdbbb7fe640 1 -- 172.21.15.43:0/4034500557 learned_addr learned my addr 172.21.15.43:0/4034500557 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:05.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.659+0000 7fdbbaffd640 1 --2- 172.21.15.43:0/4034500557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdbbc106f60 0x7fdbbc19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:05.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.659+0000 7fdbbbfff640 1 --2- 172.21.15.43:0/4034500557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbbc1098c0 0x7fdbbc1a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:05.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.660+0000 7fdbbbfff640 1 -- 172.21.15.43:0/4034500557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdbbc106f60 msgr2=0x7fdbbc19a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.660+0000 7fdbbbfff640 1 --2- 172.21.15.43:0/4034500557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdbbc106f60 0x7fdbbc19a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.660+0000 7fdbbbfff640 1 -- 172.21.15.43:0/4034500557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdbbc104600 msgr2=0x7fdbbc19a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.660+0000 7fdbbbfff640 1 --2- 172.21.15.43:0/4034500557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdbbc104600 0x7fdbbc19a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.660+0000 7fdbbbfff640 1 -- 172.21.15.43:0/4034500557 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbbc1a1d00 con 0x7fdbbc1098c0 2024-04-25T13:42:05.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.660+0000 7fdbbb7fe640 1 --2- 172.21.15.43:0/4034500557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdbbc104600 0x7fdbbc19a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:05.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.660+0000 7fdbbbfff640 1 --2- 172.21.15.43:0/4034500557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbbc1098c0 0x7fdbbc1a1690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4005fd0 tx=0x7fdbb400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:05.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.660+0000 7fdbb8ff9640 1 -- 172.21.15.43:0/4034500557 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400cdf0 con 0x7fdbbc1098c0 2024-04-25T13:42:05.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.660+0000 7fdbb8ff9640 1 -- 172.21.15.43:0/4034500557 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbb4005020 con 0x7fdbbc1098c0 2024-04-25T13:42:05.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.660+0000 7fdbc1eb1640 1 -- 172.21.15.43:0/4034500557 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbbc1a1ff0 con 0x7fdbbc1098c0 2024-04-25T13:42:05.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.660+0000 7fdbb8ff9640 1 -- 172.21.15.43:0/4034500557 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4010690 con 0x7fdbbc1098c0 2024-04-25T13:42:05.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.660+0000 7fdbc1eb1640 1 -- 172.21.15.43:0/4034500557 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbbc1a2450 con 0x7fdbbc1098c0 2024-04-25T13:42:05.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.662+0000 7fdbc1eb1640 1 -- 172.21.15.43:0/4034500557 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbbc069310 con 0x7fdbbc1098c0 2024-04-25T13:42:05.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.663+0000 7fdbb8ff9640 1 -- 172.21.15.43:0/4034500557 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fdbb4004b20 con 0x7fdbbc1098c0 2024-04-25T13:42:05.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.663+0000 7fdbb8ff9640 1 --2- 172.21.15.43:0/4034500557 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdba40afb70 0x7fdba40b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:05.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.664+0000 7fdbbb7fe640 1 --2- 172.21.15.43:0/4034500557 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdba40afb70 0x7fdba40b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:05.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.664+0000 7fdbb8ff9640 1 -- 172.21.15.43:0/4034500557 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fdbb40dee10 con 0x7fdbbc1098c0 2024-04-25T13:42:05.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.664+0000 7fdbbb7fe640 1 --2- 172.21.15.43:0/4034500557 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdba40afb70 0x7fdba40b2080 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0104e0 tx=0x7fdbac00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:05.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.668+0000 7fdbb8ff9640 1 -- 172.21.15.43:0/4034500557 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdbb40a7e70 con 0x7fdbbc1098c0 2024-04-25T13:42:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.864+0000 7fdbc1eb1640 1 -- 172.21.15.43:0/4034500557 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fdbbc02dbd0 con 0x7fdbbc1098c0 2024-04-25T13:42:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.865+0000 7fdbb8ff9640 1 -- 172.21.15.43:0/4034500557 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) ==== 84+0+65 (secure 0 0 0) 0x7fdbb40a7770 con 0x7fdbbc1098c0 2024-04-25T13:42:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:05.865 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2024-04-25T13:42:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:42:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2024-04-25T13:42:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2024-04-25T13:42:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:42:05.865 INFO:teuthology.orchestra.run.smithi043.stdout:] 2024-04-25T13:42:05.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.867+0000 7fdbc1eb1640 1 -- 172.21.15.43:0/4034500557 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdba40afb70 msgr2=0x7fdba40b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.867+0000 7fdbc1eb1640 1 --2- 172.21.15.43:0/4034500557 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdba40afb70 0x7fdba40b2080 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0104e0 tx=0x7fdbac00b410 comp rx=0 tx=0).stop 2024-04-25T13:42:05.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.867+0000 7fdbc1eb1640 1 -- 172.21.15.43:0/4034500557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbbc1098c0 msgr2=0x7fdbbc1a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.867+0000 7fdbc1eb1640 1 --2- 172.21.15.43:0/4034500557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbbc1098c0 0x7fdbbc1a1690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4005fd0 tx=0x7fdbb400ef10 comp rx=0 tx=0).stop 2024-04-25T13:42:05.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.867+0000 7fdbc1eb1640 1 -- 172.21.15.43:0/4034500557 shutdown_connections 2024-04-25T13:42:05.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.867+0000 7fdbc1eb1640 1 --2- 172.21.15.43:0/4034500557 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdba40afb70 0x7fdba40b2080 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.867+0000 7fdbc1eb1640 1 --2- 172.21.15.43:0/4034500557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbbc1098c0 0x7fdbbc1a1690 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.867+0000 7fdbc1eb1640 1 --2- 172.21.15.43:0/4034500557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdbbc106f60 0x7fdbbc19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.867+0000 7fdbc1eb1640 1 --2- 172.21.15.43:0/4034500557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdbbc104600 0x7fdbbc19a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.867+0000 7fdbc1eb1640 1 -- 172.21.15.43:0/4034500557 >> 172.21.15.43:0/4034500557 conn(0x7fdbbc0fdc00 msgr2=0x7fdbbc106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:05.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.867+0000 7fdbc1eb1640 1 -- 172.21.15.43:0/4034500557 shutdown_connections 2024-04-25T13:42:05.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.867+0000 7fdbc1eb1640 1 -- 172.21.15.43:0/4034500557 wait complete. 2024-04-25T13:42:05.878 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T13:42:05.878 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T13:42:05.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.998+0000 7fcb49db2640 1 -- 172.21.15.43:0/1898523848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb44101ef0 msgr2=0x7fcb44106b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.998+0000 7fcb49db2640 1 --2- 172.21.15.43:0/1898523848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb44101ef0 0x7fcb44106b60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009900 tx=0x7fcb3402a410 comp rx=0 tx=0).stop 2024-04-25T13:42:05.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.998+0000 7fcb49db2640 1 -- 172.21.15.43:0/1898523848 shutdown_connections 2024-04-25T13:42:05.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.998+0000 7fcb49db2640 1 --2- 172.21.15.43:0/1898523848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb44109a00 0x7fcb4410be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.998+0000 7fcb49db2640 1 --2- 172.21.15.43:0/1898523848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb441070a0 0x7fcb441094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.998+0000 7fcb49db2640 1 --2- 172.21.15.43:0/1898523848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb44101ef0 0x7fcb44106b60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.998+0000 7fcb49db2640 1 -- 172.21.15.43:0/1898523848 >> 172.21.15.43:0/1898523848 conn(0x7fcb440fd350 msgr2=0x7fcb440ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:06.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.999+0000 7fcb49db2640 1 -- 172.21.15.43:0/1898523848 shutdown_connections 2024-04-25T13:42:06.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.999+0000 7fcb49db2640 1 -- 172.21.15.43:0/1898523848 wait complete. 2024-04-25T13:42:06.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.999+0000 7fcb49db2640 1 Processor -- start 2024-04-25T13:42:06.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:05.999+0000 7fcb49db2640 1 -- start start 2024-04-25T13:42:06.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb49db2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb44101ef0 0x7fcb44104330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:06.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb49db2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb441070a0 0x7fcb441029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:06.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb49db2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb44109a00 0x7fcb44102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:06.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb49db2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4410f500 con 0x7fcb44101ef0 2024-04-25T13:42:06.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb49db2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4410f380 con 0x7fcb44109a00 2024-04-25T13:42:06.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb49db2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4410f680 con 0x7fcb441070a0 2024-04-25T13:42:06.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb437fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb44101ef0 0x7fcb44104330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:06.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb42ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb441070a0 0x7fcb441029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:06.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb437fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb44101ef0 0x7fcb44104330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57884/0 (socket says 172.21.15.43:57884) 2024-04-25T13:42:06.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb437fe640 1 -- 172.21.15.43:0/755449631 learned_addr learned my addr 172.21.15.43:0/755449631 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:06.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb42ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb441070a0 0x7fcb441029d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.43:52258/0 (socket says 172.21.15.43:52258) 2024-04-25T13:42:06.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb43fff640 1 --2- 172.21.15.43:0/755449631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb44109a00 0x7fcb44102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:06.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb437fe640 1 -- 172.21.15.43:0/755449631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb441070a0 msgr2=0x7fcb441029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:06.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb437fe640 1 --2- 172.21.15.43:0/755449631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb441070a0 0x7fcb441029d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb437fe640 1 -- 172.21.15.43:0/755449631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb44109a00 msgr2=0x7fcb44102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:06.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb437fe640 1 --2- 172.21.15.43:0/755449631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb44109a00 0x7fcb44102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb437fe640 1 -- 172.21.15.43:0/755449631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb44103640 con 0x7fcb44101ef0 2024-04-25T13:42:06.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb42ffd640 1 --2- 172.21.15.43:0/755449631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb441070a0 0x7fcb441029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:06.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.000+0000 7fcb437fe640 1 --2- 172.21.15.43:0/755449631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb44101ef0 0x7fcb44104330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcb34031460 tx=0x7fcb34005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:06.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.001+0000 7fcb40ff9640 1 -- 172.21.15.43:0/755449631 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3403f030 con 0x7fcb44101ef0 2024-04-25T13:42:06.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.001+0000 7fcb40ff9640 1 -- 172.21.15.43:0/755449631 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb340043d0 con 0x7fcb44101ef0 2024-04-25T13:42:06.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.001+0000 7fcb49db2640 1 -- 172.21.15.43:0/755449631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb441a4230 con 0x7fcb44101ef0 2024-04-25T13:42:06.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.001+0000 7fcb40ff9640 1 -- 172.21.15.43:0/755449631 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34035070 con 0x7fcb44101ef0 2024-04-25T13:42:06.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.001+0000 7fcb49db2640 1 -- 172.21.15.43:0/755449631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb441a4690 con 0x7fcb44101ef0 2024-04-25T13:42:06.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.003+0000 7fcb49db2640 1 -- 172.21.15.43:0/755449631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb440fee70 con 0x7fcb44101ef0 2024-04-25T13:42:06.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.004+0000 7fcb40ff9640 1 -- 172.21.15.43:0/755449631 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fcb34042030 con 0x7fcb44101ef0 2024-04-25T13:42:06.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.005+0000 7fcb40ff9640 1 --2- 172.21.15.43:0/755449631 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcb2c0afb70 0x7fcb2c0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:06.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.005+0000 7fcb42ffd640 1 --2- 172.21.15.43:0/755449631 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcb2c0afb70 0x7fcb2c0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:06.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.005+0000 7fcb40ff9640 1 -- 172.21.15.43:0/755449631 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fcb340feea0 con 0x7fcb44101ef0 2024-04-25T13:42:06.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.006+0000 7fcb42ffd640 1 --2- 172.21.15.43:0/755449631 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcb2c0afb70 0x7fcb2c0b2080 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb44103cd0 tx=0x7fcb38005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:06.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.008+0000 7fcb40ff9640 1 -- 172.21.15.43:0/755449631 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcb340c78b0 con 0x7fcb44101ef0 2024-04-25T13:42:06.121 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:05 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:42:06.121 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:06 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2267343637' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:06.121 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:06 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3410907042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:42:06.121 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:06 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/4034500557' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-25T13:42:06.171 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:05 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:42:06.172 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:05 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2267343637' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:06.172 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:05 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3410907042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:42:06.172 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:05 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/4034500557' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-25T13:42:06.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:06.197+0000 7fcb49db2640 1 -- 172.21.15.43:0/755449631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcb4402db50 con 0x7fcb44101ef0 2024-04-25T13:42:06.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:05 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:42:06.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:05 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2267343637' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:06.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:05 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3410907042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:42:06.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:05 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/4034500557' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-25T13:42:07.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.006+0000 7fcb40ff9640 1 -- 172.21.15.43:0/755449631 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) ==== 138+0+0 (secure 0 0 0) 0x7fcb340cbbb0 con 0x7fcb44101ef0 2024-04-25T13:42:07.006 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2024-04-25T13:42:07.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.008+0000 7fcb49db2640 1 -- 172.21.15.43:0/755449631 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcb2c0afb70 msgr2=0x7fcb2c0b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:07.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.008+0000 7fcb49db2640 1 --2- 172.21.15.43:0/755449631 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcb2c0afb70 0x7fcb2c0b2080 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb44103cd0 tx=0x7fcb38005f90 comp rx=0 tx=0).stop 2024-04-25T13:42:07.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.008+0000 7fcb49db2640 1 -- 172.21.15.43:0/755449631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb44101ef0 msgr2=0x7fcb44104330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:07.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.008+0000 7fcb49db2640 1 --2- 172.21.15.43:0/755449631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb44101ef0 0x7fcb44104330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcb34031460 tx=0x7fcb34005e70 comp rx=0 tx=0).stop 2024-04-25T13:42:07.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.009+0000 7fcb49db2640 1 -- 172.21.15.43:0/755449631 shutdown_connections 2024-04-25T13:42:07.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.009+0000 7fcb49db2640 1 --2- 172.21.15.43:0/755449631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb44109a00 0x7fcb44102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.009+0000 7fcb49db2640 1 --2- 172.21.15.43:0/755449631 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcb2c0afb70 0x7fcb2c0b2080 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.009+0000 7fcb49db2640 1 --2- 172.21.15.43:0/755449631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb441070a0 0x7fcb441029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.009+0000 7fcb49db2640 1 --2- 172.21.15.43:0/755449631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb44101ef0 0x7fcb44104330 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.009+0000 7fcb49db2640 1 -- 172.21.15.43:0/755449631 >> 172.21.15.43:0/755449631 conn(0x7fcb440fd350 msgr2=0x7fcb44105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:07.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.009+0000 7fcb49db2640 1 -- 172.21.15.43:0/755449631 shutdown_connections 2024-04-25T13:42:07.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.009+0000 7fcb49db2640 1 -- 172.21.15.43:0/755449631 wait complete. 2024-04-25T13:42:07.023 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-25T13:42:07.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.142+0000 7f82bd461640 1 -- 172.21.15.43:0/3446341793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b81045b0 msgr2=0x7f82b81069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:07.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.142+0000 7f82bd461640 1 --2- 172.21.15.43:0/3446341793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b81045b0 0x7f82b81069d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009900 tx=0x7f82b002a410 comp rx=0 tx=0).stop 2024-04-25T13:42:07.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.143+0000 7f82bd461640 1 -- 172.21.15.43:0/3446341793 shutdown_connections 2024-04-25T13:42:07.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.143+0000 7f82bd461640 1 --2- 172.21.15.43:0/3446341793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82b8109870 0x7f82b810bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.143+0000 7f82bd461640 1 --2- 172.21.15.43:0/3446341793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82b8106f10 0x7f82b8109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.143+0000 7f82bd461640 1 --2- 172.21.15.43:0/3446341793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b81045b0 0x7f82b81069d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.143+0000 7f82bd461640 1 -- 172.21.15.43:0/3446341793 >> 172.21.15.43:0/3446341793 conn(0x7f82b80fdbd0 msgr2=0x7f82b8100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:07.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.143+0000 7f82bd461640 1 -- 172.21.15.43:0/3446341793 shutdown_connections 2024-04-25T13:42:07.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.143+0000 7f82bd461640 1 -- 172.21.15.43:0/3446341793 wait complete. 2024-04-25T13:42:07.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.143+0000 7f82bd461640 1 Processor -- start 2024-04-25T13:42:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.143+0000 7f82bd461640 1 -- start start 2024-04-25T13:42:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82bd461640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82b81045b0 0x7f82b8103a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82bd461640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82b8106f10 0x7f82b81020a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82bd461640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b8109870 0x7f82b81025e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82bd461640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f82b810f470 con 0x7f82b8109870 2024-04-25T13:42:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82bd461640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f82b810f2f0 con 0x7f82b81045b0 2024-04-25T13:42:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82bd461640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f82b810f5f0 con 0x7f82b8106f10 2024-04-25T13:42:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82b77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b8109870 0x7f82b81025e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82b77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b8109870 0x7f82b81025e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57894/0 (socket says 172.21.15.43:57894) 2024-04-25T13:42:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82b77fe640 1 -- 172.21.15.43:0/1298661226 learned_addr learned my addr 172.21.15.43:0/1298661226 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82b67fc640 1 --2- 172.21.15.43:0/1298661226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82b8106f10 0x7f82b81020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82b6ffd640 1 --2- 172.21.15.43:0/1298661226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82b81045b0 0x7f82b8103a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82b77fe640 1 -- 172.21.15.43:0/1298661226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82b8106f10 msgr2=0x7f82b81020a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:07.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82b77fe640 1 --2- 172.21.15.43:0/1298661226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82b8106f10 0x7f82b81020a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82b77fe640 1 -- 172.21.15.43:0/1298661226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82b81045b0 msgr2=0x7f82b8103a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:07.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82b77fe640 1 --2- 172.21.15.43:0/1298661226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82b81045b0 0x7f82b8103a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82b77fe640 1 -- 172.21.15.43:0/1298661226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b8102d10 con 0x7f82b8109870 2024-04-25T13:42:07.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82b77fe640 1 --2- 172.21.15.43:0/1298661226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b8109870 0x7f82b81025e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f82a800e9d0 tx=0x7f82a800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:07.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f829ffff640 1 -- 172.21.15.43:0/1298661226 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a800cd80 con 0x7f82b8109870 2024-04-25T13:42:07.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f82bd461640 1 -- 172.21.15.43:0/1298661226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82b81a4200 con 0x7f82b8109870 2024-04-25T13:42:07.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f829ffff640 1 -- 172.21.15.43:0/1298661226 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82a8005020 con 0x7f82b8109870 2024-04-25T13:42:07.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.144+0000 7f829ffff640 1 -- 172.21.15.43:0/1298661226 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a80116d0 con 0x7f82b8109870 2024-04-25T13:42:07.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.145+0000 7f82bd461640 1 -- 172.21.15.43:0/1298661226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82b81a46c0 con 0x7f82b8109870 2024-04-25T13:42:07.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.146+0000 7f82bd461640 1 -- 172.21.15.43:0/1298661226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82b80ff6f0 con 0x7f82b8109870 2024-04-25T13:42:07.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.147+0000 7f829ffff640 1 -- 172.21.15.43:0/1298661226 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f82a8004a40 con 0x7f82b8109870 2024-04-25T13:42:07.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.148+0000 7f829ffff640 1 --2- 172.21.15.43:0/1298661226 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f82a00afaf0 0x7f82a00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:07.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.148+0000 7f82b6ffd640 1 --2- 172.21.15.43:0/1298661226 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f82a00afaf0 0x7f82a00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:07.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.148+0000 7f829ffff640 1 -- 172.21.15.43:0/1298661226 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7497+0+0 (secure 0 0 0) 0x7f82a80deec0 con 0x7f82b8109870 2024-04-25T13:42:07.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.148+0000 7f82b6ffd640 1 --2- 172.21.15.43:0/1298661226 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f82a00afaf0 0x7f82a00b2000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f82b0006010 tx=0x7f82b0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:07.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.152+0000 7f829ffff640 1 -- 172.21.15.43:0/1298661226 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f82a8016030 con 0x7f82b8109870 2024-04-25T13:42:07.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:07.343+0000 7f82bd461640 1 -- 172.21.15.43:0/1298661226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f82b802db50 con 0x7f82b8109870 2024-04-25T13:42:07.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:07 smithi161 ceph-mon[32696]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:42:07.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:07 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/755449631' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T13:42:07.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:07 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:07 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:07 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:07 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:07 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:07 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:07 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:42:07.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:07 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:42:07.355 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:07 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:07 smithi175 ceph-mon[32649]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:42:07.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:07 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/755449631' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T13:42:07.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:07 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:07 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:07 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:07 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:07 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:07 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:07 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:42:07.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:07 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:42:07.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:07 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:07 smithi043 ceph-mon[29195]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:42:07.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:07 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/755449631' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T13:42:07.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:07 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:07 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:07 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:07 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:07 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:07 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:07.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:07 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:42:07.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:07 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:42:07.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:07 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:42:08.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.013+0000 7f829ffff640 1 -- 172.21.15.43:0/1298661226 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v74) ==== 171+0+0 (secure 0 0 0) 0x7f82a80a7d30 con 0x7f82b8109870 2024-04-25T13:42:08.014 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2024-04-25T13:42:08.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.017+0000 7f82bd461640 1 -- 172.21.15.43:0/1298661226 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f82a00afaf0 msgr2=0x7f82a00b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:08.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.018+0000 7f82bd461640 1 --2- 172.21.15.43:0/1298661226 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f82a00afaf0 0x7f82a00b2000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f82b0006010 tx=0x7f82b0000bc0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.018+0000 7f82bd461640 1 -- 172.21.15.43:0/1298661226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b8109870 msgr2=0x7f82b81025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:08.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.018+0000 7f82bd461640 1 --2- 172.21.15.43:0/1298661226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b8109870 0x7f82b81025e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f82a800e9d0 tx=0x7f82a800ee90 comp rx=0 tx=0).stop 2024-04-25T13:42:08.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.018+0000 7f82bd461640 1 -- 172.21.15.43:0/1298661226 shutdown_connections 2024-04-25T13:42:08.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.018+0000 7f82bd461640 1 --2- 172.21.15.43:0/1298661226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b8109870 0x7f82b81025e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.018+0000 7f82bd461640 1 --2- 172.21.15.43:0/1298661226 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f82a00afaf0 0x7f82a00b2000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.018+0000 7f82bd461640 1 --2- 172.21.15.43:0/1298661226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82b8106f10 0x7f82b81020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.018+0000 7f82bd461640 1 --2- 172.21.15.43:0/1298661226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82b81045b0 0x7f82b8103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.018+0000 7f82bd461640 1 -- 172.21.15.43:0/1298661226 >> 172.21.15.43:0/1298661226 conn(0x7f82b80fdbd0 msgr2=0x7f82b8106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:08.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.018+0000 7f82bd461640 1 -- 172.21.15.43:0/1298661226 shutdown_connections 2024-04-25T13:42:08.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.018+0000 7f82bd461640 1 -- 172.21.15.43:0/1298661226 wait complete. 2024-04-25T13:42:08.042 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T13:42:08.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.164+0000 7f4898fa8640 1 -- 172.21.15.43:0/1204763139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48941029e0 msgr2=0x7f48941036e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:08.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.164+0000 7f4898fa8640 1 --2- 172.21.15.43:0/1204763139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48941029e0 0x7f48941036e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4884009900 tx=0x7f488402a410 comp rx=0 tx=0).stop 2024-04-25T13:42:08.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.164+0000 7f4898fa8640 1 -- 172.21.15.43:0/1204763139 shutdown_connections 2024-04-25T13:42:08.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.164+0000 7f4898fa8640 1 --2- 172.21.15.43:0/1204763139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4894108920 0x7f489410ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.164+0000 7f4898fa8640 1 --2- 172.21.15.43:0/1204763139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4894103c20 0x7f4894104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.164+0000 7f4898fa8640 1 --2- 172.21.15.43:0/1204763139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48941029e0 0x7f48941036e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.164+0000 7f4898fa8640 1 -- 172.21.15.43:0/1204763139 >> 172.21.15.43:0/1204763139 conn(0x7f48940fdbd0 msgr2=0x7f4894100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:08.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.164+0000 7f4898fa8640 1 -- 172.21.15.43:0/1204763139 shutdown_connections 2024-04-25T13:42:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.164+0000 7f4898fa8640 1 -- 172.21.15.43:0/1204763139 wait complete. 2024-04-25T13:42:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4898fa8640 1 Processor -- start 2024-04-25T13:42:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4898fa8640 1 -- start start 2024-04-25T13:42:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4898fa8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48941029e0 0x7f48941994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4898fa8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4894103c20 0x7f4894199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4898fa8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4894108920 0x7f48941a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4898fa8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f489410e470 con 0x7f4894108920 2024-04-25T13:42:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4898fa8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f489410e2f0 con 0x7f4894103c20 2024-04-25T13:42:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4898fa8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f489410e5f0 con 0x7f48941029e0 2024-04-25T13:42:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4892d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4894108920 0x7f48941a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4892d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4894108920 0x7f48941a09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57916/0 (socket says 172.21.15.43:57916) 2024-04-25T13:42:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4892d9d640 1 -- 172.21.15.43:0/2371766421 learned_addr learned my addr 172.21.15.43:0/2371766421 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f489259c640 1 --2- 172.21.15.43:0/2371766421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48941029e0 0x7f48941994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f488bfff640 1 --2- 172.21.15.43:0/2371766421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4894103c20 0x7f4894199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:08.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4892d9d640 1 -- 172.21.15.43:0/2371766421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48941029e0 msgr2=0x7f48941994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:08.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4892d9d640 1 --2- 172.21.15.43:0/2371766421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48941029e0 0x7f48941994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4892d9d640 1 -- 172.21.15.43:0/2371766421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4894103c20 msgr2=0x7f4894199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:08.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4892d9d640 1 --2- 172.21.15.43:0/2371766421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4894103c20 0x7f4894199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4892d9d640 1 -- 172.21.15.43:0/2371766421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48941a1030 con 0x7f4894108920 2024-04-25T13:42:08.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.165+0000 7f4892d9d640 1 --2- 172.21.15.43:0/2371766421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4894108920 0x7f48941a09c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f488c00b970 tx=0x7f488c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:08.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.166+0000 7f488b7fe640 1 -- 172.21.15.43:0/2371766421 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c019070 con 0x7f4894108920 2024-04-25T13:42:08.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.166+0000 7f4898fa8640 1 -- 172.21.15.43:0/2371766421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48941a1320 con 0x7f4894108920 2024-04-25T13:42:08.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.166+0000 7f488b7fe640 1 -- 172.21.15.43:0/2371766421 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f488c014440 con 0x7f4894108920 2024-04-25T13:42:08.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.166+0000 7f4898fa8640 1 -- 172.21.15.43:0/2371766421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48941a18f0 con 0x7f4894108920 2024-04-25T13:42:08.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.166+0000 7f488b7fe640 1 -- 172.21.15.43:0/2371766421 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c0075d0 con 0x7f4894108920 2024-04-25T13:42:08.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.167+0000 7f4898fa8640 1 -- 172.21.15.43:0/2371766421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4894107730 con 0x7f4894108920 2024-04-25T13:42:08.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.168+0000 7f488b7fe640 1 -- 172.21.15.43:0/2371766421 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f488c01c070 con 0x7f4894108920 2024-04-25T13:42:08.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.169+0000 7f488b7fe640 1 --2- 172.21.15.43:0/2371766421 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f48800afaf0 0x7f48800b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:08.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.169+0000 7f489259c640 1 --2- 172.21.15.43:0/2371766421 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f48800afaf0 0x7f48800b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:08.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.169+0000 7f488b7fe640 1 -- 172.21.15.43:0/2371766421 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7879+0+0 (secure 0 0 0) 0x7f488c0de480 con 0x7f4894108920 2024-04-25T13:42:08.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.169+0000 7f489259c640 1 --2- 172.21.15.43:0/2371766421 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f48800afaf0 0x7f48800b2000 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4884005760 tx=0x7f4884000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:08.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.173+0000 7f488b7fe640 1 -- 172.21.15.43:0/2371766421 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f488c0a6bc0 con 0x7f4894108920 2024-04-25T13:42:08.331 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:08 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/755449631' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-25T13:42:08.332 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:08 smithi175 ceph-mon[32649]: osdmap e73: 12 total, 12 up, 12 in 2024-04-25T13:42:08.332 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:08 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1298661226' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-25T13:42:08.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:08 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/755449631' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-25T13:42:08.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:08 smithi161 ceph-mon[32696]: osdmap e73: 12 total, 12 up, 12 in 2024-04-25T13:42:08.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:08 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1298661226' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-25T13:42:08.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:08.399+0000 7f4898fa8640 1 -- 172.21.15.43:0/2371766421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f489406c3c0 con 0x7f4894108920 2024-04-25T13:42:08.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:08 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/755449631' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-25T13:42:08.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:08 smithi043 ceph-mon[29195]: osdmap e73: 12 total, 12 up, 12 in 2024-04-25T13:42:08.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:08 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1298661226' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-25T13:42:09.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.015+0000 7f488b7fe640 1 -- 172.21.15.43:0/2371766421 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f488c0af290 con 0x7f4894108920 2024-04-25T13:42:09.016 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T13:42:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.019+0000 7f4898fa8640 1 -- 172.21.15.43:0/2371766421 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f48800afaf0 msgr2=0x7f48800b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.019+0000 7f4898fa8640 1 --2- 172.21.15.43:0/2371766421 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f48800afaf0 0x7f48800b2000 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4884005760 tx=0x7f4884000bc0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.019+0000 7f4898fa8640 1 -- 172.21.15.43:0/2371766421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4894108920 msgr2=0x7f48941a09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.019+0000 7f4898fa8640 1 --2- 172.21.15.43:0/2371766421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4894108920 0x7f48941a09c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f488c00b970 tx=0x7f488c00be30 comp rx=0 tx=0).stop 2024-04-25T13:42:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.019+0000 7f4898fa8640 1 -- 172.21.15.43:0/2371766421 shutdown_connections 2024-04-25T13:42:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.019+0000 7f4898fa8640 1 --2- 172.21.15.43:0/2371766421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4894108920 0x7f48941a09c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.019+0000 7f4898fa8640 1 --2- 172.21.15.43:0/2371766421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4894103c20 0x7f4894199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.019+0000 7f4898fa8640 1 --2- 172.21.15.43:0/2371766421 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f48800afaf0 0x7f48800b2000 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4884005760 tx=0x7f4884000bc0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.019+0000 7f4898fa8640 1 --2- 172.21.15.43:0/2371766421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48941029e0 0x7f48941994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.019+0000 7f4898fa8640 1 -- 172.21.15.43:0/2371766421 >> 172.21.15.43:0/2371766421 conn(0x7f48940fdbd0 msgr2=0x7f4894104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:09.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.019+0000 7f4898fa8640 1 -- 172.21.15.43:0/2371766421 shutdown_connections 2024-04-25T13:42:09.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.019+0000 7f4898fa8640 1 -- 172.21.15.43:0/2371766421 wait complete. 2024-04-25T13:42:09.042 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-25T13:42:09.042 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-25T13:42:09.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.171+0000 7fcf4f25a640 1 -- 172.21.15.43:0/958166808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf48103c20 msgr2=0x7fcf48104030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.171+0000 7fcf4f25a640 1 --2- 172.21.15.43:0/958166808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf48103c20 0x7fcf48104030 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009900 tx=0x7fcf3c02a410 comp rx=0 tx=0).stop 2024-04-25T13:42:09.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.171+0000 7fcf4f25a640 1 -- 172.21.15.43:0/958166808 shutdown_connections 2024-04-25T13:42:09.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.171+0000 7fcf4f25a640 1 --2- 172.21.15.43:0/958166808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf48108920 0x7fcf4810ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.171+0000 7fcf4f25a640 1 --2- 172.21.15.43:0/958166808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf48103c20 0x7fcf48104030 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.171+0000 7fcf4f25a640 1 --2- 172.21.15.43:0/958166808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf481029e0 0x7fcf481036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.171+0000 7fcf4f25a640 1 -- 172.21.15.43:0/958166808 >> 172.21.15.43:0/958166808 conn(0x7fcf480fdbd0 msgr2=0x7fcf48100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:09.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.171+0000 7fcf4f25a640 1 -- 172.21.15.43:0/958166808 shutdown_connections 2024-04-25T13:42:09.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.171+0000 7fcf4f25a640 1 -- 172.21.15.43:0/958166808 wait complete. 2024-04-25T13:42:09.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.171+0000 7fcf4f25a640 1 Processor -- start 2024-04-25T13:42:09.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf4f25a640 1 -- start start 2024-04-25T13:42:09.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf4f25a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf481029e0 0x7fcf481993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:09.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf4f25a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf48103c20 0x7fcf48199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:09.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf4f25a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf48108920 0x7fcf481a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:09.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf4f25a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4810e3c0 con 0x7fcf48103c20 2024-04-25T13:42:09.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf4f25a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4810e240 con 0x7fcf481029e0 2024-04-25T13:42:09.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf4f25a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4810e540 con 0x7fcf48108920 2024-04-25T13:42:09.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf47fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf48103c20 0x7fcf48199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:09.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf47fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf48103c20 0x7fcf48199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57930/0 (socket says 172.21.15.43:57930) 2024-04-25T13:42:09.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf47fff640 1 -- 172.21.15.43:0/2041234736 learned_addr learned my addr 172.21.15.43:0/2041234736 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:09.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf4cff6640 1 --2- 172.21.15.43:0/2041234736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf481029e0 0x7fcf481993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:09.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf4d7f7640 1 --2- 172.21.15.43:0/2041234736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf48108920 0x7fcf481a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:09.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf47fff640 1 -- 172.21.15.43:0/2041234736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf48108920 msgr2=0x7fcf481a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf47fff640 1 --2- 172.21.15.43:0/2041234736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf48108920 0x7fcf481a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf47fff640 1 -- 172.21.15.43:0/2041234736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf481029e0 msgr2=0x7fcf481993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf47fff640 1 --2- 172.21.15.43:0/2041234736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf481029e0 0x7fcf481993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf47fff640 1 -- 172.21.15.43:0/2041234736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf481a0ec0 con 0x7fcf48103c20 2024-04-25T13:42:09.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf47fff640 1 --2- 172.21.15.43:0/2041234736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf48103c20 0x7fcf48199930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009230 tx=0x7fcf3c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:09.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.172+0000 7fcf45ffb640 1 -- 172.21.15.43:0/2041234736 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c046070 con 0x7fcf48103c20 2024-04-25T13:42:09.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.173+0000 7fcf45ffb640 1 -- 172.21.15.43:0/2041234736 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf3c004440 con 0x7fcf48103c20 2024-04-25T13:42:09.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.173+0000 7fcf4f25a640 1 -- 172.21.15.43:0/2041234736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf48069e90 con 0x7fcf48103c20 2024-04-25T13:42:09.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.173+0000 7fcf45ffb640 1 -- 172.21.15.43:0/2041234736 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c035050 con 0x7fcf48103c20 2024-04-25T13:42:09.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.173+0000 7fcf4f25a640 1 -- 172.21.15.43:0/2041234736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf4806a3d0 con 0x7fcf48103c20 2024-04-25T13:42:09.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.174+0000 7fcf4f25a640 1 -- 172.21.15.43:0/2041234736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf4806afd0 con 0x7fcf48103c20 2024-04-25T13:42:09.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.175+0000 7fcf45ffb640 1 -- 172.21.15.43:0/2041234736 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fcf3c049070 con 0x7fcf48103c20 2024-04-25T13:42:09.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.176+0000 7fcf45ffb640 1 --2- 172.21.15.43:0/2041234736 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcf300afb70 0x7fcf300b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:09.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.176+0000 7fcf4cff6640 1 --2- 172.21.15.43:0/2041234736 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcf300afb70 0x7fcf300b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:09.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.176+0000 7fcf45ffb640 1 -- 172.21.15.43:0/2041234736 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fcf3c100a00 con 0x7fcf48103c20 2024-04-25T13:42:09.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.177+0000 7fcf4cff6640 1 --2- 172.21.15.43:0/2041234736 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcf300afb70 0x7fcf300b2080 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcf481035e0 tx=0x7fcf38005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:09.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.180+0000 7fcf45ffb640 1 -- 172.21.15.43:0/2041234736 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcf4806afd0 con 0x7fcf48103c20 2024-04-25T13:42:09.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:09 smithi161 ceph-mon[32696]: pgmap v278: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:42:09.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:09 smithi161 ceph-mon[32696]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T13:42:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:09 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1298661226' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-04-25T13:42:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:09 smithi161 ceph-mon[32696]: osdmap e74: 12 total, 12 up, 12 in 2024-04-25T13:42:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:09 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2371766421' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-25T13:42:09.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:09 smithi161 ceph-mon[32696]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-25T13:42:09.353 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:09 smithi175 ceph-mon[32649]: pgmap v278: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:42:09.353 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:09 smithi175 ceph-mon[32649]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T13:42:09.353 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:09 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1298661226' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-04-25T13:42:09.353 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:09 smithi175 ceph-mon[32649]: osdmap e74: 12 total, 12 up, 12 in 2024-04-25T13:42:09.353 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:09 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2371766421' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-25T13:42:09.354 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:09 smithi175 ceph-mon[32649]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-25T13:42:09.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:09.375+0000 7fcf4f25a640 1 -- 172.21.15.43:0/2041234736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fcf4806c330 con 0x7fcf48103c20 2024-04-25T13:42:09.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:09 smithi043 ceph-mon[29195]: pgmap v278: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:42:09.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:09 smithi043 ceph-mon[29195]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T13:42:09.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:09 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1298661226' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-04-25T13:42:09.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:09 smithi043 ceph-mon[29195]: osdmap e74: 12 total, 12 up, 12 in 2024-04-25T13:42:09.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:09 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2371766421' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-25T13:42:09.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:09 smithi043 ceph-mon[29195]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-25T13:42:10.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.038+0000 7fcf45ffb640 1 -- 172.21.15.43:0/2041234736 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v76) ==== 157+0+0 (secure 0 0 0) 0x7fcf3c050020 con 0x7fcf48103c20 2024-04-25T13:42:10.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.042+0000 7fcf4f25a640 1 -- 172.21.15.43:0/2041234736 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcf300afb70 msgr2=0x7fcf300b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.042+0000 7fcf4f25a640 1 --2- 172.21.15.43:0/2041234736 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcf300afb70 0x7fcf300b2080 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcf481035e0 tx=0x7fcf38005f90 comp rx=0 tx=0).stop 2024-04-25T13:42:10.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.042+0000 7fcf4f25a640 1 -- 172.21.15.43:0/2041234736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf48103c20 msgr2=0x7fcf48199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.042+0000 7fcf4f25a640 1 --2- 172.21.15.43:0/2041234736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf48103c20 0x7fcf48199930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009230 tx=0x7fcf3c004040 comp rx=0 tx=0).stop 2024-04-25T13:42:10.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.042+0000 7fcf4f25a640 1 -- 172.21.15.43:0/2041234736 shutdown_connections 2024-04-25T13:42:10.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.042+0000 7fcf4f25a640 1 --2- 172.21.15.43:0/2041234736 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcf300afb70 0x7fcf300b2080 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.042+0000 7fcf4f25a640 1 --2- 172.21.15.43:0/2041234736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf48108920 0x7fcf481a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.042+0000 7fcf4f25a640 1 --2- 172.21.15.43:0/2041234736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf48103c20 0x7fcf48199930 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.042+0000 7fcf4f25a640 1 --2- 172.21.15.43:0/2041234736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf481029e0 0x7fcf481993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.042+0000 7fcf4f25a640 1 -- 172.21.15.43:0/2041234736 >> 172.21.15.43:0/2041234736 conn(0x7fcf480fdbd0 msgr2=0x7fcf48104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:10.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.042+0000 7fcf4f25a640 1 -- 172.21.15.43:0/2041234736 shutdown_connections 2024-04-25T13:42:10.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.042+0000 7fcf4f25a640 1 -- 172.21.15.43:0/2041234736 wait complete. 2024-04-25T13:42:10.056 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T13:42:10.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.182+0000 7f245deb6640 1 -- 172.21.15.43:0/3731627320 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2458103990 msgr2=0x7f2458103e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.182+0000 7f245deb6640 1 --2- 172.21.15.43:0/3731627320 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2458103990 0x7f2458103e00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f244c009900 tx=0x7f244c02a410 comp rx=0 tx=0).stop 2024-04-25T13:42:10.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.182+0000 7f245deb6640 1 -- 172.21.15.43:0/3731627320 shutdown_connections 2024-04-25T13:42:10.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.182+0000 7f245deb6640 1 --2- 172.21.15.43:0/3731627320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2458104490 0x7f245810abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.182+0000 7f245deb6640 1 --2- 172.21.15.43:0/3731627320 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2458103990 0x7f2458103e00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.182+0000 7f245deb6640 1 --2- 172.21.15.43:0/3731627320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2458102fb0 0x7f24581033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.182+0000 7f245deb6640 1 -- 172.21.15.43:0/3731627320 >> 172.21.15.43:0/3731627320 conn(0x7f24580fd3b0 msgr2=0x7f24580ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:10.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.183+0000 7f245deb6640 1 -- 172.21.15.43:0/3731627320 shutdown_connections 2024-04-25T13:42:10.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.183+0000 7f245deb6640 1 -- 172.21.15.43:0/3731627320 wait complete. 2024-04-25T13:42:10.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.183+0000 7f245deb6640 1 Processor -- start 2024-04-25T13:42:10.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.183+0000 7f245deb6640 1 -- start start 2024-04-25T13:42:10.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f245deb6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2458102fb0 0x7f245819a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:10.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f245deb6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2458103990 0x7f245819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:10.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f245deb6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2458104490 0x7f24581a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:10.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f245deb6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f245810e400 con 0x7f2458103990 2024-04-25T13:42:10.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f245deb6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f245810e280 con 0x7f2458104490 2024-04-25T13:42:10.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f245deb6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f245810e580 con 0x7f2458102fb0 2024-04-25T13:42:10.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f2456ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2458103990 0x7f245819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:10.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f2456ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2458103990 0x7f245819a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41770/0 (socket says 172.21.15.43:41770) 2024-04-25T13:42:10.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f2456ffd640 1 -- 172.21.15.43:0/3433409965 learned_addr learned my addr 172.21.15.43:0/3433409965 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:10.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f24577fe640 1 --2- 172.21.15.43:0/3433409965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2458102fb0 0x7f245819a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:10.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f2457fff640 1 --2- 172.21.15.43:0/3433409965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2458104490 0x7f24581a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:10.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f2456ffd640 1 -- 172.21.15.43:0/3433409965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2458102fb0 msgr2=0x7f245819a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f2456ffd640 1 --2- 172.21.15.43:0/3433409965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2458102fb0 0x7f245819a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f2456ffd640 1 -- 172.21.15.43:0/3433409965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2458104490 msgr2=0x7f24581a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f2456ffd640 1 --2- 172.21.15.43:0/3433409965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2458104490 0x7f24581a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f2456ffd640 1 -- 172.21.15.43:0/3433409965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24581a1c90 con 0x7f2458103990 2024-04-25T13:42:10.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f2456ffd640 1 --2- 172.21.15.43:0/3433409965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2458103990 0x7f245819a690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f244c009230 tx=0x7f244c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:10.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f2454ff9640 1 -- 172.21.15.43:0/3433409965 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c03f030 con 0x7f2458103990 2024-04-25T13:42:10.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.184+0000 7f2454ff9640 1 -- 172.21.15.43:0/3433409965 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f244c0043d0 con 0x7f2458103990 2024-04-25T13:42:10.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.185+0000 7f245deb6640 1 -- 172.21.15.43:0/3433409965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24581a1f20 con 0x7f2458103990 2024-04-25T13:42:10.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.185+0000 7f2454ff9640 1 -- 172.21.15.43:0/3433409965 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c035070 con 0x7f2458103990 2024-04-25T13:42:10.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.185+0000 7f245deb6640 1 -- 172.21.15.43:0/3433409965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24581a2330 con 0x7f2458103990 2024-04-25T13:42:10.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.186+0000 7f245deb6640 1 -- 172.21.15.43:0/3433409965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24581a2590 con 0x7f2458103990 2024-04-25T13:42:10.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.187+0000 7f2454ff9640 1 -- 172.21.15.43:0/3433409965 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f244c042030 con 0x7f2458103990 2024-04-25T13:42:10.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.188+0000 7f2454ff9640 1 --2- 172.21.15.43:0/3433409965 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f24400afaf0 0x7f24400b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:10.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.188+0000 7f24577fe640 1 --2- 172.21.15.43:0/3433409965 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f24400afaf0 0x7f24400b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:10.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.188+0000 7f2454ff9640 1 -- 172.21.15.43:0/3433409965 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8277+0+0 (secure 0 0 0) 0x7f244c0ff040 con 0x7f2458103990 2024-04-25T13:42:10.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.188+0000 7f24577fe640 1 --2- 172.21.15.43:0/3433409965 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f24400afaf0 0x7f24400b2000 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f245806b310 tx=0x7f2448005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:10.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.192+0000 7f2454ff9640 1 -- 172.21.15.43:0/3433409965 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f244c0c75a0 con 0x7f2458103990 2024-04-25T13:42:10.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:10 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2371766421' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-25T13:42:10.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:10 smithi161 ceph-mon[32696]: osdmap e75: 12 total, 12 up, 12 in 2024-04-25T13:42:10.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:10 smithi161 ceph-mon[32696]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-25T13:42:10.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:10 smithi161 ceph-mon[32696]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-25T13:42:10.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:10 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2041234736' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-04-25T13:42:10.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:10.379+0000 7f245deb6640 1 -- 172.21.15.43:0/3433409965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f24581a2d10 con 0x7f2458103990 2024-04-25T13:42:10.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:10 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2371766421' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-25T13:42:10.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:10 smithi175 ceph-mon[32649]: osdmap e75: 12 total, 12 up, 12 in 2024-04-25T13:42:10.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:10 smithi175 ceph-mon[32649]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-25T13:42:10.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:10 smithi175 ceph-mon[32649]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-25T13:42:10.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:10 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2041234736' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-04-25T13:42:10.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:10 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2371766421' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-25T13:42:10.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:10 smithi043 ceph-mon[29195]: osdmap e75: 12 total, 12 up, 12 in 2024-04-25T13:42:10.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:10 smithi043 ceph-mon[29195]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-25T13:42:10.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:10 smithi043 ceph-mon[29195]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-25T13:42:10.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:10 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2041234736' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-04-25T13:42:11.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:11 smithi161 ceph-mon[32696]: pgmap v281: 97 pgs: 16 creating+peering, 11 active+clean, 70 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-04-25T13:42:11.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:11 smithi161 ceph-mon[32696]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-25T13:42:11.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:11 smithi161 ceph-mon[32696]: Cluster is now healthy 2024-04-25T13:42:11.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:11 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2041234736' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-04-25T13:42:11.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:11 smithi161 ceph-mon[32696]: osdmap e76: 12 total, 12 up, 12 in 2024-04-25T13:42:11.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:11 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] up:active 2024-04-25T13:42:11.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:11 smithi161 ceph-mon[32696]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T13:42:11.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:11 smithi161 ceph-mon[32696]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T13:42:11.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:11 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3433409965' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-25T13:42:11.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:11 smithi175 ceph-mon[32649]: pgmap v281: 97 pgs: 16 creating+peering, 11 active+clean, 70 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-04-25T13:42:11.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:11 smithi175 ceph-mon[32649]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-25T13:42:11.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:11 smithi175 ceph-mon[32649]: Cluster is now healthy 2024-04-25T13:42:11.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:11 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2041234736' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-04-25T13:42:11.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:11 smithi175 ceph-mon[32649]: osdmap e76: 12 total, 12 up, 12 in 2024-04-25T13:42:11.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:11 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] up:active 2024-04-25T13:42:11.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:11 smithi175 ceph-mon[32649]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T13:42:11.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:11 smithi175 ceph-mon[32649]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T13:42:11.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:11 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3433409965' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-25T13:42:11.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:11 smithi043 ceph-mon[29195]: pgmap v281: 97 pgs: 16 creating+peering, 11 active+clean, 70 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-04-25T13:42:11.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:11 smithi043 ceph-mon[29195]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-25T13:42:11.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:11 smithi043 ceph-mon[29195]: Cluster is now healthy 2024-04-25T13:42:11.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:11 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2041234736' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-04-25T13:42:11.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:11 smithi043 ceph-mon[29195]: osdmap e76: 12 total, 12 up, 12 in 2024-04-25T13:42:11.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:11 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] up:active 2024-04-25T13:42:11.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:11 smithi043 ceph-mon[29195]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T13:42:11.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:11 smithi043 ceph-mon[29195]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T13:42:11.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:11 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3433409965' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-25T13:42:12.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.049+0000 7f2454ff9640 1 -- 172.21.15.43:0/3433409965 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v78) ==== 228+0+0 (secure 0 0 0) 0x7f244c0cb8a0 con 0x7f2458103990 2024-04-25T13:42:12.049 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data_ec' created 2024-04-25T13:42:12.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.053+0000 7f245deb6640 1 -- 172.21.15.43:0/3433409965 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f24400afaf0 msgr2=0x7f24400b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.053+0000 7f245deb6640 1 --2- 172.21.15.43:0/3433409965 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f24400afaf0 0x7f24400b2000 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f245806b310 tx=0x7f2448005f90 comp rx=0 tx=0).stop 2024-04-25T13:42:12.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.053+0000 7f245deb6640 1 -- 172.21.15.43:0/3433409965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2458103990 msgr2=0x7f245819a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.053+0000 7f245deb6640 1 --2- 172.21.15.43:0/3433409965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2458103990 0x7f245819a690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f244c009230 tx=0x7f244c005e80 comp rx=0 tx=0).stop 2024-04-25T13:42:12.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.053+0000 7f245deb6640 1 -- 172.21.15.43:0/3433409965 shutdown_connections 2024-04-25T13:42:12.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.053+0000 7f245deb6640 1 --2- 172.21.15.43:0/3433409965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2458104490 0x7f24581a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.053+0000 7f245deb6640 1 --2- 172.21.15.43:0/3433409965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2458103990 0x7f245819a690 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.053+0000 7f245deb6640 1 --2- 172.21.15.43:0/3433409965 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f24400afaf0 0x7f24400b2000 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.053+0000 7f245deb6640 1 --2- 172.21.15.43:0/3433409965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2458102fb0 0x7f245819a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.053+0000 7f245deb6640 1 -- 172.21.15.43:0/3433409965 >> 172.21.15.43:0/3433409965 conn(0x7f24580fd3b0 msgr2=0x7f24581017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.053+0000 7f245deb6640 1 -- 172.21.15.43:0/3433409965 shutdown_connections 2024-04-25T13:42:12.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.053+0000 7f245deb6640 1 -- 172.21.15.43:0/3433409965 wait complete. 2024-04-25T13:42:12.073 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-25T13:42:12.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.194+0000 7f051b449640 1 -- 172.21.15.43:0/3472274141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0514104d30 msgr2=0x7f0514105140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.195+0000 7f051b449640 1 --2- 172.21.15.43:0/3472274141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0514104d30 0x7f0514105140 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0504009900 tx=0x7f050402a410 comp rx=0 tx=0).stop 2024-04-25T13:42:12.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.195+0000 7f051b449640 1 -- 172.21.15.43:0/3472274141 shutdown_connections 2024-04-25T13:42:12.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.195+0000 7f051b449640 1 --2- 172.21.15.43:0/3472274141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0514109a30 0x7f051410be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.195+0000 7f051b449640 1 --2- 172.21.15.43:0/3472274141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0514104d30 0x7f0514105140 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.195+0000 7f051b449640 1 --2- 172.21.15.43:0/3472274141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0514103af0 0x7f05141047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.195+0000 7f051b449640 1 -- 172.21.15.43:0/3472274141 >> 172.21.15.43:0/3472274141 conn(0x7f05140fece0 msgr2=0x7f0514101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.195+0000 7f051b449640 1 -- 172.21.15.43:0/3472274141 shutdown_connections 2024-04-25T13:42:12.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.195+0000 7f051b449640 1 -- 172.21.15.43:0/3472274141 wait complete. 2024-04-25T13:42:12.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.195+0000 7f051b449640 1 Processor -- start 2024-04-25T13:42:12.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.195+0000 7f051b449640 1 -- start start 2024-04-25T13:42:12.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f051b449640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0514103af0 0x7f0514077960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f051b449640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0514104d30 0x7f0514076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f051b449640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0514109a30 0x7f0514076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f051b449640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f051410f4c0 con 0x7f0514104d30 2024-04-25T13:42:12.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f051b449640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f051410f340 con 0x7f0514109a30 2024-04-25T13:42:12.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f051b449640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f051410f640 con 0x7f0514103af0 2024-04-25T13:42:12.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f05189e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0514104d30 0x7f0514076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f05189e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0514104d30 0x7f0514076000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41776/0 (socket says 172.21.15.43:41776) 2024-04-25T13:42:12.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f05189e4640 1 -- 172.21.15.43:0/1089233768 learned_addr learned my addr 172.21.15.43:0/1089233768 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:12.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f05191e5640 1 --2- 172.21.15.43:0/1089233768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0514103af0 0x7f0514077960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f05189e4640 1 -- 172.21.15.43:0/1089233768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0514103af0 msgr2=0x7f0514077960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f05189e4640 1 --2- 172.21.15.43:0/1089233768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0514103af0 0x7f0514077960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f05189e4640 1 -- 172.21.15.43:0/1089233768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0514109a30 msgr2=0x7f0514076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f05199e6640 1 --2- 172.21.15.43:0/1089233768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0514109a30 0x7f0514076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f05189e4640 1 --2- 172.21.15.43:0/1089233768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0514109a30 0x7f0514076540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f05189e4640 1 -- 172.21.15.43:0/1089233768 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0514076c70 con 0x7f0514104d30 2024-04-25T13:42:12.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f05191e5640 1 --2- 172.21.15.43:0/1089233768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0514103af0 0x7f0514077960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:12.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f05189e4640 1 --2- 172.21.15.43:0/1089233768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0514104d30 0x7f0514076000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0504009230 tx=0x7f05040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f050a7fc640 1 -- 172.21.15.43:0/1089233768 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050403f030 con 0x7f0514104d30 2024-04-25T13:42:12.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f050a7fc640 1 -- 172.21.15.43:0/1089233768 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0504003c90 con 0x7f0514104d30 2024-04-25T13:42:12.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f051b449640 1 -- 172.21.15.43:0/1089233768 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05141a4220 con 0x7f0514104d30 2024-04-25T13:42:12.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.196+0000 7f050a7fc640 1 -- 172.21.15.43:0/1089233768 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504035070 con 0x7f0514104d30 2024-04-25T13:42:12.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.197+0000 7f051b449640 1 -- 172.21.15.43:0/1089233768 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05141a4620 con 0x7f0514104d30 2024-04-25T13:42:12.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.198+0000 7f051b449640 1 -- 172.21.15.43:0/1089233768 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f051406a160 con 0x7f0514104d30 2024-04-25T13:42:12.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.199+0000 7f050a7fc640 1 -- 172.21.15.43:0/1089233768 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f0504042030 con 0x7f0514104d30 2024-04-25T13:42:12.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.200+0000 7f050a7fc640 1 --2- 172.21.15.43:0/1089233768 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f05000afaf0 0x7f05000b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.200+0000 7f05191e5640 1 --2- 172.21.15.43:0/1089233768 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f05000afaf0 0x7f05000b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.200+0000 7f050a7fc640 1 -- 172.21.15.43:0/1089233768 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8770+0+0 (secure 0 0 0) 0x7f05040ff990 con 0x7f0514104d30 2024-04-25T13:42:12.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.201+0000 7f05191e5640 1 --2- 172.21.15.43:0/1089233768 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f05000afaf0 0x7f05000b2000 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f05141046f0 tx=0x7f0510005e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.204+0000 7f050a7fc640 1 -- 172.21.15.43:0/1089233768 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f05040c8350 con 0x7f0514104d30 2024-04-25T13:42:12.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:12 smithi161 ceph-mon[32696]: osdmap e77: 12 total, 12 up, 12 in 2024-04-25T13:42:12.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:12.389+0000 7f051b449640 1 -- 172.21.15.43:0/1089233768 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f0514108840 con 0x7f0514104d30 2024-04-25T13:42:12.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:12 smithi175 ceph-mon[32649]: osdmap e77: 12 total, 12 up, 12 in 2024-04-25T13:42:12.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:12 smithi043 ceph-mon[29195]: osdmap e77: 12 total, 12 up, 12 in 2024-04-25T13:42:13.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.051+0000 7f050a7fc640 1 -- 172.21.15.43:0/1089233768 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v79) ==== 169+0+0 (secure 0 0 0) 0x7f05040c7c50 con 0x7f0514104d30 2024-04-25T13:42:13.051 INFO:teuthology.orchestra.run.smithi043.stderr:set pool 4 allow_ec_overwrites to true 2024-04-25T13:42:13.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.055+0000 7f051b449640 1 -- 172.21.15.43:0/1089233768 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f05000afaf0 msgr2=0x7f05000b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.055+0000 7f051b449640 1 --2- 172.21.15.43:0/1089233768 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f05000afaf0 0x7f05000b2000 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f05141046f0 tx=0x7f0510005e70 comp rx=0 tx=0).stop 2024-04-25T13:42:13.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.055+0000 7f051b449640 1 -- 172.21.15.43:0/1089233768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0514104d30 msgr2=0x7f0514076000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.055+0000 7f051b449640 1 --2- 172.21.15.43:0/1089233768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0514104d30 0x7f0514076000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0504009230 tx=0x7f05040042f0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.055+0000 7f051b449640 1 -- 172.21.15.43:0/1089233768 shutdown_connections 2024-04-25T13:42:13.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.055+0000 7f051b449640 1 --2- 172.21.15.43:0/1089233768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0514109a30 0x7f0514076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.055+0000 7f051b449640 1 --2- 172.21.15.43:0/1089233768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0514104d30 0x7f0514076000 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.055+0000 7f051b449640 1 --2- 172.21.15.43:0/1089233768 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f05000afaf0 0x7f05000b2000 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.055+0000 7f051b449640 1 --2- 172.21.15.43:0/1089233768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0514103af0 0x7f0514077960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.055+0000 7f051b449640 1 -- 172.21.15.43:0/1089233768 >> 172.21.15.43:0/1089233768 conn(0x7f05140fece0 msgr2=0x7f0514105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:13.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.055+0000 7f051b449640 1 -- 172.21.15.43:0/1089233768 shutdown_connections 2024-04-25T13:42:13.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.055+0000 7f051b449640 1 -- 172.21.15.43:0/1089233768 wait complete. 2024-04-25T13:42:13.079 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-25T13:42:13.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.201+0000 7fc55e4f9640 1 -- 172.21.15.43:0/1170339911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc558109a30 msgr2=0x7fc55810be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.201+0000 7fc55e4f9640 1 --2- 172.21.15.43:0/1170339911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc558109a30 0x7fc55810be50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc550009ca0 tx=0x7fc55002a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.201+0000 7fc55e4f9640 1 -- 172.21.15.43:0/1170339911 shutdown_connections 2024-04-25T13:42:13.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.201+0000 7fc55e4f9640 1 --2- 172.21.15.43:0/1170339911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc558109a30 0x7fc55810be50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.201+0000 7fc55e4f9640 1 --2- 172.21.15.43:0/1170339911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc558104d30 0x7fc558105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.201+0000 7fc55e4f9640 1 --2- 172.21.15.43:0/1170339911 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc558103af0 0x7fc5581047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.201+0000 7fc55e4f9640 1 -- 172.21.15.43:0/1170339911 >> 172.21.15.43:0/1170339911 conn(0x7fc5580fece0 msgr2=0x7fc558101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:13.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.201+0000 7fc55e4f9640 1 -- 172.21.15.43:0/1170339911 shutdown_connections 2024-04-25T13:42:13.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.201+0000 7fc55e4f9640 1 -- 172.21.15.43:0/1170339911 wait complete. 2024-04-25T13:42:13.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.202+0000 7fc55e4f9640 1 Processor -- start 2024-04-25T13:42:13.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.202+0000 7fc55e4f9640 1 -- start start 2024-04-25T13:42:13.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.202+0000 7fc55e4f9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc558103af0 0x7fc55819a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:13.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.202+0000 7fc55e4f9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc558104d30 0x7fc55819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:13.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.202+0000 7fc55e4f9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc558109a30 0x7fc5581a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:13.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.202+0000 7fc55e4f9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc55810f500 con 0x7fc558109a30 2024-04-25T13:42:13.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.202+0000 7fc55e4f9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fc55810f380 con 0x7fc558103af0 2024-04-25T13:42:13.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.202+0000 7fc55e4f9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc55810f680 con 0x7fc558104d30 2024-04-25T13:42:13.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.203+0000 7fc55ca96640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc558109a30 0x7fc5581a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:13.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.203+0000 7fc55ca96640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc558109a30 0x7fc5581a15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41796/0 (socket says 172.21.15.43:41796) 2024-04-25T13:42:13.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.203+0000 7fc55ca96640 1 -- 172.21.15.43:0/1516106972 learned_addr learned my addr 172.21.15.43:0/1516106972 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:13.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.203+0000 7fc557fff640 1 --2- 172.21.15.43:0/1516106972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc558103af0 0x7fc55819a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:13.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.203+0000 7fc5577fe640 1 --2- 172.21.15.43:0/1516106972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc558104d30 0x7fc55819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:13.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.203+0000 7fc55ca96640 1 -- 172.21.15.43:0/1516106972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc558104d30 msgr2=0x7fc55819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.203+0000 7fc55ca96640 1 --2- 172.21.15.43:0/1516106972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc558104d30 0x7fc55819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.203+0000 7fc55ca96640 1 -- 172.21.15.43:0/1516106972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc558103af0 msgr2=0x7fc55819a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.203+0000 7fc55ca96640 1 --2- 172.21.15.43:0/1516106972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc558103af0 0x7fc55819a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.203+0000 7fc55ca96640 1 -- 172.21.15.43:0/1516106972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5581a1c10 con 0x7fc558109a30 2024-04-25T13:42:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.203+0000 7fc55ca96640 1 --2- 172.21.15.43:0/1516106972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc558109a30 0x7fc5581a15a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc550031040 tx=0x7fc550003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.203+0000 7fc5557fa640 1 -- 172.21.15.43:0/1516106972 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550004040 con 0x7fc558109a30 2024-04-25T13:42:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.203+0000 7fc5557fa640 1 -- 172.21.15.43:0/1516106972 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc550004670 con 0x7fc558109a30 2024-04-25T13:42:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.203+0000 7fc5557fa640 1 -- 172.21.15.43:0/1516106972 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550030d50 con 0x7fc558109a30 2024-04-25T13:42:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.203+0000 7fc55e4f9640 1 -- 172.21.15.43:0/1516106972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5581a1ea0 con 0x7fc558109a30 2024-04-25T13:42:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.203+0000 7fc55e4f9640 1 -- 172.21.15.43:0/1516106972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5581a2310 con 0x7fc558109a30 2024-04-25T13:42:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.204+0000 7fc55e4f9640 1 -- 172.21.15.43:0/1516106972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc558108840 con 0x7fc558109a30 2024-04-25T13:42:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.206+0000 7fc5557fa640 1 -- 172.21.15.43:0/1516106972 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fc5500305c0 con 0x7fc558109a30 2024-04-25T13:42:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.206+0000 7fc5557fa640 1 --2- 172.21.15.43:0/1516106972 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc5400afb70 0x7fc5400b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.207+0000 7fc557fff640 1 --2- 172.21.15.43:0/1516106972 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc5400afb70 0x7fc5400b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:13.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.207+0000 7fc5557fa640 1 -- 172.21.15.43:0/1516106972 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8770+0+0 (secure 0 0 0) 0x7fc5501005d0 con 0x7fc558109a30 2024-04-25T13:42:13.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.207+0000 7fc557fff640 1 --2- 172.21.15.43:0/1516106972 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc5400afb70 0x7fc5400b2080 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc548005fd0 tx=0x7fc548005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:13.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.210+0000 7fc5557fa640 1 -- 172.21.15.43:0/1516106972 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc5500c8f90 con 0x7fc558109a30 2024-04-25T13:42:13.352 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:42:12 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-b[63120]: 2024-04-25T13:42:12.990+0000 7f77e460e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T13:42:13.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:13 smithi161 ceph-mon[32696]: pgmap v284: 97 pgs: 16 creating+peering, 71 active+clean, 10 unknown; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2024-04-25T13:42:13.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:13 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3433409965' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-25T13:42:13.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:13 smithi161 ceph-mon[32696]: osdmap e78: 12 total, 12 up, 12 in 2024-04-25T13:42:13.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:13 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1089233768' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-04-25T13:42:13.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:13 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1089233768' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-04-25T13:42:13.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:13 smithi161 ceph-mon[32696]: osdmap e79: 12 total, 12 up, 12 in 2024-04-25T13:42:13.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:13 smithi175 ceph-mon[32649]: pgmap v284: 97 pgs: 16 creating+peering, 71 active+clean, 10 unknown; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2024-04-25T13:42:13.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:13 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3433409965' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-25T13:42:13.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:13 smithi175 ceph-mon[32649]: osdmap e78: 12 total, 12 up, 12 in 2024-04-25T13:42:13.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:13 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1089233768' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-04-25T13:42:13.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:13 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1089233768' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-04-25T13:42:13.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:13 smithi175 ceph-mon[32649]: osdmap e79: 12 total, 12 up, 12 in 2024-04-25T13:42:13.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:13.439+0000 7fc55e4f9640 1 -- 172.21.15.43:0/1516106972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fc55802dcd0 con 0x7fc558109a30 2024-04-25T13:42:13.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:13 smithi043 ceph-mon[29195]: pgmap v284: 97 pgs: 16 creating+peering, 71 active+clean, 10 unknown; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2024-04-25T13:42:13.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:13 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3433409965' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-25T13:42:13.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:13 smithi043 ceph-mon[29195]: osdmap e78: 12 total, 12 up, 12 in 2024-04-25T13:42:13.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:13 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1089233768' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-04-25T13:42:13.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:13 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1089233768' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-04-25T13:42:13.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:13 smithi043 ceph-mon[29195]: osdmap e79: 12 total, 12 up, 12 in 2024-04-25T13:42:14.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.078+0000 7fc5557fa640 1 -- 172.21.15.43:0/1516106972 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7fc5500c8890 con 0x7fc558109a30 2024-04-25T13:42:14.078 INFO:teuthology.orchestra.run.smithi043.stderr:added data pool 4 to fsmap 2024-04-25T13:42:14.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.080+0000 7fc55e4f9640 1 -- 172.21.15.43:0/1516106972 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc5400afb70 msgr2=0x7fc5400b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.080+0000 7fc55e4f9640 1 --2- 172.21.15.43:0/1516106972 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc5400afb70 0x7fc5400b2080 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc548005fd0 tx=0x7fc548005850 comp rx=0 tx=0).stop 2024-04-25T13:42:14.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.080+0000 7fc55e4f9640 1 -- 172.21.15.43:0/1516106972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc558109a30 msgr2=0x7fc5581a15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.080+0000 7fc55e4f9640 1 --2- 172.21.15.43:0/1516106972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc558109a30 0x7fc5581a15a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc550031040 tx=0x7fc550003ba0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.081+0000 7fc55e4f9640 1 -- 172.21.15.43:0/1516106972 shutdown_connections 2024-04-25T13:42:14.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.081+0000 7fc55e4f9640 1 --2- 172.21.15.43:0/1516106972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc558109a30 0x7fc5581a15a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.081+0000 7fc55e4f9640 1 --2- 172.21.15.43:0/1516106972 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc5400afb70 0x7fc5400b2080 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.081+0000 7fc55e4f9640 1 --2- 172.21.15.43:0/1516106972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc558104d30 0x7fc55819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.081+0000 7fc55e4f9640 1 --2- 172.21.15.43:0/1516106972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc558103af0 0x7fc55819a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.081+0000 7fc55e4f9640 1 -- 172.21.15.43:0/1516106972 >> 172.21.15.43:0/1516106972 conn(0x7fc5580fece0 msgr2=0x7fc558105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.081+0000 7fc55e4f9640 1 -- 172.21.15.43:0/1516106972 shutdown_connections 2024-04-25T13:42:14.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.081+0000 7fc55e4f9640 1 -- 172.21.15.43:0/1516106972 wait complete. 2024-04-25T13:42:14.095 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:42:14.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.214+0000 7f6b70d06640 1 -- 172.21.15.43:0/2194409428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b6c108920 msgr2=0x7f6b6c10ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.214+0000 7f6b70d06640 1 --2- 172.21.15.43:0/2194409428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b6c108920 0x7f6b6c10ad40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009ca0 tx=0x7f6b6402a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.214+0000 7f6b70d06640 1 -- 172.21.15.43:0/2194409428 shutdown_connections 2024-04-25T13:42:14.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.214+0000 7f6b70d06640 1 --2- 172.21.15.43:0/2194409428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b6c108920 0x7f6b6c10ad40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.214+0000 7f6b70d06640 1 --2- 172.21.15.43:0/2194409428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b6c103c20 0x7f6b6c104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.214+0000 7f6b70d06640 1 --2- 172.21.15.43:0/2194409428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b6c1029e0 0x7f6b6c1036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.214+0000 7f6b70d06640 1 -- 172.21.15.43:0/2194409428 >> 172.21.15.43:0/2194409428 conn(0x7f6b6c0fdbd0 msgr2=0x7f6b6c100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.214+0000 7f6b70d06640 1 -- 172.21.15.43:0/2194409428 shutdown_connections 2024-04-25T13:42:14.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.214+0000 7f6b70d06640 1 -- 172.21.15.43:0/2194409428 wait complete. 2024-04-25T13:42:14.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.215+0000 7f6b70d06640 1 Processor -- start 2024-04-25T13:42:14.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.215+0000 7f6b70d06640 1 -- start start 2024-04-25T13:42:14.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.215+0000 7f6b70d06640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b6c1029e0 0x7f6b6c075840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.215+0000 7f6b70d06640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b6c103c20 0x7f6b6c19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.215+0000 7f6b70d06640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b6c108920 0x7f6b6c1a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.215+0000 7f6b70d06640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c10e460 con 0x7f6b6c1029e0 2024-04-25T13:42:14.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.215+0000 7f6b70d06640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c10e2e0 con 0x7f6b6c108920 2024-04-25T13:42:14.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.215+0000 7f6b70d06640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c10e5e0 con 0x7f6b6c103c20 2024-04-25T13:42:14.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.216+0000 7f6b6a59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b6c1029e0 0x7f6b6c075840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.216+0000 7f6b6a59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b6c1029e0 0x7f6b6c075840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41828/0 (socket says 172.21.15.43:41828) 2024-04-25T13:42:14.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.216+0000 7f6b6a59c640 1 -- 172.21.15.43:0/2961607769 learned_addr learned my addr 172.21.15.43:0/2961607769 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:14.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.216+0000 7f6b6ad9d640 1 --2- 172.21.15.43:0/2961607769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b6c108920 0x7f6b6c1a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.216+0000 7f6b63fff640 1 --2- 172.21.15.43:0/2961607769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b6c103c20 0x7f6b6c19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.216+0000 7f6b6a59c640 1 -- 172.21.15.43:0/2961607769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b6c103c20 msgr2=0x7f6b6c19ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.216+0000 7f6b6a59c640 1 --2- 172.21.15.43:0/2961607769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b6c103c20 0x7f6b6c19ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.216+0000 7f6b6a59c640 1 -- 172.21.15.43:0/2961607769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b6c108920 msgr2=0x7f6b6c1a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.216+0000 7f6b6a59c640 1 --2- 172.21.15.43:0/2961607769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b6c108920 0x7f6b6c1a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.216+0000 7f6b6a59c640 1 -- 172.21.15.43:0/2961607769 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6c1a1c30 con 0x7f6b6c1029e0 2024-04-25T13:42:14.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.216+0000 7f6b6a59c640 1 --2- 172.21.15.43:0/2961607769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b6c1029e0 0x7f6b6c075840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00c970 tx=0x7f6b5c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.216+0000 7f6b637fe640 1 -- 172.21.15.43:0/2961607769 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c007c70 con 0x7f6b6c1029e0 2024-04-25T13:42:14.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.216+0000 7f6b637fe640 1 -- 172.21.15.43:0/2961607769 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b5c007e10 con 0x7f6b6c1029e0 2024-04-25T13:42:14.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.216+0000 7f6b70d06640 1 -- 172.21.15.43:0/2961607769 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6c1a1f20 con 0x7f6b6c1029e0 2024-04-25T13:42:14.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.216+0000 7f6b637fe640 1 -- 172.21.15.43:0/2961607769 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c0186f0 con 0x7f6b6c1029e0 2024-04-25T13:42:14.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.216+0000 7f6b70d06640 1 -- 172.21.15.43:0/2961607769 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6c1a2380 con 0x7f6b6c1029e0 2024-04-25T13:42:14.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.217+0000 7f6b70d06640 1 -- 172.21.15.43:0/2961607769 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6c06a1c0 con 0x7f6b6c1029e0 2024-04-25T13:42:14.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.219+0000 7f6b637fe640 1 -- 172.21.15.43:0/2961607769 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f6b5c00fa90 con 0x7f6b6c1029e0 2024-04-25T13:42:14.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.219+0000 7f6b637fe640 1 --2- 172.21.15.43:0/2961607769 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6b580afaf0 0x7f6b580b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.219+0000 7f6b637fe640 1 -- 172.21.15.43:0/2961607769 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f6b5c0df120 con 0x7f6b6c1029e0 2024-04-25T13:42:14.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.219+0000 7f6b63fff640 1 --2- 172.21.15.43:0/2961607769 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6b580afaf0 0x7f6b580b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.220+0000 7f6b63fff640 1 --2- 172.21.15.43:0/2961607769 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6b580afaf0 0x7f6b580b2000 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0751e0 tx=0x7f6b54008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.223+0000 7f6b637fe640 1 -- 172.21.15.43:0/2961607769 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6b5c053ff0 con 0x7f6b6c1029e0 2024-04-25T13:42:14.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:14 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1516106972' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-04-25T13:42:14.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:14 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1516106972' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-04-25T13:42:14.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.450+0000 7f6b70d06640 1 -- 172.21.15.43:0/2961607769 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b6c02dc40 con 0x7f6b6c1029e0 2024-04-25T13:42:14.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.451+0000 7f6b637fe640 1 -- 172.21.15.43:0/2961607769 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11803 (secure 0 0 0) 0x7f6b6c06a1c0 con 0x7f6b6c1029e0 2024-04-25T13:42:14.451 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:14.451 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2642701222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2642701222},{"type":"v1","addr":"172.21.15.43:6839","nonce":2642701222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6841/3777483996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":3777483996},{"type":"v1","addr":"172.21.15.43:6841","nonce":3777483996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/3323587585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3323587585},{"type":"v1","addr":"172.21.15.175:6839","nonce":3323587585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24509,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1464384320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1464384320},{"type":"v1","addr":"172.21.15.161:6837","nonce":1464384320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:42:08.401075+0000","modified":"2024-04-25T13:42:13.441504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24542},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6839/1243414461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":1243414461},{"type":"v1","addr":"172.21.15.161:6839","nonce":1243414461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24542,"qdb_cluster":[24542]},"id":1}]} 2024-04-25T13:42:14.451 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 17 2024-04-25T13:42:14.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.452+0000 7f6b70d06640 1 -- 172.21.15.43:0/2961607769 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6b580afaf0 msgr2=0x7f6b580b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.452+0000 7f6b70d06640 1 --2- 172.21.15.43:0/2961607769 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6b580afaf0 0x7f6b580b2000 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0751e0 tx=0x7f6b54008040 comp rx=0 tx=0).stop 2024-04-25T13:42:14.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.452+0000 7f6b70d06640 1 -- 172.21.15.43:0/2961607769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b6c1029e0 msgr2=0x7f6b6c075840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.452+0000 7f6b70d06640 1 --2- 172.21.15.43:0/2961607769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b6c1029e0 0x7f6b6c075840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00c970 tx=0x7f6b5c00ce30 comp rx=0 tx=0).stop 2024-04-25T13:42:14.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.453+0000 7f6b70d06640 1 -- 172.21.15.43:0/2961607769 shutdown_connections 2024-04-25T13:42:14.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.453+0000 7f6b70d06640 1 --2- 172.21.15.43:0/2961607769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b6c108920 0x7f6b6c1a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.453+0000 7f6b70d06640 1 --2- 172.21.15.43:0/2961607769 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6b580afaf0 0x7f6b580b2000 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.453+0000 7f6b70d06640 1 --2- 172.21.15.43:0/2961607769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b6c103c20 0x7f6b6c19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.453+0000 7f6b70d06640 1 --2- 172.21.15.43:0/2961607769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b6c1029e0 0x7f6b6c075840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.453+0000 7f6b70d06640 1 -- 172.21.15.43:0/2961607769 >> 172.21.15.43:0/2961607769 conn(0x7f6b6c0fdbd0 msgr2=0x7f6b6c104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.453+0000 7f6b70d06640 1 -- 172.21.15.43:0/2961607769 shutdown_connections 2024-04-25T13:42:14.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.453+0000 7f6b70d06640 1 -- 172.21.15.43:0/2961607769 wait complete. 2024-04-25T13:42:14.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:14 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1516106972' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-04-25T13:42:14.464 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:14.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.576+0000 7fc8fa93f640 1 -- 172.21.15.43:0/230330011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8f41080c0 msgr2=0x7fc8f410a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.576+0000 7fc8fa93f640 1 --2- 172.21.15.43:0/230330011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8f41080c0 0x7fc8f410a4e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009ca0 tx=0x7fc8ec02a8e0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.576+0000 7fc8fa93f640 1 -- 172.21.15.43:0/230330011 shutdown_connections 2024-04-25T13:42:14.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.576+0000 7fc8fa93f640 1 --2- 172.21.15.43:0/230330011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8f41080c0 0x7fc8f410a4e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.576+0000 7fc8fa93f640 1 --2- 172.21.15.43:0/230330011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8f41033c0 0x7fc8f41037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.576+0000 7fc8fa93f640 1 --2- 172.21.15.43:0/230330011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8f4102180 0x7fc8f4102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.576+0000 7fc8fa93f640 1 -- 172.21.15.43:0/230330011 >> 172.21.15.43:0/230330011 conn(0x7fc8f40fd3b0 msgr2=0x7fc8f40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.576+0000 7fc8fa93f640 1 -- 172.21.15.43:0/230330011 shutdown_connections 2024-04-25T13:42:14.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.576+0000 7fc8fa93f640 1 -- 172.21.15.43:0/230330011 wait complete. 2024-04-25T13:42:14.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8fa93f640 1 Processor -- start 2024-04-25T13:42:14.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8fa93f640 1 -- start start 2024-04-25T13:42:14.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8fa93f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8f4102180 0x7fc8f419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8fa93f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8f41033c0 0x7fc8f419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8fa93f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8f41080c0 0x7fc8f41a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8fa93f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f410dbb0 con 0x7fc8f4102180 2024-04-25T13:42:14.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8fa93f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f410da30 con 0x7fc8f41033c0 2024-04-25T13:42:14.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8fa93f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f410dd30 con 0x7fc8f41080c0 2024-04-25T13:42:14.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8f3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8f4102180 0x7fc8f419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8f3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8f4102180 0x7fc8f419a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41846/0 (socket says 172.21.15.43:41846) 2024-04-25T13:42:14.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8f3fff640 1 -- 172.21.15.43:0/2995340135 learned_addr learned my addr 172.21.15.43:0/2995340135 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:14.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8f8edc640 1 --2- 172.21.15.43:0/2995340135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8f41080c0 0x7fc8f41a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8f37fe640 1 --2- 172.21.15.43:0/2995340135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8f41033c0 0x7fc8f419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8f3fff640 1 -- 172.21.15.43:0/2995340135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8f41080c0 msgr2=0x7fc8f41a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8f3fff640 1 --2- 172.21.15.43:0/2995340135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8f41080c0 0x7fc8f41a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8f3fff640 1 -- 172.21.15.43:0/2995340135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8f41033c0 msgr2=0x7fc8f419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8f3fff640 1 --2- 172.21.15.43:0/2995340135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8f41033c0 0x7fc8f419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8f3fff640 1 -- 172.21.15.43:0/2995340135 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f41a1ba0 con 0x7fc8f4102180 2024-04-25T13:42:14.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.577+0000 7fc8f37fe640 1 --2- 172.21.15.43:0/2995340135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8f41033c0 0x7fc8f419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:14.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.578+0000 7fc8f3fff640 1 --2- 172.21.15.43:0/2995340135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8f4102180 0x7fc8f419a110 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc006fd0 tx=0x7fc8dc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.578+0000 7fc8f17fa640 1 -- 172.21.15.43:0/2995340135 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc011830 con 0x7fc8f4102180 2024-04-25T13:42:14.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.578+0000 7fc8f17fa640 1 -- 172.21.15.43:0/2995340135 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8dc016070 con 0x7fc8f4102180 2024-04-25T13:42:14.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.578+0000 7fc8fa93f640 1 -- 172.21.15.43:0/2995340135 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f41a1e90 con 0x7fc8f4102180 2024-04-25T13:42:14.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.578+0000 7fc8f17fa640 1 -- 172.21.15.43:0/2995340135 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc010d30 con 0x7fc8f4102180 2024-04-25T13:42:14.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.578+0000 7fc8fa93f640 1 -- 172.21.15.43:0/2995340135 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f41a2380 con 0x7fc8f4102180 2024-04-25T13:42:14.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.579+0000 7fc8fa93f640 1 -- 172.21.15.43:0/2995340135 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f41a2640 con 0x7fc8f4102180 2024-04-25T13:42:14.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.580+0000 7fc8f17fa640 1 -- 172.21.15.43:0/2995340135 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fc8dc0119d0 con 0x7fc8f4102180 2024-04-25T13:42:14.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.581+0000 7fc8f17fa640 1 --2- 172.21.15.43:0/2995340135 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc8e00afb70 0x7fc8e00b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.581+0000 7fc8f37fe640 1 --2- 172.21.15.43:0/2995340135 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc8e00afb70 0x7fc8e00b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.581+0000 7fc8f17fa640 1 -- 172.21.15.43:0/2995340135 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fc8dc0deb90 con 0x7fc8f4102180 2024-04-25T13:42:14.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.582+0000 7fc8f37fe640 1 --2- 172.21.15.43:0/2995340135 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc8e00afb70 0x7fc8e00b2080 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc8f419b1b0 tx=0x7fc8e4005db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.585+0000 7fc8f17fa640 1 -- 172.21.15.43:0/2995340135 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc8dc0a7530 con 0x7fc8f4102180 2024-04-25T13:42:14.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.772+0000 7fc8fa93f640 1 -- 172.21.15.43:0/2995340135 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8f41a2810 con 0x7fc8f4102180 2024-04-25T13:42:14.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.774+0000 7fc8f17fa640 1 -- 172.21.15.43:0/2995340135 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24117 (secure 0 0 0) 0x7fc8dc0a6e30 con 0x7fc8f4102180 2024-04-25T13:42:14.774 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:14.775 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":80,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:42:13.441319+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:14.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.776+0000 7fc8fa93f640 1 -- 172.21.15.43:0/2995340135 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc8e00afb70 msgr2=0x7fc8e00b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.776+0000 7fc8fa93f640 1 --2- 172.21.15.43:0/2995340135 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc8e00afb70 0x7fc8e00b2080 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc8f419b1b0 tx=0x7fc8e4005db0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.776+0000 7fc8fa93f640 1 -- 172.21.15.43:0/2995340135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8f4102180 msgr2=0x7fc8f419a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.776+0000 7fc8fa93f640 1 --2- 172.21.15.43:0/2995340135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8f4102180 0x7fc8f419a110 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc006fd0 tx=0x7fc8dc00b8e0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.776+0000 7fc8fa93f640 1 -- 172.21.15.43:0/2995340135 shutdown_connections 2024-04-25T13:42:14.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.776+0000 7fc8fa93f640 1 --2- 172.21.15.43:0/2995340135 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc8e00afb70 0x7fc8e00b2080 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.776+0000 7fc8fa93f640 1 --2- 172.21.15.43:0/2995340135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8f41080c0 0x7fc8f41a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.776+0000 7fc8fa93f640 1 --2- 172.21.15.43:0/2995340135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8f41033c0 0x7fc8f419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.776+0000 7fc8fa93f640 1 --2- 172.21.15.43:0/2995340135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8f4102180 0x7fc8f419a110 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.776+0000 7fc8fa93f640 1 -- 172.21.15.43:0/2995340135 >> 172.21.15.43:0/2995340135 conn(0x7fc8f40fd3b0 msgr2=0x7fc8f410e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.776+0000 7fc8fa93f640 1 -- 172.21.15.43:0/2995340135 shutdown_connections 2024-04-25T13:42:14.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.776+0000 7fc8fa93f640 1 -- 172.21.15.43:0/2995340135 wait complete. 2024-04-25T13:42:14.789 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:14.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.900+0000 7fe55e8a7640 1 -- 172.21.15.43:0/4082736015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe558104d40 msgr2=0x7fe558105150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.900+0000 7fe55e8a7640 1 --2- 172.21.15.43:0/4082736015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe558104d40 0x7fe558105150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe540009900 tx=0x7fe54002a410 comp rx=0 tx=0).stop 2024-04-25T13:42:14.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.901+0000 7fe55e8a7640 1 -- 172.21.15.43:0/4082736015 shutdown_connections 2024-04-25T13:42:14.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.901+0000 7fe55e8a7640 1 --2- 172.21.15.43:0/4082736015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe558109a40 0x7fe55810be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.901+0000 7fe55e8a7640 1 --2- 172.21.15.43:0/4082736015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe558104d40 0x7fe558105150 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.901+0000 7fe55e8a7640 1 --2- 172.21.15.43:0/4082736015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe558103b00 0x7fe558104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.901+0000 7fe55e8a7640 1 -- 172.21.15.43:0/4082736015 >> 172.21.15.43:0/4082736015 conn(0x7fe5580fed10 msgr2=0x7fe5581011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.901+0000 7fe55e8a7640 1 -- 172.21.15.43:0/4082736015 shutdown_connections 2024-04-25T13:42:14.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.901+0000 7fe55e8a7640 1 -- 172.21.15.43:0/4082736015 wait complete. 2024-04-25T13:42:14.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.901+0000 7fe55e8a7640 1 Processor -- start 2024-04-25T13:42:14.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.901+0000 7fe55e8a7640 1 -- start start 2024-04-25T13:42:14.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe55e8a7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe558103b00 0x7fe55819a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe55e8a7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe558104d40 0x7fe55819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe55e8a7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe558109a40 0x7fe5581a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe55e8a7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe55810f4d0 con 0x7fe558103b00 2024-04-25T13:42:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe55e8a7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe55810f350 con 0x7fe558104d40 2024-04-25T13:42:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe55e8a7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe55810f650 con 0x7fe558109a40 2024-04-25T13:42:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe557fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe558103b00 0x7fe55819a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe557fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe558103b00 0x7fe55819a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41864/0 (socket says 172.21.15.43:41864) 2024-04-25T13:42:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe557fff640 1 -- 172.21.15.43:0/13955280 learned_addr learned my addr 172.21.15.43:0/13955280 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe5577fe640 1 --2- 172.21.15.43:0/13955280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe558104d40 0x7fe55819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe557fff640 1 -- 172.21.15.43:0/13955280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe558109a40 msgr2=0x7fe5581a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe55ce44640 1 --2- 172.21.15.43:0/13955280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe558109a40 0x7fe5581a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe557fff640 1 --2- 172.21.15.43:0/13955280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe558109a40 0x7fe5581a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe557fff640 1 -- 172.21.15.43:0/13955280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe558104d40 msgr2=0x7fe55819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe557fff640 1 --2- 172.21.15.43:0/13955280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe558104d40 0x7fe55819a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe557fff640 1 -- 172.21.15.43:0/13955280 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5581a1c70 con 0x7fe558103b00 2024-04-25T13:42:14.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe55ce44640 1 --2- 172.21.15.43:0/13955280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe558109a40 0x7fe5581a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:14.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe557fff640 1 --2- 172.21.15.43:0/13955280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe558103b00 0x7fe55819a130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe54800c970 tx=0x7fe54800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe5557fa640 1 -- 172.21.15.43:0/13955280 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548004220 con 0x7fe558103b00 2024-04-25T13:42:14.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe55e8a7640 1 -- 172.21.15.43:0/13955280 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5581a1f60 con 0x7fe558103b00 2024-04-25T13:42:14.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe5557fa640 1 -- 172.21.15.43:0/13955280 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe548007e40 con 0x7fe558103b00 2024-04-25T13:42:14.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.902+0000 7fe5557fa640 1 -- 172.21.15.43:0/13955280 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5480047a0 con 0x7fe558103b00 2024-04-25T13:42:14.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.903+0000 7fe55e8a7640 1 -- 172.21.15.43:0/13955280 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5581a23c0 con 0x7fe558103b00 2024-04-25T13:42:14.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.903+0000 7fe55e8a7640 1 -- 172.21.15.43:0/13955280 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe55806a190 con 0x7fe558103b00 2024-04-25T13:42:14.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.905+0000 7fe5557fa640 1 -- 172.21.15.43:0/13955280 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fe5480079b0 con 0x7fe558103b00 2024-04-25T13:42:14.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.906+0000 7fe5557fa640 1 --2- 172.21.15.43:0/13955280 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5440afaf0 0x7fe5440b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.906+0000 7fe5577fe640 1 --2- 172.21.15.43:0/13955280 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5440afaf0 0x7fe5440b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.906+0000 7fe5557fa640 1 -- 172.21.15.43:0/13955280 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fe5480df150 con 0x7fe558103b00 2024-04-25T13:42:14.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.906+0000 7fe5577fe640 1 --2- 172.21.15.43:0/13955280 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5440afaf0 0x7fe5440b2000 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe540031460 tx=0x7fe540000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:14.909+0000 7fe5557fa640 1 -- 172.21.15.43:0/13955280 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe548014030 con 0x7fe558103b00 2024-04-25T13:42:15.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.098+0000 7fe55e8a7640 1 -- 172.21.15.43:0/13955280 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5581088a0 con 0x7fe558103b00 2024-04-25T13:42:15.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.099+0000 7fe5557fa640 1 -- 172.21.15.43:0/13955280 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24117 (secure 0 0 0) 0x7fe5581088a0 con 0x7fe558103b00 2024-04-25T13:42:15.100 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:15.100 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":80,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:42:13.441319+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:15.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.101+0000 7fe55e8a7640 1 -- 172.21.15.43:0/13955280 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5440afaf0 msgr2=0x7fe5440b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.101+0000 7fe55e8a7640 1 --2- 172.21.15.43:0/13955280 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5440afaf0 0x7fe5440b2000 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe540031460 tx=0x7fe540000bc0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.101+0000 7fe55e8a7640 1 -- 172.21.15.43:0/13955280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe558103b00 msgr2=0x7fe55819a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.101+0000 7fe55e8a7640 1 --2- 172.21.15.43:0/13955280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe558103b00 0x7fe55819a130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe54800c970 tx=0x7fe54800ce30 comp rx=0 tx=0).stop 2024-04-25T13:42:15.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.101+0000 7fe55e8a7640 1 -- 172.21.15.43:0/13955280 shutdown_connections 2024-04-25T13:42:15.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.101+0000 7fe55e8a7640 1 --2- 172.21.15.43:0/13955280 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5440afaf0 0x7fe5440b2000 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.101+0000 7fe55e8a7640 1 --2- 172.21.15.43:0/13955280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe558109a40 0x7fe5581a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.101+0000 7fe55e8a7640 1 --2- 172.21.15.43:0/13955280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe558104d40 0x7fe55819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.101+0000 7fe55e8a7640 1 --2- 172.21.15.43:0/13955280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe558103b00 0x7fe55819a130 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.101+0000 7fe55e8a7640 1 -- 172.21.15.43:0/13955280 >> 172.21.15.43:0/13955280 conn(0x7fe5580fed10 msgr2=0x7fe558105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:15.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.102+0000 7fe55e8a7640 1 -- 172.21.15.43:0/13955280 shutdown_connections 2024-04-25T13:42:15.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.102+0000 7fe55e8a7640 1 -- 172.21.15.43:0/13955280 wait complete. 2024-04-25T13:42:15.128 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:42:15.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.240+0000 7fcc7d013640 1 -- 172.21.15.43:0/231877262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc78108900 msgr2=0x7fcc7810ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.240+0000 7fcc7d013640 1 --2- 172.21.15.43:0/231877262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc78108900 0x7fcc7810ad20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcc70009ca0 tx=0x7fcc7002a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.240+0000 7fcc7d013640 1 -- 172.21.15.43:0/231877262 shutdown_connections 2024-04-25T13:42:15.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.240+0000 7fcc7d013640 1 --2- 172.21.15.43:0/231877262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc78108900 0x7fcc7810ad20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.240+0000 7fcc7d013640 1 --2- 172.21.15.43:0/231877262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc78103c00 0x7fcc78104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.240+0000 7fcc7d013640 1 --2- 172.21.15.43:0/231877262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc781029c0 0x7fcc781036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.240+0000 7fcc7d013640 1 -- 172.21.15.43:0/231877262 >> 172.21.15.43:0/231877262 conn(0x7fcc780fdbd0 msgr2=0x7fcc78100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:15.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.240+0000 7fcc7d013640 1 -- 172.21.15.43:0/231877262 shutdown_connections 2024-04-25T13:42:15.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.240+0000 7fcc7d013640 1 -- 172.21.15.43:0/231877262 wait complete. 2024-04-25T13:42:15.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.240+0000 7fcc7d013640 1 Processor -- start 2024-04-25T13:42:15.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc7d013640 1 -- start start 2024-04-25T13:42:15.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc7d013640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc781029c0 0x7fcc7806a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc7d013640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc78103c00 0x7fcc7819eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc7d013640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc78108900 0x7fcc781a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc7d013640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7810e3f0 con 0x7fcc781029c0 2024-04-25T13:42:15.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc7d013640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7810e270 con 0x7fcc78108900 2024-04-25T13:42:15.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc7d013640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7810e570 con 0x7fcc78103c00 2024-04-25T13:42:15.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc76d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc781029c0 0x7fcc7806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc76d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc781029c0 0x7fcc7806a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41890/0 (socket says 172.21.15.43:41890) 2024-04-25T13:42:15.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc76d9d640 1 -- 172.21.15.43:0/993778633 learned_addr learned my addr 172.21.15.43:0/993778633 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:15.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc7659c640 1 --2- 172.21.15.43:0/993778633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc78103c00 0x7fcc7819eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc7759e640 1 --2- 172.21.15.43:0/993778633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc78108900 0x7fcc781a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc76d9d640 1 -- 172.21.15.43:0/993778633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc78103c00 msgr2=0x7fcc7819eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc76d9d640 1 --2- 172.21.15.43:0/993778633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc78103c00 0x7fcc7819eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc76d9d640 1 -- 172.21.15.43:0/993778633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc78108900 msgr2=0x7fcc781a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc76d9d640 1 --2- 172.21.15.43:0/993778633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc78108900 0x7fcc781a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc76d9d640 1 -- 172.21.15.43:0/993778633 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc781a1c10 con 0x7fcc781029c0 2024-04-25T13:42:15.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.241+0000 7fcc76d9d640 1 --2- 172.21.15.43:0/993778633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc781029c0 0x7fcc7806a900 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcc68005d00 tx=0x7fcc6800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.242+0000 7fcc5ffff640 1 -- 172.21.15.43:0/993778633 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68017070 con 0x7fcc781029c0 2024-04-25T13:42:15.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.242+0000 7fcc5ffff640 1 -- 172.21.15.43:0/993778633 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc68009c30 con 0x7fcc781029c0 2024-04-25T13:42:15.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.242+0000 7fcc7d013640 1 -- 172.21.15.43:0/993778633 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc781a1f00 con 0x7fcc781029c0 2024-04-25T13:42:15.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.242+0000 7fcc5ffff640 1 -- 172.21.15.43:0/993778633 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6800f620 con 0x7fcc781029c0 2024-04-25T13:42:15.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.242+0000 7fcc7d013640 1 -- 172.21.15.43:0/993778633 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc781a2360 con 0x7fcc781029c0 2024-04-25T13:42:15.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.243+0000 7fcc7d013640 1 -- 172.21.15.43:0/993778633 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc7806af80 con 0x7fcc781029c0 2024-04-25T13:42:15.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.245+0000 7fcc5ffff640 1 -- 172.21.15.43:0/993778633 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fcc6801a070 con 0x7fcc781029c0 2024-04-25T13:42:15.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.246+0000 7fcc5ffff640 1 --2- 172.21.15.43:0/993778633 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcc600afb70 0x7fcc600b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.246+0000 7fcc7659c640 1 --2- 172.21.15.43:0/993778633 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcc600afb70 0x7fcc600b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.246+0000 7fcc5ffff640 1 -- 172.21.15.43:0/993778633 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fcc680de880 con 0x7fcc781029c0 2024-04-25T13:42:15.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.246+0000 7fcc7659c640 1 --2- 172.21.15.43:0/993778633 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcc600afb70 0x7fcc600b2080 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcc7806a2a0 tx=0x7fcc6c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.250+0000 7fcc5ffff640 1 -- 172.21.15.43:0/993778633 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcc68009de0 con 0x7fcc781029c0 2024-04-25T13:42:15.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:15 smithi161 ceph-mon[32696]: pgmap v287: 129 pgs: 4 creating+peering, 100 active+clean, 25 unknown; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 9 op/s 2024-04-25T13:42:15.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:15 smithi161 ceph-mon[32696]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T13:42:15.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:15 smithi161 ceph-mon[32696]: osdmap e80: 12 total, 12 up, 12 in 2024-04-25T13:42:15.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:15 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1516106972' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-04-25T13:42:15.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:15 smithi161 ceph-mon[32696]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T13:42:15.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:15 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2961607769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:15.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:15 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2995340135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:15.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:15 smithi175 ceph-mon[32649]: pgmap v287: 129 pgs: 4 creating+peering, 100 active+clean, 25 unknown; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 9 op/s 2024-04-25T13:42:15.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:15 smithi175 ceph-mon[32649]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T13:42:15.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:15 smithi175 ceph-mon[32649]: osdmap e80: 12 total, 12 up, 12 in 2024-04-25T13:42:15.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:15 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1516106972' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-04-25T13:42:15.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:15 smithi175 ceph-mon[32649]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T13:42:15.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:15 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2961607769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:15.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:15 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2995340135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:15.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:15 smithi043 ceph-mon[29195]: pgmap v287: 129 pgs: 4 creating+peering, 100 active+clean, 25 unknown; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 9 op/s 2024-04-25T13:42:15.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:15 smithi043 ceph-mon[29195]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T13:42:15.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:15 smithi043 ceph-mon[29195]: osdmap e80: 12 total, 12 up, 12 in 2024-04-25T13:42:15.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:15 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1516106972' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-04-25T13:42:15.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:15 smithi043 ceph-mon[29195]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T13:42:15.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:15 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2961607769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:15.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:15 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2995340135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:15.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.475+0000 7fcc7d013640 1 -- 172.21.15.43:0/993778633 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc7802dbf0 con 0x7fcc781029c0 2024-04-25T13:42:15.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.476+0000 7fcc5ffff640 1 -- 172.21.15.43:0/993778633 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11803 (secure 0 0 0) 0x7fcc680a7240 con 0x7fcc781029c0 2024-04-25T13:42:15.476 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:15.476 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2642701222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2642701222},{"type":"v1","addr":"172.21.15.43:6839","nonce":2642701222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6841/3777483996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":3777483996},{"type":"v1","addr":"172.21.15.43:6841","nonce":3777483996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/3323587585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3323587585},{"type":"v1","addr":"172.21.15.175:6839","nonce":3323587585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24509,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1464384320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1464384320},{"type":"v1","addr":"172.21.15.161:6837","nonce":1464384320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:42:08.401075+0000","modified":"2024-04-25T13:42:13.441504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24542},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6839/1243414461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":1243414461},{"type":"v1","addr":"172.21.15.161:6839","nonce":1243414461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24542,"qdb_cluster":[24542]},"id":1}]} 2024-04-25T13:42:15.476 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 17 2024-04-25T13:42:15.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.478+0000 7fcc7d013640 1 -- 172.21.15.43:0/993778633 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcc600afb70 msgr2=0x7fcc600b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.478+0000 7fcc7d013640 1 --2- 172.21.15.43:0/993778633 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcc600afb70 0x7fcc600b2080 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcc7806a2a0 tx=0x7fcc6c005f90 comp rx=0 tx=0).stop 2024-04-25T13:42:15.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.478+0000 7fcc7d013640 1 -- 172.21.15.43:0/993778633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc781029c0 msgr2=0x7fcc7806a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.478+0000 7fcc7d013640 1 --2- 172.21.15.43:0/993778633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc781029c0 0x7fcc7806a900 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcc68005d00 tx=0x7fcc6800dde0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.478+0000 7fcc7d013640 1 -- 172.21.15.43:0/993778633 shutdown_connections 2024-04-25T13:42:15.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.478+0000 7fcc7d013640 1 --2- 172.21.15.43:0/993778633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc78108900 0x7fcc781a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.478+0000 7fcc7d013640 1 --2- 172.21.15.43:0/993778633 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcc600afb70 0x7fcc600b2080 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.478+0000 7fcc7d013640 1 --2- 172.21.15.43:0/993778633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc78103c00 0x7fcc7819eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.478+0000 7fcc7d013640 1 --2- 172.21.15.43:0/993778633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc781029c0 0x7fcc7806a900 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.478+0000 7fcc7d013640 1 -- 172.21.15.43:0/993778633 >> 172.21.15.43:0/993778633 conn(0x7fcc780fdbd0 msgr2=0x7fcc781048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:15.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.478+0000 7fcc7d013640 1 -- 172.21.15.43:0/993778633 shutdown_connections 2024-04-25T13:42:15.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.478+0000 7fcc7d013640 1 -- 172.21.15.43:0/993778633 wait complete. 2024-04-25T13:42:15.490 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:15.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.601+0000 7f91eaef9640 1 -- 172.21.15.43:0/3652601089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91e4109a40 msgr2=0x7f91e410be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.601+0000 7f91eaef9640 1 --2- 172.21.15.43:0/3652601089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91e4109a40 0x7f91e410be60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009ca0 tx=0x7f91dc02a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.601+0000 7f91eaef9640 1 -- 172.21.15.43:0/3652601089 shutdown_connections 2024-04-25T13:42:15.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.601+0000 7f91eaef9640 1 --2- 172.21.15.43:0/3652601089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91e4109a40 0x7f91e410be60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.601+0000 7f91eaef9640 1 --2- 172.21.15.43:0/3652601089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91e4104d40 0x7f91e4105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.601+0000 7f91eaef9640 1 --2- 172.21.15.43:0/3652601089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e4103b00 0x7f91e4104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.601+0000 7f91eaef9640 1 -- 172.21.15.43:0/3652601089 >> 172.21.15.43:0/3652601089 conn(0x7f91e40fed10 msgr2=0x7f91e41011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:15.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.601+0000 7f91eaef9640 1 -- 172.21.15.43:0/3652601089 shutdown_connections 2024-04-25T13:42:15.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.601+0000 7f91eaef9640 1 -- 172.21.15.43:0/3652601089 wait complete. 2024-04-25T13:42:15.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.602+0000 7f91eaef9640 1 Processor -- start 2024-04-25T13:42:15.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.602+0000 7f91eaef9640 1 -- start start 2024-04-25T13:42:15.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.602+0000 7f91eaef9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91e4103b00 0x7f91e419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.602+0000 7f91eaef9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91e4104d40 0x7f91e419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.602+0000 7f91eaef9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e4109a40 0x7f91e41a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.602+0000 7f91eaef9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f91e410f510 con 0x7f91e4104d40 2024-04-25T13:42:15.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.602+0000 7f91eaef9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f91e410f390 con 0x7f91e4103b00 2024-04-25T13:42:15.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.602+0000 7f91eaef9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91e410f690 con 0x7f91e4109a40 2024-04-25T13:42:15.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.602+0000 7f91e3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91e4104d40 0x7f91e419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.602+0000 7f91e3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91e4104d40 0x7f91e419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41904/0 (socket says 172.21.15.43:41904) 2024-04-25T13:42:15.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.602+0000 7f91e3fff640 1 -- 172.21.15.43:0/3058321420 learned_addr learned my addr 172.21.15.43:0/3058321420 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:15.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.602+0000 7f91e8c95640 1 --2- 172.21.15.43:0/3058321420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91e4103b00 0x7f91e419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.603+0000 7f91e9496640 1 --2- 172.21.15.43:0/3058321420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e4109a40 0x7f91e41a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.603+0000 7f91e3fff640 1 -- 172.21.15.43:0/3058321420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e4109a40 msgr2=0x7f91e41a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.603+0000 7f91e3fff640 1 --2- 172.21.15.43:0/3058321420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e4109a40 0x7f91e41a15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.603+0000 7f91e3fff640 1 -- 172.21.15.43:0/3058321420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91e4103b00 msgr2=0x7f91e419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.603+0000 7f91e3fff640 1 --2- 172.21.15.43:0/3058321420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91e4103b00 0x7f91e419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.603+0000 7f91e3fff640 1 -- 172.21.15.43:0/3058321420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e41a1b80 con 0x7f91e4104d40 2024-04-25T13:42:15.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.603+0000 7f91e3fff640 1 --2- 172.21.15.43:0/3058321420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91e4104d40 0x7f91e419a630 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f91d800d950 tx=0x7f91d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.603+0000 7f91e1ffb640 1 -- 172.21.15.43:0/3058321420 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8017070 con 0x7f91e4104d40 2024-04-25T13:42:15.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.603+0000 7f91e1ffb640 1 -- 172.21.15.43:0/3058321420 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f91d8009c30 con 0x7f91e4104d40 2024-04-25T13:42:15.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.603+0000 7f91eaef9640 1 -- 172.21.15.43:0/3058321420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e41a1e70 con 0x7f91e4104d40 2024-04-25T13:42:15.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.603+0000 7f91e1ffb640 1 -- 172.21.15.43:0/3058321420 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d800f620 con 0x7f91e4104d40 2024-04-25T13:42:15.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.603+0000 7f91eaef9640 1 -- 172.21.15.43:0/3058321420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e41a22e0 con 0x7f91e4104d40 2024-04-25T13:42:15.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.604+0000 7f91eaef9640 1 -- 172.21.15.43:0/3058321420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e4108850 con 0x7f91e4104d40 2024-04-25T13:42:15.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.605+0000 7f91e1ffb640 1 -- 172.21.15.43:0/3058321420 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f91d8010460 con 0x7f91e4104d40 2024-04-25T13:42:15.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.606+0000 7f91e1ffb640 1 --2- 172.21.15.43:0/3058321420 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f91cc0afaf0 0x7f91cc0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.606+0000 7f91e8c95640 1 --2- 172.21.15.43:0/3058321420 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f91cc0afaf0 0x7f91cc0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.606+0000 7f91e1ffb640 1 -- 172.21.15.43:0/3058321420 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f91d80deac0 con 0x7f91e4104d40 2024-04-25T13:42:15.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.607+0000 7f91e8c95640 1 --2- 172.21.15.43:0/3058321420 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f91cc0afaf0 0x7f91cc0b2000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f91e4104700 tx=0x7f91d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.611+0000 7f91e1ffb640 1 -- 172.21.15.43:0/3058321420 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f91d80a7460 con 0x7f91e4104d40 2024-04-25T13:42:15.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.800+0000 7f91eaef9640 1 -- 172.21.15.43:0/3058321420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91e40637d0 con 0x7f91e4104d40 2024-04-25T13:42:15.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.802+0000 7f91e1ffb640 1 -- 172.21.15.43:0/3058321420 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24117 (secure 0 0 0) 0x7f91d8009de0 con 0x7f91e4104d40 2024-04-25T13:42:15.802 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:15.803 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":80,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:42:13.441319+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:15.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.804+0000 7f91eaef9640 1 -- 172.21.15.43:0/3058321420 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f91cc0afaf0 msgr2=0x7f91cc0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.804+0000 7f91eaef9640 1 --2- 172.21.15.43:0/3058321420 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f91cc0afaf0 0x7f91cc0b2000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f91e4104700 tx=0x7f91d4005f90 comp rx=0 tx=0).stop 2024-04-25T13:42:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.804+0000 7f91eaef9640 1 -- 172.21.15.43:0/3058321420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91e4104d40 msgr2=0x7f91e419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.804+0000 7f91eaef9640 1 --2- 172.21.15.43:0/3058321420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91e4104d40 0x7f91e419a630 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f91d800d950 tx=0x7f91d800de10 comp rx=0 tx=0).stop 2024-04-25T13:42:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.804+0000 7f91eaef9640 1 -- 172.21.15.43:0/3058321420 shutdown_connections 2024-04-25T13:42:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.804+0000 7f91eaef9640 1 --2- 172.21.15.43:0/3058321420 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f91cc0afaf0 0x7f91cc0b2000 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.804+0000 7f91eaef9640 1 --2- 172.21.15.43:0/3058321420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e4109a40 0x7f91e41a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.804+0000 7f91eaef9640 1 --2- 172.21.15.43:0/3058321420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91e4104d40 0x7f91e419a630 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.804+0000 7f91eaef9640 1 --2- 172.21.15.43:0/3058321420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91e4103b00 0x7f91e419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.804+0000 7f91eaef9640 1 -- 172.21.15.43:0/3058321420 >> 172.21.15.43:0/3058321420 conn(0x7f91e40fed10 msgr2=0x7f91e4105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.804+0000 7f91eaef9640 1 -- 172.21.15.43:0/3058321420 shutdown_connections 2024-04-25T13:42:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.804+0000 7f91eaef9640 1 -- 172.21.15.43:0/3058321420 wait complete. 2024-04-25T13:42:15.817 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T13:42:08.401075+0000', 'modified': '2024-04-25T13:42:13.441504+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24542}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24542': {'gid': 24542, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.161:6839/1243414461', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6838', 'nonce': 1243414461}, {'type': 'v1', 'addr': '172.21.15.161:6839', 'nonce': 1243414461}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24542, 'qdb_cluster': [24542]} 2024-04-25T13:42:15.817 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T13:42:15.817 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T13:42:15.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.929+0000 7fb779eca640 1 -- 172.21.15.43:0/1329207125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb774108930 msgr2=0x7fb77410ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.929+0000 7fb779eca640 1 --2- 172.21.15.43:0/1329207125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb774108930 0x7fb77410ad50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb76c009ca0 tx=0x7fb76c02a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.929+0000 7fb779eca640 1 -- 172.21.15.43:0/1329207125 shutdown_connections 2024-04-25T13:42:15.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.929+0000 7fb779eca640 1 --2- 172.21.15.43:0/1329207125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb774108930 0x7fb77410ad50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.929+0000 7fb779eca640 1 --2- 172.21.15.43:0/1329207125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb774103c30 0x7fb774104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.929+0000 7fb779eca640 1 --2- 172.21.15.43:0/1329207125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7741029f0 0x7fb7741036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.929+0000 7fb779eca640 1 -- 172.21.15.43:0/1329207125 >> 172.21.15.43:0/1329207125 conn(0x7fb7740fdbc0 msgr2=0x7fb774100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:15.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.930+0000 7fb779eca640 1 -- 172.21.15.43:0/1329207125 shutdown_connections 2024-04-25T13:42:15.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.930+0000 7fb779eca640 1 -- 172.21.15.43:0/1329207125 wait complete. 2024-04-25T13:42:15.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.930+0000 7fb779eca640 1 Processor -- start 2024-04-25T13:42:15.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.930+0000 7fb779eca640 1 -- start start 2024-04-25T13:42:15.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb779eca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7741029f0 0x7fb77419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb779eca640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb774103c30 0x7fb77419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb779eca640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774108930 0x7fb7741a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb779eca640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb77410e400 con 0x7fb774103c30 2024-04-25T13:42:15.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb779eca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fb77410e280 con 0x7fb7741029f0 2024-04-25T13:42:15.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb779eca640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb77410e580 con 0x7fb774108930 2024-04-25T13:42:15.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb772ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb774103c30 0x7fb77419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb772ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb774103c30 0x7fb77419a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41922/0 (socket says 172.21.15.43:41922) 2024-04-25T13:42:15.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb772ffd640 1 -- 172.21.15.43:0/796897456 learned_addr learned my addr 172.21.15.43:0/796897456 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:15.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb7737fe640 1 --2- 172.21.15.43:0/796897456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7741029f0 0x7fb77419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb773fff640 1 --2- 172.21.15.43:0/796897456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774108930 0x7fb7741a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb772ffd640 1 -- 172.21.15.43:0/796897456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774108930 msgr2=0x7fb7741a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb772ffd640 1 --2- 172.21.15.43:0/796897456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774108930 0x7fb7741a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb772ffd640 1 -- 172.21.15.43:0/796897456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7741029f0 msgr2=0x7fb77419a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb772ffd640 1 --2- 172.21.15.43:0/796897456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7741029f0 0x7fb77419a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb772ffd640 1 -- 172.21.15.43:0/796897456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7741a1c60 con 0x7fb774103c30 2024-04-25T13:42:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb7737fe640 1 --2- 172.21.15.43:0/796897456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7741029f0 0x7fb77419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb773fff640 1 --2- 172.21.15.43:0/796897456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774108930 0x7fb7741a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb772ffd640 1 --2- 172.21.15.43:0/796897456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb774103c30 0x7fb77419a660 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb76400d950 tx=0x7fb76400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb770ff9640 1 -- 172.21.15.43:0/796897456 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764017070 con 0x7fb774103c30 2024-04-25T13:42:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb770ff9640 1 -- 172.21.15.43:0/796897456 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb764009c30 con 0x7fb774103c30 2024-04-25T13:42:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.931+0000 7fb779eca640 1 -- 172.21.15.43:0/796897456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7741a1f50 con 0x7fb774103c30 2024-04-25T13:42:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.932+0000 7fb770ff9640 1 -- 172.21.15.43:0/796897456 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76400f620 con 0x7fb774103c30 2024-04-25T13:42:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.932+0000 7fb779eca640 1 -- 172.21.15.43:0/796897456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7741a23c0 con 0x7fb774103c30 2024-04-25T13:42:15.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb780d79740 1 Processor -- start 2024-04-25T13:42:15.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb780d79740 1 -- start start 2024-04-25T13:42:15.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb770ff9640 1 -- 172.21.15.43:0/796897456 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fb764010460 con 0x7fb774103c30 2024-04-25T13:42:15.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb780d79740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7ff270 0x5600abba0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb780d79740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7d63b0 0x5600abba08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb780d79740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7de590 0x5600abba77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb780d79740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5600abb05740 con 0x5600ab7de590 2024-04-25T13:42:15.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb780d79740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x5600abaa13a0 con 0x5600ab7ff270 2024-04-25T13:42:15.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb780d79740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5600abb01700 con 0x5600ab7d63b0 2024-04-25T13:42:15.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb772ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7de590 0x5600abba77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb772ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7de590 0x5600abba77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41928/0 (socket says 172.21.15.43:41928) 2024-04-25T13:42:15.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb772ffd640 1 -- 172.21.15.43:0/748631048 learned_addr learned my addr 172.21.15.43:0/748631048 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:15.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb7737fe640 1 --2- 172.21.15.43:0/748631048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7d63b0 0x5600abba08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb773fff640 1 --2- 172.21.15.43:0/748631048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7ff270 0x5600abba0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb772ffd640 1 -- 172.21.15.43:0/748631048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7d63b0 msgr2=0x5600abba08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:15.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb772ffd640 1 --2- 172.21.15.43:0/748631048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7d63b0 0x5600abba08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb772ffd640 1 -- 172.21.15.43:0/748631048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7ff270 msgr2=0x5600abba0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:15.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb772ffd640 1 --2- 172.21.15.43:0/748631048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7ff270 0x5600abba0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb772ffd640 1 -- 172.21.15.43:0/748631048 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600ababd750 con 0x5600ab7de590 2024-04-25T13:42:15.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.935+0000 7fb773fff640 1 --2- 172.21.15.43:0/748631048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7ff270 0x5600abba0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:15.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.936+0000 7fb772ffd640 1 --2- 172.21.15.43:0/748631048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7de590 0x5600abba77f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb7640e2b80 tx=0x7fb7640e7640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8552320d9961b4b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.936+0000 7fb770ff9640 1 --2- 172.21.15.43:0/796897456 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb7600afaf0 0x7fb7600b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.936+0000 7fb769ffb640 1 -- 172.21.15.43:0/748631048 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7640ee070 con 0x5600ab7de590 2024-04-25T13:42:15.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.936+0000 7fb773fff640 1 --2- 172.21.15.43:0/796897456 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb7600afaf0 0x7fb7600b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.936+0000 7fb769ffb640 1 -- 172.21.15.43:0/748631048 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7640a6920 con 0x5600ab7de590 2024-04-25T13:42:15.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.936+0000 7fb769ffb640 1 -- 172.21.15.43:0/748631048 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7640a2cd0 con 0x5600ab7de590 2024-04-25T13:42:15.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.936+0000 7fb770ff9640 1 -- 172.21.15.43:0/796897456 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fb7640deb70 con 0x7fb774103c30 2024-04-25T13:42:15.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.937+0000 7fb780d79740 1 -- 172.21.15.43:0/748631048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7de590 msgr2=0x5600abba77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.937+0000 7fb780d79740 1 --2- 172.21.15.43:0/748631048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7de590 0x5600abba77f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb7640e2b80 tx=0x7fb7640e7640 comp rx=0 tx=0).stop 2024-04-25T13:42:15.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.937+0000 7fb773fff640 1 --2- 172.21.15.43:0/796897456 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb7600afaf0 0x7fb7600b2000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb76c005cc0 tx=0x7fb76c005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.937+0000 7fb780d79740 1 -- 172.21.15.43:0/748631048 shutdown_connections 2024-04-25T13:42:15.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.937+0000 7fb780d79740 1 --2- 172.21.15.43:0/748631048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7de590 0x5600abba77f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.937+0000 7fb780d79740 1 --2- 172.21.15.43:0/748631048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7d63b0 0x5600abba08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.937+0000 7fb780d79740 1 --2- 172.21.15.43:0/748631048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7ff270 0x5600abba0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.937+0000 7fb780d79740 1 -- 172.21.15.43:0/748631048 >> 172.21.15.43:0/748631048 conn(0x5600ab7f33c0 msgr2=0x5600abb9bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:15.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.937+0000 7fb780d79740 1 -- 172.21.15.43:0/748631048 shutdown_connections 2024-04-25T13:42:15.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.937+0000 7fb780d79740 1 -- 172.21.15.43:0/748631048 wait complete. 2024-04-25T13:42:15.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.937+0000 7fb780d79740 1 -- start start 2024-04-25T13:42:15.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb780d79740 1 Processor -- start 2024-04-25T13:42:15.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb780d79740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7d63b0 0x5600abbaa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb780d79740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7de590 0x5600abbaa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb780d79740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7ff270 0x5600abbb1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb780d79740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5600abba8240 con 0x5600ab7ff270 2024-04-25T13:42:15.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb780d79740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x5600aba8cfe0 con 0x5600ab7d63b0 2024-04-25T13:42:15.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb780d79740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5600abba83c0 con 0x5600ab7de590 2024-04-25T13:42:15.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb780d79740 10 client.0 _ll_register_callbacks cb 0x5600abaa3150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:42:15.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb773fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7ff270 0x5600abbb1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb773fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7ff270 0x5600abbb1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41932/0 (socket says 172.21.15.43:41932) 2024-04-25T13:42:15.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb773fff640 1 -- 172.21.15.43:0/3710483529 learned_addr learned my addr 172.21.15.43:0/3710483529 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:15.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb772ffd640 1 --2- 172.21.15.43:0/3710483529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7de590 0x5600abbaa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb7737fe640 1 --2- 172.21.15.43:0/3710483529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7d63b0 0x5600abbaa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb773fff640 1 -- 172.21.15.43:0/3710483529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7de590 msgr2=0x5600abbaa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:15.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb773fff640 1 --2- 172.21.15.43:0/3710483529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7de590 0x5600abbaa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb773fff640 1 -- 172.21.15.43:0/3710483529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7d63b0 msgr2=0x5600abbaa2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:15.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb773fff640 1 --2- 172.21.15.43:0/3710483529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7d63b0 0x5600abbaa2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb773fff640 1 -- 172.21.15.43:0/3710483529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600ab8172d0 con 0x5600ab7ff270 2024-04-25T13:42:15.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb7737fe640 1 --2- 172.21.15.43:0/3710483529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7d63b0 0x5600abbaa2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:15.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb773fff640 1 --2- 172.21.15.43:0/3710483529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7ff270 0x5600abbb1750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb76c035000 tx=0x7fb76c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae4c0e594d84162 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.938+0000 7fb752ffd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T13:42:15.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.939+0000 7fb752ffd640 1 -- 172.21.15.43:0/3710483529 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c04e070 con 0x5600ab7ff270 2024-04-25T13:42:15.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.939+0000 7fb752ffd640 1 -- 172.21.15.43:0/3710483529 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fb76c0047d0 con 0x5600ab7ff270 2024-04-25T13:42:15.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.939+0000 7fb780d79740 1 -- 172.21.15.43:0/3710483529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7640a6920 con 0x5600ab7ff270 2024-04-25T13:42:15.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.939+0000 7fb752ffd640 1 -- 172.21.15.43:0/3710483529 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb76c0305c0 con 0x5600ab7ff270 2024-04-25T13:42:15.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.939+0000 7fb780d79740 10 client.14778 fetch_fsmap learned FSMap version 17 2024-04-25T13:42:15.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.939+0000 7fb780d79740 1 -- 172.21.15.43:0/3710483529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5600ab8e16b0 con 0x5600ab7ff270 2024-04-25T13:42:15.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.939+0000 7fb752ffd640 1 -- 172.21.15.43:0/3710483529 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7640a6920 con 0x5600ab7ff270 2024-04-25T13:42:15.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.939+0000 7fb752ffd640 1 -- 172.21.15.43:0/3710483529 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7fb76c043040 con 0x5600ab7ff270 2024-04-25T13:42:15.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.939+0000 7fb780d79740 10 client.14778 fetch_fsmap finished waiting for FSMap version 17 2024-04-25T13:42:15.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.939+0000 7fb780d79740 10 client.14778 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T13:42:15.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.939+0000 7fb780d79740 20 client.14778 populate_metadata read hostname 'smithi043' 2024-04-25T13:42:15.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.939+0000 7fb780d79740 1 --2- 172.21.15.43:0/3710483529 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x5600ab7bde40 0x5600abbb7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.939+0000 7fb780d79740 4 client.14778 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:42:15.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.939+0000 7fb780d79740 1 -- 172.21.15.43:0/3710483529 --> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600abb13350 con 0x5600ab7bde40 2024-04-25T13:42:15.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.940+0000 7fb7737fe640 1 --2- 172.21.15.43:0/3710483529 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x5600ab7bde40 0x5600abbb7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.940+0000 7fb752ffd640 10 client.14778 ms_handle_connect on v2:172.21.15.161:6838/1243414461 2024-04-25T13:42:15.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.940+0000 7fb7737fe640 1 --2- 172.21.15.43:0/3710483529 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x5600ab7bde40 0x5600abbb7fd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=284c900ad3d9fe1 server_cookie=22a01f5b7255481e in_seq=0 out_seq=0 2024-04-25T13:42:15.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.941+0000 7fb752ffd640 1 -- 172.21.15.43:0/3710483529 <== mds.0 v2:172.21.15.161:6838/1243414461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5600abb13350 con 0x5600ab7bde40 2024-04-25T13:42:15.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.941+0000 7fb752ffd640 10 client.14778 handle_command_reply: tid=0 2024-04-25T13:42:15.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.941+0000 7fb780d79740 1 client.14778 shutdown 2024-04-25T13:42:15.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.941+0000 7fb780d79740 1 -- 172.21.15.43:0/3710483529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7ff270 msgr2=0x5600abbb1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.941+0000 7fb780d79740 1 --2- 172.21.15.43:0/3710483529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7ff270 0x5600abbb1750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb76c035000 tx=0x7fb76c0095c0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.941+0000 7fb780d79740 1 -- 172.21.15.43:0/3710483529 shutdown_connections 2024-04-25T13:42:15.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.941+0000 7fb780d79740 1 --2- 172.21.15.43:0/3710483529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7ff270 0x5600abbb1750 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.941+0000 7fb780d79740 1 --2- 172.21.15.43:0/3710483529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7de590 0x5600abbaa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.941+0000 7fb780d79740 1 --2- 172.21.15.43:0/3710483529 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x5600ab7bde40 0x5600abbb7fd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.941+0000 7fb780d79740 1 --2- 172.21.15.43:0/3710483529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7d63b0 0x5600abbaa2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.941+0000 7fb752ffd640 0 client.14778 ms_handle_reset on v2:172.21.15.161:6838/1243414461 2024-04-25T13:42:15.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.941+0000 7fb780d79740 1 -- 172.21.15.43:0/3710483529 >> 172.21.15.43:0/3710483529 conn(0x5600ab7f33c0 msgr2=0x5600abb9ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:15.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.941+0000 7fb780d79740 1 -- 172.21.15.43:0/3710483529 shutdown_connections 2024-04-25T13:42:15.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.941+0000 7fb780d79740 1 -- 172.21.15.43:0/3710483529 wait complete. 2024-04-25T13:42:15.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.941+0000 7fb780d79740 20 client.14778 trim_cache size 0 max 16384 2024-04-25T13:42:15.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.960+0000 7fb780d79740 1 Processor -- start 2024-04-25T13:42:15.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.960+0000 7fb780d79740 1 -- start start 2024-04-25T13:42:15.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb780d79740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7d63b0 0x5600abba8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb780d79740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7de590 0x5600abba95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb780d79740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7ff270 0x5600abbb1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb780d79740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5600abbb6310 con 0x5600ab7de590 2024-04-25T13:42:15.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb780d79740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x5600abbb69e0 con 0x5600ab7ff270 2024-04-25T13:42:15.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb780d79740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5600abbb70b0 con 0x5600ab7d63b0 2024-04-25T13:42:15.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb772ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7de590 0x5600abba95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb772ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7de590 0x5600abba95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41934/0 (socket says 172.21.15.43:41934) 2024-04-25T13:42:15.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb772ffd640 1 -- 172.21.15.43:0/204717647 learned_addr learned my addr 172.21.15.43:0/204717647 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:15.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb7737fe640 1 --2- 172.21.15.43:0/204717647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7d63b0 0x5600abba8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb772ffd640 1 -- 172.21.15.43:0/204717647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7d63b0 msgr2=0x5600abba8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:15.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb772ffd640 1 --2- 172.21.15.43:0/204717647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7d63b0 0x5600abba8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb772ffd640 1 -- 172.21.15.43:0/204717647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7ff270 msgr2=0x5600abbb1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:15.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb772ffd640 1 --2- 172.21.15.43:0/204717647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7ff270 0x5600abbb1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb772ffd640 1 -- 172.21.15.43:0/204717647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600abba50c0 con 0x5600ab7de590 2024-04-25T13:42:15.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb772ffd640 1 --2- 172.21.15.43:0/204717647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7de590 0x5600abba95e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb7640dc7a0 tx=0x7fb7640e2e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1267be5b68662d7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb7697fa640 1 -- 172.21.15.43:0/204717647 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764021950 con 0x5600ab7de590 2024-04-25T13:42:15.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb7697fa640 1 -- 172.21.15.43:0/204717647 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb764054070 con 0x5600ab7de590 2024-04-25T13:42:15.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.961+0000 7fb7697fa640 1 -- 172.21.15.43:0/204717647 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764021b80 con 0x5600ab7de590 2024-04-25T13:42:15.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.962+0000 7fb780d79740 1 -- 172.21.15.43:0/204717647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7de590 msgr2=0x5600abba95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.962+0000 7fb780d79740 1 --2- 172.21.15.43:0/204717647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7de590 0x5600abba95e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb7640dc7a0 tx=0x7fb7640e2e80 comp rx=0 tx=0).stop 2024-04-25T13:42:15.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.962+0000 7fb780d79740 1 -- 172.21.15.43:0/204717647 shutdown_connections 2024-04-25T13:42:15.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.962+0000 7fb780d79740 1 --2- 172.21.15.43:0/204717647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7ff270 0x5600abbb1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.962+0000 7fb780d79740 1 --2- 172.21.15.43:0/204717647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7de590 0x5600abba95e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.962+0000 7fb780d79740 1 --2- 172.21.15.43:0/204717647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7d63b0 0x5600abba8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.962+0000 7fb780d79740 1 -- 172.21.15.43:0/204717647 >> 172.21.15.43:0/204717647 conn(0x5600ab7f33c0 msgr2=0x5600abba87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.962+0000 7fb780d79740 1 -- 172.21.15.43:0/204717647 shutdown_connections 2024-04-25T13:42:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.962+0000 7fb780d79740 1 -- 172.21.15.43:0/204717647 wait complete. 2024-04-25T13:42:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.962+0000 7fb780d79740 1 -- start start 2024-04-25T13:42:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb780d79740 1 Processor -- start 2024-04-25T13:42:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb780d79740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7d63b0 0x5600abbacd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb780d79740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7de590 0x5600abbad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb780d79740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7ff270 0x5600abc1ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb780d79740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5600abbb7e50 con 0x5600ab7ff270 2024-04-25T13:42:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb780d79740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x5600abbb7780 con 0x5600ab7d63b0 2024-04-25T13:42:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb780d79740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5600abbb8520 con 0x5600ab7de590 2024-04-25T13:42:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb780d79740 10 client.0 _ll_register_callbacks cb 0x7fb76c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:42:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb773fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7ff270 0x5600abc1ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb773fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7ff270 0x5600abc1ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41946/0 (socket says 172.21.15.43:41946) 2024-04-25T13:42:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb773fff640 1 -- 172.21.15.43:0/2382060668 learned_addr learned my addr 172.21.15.43:0/2382060668 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb772ffd640 1 --2- 172.21.15.43:0/2382060668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7de590 0x5600abbad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb7737fe640 1 --2- 172.21.15.43:0/2382060668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7d63b0 0x5600abbacd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb773fff640 1 -- 172.21.15.43:0/2382060668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7de590 msgr2=0x5600abbad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb773fff640 1 --2- 172.21.15.43:0/2382060668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7de590 0x5600abbad250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb773fff640 1 -- 172.21.15.43:0/2382060668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7d63b0 msgr2=0x5600abbacd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb773fff640 1 --2- 172.21.15.43:0/2382060668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7d63b0 0x5600abbacd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.963+0000 7fb773fff640 1 -- 172.21.15.43:0/2382060668 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600abbad890 con 0x5600ab7ff270 2024-04-25T13:42:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.964+0000 7fb773fff640 1 --2- 172.21.15.43:0/2382060668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7ff270 0x5600abc1ee40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0458d0 tx=0x7fb76c031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5660727652ab34d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.964+0000 7fb752ffd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T13:42:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.964+0000 7fb752ffd640 1 -- 172.21.15.43:0/2382060668 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c04e040 con 0x5600ab7ff270 2024-04-25T13:42:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.964+0000 7fb780d79740 1 -- 172.21.15.43:0/2382060668 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb764054070 con 0x5600ab7ff270 2024-04-25T13:42:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.964+0000 7fb752ffd640 1 -- 172.21.15.43:0/2382060668 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fb76c045660 con 0x5600ab7ff270 2024-04-25T13:42:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.964+0000 7fb752ffd640 1 -- 172.21.15.43:0/2382060668 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb76c030760 con 0x5600ab7ff270 2024-04-25T13:42:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.964+0000 7fb780d79740 10 client.14784 fetch_fsmap learned FSMap version 17 2024-04-25T13:42:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.964+0000 7fb780d79740 1 -- 172.21.15.43:0/2382060668 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5600abc203c0 con 0x5600ab7ff270 2024-04-25T13:42:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.964+0000 7fb752ffd640 1 -- 172.21.15.43:0/2382060668 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb764054070 con 0x5600ab7ff270 2024-04-25T13:42:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.964+0000 7fb752ffd640 1 -- 172.21.15.43:0/2382060668 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7fb76c043070 con 0x5600ab7ff270 2024-04-25T13:42:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.964+0000 7fb780d79740 10 client.14784 fetch_fsmap finished waiting for FSMap version 17 2024-04-25T13:42:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.964+0000 7fb780d79740 10 client.14784 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T13:42:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.964+0000 7fb780d79740 20 client.14784 populate_metadata read hostname 'smithi043' 2024-04-25T13:42:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.964+0000 7fb780d79740 1 --2- 172.21.15.43:0/2382060668 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x5600ab793280 0x5600abc23cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.964+0000 7fb780d79740 4 client.14784 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:42:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.964+0000 7fb780d79740 1 -- 172.21.15.43:0/2382060668 --> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] -- command(tid 0: {"prefix": "status"}) -- 0x5600abb0d1c0 con 0x5600ab793280 2024-04-25T13:42:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.965+0000 7fb7737fe640 1 --2- 172.21.15.43:0/2382060668 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x5600ab793280 0x5600abc23cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.965+0000 7fb752ffd640 10 client.14784 ms_handle_connect on v2:172.21.15.161:6838/1243414461 2024-04-25T13:42:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.965+0000 7fb7737fe640 1 --2- 172.21.15.43:0/2382060668 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x5600ab793280 0x5600abc23cc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b3941d6cb3e7b23 server_cookie=b3ba2c2a386d4955 in_seq=0 out_seq=0 2024-04-25T13:42:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.965+0000 7fb752ffd640 1 -- 172.21.15.43:0/2382060668 <== mds.0 v2:172.21.15.161:6838/1243414461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5600abb0d1c0 con 0x5600ab793280 2024-04-25T13:42:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.965+0000 7fb752ffd640 10 client.14784 handle_command_reply: tid=0 2024-04-25T13:42:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.965+0000 7fb780d79740 1 client.14784 shutdown 2024-04-25T13:42:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb780d79740 1 -- 172.21.15.43:0/2382060668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7ff270 msgr2=0x5600abc1ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb780d79740 1 --2- 172.21.15.43:0/2382060668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7ff270 0x5600abc1ee40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0458d0 tx=0x7fb76c031ea0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb780d79740 1 -- 172.21.15.43:0/2382060668 shutdown_connections 2024-04-25T13:42:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb780d79740 1 --2- 172.21.15.43:0/2382060668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5600ab7ff270 0x5600abc1ee40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb780d79740 1 --2- 172.21.15.43:0/2382060668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5600ab7de590 0x5600abbad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb780d79740 1 --2- 172.21.15.43:0/2382060668 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x5600ab793280 0x5600abc23cc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb780d79740 1 --2- 172.21.15.43:0/2382060668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600ab7d63b0 0x5600abbacd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb780d79740 1 -- 172.21.15.43:0/2382060668 >> 172.21.15.43:0/2382060668 conn(0x5600ab7f33c0 msgr2=0x5600abb9b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:15.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb752ffd640 0 client.14784 ms_handle_reset on v2:172.21.15.161:6838/1243414461 2024-04-25T13:42:15.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb780d79740 1 -- 172.21.15.43:0/2382060668 shutdown_connections 2024-04-25T13:42:15.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb780d79740 1 -- 172.21.15.43:0/2382060668 wait complete. 2024-04-25T13:42:15.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb780d79740 20 client.14784 trim_cache size 0 max 16384 2024-04-25T13:42:15.972 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T13:42:15.972 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "394efb6c-0308-11ef-bc93-c7b262605968", 2024-04-25T13:42:15.972 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-04-25T13:42:15.972 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24542, 2024-04-25T13:42:15.972 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T13:42:15.972 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T13:42:15.973 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T13:42:15.973 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 6.9481288760000002, 2024-04-25T13:42:15.973 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 17, 2024-04-25T13:42:15.973 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 80, 2024-04-25T13:42:15.973 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 80, 2024-04-25T13:42:15.973 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 13.239065457000001 2024-04-25T13:42:15.973 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T13:42:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb779eca640 1 -- 172.21.15.43:0/796897456 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb7600afaf0 msgr2=0x7fb7600b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb779eca640 1 --2- 172.21.15.43:0/796897456 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb7600afaf0 0x7fb7600b2000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb76c005cc0 tx=0x7fb76c005c30 comp rx=0 tx=0).stop 2024-04-25T13:42:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb779eca640 1 -- 172.21.15.43:0/796897456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb774103c30 msgr2=0x7fb77419a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb779eca640 1 --2- 172.21.15.43:0/796897456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb774103c30 0x7fb77419a660 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb76400d950 tx=0x7fb76400de10 comp rx=0 tx=0).stop 2024-04-25T13:42:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb779eca640 1 -- 172.21.15.43:0/796897456 shutdown_connections 2024-04-25T13:42:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb779eca640 1 --2- 172.21.15.43:0/796897456 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb7600afaf0 0x7fb7600b2000 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb779eca640 1 --2- 172.21.15.43:0/796897456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774108930 0x7fb7741a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb779eca640 1 --2- 172.21.15.43:0/796897456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb774103c30 0x7fb77419a660 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb779eca640 1 --2- 172.21.15.43:0/796897456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7741029f0 0x7fb77419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb779eca640 1 -- 172.21.15.43:0/796897456 >> 172.21.15.43:0/796897456 conn(0x7fb7740fdbc0 msgr2=0x7fb774074dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb779eca640 1 -- 172.21.15.43:0/796897456 shutdown_connections 2024-04-25T13:42:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:15.966+0000 7fb779eca640 1 -- 172.21.15.43:0/796897456 wait complete. 2024-04-25T13:42:15.978 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T13:42:15.979 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:42:15.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-25T13:42:16.225 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:16.347 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:16 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/13955280' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:16.347 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:16 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/993778633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:16.347 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:16 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3058321420' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:16.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:16 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/13955280' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:16.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:16 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/993778633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:16.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:16 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3058321420' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:16.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:16 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/13955280' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:16.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:16 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/993778633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:16.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:16 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3058321420' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:17.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:17 smithi161 ceph-mon[32696]: pgmap v289: 129 pgs: 4 creating+peering, 121 active+clean, 4 unknown; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 209 B/s wr, 4 op/s 2024-04-25T13:42:17.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:17 smithi161 ceph-mon[32696]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-25T13:42:17.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:17 smithi161 ceph-mon[32696]: Cluster is now healthy 2024-04-25T13:42:17.382 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:17 smithi043 ceph-mon[29195]: pgmap v289: 129 pgs: 4 creating+peering, 121 active+clean, 4 unknown; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 209 B/s wr, 4 op/s 2024-04-25T13:42:17.382 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:17 smithi043 ceph-mon[29195]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-25T13:42:17.382 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:17 smithi043 ceph-mon[29195]: Cluster is now healthy 2024-04-25T13:42:17.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:17 smithi175 ceph-mon[32649]: pgmap v289: 129 pgs: 4 creating+peering, 121 active+clean, 4 unknown; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 209 B/s wr, 4 op/s 2024-04-25T13:42:17.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:17 smithi175 ceph-mon[32649]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-25T13:42:17.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:17 smithi175 ceph-mon[32649]: Cluster is now healthy 2024-04-25T13:42:17.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.944+0000 7f1179bfb700 1 -- 172.21.15.43:0/1274849818 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1174103390 msgr2=0x7f11741037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:17.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.944+0000 7f1179bfb700 1 --2- 172.21.15.43:0/1274849818 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1174103390 0x7f11741037a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f11640099c0 tx=0x7f1164009cd0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.944+0000 7f1179bfb700 1 -- 172.21.15.43:0/1274849818 shutdown_connections 2024-04-25T13:42:17.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.944+0000 7f1179bfb700 1 --2- 172.21.15.43:0/1274849818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1174108610 0x7f117410ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.944+0000 7f1179bfb700 1 --2- 172.21.15.43:0/1274849818 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1174103390 0x7f11741037a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.944+0000 7f1179bfb700 1 --2- 172.21.15.43:0/1274849818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1174107cc0 0x7f11741080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.944+0000 7f1179bfb700 1 -- 172.21.15.43:0/1274849818 >> 172.21.15.43:0/1274849818 conn(0x7f11740fec90 msgr2=0x7f11741010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:17.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.944+0000 7f1179bfb700 1 -- 172.21.15.43:0/1274849818 shutdown_connections 2024-04-25T13:42:17.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.944+0000 7f1179bfb700 1 -- 172.21.15.43:0/1274849818 wait complete. 2024-04-25T13:42:17.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.945+0000 7f1179bfb700 1 Processor -- start 2024-04-25T13:42:17.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.946+0000 7f1179bfb700 1 -- start start 2024-04-25T13:42:17.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.946+0000 7f1179bfb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1174103390 0x7f117419f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.946+0000 7f1179bfb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1174107cc0 0x7f117419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.946+0000 7f1179bfb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1174108610 0x7f1174199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.946+0000 7f1179bfb700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f11741130f0 con 0x7f1174108610 2024-04-25T13:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.946+0000 7f1179bfb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f1174112f70 con 0x7f1174103390 2024-04-25T13:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.946+0000 7f1179bfb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1174113270 con 0x7f1174107cc0 2024-04-25T13:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.946+0000 7f1173fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1174108610 0x7f1174199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.946+0000 7f1173fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1174108610 0x7f1174199970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41966/0 (socket says 172.21.15.43:41966) 2024-04-25T13:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.946+0000 7f1173fff700 1 -- 172.21.15.43:0/2557507459 learned_addr learned my addr 172.21.15.43:0/2557507459 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.946+0000 7f11737fe700 1 --2- 172.21.15.43:0/2557507459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1174103390 0x7f117419f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.946+0000 7f1172ffd700 1 --2- 172.21.15.43:0/2557507459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1174107cc0 0x7f117419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.947+0000 7f1173fff700 1 -- 172.21.15.43:0/2557507459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1174107cc0 msgr2=0x7f117419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.947+0000 7f1173fff700 1 --2- 172.21.15.43:0/2557507459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1174107cc0 0x7f117419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.947+0000 7f1173fff700 1 -- 172.21.15.43:0/2557507459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1174103390 msgr2=0x7f117419f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:17.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.947+0000 7f1173fff700 1 --2- 172.21.15.43:0/2557507459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1174103390 0x7f117419f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.947+0000 7f1173fff700 1 -- 172.21.15.43:0/2557507459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f117419a020 con 0x7f1174108610 2024-04-25T13:42:17.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.947+0000 7f1173fff700 1 --2- 172.21.15.43:0/2557507459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1174108610 0x7f1174199970 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f116c007ee0 tx=0x7f116c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:17.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.947+0000 7f1170ff9700 1 -- 172.21.15.43:0/2557507459 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116c004bb0 con 0x7f1174108610 2024-04-25T13:42:17.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.947+0000 7f1170ff9700 1 -- 172.21.15.43:0/2557507459 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f116c004d50 con 0x7f1174108610 2024-04-25T13:42:17.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.947+0000 7f1179bfb700 1 -- 172.21.15.43:0/2557507459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f117419a310 con 0x7f1174108610 2024-04-25T13:42:17.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.947+0000 7f1170ff9700 1 -- 172.21.15.43:0/2557507459 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116c0058b0 con 0x7f1174108610 2024-04-25T13:42:17.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.947+0000 7f1179bfb700 1 -- 172.21.15.43:0/2557507459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f117406b4e0 con 0x7f1174108610 2024-04-25T13:42:17.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.948+0000 7f1179bfb700 1 -- 172.21.15.43:0/2557507459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1174104840 con 0x7f1174108610 2024-04-25T13:42:17.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.950+0000 7f1170ff9700 1 -- 172.21.15.43:0/2557507459 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f116c01a020 con 0x7f1174108610 2024-04-25T13:42:17.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.950+0000 7f1170ff9700 1 --2- 172.21.15.43:0/2557507459 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f115c0afbf0 0x7f115c0b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.950+0000 7f11737fe700 1 --2- 172.21.15.43:0/2557507459 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f115c0afbf0 0x7f115c0b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.950+0000 7f1170ff9700 1 -- 172.21.15.43:0/2557507459 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f116c0de430 con 0x7f1174108610 2024-04-25T13:42:17.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.951+0000 7f11737fe700 1 --2- 172.21.15.43:0/2557507459 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f115c0afbf0 0x7f115c0b2100 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1164009990 tx=0x7f1164005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:17.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:17.955+0000 7f1170ff9700 1 -- 172.21.15.43:0/2557507459 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f116c010070 con 0x7f1174108610 2024-04-25T13:42:18.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:18.214+0000 7f1179bfb700 1 -- 172.21.15.43:0/2557507459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1174051190 con 0x7f1174108610 2024-04-25T13:42:18.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:18.214+0000 7f1170ff9700 1 -- 172.21.15.43:0/2557507459 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f116c0a6dd0 con 0x7f1174108610 2024-04-25T13:42:18.214 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T13:42:18.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:18.216+0000 7f1179bfb700 1 -- 172.21.15.43:0/2557507459 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f115c0afbf0 msgr2=0x7f115c0b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:18.216+0000 7f1179bfb700 1 --2- 172.21.15.43:0/2557507459 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f115c0afbf0 0x7f115c0b2100 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1164009990 tx=0x7f1164005fb0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:18.216+0000 7f1179bfb700 1 -- 172.21.15.43:0/2557507459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1174108610 msgr2=0x7f1174199970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:18.216+0000 7f1179bfb700 1 --2- 172.21.15.43:0/2557507459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1174108610 0x7f1174199970 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f116c007ee0 tx=0x7f116c00d3b0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:18.216+0000 7f1179bfb700 1 -- 172.21.15.43:0/2557507459 shutdown_connections 2024-04-25T13:42:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:18.216+0000 7f1179bfb700 1 --2- 172.21.15.43:0/2557507459 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f115c0afbf0 0x7f115c0b2100 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:18.216+0000 7f1179bfb700 1 --2- 172.21.15.43:0/2557507459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1174108610 0x7f1174199970 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:18.216+0000 7f1179bfb700 1 --2- 172.21.15.43:0/2557507459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1174103390 0x7f117419f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:18.216+0000 7f1179bfb700 1 --2- 172.21.15.43:0/2557507459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1174107cc0 0x7f117419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:18.216+0000 7f1179bfb700 1 -- 172.21.15.43:0/2557507459 >> 172.21.15.43:0/2557507459 conn(0x7f11740fec90 msgr2=0x7f11741010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:18.217+0000 7f1179bfb700 1 -- 172.21.15.43:0/2557507459 shutdown_connections 2024-04-25T13:42:18.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:18.217+0000 7f1179bfb700 1 -- 172.21.15.43:0/2557507459 wait complete. 2024-04-25T13:42:18.924 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T13:42:18.925 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:42:18.925 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-04-25T13:42:18.925 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-25T13:42:18.925 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:42:18.925 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T13:42:18.925 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T13:42:18.925 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:42:18.925 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T13:42:18.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:18.925 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-04-25T13:42:18.944 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:42:18.944 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:42:18.944 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:42:18.944 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:18.944 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-04-25T13:42:18.944 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:18.944 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:42:18.944 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:18.945 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-04-25T13:42:18.945 INFO:teuthology.orchestra.run.smithi043.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:42:18.945 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:18.945 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-04-25T13:42:18.945 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T13:42:18.945 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42080sec preferred_lft 42080sec 2024-04-25T13:42:18.945 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link noprefixroute 2024-04-25T13:42:18.945 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:18.945 INFO:teuthology.orchestra.run.smithi043.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:42:18.945 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:18.945 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-04-25T13:42:18.945 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:42:18.945 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:18.945 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-04-25T13:42:18.946 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T13:42:18.946 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:18.946 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T13:42:18.946 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2024-04-25T13:42:18.947 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2024-04-25T13:42:18.947 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2024-04-25T13:42:18.947 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T13:42:18.947 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T13:42:19.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:19.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:19.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:19.133 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:42:19.148 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:19 smithi043 ceph-mon[29195]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2024-04-25T13:42:19.148 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:19 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2557507459' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T13:42:19.159 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-04-25T13:42:19.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:19.161 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-04-25T13:42:19.229 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-04-25T13:42:19.230 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:42:19.230 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T13:42:19.230 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T13:42:19.230 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:42:19.230 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:19.230 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T13:42:19.230 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T13:42:19.231 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T13:42:19.231 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T13:42:19.231 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T13:42:19.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:19.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:19 smithi161 ceph-mon[32696]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2024-04-25T13:42:19.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:19 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2557507459' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T13:42:19.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:19 smithi175 ceph-mon[32649]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2024-04-25T13:42:19.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:19 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2557507459' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T13:42:19.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:19.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:19.502 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-25T13:42:19.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:19.519 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2024-04-25T13:42:19.575 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:19.575 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T13:42:19.575 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:42:19.575 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-25T13:42:19.575 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T13:42:19.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:19.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:19.695 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-25T13:42:19.696 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:19.696 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T13:42:19.696 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-25T13:42:19.697 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T13:42:19.697 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-25T13:42:19.697 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-25T13:42:19.697 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-25T13:42:19.697 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T13:42:19.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:19.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:19.847 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:19.847 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T13:42:19.847 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2024-04-25T13:42:19.847 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T13:42:19.848 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T13:42:19.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:19.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:19.924 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-25T13:42:19.924 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:42:19.925 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:42:19.939 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T13:42:19.940 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:42:19.940 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:42:19.995 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-04-25T13:42:20.063 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:42:20.119 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-04-25T13:42:20.119 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-04-25T13:42:20.119 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-04-25T13:42:20.119 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-04-25T13:42:20.119 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-04-25T13:42:20.119 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-04-25T13:42:20.119 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-04-25T13:42:20.119 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-04-25T13:42:20.119 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-04-25T13:42:20.119 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-04-25T13:42:20.119 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/selinux 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/bf8dd62de97bef275234fec2db7fe6ae942124898b405f7a685627159de12dc2/merged 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/0c14cefe4e593c231f9d943cbbbe656c6a1a59a428c7fdd266af7d5c057ebdd0/merged 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/0 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/02a5fa2057c5e4feda29fd23dce82c552605aef5d3e0839934c7e70979b5f5c1/merged 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/943766bca05f83610ab7ddc5c1aad709aa59566af629c42ef97daf819887ba35/merged 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/631bce35cf1985bea94cf8dbf4fb501421dceb5e37d0fab07c4fb861299a1151/merged 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/3f8fe60384483ce1e0db5668bb6e199f40fb582d7fa78043ad01a0dbc94886f3/merged 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/5739f0fa3396653c8fec270ad44c09325d968147793b054b3e19dc4f610bedce/merged 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/767a931f62c9b2740515b6100aa30145d87f063030a179a09b3d7cf6f75b1942/merged 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/b3621d1e8d57f2524eb441296b66a4233ea4ead732953d5f28b8c0b0c8f1a63a/merged 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/36fb2aebddae48cc1029114b62947ac5cfad32bbceb64bbe2f23cf7968868b5f/merged 2024-04-25T13:42:20.122 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-04-25T13:42:20.122 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:42:20.122 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:42:20.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:20.122 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-04-25T13:42:20.173 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T13:42:20.174 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-25T13:42:20.216 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-04-25T13:42:20.240 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:42:20.297 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-04-25T13:42:20.297 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-04-25T13:42:20.297 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-04-25T13:42:20.297 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-04-25T13:42:20.297 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-04-25T13:42:20.297 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-04-25T13:42:20.297 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-04-25T13:42:20.297 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-04-25T13:42:20.297 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-04-25T13:42:20.298 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-04-25T13:42:20.298 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-04-25T13:42:20.298 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/selinux 2024-04-25T13:42:20.298 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:42:20.298 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-04-25T13:42:20.298 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-04-25T13:42:20.298 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-04-25T13:42:20.298 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-04-25T13:42:20.298 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-04-25T13:42:20.298 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:42:20.298 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:42:20.298 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-04-25T13:42:20.298 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:42:20.298 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:42:20.299 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:42:20.299 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-04-25T13:42:20.299 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-04-25T13:42:20.299 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay 2024-04-25T13:42:20.299 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/bf8dd62de97bef275234fec2db7fe6ae942124898b405f7a685627159de12dc2/merged 2024-04-25T13:42:20.299 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/0c14cefe4e593c231f9d943cbbbe656c6a1a59a428c7fdd266af7d5c057ebdd0/merged 2024-04-25T13:42:20.299 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/0 2024-04-25T13:42:20.299 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:42:20.299 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/02a5fa2057c5e4feda29fd23dce82c552605aef5d3e0839934c7e70979b5f5c1/merged 2024-04-25T13:42:20.299 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/943766bca05f83610ab7ddc5c1aad709aa59566af629c42ef97daf819887ba35/merged 2024-04-25T13:42:20.299 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/631bce35cf1985bea94cf8dbf4fb501421dceb5e37d0fab07c4fb861299a1151/merged 2024-04-25T13:42:20.299 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/3f8fe60384483ce1e0db5668bb6e199f40fb582d7fa78043ad01a0dbc94886f3/merged 2024-04-25T13:42:20.299 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/5739f0fa3396653c8fec270ad44c09325d968147793b054b3e19dc4f610bedce/merged 2024-04-25T13:42:20.299 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/767a931f62c9b2740515b6100aa30145d87f063030a179a09b3d7cf6f75b1942/merged 2024-04-25T13:42:20.300 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/b3621d1e8d57f2524eb441296b66a4233ea4ead732953d5f28b8c0b0c8f1a63a/merged 2024-04-25T13:42:20.300 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/36fb2aebddae48cc1029114b62947ac5cfad32bbceb64bbe2f23cf7968868b5f/merged 2024-04-25T13:42:20.300 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-04-25T13:42:20.300 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:42:20.300 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:42:20.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:20.300 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-04-25T13:42:20.322 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:2024-04-25T13:42:20.322+0000 7f5d37327480 -1 init, newargv = 0x7f5d24004360 newargc=15 2024-04-25T13:42:20.322 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:ceph-fuse[72972]: starting ceph client 2024-04-25T13:42:20.330 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:ceph-fuse[72972]: starting fuse 2024-04-25T13:42:20.338 INFO:teuthology.orchestra.run.smithi043.stdout:115 2024-04-25T13:42:20.339 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [115] 2024-04-25T13:42:20.339 DEBUG:teuthology.orchestra.run.smithi043:> sudo stdin-killer -- python3 -c ' 2024-04-25T13:42:20.339 DEBUG:teuthology.orchestra.run.smithi043:> import glob 2024-04-25T13:42:20.339 DEBUG:teuthology.orchestra.run.smithi043:> import re 2024-04-25T13:42:20.339 DEBUG:teuthology.orchestra.run.smithi043:> import os 2024-04-25T13:42:20.339 DEBUG:teuthology.orchestra.run.smithi043:> import subprocess 2024-04-25T13:42:20.339 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-25T13:42:20.339 DEBUG:teuthology.orchestra.run.smithi043:> def _find_admin_socket(client_name): 2024-04-25T13:42:20.339 DEBUG:teuthology.orchestra.run.smithi043:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-25T13:42:20.340 DEBUG:teuthology.orchestra.run.smithi043:> files = glob.glob(asok_path) 2024-04-25T13:42:20.340 DEBUG:teuthology.orchestra.run.smithi043:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-25T13:42:20.340 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-25T13:42:20.340 DEBUG:teuthology.orchestra.run.smithi043:> # Given a non-glob path, it better be there 2024-04-25T13:42:20.340 DEBUG:teuthology.orchestra.run.smithi043:> if "*" not in asok_path: 2024-04-25T13:42:20.340 DEBUG:teuthology.orchestra.run.smithi043:> assert(len(files) == 1) 2024-04-25T13:42:20.340 DEBUG:teuthology.orchestra.run.smithi043:> return files[0] 2024-04-25T13:42:20.340 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-25T13:42:20.340 DEBUG:teuthology.orchestra.run.smithi043:> for f in files: 2024-04-25T13:42:20.340 DEBUG:teuthology.orchestra.run.smithi043:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T13:42:20.340 DEBUG:teuthology.orchestra.run.smithi043:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T13:42:20.340 DEBUG:teuthology.orchestra.run.smithi043:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T13:42:20.340 DEBUG:teuthology.orchestra.run.smithi043:> contents = proc_f.read() 2024-04-25T13:42:20.341 DEBUG:teuthology.orchestra.run.smithi043:> if mountpoint in contents: 2024-04-25T13:42:20.341 DEBUG:teuthology.orchestra.run.smithi043:> return f 2024-04-25T13:42:20.341 DEBUG:teuthology.orchestra.run.smithi043:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T13:42:20.341 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-25T13:42:20.341 DEBUG:teuthology.orchestra.run.smithi043:> print(_find_admin_socket("client.admin")) 2024-04-25T13:42:20.341 DEBUG:teuthology.orchestra.run.smithi043:> ' 2024-04-25T13:42:20.461 INFO:teuthology.orchestra.run.smithi043.stdout:/var/run/ceph/ceph-client.admin.72972.asok 2024-04-25T13:42:20.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:20.472 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.72972.asok 2024-04-25T13:42:20.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:20.473 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.72972.asok status 2024-04-25T13:42:20.620 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T13:42:20.620 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": { 2024-04-25T13:42:20.620 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_sha1": "994e2f20102a20fa9a27966c14b625cc01884df8", 2024-04-25T13:42:20.620 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T13:42:20.620 INFO:teuthology.orchestra.run.smithi043.stdout: "entity_id": "admin", 2024-04-25T13:42:20.621 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": "smithi043", 2024-04-25T13:42:20.621 INFO:teuthology.orchestra.run.smithi043.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-25T13:42:20.621 INFO:teuthology.orchestra.run.smithi043.stdout: "pid": "72972", 2024-04-25T13:42:20.621 INFO:teuthology.orchestra.run.smithi043.stdout: "root": "/" 2024-04-25T13:42:20.621 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:42:20.621 INFO:teuthology.orchestra.run.smithi043.stdout: "dentry_count": 0, 2024-04-25T13:42:20.621 INFO:teuthology.orchestra.run.smithi043.stdout: "dentry_pinned_count": 0, 2024-04-25T13:42:20.621 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 14796, 2024-04-25T13:42:20.621 INFO:teuthology.orchestra.run.smithi043.stdout: "inst": { 2024-04-25T13:42:20.621 INFO:teuthology.orchestra.run.smithi043.stdout: "name": { 2024-04-25T13:42:20.621 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "client", 2024-04-25T13:42:20.621 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 14796 2024-04-25T13:42:20.622 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:42:20.622 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": { 2024-04-25T13:42:20.622 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T13:42:20.622 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "192.168.0.1:0", 2024-04-25T13:42:20.622 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3784753132 2024-04-25T13:42:20.622 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:42:20.622 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:42:20.622 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": { 2024-04-25T13:42:20.622 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T13:42:20.622 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "192.168.0.1:0", 2024-04-25T13:42:20.622 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3784753132 2024-04-25T13:42:20.622 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:42:20.622 INFO:teuthology.orchestra.run.smithi043.stdout: "inst_str": "client.14796 192.168.0.1:0/3784753132", 2024-04-25T13:42:20.623 INFO:teuthology.orchestra.run.smithi043.stdout: "addr_str": "192.168.0.1:0/3784753132", 2024-04-25T13:42:20.623 INFO:teuthology.orchestra.run.smithi043.stdout: "inode_count": 1, 2024-04-25T13:42:20.623 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_epoch": 17, 2024-04-25T13:42:20.623 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_epoch": 80, 2024-04-25T13:42:20.623 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_epoch_barrier": 0, 2024-04-25T13:42:20.623 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklisted": false, 2024-04-25T13:42:20.623 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs" 2024-04-25T13:42:20.623 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T13:42:20.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:20.629 DEBUG:teuthology.orchestra.run.smithi043:> stat --file-system '--printf=%T 2024-04-25T13:42:20.629 DEBUG:teuthology.orchestra.run.smithi043:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:42:20.645 INFO:teuthology.orchestra.run.smithi043.stdout:fuseblk 2024-04-25T13:42:20.645 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:42:20.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:20.645 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:42:20.711 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-25T13:42:20.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:42:20.819 INFO:teuthology.orchestra.run.smithi043.stdout:# file: . 2024-04-25T13:42:20.819 INFO:teuthology.orchestra.run.smithi043.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-25T13:42:20.819 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:20.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:20.825 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:42:20.825 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:20.842 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:20.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.995+0000 7fb45077d640 1 -- 172.21.15.43:0/668513346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb448108900 msgr2=0x7fb44810ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:20.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.995+0000 7fb45077d640 1 --2- 172.21.15.43:0/668513346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb448108900 0x7fb44810ad20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb440009ca0 tx=0x7fb44002a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.995+0000 7fb45077d640 1 -- 172.21.15.43:0/668513346 shutdown_connections 2024-04-25T13:42:20.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.995+0000 7fb45077d640 1 --2- 172.21.15.43:0/668513346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb448108900 0x7fb44810ad20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.995+0000 7fb45077d640 1 --2- 172.21.15.43:0/668513346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb448103c00 0x7fb448104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.995+0000 7fb45077d640 1 --2- 172.21.15.43:0/668513346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4481029c0 0x7fb4481036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.995+0000 7fb45077d640 1 -- 172.21.15.43:0/668513346 >> 172.21.15.43:0/668513346 conn(0x7fb4480fdbd0 msgr2=0x7fb448100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:20.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.995+0000 7fb45077d640 1 -- 172.21.15.43:0/668513346 shutdown_connections 2024-04-25T13:42:20.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.995+0000 7fb45077d640 1 -- 172.21.15.43:0/668513346 wait complete. 2024-04-25T13:42:20.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.996+0000 7fb45077d640 1 Processor -- start 2024-04-25T13:42:20.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.996+0000 7fb45077d640 1 -- start start 2024-04-25T13:42:20.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.996+0000 7fb45077d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4481029c0 0x7fb44806a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.996+0000 7fb45077d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb448103c00 0x7fb44819eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.996+0000 7fb45077d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb448108900 0x7fb4481a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.996+0000 7fb45077d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb44810e3f0 con 0x7fb448103c00 2024-04-25T13:42:20.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.996+0000 7fb45077d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fb44810e270 con 0x7fb4481029c0 2024-04-25T13:42:20.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.996+0000 7fb45077d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb44810e570 con 0x7fb448108900 2024-04-25T13:42:21.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.996+0000 7fb44dd18640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb448103c00 0x7fb44819eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.996+0000 7fb44dd18640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb448103c00 0x7fb44819eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37252/0 (socket says 172.21.15.43:37252) 2024-04-25T13:42:21.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.996+0000 7fb44dd18640 1 -- 172.21.15.43:0/1422445490 learned_addr learned my addr 172.21.15.43:0/1422445490 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:21.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.997+0000 7fb44e519640 1 --2- 172.21.15.43:0/1422445490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4481029c0 0x7fb44806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.997+0000 7fb44ed1a640 1 --2- 172.21.15.43:0/1422445490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb448108900 0x7fb4481a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.997+0000 7fb44dd18640 1 -- 172.21.15.43:0/1422445490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb448108900 msgr2=0x7fb4481a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.997+0000 7fb44dd18640 1 --2- 172.21.15.43:0/1422445490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb448108900 0x7fb4481a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.997+0000 7fb44dd18640 1 -- 172.21.15.43:0/1422445490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4481029c0 msgr2=0x7fb44806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.997+0000 7fb44dd18640 1 --2- 172.21.15.43:0/1422445490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4481029c0 0x7fb44806a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.997+0000 7fb44dd18640 1 -- 172.21.15.43:0/1422445490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4481a1c10 con 0x7fb448103c00 2024-04-25T13:42:21.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.997+0000 7fb44ed1a640 1 --2- 172.21.15.43:0/1422445490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb448108900 0x7fb4481a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:21.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.997+0000 7fb44e519640 1 --2- 172.21.15.43:0/1422445490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4481029c0 0x7fb44806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:21.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.997+0000 7fb44dd18640 1 --2- 172.21.15.43:0/1422445490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb448103c00 0x7fb44819eea0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb44400e9f0 tx=0x7fb44400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:21.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.997+0000 7fb43f7fe640 1 -- 172.21.15.43:0/1422445490 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44400cd80 con 0x7fb448103c00 2024-04-25T13:42:21.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.997+0000 7fb43f7fe640 1 -- 172.21.15.43:0/1422445490 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4440054b0 con 0x7fb448103c00 2024-04-25T13:42:21.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.997+0000 7fb45077d640 1 -- 172.21.15.43:0/1422445490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4481a1f00 con 0x7fb448103c00 2024-04-25T13:42:21.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.997+0000 7fb43f7fe640 1 -- 172.21.15.43:0/1422445490 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444010430 con 0x7fb448103c00 2024-04-25T13:42:21.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.997+0000 7fb45077d640 1 -- 172.21.15.43:0/1422445490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4481a2370 con 0x7fb448103c00 2024-04-25T13:42:21.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:20.999+0000 7fb45077d640 1 -- 172.21.15.43:0/1422445490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb448107710 con 0x7fb448103c00 2024-04-25T13:42:21.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.000+0000 7fb43f7fe640 1 -- 172.21.15.43:0/1422445490 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fb4440046c0 con 0x7fb448103c00 2024-04-25T13:42:21.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.000+0000 7fb43f7fe640 1 --2- 172.21.15.43:0/1422445490 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb4340afaf0 0x7fb4340b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.000+0000 7fb44e519640 1 --2- 172.21.15.43:0/1422445490 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb4340afaf0 0x7fb4340b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.001+0000 7fb43f7fe640 1 -- 172.21.15.43:0/1422445490 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fb4440df330 con 0x7fb448103c00 2024-04-25T13:42:21.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.001+0000 7fb44e519640 1 --2- 172.21.15.43:0/1422445490 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb4340afaf0 0x7fb4340b2000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb4380058c0 tx=0x7fb438005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:21.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.005+0000 7fb43f7fe640 1 -- 172.21.15.43:0/1422445490 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb4440a7cd0 con 0x7fb448103c00 2024-04-25T13:42:21.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.206+0000 7fb45077d640 1 -- 172.21.15.43:0/1422445490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4480637a0 con 0x7fb448103c00 2024-04-25T13:42:21.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.208+0000 7fb43f7fe640 1 -- 172.21.15.43:0/1422445490 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24117 (secure 0 0 0) 0x7fb4440a75d0 con 0x7fb448103c00 2024-04-25T13:42:21.208 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:21.208 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":80,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:42:13.441319+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:21.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.210+0000 7fb45077d640 1 -- 172.21.15.43:0/1422445490 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb4340afaf0 msgr2=0x7fb4340b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.210+0000 7fb45077d640 1 --2- 172.21.15.43:0/1422445490 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb4340afaf0 0x7fb4340b2000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb4380058c0 tx=0x7fb438005850 comp rx=0 tx=0).stop 2024-04-25T13:42:21.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.210+0000 7fb45077d640 1 -- 172.21.15.43:0/1422445490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb448103c00 msgr2=0x7fb44819eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.210+0000 7fb45077d640 1 --2- 172.21.15.43:0/1422445490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb448103c00 0x7fb44819eea0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb44400e9f0 tx=0x7fb44400edf0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.210+0000 7fb45077d640 1 -- 172.21.15.43:0/1422445490 shutdown_connections 2024-04-25T13:42:21.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.210+0000 7fb45077d640 1 --2- 172.21.15.43:0/1422445490 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb4340afaf0 0x7fb4340b2000 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.210+0000 7fb45077d640 1 --2- 172.21.15.43:0/1422445490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb448108900 0x7fb4481a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.210+0000 7fb45077d640 1 --2- 172.21.15.43:0/1422445490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb448103c00 0x7fb44819eea0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.210+0000 7fb45077d640 1 --2- 172.21.15.43:0/1422445490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4481029c0 0x7fb44806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.210+0000 7fb45077d640 1 -- 172.21.15.43:0/1422445490 >> 172.21.15.43:0/1422445490 conn(0x7fb4480fdbd0 msgr2=0x7fb4481048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:21.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.210+0000 7fb45077d640 1 -- 172.21.15.43:0/1422445490 shutdown_connections 2024-04-25T13:42:21.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.210+0000 7fb45077d640 1 -- 172.21.15.43:0/1422445490 wait complete. 2024-04-25T13:42:21.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:21 smithi043 ceph-mon[29195]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 129 B/s wr, 3 op/s 2024-04-25T13:42:21.222 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:37:25.931659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:06.202688+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:07.348534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:42:11.056739+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:42:21.222 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:21.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.337+0000 7ffb03842640 1 -- 172.21.15.43:0/4231510448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffafc108930 msgr2=0x7ffafc10ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.337+0000 7ffb03842640 1 --2- 172.21.15.43:0/4231510448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffafc108930 0x7ffafc10ad50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009ca0 tx=0x7ffaf402a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.337+0000 7ffb03842640 1 -- 172.21.15.43:0/4231510448 shutdown_connections 2024-04-25T13:42:21.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.337+0000 7ffb03842640 1 --2- 172.21.15.43:0/4231510448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffafc108930 0x7ffafc10ad50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.337+0000 7ffb03842640 1 --2- 172.21.15.43:0/4231510448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffafc103c30 0x7ffafc104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.337+0000 7ffb03842640 1 --2- 172.21.15.43:0/4231510448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffafc1029f0 0x7ffafc1036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.337+0000 7ffb03842640 1 -- 172.21.15.43:0/4231510448 >> 172.21.15.43:0/4231510448 conn(0x7ffafc0fdbc0 msgr2=0x7ffafc100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:21.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.338+0000 7ffb03842640 1 -- 172.21.15.43:0/4231510448 shutdown_connections 2024-04-25T13:42:21.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.338+0000 7ffb03842640 1 -- 172.21.15.43:0/4231510448 wait complete. 2024-04-25T13:42:21.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.338+0000 7ffb03842640 1 Processor -- start 2024-04-25T13:42:21.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb03842640 1 -- start start 2024-04-25T13:42:21.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb03842640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffafc1029f0 0x7ffafc198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb03842640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffafc103c30 0x7ffafc199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb03842640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffafc108930 0x7ffafc1a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb03842640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc10e400 con 0x7ffafc103c30 2024-04-25T13:42:21.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb03842640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc10e280 con 0x7ffafc1029f0 2024-04-25T13:42:21.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb03842640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc10e580 con 0x7ffafc108930 2024-04-25T13:42:21.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb00ddd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffafc103c30 0x7ffafc199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb00ddd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffafc103c30 0x7ffafc199510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37274/0 (socket says 172.21.15.43:37274) 2024-04-25T13:42:21.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb00ddd640 1 -- 172.21.15.43:0/211762427 learned_addr learned my addr 172.21.15.43:0/211762427 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb01ddf640 1 --2- 172.21.15.43:0/211762427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffafc108930 0x7ffafc1a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb015de640 1 --2- 172.21.15.43:0/211762427 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffafc1029f0 0x7ffafc198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb00ddd640 1 -- 172.21.15.43:0/211762427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffafc108930 msgr2=0x7ffafc1a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb00ddd640 1 --2- 172.21.15.43:0/211762427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffafc108930 0x7ffafc1a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb00ddd640 1 -- 172.21.15.43:0/211762427 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffafc1029f0 msgr2=0x7ffafc198fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb00ddd640 1 --2- 172.21.15.43:0/211762427 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffafc1029f0 0x7ffafc198fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.339+0000 7ffb00ddd640 1 -- 172.21.15.43:0/211762427 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffafc1a0a60 con 0x7ffafc103c30 2024-04-25T13:42:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.340+0000 7ffb00ddd640 1 --2- 172.21.15.43:0/211762427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffafc103c30 0x7ffafc199510 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ffaec00c920 tx=0x7ffaec00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.340+0000 7ffaf27fc640 1 -- 172.21.15.43:0/211762427 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec007c70 con 0x7ffafc103c30 2024-04-25T13:42:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.340+0000 7ffaf27fc640 1 -- 172.21.15.43:0/211762427 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffaec007e10 con 0x7ffafc103c30 2024-04-25T13:42:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.340+0000 7ffaf27fc640 1 -- 172.21.15.43:0/211762427 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec018710 con 0x7ffafc103c30 2024-04-25T13:42:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.340+0000 7ffb03842640 1 -- 172.21.15.43:0/211762427 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffafc1a0d50 con 0x7ffafc103c30 2024-04-25T13:42:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.340+0000 7ffb03842640 1 -- 172.21.15.43:0/211762427 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffafc1a1210 con 0x7ffafc103c30 2024-04-25T13:42:21.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.341+0000 7ffb03842640 1 -- 172.21.15.43:0/211762427 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffafc107740 con 0x7ffafc103c30 2024-04-25T13:42:21.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.342+0000 7ffaf27fc640 1 -- 172.21.15.43:0/211762427 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7ffaec00f450 con 0x7ffafc103c30 2024-04-25T13:42:21.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.343+0000 7ffaf27fc640 1 --2- 172.21.15.43:0/211762427 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ffae80afb70 0x7ffae80b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.343+0000 7ffb015de640 1 --2- 172.21.15.43:0/211762427 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ffae80afb70 0x7ffae80b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.343+0000 7ffaf27fc640 1 -- 172.21.15.43:0/211762427 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7ffaec0defe0 con 0x7ffafc103c30 2024-04-25T13:42:21.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.343+0000 7ffb015de640 1 --2- 172.21.15.43:0/211762427 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ffae80afb70 0x7ffae80b2080 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8005fd0 tx=0x7ffaf8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:21.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.348+0000 7ffaf27fc640 1 -- 172.21.15.43:0/211762427 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ffaec014030 con 0x7ffafc103c30 2024-04-25T13:42:21.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:21 smithi161 ceph-mon[32696]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 129 B/s wr, 3 op/s 2024-04-25T13:42:21.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:21 smithi175 ceph-mon[32649]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 129 B/s wr, 3 op/s 2024-04-25T13:42:21.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.533+0000 7ffb03842640 1 -- 172.21.15.43:0/211762427 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ffafc0637d0 con 0x7ffafc103c30 2024-04-25T13:42:21.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.534+0000 7ffaf27fc640 1 -- 172.21.15.43:0/211762427 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7ffaec0a7940 con 0x7ffafc103c30 2024-04-25T13:42:21.534 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T13:42:21.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.536+0000 7ffb03842640 1 -- 172.21.15.43:0/211762427 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ffae80afb70 msgr2=0x7ffae80b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.536+0000 7ffb03842640 1 --2- 172.21.15.43:0/211762427 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ffae80afb70 0x7ffae80b2080 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8005fd0 tx=0x7ffaf8005850 comp rx=0 tx=0).stop 2024-04-25T13:42:21.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.536+0000 7ffb03842640 1 -- 172.21.15.43:0/211762427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffafc103c30 msgr2=0x7ffafc199510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.536+0000 7ffb03842640 1 --2- 172.21.15.43:0/211762427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffafc103c30 0x7ffafc199510 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ffaec00c920 tx=0x7ffaec00cde0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.536+0000 7ffb03842640 1 -- 172.21.15.43:0/211762427 shutdown_connections 2024-04-25T13:42:21.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.536+0000 7ffb03842640 1 --2- 172.21.15.43:0/211762427 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ffae80afb70 0x7ffae80b2080 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.536+0000 7ffb03842640 1 --2- 172.21.15.43:0/211762427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffafc108930 0x7ffafc1a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.536+0000 7ffb03842640 1 --2- 172.21.15.43:0/211762427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffafc103c30 0x7ffafc199510 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.536+0000 7ffb03842640 1 --2- 172.21.15.43:0/211762427 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffafc1029f0 0x7ffafc198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.536+0000 7ffb03842640 1 -- 172.21.15.43:0/211762427 >> 172.21.15.43:0/211762427 conn(0x7ffafc0fdbc0 msgr2=0x7ffafc104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:21.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.536+0000 7ffb03842640 1 -- 172.21.15.43:0/211762427 shutdown_connections 2024-04-25T13:42:21.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.536+0000 7ffb03842640 1 -- 172.21.15.43:0/211762427 wait complete. 2024-04-25T13:42:21.547 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:42:21.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.662+0000 7f59b4f72640 1 -- 172.21.15.43:0/207502093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b0102350 msgr2=0x7f59b01090e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.662+0000 7f59b4f72640 1 --2- 172.21.15.43:0/207502093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b0102350 0x7f59b01090e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f59a4009900 tx=0x7f59a402a410 comp rx=0 tx=0).stop 2024-04-25T13:42:21.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.662+0000 7f59b4f72640 1 -- 172.21.15.43:0/207502093 shutdown_connections 2024-04-25T13:42:21.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.662+0000 7f59b4f72640 1 --2- 172.21.15.43:0/207502093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59b0109770 0x7f59b010bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.662+0000 7f59b4f72640 1 --2- 172.21.15.43:0/207502093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b0102350 0x7f59b01090e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.662+0000 7f59b4f72640 1 --2- 172.21.15.43:0/207502093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59b0101e50 0x7f59b0106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.662+0000 7f59b4f72640 1 -- 172.21.15.43:0/207502093 >> 172.21.15.43:0/207502093 conn(0x7f59b00fd380 msgr2=0x7f59b00ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:21.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.662+0000 7f59b4f72640 1 -- 172.21.15.43:0/207502093 shutdown_connections 2024-04-25T13:42:21.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.662+0000 7f59b4f72640 1 -- 172.21.15.43:0/207502093 wait complete. 2024-04-25T13:42:21.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59b4f72640 1 Processor -- start 2024-04-25T13:42:21.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59b4f72640 1 -- start start 2024-04-25T13:42:21.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59b4f72640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59b0101e50 0x7f59b019a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59b4f72640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b0102350 0x7f59b019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59b4f72640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59b0109770 0x7f59b01a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59b4f72640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f59b010f4c0 con 0x7f59b0102350 2024-04-25T13:42:21.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59b4f72640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f59b010f340 con 0x7f59b0109770 2024-04-25T13:42:21.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59b4f72640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59b010f640 con 0x7f59b0101e50 2024-04-25T13:42:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59add9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b0102350 0x7f59b019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59add9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b0102350 0x7f59b019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37288/0 (socket says 172.21.15.43:37288) 2024-04-25T13:42:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59add9b640 1 -- 172.21.15.43:0/652355746 learned_addr learned my addr 172.21.15.43:0/652355746 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59aed9d640 1 --2- 172.21.15.43:0/652355746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59b0109770 0x7f59b01a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59ae59c640 1 --2- 172.21.15.43:0/652355746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59b0101e50 0x7f59b019a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59add9b640 1 -- 172.21.15.43:0/652355746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59b0101e50 msgr2=0x7f59b019a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59add9b640 1 --2- 172.21.15.43:0/652355746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59b0101e50 0x7f59b019a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59add9b640 1 -- 172.21.15.43:0/652355746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59b0109770 msgr2=0x7f59b01a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59add9b640 1 --2- 172.21.15.43:0/652355746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59b0109770 0x7f59b01a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59add9b640 1 -- 172.21.15.43:0/652355746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b01a1c40 con 0x7f59b0102350 2024-04-25T13:42:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.663+0000 7f59ae59c640 1 --2- 172.21.15.43:0/652355746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59b0101e50 0x7f59b019a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.664+0000 7f59add9b640 1 --2- 172.21.15.43:0/652355746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b0102350 0x7f59b019a640 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f59a4005760 tx=0x7f59a4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:21.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.664+0000 7f599f7fe640 1 -- 172.21.15.43:0/652355746 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a403f070 con 0x7f59b0102350 2024-04-25T13:42:21.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.664+0000 7f599f7fe640 1 -- 172.21.15.43:0/652355746 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59a4031ba0 con 0x7f59b0102350 2024-04-25T13:42:21.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.664+0000 7f59b4f72640 1 -- 172.21.15.43:0/652355746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b01a1ed0 con 0x7f59b0102350 2024-04-25T13:42:21.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.664+0000 7f599f7fe640 1 -- 172.21.15.43:0/652355746 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a4035030 con 0x7f59b0102350 2024-04-25T13:42:21.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.664+0000 7f59b4f72640 1 -- 172.21.15.43:0/652355746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b01a2330 con 0x7f59b0102350 2024-04-25T13:42:21.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.665+0000 7f59b4f72640 1 -- 172.21.15.43:0/652355746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b00feea0 con 0x7f59b0102350 2024-04-25T13:42:21.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.666+0000 7f599f7fe640 1 -- 172.21.15.43:0/652355746 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f59a4042070 con 0x7f59b0102350 2024-04-25T13:42:21.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.667+0000 7f599f7fe640 1 --2- 172.21.15.43:0/652355746 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f59980afb70 0x7f59980b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.667+0000 7f59ae59c640 1 --2- 172.21.15.43:0/652355746 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f59980afb70 0x7f59980b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.667+0000 7f599f7fe640 1 -- 172.21.15.43:0/652355746 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f59a40fffb0 con 0x7f59b0102350 2024-04-25T13:42:21.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.668+0000 7f59ae59c640 1 --2- 172.21.15.43:0/652355746 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f59980afb70 0x7f59980b2080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f59a00058c0 tx=0x7f59a0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:21.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.671+0000 7f599f7fe640 1 -- 172.21.15.43:0/652355746 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f59a40c8950 con 0x7f59b0102350 2024-04-25T13:42:21.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.859+0000 7f59b4f72640 1 -- 172.21.15.43:0/652355746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f59b002dce0 con 0x7f59b0102350 2024-04-25T13:42:21.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.859+0000 7f599f7fe640 1 -- 172.21.15.43:0/652355746 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) ==== 104+0+11 (secure 0 0 0) 0x7f59a40c8250 con 0x7f59b0102350 2024-04-25T13:42:21.860 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:42:21.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.861+0000 7f59b4f72640 1 -- 172.21.15.43:0/652355746 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f59980afb70 msgr2=0x7f59980b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.861+0000 7f59b4f72640 1 --2- 172.21.15.43:0/652355746 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f59980afb70 0x7f59980b2080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f59a00058c0 tx=0x7f59a0005850 comp rx=0 tx=0).stop 2024-04-25T13:42:21.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.861+0000 7f59b4f72640 1 -- 172.21.15.43:0/652355746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b0102350 msgr2=0x7f59b019a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.861+0000 7f59b4f72640 1 --2- 172.21.15.43:0/652355746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b0102350 0x7f59b019a640 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f59a4005760 tx=0x7f59a4003c10 comp rx=0 tx=0).stop 2024-04-25T13:42:21.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.861+0000 7f59b4f72640 1 -- 172.21.15.43:0/652355746 shutdown_connections 2024-04-25T13:42:21.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.861+0000 7f59b4f72640 1 --2- 172.21.15.43:0/652355746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59b0109770 0x7f59b01a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.861+0000 7f59b4f72640 1 --2- 172.21.15.43:0/652355746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b0102350 0x7f59b019a640 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.861+0000 7f59b4f72640 1 --2- 172.21.15.43:0/652355746 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f59980afb70 0x7f59980b2080 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.861+0000 7f59b4f72640 1 --2- 172.21.15.43:0/652355746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59b0101e50 0x7f59b019a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.861+0000 7f59b4f72640 1 -- 172.21.15.43:0/652355746 >> 172.21.15.43:0/652355746 conn(0x7f59b00fd380 msgr2=0x7f59b0105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:21.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.861+0000 7f59b4f72640 1 -- 172.21.15.43:0/652355746 shutdown_connections 2024-04-25T13:42:21.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.861+0000 7f59b4f72640 1 -- 172.21.15.43:0/652355746 wait complete. 2024-04-25T13:42:21.872 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:42:21.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.987+0000 7eff13b3f640 1 -- 172.21.15.43:0/1053705106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff0c108930 msgr2=0x7eff0c10ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.987+0000 7eff13b3f640 1 --2- 172.21.15.43:0/1053705106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff0c108930 0x7eff0c10ad50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7eff04009900 tx=0x7eff0402a410 comp rx=0 tx=0).stop 2024-04-25T13:42:21.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.987+0000 7eff13b3f640 1 -- 172.21.15.43:0/1053705106 shutdown_connections 2024-04-25T13:42:21.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.987+0000 7eff13b3f640 1 --2- 172.21.15.43:0/1053705106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff0c108930 0x7eff0c10ad50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.987+0000 7eff13b3f640 1 --2- 172.21.15.43:0/1053705106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff0c103c30 0x7eff0c104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.987+0000 7eff13b3f640 1 --2- 172.21.15.43:0/1053705106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c1029f0 0x7eff0c1036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.987+0000 7eff13b3f640 1 -- 172.21.15.43:0/1053705106 >> 172.21.15.43:0/1053705106 conn(0x7eff0c0fdc00 msgr2=0x7eff0c100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.987+0000 7eff13b3f640 1 -- 172.21.15.43:0/1053705106 shutdown_connections 2024-04-25T13:42:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.987+0000 7eff13b3f640 1 -- 172.21.15.43:0/1053705106 wait complete. 2024-04-25T13:42:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.988+0000 7eff13b3f640 1 Processor -- start 2024-04-25T13:42:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.988+0000 7eff13b3f640 1 -- start start 2024-04-25T13:42:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.988+0000 7eff13b3f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff0c1029f0 0x7eff0c19a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.988+0000 7eff13b3f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff0c103c30 0x7eff0c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.988+0000 7eff13b3f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c108930 0x7eff0c1a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.988+0000 7eff13b3f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c10e3b0 con 0x7eff0c103c30 2024-04-25T13:42:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.988+0000 7eff13b3f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c10e230 con 0x7eff0c108930 2024-04-25T13:42:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.988+0000 7eff13b3f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c10e530 con 0x7eff0c1029f0 2024-04-25T13:42:21.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.988+0000 7eff110da640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff0c103c30 0x7eff0c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.988+0000 7eff110da640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff0c103c30 0x7eff0c19a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37310/0 (socket says 172.21.15.43:37310) 2024-04-25T13:42:21.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.988+0000 7eff110da640 1 -- 172.21.15.43:0/1779070774 learned_addr learned my addr 172.21.15.43:0/1779070774 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:21.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.988+0000 7eff118db640 1 --2- 172.21.15.43:0/1779070774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff0c1029f0 0x7eff0c19a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.988+0000 7eff120dc640 1 --2- 172.21.15.43:0/1779070774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c108930 0x7eff0c1a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.989+0000 7eff110da640 1 -- 172.21.15.43:0/1779070774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff0c1029f0 msgr2=0x7eff0c19a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.989+0000 7eff110da640 1 --2- 172.21.15.43:0/1779070774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff0c1029f0 0x7eff0c19a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.989+0000 7eff110da640 1 -- 172.21.15.43:0/1779070774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c108930 msgr2=0x7eff0c1a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.989+0000 7eff110da640 1 --2- 172.21.15.43:0/1779070774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c108930 0x7eff0c1a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.989+0000 7eff110da640 1 -- 172.21.15.43:0/1779070774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0c1a1c80 con 0x7eff0c103c30 2024-04-25T13:42:21.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.989+0000 7eff110da640 1 --2- 172.21.15.43:0/1779070774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff0c103c30 0x7eff0c19a680 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efefc00e9f0 tx=0x7efefc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:21.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.989+0000 7eff02ffd640 1 -- 172.21.15.43:0/1779070774 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc00cd80 con 0x7eff0c103c30 2024-04-25T13:42:21.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.989+0000 7eff13b3f640 1 -- 172.21.15.43:0/1779070774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff0c1a1f70 con 0x7eff0c103c30 2024-04-25T13:42:21.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.989+0000 7eff02ffd640 1 -- 172.21.15.43:0/1779070774 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efefc0108c0 con 0x7eff0c103c30 2024-04-25T13:42:21.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.989+0000 7eff02ffd640 1 -- 172.21.15.43:0/1779070774 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc0187c0 con 0x7eff0c103c30 2024-04-25T13:42:21.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.989+0000 7eff13b3f640 1 -- 172.21.15.43:0/1779070774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff0c1a23e0 con 0x7eff0c103c30 2024-04-25T13:42:21.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.990+0000 7eff13b3f640 1 -- 172.21.15.43:0/1779070774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff0c1a2640 con 0x7eff0c103c30 2024-04-25T13:42:21.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.992+0000 7eff02ffd640 1 -- 172.21.15.43:0/1779070774 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7efefc010430 con 0x7eff0c103c30 2024-04-25T13:42:21.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.992+0000 7eff02ffd640 1 --2- 172.21.15.43:0/1779070774 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efef80afaf0 0x7efef80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.993+0000 7eff118db640 1 --2- 172.21.15.43:0/1779070774 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efef80afaf0 0x7efef80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.993+0000 7eff02ffd640 1 -- 172.21.15.43:0/1779070774 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7efefc0df210 con 0x7eff0c103c30 2024-04-25T13:42:21.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.993+0000 7eff118db640 1 --2- 172.21.15.43:0/1779070774 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efef80afaf0 0x7efef80b2000 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7eff080099a0 tx=0x7eff08009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:21.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:21.997+0000 7eff02ffd640 1 -- 172.21.15.43:0/1779070774 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efefc0a7560 con 0x7eff0c103c30 2024-04-25T13:42:22.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.184+0000 7eff13b3f640 1 -- 172.21.15.43:0/1779070774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7eff0c1a2810 con 0x7eff0c103c30 2024-04-25T13:42:22.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.184+0000 7eff02ffd640 1 -- 172.21.15.43:0/1779070774 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) ==== 100+0+11 (secure 0 0 0) 0x7efefc0ab860 con 0x7eff0c103c30 2024-04-25T13:42:22.185 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-25T13:42:22.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.186+0000 7eff13b3f640 1 -- 172.21.15.43:0/1779070774 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efef80afaf0 msgr2=0x7efef80b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:22.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.186+0000 7eff13b3f640 1 --2- 172.21.15.43:0/1779070774 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efef80afaf0 0x7efef80b2000 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7eff080099a0 tx=0x7eff08009500 comp rx=0 tx=0).stop 2024-04-25T13:42:22.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.186+0000 7eff13b3f640 1 -- 172.21.15.43:0/1779070774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff0c103c30 msgr2=0x7eff0c19a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:22.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.186+0000 7eff13b3f640 1 --2- 172.21.15.43:0/1779070774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff0c103c30 0x7eff0c19a680 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efefc00e9f0 tx=0x7efefc00eeb0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.186+0000 7eff13b3f640 1 -- 172.21.15.43:0/1779070774 shutdown_connections 2024-04-25T13:42:22.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.186+0000 7eff13b3f640 1 --2- 172.21.15.43:0/1779070774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c108930 0x7eff0c1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.186+0000 7eff13b3f640 1 --2- 172.21.15.43:0/1779070774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff0c103c30 0x7eff0c19a680 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.186+0000 7eff13b3f640 1 --2- 172.21.15.43:0/1779070774 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efef80afaf0 0x7efef80b2000 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.187+0000 7eff13b3f640 1 --2- 172.21.15.43:0/1779070774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff0c1029f0 0x7eff0c19a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.187+0000 7eff13b3f640 1 -- 172.21.15.43:0/1779070774 >> 172.21.15.43:0/1779070774 conn(0x7eff0c0fdc00 msgr2=0x7eff0c109e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:22.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.187+0000 7eff13b3f640 1 -- 172.21.15.43:0/1779070774 shutdown_connections 2024-04-25T13:42:22.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.187+0000 7eff13b3f640 1 -- 172.21.15.43:0/1779070774 wait complete. 2024-04-25T13:42:22.196 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:22 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1422445490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:22.196 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:22 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/211762427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:42:22.196 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:22 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/652355746' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:42:22.197 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:42:22.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.312+0000 7fdb9b100640 1 -- 172.21.15.43:0/2741647826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb94104d30 msgr2=0x7fdb94105140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:22.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.312+0000 7fdb9b100640 1 --2- 172.21.15.43:0/2741647826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb94104d30 0x7fdb94105140 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009900 tx=0x7fdb7c02a410 comp rx=0 tx=0).stop 2024-04-25T13:42:22.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.312+0000 7fdb9b100640 1 -- 172.21.15.43:0/2741647826 shutdown_connections 2024-04-25T13:42:22.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.312+0000 7fdb9b100640 1 --2- 172.21.15.43:0/2741647826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb94109a30 0x7fdb9410be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.312+0000 7fdb9b100640 1 --2- 172.21.15.43:0/2741647826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb94104d30 0x7fdb94105140 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.312+0000 7fdb9b100640 1 --2- 172.21.15.43:0/2741647826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb94103af0 0x7fdb941047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.312+0000 7fdb9b100640 1 -- 172.21.15.43:0/2741647826 >> 172.21.15.43:0/2741647826 conn(0x7fdb940fece0 msgr2=0x7fdb94101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:22.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.312+0000 7fdb9b100640 1 -- 172.21.15.43:0/2741647826 shutdown_connections 2024-04-25T13:42:22.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.312+0000 7fdb9b100640 1 -- 172.21.15.43:0/2741647826 wait complete. 2024-04-25T13:42:22.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.313+0000 7fdb9b100640 1 Processor -- start 2024-04-25T13:42:22.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.313+0000 7fdb9b100640 1 -- start start 2024-04-25T13:42:22.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.313+0000 7fdb9b100640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb94103af0 0x7fdb9419a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:22.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.313+0000 7fdb9b100640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb94104d30 0x7fdb9419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.313+0000 7fdb9b100640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb94109a30 0x7fdb941a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.313+0000 7fdb9b100640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9410f4d0 con 0x7fdb94103af0 2024-04-25T13:42:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.313+0000 7fdb9b100640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9410f350 con 0x7fdb94104d30 2024-04-25T13:42:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.313+0000 7fdb9b100640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9410f650 con 0x7fdb94109a30 2024-04-25T13:42:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.313+0000 7fdb98e9c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb94103af0 0x7fdb9419a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.313+0000 7fdb98e9c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb94103af0 0x7fdb9419a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37318/0 (socket says 172.21.15.43:37318) 2024-04-25T13:42:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.313+0000 7fdb98e9c640 1 -- 172.21.15.43:0/1236870190 learned_addr learned my addr 172.21.15.43:0/1236870190 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.314+0000 7fdb9969d640 1 --2- 172.21.15.43:0/1236870190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb94109a30 0x7fdb941a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.314+0000 7fdb93fff640 1 --2- 172.21.15.43:0/1236870190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb94104d30 0x7fdb9419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.314+0000 7fdb98e9c640 1 -- 172.21.15.43:0/1236870190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb94109a30 msgr2=0x7fdb941a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.314+0000 7fdb98e9c640 1 --2- 172.21.15.43:0/1236870190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb94109a30 0x7fdb941a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.314+0000 7fdb98e9c640 1 -- 172.21.15.43:0/1236870190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb94104d30 msgr2=0x7fdb9419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.314+0000 7fdb98e9c640 1 --2- 172.21.15.43:0/1236870190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb94104d30 0x7fdb9419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.314+0000 7fdb98e9c640 1 -- 172.21.15.43:0/1236870190 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb941a1c90 con 0x7fdb94103af0 2024-04-25T13:42:22.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.314+0000 7fdb9969d640 1 --2- 172.21.15.43:0/1236870190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb94109a30 0x7fdb941a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:22.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.314+0000 7fdb98e9c640 1 --2- 172.21.15.43:0/1236870190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb94103af0 0x7fdb9419a1c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdb84005fd0 tx=0x7fdb8400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:22.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.314+0000 7fdb91ffb640 1 -- 172.21.15.43:0/1236870190 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84017070 con 0x7fdb94103af0 2024-04-25T13:42:22.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.314+0000 7fdb91ffb640 1 -- 172.21.15.43:0/1236870190 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb84009c30 con 0x7fdb94103af0 2024-04-25T13:42:22.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.314+0000 7fdb9b100640 1 -- 172.21.15.43:0/1236870190 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb941a1f80 con 0x7fdb94103af0 2024-04-25T13:42:22.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.314+0000 7fdb91ffb640 1 -- 172.21.15.43:0/1236870190 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84003c90 con 0x7fdb94103af0 2024-04-25T13:42:22.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.314+0000 7fdb9b100640 1 -- 172.21.15.43:0/1236870190 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb941a23e0 con 0x7fdb94103af0 2024-04-25T13:42:22.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.315+0000 7fdb9b100640 1 -- 172.21.15.43:0/1236870190 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb9406a160 con 0x7fdb94103af0 2024-04-25T13:42:22.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.317+0000 7fdb91ffb640 1 -- 172.21.15.43:0/1236870190 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fdb84003e30 con 0x7fdb94103af0 2024-04-25T13:42:22.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.317+0000 7fdb91ffb640 1 --2- 172.21.15.43:0/1236870190 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdb800afaf0 0x7fdb800b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:22.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.317+0000 7fdb93fff640 1 --2- 172.21.15.43:0/1236870190 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdb800afaf0 0x7fdb800b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:22.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.317+0000 7fdb91ffb640 1 -- 172.21.15.43:0/1236870190 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fdb840dec40 con 0x7fdb94103af0 2024-04-25T13:42:22.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.318+0000 7fdb93fff640 1 --2- 172.21.15.43:0/1236870190 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdb800afaf0 0x7fdb800b2000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c006010 tx=0x7fdb7c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:22.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.322+0000 7fdb91ffb640 1 -- 172.21.15.43:0/1236870190 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdb84020030 con 0x7fdb94103af0 2024-04-25T13:42:22.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:22 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1422445490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:22.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:22 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/211762427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:42:22.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:22 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/652355746' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:42:22.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:22 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1422445490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:22.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:22 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/211762427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:42:22.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:22 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/652355746' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:42:22.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.508+0000 7fdb9b100640 1 -- 172.21.15.43:0/1236870190 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fdb940637d0 con 0x7fdb94103af0 2024-04-25T13:42:22.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.509+0000 7fdb91ffb640 1 -- 172.21.15.43:0/1236870190 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v80) ==== 103+0+11 (secure 0 0 0) 0x7fdb840a7580 con 0x7fdb94103af0 2024-04-25T13:42:22.509 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:42:22.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.511+0000 7fdb9b100640 1 -- 172.21.15.43:0/1236870190 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdb800afaf0 msgr2=0x7fdb800b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:22.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.511+0000 7fdb9b100640 1 --2- 172.21.15.43:0/1236870190 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdb800afaf0 0x7fdb800b2000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c006010 tx=0x7fdb7c000bc0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.511+0000 7fdb9b100640 1 -- 172.21.15.43:0/1236870190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb94103af0 msgr2=0x7fdb9419a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:22.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.511+0000 7fdb9b100640 1 --2- 172.21.15.43:0/1236870190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb94103af0 0x7fdb9419a1c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdb84005fd0 tx=0x7fdb8400dde0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.511+0000 7fdb9b100640 1 -- 172.21.15.43:0/1236870190 shutdown_connections 2024-04-25T13:42:22.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.511+0000 7fdb9b100640 1 --2- 172.21.15.43:0/1236870190 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdb800afaf0 0x7fdb800b2000 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.511+0000 7fdb9b100640 1 --2- 172.21.15.43:0/1236870190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb94109a30 0x7fdb941a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.511+0000 7fdb9b100640 1 --2- 172.21.15.43:0/1236870190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb94104d30 0x7fdb9419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.511+0000 7fdb9b100640 1 --2- 172.21.15.43:0/1236870190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb94103af0 0x7fdb9419a1c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.511+0000 7fdb9b100640 1 -- 172.21.15.43:0/1236870190 >> 172.21.15.43:0/1236870190 conn(0x7fdb940fece0 msgr2=0x7fdb94105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:22.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.511+0000 7fdb9b100640 1 -- 172.21.15.43:0/1236870190 shutdown_connections 2024-04-25T13:42:22.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.511+0000 7fdb9b100640 1 -- 172.21.15.43:0/1236870190 wait complete. 2024-04-25T13:42:22.522 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:42:22.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.635+0000 7f50abb4d640 1 -- 172.21.15.43:0/1903564179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a4108930 msgr2=0x7f50a410ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:22.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.635+0000 7f50abb4d640 1 --2- 172.21.15.43:0/1903564179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a4108930 0x7f50a410ad50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f509c009ca0 tx=0x7f509c02a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.635+0000 7f50abb4d640 1 -- 172.21.15.43:0/1903564179 shutdown_connections 2024-04-25T13:42:22.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.635+0000 7f50abb4d640 1 --2- 172.21.15.43:0/1903564179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a4108930 0x7f50a410ad50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.635+0000 7f50abb4d640 1 --2- 172.21.15.43:0/1903564179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50a4103c30 0x7f50a4104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.635+0000 7f50abb4d640 1 --2- 172.21.15.43:0/1903564179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50a41029f0 0x7f50a41036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.635+0000 7f50abb4d640 1 -- 172.21.15.43:0/1903564179 >> 172.21.15.43:0/1903564179 conn(0x7f50a40fdbc0 msgr2=0x7f50a4100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:22.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.635+0000 7f50abb4d640 1 -- 172.21.15.43:0/1903564179 shutdown_connections 2024-04-25T13:42:22.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.635+0000 7f50abb4d640 1 -- 172.21.15.43:0/1903564179 wait complete. 2024-04-25T13:42:22.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.636+0000 7f50abb4d640 1 Processor -- start 2024-04-25T13:42:22.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.636+0000 7f50abb4d640 1 -- start start 2024-04-25T13:42:22.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.636+0000 7f50abb4d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a41029f0 0x7f50a4075860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:22.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.636+0000 7f50abb4d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50a4103c30 0x7f50a419ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:22.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.636+0000 7f50abb4d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50a4108930 0x7f50a41a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:22.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.636+0000 7f50abb4d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f50a410e420 con 0x7f50a41029f0 2024-04-25T13:42:22.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.636+0000 7f50abb4d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f50a410e2a0 con 0x7f50a4108930 2024-04-25T13:42:22.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.636+0000 7f50abb4d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f50a410e5a0 con 0x7f50a4103c30 2024-04-25T13:42:22.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.636+0000 7f50a98e9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a41029f0 0x7f50a4075860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:22.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.636+0000 7f50a98e9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a41029f0 0x7f50a4075860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37330/0 (socket says 172.21.15.43:37330) 2024-04-25T13:42:22.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.636+0000 7f50a98e9640 1 -- 172.21.15.43:0/555311302 learned_addr learned my addr 172.21.15.43:0/555311302 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:22.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.636+0000 7f50aa0ea640 1 --2- 172.21.15.43:0/555311302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50a4108930 0x7f50a41a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:22.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.637+0000 7f50a90e8640 1 --2- 172.21.15.43:0/555311302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50a4103c30 0x7f50a419ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:22.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.637+0000 7f50a98e9640 1 -- 172.21.15.43:0/555311302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50a4103c30 msgr2=0x7f50a419ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:22.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.637+0000 7f50a98e9640 1 --2- 172.21.15.43:0/555311302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50a4103c30 0x7f50a419ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.637+0000 7f50a98e9640 1 -- 172.21.15.43:0/555311302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50a4108930 msgr2=0x7f50a41a13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:22.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.637+0000 7f50a98e9640 1 --2- 172.21.15.43:0/555311302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50a4108930 0x7f50a41a13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.637+0000 7f50a98e9640 1 -- 172.21.15.43:0/555311302 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a41a1b50 con 0x7f50a41029f0 2024-04-25T13:42:22.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.637+0000 7f50a90e8640 1 --2- 172.21.15.43:0/555311302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50a4103c30 0x7f50a419ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:22.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.637+0000 7f50a98e9640 1 --2- 172.21.15.43:0/555311302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a41029f0 0x7f50a4075860 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f509400c970 tx=0x7f509400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:22.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.637+0000 7f509affd640 1 -- 172.21.15.43:0/555311302 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5094007c70 con 0x7f50a41029f0 2024-04-25T13:42:22.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.637+0000 7f509affd640 1 -- 172.21.15.43:0/555311302 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5094007e10 con 0x7f50a41029f0 2024-04-25T13:42:22.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.637+0000 7f50abb4d640 1 -- 172.21.15.43:0/555311302 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a41a1e40 con 0x7f50a41029f0 2024-04-25T13:42:22.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.637+0000 7f509affd640 1 -- 172.21.15.43:0/555311302 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50940186f0 con 0x7f50a41029f0 2024-04-25T13:42:22.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.637+0000 7f50abb4d640 1 -- 172.21.15.43:0/555311302 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a41a2300 con 0x7f50a41029f0 2024-04-25T13:42:22.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.638+0000 7f50abb4d640 1 -- 172.21.15.43:0/555311302 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50a4107740 con 0x7f50a41029f0 2024-04-25T13:42:22.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.640+0000 7f509affd640 1 -- 172.21.15.43:0/555311302 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f509400fa90 con 0x7f50a41029f0 2024-04-25T13:42:22.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.641+0000 7f509affd640 1 --2- 172.21.15.43:0/555311302 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f50900afb70 0x7f50900b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:22.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.641+0000 7f50a90e8640 1 --2- 172.21.15.43:0/555311302 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f50900afb70 0x7f50900b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:22.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.641+0000 7f509affd640 1 -- 172.21.15.43:0/555311302 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f50940df090 con 0x7f50a41029f0 2024-04-25T13:42:22.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.641+0000 7f50a90e8640 1 --2- 172.21.15.43:0/555311302 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f50900afb70 0x7f50900b2080 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f50a4075200 tx=0x7f50a0005e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:22.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.644+0000 7f509affd640 1 -- 172.21.15.43:0/555311302 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5094053ff0 con 0x7f50a41029f0 2024-04-25T13:42:22.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.844+0000 7f50abb4d640 1 -- 172.21.15.43:0/555311302 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f50a402ddc0 con 0x7f50a41029f0 2024-04-25T13:42:22.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.844+0000 7f509affd640 1 -- 172.21.15.43:0/555311302 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v80) ==== 81+0+591 (secure 0 0 0) 0x7f5094014030 con 0x7f50a41029f0 2024-04-25T13:42:22.844 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/775979394 2024-04-26T13:34:57.835176+0000 2024-04-25T13:42:22.845 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1063219824 2024-04-26T13:34:57.835176+0000 2024-04-25T13:42:22.845 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/1629086480 2024-04-26T13:34:57.835176+0000 2024-04-25T13:42:22.845 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/1629086480 2024-04-26T13:34:57.835176+0000 2024-04-25T13:42:22.845 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/3816223875 2024-04-26T13:34:30.246627+0000 2024-04-25T13:42:22.845 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1985552645 2024-04-26T13:34:57.835176+0000 2024-04-25T13:42:22.845 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1274235665 2024-04-26T13:34:30.246627+0000 2024-04-25T13:42:22.845 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/3816223875 2024-04-26T13:34:30.246627+0000 2024-04-25T13:42:22.845 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1022690204 2024-04-26T13:34:30.246627+0000 2024-04-25T13:42:22.845 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3992074212 2024-04-26T13:34:30.246627+0000 2024-04-25T13:42:22.845 INFO:teuthology.orchestra.run.smithi043.stderr:listed 10 entries 2024-04-25T13:42:22.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.846+0000 7f50abb4d640 1 -- 172.21.15.43:0/555311302 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f50900afb70 msgr2=0x7f50900b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:22.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.846+0000 7f50abb4d640 1 --2- 172.21.15.43:0/555311302 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f50900afb70 0x7f50900b2080 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f50a4075200 tx=0x7f50a0005e70 comp rx=0 tx=0).stop 2024-04-25T13:42:22.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.846+0000 7f50abb4d640 1 -- 172.21.15.43:0/555311302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a41029f0 msgr2=0x7f50a4075860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:22.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.846+0000 7f50abb4d640 1 --2- 172.21.15.43:0/555311302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a41029f0 0x7f50a4075860 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f509400c970 tx=0x7f509400ce30 comp rx=0 tx=0).stop 2024-04-25T13:42:22.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.846+0000 7f50abb4d640 1 -- 172.21.15.43:0/555311302 shutdown_connections 2024-04-25T13:42:22.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.846+0000 7f50abb4d640 1 --2- 172.21.15.43:0/555311302 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50a4108930 0x7f50a41a13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.846+0000 7f50abb4d640 1 --2- 172.21.15.43:0/555311302 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f50900afb70 0x7f50900b2080 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.846+0000 7f50abb4d640 1 --2- 172.21.15.43:0/555311302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50a4103c30 0x7f50a419ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.846+0000 7f50abb4d640 1 --2- 172.21.15.43:0/555311302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50a41029f0 0x7f50a4075860 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:22.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.846+0000 7f50abb4d640 1 -- 172.21.15.43:0/555311302 >> 172.21.15.43:0/555311302 conn(0x7f50a40fdbc0 msgr2=0x7f50a4104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:22.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.846+0000 7f50abb4d640 1 -- 172.21.15.43:0/555311302 shutdown_connections 2024-04-25T13:42:22.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:22.846+0000 7f50abb4d640 1 -- 172.21.15.43:0/555311302 wait complete. 2024-04-25T13:42:22.858 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:42:22.858 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:22.874 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:23.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.025+0000 7f5b76f84640 1 -- 172.21.15.43:0/1289713424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b70103c20 msgr2=0x7f5b70104030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:23.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.025+0000 7f5b76f84640 1 --2- 172.21.15.43:0/1289713424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b70103c20 0x7f5b70104030 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009900 tx=0x7f5b5c02a410 comp rx=0 tx=0).stop 2024-04-25T13:42:23.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.025+0000 7f5b76f84640 1 -- 172.21.15.43:0/1289713424 shutdown_connections 2024-04-25T13:42:23.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.025+0000 7f5b76f84640 1 --2- 172.21.15.43:0/1289713424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b70108920 0x7f5b7010ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.025+0000 7f5b76f84640 1 --2- 172.21.15.43:0/1289713424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b70103c20 0x7f5b70104030 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.025+0000 7f5b76f84640 1 --2- 172.21.15.43:0/1289713424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b701029e0 0x7f5b701036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.025+0000 7f5b76f84640 1 -- 172.21.15.43:0/1289713424 >> 172.21.15.43:0/1289713424 conn(0x7f5b700fdbd0 msgr2=0x7f5b70100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:23.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.025+0000 7f5b76f84640 1 -- 172.21.15.43:0/1289713424 shutdown_connections 2024-04-25T13:42:23.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.025+0000 7f5b76f84640 1 -- 172.21.15.43:0/1289713424 wait complete. 2024-04-25T13:42:23.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.026+0000 7f5b76f84640 1 Processor -- start 2024-04-25T13:42:23.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.026+0000 7f5b76f84640 1 -- start start 2024-04-25T13:42:23.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.026+0000 7f5b76f84640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b701029e0 0x7f5b7019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:23.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.026+0000 7f5b76f84640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b70103c20 0x7f5b7019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:23.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.026+0000 7f5b76f84640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b70108920 0x7f5b701a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:23.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.026+0000 7f5b76f84640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7010e3c0 con 0x7f5b70108920 2024-04-25T13:42:23.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.026+0000 7f5b76f84640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7010e240 con 0x7f5b70103c20 2024-04-25T13:42:23.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.026+0000 7f5b76f84640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7010e540 con 0x7f5b701029e0 2024-04-25T13:42:23.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.026+0000 7f5b75521640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b70108920 0x7f5b701a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:23.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.026+0000 7f5b75521640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b70108920 0x7f5b701a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37350/0 (socket says 172.21.15.43:37350) 2024-04-25T13:42:23.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.026+0000 7f5b75521640 1 -- 172.21.15.43:0/3713940915 learned_addr learned my addr 172.21.15.43:0/3713940915 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:23.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.027+0000 7f5b6ffff640 1 --2- 172.21.15.43:0/3713940915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b70103c20 0x7f5b7019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:23.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.027+0000 7f5b74d20640 1 --2- 172.21.15.43:0/3713940915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b701029e0 0x7f5b7019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:23.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.027+0000 7f5b75521640 1 -- 172.21.15.43:0/3713940915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b701029e0 msgr2=0x7f5b7019a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:23.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.027+0000 7f5b75521640 1 --2- 172.21.15.43:0/3713940915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b701029e0 0x7f5b7019a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.027+0000 7f5b75521640 1 -- 172.21.15.43:0/3713940915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b70103c20 msgr2=0x7f5b7019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:23.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.027+0000 7f5b75521640 1 --2- 172.21.15.43:0/3713940915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b70103c20 0x7f5b7019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.027+0000 7f5b75521640 1 -- 172.21.15.43:0/3713940915 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b701a1c60 con 0x7f5b70108920 2024-04-25T13:42:23.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.027+0000 7f5b75521640 1 --2- 172.21.15.43:0/3713940915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b70108920 0x7f5b701a16a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800eb10 tx=0x7f5b6800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:23.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.027+0000 7f5b6dffb640 1 -- 172.21.15.43:0/3713940915 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68004b20 con 0x7f5b70108920 2024-04-25T13:42:23.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.027+0000 7f5b6dffb640 1 -- 172.21.15.43:0/3713940915 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b68004cc0 con 0x7f5b70108920 2024-04-25T13:42:23.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.027+0000 7f5b76f84640 1 -- 172.21.15.43:0/3713940915 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b701a1f50 con 0x7f5b70108920 2024-04-25T13:42:23.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.027+0000 7f5b6dffb640 1 -- 172.21.15.43:0/3713940915 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68010690 con 0x7f5b70108920 2024-04-25T13:42:23.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.027+0000 7f5b76f84640 1 -- 172.21.15.43:0/3713940915 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b701a2410 con 0x7f5b70108920 2024-04-25T13:42:23.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.028+0000 7f5b76f84640 1 -- 172.21.15.43:0/3713940915 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b701a26d0 con 0x7f5b70108920 2024-04-25T13:42:23.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.030+0000 7f5b6dffb640 1 -- 172.21.15.43:0/3713940915 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f5b68005020 con 0x7f5b70108920 2024-04-25T13:42:23.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.030+0000 7f5b6dffb640 1 --2- 172.21.15.43:0/3713940915 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f5b600afb70 0x7f5b600b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:23.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.030+0000 7f5b74d20640 1 --2- 172.21.15.43:0/3713940915 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f5b600afb70 0x7f5b600b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:23.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.030+0000 7f5b6dffb640 1 -- 172.21.15.43:0/3713940915 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f5b680df300 con 0x7f5b70108920 2024-04-25T13:42:23.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.031+0000 7f5b74d20640 1 --2- 172.21.15.43:0/3713940915 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f5b600afb70 0x7f5b600b2080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5b701035e0 tx=0x7f5b64005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:23.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.035+0000 7f5b6dffb640 1 -- 172.21.15.43:0/3713940915 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5b680a7ca0 con 0x7f5b70108920 2024-04-25T13:42:23.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:23 smithi043 ceph-mon[29195]: pgmap v292: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 346 B/s wr, 0 op/s 2024-04-25T13:42:23.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:23 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1779070774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:42:23.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:23 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1236870190' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:42:23.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:23 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/555311302' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T13:42:23.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.221+0000 7f5b76f84640 1 -- 172.21.15.43:0/3713940915 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b701a28a0 con 0x7f5b70108920 2024-04-25T13:42:23.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.223+0000 7f5b6dffb640 1 -- 172.21.15.43:0/3713940915 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24117 (secure 0 0 0) 0x7f5b680a75a0 con 0x7f5b70108920 2024-04-25T13:42:23.223 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:23.224 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":80,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:42:13.441319+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:23.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.225+0000 7f5b76f84640 1 -- 172.21.15.43:0/3713940915 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f5b600afb70 msgr2=0x7f5b600b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:23.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.225+0000 7f5b76f84640 1 --2- 172.21.15.43:0/3713940915 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f5b600afb70 0x7f5b600b2080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5b701035e0 tx=0x7f5b64005f90 comp rx=0 tx=0).stop 2024-04-25T13:42:23.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.225+0000 7f5b76f84640 1 -- 172.21.15.43:0/3713940915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b70108920 msgr2=0x7f5b701a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:23.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.225+0000 7f5b76f84640 1 --2- 172.21.15.43:0/3713940915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b70108920 0x7f5b701a16a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800eb10 tx=0x7f5b6800c2d0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.225+0000 7f5b76f84640 1 -- 172.21.15.43:0/3713940915 shutdown_connections 2024-04-25T13:42:23.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.225+0000 7f5b76f84640 1 --2- 172.21.15.43:0/3713940915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b70108920 0x7f5b701a16a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.225+0000 7f5b76f84640 1 --2- 172.21.15.43:0/3713940915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b70103c20 0x7f5b7019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.225+0000 7f5b76f84640 1 --2- 172.21.15.43:0/3713940915 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f5b600afb70 0x7f5b600b2080 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.225+0000 7f5b76f84640 1 --2- 172.21.15.43:0/3713940915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b701029e0 0x7f5b7019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.225+0000 7f5b76f84640 1 -- 172.21.15.43:0/3713940915 >> 172.21.15.43:0/3713940915 conn(0x7f5b700fdbd0 msgr2=0x7f5b70109f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:23.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.225+0000 7f5b76f84640 1 -- 172.21.15.43:0/3713940915 shutdown_connections 2024-04-25T13:42:23.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.225+0000 7f5b76f84640 1 -- 172.21.15.43:0/3713940915 wait complete. 2024-04-25T13:42:23.237 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:37:25.931659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:06.202688+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:07.348534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:42:11.056739+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:42:23.237 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:23.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:23 smithi161 ceph-mon[32696]: pgmap v292: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 346 B/s wr, 0 op/s 2024-04-25T13:42:23.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:23 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1779070774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:42:23.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:23 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1236870190' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:42:23.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:23 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/555311302' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T13:42:23.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.353+0000 7fdf249fe640 1 -- 172.21.15.43:0/3660164164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf20109870 msgr2=0x7fdf2010bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:23.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.353+0000 7fdf249fe640 1 --2- 172.21.15.43:0/3660164164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf20109870 0x7fdf2010bc90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009ca0 tx=0x7fdf1802a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.353+0000 7fdf249fe640 1 -- 172.21.15.43:0/3660164164 shutdown_connections 2024-04-25T13:42:23.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.353+0000 7fdf249fe640 1 --2- 172.21.15.43:0/3660164164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf20109870 0x7fdf2010bc90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.353+0000 7fdf249fe640 1 --2- 172.21.15.43:0/3660164164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf20104b70 0x7fdf20104f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.353+0000 7fdf249fe640 1 --2- 172.21.15.43:0/3660164164 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf20103930 0x7fdf20104630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.353+0000 7fdf249fe640 1 -- 172.21.15.43:0/3660164164 >> 172.21.15.43:0/3660164164 conn(0x7fdf200feb20 msgr2=0x7fdf20100fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:23.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.353+0000 7fdf249fe640 1 -- 172.21.15.43:0/3660164164 shutdown_connections 2024-04-25T13:42:23.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.353+0000 7fdf249fe640 1 -- 172.21.15.43:0/3660164164 wait complete. 2024-04-25T13:42:23.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.353+0000 7fdf249fe640 1 Processor -- start 2024-04-25T13:42:23.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf249fe640 1 -- start start 2024-04-25T13:42:23.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf249fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf20103930 0x7fdf20076850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:23.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf249fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf20104b70 0x7fdf20074ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:23.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf249fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf20109870 0x7fdf20075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:23.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf249fe640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2010f360 con 0x7fdf20104b70 2024-04-25T13:42:23.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf249fe640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2010f1e0 con 0x7fdf20103930 2024-04-25T13:42:23.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf249fe640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2010f4e0 con 0x7fdf20109870 2024-04-25T13:42:23.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf1e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf20104b70 0x7fdf20074ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:23.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf1e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf20104b70 0x7fdf20074ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37358/0 (socket says 172.21.15.43:37358) 2024-04-25T13:42:23.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf1e59c640 1 -- 172.21.15.43:0/722089840 learned_addr learned my addr 172.21.15.43:0/722089840 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:23.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf1f59e640 1 --2- 172.21.15.43:0/722089840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf20109870 0x7fdf20075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:23.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf1ed9d640 1 --2- 172.21.15.43:0/722089840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf20103930 0x7fdf20076850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:23.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf1e59c640 1 -- 172.21.15.43:0/722089840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf20109870 msgr2=0x7fdf20075430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:23.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf1e59c640 1 --2- 172.21.15.43:0/722089840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf20109870 0x7fdf20075430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf1e59c640 1 -- 172.21.15.43:0/722089840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf20103930 msgr2=0x7fdf20076850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:23.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf1e59c640 1 --2- 172.21.15.43:0/722089840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf20103930 0x7fdf20076850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf1e59c640 1 -- 172.21.15.43:0/722089840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf20075ad0 con 0x7fdf20104b70 2024-04-25T13:42:23.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.354+0000 7fdf1f59e640 1 --2- 172.21.15.43:0/722089840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf20109870 0x7fdf20075430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:23.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.355+0000 7fdf1e59c640 1 --2- 172.21.15.43:0/722089840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf20104b70 0x7fdf20074ef0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400d770 tx=0x7fdf1400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:23.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.355+0000 7fdf07fff640 1 -- 172.21.15.43:0/722089840 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14017070 con 0x7fdf20104b70 2024-04-25T13:42:23.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.355+0000 7fdf07fff640 1 -- 172.21.15.43:0/722089840 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf140054b0 con 0x7fdf20104b70 2024-04-25T13:42:23.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.355+0000 7fdf249fe640 1 -- 172.21.15.43:0/722089840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf201a3fd0 con 0x7fdf20104b70 2024-04-25T13:42:23.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.355+0000 7fdf07fff640 1 -- 172.21.15.43:0/722089840 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14004c60 con 0x7fdf20104b70 2024-04-25T13:42:23.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.355+0000 7fdf249fe640 1 -- 172.21.15.43:0/722089840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf201a4380 con 0x7fdf20104b70 2024-04-25T13:42:23.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.356+0000 7fdf249fe640 1 -- 172.21.15.43:0/722089840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf20069be0 con 0x7fdf20104b70 2024-04-25T13:42:23.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.358+0000 7fdf07fff640 1 -- 172.21.15.43:0/722089840 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fdf14004e00 con 0x7fdf20104b70 2024-04-25T13:42:23.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.358+0000 7fdf07fff640 1 --2- 172.21.15.43:0/722089840 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdf080afae0 0x7fdf080b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:23.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.358+0000 7fdf07fff640 1 -- 172.21.15.43:0/722089840 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fdf140dedd0 con 0x7fdf20104b70 2024-04-25T13:42:23.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.358+0000 7fdf1ed9d640 1 --2- 172.21.15.43:0/722089840 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdf080afae0 0x7fdf080b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:23.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.359+0000 7fdf1ed9d640 1 --2- 172.21.15.43:0/722089840 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdf080afae0 0x7fdf080b1ff0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdf100058c0 tx=0x7fdf10005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:23.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.362+0000 7fdf07fff640 1 -- 172.21.15.43:0/722089840 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdf140a7770 con 0x7fdf20104b70 2024-04-25T13:42:23.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:23 smithi175 ceph-mon[32649]: pgmap v292: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 346 B/s wr, 0 op/s 2024-04-25T13:42:23.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:23 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1779070774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:42:23.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:23 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1236870190' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:42:23.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:23 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/555311302' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T13:42:23.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.548+0000 7fdf249fe640 1 -- 172.21.15.43:0/722089840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdf2002db50 con 0x7fdf20104b70 2024-04-25T13:42:23.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.549+0000 7fdf07fff640 1 -- 172.21.15.43:0/722089840 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7fdf140a7070 con 0x7fdf20104b70 2024-04-25T13:42:23.549 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T13:42:23.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.550+0000 7fdf249fe640 1 -- 172.21.15.43:0/722089840 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdf080afae0 msgr2=0x7fdf080b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:23.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.550+0000 7fdf249fe640 1 --2- 172.21.15.43:0/722089840 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdf080afae0 0x7fdf080b1ff0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdf100058c0 tx=0x7fdf10005850 comp rx=0 tx=0).stop 2024-04-25T13:42:23.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.550+0000 7fdf249fe640 1 -- 172.21.15.43:0/722089840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf20104b70 msgr2=0x7fdf20074ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:23.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.550+0000 7fdf249fe640 1 --2- 172.21.15.43:0/722089840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf20104b70 0x7fdf20074ef0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400d770 tx=0x7fdf1400dc30 comp rx=0 tx=0).stop 2024-04-25T13:42:23.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.551+0000 7fdf249fe640 1 -- 172.21.15.43:0/722089840 shutdown_connections 2024-04-25T13:42:23.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.551+0000 7fdf249fe640 1 --2- 172.21.15.43:0/722089840 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdf080afae0 0x7fdf080b1ff0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.551+0000 7fdf249fe640 1 --2- 172.21.15.43:0/722089840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf20109870 0x7fdf20075430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.551+0000 7fdf249fe640 1 --2- 172.21.15.43:0/722089840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf20104b70 0x7fdf20074ef0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.551+0000 7fdf249fe640 1 --2- 172.21.15.43:0/722089840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf20103930 0x7fdf20076850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.551+0000 7fdf249fe640 1 -- 172.21.15.43:0/722089840 >> 172.21.15.43:0/722089840 conn(0x7fdf200feb20 msgr2=0x7fdf20105850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:23.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.551+0000 7fdf249fe640 1 -- 172.21.15.43:0/722089840 shutdown_connections 2024-04-25T13:42:23.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.551+0000 7fdf249fe640 1 -- 172.21.15.43:0/722089840 wait complete. 2024-04-25T13:42:23.562 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:42:23.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.676+0000 7f36bb708640 1 -- 172.21.15.43:0/1019340284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4106f30 msgr2=0x7f36b4109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:23.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.676+0000 7f36bb708640 1 --2- 172.21.15.43:0/1019340284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4106f30 0x7f36b4109350 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009900 tx=0x7f36a402a410 comp rx=0 tx=0).stop 2024-04-25T13:42:23.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.676+0000 7f36bb708640 1 -- 172.21.15.43:0/1019340284 shutdown_connections 2024-04-25T13:42:23.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.676+0000 7f36bb708640 1 --2- 172.21.15.43:0/1019340284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36b4109890 0x7f36b410bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.676+0000 7f36bb708640 1 --2- 172.21.15.43:0/1019340284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4106f30 0x7f36b4109350 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.676+0000 7f36bb708640 1 --2- 172.21.15.43:0/1019340284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36b41045d0 0x7f36b41069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.676+0000 7f36bb708640 1 -- 172.21.15.43:0/1019340284 >> 172.21.15.43:0/1019340284 conn(0x7f36b40fdbd0 msgr2=0x7f36b4100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:23.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.676+0000 7f36bb708640 1 -- 172.21.15.43:0/1019340284 shutdown_connections 2024-04-25T13:42:23.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.676+0000 7f36bb708640 1 -- 172.21.15.43:0/1019340284 wait complete. 2024-04-25T13:42:23.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.677+0000 7f36bb708640 1 Processor -- start 2024-04-25T13:42:23.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.677+0000 7f36bb708640 1 -- start start 2024-04-25T13:42:23.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.677+0000 7f36bb708640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36b41045d0 0x7f36b4103a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:23.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.677+0000 7f36bb708640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36b4106f30 0x7f36b41020c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:23.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.677+0000 7f36bb708640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4109890 0x7f36b4102600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.677+0000 7f36bb708640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f36b410f4c0 con 0x7f36b4109890 2024-04-25T13:42:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.677+0000 7f36bb708640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f36b410f340 con 0x7f36b41045d0 2024-04-25T13:42:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.677+0000 7f36bb708640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36b410f640 con 0x7f36b4106f30 2024-04-25T13:42:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.677+0000 7f36b9ca5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4109890 0x7f36b4102600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.677+0000 7f36b9ca5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4109890 0x7f36b4102600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37380/0 (socket says 172.21.15.43:37380) 2024-04-25T13:42:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.677+0000 7f36b9ca5640 1 -- 172.21.15.43:0/396349775 learned_addr learned my addr 172.21.15.43:0/396349775 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.677+0000 7f36b94a4640 1 --2- 172.21.15.43:0/396349775 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36b41045d0 0x7f36b4103a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.677+0000 7f36b8ca3640 1 --2- 172.21.15.43:0/396349775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36b4106f30 0x7f36b41020c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.678+0000 7f36b9ca5640 1 -- 172.21.15.43:0/396349775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36b4106f30 msgr2=0x7f36b41020c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.678+0000 7f36b9ca5640 1 --2- 172.21.15.43:0/396349775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36b4106f30 0x7f36b41020c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.678+0000 7f36b9ca5640 1 -- 172.21.15.43:0/396349775 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36b41045d0 msgr2=0x7f36b4103a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.678+0000 7f36b9ca5640 1 --2- 172.21.15.43:0/396349775 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36b41045d0 0x7f36b4103a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.678+0000 7f36b9ca5640 1 -- 172.21.15.43:0/396349775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b4102ca0 con 0x7f36b4109890 2024-04-25T13:42:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.678+0000 7f36b9ca5640 1 --2- 172.21.15.43:0/396349775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4109890 0x7f36b4102600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00ccb0 tx=0x7f36ac00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:23.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.678+0000 7f36aa7fc640 1 -- 172.21.15.43:0/396349775 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac003970 con 0x7f36b4109890 2024-04-25T13:42:23.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.678+0000 7f36aa7fc640 1 -- 172.21.15.43:0/396349775 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36ac004030 con 0x7f36b4109890 2024-04-25T13:42:23.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.678+0000 7f36bb708640 1 -- 172.21.15.43:0/396349775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b41a4590 con 0x7f36b4109890 2024-04-25T13:42:23.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.678+0000 7f36aa7fc640 1 -- 172.21.15.43:0/396349775 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00f6b0 con 0x7f36b4109890 2024-04-25T13:42:23.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.678+0000 7f36bb708640 1 -- 172.21.15.43:0/396349775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b41a49a0 con 0x7f36b4109890 2024-04-25T13:42:23.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.679+0000 7f36bb708640 1 -- 172.21.15.43:0/396349775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36b406c2a0 con 0x7f36b4109890 2024-04-25T13:42:23.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.681+0000 7f36aa7fc640 1 -- 172.21.15.43:0/396349775 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f36ac003b10 con 0x7f36b4109890 2024-04-25T13:42:23.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.682+0000 7f36aa7fc640 1 --2- 172.21.15.43:0/396349775 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f36a00afaf0 0x7f36a00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:23.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.682+0000 7f36b94a4640 1 --2- 172.21.15.43:0/396349775 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f36a00afaf0 0x7f36a00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:23.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.682+0000 7f36aa7fc640 1 -- 172.21.15.43:0/396349775 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f36ac0df2c0 con 0x7f36b4109890 2024-04-25T13:42:23.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.682+0000 7f36b94a4640 1 --2- 172.21.15.43:0/396349775 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f36a00afaf0 0x7f36a00b2000 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f36b0005fd0 tx=0x7f36b000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:23.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.686+0000 7f36aa7fc640 1 -- 172.21.15.43:0/396349775 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f36ac014070 con 0x7f36b4109890 2024-04-25T13:42:23.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.872+0000 7f36bb708640 1 -- 172.21.15.43:0/396349775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f36b41a4c30 con 0x7f36b4109890 2024-04-25T13:42:23.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.872+0000 7f36aa7fc640 1 -- 172.21.15.43:0/396349775 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) ==== 104+0+11 (secure 0 0 0) 0x7f36ac0a7610 con 0x7f36b4109890 2024-04-25T13:42:23.872 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:42:23.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.874+0000 7f36bb708640 1 -- 172.21.15.43:0/396349775 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f36a00afaf0 msgr2=0x7f36a00b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:23.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.874+0000 7f36bb708640 1 --2- 172.21.15.43:0/396349775 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f36a00afaf0 0x7f36a00b2000 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f36b0005fd0 tx=0x7f36b000b390 comp rx=0 tx=0).stop 2024-04-25T13:42:23.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.874+0000 7f36bb708640 1 -- 172.21.15.43:0/396349775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4109890 msgr2=0x7f36b4102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:23.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.874+0000 7f36bb708640 1 --2- 172.21.15.43:0/396349775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4109890 0x7f36b4102600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00ccb0 tx=0x7f36ac00a620 comp rx=0 tx=0).stop 2024-04-25T13:42:23.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.874+0000 7f36bb708640 1 -- 172.21.15.43:0/396349775 shutdown_connections 2024-04-25T13:42:23.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.874+0000 7f36bb708640 1 --2- 172.21.15.43:0/396349775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4109890 0x7f36b4102600 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.874+0000 7f36bb708640 1 --2- 172.21.15.43:0/396349775 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f36a00afaf0 0x7f36a00b2000 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.874+0000 7f36bb708640 1 --2- 172.21.15.43:0/396349775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36b4106f30 0x7f36b41020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.874+0000 7f36bb708640 1 --2- 172.21.15.43:0/396349775 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36b41045d0 0x7f36b4103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:23.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.874+0000 7f36bb708640 1 -- 172.21.15.43:0/396349775 >> 172.21.15.43:0/396349775 conn(0x7f36b40fdbd0 msgr2=0x7f36b4104c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:23.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.874+0000 7f36bb708640 1 -- 172.21.15.43:0/396349775 shutdown_connections 2024-04-25T13:42:23.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:23.874+0000 7f36bb708640 1 -- 172.21.15.43:0/396349775 wait complete. 2024-04-25T13:42:23.885 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:42:24.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.000+0000 7f8bf3d85640 1 -- 172.21.15.43:0/3894212185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bec1029e0 msgr2=0x7f8bec1036e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.000+0000 7f8bf3d85640 1 --2- 172.21.15.43:0/3894212185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bec1029e0 0x7f8bec1036e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009900 tx=0x7f8be402a410 comp rx=0 tx=0).stop 2024-04-25T13:42:24.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.000+0000 7f8bf3d85640 1 -- 172.21.15.43:0/3894212185 shutdown_connections 2024-04-25T13:42:24.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.000+0000 7f8bf3d85640 1 --2- 172.21.15.43:0/3894212185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bec108920 0x7f8bec10ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.000+0000 7f8bf3d85640 1 --2- 172.21.15.43:0/3894212185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bec103c20 0x7f8bec104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.000+0000 7f8bf3d85640 1 --2- 172.21.15.43:0/3894212185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bec1029e0 0x7f8bec1036e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.000+0000 7f8bf3d85640 1 -- 172.21.15.43:0/3894212185 >> 172.21.15.43:0/3894212185 conn(0x7f8bec0fdbd0 msgr2=0x7f8bec100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:24.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.000+0000 7f8bf3d85640 1 -- 172.21.15.43:0/3894212185 shutdown_connections 2024-04-25T13:42:24.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.000+0000 7f8bf3d85640 1 -- 172.21.15.43:0/3894212185 wait complete. 2024-04-25T13:42:24.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.000+0000 7f8bf3d85640 1 Processor -- start 2024-04-25T13:42:24.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf3d85640 1 -- start start 2024-04-25T13:42:24.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf3d85640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bec1029e0 0x7f8bec19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf3d85640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bec103c20 0x7f8bec19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf3d85640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bec108920 0x7f8bec1a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf3d85640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec10e390 con 0x7f8bec108920 2024-04-25T13:42:24.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf3d85640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec10e210 con 0x7f8bec1029e0 2024-04-25T13:42:24.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf3d85640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec10e510 con 0x7f8bec103c20 2024-04-25T13:42:24.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf2322640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bec108920 0x7f8bec1a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf2322640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bec108920 0x7f8bec1a1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37386/0 (socket says 172.21.15.43:37386) 2024-04-25T13:42:24.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf2322640 1 -- 172.21.15.43:0/3598077662 learned_addr learned my addr 172.21.15.43:0/3598077662 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:24.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf1320640 1 --2- 172.21.15.43:0/3598077662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bec103c20 0x7f8bec19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf1b21640 1 --2- 172.21.15.43:0/3598077662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bec1029e0 0x7f8bec19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf2322640 1 -- 172.21.15.43:0/3598077662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bec103c20 msgr2=0x7f8bec19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf2322640 1 --2- 172.21.15.43:0/3598077662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bec103c20 0x7f8bec19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf2322640 1 -- 172.21.15.43:0/3598077662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bec1029e0 msgr2=0x7f8bec19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf2322640 1 --2- 172.21.15.43:0/3598077662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bec1029e0 0x7f8bec19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf2322640 1 -- 172.21.15.43:0/3598077662 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bec1a1fd0 con 0x7f8bec108920 2024-04-25T13:42:24.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.001+0000 7f8bf2322640 1 --2- 172.21.15.43:0/3598077662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bec108920 0x7f8bec1a1960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00eaa0 tx=0x7f8bdc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:24.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.002+0000 7f8beaffd640 1 -- 172.21.15.43:0/3598077662 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc00cdb0 con 0x7f8bec108920 2024-04-25T13:42:24.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.002+0000 7f8beaffd640 1 -- 172.21.15.43:0/3598077662 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8bdc005020 con 0x7f8bec108920 2024-04-25T13:42:24.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.002+0000 7f8beaffd640 1 -- 172.21.15.43:0/3598077662 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0116d0 con 0x7f8bec108920 2024-04-25T13:42:24.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.002+0000 7f8bf3d85640 1 -- 172.21.15.43:0/3598077662 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bec1a22c0 con 0x7f8bec108920 2024-04-25T13:42:24.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.002+0000 7f8bf3d85640 1 -- 172.21.15.43:0/3598077662 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bec1a2860 con 0x7f8bec108920 2024-04-25T13:42:24.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.003+0000 7f8bf3d85640 1 -- 172.21.15.43:0/3598077662 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bec06c2a0 con 0x7f8bec108920 2024-04-25T13:42:24.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.004+0000 7f8beaffd640 1 -- 172.21.15.43:0/3598077662 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f8bdc0051d0 con 0x7f8bec108920 2024-04-25T13:42:24.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.005+0000 7f8beaffd640 1 --2- 172.21.15.43:0/3598077662 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8bd40afb70 0x7f8bd40b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.005+0000 7f8bf1b21640 1 --2- 172.21.15.43:0/3598077662 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8bd40afb70 0x7f8bd40b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.005+0000 7f8beaffd640 1 -- 172.21.15.43:0/3598077662 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f8bdc0df350 con 0x7f8bec108920 2024-04-25T13:42:24.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.005+0000 7f8bf1b21640 1 --2- 172.21.15.43:0/3598077662 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8bd40afb70 0x7f8bd40b2080 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8be40057c0 tx=0x7f8be4005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:24.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.008+0000 7f8beaffd640 1 -- 172.21.15.43:0/3598077662 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8bdc016030 con 0x7f8bec108920 2024-04-25T13:42:24.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.199+0000 7f8bf3d85640 1 -- 172.21.15.43:0/3598077662 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8bec1a2b20 con 0x7f8bec108920 2024-04-25T13:42:24.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.200+0000 7f8beaffd640 1 -- 172.21.15.43:0/3598077662 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) ==== 100+0+11 (secure 0 0 0) 0x7f8bdc0a7d70 con 0x7f8bec108920 2024-04-25T13:42:24.201 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-25T13:42:24.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.202+0000 7f8bf3d85640 1 -- 172.21.15.43:0/3598077662 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8bd40afb70 msgr2=0x7f8bd40b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.202+0000 7f8bf3d85640 1 --2- 172.21.15.43:0/3598077662 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8bd40afb70 0x7f8bd40b2080 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8be40057c0 tx=0x7f8be4005720 comp rx=0 tx=0).stop 2024-04-25T13:42:24.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.202+0000 7f8bf3d85640 1 -- 172.21.15.43:0/3598077662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bec108920 msgr2=0x7f8bec1a1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.202+0000 7f8bf3d85640 1 --2- 172.21.15.43:0/3598077662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bec108920 0x7f8bec1a1960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00eaa0 tx=0x7f8bdc00ef60 comp rx=0 tx=0).stop 2024-04-25T13:42:24.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.202+0000 7f8bf3d85640 1 -- 172.21.15.43:0/3598077662 shutdown_connections 2024-04-25T13:42:24.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.202+0000 7f8bf3d85640 1 --2- 172.21.15.43:0/3598077662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bec108920 0x7f8bec1a1960 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.202+0000 7f8bf3d85640 1 --2- 172.21.15.43:0/3598077662 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8bd40afb70 0x7f8bd40b2080 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.202+0000 7f8bf3d85640 1 --2- 172.21.15.43:0/3598077662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bec103c20 0x7f8bec19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.202+0000 7f8bf3d85640 1 --2- 172.21.15.43:0/3598077662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bec1029e0 0x7f8bec19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.202+0000 7f8bf3d85640 1 -- 172.21.15.43:0/3598077662 >> 172.21.15.43:0/3598077662 conn(0x7f8bec0fdbd0 msgr2=0x7f8bec109e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:24.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.202+0000 7f8bf3d85640 1 -- 172.21.15.43:0/3598077662 shutdown_connections 2024-04-25T13:42:24.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.202+0000 7f8bf3d85640 1 -- 172.21.15.43:0/3598077662 wait complete. 2024-04-25T13:42:24.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:24 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3713940915' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:24.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:24 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/722089840' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:42:24.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:24 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/396349775' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:42:24.213 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:42:24.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.328+0000 7f1314f14640 1 -- 172.21.15.43:0/4118158876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1310109a40 msgr2=0x7f131010be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.328+0000 7f1314f14640 1 --2- 172.21.15.43:0/4118158876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1310109a40 0x7f131010be60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1308009ca0 tx=0x7f130802a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.328+0000 7f1314f14640 1 -- 172.21.15.43:0/4118158876 shutdown_connections 2024-04-25T13:42:24.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.328+0000 7f1314f14640 1 --2- 172.21.15.43:0/4118158876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1310109a40 0x7f131010be60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.328+0000 7f1314f14640 1 --2- 172.21.15.43:0/4118158876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1310104d40 0x7f1310105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.328+0000 7f1314f14640 1 --2- 172.21.15.43:0/4118158876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1310103b00 0x7f1310104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.328+0000 7f1314f14640 1 -- 172.21.15.43:0/4118158876 >> 172.21.15.43:0/4118158876 conn(0x7f13100fed10 msgr2=0x7f13101011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:24.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.328+0000 7f1314f14640 1 -- 172.21.15.43:0/4118158876 shutdown_connections 2024-04-25T13:42:24.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.328+0000 7f1314f14640 1 -- 172.21.15.43:0/4118158876 wait complete. 2024-04-25T13:42:24.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.329+0000 7f1314f14640 1 Processor -- start 2024-04-25T13:42:24.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.329+0000 7f1314f14640 1 -- start start 2024-04-25T13:42:24.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.329+0000 7f1314f14640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1310103b00 0x7f131019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f1314f14640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1310104d40 0x7f131019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f1314f14640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1310109a40 0x7f13101a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f1314f14640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f131010f530 con 0x7f1310104d40 2024-04-25T13:42:24.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f1314f14640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f131010f3b0 con 0x7f1310109a40 2024-04-25T13:42:24.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f1314f14640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f131010f6b0 con 0x7f1310103b00 2024-04-25T13:42:24.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f1307fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1310104d40 0x7f131019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f1307fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1310104d40 0x7f131019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37406/0 (socket says 172.21.15.43:37406) 2024-04-25T13:42:24.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f1307fff640 1 -- 172.21.15.43:0/704148296 learned_addr learned my addr 172.21.15.43:0/704148296 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f130ed9d640 1 --2- 172.21.15.43:0/704148296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1310109a40 0x7f13101a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f1307fff640 1 -- 172.21.15.43:0/704148296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1310103b00 msgr2=0x7f131019a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f130e59c640 1 --2- 172.21.15.43:0/704148296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1310103b00 0x7f131019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f1307fff640 1 --2- 172.21.15.43:0/704148296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1310103b00 0x7f131019a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f1307fff640 1 -- 172.21.15.43:0/704148296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1310109a40 msgr2=0x7f13101a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f1307fff640 1 --2- 172.21.15.43:0/704148296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1310109a40 0x7f13101a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f1307fff640 1 -- 172.21.15.43:0/704148296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13101a1ca0 con 0x7f1310104d40 2024-04-25T13:42:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f130ed9d640 1 --2- 172.21.15.43:0/704148296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1310109a40 0x7f13101a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f1307fff640 1 --2- 172.21.15.43:0/704148296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1310104d40 0x7f131019a710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f12f800e9f0 tx=0x7f12f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f13077fe640 1 -- 172.21.15.43:0/704148296 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f800cd80 con 0x7f1310104d40 2024-04-25T13:42:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f13077fe640 1 -- 172.21.15.43:0/704148296 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12f80108c0 con 0x7f1310104d40 2024-04-25T13:42:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f1314f14640 1 -- 172.21.15.43:0/704148296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13101a1f90 con 0x7f1310104d40 2024-04-25T13:42:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f13077fe640 1 -- 172.21.15.43:0/704148296 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f80187c0 con 0x7f1310104d40 2024-04-25T13:42:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.330+0000 7f1314f14640 1 -- 172.21.15.43:0/704148296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13101a2400 con 0x7f1310104d40 2024-04-25T13:42:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.331+0000 7f1314f14640 1 -- 172.21.15.43:0/704148296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1310108850 con 0x7f1310104d40 2024-04-25T13:42:24.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.333+0000 7f13077fe640 1 -- 172.21.15.43:0/704148296 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f12f8010430 con 0x7f1310104d40 2024-04-25T13:42:24.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.334+0000 7f13077fe640 1 --2- 172.21.15.43:0/704148296 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f12fc0afaf0 0x7f12fc0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.334+0000 7f130e59c640 1 --2- 172.21.15.43:0/704148296 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f12fc0afaf0 0x7f12fc0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.334+0000 7f13077fe640 1 -- 172.21.15.43:0/704148296 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f12f80df7c0 con 0x7f1310104d40 2024-04-25T13:42:24.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.334+0000 7f130e59c640 1 --2- 172.21.15.43:0/704148296 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f12fc0afaf0 0x7f12fc0b2000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1310104700 tx=0x7f1300005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:24.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.338+0000 7f13077fe640 1 -- 172.21.15.43:0/704148296 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f12f80a8160 con 0x7f1310104d40 2024-04-25T13:42:24.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:24 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3713940915' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:24.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:24 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/722089840' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:42:24.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:24 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/396349775' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:42:24.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:24 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3713940915' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:24.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:24 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/722089840' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:42:24.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:24 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/396349775' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:42:24.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.522+0000 7f1314f14640 1 -- 172.21.15.43:0/704148296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f131002dce0 con 0x7f1310104d40 2024-04-25T13:42:24.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.522+0000 7f13077fe640 1 -- 172.21.15.43:0/704148296 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v80) ==== 103+0+11 (secure 0 0 0) 0x7f12f80b01e0 con 0x7f1310104d40 2024-04-25T13:42:24.523 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:42:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.524+0000 7f1314f14640 1 -- 172.21.15.43:0/704148296 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f12fc0afaf0 msgr2=0x7f12fc0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.524+0000 7f1314f14640 1 --2- 172.21.15.43:0/704148296 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f12fc0afaf0 0x7f12fc0b2000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1310104700 tx=0x7f1300005f90 comp rx=0 tx=0).stop 2024-04-25T13:42:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.524+0000 7f1314f14640 1 -- 172.21.15.43:0/704148296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1310104d40 msgr2=0x7f131019a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.524+0000 7f1314f14640 1 --2- 172.21.15.43:0/704148296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1310104d40 0x7f131019a710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f12f800e9f0 tx=0x7f12f800eeb0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.524+0000 7f1314f14640 1 -- 172.21.15.43:0/704148296 shutdown_connections 2024-04-25T13:42:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.524+0000 7f1314f14640 1 --2- 172.21.15.43:0/704148296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1310109a40 0x7f13101a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.524+0000 7f1314f14640 1 --2- 172.21.15.43:0/704148296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1310104d40 0x7f131019a710 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.524+0000 7f1314f14640 1 --2- 172.21.15.43:0/704148296 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f12fc0afaf0 0x7f12fc0b2000 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.524+0000 7f1314f14640 1 --2- 172.21.15.43:0/704148296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1310103b00 0x7f131019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.524+0000 7f1314f14640 1 -- 172.21.15.43:0/704148296 >> 172.21.15.43:0/704148296 conn(0x7f13100fed10 msgr2=0x7f1310105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.524+0000 7f1314f14640 1 -- 172.21.15.43:0/704148296 shutdown_connections 2024-04-25T13:42:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.524+0000 7f1314f14640 1 -- 172.21.15.43:0/704148296 wait complete. 2024-04-25T13:42:24.536 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:42:24.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.648+0000 7f67b5734640 1 -- 172.21.15.43:0/3912866422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b0103c30 msgr2=0x7f67b0104040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.648+0000 7f67b5734640 1 --2- 172.21.15.43:0/3912866422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b0103c30 0x7f67b0104040 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6798009900 tx=0x7f679802a410 comp rx=0 tx=0).stop 2024-04-25T13:42:24.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.648+0000 7f67b5734640 1 -- 172.21.15.43:0/3912866422 shutdown_connections 2024-04-25T13:42:24.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.648+0000 7f67b5734640 1 --2- 172.21.15.43:0/3912866422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67b0108930 0x7f67b010ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.648+0000 7f67b5734640 1 --2- 172.21.15.43:0/3912866422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b0103c30 0x7f67b0104040 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.648+0000 7f67b5734640 1 --2- 172.21.15.43:0/3912866422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b01029f0 0x7f67b01036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.648+0000 7f67b5734640 1 -- 172.21.15.43:0/3912866422 >> 172.21.15.43:0/3912866422 conn(0x7f67b00fdbc0 msgr2=0x7f67b0100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:24.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.649+0000 7f67b5734640 1 -- 172.21.15.43:0/3912866422 shutdown_connections 2024-04-25T13:42:24.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.649+0000 7f67b5734640 1 -- 172.21.15.43:0/3912866422 wait complete. 2024-04-25T13:42:24.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.649+0000 7f67b5734640 1 Processor -- start 2024-04-25T13:42:24.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.649+0000 7f67b5734640 1 -- start start 2024-04-25T13:42:24.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.649+0000 7f67b5734640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b01029f0 0x7f67b0075860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.649+0000 7f67b5734640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67b0103c30 0x7f67b019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.649+0000 7f67b5734640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b0108930 0x7f67b01a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.649+0000 7f67b5734640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f67b010e3c0 con 0x7f67b0108930 2024-04-25T13:42:24.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.649+0000 7f67b5734640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f67b010e240 con 0x7f67b0103c30 2024-04-25T13:42:24.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.649+0000 7f67b5734640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f67b010e540 con 0x7f67b01029f0 2024-04-25T13:42:24.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67af7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b0108930 0x7f67b01a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67af7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b0108930 0x7f67b01a1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37430/0 (socket says 172.21.15.43:37430) 2024-04-25T13:42:24.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67af7fe640 1 -- 172.21.15.43:0/3176161746 learned_addr learned my addr 172.21.15.43:0/3176161746 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:24.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67aeffd640 1 --2- 172.21.15.43:0/3176161746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b01029f0 0x7f67b0075860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67a7fff640 1 --2- 172.21.15.43:0/3176161746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67b0103c30 0x7f67b019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67af7fe640 1 -- 172.21.15.43:0/3176161746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b01029f0 msgr2=0x7f67b0075860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67af7fe640 1 --2- 172.21.15.43:0/3176161746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b01029f0 0x7f67b0075860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67af7fe640 1 -- 172.21.15.43:0/3176161746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67b0103c30 msgr2=0x7f67b019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67af7fe640 1 --2- 172.21.15.43:0/3176161746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67b0103c30 0x7f67b019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67af7fe640 1 -- 172.21.15.43:0/3176161746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b01a1c60 con 0x7f67b0108930 2024-04-25T13:42:24.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67a7fff640 1 --2- 172.21.15.43:0/3176161746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67b0103c30 0x7f67b019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:24.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67af7fe640 1 --2- 172.21.15.43:0/3176161746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b0108930 0x7f67b01a1440 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f67a800eb10 tx=0x7f67a800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:24.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67acff9640 1 -- 172.21.15.43:0/3176161746 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8004b20 con 0x7f67b0108930 2024-04-25T13:42:24.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67acff9640 1 -- 172.21.15.43:0/3176161746 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67a8004cc0 con 0x7f67b0108930 2024-04-25T13:42:24.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67b5734640 1 -- 172.21.15.43:0/3176161746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b01a1f50 con 0x7f67b0108930 2024-04-25T13:42:24.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67acff9640 1 -- 172.21.15.43:0/3176161746 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8010690 con 0x7f67b0108930 2024-04-25T13:42:24.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.650+0000 7f67b5734640 1 -- 172.21.15.43:0/3176161746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b01a2360 con 0x7f67b0108930 2024-04-25T13:42:24.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.651+0000 7f67b5734640 1 -- 172.21.15.43:0/3176161746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b006a190 con 0x7f67b0108930 2024-04-25T13:42:24.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.654+0000 7f67acff9640 1 -- 172.21.15.43:0/3176161746 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f67a8005000 con 0x7f67b0108930 2024-04-25T13:42:24.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.654+0000 7f67acff9640 1 --2- 172.21.15.43:0/3176161746 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f679c0afaf0 0x7f679c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.654+0000 7f67aeffd640 1 --2- 172.21.15.43:0/3176161746 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f679c0afaf0 0x7f679c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.654+0000 7f67acff9640 1 -- 172.21.15.43:0/3176161746 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f67a80df690 con 0x7f67b0108930 2024-04-25T13:42:24.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.655+0000 7f67aeffd640 1 --2- 172.21.15.43:0/3176161746 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f679c0afaf0 0x7f679c0b2000 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f67a0005fd0 tx=0x7f67a000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:24.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.658+0000 7f67acff9640 1 -- 172.21.15.43:0/3176161746 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f67a8053ff0 con 0x7f67b0108930 2024-04-25T13:42:24.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.857+0000 7f67b5734640 1 -- 172.21.15.43:0/3176161746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f67b0107790 con 0x7f67b0108930 2024-04-25T13:42:24.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.857+0000 7f67acff9640 1 -- 172.21.15.43:0/3176161746 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v80) ==== 81+0+591 (secure 0 0 0) 0x7f67b0107790 con 0x7f67b0108930 2024-04-25T13:42:24.857 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/775979394 2024-04-26T13:34:57.835176+0000 2024-04-25T13:42:24.858 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1063219824 2024-04-26T13:34:57.835176+0000 2024-04-25T13:42:24.858 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/1629086480 2024-04-26T13:34:57.835176+0000 2024-04-25T13:42:24.858 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/1629086480 2024-04-26T13:34:57.835176+0000 2024-04-25T13:42:24.858 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/3816223875 2024-04-26T13:34:30.246627+0000 2024-04-25T13:42:24.858 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1985552645 2024-04-26T13:34:57.835176+0000 2024-04-25T13:42:24.858 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1274235665 2024-04-26T13:34:30.246627+0000 2024-04-25T13:42:24.858 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/3816223875 2024-04-26T13:34:30.246627+0000 2024-04-25T13:42:24.858 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1022690204 2024-04-26T13:34:30.246627+0000 2024-04-25T13:42:24.858 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3992074212 2024-04-26T13:34:30.246627+0000 2024-04-25T13:42:24.858 INFO:teuthology.orchestra.run.smithi043.stderr:listed 10 entries 2024-04-25T13:42:24.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.859+0000 7f67b5734640 1 -- 172.21.15.43:0/3176161746 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f679c0afaf0 msgr2=0x7f679c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.859+0000 7f67b5734640 1 --2- 172.21.15.43:0/3176161746 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f679c0afaf0 0x7f679c0b2000 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f67a0005fd0 tx=0x7f67a000b390 comp rx=0 tx=0).stop 2024-04-25T13:42:24.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.859+0000 7f67b5734640 1 -- 172.21.15.43:0/3176161746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b0108930 msgr2=0x7f67b01a1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.859+0000 7f67b5734640 1 --2- 172.21.15.43:0/3176161746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b0108930 0x7f67b01a1440 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f67a800eb10 tx=0x7f67a800c2d0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.859+0000 7f67b5734640 1 -- 172.21.15.43:0/3176161746 shutdown_connections 2024-04-25T13:42:24.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.859+0000 7f67b5734640 1 --2- 172.21.15.43:0/3176161746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b0108930 0x7f67b01a1440 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.859+0000 7f67b5734640 1 --2- 172.21.15.43:0/3176161746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67b0103c30 0x7f67b019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.859+0000 7f67b5734640 1 --2- 172.21.15.43:0/3176161746 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f679c0afaf0 0x7f679c0b2000 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.859+0000 7f67b5734640 1 --2- 172.21.15.43:0/3176161746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b01029f0 0x7f67b0075860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.859+0000 7f67b5734640 1 -- 172.21.15.43:0/3176161746 >> 172.21.15.43:0/3176161746 conn(0x7f67b00fdbc0 msgr2=0x7f67b0104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:24.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.859+0000 7f67b5734640 1 -- 172.21.15.43:0/3176161746 shutdown_connections 2024-04-25T13:42:24.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:24.859+0000 7f67b5734640 1 -- 172.21.15.43:0/3176161746 wait complete. 2024-04-25T13:42:24.871 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi043.front.sepia.ceph.com... 2024-04-25T13:42:24.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:24.871 DEBUG:teuthology.orchestra.run.smithi043:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:42:24.894 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:ceph-fuse[72972]: fuse finished with error 0 and tester_r 0 2024-04-25T13:42:24.896 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:42:25.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:25 smithi043 ceph-mon[29195]: pgmap v293: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2024-04-25T13:42:25.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:25 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3598077662' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:42:25.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:25 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/704148296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:42:25.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:25 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3176161746' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T13:42:25.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:25 smithi161 ceph-mon[32696]: pgmap v293: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2024-04-25T13:42:25.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:25 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3598077662' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:42:25.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:25 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/704148296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:42:25.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:25 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3176161746' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T13:42:25.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:25 smithi175 ceph-mon[32649]: pgmap v293: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2024-04-25T13:42:25.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:25 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3598077662' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:42:25.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:25 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/704148296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:42:25.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:25 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3176161746' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T13:42:27.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:27 smithi161 ceph-mon[32696]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 258 B/s wr, 0 op/s 2024-04-25T13:42:27.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:27 smithi175 ceph-mon[32649]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 258 B/s wr, 0 op/s 2024-04-25T13:42:27.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:27 smithi043 ceph-mon[29195]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 258 B/s wr, 0 op/s 2024-04-25T13:42:29.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:29 smithi161 ceph-mon[32696]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-25T13:42:29.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:29 smithi175 ceph-mon[32649]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-25T13:42:29.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:29 smithi043 ceph-mon[29195]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-25T13:42:30.998 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T13:42:30.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:30.998 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-25T13:42:31.021 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:31.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.188+0000 7f96f6f4e640 1 -- 172.21.15.43:0/549667124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96f01029c0 msgr2=0x7f96f01036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.188+0000 7f96f6f4e640 1 --2- 172.21.15.43:0/549667124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96f01029c0 0x7f96f01036c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009ca0 tx=0x7f96e802a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.188+0000 7f96f6f4e640 1 -- 172.21.15.43:0/549667124 shutdown_connections 2024-04-25T13:42:31.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.188+0000 7f96f6f4e640 1 --2- 172.21.15.43:0/549667124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96f0108900 0x7f96f010ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.188+0000 7f96f6f4e640 1 --2- 172.21.15.43:0/549667124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96f0103c00 0x7f96f0104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.188+0000 7f96f6f4e640 1 --2- 172.21.15.43:0/549667124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96f01029c0 0x7f96f01036c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.188+0000 7f96f6f4e640 1 -- 172.21.15.43:0/549667124 >> 172.21.15.43:0/549667124 conn(0x7f96f00fdbd0 msgr2=0x7f96f0100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:31.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.188+0000 7f96f6f4e640 1 -- 172.21.15.43:0/549667124 shutdown_connections 2024-04-25T13:42:31.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.188+0000 7f96f6f4e640 1 -- 172.21.15.43:0/549667124 wait complete. 2024-04-25T13:42:31.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.189+0000 7f96f6f4e640 1 Processor -- start 2024-04-25T13:42:31.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.189+0000 7f96f6f4e640 1 -- start start 2024-04-25T13:42:31.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.189+0000 7f96f6f4e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96f01029c0 0x7f96f019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.189+0000 7f96f6f4e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96f0103c00 0x7f96f019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.189+0000 7f96f6f4e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96f0108900 0x7f96f01a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.189+0000 7f96f6f4e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f96f010e3a0 con 0x7f96f01029c0 2024-04-25T13:42:31.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.189+0000 7f96f6f4e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f96f010e220 con 0x7f96f0108900 2024-04-25T13:42:31.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.189+0000 7f96f6f4e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96f010e520 con 0x7f96f0103c00 2024-04-25T13:42:31.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.189+0000 7f96f4cea640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96f01029c0 0x7f96f019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.190+0000 7f96f4cea640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96f01029c0 0x7f96f019a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43960/0 (socket says 172.21.15.43:43960) 2024-04-25T13:42:31.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.190+0000 7f96f4cea640 1 -- 172.21.15.43:0/3332917549 learned_addr learned my addr 172.21.15.43:0/3332917549 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:31.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.190+0000 7f96f54eb640 1 --2- 172.21.15.43:0/3332917549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96f0108900 0x7f96f01a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.190+0000 7f96effff640 1 --2- 172.21.15.43:0/3332917549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96f0103c00 0x7f96f019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.190+0000 7f96f4cea640 1 -- 172.21.15.43:0/3332917549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96f0103c00 msgr2=0x7f96f019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.190+0000 7f96f4cea640 1 --2- 172.21.15.43:0/3332917549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96f0103c00 0x7f96f019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.190+0000 7f96f4cea640 1 -- 172.21.15.43:0/3332917549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96f0108900 msgr2=0x7f96f01a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.190+0000 7f96f4cea640 1 --2- 172.21.15.43:0/3332917549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96f0108900 0x7f96f01a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.190+0000 7f96f4cea640 1 -- 172.21.15.43:0/3332917549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f01a1c20 con 0x7f96f01029c0 2024-04-25T13:42:31.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.190+0000 7f96effff640 1 --2- 172.21.15.43:0/3332917549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96f0103c00 0x7f96f019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:31.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.190+0000 7f96f4cea640 1 --2- 172.21.15.43:0/3332917549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96f01029c0 0x7f96f019a190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f96e80098d0 tx=0x7f96e8003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:31.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.190+0000 7f96edffb640 1 -- 172.21.15.43:0/3332917549 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e8032ed0 con 0x7f96f01029c0 2024-04-25T13:42:31.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.190+0000 7f96edffb640 1 -- 172.21.15.43:0/3332917549 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96e80046d0 con 0x7f96f01029c0 2024-04-25T13:42:31.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.190+0000 7f96edffb640 1 -- 172.21.15.43:0/3332917549 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e8030dc0 con 0x7f96f01029c0 2024-04-25T13:42:31.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.190+0000 7f96f6f4e640 1 -- 172.21.15.43:0/3332917549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f01a1eb0 con 0x7f96f01029c0 2024-04-25T13:42:31.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.191+0000 7f96f6f4e640 1 -- 172.21.15.43:0/3332917549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f01a2310 con 0x7f96f01029c0 2024-04-25T13:42:31.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.192+0000 7f96f6f4e640 1 -- 172.21.15.43:0/3332917549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f01a2540 con 0x7f96f01029c0 2024-04-25T13:42:31.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.193+0000 7f96edffb640 1 -- 172.21.15.43:0/3332917549 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f96e80305c0 con 0x7f96f01029c0 2024-04-25T13:42:31.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.194+0000 7f96edffb640 1 --2- 172.21.15.43:0/3332917549 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f96d80afaf0 0x7f96d80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.194+0000 7f96effff640 1 --2- 172.21.15.43:0/3332917549 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f96d80afaf0 0x7f96d80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.195+0000 7f96edffb640 1 -- 172.21.15.43:0/3332917549 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f96e8100720 con 0x7f96f01029c0 2024-04-25T13:42:31.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.195+0000 7f96effff640 1 --2- 172.21.15.43:0/3332917549 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f96d80afaf0 0x7f96d80b2000 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f96e40058c0 tx=0x7f96e4005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:31.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.198+0000 7f96edffb640 1 -- 172.21.15.43:0/3332917549 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f96e80c9060 con 0x7f96f01029c0 2024-04-25T13:42:31.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:31 smithi161 ceph-mon[32696]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-25T13:42:31.373 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:31 smithi043 ceph-mon[29195]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-25T13:42:31.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.386+0000 7f96f6f4e640 1 -- 172.21.15.43:0/3332917549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96f01a2880 con 0x7f96f01029c0 2024-04-25T13:42:31.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.388+0000 7f96edffb640 1 -- 172.21.15.43:0/3332917549 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24117 (secure 0 0 0) 0x7f96e80c8960 con 0x7f96f01029c0 2024-04-25T13:42:31.388 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:31.388 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":80,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:42:13.441319+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.389+0000 7f96f6f4e640 1 -- 172.21.15.43:0/3332917549 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f96d80afaf0 msgr2=0x7f96d80b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.389+0000 7f96f6f4e640 1 --2- 172.21.15.43:0/3332917549 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f96d80afaf0 0x7f96d80b2000 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f96e40058c0 tx=0x7f96e4005d50 comp rx=0 tx=0).stop 2024-04-25T13:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.390+0000 7f96f6f4e640 1 -- 172.21.15.43:0/3332917549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96f01029c0 msgr2=0x7f96f019a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.390+0000 7f96f6f4e640 1 --2- 172.21.15.43:0/3332917549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96f01029c0 0x7f96f019a190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f96e80098d0 tx=0x7f96e8003ca0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.390+0000 7f96f6f4e640 1 -- 172.21.15.43:0/3332917549 shutdown_connections 2024-04-25T13:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.390+0000 7f96f6f4e640 1 --2- 172.21.15.43:0/3332917549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96f0108900 0x7f96f01a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.390+0000 7f96f6f4e640 1 --2- 172.21.15.43:0/3332917549 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f96d80afaf0 0x7f96d80b2000 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.390+0000 7f96f6f4e640 1 --2- 172.21.15.43:0/3332917549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96f0103c00 0x7f96f019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.390+0000 7f96f6f4e640 1 --2- 172.21.15.43:0/3332917549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96f01029c0 0x7f96f019a190 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.390+0000 7f96f6f4e640 1 -- 172.21.15.43:0/3332917549 >> 172.21.15.43:0/3332917549 conn(0x7f96f00fdbd0 msgr2=0x7f96f0109ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:31.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.390+0000 7f96f6f4e640 1 -- 172.21.15.43:0/3332917549 shutdown_connections 2024-04-25T13:42:31.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.390+0000 7f96f6f4e640 1 -- 172.21.15.43:0/3332917549 wait complete. 2024-04-25T13:42:31.402 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:31.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:31 smithi175 ceph-mon[32649]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-25T13:42:31.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.514+0000 7f4cf7a61640 1 -- 172.21.15.43:0/2535494985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cf0103c00 msgr2=0x7f4cf0104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.514+0000 7f4cf7a61640 1 --2- 172.21.15.43:0/2535494985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cf0103c00 0x7f4cf0104010 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009900 tx=0x7f4ce002a410 comp rx=0 tx=0).stop 2024-04-25T13:42:31.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.514+0000 7f4cf7a61640 1 -- 172.21.15.43:0/2535494985 shutdown_connections 2024-04-25T13:42:31.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.514+0000 7f4cf7a61640 1 --2- 172.21.15.43:0/2535494985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf0108900 0x7f4cf010ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.514+0000 7f4cf7a61640 1 --2- 172.21.15.43:0/2535494985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cf0103c00 0x7f4cf0104010 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.514+0000 7f4cf7a61640 1 --2- 172.21.15.43:0/2535494985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf01029c0 0x7f4cf01036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.514+0000 7f4cf7a61640 1 -- 172.21.15.43:0/2535494985 >> 172.21.15.43:0/2535494985 conn(0x7f4cf00fdbd0 msgr2=0x7f4cf0100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:31.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.514+0000 7f4cf7a61640 1 -- 172.21.15.43:0/2535494985 shutdown_connections 2024-04-25T13:42:31.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.514+0000 7f4cf7a61640 1 -- 172.21.15.43:0/2535494985 wait complete. 2024-04-25T13:42:31.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.515+0000 7f4cf7a61640 1 Processor -- start 2024-04-25T13:42:31.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.515+0000 7f4cf7a61640 1 -- start start 2024-04-25T13:42:31.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.515+0000 7f4cf7a61640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cf01029c0 0x7f4cf006a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.515+0000 7f4cf7a61640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf0103c00 0x7f4cf019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.515+0000 7f4cf7a61640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf0108900 0x7f4cf01a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.515+0000 7f4cf7a61640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf010e370 con 0x7f4cf01029c0 2024-04-25T13:42:31.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.515+0000 7f4cf7a61640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf010e1f0 con 0x7f4cf0108900 2024-04-25T13:42:31.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.515+0000 7f4cf7a61640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf010e4f0 con 0x7f4cf0103c00 2024-04-25T13:42:31.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.515+0000 7f4cf57fd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cf01029c0 0x7f4cf006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.515+0000 7f4cf57fd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cf01029c0 0x7f4cf006a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43966/0 (socket says 172.21.15.43:43966) 2024-04-25T13:42:31.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.515+0000 7f4cf57fd640 1 -- 172.21.15.43:0/3288192629 learned_addr learned my addr 172.21.15.43:0/3288192629 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:31.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.515+0000 7f4cf5ffe640 1 --2- 172.21.15.43:0/3288192629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf0108900 0x7f4cf01a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.515+0000 7f4cf4ffc640 1 --2- 172.21.15.43:0/3288192629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf0103c00 0x7f4cf019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.515+0000 7f4cf57fd640 1 -- 172.21.15.43:0/3288192629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf0103c00 msgr2=0x7f4cf019eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.515+0000 7f4cf57fd640 1 --2- 172.21.15.43:0/3288192629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf0103c00 0x7f4cf019eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.515+0000 7f4cf57fd640 1 -- 172.21.15.43:0/3288192629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf0108900 msgr2=0x7f4cf01a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.516+0000 7f4cf57fd640 1 --2- 172.21.15.43:0/3288192629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf0108900 0x7f4cf01a1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.516+0000 7f4cf57fd640 1 -- 172.21.15.43:0/3288192629 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf01a1c20 con 0x7f4cf01029c0 2024-04-25T13:42:31.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.516+0000 7f4cf5ffe640 1 --2- 172.21.15.43:0/3288192629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf0108900 0x7f4cf01a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:31.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.516+0000 7f4cf4ffc640 1 --2- 172.21.15.43:0/3288192629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf0103c00 0x7f4cf019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:31.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.516+0000 7f4cf57fd640 1 --2- 172.21.15.43:0/3288192629 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cf01029c0 0x7f4cf006a900 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00d740 tx=0x7f4cec00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:31.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.516+0000 7f4ce67fc640 1 -- 172.21.15.43:0/3288192629 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cec017070 con 0x7f4cf01029c0 2024-04-25T13:42:31.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.516+0000 7f4ce67fc640 1 -- 172.21.15.43:0/3288192629 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cec00de50 con 0x7f4cf01029c0 2024-04-25T13:42:31.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.516+0000 7f4ce67fc640 1 -- 172.21.15.43:0/3288192629 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cec003bb0 con 0x7f4cf01029c0 2024-04-25T13:42:31.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.516+0000 7f4cf7a61640 1 -- 172.21.15.43:0/3288192629 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf01a1f10 con 0x7f4cf01029c0 2024-04-25T13:42:31.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.516+0000 7f4cf7a61640 1 -- 172.21.15.43:0/3288192629 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf01a23d0 con 0x7f4cf01029c0 2024-04-25T13:42:31.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.517+0000 7f4cf7a61640 1 -- 172.21.15.43:0/3288192629 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf0107710 con 0x7f4cf01029c0 2024-04-25T13:42:31.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.518+0000 7f4ce67fc640 1 -- 172.21.15.43:0/3288192629 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f4cec003d50 con 0x7f4cf01029c0 2024-04-25T13:42:31.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.519+0000 7f4ce67fc640 1 --2- 172.21.15.43:0/3288192629 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4cdc0afb70 0x7f4cdc0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.519+0000 7f4cf4ffc640 1 --2- 172.21.15.43:0/3288192629 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4cdc0afb70 0x7f4cdc0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.519+0000 7f4ce67fc640 1 -- 172.21.15.43:0/3288192629 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f4cec0dece0 con 0x7f4cf01029c0 2024-04-25T13:42:31.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.520+0000 7f4cf4ffc640 1 --2- 172.21.15.43:0/3288192629 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4cdc0afb70 0x7f4cdc0b2080 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0006010 tx=0x7f4ce0031420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:31.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.522+0000 7f4ce67fc640 1 -- 172.21.15.43:0/3288192629 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4cec0a76a0 con 0x7f4cf01029c0 2024-04-25T13:42:31.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.708+0000 7f4cf7a61640 1 -- 172.21.15.43:0/3288192629 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4cf002dd20 con 0x7f4cf01029c0 2024-04-25T13:42:31.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.710+0000 7f4ce67fc640 1 -- 172.21.15.43:0/3288192629 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24117 (secure 0 0 0) 0x7f4cec0a6fa0 con 0x7f4cf01029c0 2024-04-25T13:42:31.710 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:31.710 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":80,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:42:13.441319+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:31.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.712+0000 7f4cf7a61640 1 -- 172.21.15.43:0/3288192629 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4cdc0afb70 msgr2=0x7f4cdc0b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.712+0000 7f4cf7a61640 1 --2- 172.21.15.43:0/3288192629 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4cdc0afb70 0x7f4cdc0b2080 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0006010 tx=0x7f4ce0031420 comp rx=0 tx=0).stop 2024-04-25T13:42:31.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.712+0000 7f4cf7a61640 1 -- 172.21.15.43:0/3288192629 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cf01029c0 msgr2=0x7f4cf006a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.712+0000 7f4cf7a61640 1 --2- 172.21.15.43:0/3288192629 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cf01029c0 0x7f4cf006a900 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00d740 tx=0x7f4cec00dc00 comp rx=0 tx=0).stop 2024-04-25T13:42:31.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.712+0000 7f4cf7a61640 1 -- 172.21.15.43:0/3288192629 shutdown_connections 2024-04-25T13:42:31.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.712+0000 7f4cf7a61640 1 --2- 172.21.15.43:0/3288192629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf0108900 0x7f4cf01a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.712+0000 7f4cf7a61640 1 --2- 172.21.15.43:0/3288192629 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4cdc0afb70 0x7f4cdc0b2080 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.712+0000 7f4cf7a61640 1 --2- 172.21.15.43:0/3288192629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf0103c00 0x7f4cf019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.712+0000 7f4cf7a61640 1 --2- 172.21.15.43:0/3288192629 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cf01029c0 0x7f4cf006a900 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.712+0000 7f4cf7a61640 1 -- 172.21.15.43:0/3288192629 >> 172.21.15.43:0/3288192629 conn(0x7f4cf00fdbd0 msgr2=0x7f4cf01048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:31.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.712+0000 7f4cf7a61640 1 -- 172.21.15.43:0/3288192629 shutdown_connections 2024-04-25T13:42:31.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.712+0000 7f4cf7a61640 1 -- 172.21.15.43:0/3288192629 wait complete. 2024-04-25T13:42:31.757 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T13:42:31.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.873+0000 7f184497a640 1 -- 172.21.15.43:0/3896432485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1840102a00 msgr2=0x7f1840103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.873+0000 7f184497a640 1 --2- 172.21.15.43:0/3896432485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1840102a00 0x7f1840103700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1830009900 tx=0x7f183002a410 comp rx=0 tx=0).stop 2024-04-25T13:42:31.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.873+0000 7f184497a640 1 -- 172.21.15.43:0/3896432485 shutdown_connections 2024-04-25T13:42:31.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.873+0000 7f184497a640 1 --2- 172.21.15.43:0/3896432485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1840108940 0x7f184010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.873+0000 7f184497a640 1 --2- 172.21.15.43:0/3896432485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1840103c40 0x7f1840104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.873+0000 7f184497a640 1 --2- 172.21.15.43:0/3896432485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1840102a00 0x7f1840103700 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.873+0000 7f184497a640 1 -- 172.21.15.43:0/3896432485 >> 172.21.15.43:0/3896432485 conn(0x7f18400fdbf0 msgr2=0x7f18401000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:31.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.873+0000 7f184497a640 1 -- 172.21.15.43:0/3896432485 shutdown_connections 2024-04-25T13:42:31.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.873+0000 7f184497a640 1 -- 172.21.15.43:0/3896432485 wait complete. 2024-04-25T13:42:31.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.874+0000 7f184497a640 1 Processor -- start 2024-04-25T13:42:31.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.874+0000 7f184497a640 1 -- start start 2024-04-25T13:42:31.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.874+0000 7f184497a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1840102a00 0x7f184019a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.874+0000 7f184497a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1840103c40 0x7f184019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.874+0000 7f184497a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1840108940 0x7f18401a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.874+0000 7f184497a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f184010e390 con 0x7f1840103c40 2024-04-25T13:42:31.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.874+0000 7f184497a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f184010e210 con 0x7f1840108940 2024-04-25T13:42:31.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.874+0000 7f184497a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f184010e510 con 0x7f1840102a00 2024-04-25T13:42:31.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.874+0000 7f183dd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1840103c40 0x7f184019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.874+0000 7f183dd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1840103c40 0x7f184019a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43996/0 (socket says 172.21.15.43:43996) 2024-04-25T13:42:31.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.874+0000 7f183dd9b640 1 -- 172.21.15.43:0/321980423 learned_addr learned my addr 172.21.15.43:0/321980423 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:31.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.874+0000 7f183e59c640 1 --2- 172.21.15.43:0/321980423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1840102a00 0x7f184019a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.874+0000 7f183ed9d640 1 --2- 172.21.15.43:0/321980423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1840108940 0x7f18401a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.875+0000 7f183dd9b640 1 -- 172.21.15.43:0/321980423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1840102a00 msgr2=0x7f184019a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.875+0000 7f183dd9b640 1 --2- 172.21.15.43:0/321980423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1840102a00 0x7f184019a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.875+0000 7f183dd9b640 1 -- 172.21.15.43:0/321980423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1840108940 msgr2=0x7f18401a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.875+0000 7f183dd9b640 1 --2- 172.21.15.43:0/321980423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1840108940 0x7f18401a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.875+0000 7f183dd9b640 1 -- 172.21.15.43:0/321980423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18401a1d20 con 0x7f1840103c40 2024-04-25T13:42:31.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.875+0000 7f183dd9b640 1 --2- 172.21.15.43:0/321980423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1840103c40 0x7f184019a720 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f183400d950 tx=0x7f183400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:31.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.875+0000 7f182f7fe640 1 -- 172.21.15.43:0/321980423 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834017070 con 0x7f1840103c40 2024-04-25T13:42:31.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.875+0000 7f182f7fe640 1 -- 172.21.15.43:0/321980423 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1834009c30 con 0x7f1840103c40 2024-04-25T13:42:31.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.875+0000 7f184497a640 1 -- 172.21.15.43:0/321980423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18401a1fb0 con 0x7f1840103c40 2024-04-25T13:42:31.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.875+0000 7f182f7fe640 1 -- 172.21.15.43:0/321980423 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183400f620 con 0x7f1840103c40 2024-04-25T13:42:31.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.875+0000 7f184497a640 1 -- 172.21.15.43:0/321980423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18401a24c0 con 0x7f1840103c40 2024-04-25T13:42:31.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.876+0000 7f184497a640 1 -- 172.21.15.43:0/321980423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18401a2720 con 0x7f1840103c40 2024-04-25T13:42:31.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.877+0000 7f182f7fe640 1 -- 172.21.15.43:0/321980423 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f1834005030 con 0x7f1840103c40 2024-04-25T13:42:31.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.878+0000 7f182f7fe640 1 --2- 172.21.15.43:0/321980423 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f18280afb70 0x7f18280b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.878+0000 7f183e59c640 1 --2- 172.21.15.43:0/321980423 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f18280afb70 0x7f18280b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.878+0000 7f182f7fe640 1 -- 172.21.15.43:0/321980423 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f18340dea30 con 0x7f1840103c40 2024-04-25T13:42:31.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.879+0000 7f183e59c640 1 --2- 172.21.15.43:0/321980423 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f18280afb70 0x7f18280b2080 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1830005ab0 tx=0x7f1830031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:31.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:31.882+0000 7f182f7fe640 1 -- 172.21.15.43:0/321980423 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f18340a73f0 con 0x7f1840103c40 2024-04-25T13:42:32.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:32.113+0000 7f184497a640 1 -- 172.21.15.43:0/321980423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f18401a28f0 con 0x7f1840103c40 2024-04-25T13:42:32.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:32 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3332917549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:32.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:32 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3288192629' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:32.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:32 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3332917549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:32.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:32 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3288192629' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:32.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:32 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3332917549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:32.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:32 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3288192629' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:33.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.114+0000 7f182f7fe640 1 -- 172.21.15.43:0/321980423 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f1834009de0 con 0x7f1840103c40 2024-04-25T13:42:33.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.116+0000 7f184497a640 1 -- 172.21.15.43:0/321980423 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f18280afb70 msgr2=0x7f18280b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.116+0000 7f184497a640 1 --2- 172.21.15.43:0/321980423 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f18280afb70 0x7f18280b2080 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1830005ab0 tx=0x7f1830031400 comp rx=0 tx=0).stop 2024-04-25T13:42:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.116+0000 7f184497a640 1 -- 172.21.15.43:0/321980423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1840103c40 msgr2=0x7f184019a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.116+0000 7f184497a640 1 --2- 172.21.15.43:0/321980423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1840103c40 0x7f184019a720 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f183400d950 tx=0x7f183400de10 comp rx=0 tx=0).stop 2024-04-25T13:42:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.116+0000 7f184497a640 1 -- 172.21.15.43:0/321980423 shutdown_connections 2024-04-25T13:42:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.116+0000 7f184497a640 1 --2- 172.21.15.43:0/321980423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1840108940 0x7f18401a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.116+0000 7f184497a640 1 --2- 172.21.15.43:0/321980423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1840103c40 0x7f184019a720 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.116+0000 7f184497a640 1 --2- 172.21.15.43:0/321980423 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f18280afb70 0x7f18280b2080 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.116+0000 7f184497a640 1 --2- 172.21.15.43:0/321980423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1840102a00 0x7f184019a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.117+0000 7f184497a640 1 -- 172.21.15.43:0/321980423 >> 172.21.15.43:0/321980423 conn(0x7f18400fdbf0 msgr2=0x7f1840074dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.117+0000 7f184497a640 1 -- 172.21.15.43:0/321980423 shutdown_connections 2024-04-25T13:42:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.117+0000 7f184497a640 1 -- 172.21.15.43:0/321980423 wait complete. 2024-04-25T13:42:33.131 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-04-25T13:42:33.131 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-04-25T13:42:33.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.254+0000 7f88e6cf2640 1 -- 172.21.15.43:0/3125994940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e0109a30 msgr2=0x7f88e010be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.254+0000 7f88e6cf2640 1 --2- 172.21.15.43:0/3125994940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e0109a30 0x7f88e010be50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009900 tx=0x7f88c802a410 comp rx=0 tx=0).stop 2024-04-25T13:42:33.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.254+0000 7f88e6cf2640 1 -- 172.21.15.43:0/3125994940 shutdown_connections 2024-04-25T13:42:33.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.254+0000 7f88e6cf2640 1 --2- 172.21.15.43:0/3125994940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e0109a30 0x7f88e010be50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.254+0000 7f88e6cf2640 1 --2- 172.21.15.43:0/3125994940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88e0104d30 0x7f88e0105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.254+0000 7f88e6cf2640 1 --2- 172.21.15.43:0/3125994940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88e0103af0 0x7f88e01047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.254+0000 7f88e6cf2640 1 -- 172.21.15.43:0/3125994940 >> 172.21.15.43:0/3125994940 conn(0x7f88e00fece0 msgr2=0x7f88e0101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:33.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.254+0000 7f88e6cf2640 1 -- 172.21.15.43:0/3125994940 shutdown_connections 2024-04-25T13:42:33.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.254+0000 7f88e6cf2640 1 -- 172.21.15.43:0/3125994940 wait complete. 2024-04-25T13:42:33.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.254+0000 7f88e6cf2640 1 Processor -- start 2024-04-25T13:42:33.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.254+0000 7f88e6cf2640 1 -- start start 2024-04-25T13:42:33.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e6cf2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e0103af0 0x7f88e0077960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e6cf2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88e0104d30 0x7f88e0076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e6cf2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88e0109a30 0x7f88e0076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e6cf2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f88e010f4d0 con 0x7f88e0103af0 2024-04-25T13:42:33.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e6cf2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f88e010f350 con 0x7f88e0104d30 2024-04-25T13:42:33.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e6cf2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f88e010f650 con 0x7f88e0109a30 2024-04-25T13:42:33.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e4a8e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e0103af0 0x7f88e0077960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e4a8e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e0103af0 0x7f88e0077960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44010/0 (socket says 172.21.15.43:44010) 2024-04-25T13:42:33.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e4a8e640 1 -- 172.21.15.43:0/3713124664 learned_addr learned my addr 172.21.15.43:0/3713124664 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:33.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e528f640 1 --2- 172.21.15.43:0/3713124664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88e0109a30 0x7f88e0076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88dffff640 1 --2- 172.21.15.43:0/3713124664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88e0104d30 0x7f88e0076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e4a8e640 1 -- 172.21.15.43:0/3713124664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88e0109a30 msgr2=0x7f88e0076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e4a8e640 1 --2- 172.21.15.43:0/3713124664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88e0109a30 0x7f88e0076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e4a8e640 1 -- 172.21.15.43:0/3713124664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88e0104d30 msgr2=0x7f88e0076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e4a8e640 1 --2- 172.21.15.43:0/3713124664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88e0104d30 0x7f88e0076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e4a8e640 1 -- 172.21.15.43:0/3713124664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e0076c70 con 0x7f88e0103af0 2024-04-25T13:42:33.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e528f640 1 --2- 172.21.15.43:0/3713124664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88e0109a30 0x7f88e0076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:33.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e4a8e640 1 --2- 172.21.15.43:0/3713124664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e0103af0 0x7f88e0077960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f88d800ead0 tx=0x7f88d800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:33.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88ddffb640 1 -- 172.21.15.43:0/3713124664 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d800cde0 con 0x7f88e0103af0 2024-04-25T13:42:33.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88ddffb640 1 -- 172.21.15.43:0/3713124664 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88d8003e00 con 0x7f88e0103af0 2024-04-25T13:42:33.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88e6cf2640 1 -- 172.21.15.43:0/3713124664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e01a4200 con 0x7f88e0103af0 2024-04-25T13:42:33.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.255+0000 7f88ddffb640 1 -- 172.21.15.43:0/3713124664 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d80116d0 con 0x7f88e0103af0 2024-04-25T13:42:33.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.256+0000 7f88e6cf2640 1 -- 172.21.15.43:0/3713124664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e01a4670 con 0x7f88e0103af0 2024-04-25T13:42:33.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.257+0000 7f88e6cf2640 1 -- 172.21.15.43:0/3713124664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88e0108840 con 0x7f88e0103af0 2024-04-25T13:42:33.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.258+0000 7f88ddffb640 1 -- 172.21.15.43:0/3713124664 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f88d8003970 con 0x7f88e0103af0 2024-04-25T13:42:33.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.258+0000 7f88ddffb640 1 --2- 172.21.15.43:0/3713124664 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f88cc0afaf0 0x7f88cc0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.259+0000 7f88dffff640 1 --2- 172.21.15.43:0/3713124664 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f88cc0afaf0 0x7f88cc0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.259+0000 7f88ddffb640 1 -- 172.21.15.43:0/3713124664 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f88d80df540 con 0x7f88e0103af0 2024-04-25T13:42:33.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.259+0000 7f88dffff640 1 --2- 172.21.15.43:0/3713124664 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f88cc0afaf0 0x7f88cc0b2000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f88e0077300 tx=0x7f88d000b5b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:33.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.263+0000 7f88ddffb640 1 -- 172.21.15.43:0/3713124664 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f88d8015030 con 0x7f88e0103af0 2024-04-25T13:42:33.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:33 smithi175 ceph-mon[32649]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-25T13:42:33.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:33 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/321980423' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-25T13:42:33.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:33 smithi043 ceph-mon[29195]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-25T13:42:33.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:33 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/321980423' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-25T13:42:33.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:33.491+0000 7f88e6cf2640 1 -- 172.21.15.43:0/3713124664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f88e00637a0 con 0x7f88e0103af0 2024-04-25T13:42:33.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:33 smithi161 ceph-mon[32696]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-25T13:42:33.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:33 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/321980423' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-25T13:42:34.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.120+0000 7f88ddffb640 1 -- 172.21.15.43:0/3713124664 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f88d80a7ee0 con 0x7f88e0103af0 2024-04-25T13:42:34.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.122+0000 7f88e6cf2640 1 -- 172.21.15.43:0/3713124664 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f88cc0afaf0 msgr2=0x7f88cc0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.122+0000 7f88e6cf2640 1 --2- 172.21.15.43:0/3713124664 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f88cc0afaf0 0x7f88cc0b2000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f88e0077300 tx=0x7f88d000b5b0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.122+0000 7f88e6cf2640 1 -- 172.21.15.43:0/3713124664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e0103af0 msgr2=0x7f88e0077960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.122+0000 7f88e6cf2640 1 --2- 172.21.15.43:0/3713124664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e0103af0 0x7f88e0077960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f88d800ead0 tx=0x7f88d800ef90 comp rx=0 tx=0).stop 2024-04-25T13:42:34.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.122+0000 7f88e6cf2640 1 -- 172.21.15.43:0/3713124664 shutdown_connections 2024-04-25T13:42:34.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.122+0000 7f88e6cf2640 1 --2- 172.21.15.43:0/3713124664 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f88cc0afaf0 0x7f88cc0b2000 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.122+0000 7f88e6cf2640 1 --2- 172.21.15.43:0/3713124664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88e0109a30 0x7f88e0076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.122+0000 7f88e6cf2640 1 --2- 172.21.15.43:0/3713124664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88e0104d30 0x7f88e0076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.122+0000 7f88e6cf2640 1 --2- 172.21.15.43:0/3713124664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e0103af0 0x7f88e0077960 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.122+0000 7f88e6cf2640 1 -- 172.21.15.43:0/3713124664 >> 172.21.15.43:0/3713124664 conn(0x7f88e00fece0 msgr2=0x7f88e0105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:34.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.122+0000 7f88e6cf2640 1 -- 172.21.15.43:0/3713124664 shutdown_connections 2024-04-25T13:42:34.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.122+0000 7f88e6cf2640 1 -- 172.21.15.43:0/3713124664 wait complete. 2024-04-25T13:42:34.139 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-04-25T13:42:34.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.259+0000 7fce7d2e0640 1 -- 172.21.15.43:0/2979834576 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce78101760 msgr2=0x7fce78101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.259+0000 7fce7d2e0640 1 --2- 172.21.15.43:0/2979834576 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce78101760 0x7fce78101bd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009900 tx=0x7fce6c02a410 comp rx=0 tx=0).stop 2024-04-25T13:42:34.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.259+0000 7fce7d2e0640 1 -- 172.21.15.43:0/2979834576 shutdown_connections 2024-04-25T13:42:34.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.259+0000 7fce7d2e0640 1 --2- 172.21.15.43:0/2979834576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce78102260 0x7fce7810bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.259+0000 7fce7d2e0640 1 --2- 172.21.15.43:0/2979834576 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce78101760 0x7fce78101bd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.259+0000 7fce7d2e0640 1 --2- 172.21.15.43:0/2979834576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce781050b0 0x7fce781054c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.259+0000 7fce7d2e0640 1 -- 172.21.15.43:0/2979834576 >> 172.21.15.43:0/2979834576 conn(0x7fce780fd380 msgr2=0x7fce780ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:34.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.259+0000 7fce7d2e0640 1 -- 172.21.15.43:0/2979834576 shutdown_connections 2024-04-25T13:42:34.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.259+0000 7fce7d2e0640 1 -- 172.21.15.43:0/2979834576 wait complete. 2024-04-25T13:42:34.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce7d2e0640 1 Processor -- start 2024-04-25T13:42:34.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce7d2e0640 1 -- start start 2024-04-25T13:42:34.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce7d2e0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce78101760 0x7fce7819a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce7d2e0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce78102260 0x7fce7819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce7d2e0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce781050b0 0x7fce781a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce7d2e0640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fce7810f4d0 con 0x7fce78102260 2024-04-25T13:42:34.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce7d2e0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fce7810f350 con 0x7fce781050b0 2024-04-25T13:42:34.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce7d2e0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fce7810f650 con 0x7fce78101760 2024-04-25T13:42:34.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce767fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce78102260 0x7fce7819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce767fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce78102260 0x7fce7819a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44034/0 (socket says 172.21.15.43:44034) 2024-04-25T13:42:34.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce767fc640 1 -- 172.21.15.43:0/1234205424 learned_addr learned my addr 172.21.15.43:0/1234205424 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:34.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce76ffd640 1 --2- 172.21.15.43:0/1234205424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce78101760 0x7fce7819a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce777fe640 1 --2- 172.21.15.43:0/1234205424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce781050b0 0x7fce781a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce767fc640 1 -- 172.21.15.43:0/1234205424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce78101760 msgr2=0x7fce7819a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce767fc640 1 --2- 172.21.15.43:0/1234205424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce78101760 0x7fce7819a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce767fc640 1 -- 172.21.15.43:0/1234205424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce781050b0 msgr2=0x7fce781a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce767fc640 1 --2- 172.21.15.43:0/1234205424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce781050b0 0x7fce781a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.260+0000 7fce767fc640 1 -- 172.21.15.43:0/1234205424 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce781a1cc0 con 0x7fce78102260 2024-04-25T13:42:34.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.261+0000 7fce767fc640 1 --2- 172.21.15.43:0/1234205424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce78102260 0x7fce7819a6c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009230 tx=0x7fce6c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:34.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.261+0000 7fce5ffff640 1 -- 172.21.15.43:0/1234205424 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c03f030 con 0x7fce78102260 2024-04-25T13:42:34.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.261+0000 7fce7d2e0640 1 -- 172.21.15.43:0/1234205424 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce781a1f50 con 0x7fce78102260 2024-04-25T13:42:34.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.261+0000 7fce5ffff640 1 -- 172.21.15.43:0/1234205424 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce6c003c90 con 0x7fce78102260 2024-04-25T13:42:34.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.261+0000 7fce5ffff640 1 -- 172.21.15.43:0/1234205424 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c035070 con 0x7fce78102260 2024-04-25T13:42:34.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.261+0000 7fce7d2e0640 1 -- 172.21.15.43:0/1234205424 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce781a2360 con 0x7fce78102260 2024-04-25T13:42:34.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.262+0000 7fce7d2e0640 1 -- 172.21.15.43:0/1234205424 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce78108a40 con 0x7fce78102260 2024-04-25T13:42:34.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.263+0000 7fce5ffff640 1 -- 172.21.15.43:0/1234205424 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fce6c042030 con 0x7fce78102260 2024-04-25T13:42:34.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.264+0000 7fce5ffff640 1 --2- 172.21.15.43:0/1234205424 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fce600afaf0 0x7fce600b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.264+0000 7fce76ffd640 1 --2- 172.21.15.43:0/1234205424 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fce600afaf0 0x7fce600b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.265+0000 7fce5ffff640 1 -- 172.21.15.43:0/1234205424 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fce6c0ff9b0 con 0x7fce78102260 2024-04-25T13:42:34.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.265+0000 7fce76ffd640 1 --2- 172.21.15.43:0/1234205424 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fce600afaf0 0x7fce600b2000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fce7806b2d0 tx=0x7fce68009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:34.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.268+0000 7fce5ffff640 1 -- 172.21.15.43:0/1234205424 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fce6c0c8350 con 0x7fce78102260 2024-04-25T13:42:34.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:34 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/321980423' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-25T13:42:34.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:34 smithi175 ceph-mon[32649]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T13:42:34.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:34 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3713124664' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-25T13:42:34.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:34 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/321980423' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-25T13:42:34.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:34 smithi043 ceph-mon[29195]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T13:42:34.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:34 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3713124664' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-25T13:42:34.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:34.493+0000 7fce7d2e0640 1 -- 172.21.15.43:0/1234205424 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fce7802dbf0 con 0x7fce78102260 2024-04-25T13:42:34.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:34 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/321980423' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-25T13:42:34.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:34 smithi161 ceph-mon[32696]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T13:42:34.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:34 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3713124664' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-25T13:42:35.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.127+0000 7fce5ffff640 1 -- 172.21.15.43:0/1234205424 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fce6c0c7c50 con 0x7fce78102260 2024-04-25T13:42:35.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.130+0000 7fce7d2e0640 1 -- 172.21.15.43:0/1234205424 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fce600afaf0 msgr2=0x7fce600b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.130+0000 7fce7d2e0640 1 --2- 172.21.15.43:0/1234205424 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fce600afaf0 0x7fce600b2000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fce7806b2d0 tx=0x7fce68009870 comp rx=0 tx=0).stop 2024-04-25T13:42:35.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.130+0000 7fce7d2e0640 1 -- 172.21.15.43:0/1234205424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce78102260 msgr2=0x7fce7819a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.130+0000 7fce7d2e0640 1 --2- 172.21.15.43:0/1234205424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce78102260 0x7fce7819a6c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009230 tx=0x7fce6c0042f0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.130+0000 7fce7d2e0640 1 -- 172.21.15.43:0/1234205424 shutdown_connections 2024-04-25T13:42:35.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.130+0000 7fce7d2e0640 1 --2- 172.21.15.43:0/1234205424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce781050b0 0x7fce781a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.130+0000 7fce7d2e0640 1 --2- 172.21.15.43:0/1234205424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce78102260 0x7fce7819a6c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.130+0000 7fce7d2e0640 1 --2- 172.21.15.43:0/1234205424 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fce600afaf0 0x7fce600b2000 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.130+0000 7fce7d2e0640 1 --2- 172.21.15.43:0/1234205424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce78101760 0x7fce7819a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.130+0000 7fce7d2e0640 1 -- 172.21.15.43:0/1234205424 >> 172.21.15.43:0/1234205424 conn(0x7fce780fd380 msgr2=0x7fce78105c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:35.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.130+0000 7fce7d2e0640 1 -- 172.21.15.43:0/1234205424 shutdown_connections 2024-04-25T13:42:35.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.130+0000 7fce7d2e0640 1 -- 172.21.15.43:0/1234205424 wait complete. 2024-04-25T13:42:35.148 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-25T13:42:35.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.270+0000 7fe5bf8b6640 1 -- 172.21.15.43:0/4135465296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5b8104270 msgr2=0x7fe5b8106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.270+0000 7fe5bf8b6640 1 --2- 172.21.15.43:0/4135465296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5b8104270 0x7fe5b8106690 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009900 tx=0x7fe5b402a410 comp rx=0 tx=0).stop 2024-04-25T13:42:35.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.270+0000 7fe5bf8b6640 1 -- 172.21.15.43:0/4135465296 shutdown_connections 2024-04-25T13:42:35.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.270+0000 7fe5bf8b6640 1 --2- 172.21.15.43:0/4135465296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5b8109770 0x7fe5b810bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.270+0000 7fe5bf8b6640 1 --2- 172.21.15.43:0/4135465296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5b8106c60 0x7fe5b81090e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.270+0000 7fe5bf8b6640 1 --2- 172.21.15.43:0/4135465296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5b8104270 0x7fe5b8106690 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.270+0000 7fe5bf8b6640 1 -- 172.21.15.43:0/4135465296 >> 172.21.15.43:0/4135465296 conn(0x7fe5b80fdbd0 msgr2=0x7fe5b8100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.270+0000 7fe5bf8b6640 1 -- 172.21.15.43:0/4135465296 shutdown_connections 2024-04-25T13:42:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.270+0000 7fe5bf8b6640 1 -- 172.21.15.43:0/4135465296 wait complete. 2024-04-25T13:42:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bf8b6640 1 Processor -- start 2024-04-25T13:42:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bf8b6640 1 -- start start 2024-04-25T13:42:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bf8b6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5b8104270 0x7fe5b819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bf8b6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5b8106c60 0x7fe5b819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bf8b6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5b8109770 0x7fe5b81a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bf8b6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b810f490 con 0x7fe5b8104270 2024-04-25T13:42:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bf8b6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b810f310 con 0x7fe5b8106c60 2024-04-25T13:42:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bf8b6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b810f610 con 0x7fe5b8109770 2024-04-25T13:42:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bd652640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5b8104270 0x7fe5b819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bd652640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5b8104270 0x7fe5b819c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44050/0 (socket says 172.21.15.43:44050) 2024-04-25T13:42:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bd652640 1 -- 172.21.15.43:0/1882970630 learned_addr learned my addr 172.21.15.43:0/1882970630 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bce51640 1 --2- 172.21.15.43:0/1882970630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5b8106c60 0x7fe5b819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bde53640 1 --2- 172.21.15.43:0/1882970630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5b8109770 0x7fe5b81a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bd652640 1 -- 172.21.15.43:0/1882970630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5b8109770 msgr2=0x7fe5b81a3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bd652640 1 --2- 172.21.15.43:0/1882970630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5b8109770 0x7fe5b81a3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bd652640 1 -- 172.21.15.43:0/1882970630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5b8106c60 msgr2=0x7fe5b819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bd652640 1 --2- 172.21.15.43:0/1882970630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5b8106c60 0x7fe5b819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.271+0000 7fe5bd652640 1 -- 172.21.15.43:0/1882970630 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b81a4220 con 0x7fe5b8104270 2024-04-25T13:42:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.272+0000 7fe5bd652640 1 --2- 172.21.15.43:0/1882970630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5b8104270 0x7fe5b819c6e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4031460 tx=0x7fe5b4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.272+0000 7fe5ae7fc640 1 -- 172.21.15.43:0/1882970630 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b403f030 con 0x7fe5b8104270 2024-04-25T13:42:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.272+0000 7fe5bf8b6640 1 -- 172.21.15.43:0/1882970630 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b81a44b0 con 0x7fe5b8104270 2024-04-25T13:42:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.272+0000 7fe5ae7fc640 1 -- 172.21.15.43:0/1882970630 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5b4003a80 con 0x7fe5b8104270 2024-04-25T13:42:35.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.272+0000 7fe5ae7fc640 1 -- 172.21.15.43:0/1882970630 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4035070 con 0x7fe5b8104270 2024-04-25T13:42:35.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.272+0000 7fe5bf8b6640 1 -- 172.21.15.43:0/1882970630 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b81a49f0 con 0x7fe5b8104270 2024-04-25T13:42:35.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.273+0000 7fe5bf8b6640 1 -- 172.21.15.43:0/1882970630 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5b806c2a0 con 0x7fe5b8104270 2024-04-25T13:42:35.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.275+0000 7fe5ae7fc640 1 -- 172.21.15.43:0/1882970630 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7fe5b4042030 con 0x7fe5b8104270 2024-04-25T13:42:35.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.276+0000 7fe5ae7fc640 1 --2- 172.21.15.43:0/1882970630 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5a40afaf0 0x7fe5a40b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.276+0000 7fe5bce51640 1 --2- 172.21.15.43:0/1882970630 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5a40afaf0 0x7fe5a40b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.276+0000 7fe5ae7fc640 1 -- 172.21.15.43:0/1882970630 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fe5b40ff9a0 con 0x7fe5b8104270 2024-04-25T13:42:35.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.276+0000 7fe5bce51640 1 --2- 172.21.15.43:0/1882970630 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5a40afaf0 0x7fe5a40b2000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe5b819d780 tx=0x7fe5a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:35.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.280+0000 7fe5ae7fc640 1 -- 172.21.15.43:0/1882970630 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe5b40c8340 con 0x7fe5b8104270 2024-04-25T13:42:35.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:35 smithi175 ceph-mon[32649]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-04-25T13:42:35.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:35 smithi175 ceph-mon[32649]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-25T13:42:35.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:35 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3713124664' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-25T13:42:35.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:35 smithi175 ceph-mon[32649]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-25T13:42:35.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:35 smithi175 ceph-mon[32649]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T13:42:35.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:35 smithi175 ceph-mon[32649]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-04-25T13:42:35.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:35 smithi175 ceph-mon[32649]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-25T13:42:35.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:35 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1234205424' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T13:42:35.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:35 smithi043 ceph-mon[29195]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-04-25T13:42:35.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:35 smithi043 ceph-mon[29195]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-25T13:42:35.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:35 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3713124664' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-25T13:42:35.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:35 smithi043 ceph-mon[29195]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-25T13:42:35.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:35 smithi043 ceph-mon[29195]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T13:42:35.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:35 smithi043 ceph-mon[29195]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-04-25T13:42:35.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:35 smithi043 ceph-mon[29195]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-25T13:42:35.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:35 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1234205424' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T13:42:35.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:35.504+0000 7fe5bf8b6640 1 -- 172.21.15.43:0/1882970630 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fe5b81a4c50 con 0x7fe5b8104270 2024-04-25T13:42:35.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:35 smithi161 ceph-mon[32696]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-04-25T13:42:35.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:35 smithi161 ceph-mon[32696]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-25T13:42:35.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:35 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3713124664' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-25T13:42:35.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:35 smithi161 ceph-mon[32696]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-25T13:42:35.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:35 smithi161 ceph-mon[32696]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T13:42:35.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:35 smithi161 ceph-mon[32696]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-04-25T13:42:35.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:35 smithi161 ceph-mon[32696]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-25T13:42:35.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:35 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1234205424' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T13:42:36.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.138+0000 7fe5ae7fc640 1 -- 172.21.15.43:0/1882970630 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7fe5b40c7c40 con 0x7fe5b8104270 2024-04-25T13:42:36.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.141+0000 7fe5bf8b6640 1 -- 172.21.15.43:0/1882970630 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5a40afaf0 msgr2=0x7fe5a40b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.141+0000 7fe5bf8b6640 1 --2- 172.21.15.43:0/1882970630 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5a40afaf0 0x7fe5a40b2000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe5b819d780 tx=0x7fe5a8005f90 comp rx=0 tx=0).stop 2024-04-25T13:42:36.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.141+0000 7fe5bf8b6640 1 -- 172.21.15.43:0/1882970630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5b8104270 msgr2=0x7fe5b819c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.141+0000 7fe5bf8b6640 1 --2- 172.21.15.43:0/1882970630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5b8104270 0x7fe5b819c6e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4031460 tx=0x7fe5b4004270 comp rx=0 tx=0).stop 2024-04-25T13:42:36.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.141+0000 7fe5bf8b6640 1 -- 172.21.15.43:0/1882970630 shutdown_connections 2024-04-25T13:42:36.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.141+0000 7fe5bf8b6640 1 --2- 172.21.15.43:0/1882970630 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe5a40afaf0 0x7fe5a40b2000 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.141+0000 7fe5bf8b6640 1 --2- 172.21.15.43:0/1882970630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5b8109770 0x7fe5b81a3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.141+0000 7fe5bf8b6640 1 --2- 172.21.15.43:0/1882970630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5b8106c60 0x7fe5b819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.141+0000 7fe5bf8b6640 1 --2- 172.21.15.43:0/1882970630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5b8104270 0x7fe5b819c6e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.141+0000 7fe5bf8b6640 1 -- 172.21.15.43:0/1882970630 >> 172.21.15.43:0/1882970630 conn(0x7fe5b80fdbd0 msgr2=0x7fe5b8102380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:36.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.141+0000 7fe5bf8b6640 1 -- 172.21.15.43:0/1882970630 shutdown_connections 2024-04-25T13:42:36.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.141+0000 7fe5bf8b6640 1 -- 172.21.15.43:0/1882970630 wait complete. 2024-04-25T13:42:36.156 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-04-25T13:42:36.156 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-04-25T13:42:36.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.277+0000 7f45ce36c640 1 -- 172.21.15.43:0/4111048809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45c8104d30 msgr2=0x7f45c8105140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.277+0000 7f45ce36c640 1 --2- 172.21.15.43:0/4111048809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45c8104d30 0x7f45c8105140 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009900 tx=0x7f45bc02a410 comp rx=0 tx=0).stop 2024-04-25T13:42:36.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.277+0000 7f45ce36c640 1 -- 172.21.15.43:0/4111048809 shutdown_connections 2024-04-25T13:42:36.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.277+0000 7f45ce36c640 1 --2- 172.21.15.43:0/4111048809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45c8109a30 0x7f45c810be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.278+0000 7f45ce36c640 1 --2- 172.21.15.43:0/4111048809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45c8104d30 0x7f45c8105140 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.278+0000 7f45ce36c640 1 --2- 172.21.15.43:0/4111048809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c8103af0 0x7f45c81047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.278+0000 7f45ce36c640 1 -- 172.21.15.43:0/4111048809 >> 172.21.15.43:0/4111048809 conn(0x7f45c80fece0 msgr2=0x7f45c8101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:36.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.278+0000 7f45ce36c640 1 -- 172.21.15.43:0/4111048809 shutdown_connections 2024-04-25T13:42:36.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.278+0000 7f45ce36c640 1 -- 172.21.15.43:0/4111048809 wait complete. 2024-04-25T13:42:36.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.278+0000 7f45ce36c640 1 Processor -- start 2024-04-25T13:42:36.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.278+0000 7f45ce36c640 1 -- start start 2024-04-25T13:42:36.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45ce36c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45c8103af0 0x7f45c819a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45ce36c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45c8104d30 0x7f45c819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45ce36c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c8109a30 0x7f45c81a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45ce36c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f45c810f4a0 con 0x7f45c8104d30 2024-04-25T13:42:36.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45ce36c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f45c810f320 con 0x7f45c8103af0 2024-04-25T13:42:36.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45ce36c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f45c810f620 con 0x7f45c8109a30 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45c77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45c8104d30 0x7f45c819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45c77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45c8104d30 0x7f45c819a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44054/0 (socket says 172.21.15.43:44054) 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45c77fe640 1 -- 172.21.15.43:0/1850124439 learned_addr learned my addr 172.21.15.43:0/1850124439 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45c7fff640 1 --2- 172.21.15.43:0/1850124439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45c8103af0 0x7f45c819a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45cc909640 1 --2- 172.21.15.43:0/1850124439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c8109a30 0x7f45c81a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45c77fe640 1 -- 172.21.15.43:0/1850124439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c8109a30 msgr2=0x7f45c81a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45c77fe640 1 --2- 172.21.15.43:0/1850124439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c8109a30 0x7f45c81a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45c77fe640 1 -- 172.21.15.43:0/1850124439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45c8103af0 msgr2=0x7f45c819a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45c77fe640 1 --2- 172.21.15.43:0/1850124439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45c8103af0 0x7f45c819a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45c77fe640 1 -- 172.21.15.43:0/1850124439 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c81a1c80 con 0x7f45c8104d30 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45cc909640 1 --2- 172.21.15.43:0/1850124439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c8109a30 0x7f45c81a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45c77fe640 1 --2- 172.21.15.43:0/1850124439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45c8104d30 0x7f45c819a680 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009230 tx=0x7f45bc0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.279+0000 7f45c57fa640 1 -- 172.21.15.43:0/1850124439 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc03f030 con 0x7f45c8104d30 2024-04-25T13:42:36.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.280+0000 7f45ce36c640 1 -- 172.21.15.43:0/1850124439 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c81a1f10 con 0x7f45c8104d30 2024-04-25T13:42:36.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.280+0000 7f45c57fa640 1 -- 172.21.15.43:0/1850124439 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45bc0044c0 con 0x7f45c8104d30 2024-04-25T13:42:36.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.280+0000 7f45c57fa640 1 -- 172.21.15.43:0/1850124439 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc035070 con 0x7f45c8104d30 2024-04-25T13:42:36.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.280+0000 7f45ce36c640 1 -- 172.21.15.43:0/1850124439 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c81a2320 con 0x7f45c8104d30 2024-04-25T13:42:36.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.281+0000 7f45ce36c640 1 -- 172.21.15.43:0/1850124439 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c8108840 con 0x7f45c8104d30 2024-04-25T13:42:36.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.282+0000 7f45c57fa640 1 -- 172.21.15.43:0/1850124439 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f45bc042030 con 0x7f45c8104d30 2024-04-25T13:42:36.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.283+0000 7f45c57fa640 1 --2- 172.21.15.43:0/1850124439 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f45b00afaf0 0x7f45b00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.283+0000 7f45c7fff640 1 --2- 172.21.15.43:0/1850124439 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f45b00afaf0 0x7f45b00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.283+0000 7f45c57fa640 1 -- 172.21.15.43:0/1850124439 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f45bc0ff850 con 0x7f45c8104d30 2024-04-25T13:42:36.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.283+0000 7f45c7fff640 1 --2- 172.21.15.43:0/1850124439 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f45b00afaf0 0x7f45b00b2000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f45c81046f0 tx=0x7f45b800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:36.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.287+0000 7f45c57fa640 1 -- 172.21.15.43:0/1850124439 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f45bc0c8190 con 0x7f45c8104d30 2024-04-25T13:42:36.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:36 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1234205424' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-25T13:42:36.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:36 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] up:active 2024-04-25T13:42:36.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:36 smithi175 ceph-mon[32649]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-25T13:42:36.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:36 smithi175 ceph-mon[32649]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-25T13:42:36.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:36 smithi175 ceph-mon[32649]: Cluster is now healthy 2024-04-25T13:42:36.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:36 smithi175 ceph-mon[32649]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-04-25T13:42:36.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:36 smithi175 ceph-mon[32649]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-04-25T13:42:36.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:36 smithi175 ceph-mon[32649]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-25T13:42:36.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:36 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1882970630' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-25T13:42:36.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:36 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1234205424' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-25T13:42:36.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:36 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] up:active 2024-04-25T13:42:36.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:36 smithi043 ceph-mon[29195]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-25T13:42:36.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:36 smithi043 ceph-mon[29195]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-25T13:42:36.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:36 smithi043 ceph-mon[29195]: Cluster is now healthy 2024-04-25T13:42:36.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:36 smithi043 ceph-mon[29195]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-04-25T13:42:36.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:36 smithi043 ceph-mon[29195]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-04-25T13:42:36.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:36 smithi043 ceph-mon[29195]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-25T13:42:36.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:36 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1882970630' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-25T13:42:36.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.499+0000 7f45ce36c640 1 -- 172.21.15.43:0/1850124439 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f45c8062fe0 con 0x7f45b00afaf0 2024-04-25T13:42:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.523+0000 7f45c57fa640 1 -- 172.21.15.43:0/1850124439 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f45c8062fe0 con 0x7f45b00afaf0 2024-04-25T13:42:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.525+0000 7f45ce36c640 1 -- 172.21.15.43:0/1850124439 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f45b00afaf0 msgr2=0x7f45b00b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.525+0000 7f45ce36c640 1 --2- 172.21.15.43:0/1850124439 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f45b00afaf0 0x7f45b00b2000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f45c81046f0 tx=0x7f45b800b390 comp rx=0 tx=0).stop 2024-04-25T13:42:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.525+0000 7f45ce36c640 1 -- 172.21.15.43:0/1850124439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45c8104d30 msgr2=0x7f45c819a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.525+0000 7f45ce36c640 1 --2- 172.21.15.43:0/1850124439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45c8104d30 0x7f45c819a680 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009230 tx=0x7f45bc0040c0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.526+0000 7f45ce36c640 1 -- 172.21.15.43:0/1850124439 shutdown_connections 2024-04-25T13:42:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.526+0000 7f45ce36c640 1 --2- 172.21.15.43:0/1850124439 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f45b00afaf0 0x7f45b00b2000 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.526+0000 7f45ce36c640 1 --2- 172.21.15.43:0/1850124439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c8109a30 0x7f45c81a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.526+0000 7f45ce36c640 1 --2- 172.21.15.43:0/1850124439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45c8104d30 0x7f45c819a680 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.526+0000 7f45ce36c640 1 --2- 172.21.15.43:0/1850124439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45c8103af0 0x7f45c819a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.526+0000 7f45ce36c640 1 -- 172.21.15.43:0/1850124439 >> 172.21.15.43:0/1850124439 conn(0x7f45c80fece0 msgr2=0x7f45c8105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:36.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.526+0000 7f45ce36c640 1 -- 172.21.15.43:0/1850124439 shutdown_connections 2024-04-25T13:42:36.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.526+0000 7f45ce36c640 1 -- 172.21.15.43:0/1850124439 wait complete. 2024-04-25T13:42:36.537 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-04-25T13:42:36.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:36 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1234205424' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-25T13:42:36.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:36 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] up:active 2024-04-25T13:42:36.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:36 smithi161 ceph-mon[32696]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-25T13:42:36.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:36 smithi161 ceph-mon[32696]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-25T13:42:36.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:36 smithi161 ceph-mon[32696]: Cluster is now healthy 2024-04-25T13:42:36.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:36 smithi161 ceph-mon[32696]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-04-25T13:42:36.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:36 smithi161 ceph-mon[32696]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-04-25T13:42:36.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:36 smithi161 ceph-mon[32696]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-25T13:42:36.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:36 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1882970630' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-25T13:42:36.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.654+0000 7f998581e640 1 -- 172.21.15.43:0/1407477924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9980108920 msgr2=0x7f998010ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.654+0000 7f998581e640 1 --2- 172.21.15.43:0/1407477924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9980108920 0x7f998010ad40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9978009ca0 tx=0x7f997802a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.654+0000 7f998581e640 1 -- 172.21.15.43:0/1407477924 shutdown_connections 2024-04-25T13:42:36.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.654+0000 7f998581e640 1 --2- 172.21.15.43:0/1407477924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9980108920 0x7f998010ad40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.654+0000 7f998581e640 1 --2- 172.21.15.43:0/1407477924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9980103c20 0x7f9980104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.654+0000 7f998581e640 1 --2- 172.21.15.43:0/1407477924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99801029e0 0x7f99801036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.654+0000 7f998581e640 1 -- 172.21.15.43:0/1407477924 >> 172.21.15.43:0/1407477924 conn(0x7f99800fdbd0 msgr2=0x7f9980100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.654+0000 7f998581e640 1 -- 172.21.15.43:0/1407477924 shutdown_connections 2024-04-25T13:42:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.654+0000 7f998581e640 1 -- 172.21.15.43:0/1407477924 wait complete. 2024-04-25T13:42:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f998581e640 1 Processor -- start 2024-04-25T13:42:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f998581e640 1 -- start start 2024-04-25T13:42:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f998581e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99801029e0 0x7f9980075860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f998581e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9980103c20 0x7f998019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f998581e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9980108920 0x7f99801a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f998581e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f998010e3f0 con 0x7f9980108920 2024-04-25T13:42:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f998581e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f998010e270 con 0x7f99801029e0 2024-04-25T13:42:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f998581e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f998010e570 con 0x7f9980103c20 2024-04-25T13:42:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f997f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9980108920 0x7f99801a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f997f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9980108920 0x7f99801a1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44110/0 (socket says 172.21.15.43:44110) 2024-04-25T13:42:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f997f7fe640 1 -- 172.21.15.43:0/1434394484 learned_addr learned my addr 172.21.15.43:0/1434394484 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f997effd640 1 --2- 172.21.15.43:0/1434394484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99801029e0 0x7f9980075860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f9977fff640 1 --2- 172.21.15.43:0/1434394484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9980103c20 0x7f998019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f997f7fe640 1 -- 172.21.15.43:0/1434394484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9980103c20 msgr2=0x7f998019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f997f7fe640 1 --2- 172.21.15.43:0/1434394484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9980103c20 0x7f998019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f997f7fe640 1 -- 172.21.15.43:0/1434394484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99801029e0 msgr2=0x7f9980075860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f997f7fe640 1 --2- 172.21.15.43:0/1434394484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99801029e0 0x7f9980075860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.655+0000 7f997f7fe640 1 -- 172.21.15.43:0/1434394484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99801a1ca0 con 0x7f9980108920 2024-04-25T13:42:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.656+0000 7f997f7fe640 1 --2- 172.21.15.43:0/1434394484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9980108920 0x7f99801a1480 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f997802aeb0 tx=0x7f9978003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.656+0000 7f998481c640 1 -- 172.21.15.43:0/1434394484 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978003d60 con 0x7f9980108920 2024-04-25T13:42:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.656+0000 7f998481c640 1 -- 172.21.15.43:0/1434394484 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99780044d0 con 0x7f9980108920 2024-04-25T13:42:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.656+0000 7f998481c640 1 -- 172.21.15.43:0/1434394484 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978030b50 con 0x7f9980108920 2024-04-25T13:42:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.656+0000 7f998581e640 1 -- 172.21.15.43:0/1434394484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99801a1f30 con 0x7f9980108920 2024-04-25T13:42:36.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.656+0000 7f998581e640 1 -- 172.21.15.43:0/1434394484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99801a2390 con 0x7f9980108920 2024-04-25T13:42:36.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.657+0000 7f998581e640 1 -- 172.21.15.43:0/1434394484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f998006a160 con 0x7f9980108920 2024-04-25T13:42:36.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.658+0000 7f998481c640 1 -- 172.21.15.43:0/1434394484 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f9978030d10 con 0x7f9980108920 2024-04-25T13:42:36.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.659+0000 7f998481c640 1 --2- 172.21.15.43:0/1434394484 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f996c0afaf0 0x7f996c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.659+0000 7f997effd640 1 --2- 172.21.15.43:0/1434394484 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f996c0afaf0 0x7f996c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.659+0000 7f998481c640 1 -- 172.21.15.43:0/1434394484 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f99781004d0 con 0x7f9980108920 2024-04-25T13:42:36.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.660+0000 7f997effd640 1 --2- 172.21.15.43:0/1434394484 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f996c0afaf0 0x7f996c0b2000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9970005fd0 tx=0x7f997000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:36.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.663+0000 7f998481c640 1 -- 172.21.15.43:0/1434394484 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f99780c8e10 con 0x7f9980108920 2024-04-25T13:42:36.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.877+0000 7f998581e640 1 -- 172.21.15.43:0/1434394484 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f9980062fe0 con 0x7f996c0afaf0 2024-04-25T13:42:36.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.902+0000 7f998481c640 1 -- 172.21.15.43:0/1434394484 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9980062fe0 con 0x7f996c0afaf0 2024-04-25T13:42:36.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.903+0000 7f998581e640 1 -- 172.21.15.43:0/1434394484 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f996c0afaf0 msgr2=0x7f996c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.903+0000 7f998581e640 1 --2- 172.21.15.43:0/1434394484 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f996c0afaf0 0x7f996c0b2000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9970005fd0 tx=0x7f997000b410 comp rx=0 tx=0).stop 2024-04-25T13:42:36.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.903+0000 7f998581e640 1 -- 172.21.15.43:0/1434394484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9980108920 msgr2=0x7f99801a1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.903+0000 7f998581e640 1 --2- 172.21.15.43:0/1434394484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9980108920 0x7f99801a1480 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f997802aeb0 tx=0x7f9978003970 comp rx=0 tx=0).stop 2024-04-25T13:42:36.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.904+0000 7f998581e640 1 -- 172.21.15.43:0/1434394484 shutdown_connections 2024-04-25T13:42:36.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.904+0000 7f998581e640 1 --2- 172.21.15.43:0/1434394484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9980108920 0x7f99801a1480 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.904+0000 7f998581e640 1 --2- 172.21.15.43:0/1434394484 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f996c0afaf0 0x7f996c0b2000 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.904+0000 7f998581e640 1 --2- 172.21.15.43:0/1434394484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9980103c20 0x7f998019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.904+0000 7f998581e640 1 --2- 172.21.15.43:0/1434394484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99801029e0 0x7f9980075860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.904+0000 7f998581e640 1 -- 172.21.15.43:0/1434394484 >> 172.21.15.43:0/1434394484 conn(0x7f99800fdbd0 msgr2=0x7f9980104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:36.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.904+0000 7f998581e640 1 -- 172.21.15.43:0/1434394484 shutdown_connections 2024-04-25T13:42:36.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:36.904+0000 7f998581e640 1 -- 172.21.15.43:0/1434394484 wait complete. 2024-04-25T13:42:36.914 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:42:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:42:36.504+0000 7f6257ce6700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:42:36.914 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:42:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:42:36.504+0000 7f6257ce6700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:42:36.914 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:42:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:42:36.504+0000 7f6257ce6700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:42:36.914 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:42:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:42:36.504+0000 7f6257ce6700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:42:36.914 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:42:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:42:36.504+0000 7f6257ce6700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:42:36.915 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-04-25T13:42:37.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.033+0000 7f89d5e61640 1 -- 172.21.15.43:0/1450501543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89d0109890 msgr2=0x7f89d010bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.033+0000 7f89d5e61640 1 --2- 172.21.15.43:0/1450501543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89d0109890 0x7f89d010bcb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009ca0 tx=0x7f89c802a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.033+0000 7f89d5e61640 1 -- 172.21.15.43:0/1450501543 shutdown_connections 2024-04-25T13:42:37.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.033+0000 7f89d5e61640 1 --2- 172.21.15.43:0/1450501543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89d0109890 0x7f89d010bcb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.033+0000 7f89d5e61640 1 --2- 172.21.15.43:0/1450501543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89d0106f30 0x7f89d0109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.033+0000 7f89d5e61640 1 --2- 172.21.15.43:0/1450501543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89d01045d0 0x7f89d01069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.033+0000 7f89d5e61640 1 -- 172.21.15.43:0/1450501543 >> 172.21.15.43:0/1450501543 conn(0x7f89d00fdbd0 msgr2=0x7f89d0100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:37.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.033+0000 7f89d5e61640 1 -- 172.21.15.43:0/1450501543 shutdown_connections 2024-04-25T13:42:37.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.033+0000 7f89d5e61640 1 -- 172.21.15.43:0/1450501543 wait complete. 2024-04-25T13:42:37.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.033+0000 7f89d5e61640 1 Processor -- start 2024-04-25T13:42:37.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89d5e61640 1 -- start start 2024-04-25T13:42:37.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89d5e61640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89d01045d0 0x7f89d019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89d5e61640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89d0106f30 0x7f89d019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89d5e61640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89d0109890 0x7f89d01a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89d5e61640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f89d010f510 con 0x7f89d0106f30 2024-04-25T13:42:37.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89d5e61640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f89d010f390 con 0x7f89d0109890 2024-04-25T13:42:37.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89d5e61640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f89d010f690 con 0x7f89d01045d0 2024-04-25T13:42:37.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89ceffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89d0106f30 0x7f89d019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89ceffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89d0106f30 0x7f89d019a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44134/0 (socket says 172.21.15.43:44134) 2024-04-25T13:42:37.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89ceffd640 1 -- 172.21.15.43:0/401267252 learned_addr learned my addr 172.21.15.43:0/401267252 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:37.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89cffff640 1 --2- 172.21.15.43:0/401267252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89d0109890 0x7f89d01a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89cf7fe640 1 --2- 172.21.15.43:0/401267252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89d01045d0 0x7f89d019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89ceffd640 1 -- 172.21.15.43:0/401267252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89d01045d0 msgr2=0x7f89d019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89ceffd640 1 --2- 172.21.15.43:0/401267252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89d01045d0 0x7f89d019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89ceffd640 1 -- 172.21.15.43:0/401267252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89d0109890 msgr2=0x7f89d01a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89ceffd640 1 --2- 172.21.15.43:0/401267252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89d0109890 0x7f89d01a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89ceffd640 1 -- 172.21.15.43:0/401267252 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d01a1f90 con 0x7f89d0106f30 2024-04-25T13:42:37.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89cf7fe640 1 --2- 172.21.15.43:0/401267252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89d01045d0 0x7f89d019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:37.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.034+0000 7f89ceffd640 1 --2- 172.21.15.43:0/401267252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89d0106f30 0x7f89d019a990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f89c400e9f0 tx=0x7f89c400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:37.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.035+0000 7f89ccff9640 1 -- 172.21.15.43:0/401267252 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c400cd80 con 0x7f89d0106f30 2024-04-25T13:42:37.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.035+0000 7f89ccff9640 1 -- 172.21.15.43:0/401267252 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89c40108c0 con 0x7f89d0106f30 2024-04-25T13:42:37.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.035+0000 7f89d5e61640 1 -- 172.21.15.43:0/401267252 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d01a2280 con 0x7f89d0106f30 2024-04-25T13:42:37.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.035+0000 7f89ccff9640 1 -- 172.21.15.43:0/401267252 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c40187c0 con 0x7f89d0106f30 2024-04-25T13:42:37.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.035+0000 7f89d5e61640 1 -- 172.21.15.43:0/401267252 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d01a27d0 con 0x7f89d0106f30 2024-04-25T13:42:37.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.036+0000 7f89d5e61640 1 -- 172.21.15.43:0/401267252 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d006c2a0 con 0x7f89d0106f30 2024-04-25T13:42:37.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.038+0000 7f89ccff9640 1 -- 172.21.15.43:0/401267252 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f89c4010430 con 0x7f89d0106f30 2024-04-25T13:42:37.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.039+0000 7f89ccff9640 1 --2- 172.21.15.43:0/401267252 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f89b80afaf0 0x7f89b80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.039+0000 7f89cf7fe640 1 --2- 172.21.15.43:0/401267252 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f89b80afaf0 0x7f89b80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.039+0000 7f89ccff9640 1 -- 172.21.15.43:0/401267252 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f89c40df730 con 0x7f89d0106f30 2024-04-25T13:42:37.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.039+0000 7f89cf7fe640 1 --2- 172.21.15.43:0/401267252 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f89b80afaf0 0x7f89b80b2000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f89c00058c0 tx=0x7f89c0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:37.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.043+0000 7f89ccff9640 1 -- 172.21.15.43:0/401267252 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f89c40a80d0 con 0x7f89d0106f30 2024-04-25T13:42:37.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:37 smithi043 ceph-mon[29195]: pgmap v299: 129 pgs: 129 active+clean; 582 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 1 op/s 2024-04-25T13:42:37.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:37 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1882970630' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-25T13:42:37.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:37 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] up:active 2024-04-25T13:42:37.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:37 smithi043 ceph-mon[29195]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-04-25T13:42:37.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:37 smithi043 ceph-mon[29195]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:42:37.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:37 smithi043 ceph-mon[29195]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:42:37.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.266+0000 7f89d5e61640 1 -- 172.21.15.43:0/401267252 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f89d01065f0 con 0x7f89b80afaf0 2024-04-25T13:42:37.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.273+0000 7f89ccff9640 1 -- 172.21.15.43:0/401267252 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f89d01065f0 con 0x7f89b80afaf0 2024-04-25T13:42:37.273 INFO:teuthology.orchestra.run.smithi043.stdout:/volumes/qa/sv_0/371af08e-2f1d-4778-ac3f-dad01340feec 2024-04-25T13:42:37.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.275+0000 7f89d5e61640 1 -- 172.21.15.43:0/401267252 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f89b80afaf0 msgr2=0x7f89b80b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.275+0000 7f89d5e61640 1 --2- 172.21.15.43:0/401267252 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f89b80afaf0 0x7f89b80b2000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f89c00058c0 tx=0x7f89c0005850 comp rx=0 tx=0).stop 2024-04-25T13:42:37.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.275+0000 7f89d5e61640 1 -- 172.21.15.43:0/401267252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89d0106f30 msgr2=0x7f89d019a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.275+0000 7f89d5e61640 1 --2- 172.21.15.43:0/401267252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89d0106f30 0x7f89d019a990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f89c400e9f0 tx=0x7f89c400eeb0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.275+0000 7f89d5e61640 1 -- 172.21.15.43:0/401267252 shutdown_connections 2024-04-25T13:42:37.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.275+0000 7f89d5e61640 1 --2- 172.21.15.43:0/401267252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89d0109890 0x7f89d01a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.275+0000 7f89d5e61640 1 --2- 172.21.15.43:0/401267252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89d0106f30 0x7f89d019a990 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.275+0000 7f89d5e61640 1 --2- 172.21.15.43:0/401267252 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f89b80afaf0 0x7f89b80b2000 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.275+0000 7f89d5e61640 1 --2- 172.21.15.43:0/401267252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89d01045d0 0x7f89d019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.275+0000 7f89d5e61640 1 -- 172.21.15.43:0/401267252 >> 172.21.15.43:0/401267252 conn(0x7f89d00fdbd0 msgr2=0x7f89d0105ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:37.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.275+0000 7f89d5e61640 1 -- 172.21.15.43:0/401267252 shutdown_connections 2024-04-25T13:42:37.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.275+0000 7f89d5e61640 1 -- 172.21.15.43:0/401267252 wait complete. 2024-04-25T13:42:37.286 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-04-25T13:42:37.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.402+0000 7f94dca92640 1 -- 172.21.15.43:0/1649352328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94d8108930 msgr2=0x7f94d810ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.402+0000 7f94dca92640 1 --2- 172.21.15.43:0/1649352328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94d8108930 0x7f94d810ad50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009ca0 tx=0x7f94d002a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.403+0000 7f94dca92640 1 -- 172.21.15.43:0/1649352328 shutdown_connections 2024-04-25T13:42:37.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.403+0000 7f94dca92640 1 --2- 172.21.15.43:0/1649352328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94d8108930 0x7f94d810ad50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.403+0000 7f94dca92640 1 --2- 172.21.15.43:0/1649352328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d8103c30 0x7f94d8104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.403+0000 7f94dca92640 1 --2- 172.21.15.43:0/1649352328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94d81029f0 0x7f94d81036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.403+0000 7f94dca92640 1 -- 172.21.15.43:0/1649352328 >> 172.21.15.43:0/1649352328 conn(0x7f94d80fdbc0 msgr2=0x7f94d8100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:37.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.403+0000 7f94dca92640 1 -- 172.21.15.43:0/1649352328 shutdown_connections 2024-04-25T13:42:37.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.403+0000 7f94dca92640 1 -- 172.21.15.43:0/1649352328 wait complete. 2024-04-25T13:42:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.403+0000 7f94dca92640 1 Processor -- start 2024-04-25T13:42:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94dca92640 1 -- start start 2024-04-25T13:42:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94dca92640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d81029f0 0x7f94d819a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94dca92640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94d8103c30 0x7f94d819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94dca92640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94d8108930 0x7f94d81a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94dca92640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f94d810f530 con 0x7f94d8108930 2024-04-25T13:42:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94dca92640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f94d810f3b0 con 0x7f94d8103c30 2024-04-25T13:42:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94dca92640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f94d810f6b0 con 0x7f94d81029f0 2024-04-25T13:42:37.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94d6d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94d8108930 0x7f94d81a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94d6d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94d8108930 0x7f94d81a1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44158/0 (socket says 172.21.15.43:44158) 2024-04-25T13:42:37.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94d6d9d640 1 -- 172.21.15.43:0/4176323469 learned_addr learned my addr 172.21.15.43:0/4176323469 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:37.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94d5d9b640 1 --2- 172.21.15.43:0/4176323469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94d8103c30 0x7f94d819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94d659c640 1 --2- 172.21.15.43:0/4176323469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d81029f0 0x7f94d819a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94d6d9d640 1 -- 172.21.15.43:0/4176323469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d81029f0 msgr2=0x7f94d819a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94d6d9d640 1 --2- 172.21.15.43:0/4176323469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d81029f0 0x7f94d819a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94d6d9d640 1 -- 172.21.15.43:0/4176323469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94d8103c30 msgr2=0x7f94d819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94d6d9d640 1 --2- 172.21.15.43:0/4176323469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94d8103c30 0x7f94d819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94d6d9d640 1 -- 172.21.15.43:0/4176323469 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d81a1b50 con 0x7f94d8108930 2024-04-25T13:42:37.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.404+0000 7f94d6d9d640 1 --2- 172.21.15.43:0/4176323469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94d8108930 0x7f94d81a1590 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f94d0031040 tx=0x7f94d0003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:37.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.405+0000 7f94c77fe640 1 -- 172.21.15.43:0/4176323469 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0004240 con 0x7f94d8108930 2024-04-25T13:42:37.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.405+0000 7f94dca92640 1 -- 172.21.15.43:0/4176323469 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d81a1de0 con 0x7f94d8108930 2024-04-25T13:42:37.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.405+0000 7f94c77fe640 1 -- 172.21.15.43:0/4176323469 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94d0003e50 con 0x7f94d8108930 2024-04-25T13:42:37.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.405+0000 7f94c77fe640 1 -- 172.21.15.43:0/4176323469 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d003c410 con 0x7f94d8108930 2024-04-25T13:42:37.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.405+0000 7f94dca92640 1 -- 172.21.15.43:0/4176323469 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d81a2240 con 0x7f94d8108930 2024-04-25T13:42:37.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.406+0000 7f94dca92640 1 -- 172.21.15.43:0/4176323469 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d806a190 con 0x7f94d8108930 2024-04-25T13:42:37.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.407+0000 7f94c77fe640 1 -- 172.21.15.43:0/4176323469 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f94d00306e0 con 0x7f94d8108930 2024-04-25T13:42:37.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.408+0000 7f94c77fe640 1 --2- 172.21.15.43:0/4176323469 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f94c00afaf0 0x7f94c00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.408+0000 7f94d659c640 1 --2- 172.21.15.43:0/4176323469 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f94c00afaf0 0x7f94c00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.408+0000 7f94c77fe640 1 -- 172.21.15.43:0/4176323469 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f94d0100750 con 0x7f94d8108930 2024-04-25T13:42:37.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.408+0000 7f94d659c640 1 --2- 172.21.15.43:0/4176323469 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f94c00afaf0 0x7f94c00b2000 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f94c80058c0 tx=0x7f94c8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:37.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.411+0000 7f94c77fe640 1 -- 172.21.15.43:0/4176323469 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f94d806a190 con 0x7f94d8108930 2024-04-25T13:42:37.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:37 smithi175 ceph-mon[32649]: pgmap v299: 129 pgs: 129 active+clean; 582 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 1 op/s 2024-04-25T13:42:37.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:37 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1882970630' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-25T13:42:37.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:37 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] up:active 2024-04-25T13:42:37.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:37 smithi175 ceph-mon[32649]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-04-25T13:42:37.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:37 smithi175 ceph-mon[32649]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:42:37.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:37 smithi175 ceph-mon[32649]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:42:37.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:37 smithi161 ceph-mon[32696]: pgmap v299: 129 pgs: 129 active+clean; 582 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 1 op/s 2024-04-25T13:42:37.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:37 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1882970630' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-25T13:42:37.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:37 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] up:active 2024-04-25T13:42:37.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:37 smithi161 ceph-mon[32696]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-04-25T13:42:37.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:37 smithi161 ceph-mon[32696]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:42:37.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:37 smithi161 ceph-mon[32696]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:42:37.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.628+0000 7f94dca92640 1 -- 172.21.15.43:0/4176323469 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f94d8062fe0 con 0x7f94c00afaf0 2024-04-25T13:42:37.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.654+0000 7f94c77fe640 1 -- 172.21.15.43:0/4176323469 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f94d8062fe0 con 0x7f94c00afaf0 2024-04-25T13:42:37.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.656+0000 7f94dca92640 1 -- 172.21.15.43:0/4176323469 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f94c00afaf0 msgr2=0x7f94c00b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.656+0000 7f94dca92640 1 --2- 172.21.15.43:0/4176323469 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f94c00afaf0 0x7f94c00b2000 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f94c80058c0 tx=0x7f94c8005850 comp rx=0 tx=0).stop 2024-04-25T13:42:37.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.656+0000 7f94dca92640 1 -- 172.21.15.43:0/4176323469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94d8108930 msgr2=0x7f94d81a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.656+0000 7f94dca92640 1 --2- 172.21.15.43:0/4176323469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94d8108930 0x7f94d81a1590 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f94d0031040 tx=0x7f94d0003ce0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.656+0000 7f94dca92640 1 -- 172.21.15.43:0/4176323469 shutdown_connections 2024-04-25T13:42:37.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.656+0000 7f94dca92640 1 --2- 172.21.15.43:0/4176323469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94d8108930 0x7f94d81a1590 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.656+0000 7f94dca92640 1 --2- 172.21.15.43:0/4176323469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94d8103c30 0x7f94d819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.656+0000 7f94dca92640 1 --2- 172.21.15.43:0/4176323469 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f94c00afaf0 0x7f94c00b2000 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.656+0000 7f94dca92640 1 --2- 172.21.15.43:0/4176323469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d81029f0 0x7f94d819a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.656+0000 7f94dca92640 1 -- 172.21.15.43:0/4176323469 >> 172.21.15.43:0/4176323469 conn(0x7f94d80fdbc0 msgr2=0x7f94d8104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:37.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.656+0000 7f94dca92640 1 -- 172.21.15.43:0/4176323469 shutdown_connections 2024-04-25T13:42:37.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.656+0000 7f94dca92640 1 -- 172.21.15.43:0/4176323469 wait complete. 2024-04-25T13:42:37.668 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-04-25T13:42:37.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.784+0000 7f3e5498f640 1 -- 172.21.15.43:0/637759972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e50108940 msgr2=0x7f3e5010ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.784+0000 7f3e5498f640 1 --2- 172.21.15.43:0/637759972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e50108940 0x7f3e5010ad60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009ca0 tx=0x7f3e4802a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.784+0000 7f3e5498f640 1 -- 172.21.15.43:0/637759972 shutdown_connections 2024-04-25T13:42:37.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.784+0000 7f3e5498f640 1 --2- 172.21.15.43:0/637759972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e50108940 0x7f3e5010ad60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.784+0000 7f3e5498f640 1 --2- 172.21.15.43:0/637759972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e50103c40 0x7f3e50104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.784+0000 7f3e5498f640 1 --2- 172.21.15.43:0/637759972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e50102a00 0x7f3e50103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.784+0000 7f3e5498f640 1 -- 172.21.15.43:0/637759972 >> 172.21.15.43:0/637759972 conn(0x7f3e500fdbf0 msgr2=0x7f3e501000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:37.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.784+0000 7f3e5498f640 1 -- 172.21.15.43:0/637759972 shutdown_connections 2024-04-25T13:42:37.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.784+0000 7f3e5498f640 1 -- 172.21.15.43:0/637759972 wait complete. 2024-04-25T13:42:37.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.785+0000 7f3e5498f640 1 Processor -- start 2024-04-25T13:42:37.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.785+0000 7f3e5498f640 1 -- start start 2024-04-25T13:42:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.785+0000 7f3e5498f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e50102a00 0x7f3e5019c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.785+0000 7f3e5498f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e50103c40 0x7f3e5019c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.785+0000 7f3e5498f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e50108940 0x7f3e501a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.785+0000 7f3e5498f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5010e410 con 0x7f3e50108940 2024-04-25T13:42:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.785+0000 7f3e5498f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5010e290 con 0x7f3e50103c40 2024-04-25T13:42:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.785+0000 7f3e5498f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5010e590 con 0x7f3e50102a00 2024-04-25T13:42:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.786+0000 7f3e4ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e50108940 0x7f3e501a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.786+0000 7f3e4ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e50108940 0x7f3e501a3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44184/0 (socket says 172.21.15.43:44184) 2024-04-25T13:42:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.786+0000 7f3e4ed9d640 1 -- 172.21.15.43:0/1224285040 learned_addr learned my addr 172.21.15.43:0/1224285040 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.786+0000 7f3e47fff640 1 --2- 172.21.15.43:0/1224285040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e50103c40 0x7f3e5019c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.786+0000 7f3e4e59c640 1 --2- 172.21.15.43:0/1224285040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e50102a00 0x7f3e5019c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.786+0000 7f3e4ed9d640 1 -- 172.21.15.43:0/1224285040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e50102a00 msgr2=0x7f3e5019c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.786+0000 7f3e4ed9d640 1 --2- 172.21.15.43:0/1224285040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e50102a00 0x7f3e5019c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.786+0000 7f3e4ed9d640 1 -- 172.21.15.43:0/1224285040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e50103c40 msgr2=0x7f3e5019c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.786+0000 7f3e4ed9d640 1 --2- 172.21.15.43:0/1224285040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e50103c40 0x7f3e5019c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.786+0000 7f3e4ed9d640 1 -- 172.21.15.43:0/1224285040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e501a3e80 con 0x7f3e50108940 2024-04-25T13:42:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.786+0000 7f3e47fff640 1 --2- 172.21.15.43:0/1224285040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e50103c40 0x7f3e5019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.786+0000 7f3e4ed9d640 1 --2- 172.21.15.43:0/1224285040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e50108940 0x7f3e501a3810 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3e4802aeb0 tx=0x7f3e48003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.786+0000 7f3e477fe640 1 -- 172.21.15.43:0/1224285040 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48032ed0 con 0x7f3e50108940 2024-04-25T13:42:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.786+0000 7f3e477fe640 1 -- 172.21.15.43:0/1224285040 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e48003e10 con 0x7f3e50108940 2024-04-25T13:42:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.786+0000 7f3e5498f640 1 -- 172.21.15.43:0/1224285040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e501a4110 con 0x7f3e50108940 2024-04-25T13:42:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.786+0000 7f3e477fe640 1 -- 172.21.15.43:0/1224285040 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48030be0 con 0x7f3e50108940 2024-04-25T13:42:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.787+0000 7f3e5498f640 1 -- 172.21.15.43:0/1224285040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e501a4660 con 0x7f3e50108940 2024-04-25T13:42:37.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.787+0000 7f3e5498f640 1 -- 172.21.15.43:0/1224285040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e501a48c0 con 0x7f3e50108940 2024-04-25T13:42:37.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.789+0000 7f3e477fe640 1 -- 172.21.15.43:0/1224285040 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 147520+0+0 (secure 0 0 0) 0x7f3e48004b40 con 0x7f3e50108940 2024-04-25T13:42:37.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.790+0000 7f3e477fe640 1 --2- 172.21.15.43:0/1224285040 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3e3c0afb70 0x7f3e3c0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.790+0000 7f3e4e59c640 1 --2- 172.21.15.43:0/1224285040 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3e3c0afb70 0x7f3e3c0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.790+0000 7f3e477fe640 1 -- 172.21.15.43:0/1224285040 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f3e48100550 con 0x7f3e50108940 2024-04-25T13:42:37.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.790+0000 7f3e4e59c640 1 --2- 172.21.15.43:0/1224285040 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3e3c0afb70 0x7f3e3c0b2080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3e40005fd0 tx=0x7f3e4000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:37.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:37.794+0000 7f3e477fe640 1 -- 172.21.15.43:0/1224285040 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3e480c8e90 con 0x7f3e50108940 2024-04-25T13:42:38.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.011+0000 7f3e5498f640 1 -- 172.21.15.43:0/1224285040 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f3e500754e0 con 0x7f3e3c0afb70 2024-04-25T13:42:38.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.017+0000 7f3e477fe640 1 -- 172.21.15.43:0/1224285040 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f3e500754e0 con 0x7f3e3c0afb70 2024-04-25T13:42:38.017 INFO:teuthology.orchestra.run.smithi043.stdout:/volumes/qa/sv_1/31f7a982-995b-41ca-a31d-c9d509053c8b 2024-04-25T13:42:38.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.019+0000 7f3e5498f640 1 -- 172.21.15.43:0/1224285040 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3e3c0afb70 msgr2=0x7f3e3c0b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.019+0000 7f3e5498f640 1 --2- 172.21.15.43:0/1224285040 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3e3c0afb70 0x7f3e3c0b2080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3e40005fd0 tx=0x7f3e4000b410 comp rx=0 tx=0).stop 2024-04-25T13:42:38.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.019+0000 7f3e5498f640 1 -- 172.21.15.43:0/1224285040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e50108940 msgr2=0x7f3e501a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.019+0000 7f3e5498f640 1 --2- 172.21.15.43:0/1224285040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e50108940 0x7f3e501a3810 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3e4802aeb0 tx=0x7f3e48003c20 comp rx=0 tx=0).stop 2024-04-25T13:42:38.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.019+0000 7f3e5498f640 1 -- 172.21.15.43:0/1224285040 shutdown_connections 2024-04-25T13:42:38.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.019+0000 7f3e5498f640 1 --2- 172.21.15.43:0/1224285040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e50108940 0x7f3e501a3810 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.019+0000 7f3e5498f640 1 --2- 172.21.15.43:0/1224285040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e50103c40 0x7f3e5019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.019+0000 7f3e5498f640 1 --2- 172.21.15.43:0/1224285040 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3e3c0afb70 0x7f3e3c0b2080 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.019+0000 7f3e5498f640 1 --2- 172.21.15.43:0/1224285040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e50102a00 0x7f3e5019c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.019+0000 7f3e5498f640 1 -- 172.21.15.43:0/1224285040 >> 172.21.15.43:0/1224285040 conn(0x7f3e500fdbf0 msgr2=0x7f3e50074dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:38.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.019+0000 7f3e5498f640 1 -- 172.21.15.43:0/1224285040 shutdown_connections 2024-04-25T13:42:38.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.019+0000 7f3e5498f640 1 -- 172.21.15.43:0/1224285040 wait complete. 2024-04-25T13:42:38.031 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:42:38.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.145+0000 7f184ea92640 1 -- 172.21.15.43:0/1458512061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1848109870 msgr2=0x7f184810bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.145+0000 7f184ea92640 1 --2- 172.21.15.43:0/1458512061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1848109870 0x7f184810bc90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1840009ca0 tx=0x7f184002a8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.145+0000 7f184ea92640 1 -- 172.21.15.43:0/1458512061 shutdown_connections 2024-04-25T13:42:38.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.145+0000 7f184ea92640 1 --2- 172.21.15.43:0/1458512061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1848109870 0x7f184810bc90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.145+0000 7f184ea92640 1 --2- 172.21.15.43:0/1458512061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1848106f10 0x7f1848109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.145+0000 7f184ea92640 1 --2- 172.21.15.43:0/1458512061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18481045b0 0x7f18481069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.145+0000 7f184ea92640 1 -- 172.21.15.43:0/1458512061 >> 172.21.15.43:0/1458512061 conn(0x7f18480fdbd0 msgr2=0x7f1848100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:38.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.145+0000 7f184ea92640 1 -- 172.21.15.43:0/1458512061 shutdown_connections 2024-04-25T13:42:38.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.145+0000 7f184ea92640 1 -- 172.21.15.43:0/1458512061 wait complete. 2024-04-25T13:42:38.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.146+0000 7f184ea92640 1 Processor -- start 2024-04-25T13:42:38.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.146+0000 7f184ea92640 1 -- start start 2024-04-25T13:42:38.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f184ea92640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18481045b0 0x7f184819a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f184ea92640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1848106f10 0x7f184819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f184ea92640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1848109870 0x7f18481a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f184ea92640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f184810f4f0 con 0x7f18481045b0 2024-04-25T13:42:38.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f184ea92640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f184810f370 con 0x7f1848109870 2024-04-25T13:42:38.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f184ea92640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f184810f670 con 0x7f1848106f10 2024-04-25T13:42:38.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f184c82e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18481045b0 0x7f184819a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f184c82e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18481045b0 0x7f184819a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44190/0 (socket says 172.21.15.43:44190) 2024-04-25T13:42:38.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f184c82e640 1 -- 172.21.15.43:0/2455919996 learned_addr learned my addr 172.21.15.43:0/2455919996 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:38.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f1847fff640 1 --2- 172.21.15.43:0/2455919996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1848106f10 0x7f184819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f184d02f640 1 --2- 172.21.15.43:0/2455919996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1848109870 0x7f18481a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f184c82e640 1 -- 172.21.15.43:0/2455919996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1848106f10 msgr2=0x7f184819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f184c82e640 1 --2- 172.21.15.43:0/2455919996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1848106f10 0x7f184819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f184c82e640 1 -- 172.21.15.43:0/2455919996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1848109870 msgr2=0x7f18481a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f184c82e640 1 --2- 172.21.15.43:0/2455919996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1848109870 0x7f18481a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f184c82e640 1 -- 172.21.15.43:0/2455919996 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18481a1c10 con 0x7f18481045b0 2024-04-25T13:42:38.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.147+0000 7f184c82e640 1 --2- 172.21.15.43:0/2455919996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18481045b0 0x7f184819a0d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f183c00e9c0 tx=0x7f183c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:38.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.159+0000 7f1845ffb640 1 -- 172.21.15.43:0/2455919996 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c00cd80 con 0x7f18481045b0 2024-04-25T13:42:38.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.159+0000 7f1845ffb640 1 -- 172.21.15.43:0/2455919996 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f183c0054b0 con 0x7f18481045b0 2024-04-25T13:42:38.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.159+0000 7f184ea92640 1 -- 172.21.15.43:0/2455919996 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18481a1f00 con 0x7f18481045b0 2024-04-25T13:42:38.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.160+0000 7f1845ffb640 1 -- 172.21.15.43:0/2455919996 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c010430 con 0x7f18481045b0 2024-04-25T13:42:38.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.160+0000 7f184ea92640 1 -- 172.21.15.43:0/2455919996 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18481a2360 con 0x7f18481045b0 2024-04-25T13:42:38.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.161+0000 7f184ea92640 1 -- 172.21.15.43:0/2455919996 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f184806afa0 con 0x7f18481045b0 2024-04-25T13:42:38.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.162+0000 7f1845ffb640 1 -- 172.21.15.43:0/2455919996 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f183c004f20 con 0x7f18481045b0 2024-04-25T13:42:38.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.163+0000 7f1845ffb640 1 --2- 172.21.15.43:0/2455919996 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f18380afb80 0x7f18380b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.163+0000 7f1847fff640 1 --2- 172.21.15.43:0/2455919996 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f18380afb80 0x7f18380b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.163+0000 7f1845ffb640 1 -- 172.21.15.43:0/2455919996 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f183c0df590 con 0x7f18481045b0 2024-04-25T13:42:38.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.164+0000 7f1847fff640 1 --2- 172.21.15.43:0/2455919996 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f18380afb80 0x7f18380b2090 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f184819b170 tx=0x7f1834005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:38.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.171+0000 7f1845ffb640 1 -- 172.21.15.43:0/2455919996 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f183c0a7dd0 con 0x7f18481045b0 2024-04-25T13:42:38.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:38 smithi161 ceph-mon[32696]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:42:38.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:38 smithi161 ceph-mon[32696]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:42:38.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:38 smithi161 ceph-mon[32696]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:42:38.353 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:42:37 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-b[63120]: 2024-04-25T13:42:37.992+0000 7f77e460e700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-25T13:42:38.353 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:42:37 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-b[63120]: 2024-04-25T13:42:37.992+0000 7f77e460e700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-25T13:42:38.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.398+0000 7f184ea92640 1 -- 172.21.15.43:0/2455919996 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f184802dc10 con 0x7f18481045b0 2024-04-25T13:42:38.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.399+0000 7f1845ffb640 1 -- 172.21.15.43:0/2455919996 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11876 (secure 0 0 0) 0x7f183c0a76d0 con 0x7f18481045b0 2024-04-25T13:42:38.399 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:38.399 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2642701222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2642701222},{"type":"v1","addr":"172.21.15.43:6839","nonce":2642701222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6841/3777483996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":3777483996},{"type":"v1","addr":"172.21.15.43:6841","nonce":3777483996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T13:42:08.401075+0000","modified":"2024-04-25T13:42:36.143414+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24542,"mds_1":24509,"mds_2":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6839/3323587585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3323587585},{"type":"v1","addr":"172.21.15.175:6839","nonce":3323587585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.161:6837/1464384320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1464384320},{"type":"v1","addr":"172.21.15.161:6837","nonce":1464384320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6839/1243414461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":1243414461},{"type":"v1","addr":"172.21.15.161:6839","nonce":1243414461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24542,"qdb_cluster":[24542,24502,24509]},"id":1}]} 2024-04-25T13:42:38.399 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 24 2024-04-25T13:42:38.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.401+0000 7f184ea92640 1 -- 172.21.15.43:0/2455919996 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f18380afb80 msgr2=0x7f18380b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.401+0000 7f184ea92640 1 --2- 172.21.15.43:0/2455919996 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f18380afb80 0x7f18380b2090 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f184819b170 tx=0x7f1834005f90 comp rx=0 tx=0).stop 2024-04-25T13:42:38.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.401+0000 7f184ea92640 1 -- 172.21.15.43:0/2455919996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18481045b0 msgr2=0x7f184819a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.401+0000 7f184ea92640 1 --2- 172.21.15.43:0/2455919996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18481045b0 0x7f184819a0d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f183c00e9c0 tx=0x7f183c00ee80 comp rx=0 tx=0).stop 2024-04-25T13:42:38.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.401+0000 7f184ea92640 1 -- 172.21.15.43:0/2455919996 shutdown_connections 2024-04-25T13:42:38.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.401+0000 7f184ea92640 1 --2- 172.21.15.43:0/2455919996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1848109870 0x7f18481a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.401+0000 7f184ea92640 1 --2- 172.21.15.43:0/2455919996 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f18380afb80 0x7f18380b2090 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.401+0000 7f184ea92640 1 --2- 172.21.15.43:0/2455919996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1848106f10 0x7f184819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.401+0000 7f184ea92640 1 --2- 172.21.15.43:0/2455919996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18481045b0 0x7f184819a0d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.401+0000 7f184ea92640 1 -- 172.21.15.43:0/2455919996 >> 172.21.15.43:0/2455919996 conn(0x7f18480fdbd0 msgr2=0x7f1848105550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:38.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.401+0000 7f184ea92640 1 -- 172.21.15.43:0/2455919996 shutdown_connections 2024-04-25T13:42:38.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.401+0000 7f184ea92640 1 -- 172.21.15.43:0/2455919996 wait complete. 2024-04-25T13:42:38.412 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:38 smithi043 ceph-mon[29195]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:42:38.412 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:38 smithi043 ceph-mon[29195]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:42:38.412 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:38 smithi043 ceph-mon[29195]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:42:38.413 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:38.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:38 smithi175 ceph-mon[32649]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:42:38.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:38 smithi175 ceph-mon[32649]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:42:38.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:38 smithi175 ceph-mon[32649]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:42:38.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.525+0000 7f8e28aa7640 1 -- 172.21.15.43:0/1899038549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e24103c00 msgr2=0x7f8e24104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.525+0000 7f8e28aa7640 1 --2- 172.21.15.43:0/1899038549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e24103c00 0x7f8e24104010 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009900 tx=0x7f8e1802a410 comp rx=0 tx=0).stop 2024-04-25T13:42:38.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.525+0000 7f8e28aa7640 1 -- 172.21.15.43:0/1899038549 shutdown_connections 2024-04-25T13:42:38.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.525+0000 7f8e28aa7640 1 --2- 172.21.15.43:0/1899038549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e24108900 0x7f8e2410ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.525+0000 7f8e28aa7640 1 --2- 172.21.15.43:0/1899038549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e24103c00 0x7f8e24104010 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.525+0000 7f8e28aa7640 1 --2- 172.21.15.43:0/1899038549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e241029c0 0x7f8e241036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.525+0000 7f8e28aa7640 1 -- 172.21.15.43:0/1899038549 >> 172.21.15.43:0/1899038549 conn(0x7f8e240fdbd0 msgr2=0x7f8e24100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:38.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.525+0000 7f8e28aa7640 1 -- 172.21.15.43:0/1899038549 shutdown_connections 2024-04-25T13:42:38.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.525+0000 7f8e28aa7640 1 -- 172.21.15.43:0/1899038549 wait complete. 2024-04-25T13:42:38.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e28aa7640 1 Processor -- start 2024-04-25T13:42:38.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e28aa7640 1 -- start start 2024-04-25T13:42:38.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e28aa7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e241029c0 0x7f8e2419c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e28aa7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e24103c00 0x7f8e2419c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e28aa7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e24108900 0x7f8e241a3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e28aa7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2410e390 con 0x7f8e241029c0 2024-04-25T13:42:38.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e28aa7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2410e210 con 0x7f8e24108900 2024-04-25T13:42:38.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e28aa7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2410e510 con 0x7f8e24103c00 2024-04-25T13:42:38.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e2259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e241029c0 0x7f8e2419c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e2259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e241029c0 0x7f8e2419c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44222/0 (socket says 172.21.15.43:44222) 2024-04-25T13:42:38.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e2259c640 1 -- 172.21.15.43:0/1836236411 learned_addr learned my addr 172.21.15.43:0/1836236411 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:38.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e21d9b640 1 --2- 172.21.15.43:0/1836236411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e24103c00 0x7f8e2419c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e22d9d640 1 --2- 172.21.15.43:0/1836236411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e24108900 0x7f8e241a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e2259c640 1 -- 172.21.15.43:0/1836236411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e24103c00 msgr2=0x7f8e2419c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e2259c640 1 --2- 172.21.15.43:0/1836236411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e24103c00 0x7f8e2419c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e2259c640 1 -- 172.21.15.43:0/1836236411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e24108900 msgr2=0x7f8e241a3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e2259c640 1 --2- 172.21.15.43:0/1836236411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e24108900 0x7f8e241a3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e2259c640 1 -- 172.21.15.43:0/1836236411 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e241a3ef0 con 0x7f8e241029c0 2024-04-25T13:42:38.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.526+0000 7f8e22d9d640 1 --2- 172.21.15.43:0/1836236411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e24108900 0x7f8e241a3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:38.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.527+0000 7f8e2259c640 1 --2- 172.21.15.43:0/1836236411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e241029c0 0x7f8e2419c3b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00cce0 tx=0x7f8e1c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:38.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.527+0000 7f8e137fe640 1 -- 172.21.15.43:0/1836236411 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c004b20 con 0x7f8e241029c0 2024-04-25T13:42:38.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.527+0000 7f8e28aa7640 1 -- 172.21.15.43:0/1836236411 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e241a41e0 con 0x7f8e241029c0 2024-04-25T13:42:38.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.527+0000 7f8e137fe640 1 -- 172.21.15.43:0/1836236411 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e1c003e20 con 0x7f8e241029c0 2024-04-25T13:42:38.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.527+0000 7f8e137fe640 1 -- 172.21.15.43:0/1836236411 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c0046e0 con 0x7f8e241029c0 2024-04-25T13:42:38.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.527+0000 7f8e28aa7640 1 -- 172.21.15.43:0/1836236411 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e241a46e0 con 0x7f8e241029c0 2024-04-25T13:42:38.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.528+0000 7f8e28aa7640 1 -- 172.21.15.43:0/1836236411 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e24105ff0 con 0x7f8e241029c0 2024-04-25T13:42:38.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.529+0000 7f8e137fe640 1 -- 172.21.15.43:0/1836236411 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f8e1c003990 con 0x7f8e241029c0 2024-04-25T13:42:38.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.530+0000 7f8e137fe640 1 --2- 172.21.15.43:0/1836236411 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8e0c0afb80 0x7f8e0c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.530+0000 7f8e21d9b640 1 --2- 172.21.15.43:0/1836236411 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8e0c0afb80 0x7f8e0c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.530+0000 7f8e137fe640 1 -- 172.21.15.43:0/1836236411 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f8e1c0df0a0 con 0x7f8e241029c0 2024-04-25T13:42:38.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.530+0000 7f8e21d9b640 1 --2- 172.21.15.43:0/1836236411 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8e0c0afb80 0x7f8e0c0b2090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8e2419d450 tx=0x7f8e18000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:38.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.534+0000 7f8e137fe640 1 -- 172.21.15.43:0/1836236411 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8e1c014030 con 0x7f8e241029c0 2024-04-25T13:42:38.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.723+0000 7f8e28aa7640 1 -- 172.21.15.43:0/1836236411 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e240637a0 con 0x7f8e241029c0 2024-04-25T13:42:38.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.725+0000 7f8e137fe640 1 -- 172.21.15.43:0/1836236411 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24117 (secure 0 0 0) 0x7f8e1c0a78e0 con 0x7f8e241029c0 2024-04-25T13:42:38.725 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:38.725 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":80,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:42:13.441319+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:38.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.727+0000 7f8e28aa7640 1 -- 172.21.15.43:0/1836236411 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8e0c0afb80 msgr2=0x7f8e0c0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.727+0000 7f8e28aa7640 1 --2- 172.21.15.43:0/1836236411 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8e0c0afb80 0x7f8e0c0b2090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8e2419d450 tx=0x7f8e18000bc0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.727+0000 7f8e28aa7640 1 -- 172.21.15.43:0/1836236411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e241029c0 msgr2=0x7f8e2419c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.727+0000 7f8e28aa7640 1 --2- 172.21.15.43:0/1836236411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e241029c0 0x7f8e2419c3b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00cce0 tx=0x7f8e1c00a620 comp rx=0 tx=0).stop 2024-04-25T13:42:38.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.727+0000 7f8e28aa7640 1 -- 172.21.15.43:0/1836236411 shutdown_connections 2024-04-25T13:42:38.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.727+0000 7f8e28aa7640 1 --2- 172.21.15.43:0/1836236411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e24108900 0x7f8e241a3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.727+0000 7f8e28aa7640 1 --2- 172.21.15.43:0/1836236411 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8e0c0afb80 0x7f8e0c0b2090 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.727+0000 7f8e28aa7640 1 --2- 172.21.15.43:0/1836236411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e24103c00 0x7f8e2419c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.727+0000 7f8e28aa7640 1 --2- 172.21.15.43:0/1836236411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e241029c0 0x7f8e2419c3b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.727+0000 7f8e28aa7640 1 -- 172.21.15.43:0/1836236411 >> 172.21.15.43:0/1836236411 conn(0x7f8e240fdbd0 msgr2=0x7f8e240ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:38.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.727+0000 7f8e28aa7640 1 -- 172.21.15.43:0/1836236411 shutdown_connections 2024-04-25T13:42:38.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.727+0000 7f8e28aa7640 1 -- 172.21.15.43:0/1836236411 wait complete. 2024-04-25T13:42:38.738 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T13:42:38.739 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:42:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.850+0000 7fd600092640 1 -- 172.21.15.43:0/4037169237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f8106f30 msgr2=0x7fd5f8109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.850+0000 7fd600092640 1 --2- 172.21.15.43:0/4037169237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f8106f30 0x7fd5f8109350 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009900 tx=0x7fd5e802a410 comp rx=0 tx=0).stop 2024-04-25T13:42:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.851+0000 7fd600092640 1 -- 172.21.15.43:0/4037169237 shutdown_connections 2024-04-25T13:42:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.851+0000 7fd600092640 1 --2- 172.21.15.43:0/4037169237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f8109890 0x7fd5f810bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.851+0000 7fd600092640 1 --2- 172.21.15.43:0/4037169237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f8106f30 0x7fd5f8109350 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.851+0000 7fd600092640 1 --2- 172.21.15.43:0/4037169237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5f81045d0 0x7fd5f81069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.851+0000 7fd600092640 1 -- 172.21.15.43:0/4037169237 >> 172.21.15.43:0/4037169237 conn(0x7fd5f80fdbd0 msgr2=0x7fd5f8100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.851+0000 7fd600092640 1 -- 172.21.15.43:0/4037169237 shutdown_connections 2024-04-25T13:42:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.851+0000 7fd600092640 1 -- 172.21.15.43:0/4037169237 wait complete. 2024-04-25T13:42:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.851+0000 7fd600092640 1 Processor -- start 2024-04-25T13:42:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.851+0000 7fd600092640 1 -- start start 2024-04-25T13:42:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd600092640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5f81045d0 0x7fd5f819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd600092640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f8106f30 0x7fd5f819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd600092640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f8109890 0x7fd5f81a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd600092640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f810f4c0 con 0x7fd5f8106f30 2024-04-25T13:42:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd600092640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f810f340 con 0x7fd5f81045d0 2024-04-25T13:42:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd600092640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f810f640 con 0x7fd5f8109890 2024-04-25T13:42:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd5fd62d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f8106f30 0x7fd5f819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd5fd62d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f8106f30 0x7fd5f819a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44246/0 (socket says 172.21.15.43:44246) 2024-04-25T13:42:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd5fd62d640 1 -- 172.21.15.43:0/122063345 learned_addr learned my addr 172.21.15.43:0/122063345 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd5fde2e640 1 --2- 172.21.15.43:0/122063345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5f81045d0 0x7fd5f819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd5fe62f640 1 --2- 172.21.15.43:0/122063345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f8109890 0x7fd5f81a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd5fd62d640 1 -- 172.21.15.43:0/122063345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f8109890 msgr2=0x7fd5f81a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd5fd62d640 1 --2- 172.21.15.43:0/122063345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f8109890 0x7fd5f81a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd5fd62d640 1 -- 172.21.15.43:0/122063345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5f81045d0 msgr2=0x7fd5f819a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd5fd62d640 1 --2- 172.21.15.43:0/122063345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5f81045d0 0x7fd5f819a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd5fd62d640 1 -- 172.21.15.43:0/122063345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f81a1d00 con 0x7fd5f8106f30 2024-04-25T13:42:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd5fd62d640 1 --2- 172.21.15.43:0/122063345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f8106f30 0x7fd5f819a700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009230 tx=0x7fd5e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd5eeffd640 1 -- 172.21.15.43:0/122063345 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e803f030 con 0x7fd5f8106f30 2024-04-25T13:42:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.852+0000 7fd5eeffd640 1 -- 172.21.15.43:0/122063345 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5e8003c90 con 0x7fd5f8106f30 2024-04-25T13:42:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.853+0000 7fd600092640 1 -- 172.21.15.43:0/122063345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f81a1f90 con 0x7fd5f8106f30 2024-04-25T13:42:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.853+0000 7fd5eeffd640 1 -- 172.21.15.43:0/122063345 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8035070 con 0x7fd5f8106f30 2024-04-25T13:42:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.853+0000 7fd600092640 1 -- 172.21.15.43:0/122063345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f81a23f0 con 0x7fd5f8106f30 2024-04-25T13:42:38.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.854+0000 7fd600092640 1 -- 172.21.15.43:0/122063345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f80ff6f0 con 0x7fd5f8106f30 2024-04-25T13:42:38.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.855+0000 7fd5eeffd640 1 -- 172.21.15.43:0/122063345 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fd5e8042030 con 0x7fd5f8106f30 2024-04-25T13:42:38.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.856+0000 7fd5eeffd640 1 --2- 172.21.15.43:0/122063345 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd5e40afc00 0x7fd5e40b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.856+0000 7fd5fde2e640 1 --2- 172.21.15.43:0/122063345 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd5e40afc00 0x7fd5e40b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.856+0000 7fd5eeffd640 1 -- 172.21.15.43:0/122063345 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fd5e80ff620 con 0x7fd5f8106f30 2024-04-25T13:42:38.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.856+0000 7fd5fde2e640 1 --2- 172.21.15.43:0/122063345 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd5e40afc00 0x7fd5e40b2110 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80757f0 tx=0x7fd5f400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:38.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:38.861+0000 7fd5eeffd640 1 -- 172.21.15.43:0/122063345 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd5e80c7870 con 0x7fd5f8106f30 2024-04-25T13:42:39.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.044+0000 7fd600092640 1 -- 172.21.15.43:0/122063345 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd5f8062fe0 con 0x7fd5e40afc00 2024-04-25T13:42:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.055+0000 7fd5eeffd640 1 -- 172.21.15.43:0/122063345 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340292 (secure 0 0 0) 0x7fd5f8062fe0 con 0x7fd5e40afc00 2024-04-25T13:42:39.060 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:39.062 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T13:42:39.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.058+0000 7fd600092640 1 -- 172.21.15.43:0/122063345 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd5e40afc00 msgr2=0x7fd5e40b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.058+0000 7fd600092640 1 --2- 172.21.15.43:0/122063345 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd5e40afc00 0x7fd5e40b2110 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80757f0 tx=0x7fd5f400b390 comp rx=0 tx=0).stop 2024-04-25T13:42:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.058+0000 7fd600092640 1 -- 172.21.15.43:0/122063345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f8106f30 msgr2=0x7fd5f819a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.058+0000 7fd600092640 1 --2- 172.21.15.43:0/122063345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f8106f30 0x7fd5f819a700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009230 tx=0x7fd5e80042f0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.058+0000 7fd600092640 1 -- 172.21.15.43:0/122063345 shutdown_connections 2024-04-25T13:42:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.058+0000 7fd600092640 1 --2- 172.21.15.43:0/122063345 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd5e40afc00 0x7fd5e40b2110 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.058+0000 7fd600092640 1 --2- 172.21.15.43:0/122063345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f8109890 0x7fd5f81a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.058+0000 7fd600092640 1 --2- 172.21.15.43:0/122063345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5f8106f30 0x7fd5f819a700 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.058+0000 7fd600092640 1 --2- 172.21.15.43:0/122063345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5f81045d0 0x7fd5f819a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.058+0000 7fd600092640 1 -- 172.21.15.43:0/122063345 >> 172.21.15.43:0/122063345 conn(0x7fd5f80fdbd0 msgr2=0x7fd5f8106670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.058+0000 7fd600092640 1 -- 172.21.15.43:0/122063345 shutdown_connections 2024-04-25T13:42:39.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.058+0000 7fd600092640 1 -- 172.21.15.43:0/122063345 wait complete. 2024-04-25T13:42:39.070 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2024-04-25T13:42:37.936399+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596616,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":88,"num_read_kb":76,"num_write":232,"num_write_kb":2190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386340,"kb_used_data":12212,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555484,"statfs":{"total":1151940427776,"available":1151544815616,"internally_reserved":0,"allocated":12505088,"data_stored":6896900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1749,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004172"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.795425+0000","last_change":"2024-04-25T13:42:09.059038+0000","last_active":"2024-04-25T13:42:14.795425+0000","last_peered":"2024-04-25T13:42:14.795425+0000","last_clean":"2024-04-25T13:42:14.795425+0000","last_became_active":"2024-04-25T13:42:09.058719+0000","last_became_peered":"2024-04-25T13:42:09.058719+0000","last_unstale":"2024-04-25T13:42:14.795425+0000","last_undegraded":"2024-04-25T13:42:14.795425+0000","last_fullsized":"2024-04-25T13:42:14.795425+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:44.573718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390151+0000","last_change":"2024-04-25T13:42:09.057862+0000","last_active":"2024-04-25T13:42:14.390151+0000","last_peered":"2024-04-25T13:42:14.390151+0000","last_clean":"2024-04-25T13:42:14.390151+0000","last_became_active":"2024-04-25T13:42:09.057511+0000","last_became_peered":"2024-04-25T13:42:09.057511+0000","last_unstale":"2024-04-25T13:42:14.390151+0000","last_undegraded":"2024-04-25T13:42:14.390151+0000","last_fullsized":"2024-04-25T13:42:14.390151+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:20.911339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389889+0000","last_change":"2024-04-25T13:42:09.060432+0000","last_active":"2024-04-25T13:42:14.389889+0000","last_peered":"2024-04-25T13:42:14.389889+0000","last_clean":"2024-04-25T13:42:14.389889+0000","last_became_active":"2024-04-25T13:42:09.060081+0000","last_became_peered":"2024-04-25T13:42:09.060081+0000","last_unstale":"2024-04-25T13:42:14.389889+0000","last_undegraded":"2024-04-25T13:42:14.389889+0000","last_fullsized":"2024-04-25T13:42:14.389889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:50.008694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390593+0000","last_change":"2024-04-25T13:42:09.040319+0000","last_active":"2024-04-25T13:42:14.390593+0000","last_peered":"2024-04-25T13:42:14.390593+0000","last_clean":"2024-04-25T13:42:14.390593+0000","last_became_active":"2024-04-25T13:42:09.039949+0000","last_became_peered":"2024-04-25T13:42:09.039949+0000","last_unstale":"2024-04-25T13:42:14.390593+0000","last_undegraded":"2024-04-25T13:42:14.390593+0000","last_fullsized":"2024-04-25T13:42:14.390593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:03.242055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.388828+0000","last_change":"2024-04-25T13:42:09.040642+0000","last_active":"2024-04-25T13:42:14.388828+0000","last_peered":"2024-04-25T13:42:14.388828+0000","last_clean":"2024-04-25T13:42:14.388828+0000","last_became_active":"2024-04-25T13:42:09.039339+0000","last_became_peered":"2024-04-25T13:42:09.039339+0000","last_unstale":"2024-04-25T13:42:14.388828+0000","last_undegraded":"2024-04-25T13:42:14.388828+0000","last_fullsized":"2024-04-25T13:42:14.388828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:50.216939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390605+0000","last_change":"2024-04-25T13:42:09.034848+0000","last_active":"2024-04-25T13:42:14.390605+0000","last_peered":"2024-04-25T13:42:14.390605+0000","last_clean":"2024-04-25T13:42:14.390605+0000","last_became_active":"2024-04-25T13:42:09.034452+0000","last_became_peered":"2024-04-25T13:42:09.034452+0000","last_unstale":"2024-04-25T13:42:14.390605+0000","last_undegraded":"2024-04-25T13:42:14.390605+0000","last_fullsized":"2024-04-25T13:42:14.390605+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:45.963322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391010+0000","last_change":"2024-04-25T13:42:09.054656+0000","last_active":"2024-04-25T13:42:14.391010+0000","last_peered":"2024-04-25T13:42:14.391010+0000","last_clean":"2024-04-25T13:42:14.391010+0000","last_became_active":"2024-04-25T13:42:09.054276+0000","last_became_peered":"2024-04-25T13:42:09.054276+0000","last_unstale":"2024-04-25T13:42:14.391010+0000","last_undegraded":"2024-04-25T13:42:14.391010+0000","last_fullsized":"2024-04-25T13:42:14.391010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:19.818362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.072785+0000","last_change":"2024-04-25T13:42:09.054227+0000","last_active":"2024-04-25T13:42:14.072785+0000","last_peered":"2024-04-25T13:42:14.072785+0000","last_clean":"2024-04-25T13:42:14.072785+0000","last_became_active":"2024-04-25T13:42:09.051893+0000","last_became_peered":"2024-04-25T13:42:09.051893+0000","last_unstale":"2024-04-25T13:42:14.072785+0000","last_undegraded":"2024-04-25T13:42:14.072785+0000","last_fullsized":"2024-04-25T13:42:14.072785+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:37.120057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.074241+0000","last_change":"2024-04-25T13:42:09.039618+0000","last_active":"2024-04-25T13:42:14.074241+0000","last_peered":"2024-04-25T13:42:14.074241+0000","last_clean":"2024-04-25T13:42:14.074241+0000","last_became_active":"2024-04-25T13:42:09.039264+0000","last_became_peered":"2024-04-25T13:42:09.039264+0000","last_unstale":"2024-04-25T13:42:14.074241+0000","last_undegraded":"2024-04-25T13:42:14.074241+0000","last_fullsized":"2024-04-25T13:42:14.074241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:50.352365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390438+0000","last_change":"2024-04-25T13:42:09.037323+0000","last_active":"2024-04-25T13:42:14.390438+0000","last_peered":"2024-04-25T13:42:14.390438+0000","last_clean":"2024-04-25T13:42:14.390438+0000","last_became_active":"2024-04-25T13:42:09.036614+0000","last_became_peered":"2024-04-25T13:42:09.036614+0000","last_unstale":"2024-04-25T13:42:14.390438+0000","last_undegraded":"2024-04-25T13:42:14.390438+0000","last_fullsized":"2024-04-25T13:42:14.390438+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:09.872287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391615+0000","last_change":"2024-04-25T13:42:09.056812+0000","last_active":"2024-04-25T13:42:14.391615+0000","last_peered":"2024-04-25T13:42:14.391615+0000","last_clean":"2024-04-25T13:42:14.391615+0000","last_became_active":"2024-04-25T13:42:09.054990+0000","last_became_peered":"2024-04-25T13:42:09.054990+0000","last_unstale":"2024-04-25T13:42:14.391615+0000","last_undegraded":"2024-04-25T13:42:14.391615+0000","last_fullsized":"2024-04-25T13:42:14.391615+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:30.855059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390471+0000","last_change":"2024-04-25T13:42:09.034107+0000","last_active":"2024-04-25T13:42:14.390471+0000","last_peered":"2024-04-25T13:42:14.390471+0000","last_clean":"2024-04-25T13:42:14.390471+0000","last_became_active":"2024-04-25T13:42:09.033713+0000","last_became_peered":"2024-04-25T13:42:09.033713+0000","last_unstale":"2024-04-25T13:42:14.390471+0000","last_undegraded":"2024-04-25T13:42:14.390471+0000","last_fullsized":"2024-04-25T13:42:14.390471+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:06.218439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390086+0000","last_change":"2024-04-25T13:42:09.043105+0000","last_active":"2024-04-25T13:42:14.390086+0000","last_peered":"2024-04-25T13:42:14.390086+0000","last_clean":"2024-04-25T13:42:14.390086+0000","last_became_active":"2024-04-25T13:42:09.042457+0000","last_became_peered":"2024-04-25T13:42:09.042457+0000","last_unstale":"2024-04-25T13:42:14.390086+0000","last_undegraded":"2024-04-25T13:42:14.390086+0000","last_fullsized":"2024-04-25T13:42:14.390086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:58.924985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389775+0000","last_change":"2024-04-25T13:42:09.046658+0000","last_active":"2024-04-25T13:42:14.389775+0000","last_peered":"2024-04-25T13:42:14.389775+0000","last_clean":"2024-04-25T13:42:14.389775+0000","last_became_active":"2024-04-25T13:42:09.046323+0000","last_became_peered":"2024-04-25T13:42:09.046323+0000","last_unstale":"2024-04-25T13:42:14.389775+0000","last_undegraded":"2024-04-25T13:42:14.389775+0000","last_fullsized":"2024-04-25T13:42:14.389775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:51.362734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389730+0000","last_change":"2024-04-25T13:42:09.049787+0000","last_active":"2024-04-25T13:42:14.389730+0000","last_peered":"2024-04-25T13:42:14.389730+0000","last_clean":"2024-04-25T13:42:14.389730+0000","last_became_active":"2024-04-25T13:42:09.049432+0000","last_became_peered":"2024-04-25T13:42:09.049432+0000","last_unstale":"2024-04-25T13:42:14.389730+0000","last_undegraded":"2024-04-25T13:42:14.389730+0000","last_fullsized":"2024-04-25T13:42:14.389730+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:23.507471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073541+0000","last_change":"2024-04-25T13:42:09.060318+0000","last_active":"2024-04-25T13:42:14.073541+0000","last_peered":"2024-04-25T13:42:14.073541+0000","last_clean":"2024-04-25T13:42:14.073541+0000","last_became_active":"2024-04-25T13:42:09.059948+0000","last_became_peered":"2024-04-25T13:42:09.059948+0000","last_unstale":"2024-04-25T13:42:14.073541+0000","last_undegraded":"2024-04-25T13:42:14.073541+0000","last_fullsized":"2024-04-25T13:42:14.073541+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:10.840181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.795236+0000","last_change":"2024-04-25T13:42:09.060432+0000","last_active":"2024-04-25T13:42:14.795236+0000","last_peered":"2024-04-25T13:42:14.795236+0000","last_clean":"2024-04-25T13:42:14.795236+0000","last_became_active":"2024-04-25T13:42:09.059525+0000","last_became_peered":"2024-04-25T13:42:09.059525+0000","last_unstale":"2024-04-25T13:42:14.795236+0000","last_undegraded":"2024-04-25T13:42:14.795236+0000","last_fullsized":"2024-04-25T13:42:14.795236+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:46:41.360324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390046+0000","last_change":"2024-04-25T13:42:09.035591+0000","last_active":"2024-04-25T13:42:14.390046+0000","last_peered":"2024-04-25T13:42:14.390046+0000","last_clean":"2024-04-25T13:42:14.390046+0000","last_became_active":"2024-04-25T13:42:09.035219+0000","last_became_peered":"2024-04-25T13:42:09.035219+0000","last_unstale":"2024-04-25T13:42:14.390046+0000","last_undegraded":"2024-04-25T13:42:14.390046+0000","last_fullsized":"2024-04-25T13:42:14.390046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:35:04.362044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389880+0000","last_change":"2024-04-25T13:42:09.057623+0000","last_active":"2024-04-25T13:42:14.389880+0000","last_peered":"2024-04-25T13:42:14.389880+0000","last_clean":"2024-04-25T13:42:14.389880+0000","last_became_active":"2024-04-25T13:42:09.057276+0000","last_became_peered":"2024-04-25T13:42:09.057276+0000","last_unstale":"2024-04-25T13:42:14.389880+0000","last_undegraded":"2024-04-25T13:42:14.389880+0000","last_fullsized":"2024-04-25T13:42:14.389880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:28.975079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389213+0000","last_change":"2024-04-25T13:42:13.081052+0000","last_active":"2024-04-25T13:42:14.389213+0000","last_peered":"2024-04-25T13:42:14.389213+0000","last_clean":"2024-04-25T13:42:14.389213+0000","last_became_active":"2024-04-25T13:42:13.080546+0000","last_became_peered":"2024-04-25T13:42:13.080546+0000","last_unstale":"2024-04-25T13:42:14.389213+0000","last_undegraded":"2024-04-25T13:42:14.389213+0000","last_fullsized":"2024-04-25T13:42:14.389213+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:59.648007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390474+0000","last_change":"2024-04-25T13:42:08.040591+0000","last_active":"2024-04-25T13:42:14.390474+0000","last_peered":"2024-04-25T13:42:14.390474+0000","last_clean":"2024-04-25T13:42:14.390474+0000","last_became_active":"2024-04-25T13:42:08.040221+0000","last_became_peered":"2024-04-25T13:42:08.040221+0000","last_unstale":"2024-04-25T13:42:14.390474+0000","last_undegraded":"2024-04-25T13:42:14.390474+0000","last_fullsized":"2024-04-25T13:42:14.390474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:09.755426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073538+0000","last_change":"2024-04-25T13:42:09.061907+0000","last_active":"2024-04-25T13:42:14.073538+0000","last_peered":"2024-04-25T13:42:14.073538+0000","last_clean":"2024-04-25T13:42:14.073538+0000","last_became_active":"2024-04-25T13:42:09.061520+0000","last_became_peered":"2024-04-25T13:42:09.061520+0000","last_unstale":"2024-04-25T13:42:14.073538+0000","last_undegraded":"2024-04-25T13:42:14.073538+0000","last_fullsized":"2024-04-25T13:42:14.073538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:45.549889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389389+0000","last_change":"2024-04-25T13:42:13.080709+0000","last_active":"2024-04-25T13:42:14.389389+0000","last_peered":"2024-04-25T13:42:14.389389+0000","last_clean":"2024-04-25T13:42:14.389389+0000","last_became_active":"2024-04-25T13:42:13.080234+0000","last_became_peered":"2024-04-25T13:42:13.080234+0000","last_unstale":"2024-04-25T13:42:14.389389+0000","last_undegraded":"2024-04-25T13:42:14.389389+0000","last_fullsized":"2024-04-25T13:42:14.389389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:29.231166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073865+0000","last_change":"2024-04-25T13:42:08.044450+0000","last_active":"2024-04-25T13:42:14.073865+0000","last_peered":"2024-04-25T13:42:14.073865+0000","last_clean":"2024-04-25T13:42:14.073865+0000","last_became_active":"2024-04-25T13:42:08.043674+0000","last_became_peered":"2024-04-25T13:42:08.043674+0000","last_unstale":"2024-04-25T13:42:14.073865+0000","last_undegraded":"2024-04-25T13:42:14.073865+0000","last_fullsized":"2024-04-25T13:42:14.073865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:12.784756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390320+0000","last_change":"2024-04-25T13:42:09.060369+0000","last_active":"2024-04-25T13:42:14.390320+0000","last_peered":"2024-04-25T13:42:14.390320+0000","last_clean":"2024-04-25T13:42:14.390320+0000","last_became_active":"2024-04-25T13:42:09.060002+0000","last_became_peered":"2024-04-25T13:42:09.060002+0000","last_unstale":"2024-04-25T13:42:14.390320+0000","last_undegraded":"2024-04-25T13:42:14.390320+0000","last_fullsized":"2024-04-25T13:42:14.390320+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:26.601583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389968+0000","last_change":"2024-04-25T13:42:13.083165+0000","last_active":"2024-04-25T13:42:14.389968+0000","last_peered":"2024-04-25T13:42:14.389968+0000","last_clean":"2024-04-25T13:42:14.389968+0000","last_became_active":"2024-04-25T13:42:13.082767+0000","last_became_peered":"2024-04-25T13:42:13.082767+0000","last_unstale":"2024-04-25T13:42:14.389968+0000","last_undegraded":"2024-04-25T13:42:14.389968+0000","last_fullsized":"2024-04-25T13:42:14.389968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:35.559831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:35.144230+0000","last_change":"2024-04-25T13:42:08.041789+0000","last_active":"2024-04-25T13:42:35.144230+0000","last_peered":"2024-04-25T13:42:35.144230+0000","last_clean":"2024-04-25T13:42:35.144230+0000","last_became_active":"2024-04-25T13:42:08.041371+0000","last_became_peered":"2024-04-25T13:42:08.041371+0000","last_unstale":"2024-04-25T13:42:35.144230+0000","last_undegraded":"2024-04-25T13:42:35.144230+0000","last_fullsized":"2024-04-25T13:42:35.144230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:33.748758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073863+0000","last_change":"2024-04-25T13:42:09.045209+0000","last_active":"2024-04-25T13:42:14.073863+0000","last_peered":"2024-04-25T13:42:14.073863+0000","last_clean":"2024-04-25T13:42:14.073863+0000","last_became_active":"2024-04-25T13:42:09.044750+0000","last_became_peered":"2024-04-25T13:42:09.044750+0000","last_unstale":"2024-04-25T13:42:14.073863+0000","last_undegraded":"2024-04-25T13:42:14.073863+0000","last_fullsized":"2024-04-25T13:42:14.073863+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:03.279395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389846+0000","last_change":"2024-04-25T13:42:13.083154+0000","last_active":"2024-04-25T13:42:14.389846+0000","last_peered":"2024-04-25T13:42:14.389846+0000","last_clean":"2024-04-25T13:42:14.389846+0000","last_became_active":"2024-04-25T13:42:13.082679+0000","last_became_peered":"2024-04-25T13:42:13.082679+0000","last_unstale":"2024-04-25T13:42:14.389846+0000","last_undegraded":"2024-04-25T13:42:14.389846+0000","last_fullsized":"2024-04-25T13:42:14.389846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:14.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389732+0000","last_change":"2024-04-25T13:42:08.035263+0000","last_active":"2024-04-25T13:42:14.389732+0000","last_peered":"2024-04-25T13:42:14.389732+0000","last_clean":"2024-04-25T13:42:14.389732+0000","last_became_active":"2024-04-25T13:42:08.034917+0000","last_became_peered":"2024-04-25T13:42:08.034917+0000","last_unstale":"2024-04-25T13:42:14.389732+0000","last_undegraded":"2024-04-25T13:42:14.389732+0000","last_fullsized":"2024-04-25T13:42:14.389732+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:50.051615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.076524+0000","last_change":"2024-04-25T13:42:09.038159+0000","last_active":"2024-04-25T13:42:14.076524+0000","last_peered":"2024-04-25T13:42:14.076524+0000","last_clean":"2024-04-25T13:42:14.076524+0000","last_became_active":"2024-04-25T13:42:09.037702+0000","last_became_peered":"2024-04-25T13:42:09.037702+0000","last_unstale":"2024-04-25T13:42:14.076524+0000","last_undegraded":"2024-04-25T13:42:14.076524+0000","last_fullsized":"2024-04-25T13:42:14.076524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:44.856392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389722+0000","last_change":"2024-04-25T13:42:13.074307+0000","last_active":"2024-04-25T13:42:14.389722+0000","last_peered":"2024-04-25T13:42:14.389722+0000","last_clean":"2024-04-25T13:42:14.389722+0000","last_became_active":"2024-04-25T13:42:13.073665+0000","last_became_peered":"2024-04-25T13:42:13.073665+0000","last_unstale":"2024-04-25T13:42:14.389722+0000","last_undegraded":"2024-04-25T13:42:14.389722+0000","last_fullsized":"2024-04-25T13:42:14.389722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:24.652912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.141651+0000","last_change":"2024-04-25T13:42:08.033277+0000","last_active":"2024-04-25T13:42:34.141651+0000","last_peered":"2024-04-25T13:42:34.141651+0000","last_clean":"2024-04-25T13:42:34.141651+0000","last_became_active":"2024-04-25T13:42:08.032609+0000","last_became_peered":"2024-04-25T13:42:08.032609+0000","last_unstale":"2024-04-25T13:42:34.141651+0000","last_undegraded":"2024-04-25T13:42:34.141651+0000","last_fullsized":"2024-04-25T13:42:34.141651+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:22.709352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389343+0000","last_change":"2024-04-25T13:42:09.037183+0000","last_active":"2024-04-25T13:42:14.389343+0000","last_peered":"2024-04-25T13:42:14.389343+0000","last_clean":"2024-04-25T13:42:14.389343+0000","last_became_active":"2024-04-25T13:42:09.036778+0000","last_became_peered":"2024-04-25T13:42:09.036778+0000","last_unstale":"2024-04-25T13:42:14.389343+0000","last_undegraded":"2024-04-25T13:42:14.389343+0000","last_fullsized":"2024-04-25T13:42:14.389343+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:24:20.009326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389678+0000","last_change":"2024-04-25T13:42:13.080499+0000","last_active":"2024-04-25T13:42:14.389678+0000","last_peered":"2024-04-25T13:42:14.389678+0000","last_clean":"2024-04-25T13:42:14.389678+0000","last_became_active":"2024-04-25T13:42:13.080007+0000","last_became_peered":"2024-04-25T13:42:13.080007+0000","last_unstale":"2024-04-25T13:42:14.389678+0000","last_undegraded":"2024-04-25T13:42:14.389678+0000","last_fullsized":"2024-04-25T13:42:14.389678+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:54.488344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:35.144589+0000","last_change":"2024-04-25T13:42:08.037902+0000","last_active":"2024-04-25T13:42:35.144589+0000","last_peered":"2024-04-25T13:42:35.144589+0000","last_clean":"2024-04-25T13:42:35.144589+0000","last_became_active":"2024-04-25T13:42:08.037284+0000","last_became_peered":"2024-04-25T13:42:08.037284+0000","last_unstale":"2024-04-25T13:42:35.144589+0000","last_undegraded":"2024-04-25T13:42:35.144589+0000","last_fullsized":"2024-04-25T13:42:35.144589+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:10.374637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.076401+0000","last_change":"2024-04-25T13:42:09.057856+0000","last_active":"2024-04-25T13:42:14.076401+0000","last_peered":"2024-04-25T13:42:14.076401+0000","last_clean":"2024-04-25T13:42:14.076401+0000","last_became_active":"2024-04-25T13:42:09.057464+0000","last_became_peered":"2024-04-25T13:42:09.057464+0000","last_unstale":"2024-04-25T13:42:14.076401+0000","last_undegraded":"2024-04-25T13:42:14.076401+0000","last_fullsized":"2024-04-25T13:42:14.076401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:03.403058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.795245+0000","last_change":"2024-04-25T13:42:13.078100+0000","last_active":"2024-04-25T13:42:14.795245+0000","last_peered":"2024-04-25T13:42:14.795245+0000","last_clean":"2024-04-25T13:42:14.795245+0000","last_became_active":"2024-04-25T13:42:13.077705+0000","last_became_peered":"2024-04-25T13:42:13.077705+0000","last_unstale":"2024-04-25T13:42:14.795245+0000","last_undegraded":"2024-04-25T13:42:14.795245+0000","last_fullsized":"2024-04-25T13:42:14.795245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:54.855223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:35.145537+0000","last_change":"2024-04-25T13:42:08.030750+0000","last_active":"2024-04-25T13:42:35.145537+0000","last_peered":"2024-04-25T13:42:35.145537+0000","last_clean":"2024-04-25T13:42:35.145537+0000","last_became_active":"2024-04-25T13:42:08.030353+0000","last_became_peered":"2024-04-25T13:42:08.030353+0000","last_unstale":"2024-04-25T13:42:35.145537+0000","last_undegraded":"2024-04-25T13:42:35.145537+0000","last_fullsized":"2024-04-25T13:42:35.145537+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:11.658589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.072987+0000","last_change":"2024-04-25T13:42:09.048800+0000","last_active":"2024-04-25T13:42:14.072987+0000","last_peered":"2024-04-25T13:42:14.072987+0000","last_clean":"2024-04-25T13:42:14.072987+0000","last_became_active":"2024-04-25T13:42:09.047777+0000","last_became_peered":"2024-04-25T13:42:09.047777+0000","last_unstale":"2024-04-25T13:42:14.072987+0000","last_undegraded":"2024-04-25T13:42:14.072987+0000","last_fullsized":"2024-04-25T13:42:14.072987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:44.739359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390588+0000","last_change":"2024-04-25T13:42:13.073583+0000","last_active":"2024-04-25T13:42:14.390588+0000","last_peered":"2024-04-25T13:42:14.390588+0000","last_clean":"2024-04-25T13:42:14.390588+0000","last_became_active":"2024-04-25T13:42:13.073154+0000","last_became_peered":"2024-04-25T13:42:13.073154+0000","last_unstale":"2024-04-25T13:42:14.390588+0000","last_undegraded":"2024-04-25T13:42:14.390588+0000","last_fullsized":"2024-04-25T13:42:14.390588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:42.720347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.075944+0000","last_change":"2024-04-25T13:42:08.035263+0000","last_active":"2024-04-25T13:42:14.075944+0000","last_peered":"2024-04-25T13:42:14.075944+0000","last_clean":"2024-04-25T13:42:14.075944+0000","last_became_active":"2024-04-25T13:42:08.034903+0000","last_became_peered":"2024-04-25T13:42:08.034903+0000","last_unstale":"2024-04-25T13:42:14.075944+0000","last_undegraded":"2024-04-25T13:42:14.075944+0000","last_fullsized":"2024-04-25T13:42:14.075944+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:22.715159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389306+0000","last_change":"2024-04-25T13:42:09.037640+0000","last_active":"2024-04-25T13:42:14.389306+0000","last_peered":"2024-04-25T13:42:14.389306+0000","last_clean":"2024-04-25T13:42:14.389306+0000","last_became_active":"2024-04-25T13:42:09.037286+0000","last_became_peered":"2024-04-25T13:42:09.037286+0000","last_unstale":"2024-04-25T13:42:14.389306+0000","last_undegraded":"2024-04-25T13:42:14.389306+0000","last_fullsized":"2024-04-25T13:42:14.389306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:28.704489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073416+0000","last_change":"2024-04-25T13:42:13.079379+0000","last_active":"2024-04-25T13:42:14.073416+0000","last_peered":"2024-04-25T13:42:14.073416+0000","last_clean":"2024-04-25T13:42:14.073416+0000","last_became_active":"2024-04-25T13:42:13.078771+0000","last_became_peered":"2024-04-25T13:42:13.078771+0000","last_unstale":"2024-04-25T13:42:14.073416+0000","last_undegraded":"2024-04-25T13:42:14.073416+0000","last_fullsized":"2024-04-25T13:42:14.073416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:35.955154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.139659+0000","last_change":"2024-04-25T13:42:08.032562+0000","last_active":"2024-04-25T13:42:34.139659+0000","last_peered":"2024-04-25T13:42:34.139659+0000","last_clean":"2024-04-25T13:42:34.139659+0000","last_became_active":"2024-04-25T13:42:08.032090+0000","last_became_peered":"2024-04-25T13:42:08.032090+0000","last_unstale":"2024-04-25T13:42:34.139659+0000","last_undegraded":"2024-04-25T13:42:34.139659+0000","last_fullsized":"2024-04-25T13:42:34.139659+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:13:52.822642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.074242+0000","last_change":"2024-04-25T13:42:09.041724+0000","last_active":"2024-04-25T13:42:14.074242+0000","last_peered":"2024-04-25T13:42:14.074242+0000","last_clean":"2024-04-25T13:42:14.074242+0000","last_became_active":"2024-04-25T13:42:09.041386+0000","last_became_peered":"2024-04-25T13:42:09.041386+0000","last_unstale":"2024-04-25T13:42:14.074242+0000","last_undegraded":"2024-04-25T13:42:14.074242+0000","last_fullsized":"2024-04-25T13:42:14.074242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:29.676814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389232+0000","last_change":"2024-04-25T13:42:13.075365+0000","last_active":"2024-04-25T13:42:14.389232+0000","last_peered":"2024-04-25T13:42:14.389232+0000","last_clean":"2024-04-25T13:42:14.389232+0000","last_became_active":"2024-04-25T13:42:13.074886+0000","last_became_peered":"2024-04-25T13:42:13.074886+0000","last_unstale":"2024-04-25T13:42:14.389232+0000","last_undegraded":"2024-04-25T13:42:14.389232+0000","last_fullsized":"2024-04-25T13:42:14.389232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:30.647002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.139590+0000","last_change":"2024-04-25T13:42:08.036830+0000","last_active":"2024-04-25T13:42:34.139590+0000","last_peered":"2024-04-25T13:42:34.139590+0000","last_clean":"2024-04-25T13:42:34.139590+0000","last_became_active":"2024-04-25T13:42:08.036418+0000","last_became_peered":"2024-04-25T13:42:08.036418+0000","last_unstale":"2024-04-25T13:42:34.139590+0000","last_undegraded":"2024-04-25T13:42:34.139590+0000","last_fullsized":"2024-04-25T13:42:34.139590+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:06.402677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390219+0000","last_change":"2024-04-25T13:42:09.063305+0000","last_active":"2024-04-25T13:42:14.390219+0000","last_peered":"2024-04-25T13:42:14.390219+0000","last_clean":"2024-04-25T13:42:14.390219+0000","last_became_active":"2024-04-25T13:42:09.062961+0000","last_became_peered":"2024-04-25T13:42:09.062961+0000","last_unstale":"2024-04-25T13:42:14.390219+0000","last_undegraded":"2024-04-25T13:42:14.390219+0000","last_fullsized":"2024-04-25T13:42:14.390219+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:34.653515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390300+0000","last_change":"2024-04-25T13:42:13.073271+0000","last_active":"2024-04-25T13:42:14.390300+0000","last_peered":"2024-04-25T13:42:14.390300+0000","last_clean":"2024-04-25T13:42:14.390300+0000","last_became_active":"2024-04-25T13:42:13.072800+0000","last_became_peered":"2024-04-25T13:42:13.072800+0000","last_unstale":"2024-04-25T13:42:14.390300+0000","last_undegraded":"2024-04-25T13:42:14.390300+0000","last_fullsized":"2024-04-25T13:42:14.390300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:40.115311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.076549+0000","last_change":"2024-04-25T13:42:08.032607+0000","last_active":"2024-04-25T13:42:14.076549+0000","last_peered":"2024-04-25T13:42:14.076549+0000","last_clean":"2024-04-25T13:42:14.076549+0000","last_became_active":"2024-04-25T13:42:08.031474+0000","last_became_peered":"2024-04-25T13:42:08.031474+0000","last_unstale":"2024-04-25T13:42:14.076549+0000","last_undegraded":"2024-04-25T13:42:14.076549+0000","last_fullsized":"2024-04-25T13:42:14.076549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:02:37.648480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.074004+0000","last_change":"2024-04-25T13:42:09.043148+0000","last_active":"2024-04-25T13:42:14.074004+0000","last_peered":"2024-04-25T13:42:14.074004+0000","last_clean":"2024-04-25T13:42:14.074004+0000","last_became_active":"2024-04-25T13:42:09.042787+0000","last_became_peered":"2024-04-25T13:42:09.042787+0000","last_unstale":"2024-04-25T13:42:14.074004+0000","last_undegraded":"2024-04-25T13:42:14.074004+0000","last_fullsized":"2024-04-25T13:42:14.074004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:29.318123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390280+0000","last_change":"2024-04-25T13:42:13.076116+0000","last_active":"2024-04-25T13:42:14.390280+0000","last_peered":"2024-04-25T13:42:14.390280+0000","last_clean":"2024-04-25T13:42:14.390280+0000","last_became_active":"2024-04-25T13:42:13.075592+0000","last_became_peered":"2024-04-25T13:42:13.075592+0000","last_unstale":"2024-04-25T13:42:14.390280+0000","last_undegraded":"2024-04-25T13:42:14.390280+0000","last_fullsized":"2024-04-25T13:42:14.390280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:06.496966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"80'12","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.139674+0000","last_change":"2024-04-25T13:42:08.030361+0000","last_active":"2024-04-25T13:42:34.139674+0000","last_peered":"2024-04-25T13:42:34.139674+0000","last_clean":"2024-04-25T13:42:34.139674+0000","last_became_active":"2024-04-25T13:42:08.029956+0000","last_became_peered":"2024-04-25T13:42:08.029956+0000","last_unstale":"2024-04-25T13:42:34.139674+0000","last_undegraded":"2024-04-25T13:42:34.139674+0000","last_fullsized":"2024-04-25T13:42:34.139674+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:50:24.375972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389561+0000","last_change":"2024-04-25T13:42:09.052062+0000","last_active":"2024-04-25T13:42:14.389561+0000","last_peered":"2024-04-25T13:42:14.389561+0000","last_clean":"2024-04-25T13:42:14.389561+0000","last_became_active":"2024-04-25T13:42:09.051642+0000","last_became_peered":"2024-04-25T13:42:09.051642+0000","last_unstale":"2024-04-25T13:42:14.389561+0000","last_undegraded":"2024-04-25T13:42:14.389561+0000","last_fullsized":"2024-04-25T13:42:14.389561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:31.228502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.076975+0000","last_change":"2024-04-25T13:42:13.083232+0000","last_active":"2024-04-25T13:42:14.076975+0000","last_peered":"2024-04-25T13:42:14.076975+0000","last_clean":"2024-04-25T13:42:14.076975+0000","last_became_active":"2024-04-25T13:42:13.082708+0000","last_became_peered":"2024-04-25T13:42:13.082708+0000","last_unstale":"2024-04-25T13:42:14.076975+0000","last_undegraded":"2024-04-25T13:42:14.076975+0000","last_fullsized":"2024-04-25T13:42:14.076975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:07.302207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"80'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.140742+0000","last_change":"2024-04-25T13:42:08.043775+0000","last_active":"2024-04-25T13:42:34.140742+0000","last_peered":"2024-04-25T13:42:34.140742+0000","last_clean":"2024-04-25T13:42:34.140742+0000","last_became_active":"2024-04-25T13:42:08.043399+0000","last_became_peered":"2024-04-25T13:42:08.043399+0000","last_unstale":"2024-04-25T13:42:34.140742+0000","last_undegraded":"2024-04-25T13:42:34.140742+0000","last_fullsized":"2024-04-25T13:42:34.140742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:41.768248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389469+0000","last_change":"2024-04-25T13:42:09.051145+0000","last_active":"2024-04-25T13:42:14.389469+0000","last_peered":"2024-04-25T13:42:14.389469+0000","last_clean":"2024-04-25T13:42:14.389469+0000","last_became_active":"2024-04-25T13:42:09.050796+0000","last_became_peered":"2024-04-25T13:42:09.050796+0000","last_unstale":"2024-04-25T13:42:14.389469+0000","last_undegraded":"2024-04-25T13:42:14.389469+0000","last_fullsized":"2024-04-25T13:42:14.389469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:37.195227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.795003+0000","last_change":"2024-04-25T13:42:13.079728+0000","last_active":"2024-04-25T13:42:14.795003+0000","last_peered":"2024-04-25T13:42:14.795003+0000","last_clean":"2024-04-25T13:42:14.795003+0000","last_became_active":"2024-04-25T13:42:13.079198+0000","last_became_peered":"2024-04-25T13:42:13.079198+0000","last_unstale":"2024-04-25T13:42:14.795003+0000","last_undegraded":"2024-04-25T13:42:14.795003+0000","last_fullsized":"2024-04-25T13:42:14.795003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:25.267778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.141535+0000","last_change":"2024-04-25T13:42:08.043885+0000","last_active":"2024-04-25T13:42:34.141535+0000","last_peered":"2024-04-25T13:42:34.141535+0000","last_clean":"2024-04-25T13:42:34.141535+0000","last_became_active":"2024-04-25T13:42:08.043363+0000","last_became_peered":"2024-04-25T13:42:08.043363+0000","last_unstale":"2024-04-25T13:42:34.141535+0000","last_undegraded":"2024-04-25T13:42:34.141535+0000","last_fullsized":"2024-04-25T13:42:34.141535+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:42.592286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391079+0000","last_change":"2024-04-25T13:42:09.054000+0000","last_active":"2024-04-25T13:42:14.391079+0000","last_peered":"2024-04-25T13:42:14.391079+0000","last_clean":"2024-04-25T13:42:14.391079+0000","last_became_active":"2024-04-25T13:42:09.053538+0000","last_became_peered":"2024-04-25T13:42:09.053538+0000","last_unstale":"2024-04-25T13:42:14.391079+0000","last_undegraded":"2024-04-25T13:42:14.391079+0000","last_fullsized":"2024-04-25T13:42:14.391079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:47.504591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390395+0000","last_change":"2024-04-25T13:42:13.086157+0000","last_active":"2024-04-25T13:42:14.390395+0000","last_peered":"2024-04-25T13:42:14.390395+0000","last_clean":"2024-04-25T13:42:14.390395+0000","last_became_active":"2024-04-25T13:42:13.085613+0000","last_became_peered":"2024-04-25T13:42:13.085613+0000","last_unstale":"2024-04-25T13:42:14.390395+0000","last_undegraded":"2024-04-25T13:42:14.390395+0000","last_fullsized":"2024-04-25T13:42:14.390395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:11.707675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390415+0000","last_change":"2024-04-25T13:42:08.034028+0000","last_active":"2024-04-25T13:42:14.390415+0000","last_peered":"2024-04-25T13:42:14.390415+0000","last_clean":"2024-04-25T13:42:14.390415+0000","last_became_active":"2024-04-25T13:42:08.033641+0000","last_became_peered":"2024-04-25T13:42:08.033641+0000","last_unstale":"2024-04-25T13:42:14.390415+0000","last_undegraded":"2024-04-25T13:42:14.390415+0000","last_fullsized":"2024-04-25T13:42:14.390415+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:34.081325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389771+0000","last_change":"2024-04-25T13:42:09.054594+0000","last_active":"2024-04-25T13:42:14.389771+0000","last_peered":"2024-04-25T13:42:14.389771+0000","last_clean":"2024-04-25T13:42:14.389771+0000","last_became_active":"2024-04-25T13:42:09.054215+0000","last_became_peered":"2024-04-25T13:42:09.054215+0000","last_unstale":"2024-04-25T13:42:14.389771+0000","last_undegraded":"2024-04-25T13:42:14.389771+0000","last_fullsized":"2024-04-25T13:42:14.389771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:56.129188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390948+0000","last_change":"2024-04-25T13:42:13.081325+0000","last_active":"2024-04-25T13:42:14.390948+0000","last_peered":"2024-04-25T13:42:14.390948+0000","last_clean":"2024-04-25T13:42:14.390948+0000","last_became_active":"2024-04-25T13:42:13.080641+0000","last_became_peered":"2024-04-25T13:42:13.080641+0000","last_unstale":"2024-04-25T13:42:14.390948+0000","last_undegraded":"2024-04-25T13:42:14.390948+0000","last_fullsized":"2024-04-25T13:42:14.390948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:45.839180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:35.147101+0000","last_change":"2024-04-25T13:42:08.037915+0000","last_active":"2024-04-25T13:42:35.147101+0000","last_peered":"2024-04-25T13:42:35.147101+0000","last_clean":"2024-04-25T13:42:35.147101+0000","last_became_active":"2024-04-25T13:42:08.037324+0000","last_became_peered":"2024-04-25T13:42:08.037324+0000","last_unstale":"2024-04-25T13:42:35.147101+0000","last_undegraded":"2024-04-25T13:42:35.147101+0000","last_fullsized":"2024-04-25T13:42:35.147101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:38.842821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.075902+0000","last_change":"2024-04-25T13:42:09.038795+0000","last_active":"2024-04-25T13:42:14.075902+0000","last_peered":"2024-04-25T13:42:14.075902+0000","last_clean":"2024-04-25T13:42:14.075902+0000","last_became_active":"2024-04-25T13:42:09.037635+0000","last_became_peered":"2024-04-25T13:42:09.037635+0000","last_unstale":"2024-04-25T13:42:14.075902+0000","last_undegraded":"2024-04-25T13:42:14.075902+0000","last_fullsized":"2024-04-25T13:42:14.075902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:46.616137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.075958+0000","last_change":"2024-04-25T13:42:13.081548+0000","last_active":"2024-04-25T13:42:14.075958+0000","last_peered":"2024-04-25T13:42:14.075958+0000","last_clean":"2024-04-25T13:42:14.075958+0000","last_became_active":"2024-04-25T13:42:13.080827+0000","last_became_peered":"2024-04-25T13:42:13.080827+0000","last_unstale":"2024-04-25T13:42:14.075958+0000","last_undegraded":"2024-04-25T13:42:14.075958+0000","last_fullsized":"2024-04-25T13:42:14.075958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:04.265824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:36.150460+0000","last_change":"2024-04-25T13:42:08.034171+0000","last_active":"2024-04-25T13:42:36.150460+0000","last_peered":"2024-04-25T13:42:36.150460+0000","last_clean":"2024-04-25T13:42:36.150460+0000","last_became_active":"2024-04-25T13:42:08.033769+0000","last_became_peered":"2024-04-25T13:42:08.033769+0000","last_unstale":"2024-04-25T13:42:36.150460+0000","last_undegraded":"2024-04-25T13:42:36.150460+0000","last_fullsized":"2024-04-25T13:42:36.150460+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:18.702989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.795130+0000","last_change":"2024-04-25T13:42:09.032212+0000","last_active":"2024-04-25T13:42:14.795130+0000","last_peered":"2024-04-25T13:42:14.795130+0000","last_clean":"2024-04-25T13:42:14.795130+0000","last_became_active":"2024-04-25T13:42:09.031833+0000","last_became_peered":"2024-04-25T13:42:09.031833+0000","last_unstale":"2024-04-25T13:42:14.795130+0000","last_undegraded":"2024-04-25T13:42:14.795130+0000","last_fullsized":"2024-04-25T13:42:14.795130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:27.681540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389195+0000","last_change":"2024-04-25T13:42:13.097322+0000","last_active":"2024-04-25T13:42:14.389195+0000","last_peered":"2024-04-25T13:42:14.389195+0000","last_clean":"2024-04-25T13:42:14.389195+0000","last_became_active":"2024-04-25T13:42:13.096869+0000","last_became_peered":"2024-04-25T13:42:13.096869+0000","last_unstale":"2024-04-25T13:42:14.389195+0000","last_undegraded":"2024-04-25T13:42:14.389195+0000","last_fullsized":"2024-04-25T13:42:14.389195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:53.041859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389670+0000","last_change":"2024-04-25T13:42:08.041834+0000","last_active":"2024-04-25T13:42:14.389670+0000","last_peered":"2024-04-25T13:42:14.389670+0000","last_clean":"2024-04-25T13:42:14.389670+0000","last_became_active":"2024-04-25T13:42:08.041246+0000","last_became_peered":"2024-04-25T13:42:08.041246+0000","last_unstale":"2024-04-25T13:42:14.389670+0000","last_undegraded":"2024-04-25T13:42:14.389670+0000","last_fullsized":"2024-04-25T13:42:14.389670+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:34.256539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389848+0000","last_change":"2024-04-25T13:42:09.044640+0000","last_active":"2024-04-25T13:42:14.389848+0000","last_peered":"2024-04-25T13:42:14.389848+0000","last_clean":"2024-04-25T13:42:14.389848+0000","last_became_active":"2024-04-25T13:42:09.044267+0000","last_became_peered":"2024-04-25T13:42:09.044267+0000","last_unstale":"2024-04-25T13:42:14.389848+0000","last_undegraded":"2024-04-25T13:42:14.389848+0000","last_fullsized":"2024-04-25T13:42:14.389848+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:47.934990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390566+0000","last_change":"2024-04-25T13:42:13.065858+0000","last_active":"2024-04-25T13:42:14.390566+0000","last_peered":"2024-04-25T13:42:14.390566+0000","last_clean":"2024-04-25T13:42:14.390566+0000","last_became_active":"2024-04-25T13:42:13.065315+0000","last_became_peered":"2024-04-25T13:42:13.065315+0000","last_unstale":"2024-04-25T13:42:14.390566+0000","last_undegraded":"2024-04-25T13:42:14.390566+0000","last_fullsized":"2024-04-25T13:42:14.390566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:41.116887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390566+0000","last_change":"2024-04-25T13:42:08.031548+0000","last_active":"2024-04-25T13:42:14.390566+0000","last_peered":"2024-04-25T13:42:14.390566+0000","last_clean":"2024-04-25T13:42:14.390566+0000","last_became_active":"2024-04-25T13:42:08.031147+0000","last_became_peered":"2024-04-25T13:42:08.031147+0000","last_unstale":"2024-04-25T13:42:14.390566+0000","last_undegraded":"2024-04-25T13:42:14.390566+0000","last_fullsized":"2024-04-25T13:42:14.390566+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:37.941234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390726+0000","last_change":"2024-04-25T13:42:09.048203+0000","last_active":"2024-04-25T13:42:14.390726+0000","last_peered":"2024-04-25T13:42:14.390726+0000","last_clean":"2024-04-25T13:42:14.390726+0000","last_became_active":"2024-04-25T13:42:09.047848+0000","last_became_peered":"2024-04-25T13:42:09.047848+0000","last_unstale":"2024-04-25T13:42:14.390726+0000","last_undegraded":"2024-04-25T13:42:14.390726+0000","last_fullsized":"2024-04-25T13:42:14.390726+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:27.829387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390823+0000","last_change":"2024-04-25T13:42:13.097390+0000","last_active":"2024-04-25T13:42:14.390823+0000","last_peered":"2024-04-25T13:42:14.390823+0000","last_clean":"2024-04-25T13:42:14.390823+0000","last_became_active":"2024-04-25T13:42:13.096795+0000","last_became_peered":"2024-04-25T13:42:13.096795+0000","last_unstale":"2024-04-25T13:42:14.390823+0000","last_undegraded":"2024-04-25T13:42:14.390823+0000","last_fullsized":"2024-04-25T13:42:14.390823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:15.401248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.076162+0000","last_change":"2024-04-25T13:42:09.038362+0000","last_active":"2024-04-25T13:42:14.076162+0000","last_peered":"2024-04-25T13:42:14.076162+0000","last_clean":"2024-04-25T13:42:14.076162+0000","last_became_active":"2024-04-25T13:42:09.037974+0000","last_became_peered":"2024-04-25T13:42:09.037974+0000","last_unstale":"2024-04-25T13:42:14.076162+0000","last_undegraded":"2024-04-25T13:42:14.076162+0000","last_fullsized":"2024-04-25T13:42:14.076162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:37.471217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:36.152116+0000","last_change":"2024-04-25T13:42:08.033967+0000","last_active":"2024-04-25T13:42:36.152116+0000","last_peered":"2024-04-25T13:42:36.152116+0000","last_clean":"2024-04-25T13:42:36.152116+0000","last_became_active":"2024-04-25T13:42:08.032906+0000","last_became_peered":"2024-04-25T13:42:08.032906+0000","last_unstale":"2024-04-25T13:42:36.152116+0000","last_undegraded":"2024-04-25T13:42:36.152116+0000","last_fullsized":"2024-04-25T13:42:36.152116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:49:10.012114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391510+0000","last_change":"2024-04-25T13:42:13.072944+0000","last_active":"2024-04-25T13:42:14.391510+0000","last_peered":"2024-04-25T13:42:14.391510+0000","last_clean":"2024-04-25T13:42:14.391510+0000","last_became_active":"2024-04-25T13:42:13.070990+0000","last_became_peered":"2024-04-25T13:42:13.070990+0000","last_unstale":"2024-04-25T13:42:14.391510+0000","last_undegraded":"2024-04-25T13:42:14.391510+0000","last_fullsized":"2024-04-25T13:42:14.391510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:18:24.946987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073010+0000","last_change":"2024-04-25T13:42:09.054270+0000","last_active":"2024-04-25T13:42:14.073010+0000","last_peered":"2024-04-25T13:42:14.073010+0000","last_clean":"2024-04-25T13:42:14.073010+0000","last_became_active":"2024-04-25T13:42:09.052333+0000","last_became_peered":"2024-04-25T13:42:09.052333+0000","last_unstale":"2024-04-25T13:42:14.073010+0000","last_undegraded":"2024-04-25T13:42:14.073010+0000","last_fullsized":"2024-04-25T13:42:14.073010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:52.401036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.141313+0000","last_change":"2024-04-25T13:42:08.033855+0000","last_active":"2024-04-25T13:42:34.141313+0000","last_peered":"2024-04-25T13:42:34.141313+0000","last_clean":"2024-04-25T13:42:34.141313+0000","last_became_active":"2024-04-25T13:42:08.033437+0000","last_became_peered":"2024-04-25T13:42:08.033437+0000","last_unstale":"2024-04-25T13:42:34.141313+0000","last_undegraded":"2024-04-25T13:42:34.141313+0000","last_fullsized":"2024-04-25T13:42:34.141313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:15.009423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389533+0000","last_change":"2024-04-25T13:40:53.040500+0000","last_active":"2024-04-25T13:42:14.389533+0000","last_peered":"2024-04-25T13:42:14.389533+0000","last_clean":"2024-04-25T13:42:14.389533+0000","last_became_active":"2024-04-25T13:40:53.034705+0000","last_became_peered":"2024-04-25T13:40:53.034705+0000","last_unstale":"2024-04-25T13:42:14.389533+0000","last_undegraded":"2024-04-25T13:42:14.389533+0000","last_fullsized":"2024-04-25T13:42:14.389533+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:37:26.143320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:37:26.143320+0000","last_clean_scrub_stamp":"2024-04-25T13:37:26.143320+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:39.342123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.076674+0000","last_change":"2024-04-25T13:42:13.097813+0000","last_active":"2024-04-25T13:42:14.076674+0000","last_peered":"2024-04-25T13:42:14.076674+0000","last_clean":"2024-04-25T13:42:14.076674+0000","last_became_active":"2024-04-25T13:42:13.096961+0000","last_became_peered":"2024-04-25T13:42:13.096961+0000","last_unstale":"2024-04-25T13:42:14.076674+0000","last_undegraded":"2024-04-25T13:42:14.076674+0000","last_fullsized":"2024-04-25T13:42:14.076674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:54.995639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.388909+0000","last_change":"2024-04-25T13:42:09.048826+0000","last_active":"2024-04-25T13:42:14.388909+0000","last_peered":"2024-04-25T13:42:14.388909+0000","last_clean":"2024-04-25T13:42:14.388909+0000","last_became_active":"2024-04-25T13:42:09.048454+0000","last_became_peered":"2024-04-25T13:42:09.048454+0000","last_unstale":"2024-04-25T13:42:14.388909+0000","last_undegraded":"2024-04-25T13:42:14.388909+0000","last_fullsized":"2024-04-25T13:42:14.388909+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:39:21.258720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:35.145085+0000","last_change":"2024-04-25T13:42:08.037788+0000","last_active":"2024-04-25T13:42:35.145085+0000","last_peered":"2024-04-25T13:42:35.145085+0000","last_clean":"2024-04-25T13:42:35.145085+0000","last_became_active":"2024-04-25T13:42:08.036707+0000","last_became_peered":"2024-04-25T13:42:08.036707+0000","last_unstale":"2024-04-25T13:42:35.145085+0000","last_undegraded":"2024-04-25T13:42:35.145085+0000","last_fullsized":"2024-04-25T13:42:35.145085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:09.835773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.794987+0000","last_change":"2024-04-25T13:42:13.079707+0000","last_active":"2024-04-25T13:42:14.794987+0000","last_peered":"2024-04-25T13:42:14.794987+0000","last_clean":"2024-04-25T13:42:14.794987+0000","last_became_active":"2024-04-25T13:42:13.079191+0000","last_became_peered":"2024-04-25T13:42:13.079191+0000","last_unstale":"2024-04-25T13:42:14.794987+0000","last_undegraded":"2024-04-25T13:42:14.794987+0000","last_fullsized":"2024-04-25T13:42:14.794987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:28.733884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.136782+0000","last_change":"2024-04-25T13:42:08.043402+0000","last_active":"2024-04-25T13:42:34.136782+0000","last_peered":"2024-04-25T13:42:34.136782+0000","last_clean":"2024-04-25T13:42:34.136782+0000","last_became_active":"2024-04-25T13:42:08.043059+0000","last_became_peered":"2024-04-25T13:42:08.043059+0000","last_unstale":"2024-04-25T13:42:34.136782+0000","last_undegraded":"2024-04-25T13:42:34.136782+0000","last_fullsized":"2024-04-25T13:42:34.136782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:36.533869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391059+0000","last_change":"2024-04-25T13:42:09.037287+0000","last_active":"2024-04-25T13:42:14.391059+0000","last_peered":"2024-04-25T13:42:14.391059+0000","last_clean":"2024-04-25T13:42:14.391059+0000","last_became_active":"2024-04-25T13:42:09.036944+0000","last_became_peered":"2024-04-25T13:42:09.036944+0000","last_unstale":"2024-04-25T13:42:14.391059+0000","last_undegraded":"2024-04-25T13:42:14.391059+0000","last_fullsized":"2024-04-25T13:42:14.391059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:43.675505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073010+0000","last_change":"2024-04-25T13:42:13.097645+0000","last_active":"2024-04-25T13:42:14.073010+0000","last_peered":"2024-04-25T13:42:14.073010+0000","last_clean":"2024-04-25T13:42:14.073010+0000","last_became_active":"2024-04-25T13:42:13.096881+0000","last_became_peered":"2024-04-25T13:42:13.096881+0000","last_unstale":"2024-04-25T13:42:14.073010+0000","last_undegraded":"2024-04-25T13:42:14.073010+0000","last_fullsized":"2024-04-25T13:42:14.073010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:03.957250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"76'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390088+0000","last_change":"2024-04-25T13:42:08.044040+0000","last_active":"2024-04-25T13:42:14.390088+0000","last_peered":"2024-04-25T13:42:14.390088+0000","last_clean":"2024-04-25T13:42:14.390088+0000","last_became_active":"2024-04-25T13:42:08.043590+0000","last_became_peered":"2024-04-25T13:42:08.043590+0000","last_unstale":"2024-04-25T13:42:14.390088+0000","last_undegraded":"2024-04-25T13:42:14.390088+0000","last_fullsized":"2024-04-25T13:42:14.390088+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:12.780050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073627+0000","last_change":"2024-04-25T13:42:09.051254+0000","last_active":"2024-04-25T13:42:14.073627+0000","last_peered":"2024-04-25T13:42:14.073627+0000","last_clean":"2024-04-25T13:42:14.073627+0000","last_became_active":"2024-04-25T13:42:09.050899+0000","last_became_peered":"2024-04-25T13:42:09.050899+0000","last_unstale":"2024-04-25T13:42:14.073627+0000","last_undegraded":"2024-04-25T13:42:14.073627+0000","last_fullsized":"2024-04-25T13:42:14.073627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:48.851445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389060+0000","last_change":"2024-04-25T13:42:13.070375+0000","last_active":"2024-04-25T13:42:14.389060+0000","last_peered":"2024-04-25T13:42:14.389060+0000","last_clean":"2024-04-25T13:42:14.389060+0000","last_became_active":"2024-04-25T13:42:13.069571+0000","last_became_peered":"2024-04-25T13:42:13.069571+0000","last_unstale":"2024-04-25T13:42:14.389060+0000","last_undegraded":"2024-04-25T13:42:14.389060+0000","last_fullsized":"2024-04-25T13:42:14.389060+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:40.878206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.137560+0000","last_change":"2024-04-25T13:42:08.043596+0000","last_active":"2024-04-25T13:42:34.137560+0000","last_peered":"2024-04-25T13:42:34.137560+0000","last_clean":"2024-04-25T13:42:34.137560+0000","last_became_active":"2024-04-25T13:42:08.043233+0000","last_became_peered":"2024-04-25T13:42:08.043233+0000","last_unstale":"2024-04-25T13:42:34.137560+0000","last_undegraded":"2024-04-25T13:42:34.137560+0000","last_fullsized":"2024-04-25T13:42:34.137560+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:31.126367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390257+0000","last_change":"2024-04-25T13:42:09.045131+0000","last_active":"2024-04-25T13:42:14.390257+0000","last_peered":"2024-04-25T13:42:14.390257+0000","last_clean":"2024-04-25T13:42:14.390257+0000","last_became_active":"2024-04-25T13:42:09.044566+0000","last_became_peered":"2024-04-25T13:42:09.044566+0000","last_unstale":"2024-04-25T13:42:14.390257+0000","last_undegraded":"2024-04-25T13:42:14.390257+0000","last_fullsized":"2024-04-25T13:42:14.390257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:25.540538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389637+0000","last_change":"2024-04-25T13:42:13.097509+0000","last_active":"2024-04-25T13:42:14.389637+0000","last_peered":"2024-04-25T13:42:14.389637+0000","last_clean":"2024-04-25T13:42:14.389637+0000","last_became_active":"2024-04-25T13:42:13.096970+0000","last_became_peered":"2024-04-25T13:42:13.096970+0000","last_unstale":"2024-04-25T13:42:14.389637+0000","last_undegraded":"2024-04-25T13:42:14.389637+0000","last_fullsized":"2024-04-25T13:42:14.389637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:38.891212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.139281+0000","last_change":"2024-04-25T13:42:08.033992+0000","last_active":"2024-04-25T13:42:34.139281+0000","last_peered":"2024-04-25T13:42:34.139281+0000","last_clean":"2024-04-25T13:42:34.139281+0000","last_became_active":"2024-04-25T13:42:08.033603+0000","last_became_peered":"2024-04-25T13:42:08.033603+0000","last_unstale":"2024-04-25T13:42:34.139281+0000","last_undegraded":"2024-04-25T13:42:34.139281+0000","last_fullsized":"2024-04-25T13:42:34.139281+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:06.552660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.388701+0000","last_change":"2024-04-25T13:42:09.040719+0000","last_active":"2024-04-25T13:42:14.388701+0000","last_peered":"2024-04-25T13:42:14.388701+0000","last_clean":"2024-04-25T13:42:14.388701+0000","last_became_active":"2024-04-25T13:42:09.038144+0000","last_became_peered":"2024-04-25T13:42:09.038144+0000","last_unstale":"2024-04-25T13:42:14.388701+0000","last_undegraded":"2024-04-25T13:42:14.388701+0000","last_fullsized":"2024-04-25T13:42:14.388701+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:20.095587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390603+0000","last_change":"2024-04-25T13:42:13.086133+0000","last_active":"2024-04-25T13:42:14.390603+0000","last_peered":"2024-04-25T13:42:14.390603+0000","last_clean":"2024-04-25T13:42:14.390603+0000","last_became_active":"2024-04-25T13:42:13.085616+0000","last_became_peered":"2024-04-25T13:42:13.085616+0000","last_unstale":"2024-04-25T13:42:14.390603+0000","last_undegraded":"2024-04-25T13:42:14.390603+0000","last_fullsized":"2024-04-25T13:42:14.390603+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:45.939319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.138860+0000","last_change":"2024-04-25T13:42:08.028526+0000","last_active":"2024-04-25T13:42:34.138860+0000","last_peered":"2024-04-25T13:42:34.138860+0000","last_clean":"2024-04-25T13:42:34.138860+0000","last_became_active":"2024-04-25T13:42:08.028056+0000","last_became_peered":"2024-04-25T13:42:08.028056+0000","last_unstale":"2024-04-25T13:42:34.138860+0000","last_undegraded":"2024-04-25T13:42:34.138860+0000","last_fullsized":"2024-04-25T13:42:34.138860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:47.433236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.794780+0000","last_change":"2024-04-25T13:42:09.058985+0000","last_active":"2024-04-25T13:42:14.794780+0000","last_peered":"2024-04-25T13:42:14.794780+0000","last_clean":"2024-04-25T13:42:14.794780+0000","last_became_active":"2024-04-25T13:42:09.058638+0000","last_became_peered":"2024-04-25T13:42:09.058638+0000","last_unstale":"2024-04-25T13:42:14.794780+0000","last_undegraded":"2024-04-25T13:42:14.794780+0000","last_fullsized":"2024-04-25T13:42:14.794780+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:04.956881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390153+0000","last_change":"2024-04-25T13:42:13.074598+0000","last_active":"2024-04-25T13:42:14.390153+0000","last_peered":"2024-04-25T13:42:14.390153+0000","last_clean":"2024-04-25T13:42:14.390153+0000","last_became_active":"2024-04-25T13:42:13.074129+0000","last_became_peered":"2024-04-25T13:42:13.074129+0000","last_unstale":"2024-04-25T13:42:14.390153+0000","last_undegraded":"2024-04-25T13:42:14.390153+0000","last_fullsized":"2024-04-25T13:42:14.390153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:31.054517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.388843+0000","last_change":"2024-04-25T13:42:08.043962+0000","last_active":"2024-04-25T13:42:14.388843+0000","last_peered":"2024-04-25T13:42:14.388843+0000","last_clean":"2024-04-25T13:42:14.388843+0000","last_became_active":"2024-04-25T13:42:08.043526+0000","last_became_peered":"2024-04-25T13:42:08.043526+0000","last_unstale":"2024-04-25T13:42:14.388843+0000","last_undegraded":"2024-04-25T13:42:14.388843+0000","last_fullsized":"2024-04-25T13:42:14.388843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:22.766138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073284+0000","last_change":"2024-04-25T13:42:09.048574+0000","last_active":"2024-04-25T13:42:14.073284+0000","last_peered":"2024-04-25T13:42:14.073284+0000","last_clean":"2024-04-25T13:42:14.073284+0000","last_became_active":"2024-04-25T13:42:09.047982+0000","last_became_peered":"2024-04-25T13:42:09.047982+0000","last_unstale":"2024-04-25T13:42:14.073284+0000","last_undegraded":"2024-04-25T13:42:14.073284+0000","last_fullsized":"2024-04-25T13:42:14.073284+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:00.898772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389643+0000","last_change":"2024-04-25T13:42:13.097637+0000","last_active":"2024-04-25T13:42:14.389643+0000","last_peered":"2024-04-25T13:42:14.389643+0000","last_clean":"2024-04-25T13:42:14.389643+0000","last_became_active":"2024-04-25T13:42:13.096790+0000","last_became_peered":"2024-04-25T13:42:13.096790+0000","last_unstale":"2024-04-25T13:42:14.389643+0000","last_undegraded":"2024-04-25T13:42:14.389643+0000","last_fullsized":"2024-04-25T13:42:14.389643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:54.174615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.139937+0000","last_change":"2024-04-25T13:42:08.040207+0000","last_active":"2024-04-25T13:42:34.139937+0000","last_peered":"2024-04-25T13:42:34.139937+0000","last_clean":"2024-04-25T13:42:34.139937+0000","last_became_active":"2024-04-25T13:42:08.039809+0000","last_became_peered":"2024-04-25T13:42:08.039809+0000","last_unstale":"2024-04-25T13:42:34.139937+0000","last_undegraded":"2024-04-25T13:42:34.139937+0000","last_fullsized":"2024-04-25T13:42:34.139937+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:12.084793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390702+0000","last_change":"2024-04-25T13:42:09.048040+0000","last_active":"2024-04-25T13:42:14.390702+0000","last_peered":"2024-04-25T13:42:14.390702+0000","last_clean":"2024-04-25T13:42:14.390702+0000","last_became_active":"2024-04-25T13:42:09.047662+0000","last_became_peered":"2024-04-25T13:42:09.047662+0000","last_unstale":"2024-04-25T13:42:14.390702+0000","last_undegraded":"2024-04-25T13:42:14.390702+0000","last_fullsized":"2024-04-25T13:42:14.390702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:10:17.675167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073781+0000","last_change":"2024-04-25T13:42:13.072706+0000","last_active":"2024-04-25T13:42:14.073781+0000","last_peered":"2024-04-25T13:42:14.073781+0000","last_clean":"2024-04-25T13:42:14.073781+0000","last_became_active":"2024-04-25T13:42:13.071525+0000","last_became_peered":"2024-04-25T13:42:13.071525+0000","last_unstale":"2024-04-25T13:42:14.073781+0000","last_undegraded":"2024-04-25T13:42:14.073781+0000","last_fullsized":"2024-04-25T13:42:14.073781+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:20.351817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389916+0000","last_change":"2024-04-25T13:42:08.033975+0000","last_active":"2024-04-25T13:42:14.389916+0000","last_peered":"2024-04-25T13:42:14.389916+0000","last_clean":"2024-04-25T13:42:14.389916+0000","last_became_active":"2024-04-25T13:42:08.033302+0000","last_became_peered":"2024-04-25T13:42:08.033302+0000","last_unstale":"2024-04-25T13:42:14.389916+0000","last_undegraded":"2024-04-25T13:42:14.389916+0000","last_fullsized":"2024-04-25T13:42:14.389916+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:57:57.561629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391613+0000","last_change":"2024-04-25T13:42:09.052457+0000","last_active":"2024-04-25T13:42:14.391613+0000","last_peered":"2024-04-25T13:42:14.391613+0000","last_clean":"2024-04-25T13:42:14.391613+0000","last_became_active":"2024-04-25T13:42:09.052052+0000","last_became_peered":"2024-04-25T13:42:09.052052+0000","last_unstale":"2024-04-25T13:42:14.391613+0000","last_undegraded":"2024-04-25T13:42:14.391613+0000","last_fullsized":"2024-04-25T13:42:14.391613+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:42.589178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390943+0000","last_change":"2024-04-25T13:42:13.070743+0000","last_active":"2024-04-25T13:42:14.390943+0000","last_peered":"2024-04-25T13:42:14.390943+0000","last_clean":"2024-04-25T13:42:14.390943+0000","last_became_active":"2024-04-25T13:42:13.070251+0000","last_became_peered":"2024-04-25T13:42:13.070251+0000","last_unstale":"2024-04-25T13:42:14.390943+0000","last_undegraded":"2024-04-25T13:42:14.390943+0000","last_fullsized":"2024-04-25T13:42:14.390943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:19.646015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.076652+0000","last_change":"2024-04-25T13:42:08.044578+0000","last_active":"2024-04-25T13:42:14.076652+0000","last_peered":"2024-04-25T13:42:14.076652+0000","last_clean":"2024-04-25T13:42:14.076652+0000","last_became_active":"2024-04-25T13:42:08.044194+0000","last_became_peered":"2024-04-25T13:42:08.044194+0000","last_unstale":"2024-04-25T13:42:14.076652+0000","last_undegraded":"2024-04-25T13:42:14.076652+0000","last_fullsized":"2024-04-25T13:42:14.076652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:58.413832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391300+0000","last_change":"2024-04-25T13:42:09.051150+0000","last_active":"2024-04-25T13:42:14.391300+0000","last_peered":"2024-04-25T13:42:14.391300+0000","last_clean":"2024-04-25T13:42:14.391300+0000","last_became_active":"2024-04-25T13:42:09.050747+0000","last_became_peered":"2024-04-25T13:42:09.050747+0000","last_unstale":"2024-04-25T13:42:14.391300+0000","last_undegraded":"2024-04-25T13:42:14.391300+0000","last_fullsized":"2024-04-25T13:42:14.391300+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:10.923728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.075784+0000","last_change":"2024-04-25T13:42:13.075405+0000","last_active":"2024-04-25T13:42:14.075784+0000","last_peered":"2024-04-25T13:42:14.075784+0000","last_clean":"2024-04-25T13:42:14.075784+0000","last_became_active":"2024-04-25T13:42:13.074989+0000","last_became_peered":"2024-04-25T13:42:13.074989+0000","last_unstale":"2024-04-25T13:42:14.075784+0000","last_undegraded":"2024-04-25T13:42:14.075784+0000","last_fullsized":"2024-04-25T13:42:14.075784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:44.544984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390929+0000","last_change":"2024-04-25T13:42:08.033305+0000","last_active":"2024-04-25T13:42:14.390929+0000","last_peered":"2024-04-25T13:42:14.390929+0000","last_clean":"2024-04-25T13:42:14.390929+0000","last_became_active":"2024-04-25T13:42:08.032879+0000","last_became_peered":"2024-04-25T13:42:08.032879+0000","last_unstale":"2024-04-25T13:42:14.390929+0000","last_undegraded":"2024-04-25T13:42:14.390929+0000","last_fullsized":"2024-04-25T13:42:14.390929+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:53.170913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391728+0000","last_change":"2024-04-25T13:42:09.054682+0000","last_active":"2024-04-25T13:42:14.391728+0000","last_peered":"2024-04-25T13:42:14.391728+0000","last_clean":"2024-04-25T13:42:14.391728+0000","last_became_active":"2024-04-25T13:42:09.051962+0000","last_became_peered":"2024-04-25T13:42:09.051962+0000","last_unstale":"2024-04-25T13:42:14.391728+0000","last_undegraded":"2024-04-25T13:42:14.391728+0000","last_fullsized":"2024-04-25T13:42:14.391728+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:50.799284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.794820+0000","last_change":"2024-04-25T13:42:09.040062+0000","last_active":"2024-04-25T13:42:14.794820+0000","last_peered":"2024-04-25T13:42:14.794820+0000","last_clean":"2024-04-25T13:42:14.794820+0000","last_became_active":"2024-04-25T13:42:09.039692+0000","last_became_peered":"2024-04-25T13:42:09.039692+0000","last_unstale":"2024-04-25T13:42:14.794820+0000","last_undegraded":"2024-04-25T13:42:14.794820+0000","last_fullsized":"2024-04-25T13:42:14.794820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:48.527698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389205+0000","last_change":"2024-04-25T13:42:09.043357+0000","last_active":"2024-04-25T13:42:14.389205+0000","last_peered":"2024-04-25T13:42:14.389205+0000","last_clean":"2024-04-25T13:42:14.389205+0000","last_became_active":"2024-04-25T13:42:09.039984+0000","last_became_peered":"2024-04-25T13:42:09.039984+0000","last_unstale":"2024-04-25T13:42:14.389205+0000","last_undegraded":"2024-04-25T13:42:14.389205+0000","last_fullsized":"2024-04-25T13:42:14.389205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:07.852924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.388782+0000","last_change":"2024-04-25T13:42:09.064663+0000","last_active":"2024-04-25T13:42:14.388782+0000","last_peered":"2024-04-25T13:42:14.388782+0000","last_clean":"2024-04-25T13:42:14.388782+0000","last_became_active":"2024-04-25T13:42:09.064202+0000","last_became_peered":"2024-04-25T13:42:09.064202+0000","last_unstale":"2024-04-25T13:42:14.388782+0000","last_undegraded":"2024-04-25T13:42:14.388782+0000","last_fullsized":"2024-04-25T13:42:14.388782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:48.611882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391037+0000","last_change":"2024-04-25T13:42:09.066196+0000","last_active":"2024-04-25T13:42:14.391037+0000","last_peered":"2024-04-25T13:42:14.391037+0000","last_clean":"2024-04-25T13:42:14.391037+0000","last_became_active":"2024-04-25T13:42:09.065793+0000","last_became_peered":"2024-04-25T13:42:09.065793+0000","last_unstale":"2024-04-25T13:42:14.391037+0000","last_undegraded":"2024-04-25T13:42:14.391037+0000","last_fullsized":"2024-04-25T13:42:14.391037+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:26.557457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390700+0000","last_change":"2024-04-25T13:42:09.063229+0000","last_active":"2024-04-25T13:42:14.390700+0000","last_peered":"2024-04-25T13:42:14.390700+0000","last_clean":"2024-04-25T13:42:14.390700+0000","last_became_active":"2024-04-25T13:42:09.062884+0000","last_became_peered":"2024-04-25T13:42:09.062884+0000","last_unstale":"2024-04-25T13:42:14.390700+0000","last_undegraded":"2024-04-25T13:42:14.390700+0000","last_fullsized":"2024-04-25T13:42:14.390700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:17.478141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.795278+0000","last_change":"2024-04-25T13:42:09.031731+0000","last_active":"2024-04-25T13:42:14.795278+0000","last_peered":"2024-04-25T13:42:14.795278+0000","last_clean":"2024-04-25T13:42:14.795278+0000","last_became_active":"2024-04-25T13:42:09.031316+0000","last_became_peered":"2024-04-25T13:42:09.031316+0000","last_unstale":"2024-04-25T13:42:14.795278+0000","last_undegraded":"2024-04-25T13:42:14.795278+0000","last_fullsized":"2024-04-25T13:42:14.795278+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:34.210437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389371+0000","last_change":"2024-04-25T13:42:09.034429+0000","last_active":"2024-04-25T13:42:14.389371+0000","last_peered":"2024-04-25T13:42:14.389371+0000","last_clean":"2024-04-25T13:42:14.389371+0000","last_became_active":"2024-04-25T13:42:09.033917+0000","last_became_peered":"2024-04-25T13:42:09.033917+0000","last_unstale":"2024-04-25T13:42:14.389371+0000","last_undegraded":"2024-04-25T13:42:14.389371+0000","last_fullsized":"2024-04-25T13:42:14.389371+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:16.572251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073727+0000","last_change":"2024-04-25T13:42:09.060585+0000","last_active":"2024-04-25T13:42:14.073727+0000","last_peered":"2024-04-25T13:42:14.073727+0000","last_clean":"2024-04-25T13:42:14.073727+0000","last_became_active":"2024-04-25T13:42:09.058624+0000","last_became_peered":"2024-04-25T13:42:09.058624+0000","last_unstale":"2024-04-25T13:42:14.073727+0000","last_undegraded":"2024-04-25T13:42:14.073727+0000","last_fullsized":"2024-04-25T13:42:14.073727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:30.996402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.075980+0000","last_change":"2024-04-25T13:42:09.057544+0000","last_active":"2024-04-25T13:42:14.075980+0000","last_peered":"2024-04-25T13:42:14.075980+0000","last_clean":"2024-04-25T13:42:14.075980+0000","last_became_active":"2024-04-25T13:42:09.057127+0000","last_became_peered":"2024-04-25T13:42:09.057127+0000","last_unstale":"2024-04-25T13:42:14.075980+0000","last_undegraded":"2024-04-25T13:42:14.075980+0000","last_fullsized":"2024-04-25T13:42:14.075980+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:57.394029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073436+0000","last_change":"2024-04-25T13:42:09.057102+0000","last_active":"2024-04-25T13:42:14.073436+0000","last_peered":"2024-04-25T13:42:14.073436+0000","last_clean":"2024-04-25T13:42:14.073436+0000","last_became_active":"2024-04-25T13:42:09.056785+0000","last_became_peered":"2024-04-25T13:42:09.056785+0000","last_unstale":"2024-04-25T13:42:14.073436+0000","last_undegraded":"2024-04-25T13:42:14.073436+0000","last_fullsized":"2024-04-25T13:42:14.073436+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:57.278485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073845+0000","last_change":"2024-04-25T13:42:09.045717+0000","last_active":"2024-04-25T13:42:14.073845+0000","last_peered":"2024-04-25T13:42:14.073845+0000","last_clean":"2024-04-25T13:42:14.073845+0000","last_became_active":"2024-04-25T13:42:09.045346+0000","last_became_peered":"2024-04-25T13:42:09.045346+0000","last_unstale":"2024-04-25T13:42:14.073845+0000","last_undegraded":"2024-04-25T13:42:14.073845+0000","last_fullsized":"2024-04-25T13:42:14.073845+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:53.731004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390199+0000","last_change":"2024-04-25T13:42:09.061956+0000","last_active":"2024-04-25T13:42:14.390199+0000","last_peered":"2024-04-25T13:42:14.390199+0000","last_clean":"2024-04-25T13:42:14.390199+0000","last_became_active":"2024-04-25T13:42:09.061589+0000","last_became_peered":"2024-04-25T13:42:09.061589+0000","last_unstale":"2024-04-25T13:42:14.390199+0000","last_undegraded":"2024-04-25T13:42:14.390199+0000","last_fullsized":"2024-04-25T13:42:14.390199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:34.535044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.794927+0000","last_change":"2024-04-25T13:42:09.033976+0000","last_active":"2024-04-25T13:42:14.794927+0000","last_peered":"2024-04-25T13:42:14.794927+0000","last_clean":"2024-04-25T13:42:14.794927+0000","last_became_active":"2024-04-25T13:42:09.033136+0000","last_became_peered":"2024-04-25T13:42:09.033136+0000","last_unstale":"2024-04-25T13:42:14.794927+0000","last_undegraded":"2024-04-25T13:42:14.794927+0000","last_fullsized":"2024-04-25T13:42:14.794927+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:30.331233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6248,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":109,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":20725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678034,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":876544,"data_stored":425507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874263,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1507328,"data_stored":1020673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037789,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":426291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234018,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":897024,"data_stored":426245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430247,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28468,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716684,"statfs":{"total":95995035648,"available":95965884416,"internally_reserved":0,"allocated":1486848,"data_stored":1017667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593773,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":880640,"data_stored":425597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":888832,"data_stored":429349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":905216,"data_stored":426985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":430005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149756,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":888832,"data_stored":425701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953526,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":425529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790002,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36800,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708352,"statfs":{"total":95995035648,"available":95957352448,"internally_reserved":0,"allocated":1499136,"data_stored":1017351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:42:39.078 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:42:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.223+0000 7efff6049640 1 -- 172.21.15.43:0/500429183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff0106f50 msgr2=0x7efff0109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.223+0000 7efff6049640 1 --2- 172.21.15.43:0/500429183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff0106f50 0x7efff0109370 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7effe4009900 tx=0x7effe402a410 comp rx=0 tx=0).stop 2024-04-25T13:42:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.223+0000 7efff6049640 1 -- 172.21.15.43:0/500429183 shutdown_connections 2024-04-25T13:42:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.223+0000 7efff6049640 1 --2- 172.21.15.43:0/500429183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efff01098b0 0x7efff010bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.223+0000 7efff6049640 1 --2- 172.21.15.43:0/500429183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff0106f50 0x7efff0109370 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.223+0000 7efff6049640 1 --2- 172.21.15.43:0/500429183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff01045f0 0x7efff0106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.223+0000 7efff6049640 1 -- 172.21.15.43:0/500429183 >> 172.21.15.43:0/500429183 conn(0x7efff00fdbf0 msgr2=0x7efff01000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.223+0000 7efff6049640 1 -- 172.21.15.43:0/500429183 shutdown_connections 2024-04-25T13:42:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.223+0000 7efff6049640 1 -- 172.21.15.43:0/500429183 wait complete. 2024-04-25T13:42:39.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.224+0000 7efff6049640 1 Processor -- start 2024-04-25T13:42:39.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.224+0000 7efff6049640 1 -- start start 2024-04-25T13:42:39.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.224+0000 7efff6049640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff01045f0 0x7efff019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.224+0000 7efff6049640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efff0106f50 0x7efff019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.224+0000 7efff6049640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff01098b0 0x7efff01a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.224+0000 7efff6049640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efff010f4e0 con 0x7efff01098b0 2024-04-25T13:42:39.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.224+0000 7efff6049640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7efff010f360 con 0x7efff01045f0 2024-04-25T13:42:39.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.224+0000 7efff6049640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efff010f660 con 0x7efff0106f50 2024-04-25T13:42:39.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.225+0000 7effeffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff01098b0 0x7efff01a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.225+0000 7effeffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff01098b0 0x7efff01a1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44260/0 (socket says 172.21.15.43:44260) 2024-04-25T13:42:39.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.225+0000 7effeffff640 1 -- 172.21.15.43:0/3843343506 learned_addr learned my addr 172.21.15.43:0/3843343506 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:39.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.225+0000 7effef7fe640 1 --2- 172.21.15.43:0/3843343506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff01045f0 0x7efff019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.225+0000 7effeeffd640 1 --2- 172.21.15.43:0/3843343506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efff0106f50 0x7efff019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.225+0000 7effeffff640 1 -- 172.21.15.43:0/3843343506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efff0106f50 msgr2=0x7efff019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.225+0000 7effeffff640 1 --2- 172.21.15.43:0/3843343506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efff0106f50 0x7efff019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.225+0000 7effeffff640 1 -- 172.21.15.43:0/3843343506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff01045f0 msgr2=0x7efff019a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.225+0000 7effeffff640 1 --2- 172.21.15.43:0/3843343506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff01045f0 0x7efff019a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.225+0000 7effeffff640 1 -- 172.21.15.43:0/3843343506 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff01a1cb0 con 0x7efff01098b0 2024-04-25T13:42:39.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.225+0000 7effeffff640 1 --2- 172.21.15.43:0/3843343506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff01098b0 0x7efff01a1640 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7effe800e9d0 tx=0x7effe800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:39.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.225+0000 7effecff9640 1 -- 172.21.15.43:0/3843343506 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe800cd80 con 0x7efff01098b0 2024-04-25T13:42:39.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.225+0000 7effecff9640 1 -- 172.21.15.43:0/3843343506 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effe8005020 con 0x7efff01098b0 2024-04-25T13:42:39.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.225+0000 7efff6049640 1 -- 172.21.15.43:0/3843343506 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff01a1fa0 con 0x7efff01098b0 2024-04-25T13:42:39.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.225+0000 7effecff9640 1 -- 172.21.15.43:0/3843343506 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe80116d0 con 0x7efff01098b0 2024-04-25T13:42:39.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.225+0000 7efff6049640 1 -- 172.21.15.43:0/3843343506 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff01a2400 con 0x7efff01098b0 2024-04-25T13:42:39.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.226+0000 7efff6049640 1 -- 172.21.15.43:0/3843343506 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efff006a190 con 0x7efff01098b0 2024-04-25T13:42:39.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.229+0000 7effecff9640 1 -- 172.21.15.43:0/3843343506 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7effe8004a40 con 0x7efff01098b0 2024-04-25T13:42:39.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.229+0000 7effecff9640 1 --2- 172.21.15.43:0/3843343506 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7effd80afb80 0x7effd80b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.229+0000 7effecff9640 1 -- 172.21.15.43:0/3843343506 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7effe80df4e0 con 0x7efff01098b0 2024-04-25T13:42:39.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.229+0000 7effef7fe640 1 --2- 172.21.15.43:0/3843343506 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7effd80afb80 0x7effd80b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.230+0000 7effef7fe640 1 --2- 172.21.15.43:0/3843343506 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7effd80afb80 0x7effd80b2090 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7effe00058c0 tx=0x7effe000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:39.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.233+0000 7effecff9640 1 -- 172.21.15.43:0/3843343506 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7effe8016030 con 0x7efff01098b0 2024-04-25T13:42:39.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.416+0000 7efff6049640 1 -- 172.21.15.43:0/3843343506 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efff0062fe0 con 0x7effd80afb80 2024-04-25T13:42:39.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.425+0000 7effecff9640 1 -- 172.21.15.43:0/3843343506 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340292 (secure 0 0 0) 0x7efff0062fe0 con 0x7effd80afb80 2024-04-25T13:42:39.428 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:39.430 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T13:42:39.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:39 smithi175 ceph-mon[32649]: pgmap v300: 129 pgs: 129 active+clean; 583 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 1.9 KiB/s wr, 5 op/s 2024-04-25T13:42:39.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:39 smithi175 ceph-mon[32649]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:42:39.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:39 smithi175 ceph-mon[32649]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-25T13:42:39.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:39 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2455919996' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:39.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:39 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1836236411' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:39.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.429+0000 7efff6049640 1 -- 172.21.15.43:0/3843343506 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7effd80afb80 msgr2=0x7effd80b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.429+0000 7efff6049640 1 --2- 172.21.15.43:0/3843343506 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7effd80afb80 0x7effd80b2090 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7effe00058c0 tx=0x7effe000a2d0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.429+0000 7efff6049640 1 -- 172.21.15.43:0/3843343506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff01098b0 msgr2=0x7efff01a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.429+0000 7efff6049640 1 --2- 172.21.15.43:0/3843343506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff01098b0 0x7efff01a1640 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7effe800e9d0 tx=0x7effe800ee90 comp rx=0 tx=0).stop 2024-04-25T13:42:39.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.429+0000 7efff6049640 1 -- 172.21.15.43:0/3843343506 shutdown_connections 2024-04-25T13:42:39.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.429+0000 7efff6049640 1 --2- 172.21.15.43:0/3843343506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff01098b0 0x7efff01a1640 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.429+0000 7efff6049640 1 --2- 172.21.15.43:0/3843343506 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7effd80afb80 0x7effd80b2090 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.429+0000 7efff6049640 1 --2- 172.21.15.43:0/3843343506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efff0106f50 0x7efff019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.429+0000 7efff6049640 1 --2- 172.21.15.43:0/3843343506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff01045f0 0x7efff019a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.429+0000 7efff6049640 1 -- 172.21.15.43:0/3843343506 >> 172.21.15.43:0/3843343506 conn(0x7efff00fdbf0 msgr2=0x7efff0106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:39.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.429+0000 7efff6049640 1 -- 172.21.15.43:0/3843343506 shutdown_connections 2024-04-25T13:42:39.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:39.429+0000 7efff6049640 1 -- 172.21.15.43:0/3843343506 wait complete. 2024-04-25T13:42:39.439 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:39 smithi043 ceph-mon[29195]: pgmap v300: 129 pgs: 129 active+clean; 583 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 1.9 KiB/s wr, 5 op/s 2024-04-25T13:42:39.439 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:39 smithi043 ceph-mon[29195]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:42:39.439 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:39 smithi043 ceph-mon[29195]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-25T13:42:39.440 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:39 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2455919996' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:39.440 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:39 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1836236411' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:39.440 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2024-04-25T13:42:37.936399+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596616,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":88,"num_read_kb":76,"num_write":232,"num_write_kb":2190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":187,"ondisk_log_size":187,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386340,"kb_used_data":12212,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555484,"statfs":{"total":1151940427776,"available":1151544815616,"internally_reserved":0,"allocated":12505088,"data_stored":6896900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1749,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004172"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.795425+0000","last_change":"2024-04-25T13:42:09.059038+0000","last_active":"2024-04-25T13:42:14.795425+0000","last_peered":"2024-04-25T13:42:14.795425+0000","last_clean":"2024-04-25T13:42:14.795425+0000","last_became_active":"2024-04-25T13:42:09.058719+0000","last_became_peered":"2024-04-25T13:42:09.058719+0000","last_unstale":"2024-04-25T13:42:14.795425+0000","last_undegraded":"2024-04-25T13:42:14.795425+0000","last_fullsized":"2024-04-25T13:42:14.795425+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:44.573718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390151+0000","last_change":"2024-04-25T13:42:09.057862+0000","last_active":"2024-04-25T13:42:14.390151+0000","last_peered":"2024-04-25T13:42:14.390151+0000","last_clean":"2024-04-25T13:42:14.390151+0000","last_became_active":"2024-04-25T13:42:09.057511+0000","last_became_peered":"2024-04-25T13:42:09.057511+0000","last_unstale":"2024-04-25T13:42:14.390151+0000","last_undegraded":"2024-04-25T13:42:14.390151+0000","last_fullsized":"2024-04-25T13:42:14.390151+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:20.911339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389889+0000","last_change":"2024-04-25T13:42:09.060432+0000","last_active":"2024-04-25T13:42:14.389889+0000","last_peered":"2024-04-25T13:42:14.389889+0000","last_clean":"2024-04-25T13:42:14.389889+0000","last_became_active":"2024-04-25T13:42:09.060081+0000","last_became_peered":"2024-04-25T13:42:09.060081+0000","last_unstale":"2024-04-25T13:42:14.389889+0000","last_undegraded":"2024-04-25T13:42:14.389889+0000","last_fullsized":"2024-04-25T13:42:14.389889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:50.008694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390593+0000","last_change":"2024-04-25T13:42:09.040319+0000","last_active":"2024-04-25T13:42:14.390593+0000","last_peered":"2024-04-25T13:42:14.390593+0000","last_clean":"2024-04-25T13:42:14.390593+0000","last_became_active":"2024-04-25T13:42:09.039949+0000","last_became_peered":"2024-04-25T13:42:09.039949+0000","last_unstale":"2024-04-25T13:42:14.390593+0000","last_undegraded":"2024-04-25T13:42:14.390593+0000","last_fullsized":"2024-04-25T13:42:14.390593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:03.242055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.388828+0000","last_change":"2024-04-25T13:42:09.040642+0000","last_active":"2024-04-25T13:42:14.388828+0000","last_peered":"2024-04-25T13:42:14.388828+0000","last_clean":"2024-04-25T13:42:14.388828+0000","last_became_active":"2024-04-25T13:42:09.039339+0000","last_became_peered":"2024-04-25T13:42:09.039339+0000","last_unstale":"2024-04-25T13:42:14.388828+0000","last_undegraded":"2024-04-25T13:42:14.388828+0000","last_fullsized":"2024-04-25T13:42:14.388828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:50.216939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390605+0000","last_change":"2024-04-25T13:42:09.034848+0000","last_active":"2024-04-25T13:42:14.390605+0000","last_peered":"2024-04-25T13:42:14.390605+0000","last_clean":"2024-04-25T13:42:14.390605+0000","last_became_active":"2024-04-25T13:42:09.034452+0000","last_became_peered":"2024-04-25T13:42:09.034452+0000","last_unstale":"2024-04-25T13:42:14.390605+0000","last_undegraded":"2024-04-25T13:42:14.390605+0000","last_fullsized":"2024-04-25T13:42:14.390605+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:45.963322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391010+0000","last_change":"2024-04-25T13:42:09.054656+0000","last_active":"2024-04-25T13:42:14.391010+0000","last_peered":"2024-04-25T13:42:14.391010+0000","last_clean":"2024-04-25T13:42:14.391010+0000","last_became_active":"2024-04-25T13:42:09.054276+0000","last_became_peered":"2024-04-25T13:42:09.054276+0000","last_unstale":"2024-04-25T13:42:14.391010+0000","last_undegraded":"2024-04-25T13:42:14.391010+0000","last_fullsized":"2024-04-25T13:42:14.391010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:19.818362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.072785+0000","last_change":"2024-04-25T13:42:09.054227+0000","last_active":"2024-04-25T13:42:14.072785+0000","last_peered":"2024-04-25T13:42:14.072785+0000","last_clean":"2024-04-25T13:42:14.072785+0000","last_became_active":"2024-04-25T13:42:09.051893+0000","last_became_peered":"2024-04-25T13:42:09.051893+0000","last_unstale":"2024-04-25T13:42:14.072785+0000","last_undegraded":"2024-04-25T13:42:14.072785+0000","last_fullsized":"2024-04-25T13:42:14.072785+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:37.120057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.074241+0000","last_change":"2024-04-25T13:42:09.039618+0000","last_active":"2024-04-25T13:42:14.074241+0000","last_peered":"2024-04-25T13:42:14.074241+0000","last_clean":"2024-04-25T13:42:14.074241+0000","last_became_active":"2024-04-25T13:42:09.039264+0000","last_became_peered":"2024-04-25T13:42:09.039264+0000","last_unstale":"2024-04-25T13:42:14.074241+0000","last_undegraded":"2024-04-25T13:42:14.074241+0000","last_fullsized":"2024-04-25T13:42:14.074241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:50.352365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390438+0000","last_change":"2024-04-25T13:42:09.037323+0000","last_active":"2024-04-25T13:42:14.390438+0000","last_peered":"2024-04-25T13:42:14.390438+0000","last_clean":"2024-04-25T13:42:14.390438+0000","last_became_active":"2024-04-25T13:42:09.036614+0000","last_became_peered":"2024-04-25T13:42:09.036614+0000","last_unstale":"2024-04-25T13:42:14.390438+0000","last_undegraded":"2024-04-25T13:42:14.390438+0000","last_fullsized":"2024-04-25T13:42:14.390438+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:09.872287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391615+0000","last_change":"2024-04-25T13:42:09.056812+0000","last_active":"2024-04-25T13:42:14.391615+0000","last_peered":"2024-04-25T13:42:14.391615+0000","last_clean":"2024-04-25T13:42:14.391615+0000","last_became_active":"2024-04-25T13:42:09.054990+0000","last_became_peered":"2024-04-25T13:42:09.054990+0000","last_unstale":"2024-04-25T13:42:14.391615+0000","last_undegraded":"2024-04-25T13:42:14.391615+0000","last_fullsized":"2024-04-25T13:42:14.391615+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:30.855059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390471+0000","last_change":"2024-04-25T13:42:09.034107+0000","last_active":"2024-04-25T13:42:14.390471+0000","last_peered":"2024-04-25T13:42:14.390471+0000","last_clean":"2024-04-25T13:42:14.390471+0000","last_became_active":"2024-04-25T13:42:09.033713+0000","last_became_peered":"2024-04-25T13:42:09.033713+0000","last_unstale":"2024-04-25T13:42:14.390471+0000","last_undegraded":"2024-04-25T13:42:14.390471+0000","last_fullsized":"2024-04-25T13:42:14.390471+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:06.218439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390086+0000","last_change":"2024-04-25T13:42:09.043105+0000","last_active":"2024-04-25T13:42:14.390086+0000","last_peered":"2024-04-25T13:42:14.390086+0000","last_clean":"2024-04-25T13:42:14.390086+0000","last_became_active":"2024-04-25T13:42:09.042457+0000","last_became_peered":"2024-04-25T13:42:09.042457+0000","last_unstale":"2024-04-25T13:42:14.390086+0000","last_undegraded":"2024-04-25T13:42:14.390086+0000","last_fullsized":"2024-04-25T13:42:14.390086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:58.924985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389775+0000","last_change":"2024-04-25T13:42:09.046658+0000","last_active":"2024-04-25T13:42:14.389775+0000","last_peered":"2024-04-25T13:42:14.389775+0000","last_clean":"2024-04-25T13:42:14.389775+0000","last_became_active":"2024-04-25T13:42:09.046323+0000","last_became_peered":"2024-04-25T13:42:09.046323+0000","last_unstale":"2024-04-25T13:42:14.389775+0000","last_undegraded":"2024-04-25T13:42:14.389775+0000","last_fullsized":"2024-04-25T13:42:14.389775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:51.362734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389730+0000","last_change":"2024-04-25T13:42:09.049787+0000","last_active":"2024-04-25T13:42:14.389730+0000","last_peered":"2024-04-25T13:42:14.389730+0000","last_clean":"2024-04-25T13:42:14.389730+0000","last_became_active":"2024-04-25T13:42:09.049432+0000","last_became_peered":"2024-04-25T13:42:09.049432+0000","last_unstale":"2024-04-25T13:42:14.389730+0000","last_undegraded":"2024-04-25T13:42:14.389730+0000","last_fullsized":"2024-04-25T13:42:14.389730+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:23.507471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073541+0000","last_change":"2024-04-25T13:42:09.060318+0000","last_active":"2024-04-25T13:42:14.073541+0000","last_peered":"2024-04-25T13:42:14.073541+0000","last_clean":"2024-04-25T13:42:14.073541+0000","last_became_active":"2024-04-25T13:42:09.059948+0000","last_became_peered":"2024-04-25T13:42:09.059948+0000","last_unstale":"2024-04-25T13:42:14.073541+0000","last_undegraded":"2024-04-25T13:42:14.073541+0000","last_fullsized":"2024-04-25T13:42:14.073541+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:10.840181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.795236+0000","last_change":"2024-04-25T13:42:09.060432+0000","last_active":"2024-04-25T13:42:14.795236+0000","last_peered":"2024-04-25T13:42:14.795236+0000","last_clean":"2024-04-25T13:42:14.795236+0000","last_became_active":"2024-04-25T13:42:09.059525+0000","last_became_peered":"2024-04-25T13:42:09.059525+0000","last_unstale":"2024-04-25T13:42:14.795236+0000","last_undegraded":"2024-04-25T13:42:14.795236+0000","last_fullsized":"2024-04-25T13:42:14.795236+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:46:41.360324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390046+0000","last_change":"2024-04-25T13:42:09.035591+0000","last_active":"2024-04-25T13:42:14.390046+0000","last_peered":"2024-04-25T13:42:14.390046+0000","last_clean":"2024-04-25T13:42:14.390046+0000","last_became_active":"2024-04-25T13:42:09.035219+0000","last_became_peered":"2024-04-25T13:42:09.035219+0000","last_unstale":"2024-04-25T13:42:14.390046+0000","last_undegraded":"2024-04-25T13:42:14.390046+0000","last_fullsized":"2024-04-25T13:42:14.390046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:35:04.362044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389880+0000","last_change":"2024-04-25T13:42:09.057623+0000","last_active":"2024-04-25T13:42:14.389880+0000","last_peered":"2024-04-25T13:42:14.389880+0000","last_clean":"2024-04-25T13:42:14.389880+0000","last_became_active":"2024-04-25T13:42:09.057276+0000","last_became_peered":"2024-04-25T13:42:09.057276+0000","last_unstale":"2024-04-25T13:42:14.389880+0000","last_undegraded":"2024-04-25T13:42:14.389880+0000","last_fullsized":"2024-04-25T13:42:14.389880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:28.975079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389213+0000","last_change":"2024-04-25T13:42:13.081052+0000","last_active":"2024-04-25T13:42:14.389213+0000","last_peered":"2024-04-25T13:42:14.389213+0000","last_clean":"2024-04-25T13:42:14.389213+0000","last_became_active":"2024-04-25T13:42:13.080546+0000","last_became_peered":"2024-04-25T13:42:13.080546+0000","last_unstale":"2024-04-25T13:42:14.389213+0000","last_undegraded":"2024-04-25T13:42:14.389213+0000","last_fullsized":"2024-04-25T13:42:14.389213+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:59.648007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390474+0000","last_change":"2024-04-25T13:42:08.040591+0000","last_active":"2024-04-25T13:42:14.390474+0000","last_peered":"2024-04-25T13:42:14.390474+0000","last_clean":"2024-04-25T13:42:14.390474+0000","last_became_active":"2024-04-25T13:42:08.040221+0000","last_became_peered":"2024-04-25T13:42:08.040221+0000","last_unstale":"2024-04-25T13:42:14.390474+0000","last_undegraded":"2024-04-25T13:42:14.390474+0000","last_fullsized":"2024-04-25T13:42:14.390474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:09.755426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073538+0000","last_change":"2024-04-25T13:42:09.061907+0000","last_active":"2024-04-25T13:42:14.073538+0000","last_peered":"2024-04-25T13:42:14.073538+0000","last_clean":"2024-04-25T13:42:14.073538+0000","last_became_active":"2024-04-25T13:42:09.061520+0000","last_became_peered":"2024-04-25T13:42:09.061520+0000","last_unstale":"2024-04-25T13:42:14.073538+0000","last_undegraded":"2024-04-25T13:42:14.073538+0000","last_fullsized":"2024-04-25T13:42:14.073538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:45.549889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389389+0000","last_change":"2024-04-25T13:42:13.080709+0000","last_active":"2024-04-25T13:42:14.389389+0000","last_peered":"2024-04-25T13:42:14.389389+0000","last_clean":"2024-04-25T13:42:14.389389+0000","last_became_active":"2024-04-25T13:42:13.080234+0000","last_became_peered":"2024-04-25T13:42:13.080234+0000","last_unstale":"2024-04-25T13:42:14.389389+0000","last_undegraded":"2024-04-25T13:42:14.389389+0000","last_fullsized":"2024-04-25T13:42:14.389389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:29.231166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073865+0000","last_change":"2024-04-25T13:42:08.044450+0000","last_active":"2024-04-25T13:42:14.073865+0000","last_peered":"2024-04-25T13:42:14.073865+0000","last_clean":"2024-04-25T13:42:14.073865+0000","last_became_active":"2024-04-25T13:42:08.043674+0000","last_became_peered":"2024-04-25T13:42:08.043674+0000","last_unstale":"2024-04-25T13:42:14.073865+0000","last_undegraded":"2024-04-25T13:42:14.073865+0000","last_fullsized":"2024-04-25T13:42:14.073865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:12.784756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390320+0000","last_change":"2024-04-25T13:42:09.060369+0000","last_active":"2024-04-25T13:42:14.390320+0000","last_peered":"2024-04-25T13:42:14.390320+0000","last_clean":"2024-04-25T13:42:14.390320+0000","last_became_active":"2024-04-25T13:42:09.060002+0000","last_became_peered":"2024-04-25T13:42:09.060002+0000","last_unstale":"2024-04-25T13:42:14.390320+0000","last_undegraded":"2024-04-25T13:42:14.390320+0000","last_fullsized":"2024-04-25T13:42:14.390320+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:26.601583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389968+0000","last_change":"2024-04-25T13:42:13.083165+0000","last_active":"2024-04-25T13:42:14.389968+0000","last_peered":"2024-04-25T13:42:14.389968+0000","last_clean":"2024-04-25T13:42:14.389968+0000","last_became_active":"2024-04-25T13:42:13.082767+0000","last_became_peered":"2024-04-25T13:42:13.082767+0000","last_unstale":"2024-04-25T13:42:14.389968+0000","last_undegraded":"2024-04-25T13:42:14.389968+0000","last_fullsized":"2024-04-25T13:42:14.389968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:35.559831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:35.144230+0000","last_change":"2024-04-25T13:42:08.041789+0000","last_active":"2024-04-25T13:42:35.144230+0000","last_peered":"2024-04-25T13:42:35.144230+0000","last_clean":"2024-04-25T13:42:35.144230+0000","last_became_active":"2024-04-25T13:42:08.041371+0000","last_became_peered":"2024-04-25T13:42:08.041371+0000","last_unstale":"2024-04-25T13:42:35.144230+0000","last_undegraded":"2024-04-25T13:42:35.144230+0000","last_fullsized":"2024-04-25T13:42:35.144230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:33.748758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073863+0000","last_change":"2024-04-25T13:42:09.045209+0000","last_active":"2024-04-25T13:42:14.073863+0000","last_peered":"2024-04-25T13:42:14.073863+0000","last_clean":"2024-04-25T13:42:14.073863+0000","last_became_active":"2024-04-25T13:42:09.044750+0000","last_became_peered":"2024-04-25T13:42:09.044750+0000","last_unstale":"2024-04-25T13:42:14.073863+0000","last_undegraded":"2024-04-25T13:42:14.073863+0000","last_fullsized":"2024-04-25T13:42:14.073863+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:03.279395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389846+0000","last_change":"2024-04-25T13:42:13.083154+0000","last_active":"2024-04-25T13:42:14.389846+0000","last_peered":"2024-04-25T13:42:14.389846+0000","last_clean":"2024-04-25T13:42:14.389846+0000","last_became_active":"2024-04-25T13:42:13.082679+0000","last_became_peered":"2024-04-25T13:42:13.082679+0000","last_unstale":"2024-04-25T13:42:14.389846+0000","last_undegraded":"2024-04-25T13:42:14.389846+0000","last_fullsized":"2024-04-25T13:42:14.389846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:14.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389732+0000","last_change":"2024-04-25T13:42:08.035263+0000","last_active":"2024-04-25T13:42:14.389732+0000","last_peered":"2024-04-25T13:42:14.389732+0000","last_clean":"2024-04-25T13:42:14.389732+0000","last_became_active":"2024-04-25T13:42:08.034917+0000","last_became_peered":"2024-04-25T13:42:08.034917+0000","last_unstale":"2024-04-25T13:42:14.389732+0000","last_undegraded":"2024-04-25T13:42:14.389732+0000","last_fullsized":"2024-04-25T13:42:14.389732+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:50.051615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.076524+0000","last_change":"2024-04-25T13:42:09.038159+0000","last_active":"2024-04-25T13:42:14.076524+0000","last_peered":"2024-04-25T13:42:14.076524+0000","last_clean":"2024-04-25T13:42:14.076524+0000","last_became_active":"2024-04-25T13:42:09.037702+0000","last_became_peered":"2024-04-25T13:42:09.037702+0000","last_unstale":"2024-04-25T13:42:14.076524+0000","last_undegraded":"2024-04-25T13:42:14.076524+0000","last_fullsized":"2024-04-25T13:42:14.076524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:44.856392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389722+0000","last_change":"2024-04-25T13:42:13.074307+0000","last_active":"2024-04-25T13:42:14.389722+0000","last_peered":"2024-04-25T13:42:14.389722+0000","last_clean":"2024-04-25T13:42:14.389722+0000","last_became_active":"2024-04-25T13:42:13.073665+0000","last_became_peered":"2024-04-25T13:42:13.073665+0000","last_unstale":"2024-04-25T13:42:14.389722+0000","last_undegraded":"2024-04-25T13:42:14.389722+0000","last_fullsized":"2024-04-25T13:42:14.389722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:24.652912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.141651+0000","last_change":"2024-04-25T13:42:08.033277+0000","last_active":"2024-04-25T13:42:34.141651+0000","last_peered":"2024-04-25T13:42:34.141651+0000","last_clean":"2024-04-25T13:42:34.141651+0000","last_became_active":"2024-04-25T13:42:08.032609+0000","last_became_peered":"2024-04-25T13:42:08.032609+0000","last_unstale":"2024-04-25T13:42:34.141651+0000","last_undegraded":"2024-04-25T13:42:34.141651+0000","last_fullsized":"2024-04-25T13:42:34.141651+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:22.709352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389343+0000","last_change":"2024-04-25T13:42:09.037183+0000","last_active":"2024-04-25T13:42:14.389343+0000","last_peered":"2024-04-25T13:42:14.389343+0000","last_clean":"2024-04-25T13:42:14.389343+0000","last_became_active":"2024-04-25T13:42:09.036778+0000","last_became_peered":"2024-04-25T13:42:09.036778+0000","last_unstale":"2024-04-25T13:42:14.389343+0000","last_undegraded":"2024-04-25T13:42:14.389343+0000","last_fullsized":"2024-04-25T13:42:14.389343+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:24:20.009326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389678+0000","last_change":"2024-04-25T13:42:13.080499+0000","last_active":"2024-04-25T13:42:14.389678+0000","last_peered":"2024-04-25T13:42:14.389678+0000","last_clean":"2024-04-25T13:42:14.389678+0000","last_became_active":"2024-04-25T13:42:13.080007+0000","last_became_peered":"2024-04-25T13:42:13.080007+0000","last_unstale":"2024-04-25T13:42:14.389678+0000","last_undegraded":"2024-04-25T13:42:14.389678+0000","last_fullsized":"2024-04-25T13:42:14.389678+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:54.488344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:35.144589+0000","last_change":"2024-04-25T13:42:08.037902+0000","last_active":"2024-04-25T13:42:35.144589+0000","last_peered":"2024-04-25T13:42:35.144589+0000","last_clean":"2024-04-25T13:42:35.144589+0000","last_became_active":"2024-04-25T13:42:08.037284+0000","last_became_peered":"2024-04-25T13:42:08.037284+0000","last_unstale":"2024-04-25T13:42:35.144589+0000","last_undegraded":"2024-04-25T13:42:35.144589+0000","last_fullsized":"2024-04-25T13:42:35.144589+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:10.374637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.076401+0000","last_change":"2024-04-25T13:42:09.057856+0000","last_active":"2024-04-25T13:42:14.076401+0000","last_peered":"2024-04-25T13:42:14.076401+0000","last_clean":"2024-04-25T13:42:14.076401+0000","last_became_active":"2024-04-25T13:42:09.057464+0000","last_became_peered":"2024-04-25T13:42:09.057464+0000","last_unstale":"2024-04-25T13:42:14.076401+0000","last_undegraded":"2024-04-25T13:42:14.076401+0000","last_fullsized":"2024-04-25T13:42:14.076401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:03.403058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.795245+0000","last_change":"2024-04-25T13:42:13.078100+0000","last_active":"2024-04-25T13:42:14.795245+0000","last_peered":"2024-04-25T13:42:14.795245+0000","last_clean":"2024-04-25T13:42:14.795245+0000","last_became_active":"2024-04-25T13:42:13.077705+0000","last_became_peered":"2024-04-25T13:42:13.077705+0000","last_unstale":"2024-04-25T13:42:14.795245+0000","last_undegraded":"2024-04-25T13:42:14.795245+0000","last_fullsized":"2024-04-25T13:42:14.795245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:54.855223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:35.145537+0000","last_change":"2024-04-25T13:42:08.030750+0000","last_active":"2024-04-25T13:42:35.145537+0000","last_peered":"2024-04-25T13:42:35.145537+0000","last_clean":"2024-04-25T13:42:35.145537+0000","last_became_active":"2024-04-25T13:42:08.030353+0000","last_became_peered":"2024-04-25T13:42:08.030353+0000","last_unstale":"2024-04-25T13:42:35.145537+0000","last_undegraded":"2024-04-25T13:42:35.145537+0000","last_fullsized":"2024-04-25T13:42:35.145537+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:11.658589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.072987+0000","last_change":"2024-04-25T13:42:09.048800+0000","last_active":"2024-04-25T13:42:14.072987+0000","last_peered":"2024-04-25T13:42:14.072987+0000","last_clean":"2024-04-25T13:42:14.072987+0000","last_became_active":"2024-04-25T13:42:09.047777+0000","last_became_peered":"2024-04-25T13:42:09.047777+0000","last_unstale":"2024-04-25T13:42:14.072987+0000","last_undegraded":"2024-04-25T13:42:14.072987+0000","last_fullsized":"2024-04-25T13:42:14.072987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:44.739359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390588+0000","last_change":"2024-04-25T13:42:13.073583+0000","last_active":"2024-04-25T13:42:14.390588+0000","last_peered":"2024-04-25T13:42:14.390588+0000","last_clean":"2024-04-25T13:42:14.390588+0000","last_became_active":"2024-04-25T13:42:13.073154+0000","last_became_peered":"2024-04-25T13:42:13.073154+0000","last_unstale":"2024-04-25T13:42:14.390588+0000","last_undegraded":"2024-04-25T13:42:14.390588+0000","last_fullsized":"2024-04-25T13:42:14.390588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:42.720347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.075944+0000","last_change":"2024-04-25T13:42:08.035263+0000","last_active":"2024-04-25T13:42:14.075944+0000","last_peered":"2024-04-25T13:42:14.075944+0000","last_clean":"2024-04-25T13:42:14.075944+0000","last_became_active":"2024-04-25T13:42:08.034903+0000","last_became_peered":"2024-04-25T13:42:08.034903+0000","last_unstale":"2024-04-25T13:42:14.075944+0000","last_undegraded":"2024-04-25T13:42:14.075944+0000","last_fullsized":"2024-04-25T13:42:14.075944+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:22.715159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389306+0000","last_change":"2024-04-25T13:42:09.037640+0000","last_active":"2024-04-25T13:42:14.389306+0000","last_peered":"2024-04-25T13:42:14.389306+0000","last_clean":"2024-04-25T13:42:14.389306+0000","last_became_active":"2024-04-25T13:42:09.037286+0000","last_became_peered":"2024-04-25T13:42:09.037286+0000","last_unstale":"2024-04-25T13:42:14.389306+0000","last_undegraded":"2024-04-25T13:42:14.389306+0000","last_fullsized":"2024-04-25T13:42:14.389306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:28.704489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073416+0000","last_change":"2024-04-25T13:42:13.079379+0000","last_active":"2024-04-25T13:42:14.073416+0000","last_peered":"2024-04-25T13:42:14.073416+0000","last_clean":"2024-04-25T13:42:14.073416+0000","last_became_active":"2024-04-25T13:42:13.078771+0000","last_became_peered":"2024-04-25T13:42:13.078771+0000","last_unstale":"2024-04-25T13:42:14.073416+0000","last_undegraded":"2024-04-25T13:42:14.073416+0000","last_fullsized":"2024-04-25T13:42:14.073416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:35.955154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.139659+0000","last_change":"2024-04-25T13:42:08.032562+0000","last_active":"2024-04-25T13:42:34.139659+0000","last_peered":"2024-04-25T13:42:34.139659+0000","last_clean":"2024-04-25T13:42:34.139659+0000","last_became_active":"2024-04-25T13:42:08.032090+0000","last_became_peered":"2024-04-25T13:42:08.032090+0000","last_unstale":"2024-04-25T13:42:34.139659+0000","last_undegraded":"2024-04-25T13:42:34.139659+0000","last_fullsized":"2024-04-25T13:42:34.139659+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:13:52.822642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.074242+0000","last_change":"2024-04-25T13:42:09.041724+0000","last_active":"2024-04-25T13:42:14.074242+0000","last_peered":"2024-04-25T13:42:14.074242+0000","last_clean":"2024-04-25T13:42:14.074242+0000","last_became_active":"2024-04-25T13:42:09.041386+0000","last_became_peered":"2024-04-25T13:42:09.041386+0000","last_unstale":"2024-04-25T13:42:14.074242+0000","last_undegraded":"2024-04-25T13:42:14.074242+0000","last_fullsized":"2024-04-25T13:42:14.074242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:29.676814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389232+0000","last_change":"2024-04-25T13:42:13.075365+0000","last_active":"2024-04-25T13:42:14.389232+0000","last_peered":"2024-04-25T13:42:14.389232+0000","last_clean":"2024-04-25T13:42:14.389232+0000","last_became_active":"2024-04-25T13:42:13.074886+0000","last_became_peered":"2024-04-25T13:42:13.074886+0000","last_unstale":"2024-04-25T13:42:14.389232+0000","last_undegraded":"2024-04-25T13:42:14.389232+0000","last_fullsized":"2024-04-25T13:42:14.389232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:30.647002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.139590+0000","last_change":"2024-04-25T13:42:08.036830+0000","last_active":"2024-04-25T13:42:34.139590+0000","last_peered":"2024-04-25T13:42:34.139590+0000","last_clean":"2024-04-25T13:42:34.139590+0000","last_became_active":"2024-04-25T13:42:08.036418+0000","last_became_peered":"2024-04-25T13:42:08.036418+0000","last_unstale":"2024-04-25T13:42:34.139590+0000","last_undegraded":"2024-04-25T13:42:34.139590+0000","last_fullsized":"2024-04-25T13:42:34.139590+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:06.402677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390219+0000","last_change":"2024-04-25T13:42:09.063305+0000","last_active":"2024-04-25T13:42:14.390219+0000","last_peered":"2024-04-25T13:42:14.390219+0000","last_clean":"2024-04-25T13:42:14.390219+0000","last_became_active":"2024-04-25T13:42:09.062961+0000","last_became_peered":"2024-04-25T13:42:09.062961+0000","last_unstale":"2024-04-25T13:42:14.390219+0000","last_undegraded":"2024-04-25T13:42:14.390219+0000","last_fullsized":"2024-04-25T13:42:14.390219+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:34.653515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390300+0000","last_change":"2024-04-25T13:42:13.073271+0000","last_active":"2024-04-25T13:42:14.390300+0000","last_peered":"2024-04-25T13:42:14.390300+0000","last_clean":"2024-04-25T13:42:14.390300+0000","last_became_active":"2024-04-25T13:42:13.072800+0000","last_became_peered":"2024-04-25T13:42:13.072800+0000","last_unstale":"2024-04-25T13:42:14.390300+0000","last_undegraded":"2024-04-25T13:42:14.390300+0000","last_fullsized":"2024-04-25T13:42:14.390300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:40.115311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.076549+0000","last_change":"2024-04-25T13:42:08.032607+0000","last_active":"2024-04-25T13:42:14.076549+0000","last_peered":"2024-04-25T13:42:14.076549+0000","last_clean":"2024-04-25T13:42:14.076549+0000","last_became_active":"2024-04-25T13:42:08.031474+0000","last_became_peered":"2024-04-25T13:42:08.031474+0000","last_unstale":"2024-04-25T13:42:14.076549+0000","last_undegraded":"2024-04-25T13:42:14.076549+0000","last_fullsized":"2024-04-25T13:42:14.076549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:02:37.648480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.074004+0000","last_change":"2024-04-25T13:42:09.043148+0000","last_active":"2024-04-25T13:42:14.074004+0000","last_peered":"2024-04-25T13:42:14.074004+0000","last_clean":"2024-04-25T13:42:14.074004+0000","last_became_active":"2024-04-25T13:42:09.042787+0000","last_became_peered":"2024-04-25T13:42:09.042787+0000","last_unstale":"2024-04-25T13:42:14.074004+0000","last_undegraded":"2024-04-25T13:42:14.074004+0000","last_fullsized":"2024-04-25T13:42:14.074004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:29.318123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390280+0000","last_change":"2024-04-25T13:42:13.076116+0000","last_active":"2024-04-25T13:42:14.390280+0000","last_peered":"2024-04-25T13:42:14.390280+0000","last_clean":"2024-04-25T13:42:14.390280+0000","last_became_active":"2024-04-25T13:42:13.075592+0000","last_became_peered":"2024-04-25T13:42:13.075592+0000","last_unstale":"2024-04-25T13:42:14.390280+0000","last_undegraded":"2024-04-25T13:42:14.390280+0000","last_fullsized":"2024-04-25T13:42:14.390280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:06.496966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"80'12","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.139674+0000","last_change":"2024-04-25T13:42:08.030361+0000","last_active":"2024-04-25T13:42:34.139674+0000","last_peered":"2024-04-25T13:42:34.139674+0000","last_clean":"2024-04-25T13:42:34.139674+0000","last_became_active":"2024-04-25T13:42:08.029956+0000","last_became_peered":"2024-04-25T13:42:08.029956+0000","last_unstale":"2024-04-25T13:42:34.139674+0000","last_undegraded":"2024-04-25T13:42:34.139674+0000","last_fullsized":"2024-04-25T13:42:34.139674+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:50:24.375972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389561+0000","last_change":"2024-04-25T13:42:09.052062+0000","last_active":"2024-04-25T13:42:14.389561+0000","last_peered":"2024-04-25T13:42:14.389561+0000","last_clean":"2024-04-25T13:42:14.389561+0000","last_became_active":"2024-04-25T13:42:09.051642+0000","last_became_peered":"2024-04-25T13:42:09.051642+0000","last_unstale":"2024-04-25T13:42:14.389561+0000","last_undegraded":"2024-04-25T13:42:14.389561+0000","last_fullsized":"2024-04-25T13:42:14.389561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:31.228502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.076975+0000","last_change":"2024-04-25T13:42:13.083232+0000","last_active":"2024-04-25T13:42:14.076975+0000","last_peered":"2024-04-25T13:42:14.076975+0000","last_clean":"2024-04-25T13:42:14.076975+0000","last_became_active":"2024-04-25T13:42:13.082708+0000","last_became_peered":"2024-04-25T13:42:13.082708+0000","last_unstale":"2024-04-25T13:42:14.076975+0000","last_undegraded":"2024-04-25T13:42:14.076975+0000","last_fullsized":"2024-04-25T13:42:14.076975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:07.302207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"80'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.140742+0000","last_change":"2024-04-25T13:42:08.043775+0000","last_active":"2024-04-25T13:42:34.140742+0000","last_peered":"2024-04-25T13:42:34.140742+0000","last_clean":"2024-04-25T13:42:34.140742+0000","last_became_active":"2024-04-25T13:42:08.043399+0000","last_became_peered":"2024-04-25T13:42:08.043399+0000","last_unstale":"2024-04-25T13:42:34.140742+0000","last_undegraded":"2024-04-25T13:42:34.140742+0000","last_fullsized":"2024-04-25T13:42:34.140742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:41.768248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389469+0000","last_change":"2024-04-25T13:42:09.051145+0000","last_active":"2024-04-25T13:42:14.389469+0000","last_peered":"2024-04-25T13:42:14.389469+0000","last_clean":"2024-04-25T13:42:14.389469+0000","last_became_active":"2024-04-25T13:42:09.050796+0000","last_became_peered":"2024-04-25T13:42:09.050796+0000","last_unstale":"2024-04-25T13:42:14.389469+0000","last_undegraded":"2024-04-25T13:42:14.389469+0000","last_fullsized":"2024-04-25T13:42:14.389469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:37.195227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.795003+0000","last_change":"2024-04-25T13:42:13.079728+0000","last_active":"2024-04-25T13:42:14.795003+0000","last_peered":"2024-04-25T13:42:14.795003+0000","last_clean":"2024-04-25T13:42:14.795003+0000","last_became_active":"2024-04-25T13:42:13.079198+0000","last_became_peered":"2024-04-25T13:42:13.079198+0000","last_unstale":"2024-04-25T13:42:14.795003+0000","last_undegraded":"2024-04-25T13:42:14.795003+0000","last_fullsized":"2024-04-25T13:42:14.795003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:25.267778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.141535+0000","last_change":"2024-04-25T13:42:08.043885+0000","last_active":"2024-04-25T13:42:34.141535+0000","last_peered":"2024-04-25T13:42:34.141535+0000","last_clean":"2024-04-25T13:42:34.141535+0000","last_became_active":"2024-04-25T13:42:08.043363+0000","last_became_peered":"2024-04-25T13:42:08.043363+0000","last_unstale":"2024-04-25T13:42:34.141535+0000","last_undegraded":"2024-04-25T13:42:34.141535+0000","last_fullsized":"2024-04-25T13:42:34.141535+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:42.592286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391079+0000","last_change":"2024-04-25T13:42:09.054000+0000","last_active":"2024-04-25T13:42:14.391079+0000","last_peered":"2024-04-25T13:42:14.391079+0000","last_clean":"2024-04-25T13:42:14.391079+0000","last_became_active":"2024-04-25T13:42:09.053538+0000","last_became_peered":"2024-04-25T13:42:09.053538+0000","last_unstale":"2024-04-25T13:42:14.391079+0000","last_undegraded":"2024-04-25T13:42:14.391079+0000","last_fullsized":"2024-04-25T13:42:14.391079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:47.504591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390395+0000","last_change":"2024-04-25T13:42:13.086157+0000","last_active":"2024-04-25T13:42:14.390395+0000","last_peered":"2024-04-25T13:42:14.390395+0000","last_clean":"2024-04-25T13:42:14.390395+0000","last_became_active":"2024-04-25T13:42:13.085613+0000","last_became_peered":"2024-04-25T13:42:13.085613+0000","last_unstale":"2024-04-25T13:42:14.390395+0000","last_undegraded":"2024-04-25T13:42:14.390395+0000","last_fullsized":"2024-04-25T13:42:14.390395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:11.707675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390415+0000","last_change":"2024-04-25T13:42:08.034028+0000","last_active":"2024-04-25T13:42:14.390415+0000","last_peered":"2024-04-25T13:42:14.390415+0000","last_clean":"2024-04-25T13:42:14.390415+0000","last_became_active":"2024-04-25T13:42:08.033641+0000","last_became_peered":"2024-04-25T13:42:08.033641+0000","last_unstale":"2024-04-25T13:42:14.390415+0000","last_undegraded":"2024-04-25T13:42:14.390415+0000","last_fullsized":"2024-04-25T13:42:14.390415+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:34.081325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389771+0000","last_change":"2024-04-25T13:42:09.054594+0000","last_active":"2024-04-25T13:42:14.389771+0000","last_peered":"2024-04-25T13:42:14.389771+0000","last_clean":"2024-04-25T13:42:14.389771+0000","last_became_active":"2024-04-25T13:42:09.054215+0000","last_became_peered":"2024-04-25T13:42:09.054215+0000","last_unstale":"2024-04-25T13:42:14.389771+0000","last_undegraded":"2024-04-25T13:42:14.389771+0000","last_fullsized":"2024-04-25T13:42:14.389771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:56.129188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390948+0000","last_change":"2024-04-25T13:42:13.081325+0000","last_active":"2024-04-25T13:42:14.390948+0000","last_peered":"2024-04-25T13:42:14.390948+0000","last_clean":"2024-04-25T13:42:14.390948+0000","last_became_active":"2024-04-25T13:42:13.080641+0000","last_became_peered":"2024-04-25T13:42:13.080641+0000","last_unstale":"2024-04-25T13:42:14.390948+0000","last_undegraded":"2024-04-25T13:42:14.390948+0000","last_fullsized":"2024-04-25T13:42:14.390948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:45.839180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:35.147101+0000","last_change":"2024-04-25T13:42:08.037915+0000","last_active":"2024-04-25T13:42:35.147101+0000","last_peered":"2024-04-25T13:42:35.147101+0000","last_clean":"2024-04-25T13:42:35.147101+0000","last_became_active":"2024-04-25T13:42:08.037324+0000","last_became_peered":"2024-04-25T13:42:08.037324+0000","last_unstale":"2024-04-25T13:42:35.147101+0000","last_undegraded":"2024-04-25T13:42:35.147101+0000","last_fullsized":"2024-04-25T13:42:35.147101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:38.842821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.075902+0000","last_change":"2024-04-25T13:42:09.038795+0000","last_active":"2024-04-25T13:42:14.075902+0000","last_peered":"2024-04-25T13:42:14.075902+0000","last_clean":"2024-04-25T13:42:14.075902+0000","last_became_active":"2024-04-25T13:42:09.037635+0000","last_became_peered":"2024-04-25T13:42:09.037635+0000","last_unstale":"2024-04-25T13:42:14.075902+0000","last_undegraded":"2024-04-25T13:42:14.075902+0000","last_fullsized":"2024-04-25T13:42:14.075902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:46.616137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.075958+0000","last_change":"2024-04-25T13:42:13.081548+0000","last_active":"2024-04-25T13:42:14.075958+0000","last_peered":"2024-04-25T13:42:14.075958+0000","last_clean":"2024-04-25T13:42:14.075958+0000","last_became_active":"2024-04-25T13:42:13.080827+0000","last_became_peered":"2024-04-25T13:42:13.080827+0000","last_unstale":"2024-04-25T13:42:14.075958+0000","last_undegraded":"2024-04-25T13:42:14.075958+0000","last_fullsized":"2024-04-25T13:42:14.075958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:04.265824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:36.150460+0000","last_change":"2024-04-25T13:42:08.034171+0000","last_active":"2024-04-25T13:42:36.150460+0000","last_peered":"2024-04-25T13:42:36.150460+0000","last_clean":"2024-04-25T13:42:36.150460+0000","last_became_active":"2024-04-25T13:42:08.033769+0000","last_became_peered":"2024-04-25T13:42:08.033769+0000","last_unstale":"2024-04-25T13:42:36.150460+0000","last_undegraded":"2024-04-25T13:42:36.150460+0000","last_fullsized":"2024-04-25T13:42:36.150460+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:18.702989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.795130+0000","last_change":"2024-04-25T13:42:09.032212+0000","last_active":"2024-04-25T13:42:14.795130+0000","last_peered":"2024-04-25T13:42:14.795130+0000","last_clean":"2024-04-25T13:42:14.795130+0000","last_became_active":"2024-04-25T13:42:09.031833+0000","last_became_peered":"2024-04-25T13:42:09.031833+0000","last_unstale":"2024-04-25T13:42:14.795130+0000","last_undegraded":"2024-04-25T13:42:14.795130+0000","last_fullsized":"2024-04-25T13:42:14.795130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:27.681540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389195+0000","last_change":"2024-04-25T13:42:13.097322+0000","last_active":"2024-04-25T13:42:14.389195+0000","last_peered":"2024-04-25T13:42:14.389195+0000","last_clean":"2024-04-25T13:42:14.389195+0000","last_became_active":"2024-04-25T13:42:13.096869+0000","last_became_peered":"2024-04-25T13:42:13.096869+0000","last_unstale":"2024-04-25T13:42:14.389195+0000","last_undegraded":"2024-04-25T13:42:14.389195+0000","last_fullsized":"2024-04-25T13:42:14.389195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:53.041859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389670+0000","last_change":"2024-04-25T13:42:08.041834+0000","last_active":"2024-04-25T13:42:14.389670+0000","last_peered":"2024-04-25T13:42:14.389670+0000","last_clean":"2024-04-25T13:42:14.389670+0000","last_became_active":"2024-04-25T13:42:08.041246+0000","last_became_peered":"2024-04-25T13:42:08.041246+0000","last_unstale":"2024-04-25T13:42:14.389670+0000","last_undegraded":"2024-04-25T13:42:14.389670+0000","last_fullsized":"2024-04-25T13:42:14.389670+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:34.256539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389848+0000","last_change":"2024-04-25T13:42:09.044640+0000","last_active":"2024-04-25T13:42:14.389848+0000","last_peered":"2024-04-25T13:42:14.389848+0000","last_clean":"2024-04-25T13:42:14.389848+0000","last_became_active":"2024-04-25T13:42:09.044267+0000","last_became_peered":"2024-04-25T13:42:09.044267+0000","last_unstale":"2024-04-25T13:42:14.389848+0000","last_undegraded":"2024-04-25T13:42:14.389848+0000","last_fullsized":"2024-04-25T13:42:14.389848+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:47.934990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390566+0000","last_change":"2024-04-25T13:42:13.065858+0000","last_active":"2024-04-25T13:42:14.390566+0000","last_peered":"2024-04-25T13:42:14.390566+0000","last_clean":"2024-04-25T13:42:14.390566+0000","last_became_active":"2024-04-25T13:42:13.065315+0000","last_became_peered":"2024-04-25T13:42:13.065315+0000","last_unstale":"2024-04-25T13:42:14.390566+0000","last_undegraded":"2024-04-25T13:42:14.390566+0000","last_fullsized":"2024-04-25T13:42:14.390566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:41.116887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390566+0000","last_change":"2024-04-25T13:42:08.031548+0000","last_active":"2024-04-25T13:42:14.390566+0000","last_peered":"2024-04-25T13:42:14.390566+0000","last_clean":"2024-04-25T13:42:14.390566+0000","last_became_active":"2024-04-25T13:42:08.031147+0000","last_became_peered":"2024-04-25T13:42:08.031147+0000","last_unstale":"2024-04-25T13:42:14.390566+0000","last_undegraded":"2024-04-25T13:42:14.390566+0000","last_fullsized":"2024-04-25T13:42:14.390566+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:37.941234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390726+0000","last_change":"2024-04-25T13:42:09.048203+0000","last_active":"2024-04-25T13:42:14.390726+0000","last_peered":"2024-04-25T13:42:14.390726+0000","last_clean":"2024-04-25T13:42:14.390726+0000","last_became_active":"2024-04-25T13:42:09.047848+0000","last_became_peered":"2024-04-25T13:42:09.047848+0000","last_unstale":"2024-04-25T13:42:14.390726+0000","last_undegraded":"2024-04-25T13:42:14.390726+0000","last_fullsized":"2024-04-25T13:42:14.390726+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:27.829387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390823+0000","last_change":"2024-04-25T13:42:13.097390+0000","last_active":"2024-04-25T13:42:14.390823+0000","last_peered":"2024-04-25T13:42:14.390823+0000","last_clean":"2024-04-25T13:42:14.390823+0000","last_became_active":"2024-04-25T13:42:13.096795+0000","last_became_peered":"2024-04-25T13:42:13.096795+0000","last_unstale":"2024-04-25T13:42:14.390823+0000","last_undegraded":"2024-04-25T13:42:14.390823+0000","last_fullsized":"2024-04-25T13:42:14.390823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:15.401248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.076162+0000","last_change":"2024-04-25T13:42:09.038362+0000","last_active":"2024-04-25T13:42:14.076162+0000","last_peered":"2024-04-25T13:42:14.076162+0000","last_clean":"2024-04-25T13:42:14.076162+0000","last_became_active":"2024-04-25T13:42:09.037974+0000","last_became_peered":"2024-04-25T13:42:09.037974+0000","last_unstale":"2024-04-25T13:42:14.076162+0000","last_undegraded":"2024-04-25T13:42:14.076162+0000","last_fullsized":"2024-04-25T13:42:14.076162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:37.471217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:36.152116+0000","last_change":"2024-04-25T13:42:08.033967+0000","last_active":"2024-04-25T13:42:36.152116+0000","last_peered":"2024-04-25T13:42:36.152116+0000","last_clean":"2024-04-25T13:42:36.152116+0000","last_became_active":"2024-04-25T13:42:08.032906+0000","last_became_peered":"2024-04-25T13:42:08.032906+0000","last_unstale":"2024-04-25T13:42:36.152116+0000","last_undegraded":"2024-04-25T13:42:36.152116+0000","last_fullsized":"2024-04-25T13:42:36.152116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:49:10.012114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391510+0000","last_change":"2024-04-25T13:42:13.072944+0000","last_active":"2024-04-25T13:42:14.391510+0000","last_peered":"2024-04-25T13:42:14.391510+0000","last_clean":"2024-04-25T13:42:14.391510+0000","last_became_active":"2024-04-25T13:42:13.070990+0000","last_became_peered":"2024-04-25T13:42:13.070990+0000","last_unstale":"2024-04-25T13:42:14.391510+0000","last_undegraded":"2024-04-25T13:42:14.391510+0000","last_fullsized":"2024-04-25T13:42:14.391510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:18:24.946987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073010+0000","last_change":"2024-04-25T13:42:09.054270+0000","last_active":"2024-04-25T13:42:14.073010+0000","last_peered":"2024-04-25T13:42:14.073010+0000","last_clean":"2024-04-25T13:42:14.073010+0000","last_became_active":"2024-04-25T13:42:09.052333+0000","last_became_peered":"2024-04-25T13:42:09.052333+0000","last_unstale":"2024-04-25T13:42:14.073010+0000","last_undegraded":"2024-04-25T13:42:14.073010+0000","last_fullsized":"2024-04-25T13:42:14.073010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:52.401036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.141313+0000","last_change":"2024-04-25T13:42:08.033855+0000","last_active":"2024-04-25T13:42:34.141313+0000","last_peered":"2024-04-25T13:42:34.141313+0000","last_clean":"2024-04-25T13:42:34.141313+0000","last_became_active":"2024-04-25T13:42:08.033437+0000","last_became_peered":"2024-04-25T13:42:08.033437+0000","last_unstale":"2024-04-25T13:42:34.141313+0000","last_undegraded":"2024-04-25T13:42:34.141313+0000","last_fullsized":"2024-04-25T13:42:34.141313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:15.009423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389533+0000","last_change":"2024-04-25T13:40:53.040500+0000","last_active":"2024-04-25T13:42:14.389533+0000","last_peered":"2024-04-25T13:42:14.389533+0000","last_clean":"2024-04-25T13:42:14.389533+0000","last_became_active":"2024-04-25T13:40:53.034705+0000","last_became_peered":"2024-04-25T13:40:53.034705+0000","last_unstale":"2024-04-25T13:42:14.389533+0000","last_undegraded":"2024-04-25T13:42:14.389533+0000","last_fullsized":"2024-04-25T13:42:14.389533+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:37:26.143320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:37:26.143320+0000","last_clean_scrub_stamp":"2024-04-25T13:37:26.143320+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:39.342123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.076674+0000","last_change":"2024-04-25T13:42:13.097813+0000","last_active":"2024-04-25T13:42:14.076674+0000","last_peered":"2024-04-25T13:42:14.076674+0000","last_clean":"2024-04-25T13:42:14.076674+0000","last_became_active":"2024-04-25T13:42:13.096961+0000","last_became_peered":"2024-04-25T13:42:13.096961+0000","last_unstale":"2024-04-25T13:42:14.076674+0000","last_undegraded":"2024-04-25T13:42:14.076674+0000","last_fullsized":"2024-04-25T13:42:14.076674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:54.995639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.388909+0000","last_change":"2024-04-25T13:42:09.048826+0000","last_active":"2024-04-25T13:42:14.388909+0000","last_peered":"2024-04-25T13:42:14.388909+0000","last_clean":"2024-04-25T13:42:14.388909+0000","last_became_active":"2024-04-25T13:42:09.048454+0000","last_became_peered":"2024-04-25T13:42:09.048454+0000","last_unstale":"2024-04-25T13:42:14.388909+0000","last_undegraded":"2024-04-25T13:42:14.388909+0000","last_fullsized":"2024-04-25T13:42:14.388909+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:39:21.258720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:35.145085+0000","last_change":"2024-04-25T13:42:08.037788+0000","last_active":"2024-04-25T13:42:35.145085+0000","last_peered":"2024-04-25T13:42:35.145085+0000","last_clean":"2024-04-25T13:42:35.145085+0000","last_became_active":"2024-04-25T13:42:08.036707+0000","last_became_peered":"2024-04-25T13:42:08.036707+0000","last_unstale":"2024-04-25T13:42:35.145085+0000","last_undegraded":"2024-04-25T13:42:35.145085+0000","last_fullsized":"2024-04-25T13:42:35.145085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:09.835773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.794987+0000","last_change":"2024-04-25T13:42:13.079707+0000","last_active":"2024-04-25T13:42:14.794987+0000","last_peered":"2024-04-25T13:42:14.794987+0000","last_clean":"2024-04-25T13:42:14.794987+0000","last_became_active":"2024-04-25T13:42:13.079191+0000","last_became_peered":"2024-04-25T13:42:13.079191+0000","last_unstale":"2024-04-25T13:42:14.794987+0000","last_undegraded":"2024-04-25T13:42:14.794987+0000","last_fullsized":"2024-04-25T13:42:14.794987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:28.733884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.136782+0000","last_change":"2024-04-25T13:42:08.043402+0000","last_active":"2024-04-25T13:42:34.136782+0000","last_peered":"2024-04-25T13:42:34.136782+0000","last_clean":"2024-04-25T13:42:34.136782+0000","last_became_active":"2024-04-25T13:42:08.043059+0000","last_became_peered":"2024-04-25T13:42:08.043059+0000","last_unstale":"2024-04-25T13:42:34.136782+0000","last_undegraded":"2024-04-25T13:42:34.136782+0000","last_fullsized":"2024-04-25T13:42:34.136782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:36.533869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391059+0000","last_change":"2024-04-25T13:42:09.037287+0000","last_active":"2024-04-25T13:42:14.391059+0000","last_peered":"2024-04-25T13:42:14.391059+0000","last_clean":"2024-04-25T13:42:14.391059+0000","last_became_active":"2024-04-25T13:42:09.036944+0000","last_became_peered":"2024-04-25T13:42:09.036944+0000","last_unstale":"2024-04-25T13:42:14.391059+0000","last_undegraded":"2024-04-25T13:42:14.391059+0000","last_fullsized":"2024-04-25T13:42:14.391059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:43.675505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073010+0000","last_change":"2024-04-25T13:42:13.097645+0000","last_active":"2024-04-25T13:42:14.073010+0000","last_peered":"2024-04-25T13:42:14.073010+0000","last_clean":"2024-04-25T13:42:14.073010+0000","last_became_active":"2024-04-25T13:42:13.096881+0000","last_became_peered":"2024-04-25T13:42:13.096881+0000","last_unstale":"2024-04-25T13:42:14.073010+0000","last_undegraded":"2024-04-25T13:42:14.073010+0000","last_fullsized":"2024-04-25T13:42:14.073010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:03.957250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"76'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390088+0000","last_change":"2024-04-25T13:42:08.044040+0000","last_active":"2024-04-25T13:42:14.390088+0000","last_peered":"2024-04-25T13:42:14.390088+0000","last_clean":"2024-04-25T13:42:14.390088+0000","last_became_active":"2024-04-25T13:42:08.043590+0000","last_became_peered":"2024-04-25T13:42:08.043590+0000","last_unstale":"2024-04-25T13:42:14.390088+0000","last_undegraded":"2024-04-25T13:42:14.390088+0000","last_fullsized":"2024-04-25T13:42:14.390088+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:12.780050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073627+0000","last_change":"2024-04-25T13:42:09.051254+0000","last_active":"2024-04-25T13:42:14.073627+0000","last_peered":"2024-04-25T13:42:14.073627+0000","last_clean":"2024-04-25T13:42:14.073627+0000","last_became_active":"2024-04-25T13:42:09.050899+0000","last_became_peered":"2024-04-25T13:42:09.050899+0000","last_unstale":"2024-04-25T13:42:14.073627+0000","last_undegraded":"2024-04-25T13:42:14.073627+0000","last_fullsized":"2024-04-25T13:42:14.073627+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:48.851445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389060+0000","last_change":"2024-04-25T13:42:13.070375+0000","last_active":"2024-04-25T13:42:14.389060+0000","last_peered":"2024-04-25T13:42:14.389060+0000","last_clean":"2024-04-25T13:42:14.389060+0000","last_became_active":"2024-04-25T13:42:13.069571+0000","last_became_peered":"2024-04-25T13:42:13.069571+0000","last_unstale":"2024-04-25T13:42:14.389060+0000","last_undegraded":"2024-04-25T13:42:14.389060+0000","last_fullsized":"2024-04-25T13:42:14.389060+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:40.878206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.137560+0000","last_change":"2024-04-25T13:42:08.043596+0000","last_active":"2024-04-25T13:42:34.137560+0000","last_peered":"2024-04-25T13:42:34.137560+0000","last_clean":"2024-04-25T13:42:34.137560+0000","last_became_active":"2024-04-25T13:42:08.043233+0000","last_became_peered":"2024-04-25T13:42:08.043233+0000","last_unstale":"2024-04-25T13:42:34.137560+0000","last_undegraded":"2024-04-25T13:42:34.137560+0000","last_fullsized":"2024-04-25T13:42:34.137560+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:31.126367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390257+0000","last_change":"2024-04-25T13:42:09.045131+0000","last_active":"2024-04-25T13:42:14.390257+0000","last_peered":"2024-04-25T13:42:14.390257+0000","last_clean":"2024-04-25T13:42:14.390257+0000","last_became_active":"2024-04-25T13:42:09.044566+0000","last_became_peered":"2024-04-25T13:42:09.044566+0000","last_unstale":"2024-04-25T13:42:14.390257+0000","last_undegraded":"2024-04-25T13:42:14.390257+0000","last_fullsized":"2024-04-25T13:42:14.390257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:25.540538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389637+0000","last_change":"2024-04-25T13:42:13.097509+0000","last_active":"2024-04-25T13:42:14.389637+0000","last_peered":"2024-04-25T13:42:14.389637+0000","last_clean":"2024-04-25T13:42:14.389637+0000","last_became_active":"2024-04-25T13:42:13.096970+0000","last_became_peered":"2024-04-25T13:42:13.096970+0000","last_unstale":"2024-04-25T13:42:14.389637+0000","last_undegraded":"2024-04-25T13:42:14.389637+0000","last_fullsized":"2024-04-25T13:42:14.389637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:38.891212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.139281+0000","last_change":"2024-04-25T13:42:08.033992+0000","last_active":"2024-04-25T13:42:34.139281+0000","last_peered":"2024-04-25T13:42:34.139281+0000","last_clean":"2024-04-25T13:42:34.139281+0000","last_became_active":"2024-04-25T13:42:08.033603+0000","last_became_peered":"2024-04-25T13:42:08.033603+0000","last_unstale":"2024-04-25T13:42:34.139281+0000","last_undegraded":"2024-04-25T13:42:34.139281+0000","last_fullsized":"2024-04-25T13:42:34.139281+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:06.552660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.388701+0000","last_change":"2024-04-25T13:42:09.040719+0000","last_active":"2024-04-25T13:42:14.388701+0000","last_peered":"2024-04-25T13:42:14.388701+0000","last_clean":"2024-04-25T13:42:14.388701+0000","last_became_active":"2024-04-25T13:42:09.038144+0000","last_became_peered":"2024-04-25T13:42:09.038144+0000","last_unstale":"2024-04-25T13:42:14.388701+0000","last_undegraded":"2024-04-25T13:42:14.388701+0000","last_fullsized":"2024-04-25T13:42:14.388701+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:20.095587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390603+0000","last_change":"2024-04-25T13:42:13.086133+0000","last_active":"2024-04-25T13:42:14.390603+0000","last_peered":"2024-04-25T13:42:14.390603+0000","last_clean":"2024-04-25T13:42:14.390603+0000","last_became_active":"2024-04-25T13:42:13.085616+0000","last_became_peered":"2024-04-25T13:42:13.085616+0000","last_unstale":"2024-04-25T13:42:14.390603+0000","last_undegraded":"2024-04-25T13:42:14.390603+0000","last_fullsized":"2024-04-25T13:42:14.390603+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:45.939319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.138860+0000","last_change":"2024-04-25T13:42:08.028526+0000","last_active":"2024-04-25T13:42:34.138860+0000","last_peered":"2024-04-25T13:42:34.138860+0000","last_clean":"2024-04-25T13:42:34.138860+0000","last_became_active":"2024-04-25T13:42:08.028056+0000","last_became_peered":"2024-04-25T13:42:08.028056+0000","last_unstale":"2024-04-25T13:42:34.138860+0000","last_undegraded":"2024-04-25T13:42:34.138860+0000","last_fullsized":"2024-04-25T13:42:34.138860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:47.433236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.794780+0000","last_change":"2024-04-25T13:42:09.058985+0000","last_active":"2024-04-25T13:42:14.794780+0000","last_peered":"2024-04-25T13:42:14.794780+0000","last_clean":"2024-04-25T13:42:14.794780+0000","last_became_active":"2024-04-25T13:42:09.058638+0000","last_became_peered":"2024-04-25T13:42:09.058638+0000","last_unstale":"2024-04-25T13:42:14.794780+0000","last_undegraded":"2024-04-25T13:42:14.794780+0000","last_fullsized":"2024-04-25T13:42:14.794780+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:04.956881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390153+0000","last_change":"2024-04-25T13:42:13.074598+0000","last_active":"2024-04-25T13:42:14.390153+0000","last_peered":"2024-04-25T13:42:14.390153+0000","last_clean":"2024-04-25T13:42:14.390153+0000","last_became_active":"2024-04-25T13:42:13.074129+0000","last_became_peered":"2024-04-25T13:42:13.074129+0000","last_unstale":"2024-04-25T13:42:14.390153+0000","last_undegraded":"2024-04-25T13:42:14.390153+0000","last_fullsized":"2024-04-25T13:42:14.390153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:31.054517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.388843+0000","last_change":"2024-04-25T13:42:08.043962+0000","last_active":"2024-04-25T13:42:14.388843+0000","last_peered":"2024-04-25T13:42:14.388843+0000","last_clean":"2024-04-25T13:42:14.388843+0000","last_became_active":"2024-04-25T13:42:08.043526+0000","last_became_peered":"2024-04-25T13:42:08.043526+0000","last_unstale":"2024-04-25T13:42:14.388843+0000","last_undegraded":"2024-04-25T13:42:14.388843+0000","last_fullsized":"2024-04-25T13:42:14.388843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:22.766138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073284+0000","last_change":"2024-04-25T13:42:09.048574+0000","last_active":"2024-04-25T13:42:14.073284+0000","last_peered":"2024-04-25T13:42:14.073284+0000","last_clean":"2024-04-25T13:42:14.073284+0000","last_became_active":"2024-04-25T13:42:09.047982+0000","last_became_peered":"2024-04-25T13:42:09.047982+0000","last_unstale":"2024-04-25T13:42:14.073284+0000","last_undegraded":"2024-04-25T13:42:14.073284+0000","last_fullsized":"2024-04-25T13:42:14.073284+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:00.898772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389643+0000","last_change":"2024-04-25T13:42:13.097637+0000","last_active":"2024-04-25T13:42:14.389643+0000","last_peered":"2024-04-25T13:42:14.389643+0000","last_clean":"2024-04-25T13:42:14.389643+0000","last_became_active":"2024-04-25T13:42:13.096790+0000","last_became_peered":"2024-04-25T13:42:13.096790+0000","last_unstale":"2024-04-25T13:42:14.389643+0000","last_undegraded":"2024-04-25T13:42:14.389643+0000","last_fullsized":"2024-04-25T13:42:14.389643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:54.174615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:34.139937+0000","last_change":"2024-04-25T13:42:08.040207+0000","last_active":"2024-04-25T13:42:34.139937+0000","last_peered":"2024-04-25T13:42:34.139937+0000","last_clean":"2024-04-25T13:42:34.139937+0000","last_became_active":"2024-04-25T13:42:08.039809+0000","last_became_peered":"2024-04-25T13:42:08.039809+0000","last_unstale":"2024-04-25T13:42:34.139937+0000","last_undegraded":"2024-04-25T13:42:34.139937+0000","last_fullsized":"2024-04-25T13:42:34.139937+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:12.084793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390702+0000","last_change":"2024-04-25T13:42:09.048040+0000","last_active":"2024-04-25T13:42:14.390702+0000","last_peered":"2024-04-25T13:42:14.390702+0000","last_clean":"2024-04-25T13:42:14.390702+0000","last_became_active":"2024-04-25T13:42:09.047662+0000","last_became_peered":"2024-04-25T13:42:09.047662+0000","last_unstale":"2024-04-25T13:42:14.390702+0000","last_undegraded":"2024-04-25T13:42:14.390702+0000","last_fullsized":"2024-04-25T13:42:14.390702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:10:17.675167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073781+0000","last_change":"2024-04-25T13:42:13.072706+0000","last_active":"2024-04-25T13:42:14.073781+0000","last_peered":"2024-04-25T13:42:14.073781+0000","last_clean":"2024-04-25T13:42:14.073781+0000","last_became_active":"2024-04-25T13:42:13.071525+0000","last_became_peered":"2024-04-25T13:42:13.071525+0000","last_unstale":"2024-04-25T13:42:14.073781+0000","last_undegraded":"2024-04-25T13:42:14.073781+0000","last_fullsized":"2024-04-25T13:42:14.073781+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:20.351817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389916+0000","last_change":"2024-04-25T13:42:08.033975+0000","last_active":"2024-04-25T13:42:14.389916+0000","last_peered":"2024-04-25T13:42:14.389916+0000","last_clean":"2024-04-25T13:42:14.389916+0000","last_became_active":"2024-04-25T13:42:08.033302+0000","last_became_peered":"2024-04-25T13:42:08.033302+0000","last_unstale":"2024-04-25T13:42:14.389916+0000","last_undegraded":"2024-04-25T13:42:14.389916+0000","last_fullsized":"2024-04-25T13:42:14.389916+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:57:57.561629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391613+0000","last_change":"2024-04-25T13:42:09.052457+0000","last_active":"2024-04-25T13:42:14.391613+0000","last_peered":"2024-04-25T13:42:14.391613+0000","last_clean":"2024-04-25T13:42:14.391613+0000","last_became_active":"2024-04-25T13:42:09.052052+0000","last_became_peered":"2024-04-25T13:42:09.052052+0000","last_unstale":"2024-04-25T13:42:14.391613+0000","last_undegraded":"2024-04-25T13:42:14.391613+0000","last_fullsized":"2024-04-25T13:42:14.391613+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:42.589178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390943+0000","last_change":"2024-04-25T13:42:13.070743+0000","last_active":"2024-04-25T13:42:14.390943+0000","last_peered":"2024-04-25T13:42:14.390943+0000","last_clean":"2024-04-25T13:42:14.390943+0000","last_became_active":"2024-04-25T13:42:13.070251+0000","last_became_peered":"2024-04-25T13:42:13.070251+0000","last_unstale":"2024-04-25T13:42:14.390943+0000","last_undegraded":"2024-04-25T13:42:14.390943+0000","last_fullsized":"2024-04-25T13:42:14.390943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:19.646015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.076652+0000","last_change":"2024-04-25T13:42:08.044578+0000","last_active":"2024-04-25T13:42:14.076652+0000","last_peered":"2024-04-25T13:42:14.076652+0000","last_clean":"2024-04-25T13:42:14.076652+0000","last_became_active":"2024-04-25T13:42:08.044194+0000","last_became_peered":"2024-04-25T13:42:08.044194+0000","last_unstale":"2024-04-25T13:42:14.076652+0000","last_undegraded":"2024-04-25T13:42:14.076652+0000","last_fullsized":"2024-04-25T13:42:14.076652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:58.413832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391300+0000","last_change":"2024-04-25T13:42:09.051150+0000","last_active":"2024-04-25T13:42:14.391300+0000","last_peered":"2024-04-25T13:42:14.391300+0000","last_clean":"2024-04-25T13:42:14.391300+0000","last_became_active":"2024-04-25T13:42:09.050747+0000","last_became_peered":"2024-04-25T13:42:09.050747+0000","last_unstale":"2024-04-25T13:42:14.391300+0000","last_undegraded":"2024-04-25T13:42:14.391300+0000","last_fullsized":"2024-04-25T13:42:14.391300+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:10.923728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.075784+0000","last_change":"2024-04-25T13:42:13.075405+0000","last_active":"2024-04-25T13:42:14.075784+0000","last_peered":"2024-04-25T13:42:14.075784+0000","last_clean":"2024-04-25T13:42:14.075784+0000","last_became_active":"2024-04-25T13:42:13.074989+0000","last_became_peered":"2024-04-25T13:42:13.074989+0000","last_unstale":"2024-04-25T13:42:14.075784+0000","last_undegraded":"2024-04-25T13:42:14.075784+0000","last_fullsized":"2024-04-25T13:42:14.075784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:44.544984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390929+0000","last_change":"2024-04-25T13:42:08.033305+0000","last_active":"2024-04-25T13:42:14.390929+0000","last_peered":"2024-04-25T13:42:14.390929+0000","last_clean":"2024-04-25T13:42:14.390929+0000","last_became_active":"2024-04-25T13:42:08.032879+0000","last_became_peered":"2024-04-25T13:42:08.032879+0000","last_unstale":"2024-04-25T13:42:14.390929+0000","last_undegraded":"2024-04-25T13:42:14.390929+0000","last_fullsized":"2024-04-25T13:42:14.390929+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:53.170913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391728+0000","last_change":"2024-04-25T13:42:09.054682+0000","last_active":"2024-04-25T13:42:14.391728+0000","last_peered":"2024-04-25T13:42:14.391728+0000","last_clean":"2024-04-25T13:42:14.391728+0000","last_became_active":"2024-04-25T13:42:09.051962+0000","last_became_peered":"2024-04-25T13:42:09.051962+0000","last_unstale":"2024-04-25T13:42:14.391728+0000","last_undegraded":"2024-04-25T13:42:14.391728+0000","last_fullsized":"2024-04-25T13:42:14.391728+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:50.799284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.794820+0000","last_change":"2024-04-25T13:42:09.040062+0000","last_active":"2024-04-25T13:42:14.794820+0000","last_peered":"2024-04-25T13:42:14.794820+0000","last_clean":"2024-04-25T13:42:14.794820+0000","last_became_active":"2024-04-25T13:42:09.039692+0000","last_became_peered":"2024-04-25T13:42:09.039692+0000","last_unstale":"2024-04-25T13:42:14.794820+0000","last_undegraded":"2024-04-25T13:42:14.794820+0000","last_fullsized":"2024-04-25T13:42:14.794820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:48.527698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389205+0000","last_change":"2024-04-25T13:42:09.043357+0000","last_active":"2024-04-25T13:42:14.389205+0000","last_peered":"2024-04-25T13:42:14.389205+0000","last_clean":"2024-04-25T13:42:14.389205+0000","last_became_active":"2024-04-25T13:42:09.039984+0000","last_became_peered":"2024-04-25T13:42:09.039984+0000","last_unstale":"2024-04-25T13:42:14.389205+0000","last_undegraded":"2024-04-25T13:42:14.389205+0000","last_fullsized":"2024-04-25T13:42:14.389205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:07.852924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.388782+0000","last_change":"2024-04-25T13:42:09.064663+0000","last_active":"2024-04-25T13:42:14.388782+0000","last_peered":"2024-04-25T13:42:14.388782+0000","last_clean":"2024-04-25T13:42:14.388782+0000","last_became_active":"2024-04-25T13:42:09.064202+0000","last_became_peered":"2024-04-25T13:42:09.064202+0000","last_unstale":"2024-04-25T13:42:14.388782+0000","last_undegraded":"2024-04-25T13:42:14.388782+0000","last_fullsized":"2024-04-25T13:42:14.388782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:48.611882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.391037+0000","last_change":"2024-04-25T13:42:09.066196+0000","last_active":"2024-04-25T13:42:14.391037+0000","last_peered":"2024-04-25T13:42:14.391037+0000","last_clean":"2024-04-25T13:42:14.391037+0000","last_became_active":"2024-04-25T13:42:09.065793+0000","last_became_peered":"2024-04-25T13:42:09.065793+0000","last_unstale":"2024-04-25T13:42:14.391037+0000","last_undegraded":"2024-04-25T13:42:14.391037+0000","last_fullsized":"2024-04-25T13:42:14.391037+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:26.557457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390700+0000","last_change":"2024-04-25T13:42:09.063229+0000","last_active":"2024-04-25T13:42:14.390700+0000","last_peered":"2024-04-25T13:42:14.390700+0000","last_clean":"2024-04-25T13:42:14.390700+0000","last_became_active":"2024-04-25T13:42:09.062884+0000","last_became_peered":"2024-04-25T13:42:09.062884+0000","last_unstale":"2024-04-25T13:42:14.390700+0000","last_undegraded":"2024-04-25T13:42:14.390700+0000","last_fullsized":"2024-04-25T13:42:14.390700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:17.478141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.795278+0000","last_change":"2024-04-25T13:42:09.031731+0000","last_active":"2024-04-25T13:42:14.795278+0000","last_peered":"2024-04-25T13:42:14.795278+0000","last_clean":"2024-04-25T13:42:14.795278+0000","last_became_active":"2024-04-25T13:42:09.031316+0000","last_became_peered":"2024-04-25T13:42:09.031316+0000","last_unstale":"2024-04-25T13:42:14.795278+0000","last_undegraded":"2024-04-25T13:42:14.795278+0000","last_fullsized":"2024-04-25T13:42:14.795278+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:34.210437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.389371+0000","last_change":"2024-04-25T13:42:09.034429+0000","last_active":"2024-04-25T13:42:14.389371+0000","last_peered":"2024-04-25T13:42:14.389371+0000","last_clean":"2024-04-25T13:42:14.389371+0000","last_became_active":"2024-04-25T13:42:09.033917+0000","last_became_peered":"2024-04-25T13:42:09.033917+0000","last_unstale":"2024-04-25T13:42:14.389371+0000","last_undegraded":"2024-04-25T13:42:14.389371+0000","last_fullsized":"2024-04-25T13:42:14.389371+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:16.572251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073727+0000","last_change":"2024-04-25T13:42:09.060585+0000","last_active":"2024-04-25T13:42:14.073727+0000","last_peered":"2024-04-25T13:42:14.073727+0000","last_clean":"2024-04-25T13:42:14.073727+0000","last_became_active":"2024-04-25T13:42:09.058624+0000","last_became_peered":"2024-04-25T13:42:09.058624+0000","last_unstale":"2024-04-25T13:42:14.073727+0000","last_undegraded":"2024-04-25T13:42:14.073727+0000","last_fullsized":"2024-04-25T13:42:14.073727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:30.996402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.075980+0000","last_change":"2024-04-25T13:42:09.057544+0000","last_active":"2024-04-25T13:42:14.075980+0000","last_peered":"2024-04-25T13:42:14.075980+0000","last_clean":"2024-04-25T13:42:14.075980+0000","last_became_active":"2024-04-25T13:42:09.057127+0000","last_became_peered":"2024-04-25T13:42:09.057127+0000","last_unstale":"2024-04-25T13:42:14.075980+0000","last_undegraded":"2024-04-25T13:42:14.075980+0000","last_fullsized":"2024-04-25T13:42:14.075980+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:57.394029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073436+0000","last_change":"2024-04-25T13:42:09.057102+0000","last_active":"2024-04-25T13:42:14.073436+0000","last_peered":"2024-04-25T13:42:14.073436+0000","last_clean":"2024-04-25T13:42:14.073436+0000","last_became_active":"2024-04-25T13:42:09.056785+0000","last_became_peered":"2024-04-25T13:42:09.056785+0000","last_unstale":"2024-04-25T13:42:14.073436+0000","last_undegraded":"2024-04-25T13:42:14.073436+0000","last_fullsized":"2024-04-25T13:42:14.073436+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:57.278485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.073845+0000","last_change":"2024-04-25T13:42:09.045717+0000","last_active":"2024-04-25T13:42:14.073845+0000","last_peered":"2024-04-25T13:42:14.073845+0000","last_clean":"2024-04-25T13:42:14.073845+0000","last_became_active":"2024-04-25T13:42:09.045346+0000","last_became_peered":"2024-04-25T13:42:09.045346+0000","last_unstale":"2024-04-25T13:42:14.073845+0000","last_undegraded":"2024-04-25T13:42:14.073845+0000","last_fullsized":"2024-04-25T13:42:14.073845+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:53.731004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.390199+0000","last_change":"2024-04-25T13:42:09.061956+0000","last_active":"2024-04-25T13:42:14.390199+0000","last_peered":"2024-04-25T13:42:14.390199+0000","last_clean":"2024-04-25T13:42:14.390199+0000","last_became_active":"2024-04-25T13:42:09.061589+0000","last_became_peered":"2024-04-25T13:42:09.061589+0000","last_unstale":"2024-04-25T13:42:14.390199+0000","last_undegraded":"2024-04-25T13:42:14.390199+0000","last_fullsized":"2024-04-25T13:42:14.390199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:34.535044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T13:42:14.794927+0000","last_change":"2024-04-25T13:42:09.033976+0000","last_active":"2024-04-25T13:42:14.794927+0000","last_peered":"2024-04-25T13:42:14.794927+0000","last_clean":"2024-04-25T13:42:14.794927+0000","last_became_active":"2024-04-25T13:42:09.033136+0000","last_became_peered":"2024-04-25T13:42:09.033136+0000","last_unstale":"2024-04-25T13:42:14.794927+0000","last_undegraded":"2024-04-25T13:42:14.794927+0000","last_fullsized":"2024-04-25T13:42:14.794927+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:30.331233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6248,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":109,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":20725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678034,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":876544,"data_stored":425507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874263,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1507328,"data_stored":1020673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037789,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":426291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234018,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":897024,"data_stored":426245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430247,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28468,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716684,"statfs":{"total":95995035648,"available":95965884416,"internally_reserved":0,"allocated":1486848,"data_stored":1017667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593773,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":880640,"data_stored":425597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":888832,"data_stored":429349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":905216,"data_stored":426985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":430005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149756,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":888832,"data_stored":425701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953526,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":425529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790002,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36800,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708352,"statfs":{"total":95995035648,"available":95957352448,"internally_reserved":0,"allocated":1499136,"data_stored":1017351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:42:39.445 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T13:42:39.445 INFO:tasks.cephadm:Setting up client nodes... 2024-04-25T13:42:39.446 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-25T13:42:39.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:39 smithi161 ceph-mon[32696]: pgmap v300: 129 pgs: 129 active+clean; 583 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 1.9 KiB/s wr, 5 op/s 2024-04-25T13:42:39.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:39 smithi161 ceph-mon[32696]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:42:39.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:39 smithi161 ceph-mon[32696]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-25T13:42:39.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:39 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2455919996' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:42:39.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:39 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1836236411' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:40.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:40 smithi175 ceph-mon[32649]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T13:42:40.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:40 smithi175 ceph-mon[32649]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T13:42:40.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:40 smithi043 ceph-mon[29195]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T13:42:40.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:40 smithi043 ceph-mon[29195]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T13:42:40.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:40 smithi161 ceph-mon[32696]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T13:42:40.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:40 smithi161 ceph-mon[32696]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T13:42:41.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:41 smithi175 ceph-mon[32649]: pgmap v301: 129 pgs: 129 active+clean; 583 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-04-25T13:42:41.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:41 smithi043 ceph-mon[29195]: pgmap v301: 129 pgs: 129 active+clean; 583 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-04-25T13:42:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.499+0000 7f83e0b64700 1 -- 172.21.15.43:0/2774145662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83dc076560 msgr2=0x7f83dc106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.499+0000 7f83e0b64700 1 --2- 172.21.15.43:0/2774145662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83dc076560 0x7f83dc106d70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f83d400b0a0 tx=0x7f83d400b3b0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.499+0000 7f83e0b64700 1 -- 172.21.15.43:0/2774145662 shutdown_connections 2024-04-25T13:42:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.499+0000 7f83e0b64700 1 --2- 172.21.15.43:0/2774145662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc109e90 0x7f83dc10c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.499+0000 7f83e0b64700 1 --2- 172.21.15.43:0/2774145662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83dc076560 0x7f83dc106d70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.499+0000 7f83e0b64700 1 --2- 172.21.15.43:0/2774145662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83dc107340 0x7f83dc109800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.499+0000 7f83e0b64700 1 -- 172.21.15.43:0/2774145662 >> 172.21.15.43:0/2774145662 conn(0x7f83dc0fe740 msgr2=0x7f83dc100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.500+0000 7f83e0b64700 1 -- 172.21.15.43:0/2774145662 shutdown_connections 2024-04-25T13:42:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.500+0000 7f83e0b64700 1 -- 172.21.15.43:0/2774145662 wait complete. 2024-04-25T13:42:41.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.500+0000 7f83e0b64700 1 Processor -- start 2024-04-25T13:42:41.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.500+0000 7f83e0b64700 1 -- start start 2024-04-25T13:42:41.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83e0b64700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc076560 0x7f83dc1045c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83e0b64700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83dc107340 0x7f83dc102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83e0b64700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83dc109e90 0x7f83dc1031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83e0b64700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc10fad0 con 0x7f83dc109e90 2024-04-25T13:42:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83e0b64700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc10f950 con 0x7f83dc076560 2024-04-25T13:42:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83e0b64700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc10fc50 con 0x7f83dc107340 2024-04-25T13:42:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83dad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83dc109e90 0x7f83dc1031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83dad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83dc109e90 0x7f83dc1031b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43732/0 (socket says 172.21.15.43:43732) 2024-04-25T13:42:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83dad9d700 1 -- 172.21.15.43:0/2566288009 learned_addr learned my addr 172.21.15.43:0/2566288009 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83da59c700 1 --2- 172.21.15.43:0/2566288009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc076560 0x7f83dc1045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83d9d9b700 1 --2- 172.21.15.43:0/2566288009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83dc107340 0x7f83dc102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83dad9d700 1 -- 172.21.15.43:0/2566288009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83dc107340 msgr2=0x7f83dc102c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83dad9d700 1 --2- 172.21.15.43:0/2566288009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83dc107340 0x7f83dc102c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83dad9d700 1 -- 172.21.15.43:0/2566288009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc076560 msgr2=0x7f83dc1045c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83dad9d700 1 --2- 172.21.15.43:0/2566288009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc076560 0x7f83dc1045c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83dad9d700 1 -- 172.21.15.43:0/2566288009 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83dc103880 con 0x7f83dc109e90 2024-04-25T13:42:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.501+0000 7f83dad9d700 1 --2- 172.21.15.43:0/2566288009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83dc109e90 0x7f83dc1031b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00d980 tx=0x7f83cc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.502+0000 7f83d37fe700 1 -- 172.21.15.43:0/2566288009 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc017070 con 0x7f83dc109e90 2024-04-25T13:42:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.502+0000 7f83d37fe700 1 -- 172.21.15.43:0/2566288009 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83cc005020 con 0x7f83dc109e90 2024-04-25T13:42:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.502+0000 7f83e0b64700 1 -- 172.21.15.43:0/2566288009 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83dc1a47b0 con 0x7f83dc109e90 2024-04-25T13:42:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.502+0000 7f83d37fe700 1 -- 172.21.15.43:0/2566288009 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc00f980 con 0x7f83dc109e90 2024-04-25T13:42:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.502+0000 7f83e0b64700 1 -- 172.21.15.43:0/2566288009 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83dc1a4bb0 con 0x7f83dc109e90 2024-04-25T13:42:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.503+0000 7f83e0b64700 1 -- 172.21.15.43:0/2566288009 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83dc051190 con 0x7f83dc109e90 2024-04-25T13:42:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.504+0000 7f83d37fe700 1 -- 172.21.15.43:0/2566288009 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f83cc004a30 con 0x7f83dc109e90 2024-04-25T13:42:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.505+0000 7f83d37fe700 1 --2- 172.21.15.43:0/2566288009 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f83c80afc10 0x7f83c80b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.505+0000 7f83da59c700 1 --2- 172.21.15.43:0/2566288009 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f83c80afc10 0x7f83c80b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.505+0000 7f83d37fe700 1 -- 172.21.15.43:0/2566288009 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f83cc0df240 con 0x7f83dc109e90 2024-04-25T13:42:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.506+0000 7f83da59c700 1 --2- 172.21.15.43:0/2566288009 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f83c80afc10 0x7f83c80b2120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009fd0 tx=0x7f83d4009780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:41.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.509+0000 7f83d37fe700 1 -- 172.21.15.43:0/2566288009 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f83cc020020 con 0x7f83dc109e90 2024-04-25T13:42:41.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:41 smithi161 ceph-mon[32696]: pgmap v301: 129 pgs: 129 active+clean; 583 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-04-25T13:42:41.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.802+0000 7f83e0b64700 1 -- 172.21.15.43:0/2566288009 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f83dc0642a0 con 0x7f83dc109e90 2024-04-25T13:42:41.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.805+0000 7f83d37fe700 1 -- 172.21.15.43:0/2566288009 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f83cc0a7a20 con 0x7f83dc109e90 2024-04-25T13:42:41.806 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2024-04-25T13:42:41.806 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDRXSpmZyL2LxAAdqWhjeXjkf202oqqb6G9jQ== 2024-04-25T13:42:41.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.808+0000 7f83e0b64700 1 -- 172.21.15.43:0/2566288009 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f83c80afc10 msgr2=0x7f83c80b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.808+0000 7f83e0b64700 1 --2- 172.21.15.43:0/2566288009 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f83c80afc10 0x7f83c80b2120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009fd0 tx=0x7f83d4009780 comp rx=0 tx=0).stop 2024-04-25T13:42:41.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.808+0000 7f83e0b64700 1 -- 172.21.15.43:0/2566288009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83dc109e90 msgr2=0x7f83dc1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.808+0000 7f83e0b64700 1 --2- 172.21.15.43:0/2566288009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83dc109e90 0x7f83dc1031b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00d980 tx=0x7f83cc00dc90 comp rx=0 tx=0).stop 2024-04-25T13:42:41.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.808+0000 7f83e0b64700 1 -- 172.21.15.43:0/2566288009 shutdown_connections 2024-04-25T13:42:41.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.808+0000 7f83e0b64700 1 --2- 172.21.15.43:0/2566288009 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f83c80afc10 0x7f83c80b2120 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.808+0000 7f83e0b64700 1 --2- 172.21.15.43:0/2566288009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83dc109e90 0x7f83dc1031b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.808+0000 7f83e0b64700 1 --2- 172.21.15.43:0/2566288009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc076560 0x7f83dc1045c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.808+0000 7f83e0b64700 1 --2- 172.21.15.43:0/2566288009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83dc107340 0x7f83dc102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.808+0000 7f83e0b64700 1 -- 172.21.15.43:0/2566288009 >> 172.21.15.43:0/2566288009 conn(0x7f83dc0fe740 msgr2=0x7f83dc1055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:41.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.808+0000 7f83e0b64700 1 -- 172.21.15.43:0/2566288009 shutdown_connections 2024-04-25T13:42:41.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:41.808+0000 7f83e0b64700 1 -- 172.21.15.43:0/2566288009 wait complete. 2024-04-25T13:42:42.413 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:42 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2566288009' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T13:42:42.413 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:42 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2566288009' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T13:42:42.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:42 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2566288009' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T13:42:42.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:42 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2566288009' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T13:42:42.439 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:42:42.439 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-25T13:42:42.439 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T13:42:42.478 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T13:42:42.478 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-25T13:42:42.478 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-25T13:42:42.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:42 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2566288009' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T13:42:42.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:42 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2566288009' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T13:42:42.770 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:43.267 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:43 smithi043 ceph-mon[29195]: pgmap v302: 129 pgs: 129 active+clean; 625 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2024-04-25T13:42:43.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:43 smithi175 ceph-mon[32649]: pgmap v302: 129 pgs: 129 active+clean; 625 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2024-04-25T13:42:43.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:43 smithi161 ceph-mon[32696]: pgmap v302: 129 pgs: 129 active+clean; 625 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2024-04-25T13:42:44.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.573+0000 7f74b93a9700 1 -- 172.21.15.43:0/452672461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b4108610 msgr2=0x7f74b410ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.573+0000 7f74b93a9700 1 --2- 172.21.15.43:0/452672461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b4108610 0x7f74b410ff70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00b0d0 tx=0x7f74ac00b3e0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.573+0000 7f74b93a9700 1 -- 172.21.15.43:0/452672461 shutdown_connections 2024-04-25T13:42:44.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.573+0000 7f74b93a9700 1 --2- 172.21.15.43:0/452672461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b4108610 0x7f74b410ff70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.573+0000 7f74b93a9700 1 --2- 172.21.15.43:0/452672461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74b4103390 0x7f74b41037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.573+0000 7f74b93a9700 1 --2- 172.21.15.43:0/452672461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b4107cc0 0x7f74b41080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.573+0000 7f74b93a9700 1 -- 172.21.15.43:0/452672461 >> 172.21.15.43:0/452672461 conn(0x7f74b40fecc0 msgr2=0x7f74b41010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:44.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.573+0000 7f74b93a9700 1 -- 172.21.15.43:0/452672461 shutdown_connections 2024-04-25T13:42:44.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.573+0000 7f74b93a9700 1 -- 172.21.15.43:0/452672461 wait complete. 2024-04-25T13:42:44.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.573+0000 7f74b93a9700 1 Processor -- start 2024-04-25T13:42:44.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.573+0000 7f74b93a9700 1 -- start start 2024-04-25T13:42:44.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.574+0000 7f74b93a9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74b4103390 0x7f74b419ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.574+0000 7f74b93a9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b4107cc0 0x7f74b419bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.574+0000 7f74b93a9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b4108610 0x7f74b41a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.574+0000 7f74b93a9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f74b41131c0 con 0x7f74b4108610 2024-04-25T13:42:44.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.574+0000 7f74b93a9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4113040 con 0x7f74b4103390 2024-04-25T13:42:44.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.574+0000 7f74b93a9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4113340 con 0x7f74b4107cc0 2024-04-25T13:42:44.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.574+0000 7f74b37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b4108610 0x7f74b41a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.574+0000 7f74b37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b4108610 0x7f74b41a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43746/0 (socket says 172.21.15.43:43746) 2024-04-25T13:42:44.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.574+0000 7f74b37fe700 1 -- 172.21.15.43:0/3801405227 learned_addr learned my addr 172.21.15.43:0/3801405227 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:44.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.574+0000 7f74abfff700 1 --2- 172.21.15.43:0/3801405227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b4107cc0 0x7f74b419bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.574+0000 7f74b2ffd700 1 --2- 172.21.15.43:0/3801405227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74b4103390 0x7f74b419ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.574+0000 7f74b37fe700 1 -- 172.21.15.43:0/3801405227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b4107cc0 msgr2=0x7f74b419bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.574+0000 7f74b37fe700 1 --2- 172.21.15.43:0/3801405227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b4107cc0 0x7f74b419bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.574+0000 7f74b37fe700 1 -- 172.21.15.43:0/3801405227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74b4103390 msgr2=0x7f74b419ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.574+0000 7f74b37fe700 1 --2- 172.21.15.43:0/3801405227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74b4103390 0x7f74b419ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.574+0000 7f74b37fe700 1 -- 172.21.15.43:0/3801405227 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b419c7e0 con 0x7f74b4108610 2024-04-25T13:42:44.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.575+0000 7f74b37fe700 1 --2- 172.21.15.43:0/3801405227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b4108610 0x7f74b41a6b00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f74ac007d10 tx=0x7f74ac007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:44.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.575+0000 7f74b0ff9700 1 -- 172.21.15.43:0/3801405227 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac01f070 con 0x7f74b4108610 2024-04-25T13:42:44.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.575+0000 7f74b0ff9700 1 -- 172.21.15.43:0/3801405227 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74ac003e10 con 0x7f74b4108610 2024-04-25T13:42:44.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.575+0000 7f74b93a9700 1 -- 172.21.15.43:0/3801405227 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b41a7040 con 0x7f74b4108610 2024-04-25T13:42:44.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.575+0000 7f74b0ff9700 1 -- 172.21.15.43:0/3801405227 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac01b960 con 0x7f74b4108610 2024-04-25T13:42:44.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.575+0000 7f74b93a9700 1 -- 172.21.15.43:0/3801405227 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b41a7490 con 0x7f74b4108610 2024-04-25T13:42:44.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.576+0000 7f74b93a9700 1 -- 172.21.15.43:0/3801405227 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b4051190 con 0x7f74b4108610 2024-04-25T13:42:44.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.577+0000 7f74b0ff9700 1 -- 172.21.15.43:0/3801405227 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f74ac022070 con 0x7f74b4108610 2024-04-25T13:42:44.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.578+0000 7f74b0ff9700 1 --2- 172.21.15.43:0/3801405227 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f74a00afc10 0x7f74a00b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.578+0000 7f74b2ffd700 1 --2- 172.21.15.43:0/3801405227 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f74a00afc10 0x7f74a00b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.578+0000 7f74b0ff9700 1 -- 172.21.15.43:0/3801405227 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f74ac00f020 con 0x7f74b4108610 2024-04-25T13:42:44.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.579+0000 7f74b2ffd700 1 --2- 172.21.15.43:0/3801405227 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f74a00afc10 0x7f74a00b2120 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f74a4006fd0 tx=0x7f74a4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:44.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.583+0000 7f74b0ff9700 1 -- 172.21.15.43:0/3801405227 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f74ac029020 con 0x7f74b4108610 2024-04-25T13:42:44.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.852+0000 7f74b93a9700 1 -- 172.21.15.43:0/3801405227 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f74b402e6d0 con 0x7f74b4108610 2024-04-25T13:42:44.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.858+0000 7f74b0ff9700 1 -- 172.21.15.43:0/3801405227 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+284478 (secure 0 0 0) 0x7f74ac0a8e50 con 0x7f74b4108610 2024-04-25T13:42:44.861 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:44.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.862+0000 7f74b93a9700 1 -- 172.21.15.43:0/3801405227 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f74a00afc10 msgr2=0x7f74a00b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.862+0000 7f74b93a9700 1 --2- 172.21.15.43:0/3801405227 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f74a00afc10 0x7f74a00b2120 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f74a4006fd0 tx=0x7f74a4008040 comp rx=0 tx=0).stop 2024-04-25T13:42:44.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.862+0000 7f74b93a9700 1 -- 172.21.15.43:0/3801405227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b4108610 msgr2=0x7f74b41a6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.862+0000 7f74b93a9700 1 --2- 172.21.15.43:0/3801405227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b4108610 0x7f74b41a6b00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f74ac007d10 tx=0x7f74ac007d40 comp rx=0 tx=0).stop 2024-04-25T13:42:44.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.862+0000 7f74b93a9700 1 -- 172.21.15.43:0/3801405227 shutdown_connections 2024-04-25T13:42:44.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.862+0000 7f74b93a9700 1 --2- 172.21.15.43:0/3801405227 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f74a00afc10 0x7f74a00b2120 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.862+0000 7f74b93a9700 1 --2- 172.21.15.43:0/3801405227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b4108610 0x7f74b41a6b00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.862+0000 7f74b93a9700 1 --2- 172.21.15.43:0/3801405227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74b4103390 0x7f74b419ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.862+0000 7f74b93a9700 1 --2- 172.21.15.43:0/3801405227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b4107cc0 0x7f74b419bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.862+0000 7f74b93a9700 1 -- 172.21.15.43:0/3801405227 >> 172.21.15.43:0/3801405227 conn(0x7f74b40fecc0 msgr2=0x7f74b4109570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:44.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.862+0000 7f74b93a9700 1 -- 172.21.15.43:0/3801405227 shutdown_connections 2024-04-25T13:42:44.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:44.862+0000 7f74b93a9700 1 -- 172.21.15.43:0/3801405227 wait complete. 2024-04-25T13:42:45.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:45 smithi175 ceph-mon[32649]: pgmap v303: 129 pgs: 129 active+clean; 625 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2024-04-25T13:42:45.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:45 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3801405227' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-25T13:42:45.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:45 smithi043 ceph-mon[29195]: pgmap v303: 129 pgs: 129 active+clean; 625 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2024-04-25T13:42:45.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:45 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3801405227' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-25T13:42:45.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:45 smithi161 ceph-mon[32696]: pgmap v303: 129 pgs: 129 active+clean; 625 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2024-04-25T13:42:45.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:45 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3801405227' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-25T13:42:45.635 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2478639579},{"type":"v1","addr":"172.21.15.43:6801","nonce":2478639579}]},"active_addr":"172.21.15.43:6801/2478639579","active_change":"2024-04-25T13:34:57.835330+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.43:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":1369825389}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":21237256}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":2307776489}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":2028903966}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":4062778214}]}]} 2024-04-25T13:42:45.641 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-25T13:42:45.641 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-25T13:42:45.641 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T13:42:45.893 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:47.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:47 smithi175 ceph-mon[32649]: pgmap v304: 129 pgs: 129 active+clean; 625 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-04-25T13:42:47.452 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:47 smithi043 ceph-mon[29195]: pgmap v304: 129 pgs: 129 active+clean; 625 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-04-25T13:42:47.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:47 smithi161 ceph-mon[32696]: pgmap v304: 129 pgs: 129 active+clean; 625 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-04-25T13:42:47.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.710+0000 7feb82114700 1 -- 172.21.15.43:0/3245924803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c103360 msgr2=0x7feb7c103770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.710+0000 7feb82114700 1 --2- 172.21.15.43:0/3245924803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c103360 0x7feb7c103770 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0099c0 tx=0x7feb6c009cd0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.710+0000 7feb82114700 1 -- 172.21.15.43:0/3245924803 shutdown_connections 2024-04-25T13:42:47.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.710+0000 7feb82114700 1 --2- 172.21.15.43:0/3245924803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb7c1085e0 0x7feb7c10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.710+0000 7feb82114700 1 --2- 172.21.15.43:0/3245924803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c103360 0x7feb7c103770 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.710+0000 7feb82114700 1 --2- 172.21.15.43:0/3245924803 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb7c107c90 0x7feb7c1080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.710+0000 7feb82114700 1 -- 172.21.15.43:0/3245924803 >> 172.21.15.43:0/3245924803 conn(0x7feb7c0fec90 msgr2=0x7feb7c1010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:47.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.710+0000 7feb82114700 1 -- 172.21.15.43:0/3245924803 shutdown_connections 2024-04-25T13:42:47.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.710+0000 7feb82114700 1 -- 172.21.15.43:0/3245924803 wait complete. 2024-04-25T13:42:47.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.711+0000 7feb82114700 1 Processor -- start 2024-04-25T13:42:47.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.711+0000 7feb82114700 1 -- start start 2024-04-25T13:42:47.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.711+0000 7feb82114700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c103360 0x7feb7c1a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.711+0000 7feb82114700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb7c107c90 0x7feb7c1a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.711+0000 7feb82114700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb7c1085e0 0x7feb7c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.711+0000 7feb82114700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c1130c0 con 0x7feb7c103360 2024-04-25T13:42:47.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.711+0000 7feb82114700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c112f40 con 0x7feb7c107c90 2024-04-25T13:42:47.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.711+0000 7feb82114700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c113240 con 0x7feb7c1085e0 2024-04-25T13:42:47.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.711+0000 7feb7b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c103360 0x7feb7c1a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.711+0000 7feb7b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c103360 0x7feb7c1a0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43764/0 (socket says 172.21.15.43:43764) 2024-04-25T13:42:47.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.711+0000 7feb7b7fe700 1 -- 172.21.15.43:0/649458120 learned_addr learned my addr 172.21.15.43:0/649458120 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:47.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.712+0000 7feb7affd700 1 --2- 172.21.15.43:0/649458120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb7c107c90 0x7feb7c1a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.712+0000 7feb7bfff700 1 --2- 172.21.15.43:0/649458120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb7c1085e0 0x7feb7c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.712+0000 7feb7b7fe700 1 -- 172.21.15.43:0/649458120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb7c1085e0 msgr2=0x7feb7c19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.712+0000 7feb7b7fe700 1 --2- 172.21.15.43:0/649458120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb7c1085e0 0x7feb7c19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.712+0000 7feb7b7fe700 1 -- 172.21.15.43:0/649458120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb7c107c90 msgr2=0x7feb7c1a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.712+0000 7feb7b7fe700 1 --2- 172.21.15.43:0/649458120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb7c107c90 0x7feb7c1a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.712+0000 7feb7b7fe700 1 -- 172.21.15.43:0/649458120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7c19b100 con 0x7feb7c103360 2024-04-25T13:42:47.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.712+0000 7feb7bfff700 1 --2- 172.21.15.43:0/649458120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb7c1085e0 0x7feb7c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:47.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.712+0000 7feb7affd700 1 --2- 172.21.15.43:0/649458120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb7c107c90 0x7feb7c1a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:47.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.712+0000 7feb7b7fe700 1 --2- 172.21.15.43:0/649458120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c103360 0x7feb7c1a0830 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7feb6c006010 tx=0x7feb6c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:47.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.712+0000 7feb78ff9700 1 -- 172.21.15.43:0/649458120 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c026070 con 0x7feb7c103360 2024-04-25T13:42:47.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.712+0000 7feb78ff9700 1 -- 172.21.15.43:0/649458120 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb6c003c50 con 0x7feb7c103360 2024-04-25T13:42:47.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.712+0000 7feb82114700 1 -- 172.21.15.43:0/649458120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb7c19b390 con 0x7feb7c103360 2024-04-25T13:42:47.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.712+0000 7feb78ff9700 1 -- 172.21.15.43:0/649458120 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c00fb10 con 0x7feb7c103360 2024-04-25T13:42:47.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.712+0000 7feb82114700 1 -- 172.21.15.43:0/649458120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb7c0ff0a0 con 0x7feb7c103360 2024-04-25T13:42:47.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.713+0000 7feb82114700 1 -- 172.21.15.43:0/649458120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb7c104810 con 0x7feb7c103360 2024-04-25T13:42:47.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.716+0000 7feb78ff9700 1 -- 172.21.15.43:0/649458120 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7feb6c029070 con 0x7feb7c103360 2024-04-25T13:42:47.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.717+0000 7feb78ff9700 1 --2- 172.21.15.43:0/649458120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7feb640afc90 0x7feb640b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.717+0000 7feb7affd700 1 --2- 172.21.15.43:0/649458120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7feb640afc90 0x7feb640b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.717+0000 7feb78ff9700 1 -- 172.21.15.43:0/649458120 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7feb6c0dfd40 con 0x7feb7c103360 2024-04-25T13:42:47.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.717+0000 7feb7affd700 1 --2- 172.21.15.43:0/649458120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7feb640afc90 0x7feb640b21a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feb7c1099e0 tx=0x7feb70009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:47.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.720+0000 7feb78ff9700 1 -- 172.21.15.43:0/649458120 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7feb6c013070 con 0x7feb7c103360 2024-04-25T13:42:47.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.929+0000 7feb82114700 1 -- 172.21.15.43:0/649458120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb7c19bf80 con 0x7feb7c103360 2024-04-25T13:42:47.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.930+0000 7feb78ff9700 1 -- 172.21.15.43:0/649458120 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24117 (secure 0 0 0) 0x7feb6c0a85b0 con 0x7feb7c103360 2024-04-25T13:42:47.931 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:47.931 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":80,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:42:13.441319+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:47.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.932+0000 7feb82114700 1 -- 172.21.15.43:0/649458120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7feb640afc90 msgr2=0x7feb640b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.932+0000 7feb82114700 1 --2- 172.21.15.43:0/649458120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7feb640afc90 0x7feb640b21a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feb7c1099e0 tx=0x7feb70009260 comp rx=0 tx=0).stop 2024-04-25T13:42:47.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.932+0000 7feb82114700 1 -- 172.21.15.43:0/649458120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c103360 msgr2=0x7feb7c1a0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.932+0000 7feb82114700 1 --2- 172.21.15.43:0/649458120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c103360 0x7feb7c1a0830 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7feb6c006010 tx=0x7feb6c004270 comp rx=0 tx=0).stop 2024-04-25T13:42:47.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.932+0000 7feb82114700 1 -- 172.21.15.43:0/649458120 shutdown_connections 2024-04-25T13:42:47.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.932+0000 7feb82114700 1 --2- 172.21.15.43:0/649458120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7feb640afc90 0x7feb640b21a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.932+0000 7feb82114700 1 --2- 172.21.15.43:0/649458120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb7c1085e0 0x7feb7c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.932+0000 7feb82114700 1 --2- 172.21.15.43:0/649458120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c103360 0x7feb7c1a0830 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.932+0000 7feb82114700 1 --2- 172.21.15.43:0/649458120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb7c107c90 0x7feb7c1a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.932+0000 7feb82114700 1 -- 172.21.15.43:0/649458120 >> 172.21.15.43:0/649458120 conn(0x7feb7c0fec90 msgr2=0x7feb7c06b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:47.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.933+0000 7feb82114700 1 -- 172.21.15.43:0/649458120 shutdown_connections 2024-04-25T13:42:47.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:47.933+0000 7feb82114700 1 -- 172.21.15.43:0/649458120 wait complete. 2024-04-25T13:42:48.326 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:48 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/649458120' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:48.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:48 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/649458120' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:48.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:48 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/649458120' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:48.670 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-25T13:42:48.670 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T13:42:48.920 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:49.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:49 smithi043 ceph-mon[29195]: pgmap v305: 129 pgs: 129 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-04-25T13:42:49.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:49 smithi175 ceph-mon[32649]: pgmap v305: 129 pgs: 129 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-04-25T13:42:49.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:49 smithi161 ceph-mon[32696]: pgmap v305: 129 pgs: 129 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-04-25T13:42:50.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.728+0000 7fe399a47700 1 -- 172.21.15.43:0/4215675769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe394103390 msgr2=0x7fe3941037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.728+0000 7fe399a47700 1 --2- 172.21.15.43:0/4215675769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe394103390 0x7fe3941037a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe3840099c0 tx=0x7fe384009cd0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.728+0000 7fe399a47700 1 -- 172.21.15.43:0/4215675769 shutdown_connections 2024-04-25T13:42:50.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.728+0000 7fe399a47700 1 --2- 172.21.15.43:0/4215675769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe394108610 0x7fe39410ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.728+0000 7fe399a47700 1 --2- 172.21.15.43:0/4215675769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe394103390 0x7fe3941037a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.728+0000 7fe399a47700 1 --2- 172.21.15.43:0/4215675769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe394107cc0 0x7fe3941080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.728+0000 7fe399a47700 1 -- 172.21.15.43:0/4215675769 >> 172.21.15.43:0/4215675769 conn(0x7fe3940fecc0 msgr2=0x7fe3941010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:50.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.728+0000 7fe399a47700 1 -- 172.21.15.43:0/4215675769 shutdown_connections 2024-04-25T13:42:50.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.728+0000 7fe399a47700 1 -- 172.21.15.43:0/4215675769 wait complete. 2024-04-25T13:42:50.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.729+0000 7fe399a47700 1 Processor -- start 2024-04-25T13:42:50.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.729+0000 7fe399a47700 1 -- start start 2024-04-25T13:42:50.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.729+0000 7fe399a47700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe394103390 0x7fe39419bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.729+0000 7fe399a47700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe394107cc0 0x7fe39419c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.729+0000 7fe399a47700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe394108610 0x7fe39419c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.729+0000 7fe399a47700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe394113140 con 0x7fe394103390 2024-04-25T13:42:50.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.729+0000 7fe399a47700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe394112fc0 con 0x7fe394107cc0 2024-04-25T13:42:50.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.729+0000 7fe399a47700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe3941132c0 con 0x7fe394108610 2024-04-25T13:42:50.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.729+0000 7fe392ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe394103390 0x7fe39419bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.729+0000 7fe392ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe394103390 0x7fe39419bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60380/0 (socket says 172.21.15.43:60380) 2024-04-25T13:42:50.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.729+0000 7fe392ffd700 1 -- 172.21.15.43:0/3565245688 learned_addr learned my addr 172.21.15.43:0/3565245688 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:42:50.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.730+0000 7fe38bfff700 1 --2- 172.21.15.43:0/3565245688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe394107cc0 0x7fe39419c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.730+0000 7fe3937fe700 1 --2- 172.21.15.43:0/3565245688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe394108610 0x7fe39419c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.730+0000 7fe392ffd700 1 -- 172.21.15.43:0/3565245688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe394108610 msgr2=0x7fe39419c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.730+0000 7fe392ffd700 1 --2- 172.21.15.43:0/3565245688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe394108610 0x7fe39419c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.730+0000 7fe392ffd700 1 -- 172.21.15.43:0/3565245688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe394107cc0 msgr2=0x7fe39419c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.730+0000 7fe392ffd700 1 --2- 172.21.15.43:0/3565245688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe394107cc0 0x7fe39419c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.730+0000 7fe392ffd700 1 -- 172.21.15.43:0/3565245688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3941a6e30 con 0x7fe394103390 2024-04-25T13:42:50.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.730+0000 7fe38bfff700 1 --2- 172.21.15.43:0/3565245688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe394107cc0 0x7fe39419c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:50.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.730+0000 7fe392ffd700 1 --2- 172.21.15.43:0/3565245688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe394103390 0x7fe39419bac0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe38400b580 tx=0x7fe38400f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:50.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.730+0000 7fe398a45700 1 -- 172.21.15.43:0/3565245688 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384027070 con 0x7fe394103390 2024-04-25T13:42:50.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.730+0000 7fe398a45700 1 -- 172.21.15.43:0/3565245688 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe38400fdd0 con 0x7fe394103390 2024-04-25T13:42:50.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.730+0000 7fe398a45700 1 -- 172.21.15.43:0/3565245688 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3840173f0 con 0x7fe394103390 2024-04-25T13:42:50.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.730+0000 7fe399a47700 1 -- 172.21.15.43:0/3565245688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3941a70c0 con 0x7fe394103390 2024-04-25T13:42:50.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.730+0000 7fe399a47700 1 -- 172.21.15.43:0/3565245688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3941a74c0 con 0x7fe394103390 2024-04-25T13:42:50.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.731+0000 7fe399a47700 1 -- 172.21.15.43:0/3565245688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe394051190 con 0x7fe394103390 2024-04-25T13:42:50.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.733+0000 7fe398a45700 1 -- 172.21.15.43:0/3565245688 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fe38402a070 con 0x7fe394103390 2024-04-25T13:42:50.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.733+0000 7fe398a45700 1 --2- 172.21.15.43:0/3565245688 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe3800afc90 0x7fe3800b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.734+0000 7fe38bfff700 1 --2- 172.21.15.43:0/3565245688 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe3800afc90 0x7fe3800b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.734+0000 7fe398a45700 1 -- 172.21.15.43:0/3565245688 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fe3840e0570 con 0x7fe394103390 2024-04-25T13:42:50.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.734+0000 7fe38bfff700 1 --2- 172.21.15.43:0/3565245688 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe3800afc90 0x7fe3800b21a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe37c005950 tx=0x7fe37c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:50.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.737+0000 7fe398a45700 1 -- 172.21.15.43:0/3565245688 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe384031020 con 0x7fe394103390 2024-04-25T13:42:50.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.945+0000 7fe399a47700 1 -- 172.21.15.43:0/3565245688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe39402e6d0 con 0x7fe394103390 2024-04-25T13:42:50.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.947+0000 7fe398a45700 1 -- 172.21.15.43:0/3565245688 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24117 (secure 0 0 0) 0x7fe384013070 con 0x7fe394103390 2024-04-25T13:42:50.948 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:42:50.948 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":80,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:42:13.441319+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:50.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.950+0000 7fe399a47700 1 -- 172.21.15.43:0/3565245688 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe3800afc90 msgr2=0x7fe3800b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.950+0000 7fe399a47700 1 --2- 172.21.15.43:0/3565245688 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe3800afc90 0x7fe3800b21a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe37c005950 tx=0x7fe37c0058e0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.950+0000 7fe399a47700 1 -- 172.21.15.43:0/3565245688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe394103390 msgr2=0x7fe39419bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.950+0000 7fe399a47700 1 --2- 172.21.15.43:0/3565245688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe394103390 0x7fe39419bac0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe38400b580 tx=0x7fe38400f510 comp rx=0 tx=0).stop 2024-04-25T13:42:50.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.950+0000 7fe399a47700 1 -- 172.21.15.43:0/3565245688 shutdown_connections 2024-04-25T13:42:50.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.950+0000 7fe399a47700 1 --2- 172.21.15.43:0/3565245688 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe3800afc90 0x7fe3800b21a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.950+0000 7fe399a47700 1 --2- 172.21.15.43:0/3565245688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe394108610 0x7fe39419c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.950+0000 7fe399a47700 1 --2- 172.21.15.43:0/3565245688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe394103390 0x7fe39419bac0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.950+0000 7fe399a47700 1 --2- 172.21.15.43:0/3565245688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe394107cc0 0x7fe39419c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.950+0000 7fe399a47700 1 -- 172.21.15.43:0/3565245688 >> 172.21.15.43:0/3565245688 conn(0x7fe3940fecc0 msgr2=0x7fe3941010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:50.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.950+0000 7fe399a47700 1 -- 172.21.15.43:0/3565245688 shutdown_connections 2024-04-25T13:42:50.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:42:50.950+0000 7fe399a47700 1 -- 172.21.15.43:0/3565245688 wait complete. 2024-04-25T13:42:51.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:51 smithi043 ceph-mon[29195]: pgmap v306: 129 pgs: 129 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-04-25T13:42:51.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:51 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3565245688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:51.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:51 smithi175 ceph-mon[32649]: pgmap v306: 129 pgs: 129 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-04-25T13:42:51.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:51 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3565245688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:51.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:51 smithi161 ceph-mon[32696]: pgmap v306: 129 pgs: 129 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-04-25T13:42:51.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:51 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3565245688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:42:51.643 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-25T13:42:51.644 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-25T13:42:51.644 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-25T13:42:51.645 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-25T13:42:51.645 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-25T13:42:51.646 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-25T13:42:51.646 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-04-25T13:42:51.646 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-04-25T13:42:51.647 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-04-25T13:42:51.647 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-04-25T13:42:51.648 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-04-25T13:42:51.648 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-04-25T13:42:52.434 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:52.435 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:52.437 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:52.437 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:52.440 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:52.445 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:52.445 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:52.446 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:52.450 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:52.450 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:52.451 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:52.522 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:42:53.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:53 smithi175 ceph-mon[32649]: pgmap v307: 129 pgs: 129 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-04-25T13:42:53.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:53 smithi043 ceph-mon[29195]: pgmap v307: 129 pgs: 129 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-04-25T13:42:53.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:53 smithi161 ceph-mon[32696]: pgmap v307: 129 pgs: 129 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-04-25T13:42:55.306 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:55 smithi043 ceph-mon[29195]: pgmap v308: 129 pgs: 129 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T13:42:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:55 smithi175 ceph-mon[32649]: pgmap v308: 129 pgs: 129 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T13:42:55.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:55 smithi161 ceph-mon[32696]: pgmap v308: 129 pgs: 129 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T13:42:57.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:57 smithi043 ceph-mon[29195]: pgmap v309: 129 pgs: 129 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T13:42:57.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:57 smithi161 ceph-mon[32696]: pgmap v309: 129 pgs: 129 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T13:42:57.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:57 smithi175 ceph-mon[32649]: pgmap v309: 129 pgs: 129 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T13:42:58.293 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-04-25T13:42:58.293 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2024-04-25T13:42:58.293 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-04-25T13:42:58.293 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-04-25T13:42:58.293 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-04-25T13:42:58.293 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-04-25T13:42:58.293 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-04-25T13:42:58.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 10]}]: dispatch 2024-04-25T13:42:58.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-04-25T13:42:58.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:58 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-04-25T13:42:58.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-04-25T13:42:58.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2024-04-25T13:42:58.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-04-25T13:42:58.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-04-25T13:42:58.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-04-25T13:42:58.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-04-25T13:42:58.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-04-25T13:42:58.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 10]}]: dispatch 2024-04-25T13:42:58.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-04-25T13:42:58.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:58 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-04-25T13:42:58.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-04-25T13:42:58.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2024-04-25T13:42:58.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-04-25T13:42:58.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-04-25T13:42:58.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-04-25T13:42:58.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-04-25T13:42:58.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-04-25T13:42:58.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 10]}]: dispatch 2024-04-25T13:42:58.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-04-25T13:42:58.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:58 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-04-25T13:42:59.357 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:59 smithi043 ceph-mon[29195]: pgmap v310: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-04-25T13:42:59.357 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-04-25T13:42:59.357 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2024-04-25T13:42:59.357 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-04-25T13:42:59.357 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-04-25T13:42:59.357 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-04-25T13:42:59.357 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-04-25T13:42:59.357 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-04-25T13:42:59.357 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 10]}]': finished 2024-04-25T13:42:59.358 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-04-25T13:42:59.358 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-04-25T13:42:59.358 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:42:59 smithi043 ceph-mon[29195]: osdmap e81: 12 total, 12 up, 12 in 2024-04-25T13:42:59.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:59 smithi161 ceph-mon[32696]: pgmap v310: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-04-25T13:42:59.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-04-25T13:42:59.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2024-04-25T13:42:59.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-04-25T13:42:59.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-04-25T13:42:59.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-04-25T13:42:59.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-04-25T13:42:59.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-04-25T13:42:59.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 10]}]': finished 2024-04-25T13:42:59.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-04-25T13:42:59.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-04-25T13:42:59.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:42:59 smithi161 ceph-mon[32696]: osdmap e81: 12 total, 12 up, 12 in 2024-04-25T13:42:59.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:59 smithi175 ceph-mon[32649]: pgmap v310: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-04-25T13:42:59.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-04-25T13:42:59.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2024-04-25T13:42:59.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-04-25T13:42:59.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-04-25T13:42:59.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-04-25T13:42:59.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-04-25T13:42:59.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-04-25T13:42:59.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 10]}]': finished 2024-04-25T13:42:59.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-04-25T13:42:59.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-04-25T13:42:59.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:42:59 smithi175 ceph-mon[32649]: osdmap e81: 12 total, 12 up, 12 in 2024-04-25T13:43:00.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:00 smithi043 ceph-mon[29195]: osdmap e82: 12 total, 12 up, 12 in 2024-04-25T13:43:00.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:00 smithi161 ceph-mon[32696]: osdmap e82: 12 total, 12 up, 12 in 2024-04-25T13:43:00.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:00 smithi175 ceph-mon[32649]: osdmap e82: 12 total, 12 up, 12 in 2024-04-25T13:43:01.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.254+0000 7fa07b412700 1 -- 172.21.15.43:0/428464673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa074105ce0 msgr2=0x7fa07410e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:01.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.254+0000 7fa07b412700 1 --2- 172.21.15.43:0/428464673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa074105ce0 0x7fa07410e230 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa064009990 tx=0x7fa064009ca0 comp rx=0 tx=0).stop 2024-04-25T13:43:01.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.254+0000 7fa07b412700 1 -- 172.21.15.43:0/428464673 shutdown_connections 2024-04-25T13:43:01.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.254+0000 7fa07b412700 1 --2- 172.21.15.43:0/428464673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa07410e7c0 0x7fa074110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:01.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.254+0000 7fa07b412700 1 --2- 172.21.15.43:0/428464673 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa074105390 0x7fa0741057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:01.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.254+0000 7fa07b412700 1 --2- 172.21.15.43:0/428464673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa074105ce0 0x7fa07410e230 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:01.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.254+0000 7fa07b412700 1 -- 172.21.15.43:0/428464673 >> 172.21.15.43:0/428464673 conn(0x7fa0740fecc0 msgr2=0x7fa0741010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:01.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.254+0000 7fa07b412700 1 -- 172.21.15.43:0/428464673 shutdown_connections 2024-04-25T13:43:01.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.254+0000 7fa07b412700 1 -- 172.21.15.43:0/428464673 wait complete. 2024-04-25T13:43:01.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.255+0000 7fa07b412700 1 Processor -- start 2024-04-25T13:43:01.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.255+0000 7fa07b412700 1 -- start start 2024-04-25T13:43:01.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.255+0000 7fa07b412700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa074105390 0x7fa0741a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:01.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.255+0000 7fa07b412700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa074105ce0 0x7fa0741a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:01.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.255+0000 7fa07b412700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa07410e7c0 0x7fa07419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:01.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.255+0000 7fa07b412700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa074114250 con 0x7fa07410e7c0 2024-04-25T13:43:01.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.255+0000 7fa07b412700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fa0741140d0 con 0x7fa074105ce0 2024-04-25T13:43:01.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.255+0000 7fa07b412700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0741143d0 con 0x7fa074105390 2024-04-25T13:43:01.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.255+0000 7fa0799af700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa07410e7c0 0x7fa07419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:01.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.255+0000 7fa0799af700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa07410e7c0 0x7fa07419aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38486/0 (socket says 172.21.15.43:38486) 2024-04-25T13:43:01.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.255+0000 7fa0799af700 1 -- 172.21.15.43:0/2055731815 learned_addr learned my addr 172.21.15.43:0/2055731815 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:01.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.255+0000 7fa0789ad700 1 --2- 172.21.15.43:0/2055731815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa074105ce0 0x7fa0741a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:01.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.255+0000 7fa0791ae700 1 --2- 172.21.15.43:0/2055731815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa074105390 0x7fa0741a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:01.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.256+0000 7fa0799af700 1 -- 172.21.15.43:0/2055731815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa074105390 msgr2=0x7fa0741a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:01.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.256+0000 7fa0799af700 1 --2- 172.21.15.43:0/2055731815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa074105390 0x7fa0741a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:01.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.256+0000 7fa0799af700 1 -- 172.21.15.43:0/2055731815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa074105ce0 msgr2=0x7fa0741a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:01.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.256+0000 7fa0799af700 1 --2- 172.21.15.43:0/2055731815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa074105ce0 0x7fa0741a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:01.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.256+0000 7fa0799af700 1 -- 172.21.15.43:0/2055731815 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07419b160 con 0x7fa07410e7c0 2024-04-25T13:43:01.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.256+0000 7fa0799af700 1 --2- 172.21.15.43:0/2055731815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa07410e7c0 0x7fa07419aab0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00b970 tx=0x7fa06c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:01.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.256+0000 7fa06a7fc700 1 -- 172.21.15.43:0/2055731815 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00d860 con 0x7fa07410e7c0 2024-04-25T13:43:01.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.256+0000 7fa06a7fc700 1 -- 172.21.15.43:0/2055731815 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa06c00e430 con 0x7fa07410e7c0 2024-04-25T13:43:01.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.256+0000 7fa06a7fc700 1 -- 172.21.15.43:0/2055731815 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c017660 con 0x7fa07410e7c0 2024-04-25T13:43:01.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.256+0000 7fa07b412700 1 -- 172.21.15.43:0/2055731815 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07419b450 con 0x7fa07410e7c0 2024-04-25T13:43:01.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.256+0000 7fa07b412700 1 -- 172.21.15.43:0/2055731815 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0741a7720 con 0x7fa07410e7c0 2024-04-25T13:43:01.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.257+0000 7fa07b412700 1 -- 172.21.15.43:0/2055731815 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa074063e20 con 0x7fa07410e7c0 2024-04-25T13:43:01.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.259+0000 7fa06a7fc700 1 -- 172.21.15.43:0/2055731815 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fa06c00da00 con 0x7fa07410e7c0 2024-04-25T13:43:01.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.259+0000 7fa06a7fc700 1 --2- 172.21.15.43:0/2055731815 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa0600afc10 0x7fa0600b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:01.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.259+0000 7fa0791ae700 1 --2- 172.21.15.43:0/2055731815 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa0600afc10 0x7fa0600b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:01.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.259+0000 7fa06a7fc700 1 -- 172.21.15.43:0/2055731815 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fa06c0df050 con 0x7fa07410e7c0 2024-04-25T13:43:01.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.260+0000 7fa06a7fc700 1 --2- 172.21.15.43:0/2055731815 >> [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261] conn(0x7fa0600badc0 0x7fa0600bd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:01.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.260+0000 7fa06a7fc700 1 -- 172.21.15.43:0/2055731815 --> [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa06c011ec0 con 0x7fa0600badc0 2024-04-25T13:43:01.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.260+0000 7fa06a7fc700 1 -- 172.21.15.43:0/2055731815 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fa06c0df4a0 con 0x7fa07410e7c0 2024-04-25T13:43:01.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.260+0000 7fa0789ad700 1 --2- 172.21.15.43:0/2055731815 >> [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261] conn(0x7fa0600badc0 0x7fa0600bd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:01.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.260+0000 7fa0791ae700 1 --2- 172.21.15.43:0/2055731815 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa0600afc10 0x7fa0600b2120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa07419bbf0 tx=0x7fa070007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:01.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.260+0000 7fa0789ad700 1 --2- 172.21.15.43:0/2055731815 >> [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261] conn(0x7fa0600badc0 0x7fa0600bd2b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:01.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.261+0000 7fa06a7fc700 1 -- 172.21.15.43:0/2055731815 <== osd.6 v2:172.21.15.43:6818/3787838261 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa06c011ec0 con 0x7fa0600badc0 2024-04-25T13:43:01.276 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:01 smithi043 ceph-mon[29195]: pgmap v313: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 5 op/s; 126 B/s, 0 objects/s recovering 2024-04-25T13:43:01.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.277+0000 7fa07b412700 1 -- 172.21.15.43:0/2055731815 --> [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa0740642a0 con 0x7fa0600badc0 2024-04-25T13:43:01.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.278+0000 7fa06a7fc700 1 -- 172.21.15.43:0/2055731815 <== osd.6 v2:172.21.15.43:6818/3787838261 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa0740642a0 con 0x7fa0600badc0 2024-04-25T13:43:01.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.278+0000 7fa07b412700 1 -- 172.21.15.43:0/2055731815 >> [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261] conn(0x7fa0600badc0 msgr2=0x7fa0600bd2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:01.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.278+0000 7fa07b412700 1 --2- 172.21.15.43:0/2055731815 >> [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261] conn(0x7fa0600badc0 0x7fa0600bd2b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:01.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.278+0000 7fa07b412700 1 -- 172.21.15.43:0/2055731815 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa0600afc10 msgr2=0x7fa0600b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:01.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.278+0000 7fa07b412700 1 --2- 172.21.15.43:0/2055731815 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa0600afc10 0x7fa0600b2120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa07419bbf0 tx=0x7fa070007400 comp rx=0 tx=0).stop 2024-04-25T13:43:01.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.278+0000 7fa07b412700 1 -- 172.21.15.43:0/2055731815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa07410e7c0 msgr2=0x7fa07419aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:01.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.278+0000 7fa07b412700 1 --2- 172.21.15.43:0/2055731815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa07410e7c0 0x7fa07419aab0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00b970 tx=0x7fa06c00bc80 comp rx=0 tx=0).stop 2024-04-25T13:43:01.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.278+0000 7fa0799af700 1 -- 172.21.15.43:0/2055731815 reap_dead start 2024-04-25T13:43:01.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.278+0000 7fa07b412700 1 -- 172.21.15.43:0/2055731815 shutdown_connections 2024-04-25T13:43:01.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.278+0000 7fa07b412700 1 -- 172.21.15.43:0/2055731815 >> 172.21.15.43:0/2055731815 conn(0x7fa0740fecc0 msgr2=0x7fa0740ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:01.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.278+0000 7fa07b412700 1 -- 172.21.15.43:0/2055731815 shutdown_connections 2024-04-25T13:43:01.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:01.278+0000 7fa07b412700 1 -- 172.21.15.43:0/2055731815 wait complete. 2024-04-25T13:43:01.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:01 smithi161 ceph-mon[32696]: pgmap v313: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 5 op/s; 126 B/s, 0 objects/s recovering 2024-04-25T13:43:01.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:01 smithi175 ceph-mon[32649]: pgmap v313: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 5 op/s; 126 B/s, 0 objects/s recovering 2024-04-25T13:43:02.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.296+0000 7f27299af700 1 -- 172.21.15.43:0/577761954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27241033b0 msgr2=0x7f27241037c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.296+0000 7f27299af700 1 --2- 172.21.15.43:0/577761954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27241033b0 0x7f27241037c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f271400b0d0 tx=0x7f271400b3e0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.296+0000 7f27299af700 1 -- 172.21.15.43:0/577761954 shutdown_connections 2024-04-25T13:43:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.296+0000 7f27299af700 1 --2- 172.21.15.43:0/577761954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2724108630 0x7f272410ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.296+0000 7f27299af700 1 --2- 172.21.15.43:0/577761954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27241033b0 0x7f27241037c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.296+0000 7f27299af700 1 --2- 172.21.15.43:0/577761954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2724107ce0 0x7f27241080f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.296+0000 7f27299af700 1 -- 172.21.15.43:0/577761954 >> 172.21.15.43:0/577761954 conn(0x7f27240fee20 msgr2=0x7f2724101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.296+0000 7f27299af700 1 -- 172.21.15.43:0/577761954 shutdown_connections 2024-04-25T13:43:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.296+0000 7f27299af700 1 -- 172.21.15.43:0/577761954 wait complete. 2024-04-25T13:43:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.297+0000 7f27299af700 1 Processor -- start 2024-04-25T13:43:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.297+0000 7f27299af700 1 -- start start 2024-04-25T13:43:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.297+0000 7f27299af700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27241033b0 0x7f272419ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.297+0000 7f27299af700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2724107ce0 0x7f272419bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.297+0000 7f27299af700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2724108630 0x7f272419c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.297+0000 7f27299af700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2724113110 con 0x7f2724108630 2024-04-25T13:43:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.297+0000 7f27299af700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2724112f90 con 0x7f27241033b0 2024-04-25T13:43:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.297+0000 7f27299af700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2724113290 con 0x7f2724107ce0 2024-04-25T13:43:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.298+0000 7f27237fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2724108630 0x7f272419c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.298+0000 7f27237fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2724108630 0x7f272419c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38498/0 (socket says 172.21.15.43:38498) 2024-04-25T13:43:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.298+0000 7f27237fe700 1 -- 172.21.15.43:0/663739075 learned_addr learned my addr 172.21.15.43:0/663739075 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.298+0000 7f2722ffd700 1 --2- 172.21.15.43:0/663739075 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27241033b0 0x7f272419ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.298+0000 7f27227fc700 1 --2- 172.21.15.43:0/663739075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2724107ce0 0x7f272419bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.298+0000 7f27237fe700 1 -- 172.21.15.43:0/663739075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2724107ce0 msgr2=0x7f272419bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.298+0000 7f27237fe700 1 --2- 172.21.15.43:0/663739075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2724107ce0 0x7f272419bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.298+0000 7f27237fe700 1 -- 172.21.15.43:0/663739075 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27241033b0 msgr2=0x7f272419ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.298+0000 7f27237fe700 1 --2- 172.21.15.43:0/663739075 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27241033b0 0x7f272419ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.298+0000 7f27237fe700 1 -- 172.21.15.43:0/663739075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27241a6dc0 con 0x7f2724108630 2024-04-25T13:43:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.298+0000 7f27237fe700 1 --2- 172.21.15.43:0/663739075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2724108630 0x7f272419c510 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f271c00c970 tx=0x7f271c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:02.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.298+0000 7f27289ad700 1 -- 172.21.15.43:0/663739075 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c004a30 con 0x7f2724108630 2024-04-25T13:43:02.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.298+0000 7f27289ad700 1 -- 172.21.15.43:0/663739075 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f271c0054b0 con 0x7f2724108630 2024-04-25T13:43:02.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.298+0000 7f27299af700 1 -- 172.21.15.43:0/663739075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27241a70b0 con 0x7f2724108630 2024-04-25T13:43:02.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.298+0000 7f27289ad700 1 -- 172.21.15.43:0/663739075 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c00eac0 con 0x7f2724108630 2024-04-25T13:43:02.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.299+0000 7f27299af700 1 -- 172.21.15.43:0/663739075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27241a75a0 con 0x7f2724108630 2024-04-25T13:43:02.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.299+0000 7f27299af700 1 -- 172.21.15.43:0/663739075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2724063da0 con 0x7f2724108630 2024-04-25T13:43:02.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.301+0000 7f27289ad700 1 -- 172.21.15.43:0/663739075 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f271c00eca0 con 0x7f2724108630 2024-04-25T13:43:02.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.302+0000 7f27289ad700 1 --2- 172.21.15.43:0/663739075 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f27100afc10 0x7f27100b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.302+0000 7f2722ffd700 1 --2- 172.21.15.43:0/663739075 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f27100afc10 0x7f27100b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.302+0000 7f27289ad700 1 -- 172.21.15.43:0/663739075 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f271c0df140 con 0x7f2724108630 2024-04-25T13:43:02.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.302+0000 7f27289ad700 1 --2- 172.21.15.43:0/663739075 >> [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149] conn(0x7f27100badc0 0x7f27100bd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.302+0000 7f27289ad700 1 -- 172.21.15.43:0/663739075 --> [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27100bd980 con 0x7f27100badc0 2024-04-25T13:43:02.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.302+0000 7f27289ad700 1 -- 172.21.15.43:0/663739075 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f271c0df590 con 0x7f2724108630 2024-04-25T13:43:02.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.302+0000 7f2722ffd700 1 --2- 172.21.15.43:0/663739075 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f27100afc10 0x7f27100b2120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2714009fd0 tx=0x7f271400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:02.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.302+0000 7f27227fc700 1 --2- 172.21.15.43:0/663739075 >> [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149] conn(0x7f27100badc0 0x7f27100bd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.303+0000 7f27227fc700 1 --2- 172.21.15.43:0/663739075 >> [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149] conn(0x7f27100badc0 0x7f27100bd2b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:02.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.304+0000 7f27289ad700 1 -- 172.21.15.43:0/663739075 <== osd.7 v2:172.21.15.161:6816/729366149 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f27100bd980 con 0x7f27100badc0 2024-04-25T13:43:02.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.320+0000 7f27299af700 1 -- 172.21.15.43:0/663739075 --> [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f27240641a0 con 0x7f27100badc0 2024-04-25T13:43:02.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.321+0000 7f27289ad700 1 -- 172.21.15.43:0/663739075 <== osd.7 v2:172.21.15.161:6816/729366149 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f27240641a0 con 0x7f27100badc0 2024-04-25T13:43:02.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.321+0000 7f27299af700 1 -- 172.21.15.43:0/663739075 >> [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149] conn(0x7f27100badc0 msgr2=0x7f27100bd2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.321+0000 7f27299af700 1 --2- 172.21.15.43:0/663739075 >> [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149] conn(0x7f27100badc0 0x7f27100bd2b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.321+0000 7f27299af700 1 -- 172.21.15.43:0/663739075 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f27100afc10 msgr2=0x7f27100b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.321+0000 7f27299af700 1 --2- 172.21.15.43:0/663739075 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f27100afc10 0x7f27100b2120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2714009fd0 tx=0x7f271400b040 comp rx=0 tx=0).stop 2024-04-25T13:43:02.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.322+0000 7f27299af700 1 -- 172.21.15.43:0/663739075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2724108630 msgr2=0x7f272419c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.322+0000 7f27299af700 1 --2- 172.21.15.43:0/663739075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2724108630 0x7f272419c510 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f271c00c970 tx=0x7f271c00cc80 comp rx=0 tx=0).stop 2024-04-25T13:43:02.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.322+0000 7f27237fe700 1 -- 172.21.15.43:0/663739075 reap_dead start 2024-04-25T13:43:02.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.322+0000 7f27299af700 1 -- 172.21.15.43:0/663739075 shutdown_connections 2024-04-25T13:43:02.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.322+0000 7f27299af700 1 -- 172.21.15.43:0/663739075 >> 172.21.15.43:0/663739075 conn(0x7f27240fee20 msgr2=0x7f27241074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:02.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.322+0000 7f27299af700 1 -- 172.21.15.43:0/663739075 shutdown_connections 2024-04-25T13:43:02.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:02.322+0000 7f27299af700 1 -- 172.21.15.43:0/663739075 wait complete. 2024-04-25T13:43:03.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:03 smithi043 ceph-mon[29195]: pgmap v314: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 6 op/s; 7.5 KiB/s, 0 objects/s recovering 2024-04-25T13:43:03.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:03 smithi161 ceph-mon[32696]: pgmap v314: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 6 op/s; 7.5 KiB/s, 0 objects/s recovering 2024-04-25T13:43:03.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:03 smithi175 ceph-mon[32649]: pgmap v314: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 6 op/s; 7.5 KiB/s, 0 objects/s recovering 2024-04-25T13:43:03.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.823+0000 7f0beec4c700 1 -- 172.21.15.43:0/1222243548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be8108de0 msgr2=0x7f0be81091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:03.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.823+0000 7f0beec4c700 1 --2- 172.21.15.43:0/1222243548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be8108de0 0x7f0be81091f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0099c0 tx=0x7f0bdc009cd0 comp rx=0 tx=0).stop 2024-04-25T13:43:03.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.823+0000 7f0beec4c700 1 -- 172.21.15.43:0/1222243548 shutdown_connections 2024-04-25T13:43:03.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.823+0000 7f0beec4c700 1 --2- 172.21.15.43:0/1222243548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be8109730 0x7f0be8111090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:03.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.823+0000 7f0beec4c700 1 --2- 172.21.15.43:0/1222243548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be81044b0 0x7f0be81048c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:03.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.823+0000 7f0beec4c700 1 --2- 172.21.15.43:0/1222243548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be8108de0 0x7f0be81091f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:03.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.823+0000 7f0beec4c700 1 -- 172.21.15.43:0/1222243548 >> 172.21.15.43:0/1222243548 conn(0x7f0be80ffd40 msgr2=0x7f0be8102190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:03.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.824+0000 7f0beec4c700 1 -- 172.21.15.43:0/1222243548 shutdown_connections 2024-04-25T13:43:03.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.824+0000 7f0beec4c700 1 -- 172.21.15.43:0/1222243548 wait complete. 2024-04-25T13:43:03.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.824+0000 7f0beec4c700 1 Processor -- start 2024-04-25T13:43:03.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.824+0000 7f0beec4c700 1 -- start start 2024-04-25T13:43:03.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0beec4c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be81044b0 0x7f0be81a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0beec4c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be8108de0 0x7f0be81a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0beec4c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be8109730 0x7f0be819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0beec4c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0be8114240 con 0x7f0be8109730 2024-04-25T13:43:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0beec4c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f0be81140c0 con 0x7f0be8108de0 2024-04-25T13:43:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0beec4c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0be81143c0 con 0x7f0be81044b0 2024-04-25T13:43:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0bed1e9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be8109730 0x7f0be819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0bed1e9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be8109730 0x7f0be819ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38508/0 (socket says 172.21.15.43:38508) 2024-04-25T13:43:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0bed1e9700 1 -- 172.21.15.43:0/2334084224 learned_addr learned my addr 172.21.15.43:0/2334084224 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0be7fff700 1 --2- 172.21.15.43:0/2334084224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be8108de0 0x7f0be81a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:03.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0bec9e8700 1 --2- 172.21.15.43:0/2334084224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be81044b0 0x7f0be81a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:03.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0bed1e9700 1 -- 172.21.15.43:0/2334084224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be81044b0 msgr2=0x7f0be81a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:03.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0bed1e9700 1 --2- 172.21.15.43:0/2334084224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be81044b0 0x7f0be81a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:03.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0bed1e9700 1 -- 172.21.15.43:0/2334084224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be8108de0 msgr2=0x7f0be81a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:03.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0bed1e9700 1 --2- 172.21.15.43:0/2334084224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be8108de0 0x7f0be81a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:03.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0bed1e9700 1 -- 172.21.15.43:0/2334084224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be819b1b0 con 0x7f0be8109730 2024-04-25T13:43:03.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0bed1e9700 1 --2- 172.21.15.43:0/2334084224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be8109730 0x7f0be819ab00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0be0007ee0 tx=0x7f0be000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:03.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0be5ffb700 1 -- 172.21.15.43:0/2334084224 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be000dbd0 con 0x7f0be8109730 2024-04-25T13:43:03.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0be5ffb700 1 -- 172.21.15.43:0/2334084224 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0be000dd70 con 0x7f0be8109730 2024-04-25T13:43:03.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0be5ffb700 1 -- 172.21.15.43:0/2334084224 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be00058d0 con 0x7f0be8109730 2024-04-25T13:43:03.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.825+0000 7f0beec4c700 1 -- 172.21.15.43:0/2334084224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be819b4a0 con 0x7f0be8109730 2024-04-25T13:43:03.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.826+0000 7f0beec4c700 1 -- 172.21.15.43:0/2334084224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be81a7720 con 0x7f0be8109730 2024-04-25T13:43:03.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.826+0000 7f0beec4c700 1 -- 172.21.15.43:0/2334084224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0be8063de0 con 0x7f0be8109730 2024-04-25T13:43:03.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.828+0000 7f0be5ffb700 1 -- 172.21.15.43:0/2334084224 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f0be001a020 con 0x7f0be8109730 2024-04-25T13:43:03.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.829+0000 7f0be5ffb700 1 --2- 172.21.15.43:0/2334084224 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0bd00afc90 0x7f0bd00b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:03.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.829+0000 7f0bec9e8700 1 --2- 172.21.15.43:0/2334084224 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0bd00afc90 0x7f0bd00b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:03.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.829+0000 7f0be5ffb700 1 -- 172.21.15.43:0/2334084224 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f0be00def00 con 0x7f0be8109730 2024-04-25T13:43:03.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.829+0000 7f0be5ffb700 1 --2- 172.21.15.43:0/2334084224 >> [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337] conn(0x7f0bd00bae40 0x7f0bd00bd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:03.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.829+0000 7f0be5ffb700 1 -- 172.21.15.43:0/2334084224 --> [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0be0014e50 con 0x7f0bd00bae40 2024-04-25T13:43:03.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.829+0000 7f0be5ffb700 1 -- 172.21.15.43:0/2334084224 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f0be00df2b0 con 0x7f0be8109730 2024-04-25T13:43:03.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.829+0000 7f0bec9e8700 1 --2- 172.21.15.43:0/2334084224 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0bd00afc90 0x7f0bd00b21a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8005950 tx=0x7f0bd80058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:03.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.829+0000 7f0be7fff700 1 --2- 172.21.15.43:0/2334084224 >> [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337] conn(0x7f0bd00bae40 0x7f0bd00bd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:03.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.830+0000 7f0be7fff700 1 --2- 172.21.15.43:0/2334084224 >> [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337] conn(0x7f0bd00bae40 0x7f0bd00bd330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:03.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.831+0000 7f0be5ffb700 1 -- 172.21.15.43:0/2334084224 <== osd.1 v2:172.21.15.161:6800/2031999337 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0be0014e50 con 0x7f0bd00bae40 2024-04-25T13:43:03.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.847+0000 7f0beec4c700 1 -- 172.21.15.43:0/2334084224 --> [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0be8064260 con 0x7f0bd00bae40 2024-04-25T13:43:03.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.848+0000 7f0be5ffb700 1 -- 172.21.15.43:0/2334084224 <== osd.1 v2:172.21.15.161:6800/2031999337 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0be8064260 con 0x7f0bd00bae40 2024-04-25T13:43:03.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.848+0000 7f0beec4c700 1 -- 172.21.15.43:0/2334084224 >> [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337] conn(0x7f0bd00bae40 msgr2=0x7f0bd00bd330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:03.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.848+0000 7f0beec4c700 1 --2- 172.21.15.43:0/2334084224 >> [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337] conn(0x7f0bd00bae40 0x7f0bd00bd330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:03.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.848+0000 7f0beec4c700 1 -- 172.21.15.43:0/2334084224 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0bd00afc90 msgr2=0x7f0bd00b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:03.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.848+0000 7f0beec4c700 1 --2- 172.21.15.43:0/2334084224 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0bd00afc90 0x7f0bd00b21a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8005950 tx=0x7f0bd80058e0 comp rx=0 tx=0).stop 2024-04-25T13:43:03.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.848+0000 7f0beec4c700 1 -- 172.21.15.43:0/2334084224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be8109730 msgr2=0x7f0be819ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:03.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.848+0000 7f0beec4c700 1 --2- 172.21.15.43:0/2334084224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be8109730 0x7f0be819ab00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0be0007ee0 tx=0x7f0be000d3b0 comp rx=0 tx=0).stop 2024-04-25T13:43:03.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.848+0000 7f0bed1e9700 1 -- 172.21.15.43:0/2334084224 reap_dead start 2024-04-25T13:43:03.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.849+0000 7f0beec4c700 1 -- 172.21.15.43:0/2334084224 shutdown_connections 2024-04-25T13:43:03.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.849+0000 7f0beec4c700 1 -- 172.21.15.43:0/2334084224 >> 172.21.15.43:0/2334084224 conn(0x7f0be80ffd40 msgr2=0x7f0be8107190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:03.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.849+0000 7f0beec4c700 1 -- 172.21.15.43:0/2334084224 shutdown_connections 2024-04-25T13:43:03.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:03.849+0000 7f0beec4c700 1 -- 172.21.15.43:0/2334084224 wait complete. 2024-04-25T13:43:04.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.019+0000 7f41d26b0700 1 -- 172.21.15.43:0/1153920125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41cc1085d0 msgr2=0x7f41cc10ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:04.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.019+0000 7f41d26b0700 1 --2- 172.21.15.43:0/1153920125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41cc1085d0 0x7f41cc10ff30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f41c400b0d0 tx=0x7f41c400b3e0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.019+0000 7f41d26b0700 1 -- 172.21.15.43:0/1153920125 shutdown_connections 2024-04-25T13:43:04.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.019+0000 7f41d26b0700 1 --2- 172.21.15.43:0/1153920125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41cc1085d0 0x7f41cc10ff30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.019+0000 7f41d26b0700 1 --2- 172.21.15.43:0/1153920125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41cc103350 0x7f41cc103760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.019+0000 7f41d26b0700 1 --2- 172.21.15.43:0/1153920125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41cc107c80 0x7f41cc108090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.019+0000 7f41d26b0700 1 -- 172.21.15.43:0/1153920125 >> 172.21.15.43:0/1153920125 conn(0x7f41cc0fec30 msgr2=0x7f41cc101050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:04.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.019+0000 7f41d26b0700 1 -- 172.21.15.43:0/1153920125 shutdown_connections 2024-04-25T13:43:04.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.019+0000 7f41d26b0700 1 -- 172.21.15.43:0/1153920125 wait complete. 2024-04-25T13:43:04.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.020+0000 7f41d26b0700 1 Processor -- start 2024-04-25T13:43:04.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.020+0000 7f41d26b0700 1 -- start start 2024-04-25T13:43:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.020+0000 7f41d26b0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41cc103350 0x7f41cc1a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.020+0000 7f41d26b0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41cc107c80 0x7f41cc1a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.020+0000 7f41d26b0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41cc1085d0 0x7f41cc19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.020+0000 7f41d26b0700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc1130b0 con 0x7f41cc103350 2024-04-25T13:43:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.020+0000 7f41d26b0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc112f30 con 0x7f41cc107c80 2024-04-25T13:43:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.020+0000 7f41d26b0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc113230 con 0x7f41cc1085d0 2024-04-25T13:43:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.020+0000 7f41cbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41cc103350 0x7f41cc1a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.021+0000 7f41cbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41cc103350 0x7f41cc1a0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38530/0 (socket says 172.21.15.43:38530) 2024-04-25T13:43:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.021+0000 7f41cbfff700 1 -- 172.21.15.43:0/2324334717 learned_addr learned my addr 172.21.15.43:0/2324334717 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.021+0000 7f41d0c4d700 1 --2- 172.21.15.43:0/2324334717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41cc1085d0 0x7f41cc19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.021+0000 7f41cb7fe700 1 --2- 172.21.15.43:0/2324334717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41cc107c80 0x7f41cc1a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.021+0000 7f41cbfff700 1 -- 172.21.15.43:0/2324334717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41cc1085d0 msgr2=0x7f41cc19a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:04.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.021+0000 7f41cbfff700 1 --2- 172.21.15.43:0/2324334717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41cc1085d0 0x7f41cc19a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.021+0000 7f41cbfff700 1 -- 172.21.15.43:0/2324334717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41cc107c80 msgr2=0x7f41cc1a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:04.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.021+0000 7f41cbfff700 1 --2- 172.21.15.43:0/2324334717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41cc107c80 0x7f41cc1a0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.021+0000 7f41cbfff700 1 -- 172.21.15.43:0/2324334717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41cc19afc0 con 0x7f41cc103350 2024-04-25T13:43:04.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.021+0000 7f41cbfff700 1 --2- 172.21.15.43:0/2324334717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41cc103350 0x7f41cc1a0760 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00d950 tx=0x7f41bc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:04.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.021+0000 7f41c97fa700 1 -- 172.21.15.43:0/2324334717 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc016070 con 0x7f41cc103350 2024-04-25T13:43:04.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.021+0000 7f41c97fa700 1 -- 172.21.15.43:0/2324334717 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f41bc00fd20 con 0x7f41cc103350 2024-04-25T13:43:04.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.021+0000 7f41d26b0700 1 -- 172.21.15.43:0/2324334717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41cc19b2b0 con 0x7f41cc103350 2024-04-25T13:43:04.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.021+0000 7f41c97fa700 1 -- 172.21.15.43:0/2324334717 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc00e3b0 con 0x7f41cc103350 2024-04-25T13:43:04.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.021+0000 7f41d26b0700 1 -- 172.21.15.43:0/2324334717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41cc1a75f0 con 0x7f41cc103350 2024-04-25T13:43:04.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.022+0000 7f41d26b0700 1 -- 172.21.15.43:0/2324334717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f41cc063e20 con 0x7f41cc103350 2024-04-25T13:43:04.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.024+0000 7f41c97fa700 1 -- 172.21.15.43:0/2324334717 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f41bc019070 con 0x7f41cc103350 2024-04-25T13:43:04.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.025+0000 7f41c97fa700 1 --2- 172.21.15.43:0/2324334717 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f41b80afc10 0x7f41b80b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:04.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.025+0000 7f41cb7fe700 1 --2- 172.21.15.43:0/2324334717 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f41b80afc10 0x7f41b80b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:04.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.025+0000 7f41c97fa700 1 -- 172.21.15.43:0/2324334717 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f41bc0df190 con 0x7f41cc103350 2024-04-25T13:43:04.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.025+0000 7f41c97fa700 1 --2- 172.21.15.43:0/2324334717 >> [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010] conn(0x7f41b80badc0 0x7f41b80bd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:04.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.025+0000 7f41c97fa700 1 -- 172.21.15.43:0/2324334717 --> [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41b80bd980 con 0x7f41b80badc0 2024-04-25T13:43:04.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.025+0000 7f41c97fa700 1 -- 172.21.15.43:0/2324334717 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f41bc0df5e0 con 0x7f41cc103350 2024-04-25T13:43:04.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.025+0000 7f41cb7fe700 1 --2- 172.21.15.43:0/2324334717 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f41b80afc10 0x7f41b80b2120 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f41cc109800 tx=0x7f41b400a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:04.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.025+0000 7f41d0c4d700 1 --2- 172.21.15.43:0/2324334717 >> [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010] conn(0x7f41b80badc0 0x7f41b80bd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:04.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.026+0000 7f41d0c4d700 1 --2- 172.21.15.43:0/2324334717 >> [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010] conn(0x7f41b80badc0 0x7f41b80bd2b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:04.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.027+0000 7f41c97fa700 1 -- 172.21.15.43:0/2324334717 <== osd.4 v2:172.21.15.161:6808/2720970010 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f41b80bd980 con 0x7f41b80badc0 2024-04-25T13:43:04.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.045+0000 7f41d26b0700 1 -- 172.21.15.43:0/2324334717 --> [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f41cc0642a0 con 0x7f41b80badc0 2024-04-25T13:43:04.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.046+0000 7f41c97fa700 1 -- 172.21.15.43:0/2324334717 <== osd.4 v2:172.21.15.161:6808/2720970010 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f41cc0642a0 con 0x7f41b80badc0 2024-04-25T13:43:04.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.046+0000 7f41d26b0700 1 -- 172.21.15.43:0/2324334717 >> [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010] conn(0x7f41b80badc0 msgr2=0x7f41b80bd2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:04.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.046+0000 7f41d26b0700 1 --2- 172.21.15.43:0/2324334717 >> [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010] conn(0x7f41b80badc0 0x7f41b80bd2b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.046+0000 7f41d26b0700 1 -- 172.21.15.43:0/2324334717 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f41b80afc10 msgr2=0x7f41b80b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:04.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.046+0000 7f41d26b0700 1 --2- 172.21.15.43:0/2324334717 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f41b80afc10 0x7f41b80b2120 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f41cc109800 tx=0x7f41b400a380 comp rx=0 tx=0).stop 2024-04-25T13:43:04.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.046+0000 7f41d26b0700 1 -- 172.21.15.43:0/2324334717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41cc103350 msgr2=0x7f41cc1a0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:04.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.046+0000 7f41d26b0700 1 --2- 172.21.15.43:0/2324334717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41cc103350 0x7f41cc1a0760 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00d950 tx=0x7f41bc00dc60 comp rx=0 tx=0).stop 2024-04-25T13:43:04.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.046+0000 7f41d0c4d700 1 -- 172.21.15.43:0/2324334717 reap_dead start 2024-04-25T13:43:04.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.046+0000 7f41d26b0700 1 -- 172.21.15.43:0/2324334717 shutdown_connections 2024-04-25T13:43:04.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.046+0000 7f41d26b0700 1 -- 172.21.15.43:0/2324334717 >> 172.21.15.43:0/2324334717 conn(0x7f41cc0fec30 msgr2=0x7f41cc06c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:04.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.046+0000 7f41d26b0700 1 -- 172.21.15.43:0/2324334717 shutdown_connections 2024-04-25T13:43:04.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:04.046+0000 7f41d26b0700 1 -- 172.21.15.43:0/2324334717 wait complete. 2024-04-25T13:43:05.014 INFO:teuthology.orchestra.run.smithi043.stdout:206158430253 2024-04-25T13:43:05.014 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-04-25T13:43:05.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:05 smithi043 ceph-mon[29195]: pgmap v315: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s; 7.5 KiB/s, 0 objects/s recovering 2024-04-25T13:43:05.322 INFO:teuthology.orchestra.run.smithi043.stdout:55834574924 2024-04-25T13:43:05.322 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-25T13:43:05.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:05 smithi161 ceph-mon[32696]: pgmap v315: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s; 7.5 KiB/s, 0 objects/s recovering 2024-04-25T13:43:05.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:05 smithi175 ceph-mon[32649]: pgmap v315: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 5 op/s; 7.5 KiB/s, 0 objects/s recovering 2024-04-25T13:43:07.466 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:07 smithi043 ceph-mon[29195]: pgmap v316: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s; 7.5 KiB/s, 0 objects/s recovering 2024-04-25T13:43:07.467 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:07 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:43:07.605 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:07 smithi161 ceph-mon[32696]: pgmap v316: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s; 7.5 KiB/s, 0 objects/s recovering 2024-04-25T13:43:07.606 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:07 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:43:07.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.616+0000 7f11eba0e700 1 -- 172.21.15.43:0/3604012734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11e41091d0 msgr2=0x7f11e41095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.616+0000 7f11eba0e700 1 --2- 172.21.15.43:0/3604012734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11e41091d0 0x7f11e41095e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009990 tx=0x7f11d4009ca0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.616+0000 7f11eba0e700 1 -- 172.21.15.43:0/3604012734 shutdown_connections 2024-04-25T13:43:07.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.616+0000 7f11eba0e700 1 --2- 172.21.15.43:0/3604012734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11e4102fb0 0x7f11e4111040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.616+0000 7f11eba0e700 1 --2- 172.21.15.43:0/3604012734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11e41091d0 0x7f11e41095e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.616+0000 7f11eba0e700 1 --2- 172.21.15.43:0/3604012734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e4102660 0x7f11e4102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.616+0000 7f11eba0e700 1 -- 172.21.15.43:0/3604012734 >> 172.21.15.43:0/3604012734 conn(0x7f11e40fe3f0 msgr2=0x7f11e4100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:07.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.616+0000 7f11eba0e700 1 -- 172.21.15.43:0/3604012734 shutdown_connections 2024-04-25T13:43:07.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.616+0000 7f11eba0e700 1 -- 172.21.15.43:0/3604012734 wait complete. 2024-04-25T13:43:07.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.617+0000 7f11eba0e700 1 Processor -- start 2024-04-25T13:43:07.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.617+0000 7f11eba0e700 1 -- start start 2024-04-25T13:43:07.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.617+0000 7f11eba0e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11e4102660 0x7f11e419ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11eba0e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e4102fb0 0x7f11e419b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11eba0e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11e41091d0 0x7f11e419f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11eba0e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f11e4114320 con 0x7f11e41091d0 2024-04-25T13:43:07.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11eba0e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f11e41141a0 con 0x7f11e4102660 2024-04-25T13:43:07.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11eba0e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f11e41144a0 con 0x7f11e4102fb0 2024-04-25T13:43:07.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11e97aa700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11e4102660 0x7f11e419ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11e9fab700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11e41091d0 0x7f11e419f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11e97aa700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11e4102660 0x7f11e419ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.43:51686/0 (socket says 172.21.15.43:51686) 2024-04-25T13:43:07.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11e9fab700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11e41091d0 0x7f11e419f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38570/0 (socket says 172.21.15.43:38570) 2024-04-25T13:43:07.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11e8fa9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e4102fb0 0x7f11e419b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11e97aa700 1 -- 172.21.15.43:0/1632925371 learned_addr learned my addr 172.21.15.43:0/1632925371 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:07.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11e8fa9700 1 -- 172.21.15.43:0/1632925371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11e4102660 msgr2=0x7f11e419ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11e8fa9700 1 --2- 172.21.15.43:0/1632925371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11e4102660 0x7f11e419ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11e8fa9700 1 -- 172.21.15.43:0/1632925371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11e41091d0 msgr2=0x7f11e419f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11e8fa9700 1 --2- 172.21.15.43:0/1632925371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11e41091d0 0x7f11e419f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11e8fa9700 1 -- 172.21.15.43:0/1632925371 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e419fb30 con 0x7f11e4102fb0 2024-04-25T13:43:07.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11e9fab700 1 --2- 172.21.15.43:0/1632925371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11e41091d0 0x7f11e419f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:43:07.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.618+0000 7f11e8fa9700 1 --2- 172.21.15.43:0/1632925371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e4102fb0 0x7f11e419b2b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f11e000e9c0 tx=0x7f11e000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:07.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.619+0000 7f11da7fc700 1 -- 172.21.15.43:0/1632925371 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e0004220 con 0x7f11e4102fb0 2024-04-25T13:43:07.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.619+0000 7f11da7fc700 1 -- 172.21.15.43:0/1632925371 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11e00043c0 con 0x7f11e4102fb0 2024-04-25T13:43:07.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.619+0000 7f11eba0e700 1 -- 172.21.15.43:0/1632925371 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e419fe20 con 0x7f11e4102fb0 2024-04-25T13:43:07.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.619+0000 7f11da7fc700 1 -- 172.21.15.43:0/1632925371 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e000ce00 con 0x7f11e4102fb0 2024-04-25T13:43:07.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.619+0000 7f11eba0e700 1 -- 172.21.15.43:0/1632925371 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e41a0310 con 0x7f11e4102fb0 2024-04-25T13:43:07.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.620+0000 7f11eba0e700 1 -- 172.21.15.43:0/1632925371 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f11e4063d60 con 0x7f11e4102fb0 2024-04-25T13:43:07.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.622+0000 7f11da7fc700 1 -- 172.21.15.43:0/1632925371 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f11e0004750 con 0x7f11e4102fb0 2024-04-25T13:43:07.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.622+0000 7f11da7fc700 1 --2- 172.21.15.43:0/1632925371 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f11d00afc10 0x7f11d00b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.622+0000 7f11e97aa700 1 --2- 172.21.15.43:0/1632925371 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f11d00afc10 0x7f11d00b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.622+0000 7f11da7fc700 1 -- 172.21.15.43:0/1632925371 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f11e00df5a0 con 0x7f11e4102fb0 2024-04-25T13:43:07.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.623+0000 7f11da7fc700 1 --2- 172.21.15.43:0/1632925371 >> [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514] conn(0x7f11d00badc0 0x7f11d00bd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.623+0000 7f11da7fc700 1 -- 172.21.15.43:0/1632925371 --> [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11d00bd980 con 0x7f11d00badc0 2024-04-25T13:43:07.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.623+0000 7f11da7fc700 1 -- 172.21.15.43:0/1632925371 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f11e00df950 con 0x7f11e4102fb0 2024-04-25T13:43:07.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.623+0000 7f11e9fab700 1 --2- 172.21.15.43:0/1632925371 >> [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514] conn(0x7f11d00badc0 0x7f11d00bd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.623+0000 7f11e97aa700 1 --2- 172.21.15.43:0/1632925371 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f11d00afc10 0x7f11d00b2120 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f11d400b2e0 tx=0x7f11d4005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:07.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.623+0000 7f11e9fab700 1 --2- 172.21.15.43:0/1632925371 >> [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514] conn(0x7f11d00badc0 0x7f11d00bd2b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:07.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.624+0000 7f11da7fc700 1 -- 172.21.15.43:0/1632925371 <== osd.3 v2:172.21.15.43:6810/253965514 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f11d00bd980 con 0x7f11d00badc0 2024-04-25T13:43:07.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.640+0000 7f11eba0e700 1 -- 172.21.15.43:0/1632925371 --> [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f11e4064160 con 0x7f11d00badc0 2024-04-25T13:43:07.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.641+0000 7f11da7fc700 1 -- 172.21.15.43:0/1632925371 <== osd.3 v2:172.21.15.43:6810/253965514 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f11e4064160 con 0x7f11d00badc0 2024-04-25T13:43:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.641+0000 7f11eba0e700 1 -- 172.21.15.43:0/1632925371 >> [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514] conn(0x7f11d00badc0 msgr2=0x7f11d00bd2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.641+0000 7f11eba0e700 1 --2- 172.21.15.43:0/1632925371 >> [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514] conn(0x7f11d00badc0 0x7f11d00bd2b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.641+0000 7f11eba0e700 1 -- 172.21.15.43:0/1632925371 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f11d00afc10 msgr2=0x7f11d00b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.641+0000 7f11eba0e700 1 --2- 172.21.15.43:0/1632925371 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f11d00afc10 0x7f11d00b2120 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f11d400b2e0 tx=0x7f11d4005fb0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.641+0000 7f11eba0e700 1 -- 172.21.15.43:0/1632925371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e4102fb0 msgr2=0x7f11e419b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.641+0000 7f11eba0e700 1 --2- 172.21.15.43:0/1632925371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11e4102fb0 0x7f11e419b2b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f11e000e9c0 tx=0x7f11e000ecd0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.641+0000 7f11e9fab700 1 -- 172.21.15.43:0/1632925371 reap_dead start 2024-04-25T13:43:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.641+0000 7f11eba0e700 1 -- 172.21.15.43:0/1632925371 shutdown_connections 2024-04-25T13:43:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.641+0000 7f11eba0e700 1 -- 172.21.15.43:0/1632925371 >> 172.21.15.43:0/1632925371 conn(0x7f11e40fe3f0 msgr2=0x7f11e41071a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.641+0000 7f11eba0e700 1 -- 172.21.15.43:0/1632925371 shutdown_connections 2024-04-25T13:43:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.641+0000 7f11eba0e700 1 -- 172.21.15.43:0/1632925371 wait complete. 2024-04-25T13:43:07.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:07 smithi175 ceph-mon[32649]: pgmap v316: 129 pgs: 129 active+clean; 640 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s; 7.5 KiB/s, 0 objects/s recovering 2024-04-25T13:43:07.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:07 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:43:08.394 INFO:teuthology.orchestra.run.smithi043.stdout:137438953532 2024-04-25T13:43:08.394 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-25T13:43:09.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.466+0000 7fdcf91a2700 1 -- 172.21.15.43:0/107651860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcf4108610 msgr2=0x7fdcf410ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:09.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.466+0000 7fdcf91a2700 1 --2- 172.21.15.43:0/107651860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcf4108610 0x7fdcf410ff70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00b0d0 tx=0x7fdcec00b3e0 comp rx=0 tx=0).stop 2024-04-25T13:43:09.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.466+0000 7fdcf91a2700 1 -- 172.21.15.43:0/107651860 shutdown_connections 2024-04-25T13:43:09.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.466+0000 7fdcf91a2700 1 --2- 172.21.15.43:0/107651860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcf4108610 0x7fdcf410ff70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:09.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.466+0000 7fdcf91a2700 1 --2- 172.21.15.43:0/107651860 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcf4103390 0x7fdcf41037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:09.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.466+0000 7fdcf91a2700 1 --2- 172.21.15.43:0/107651860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcf4107cc0 0x7fdcf41080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:09.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.466+0000 7fdcf91a2700 1 -- 172.21.15.43:0/107651860 >> 172.21.15.43:0/107651860 conn(0x7fdcf40fecc0 msgr2=0x7fdcf41010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:09.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.466+0000 7fdcf91a2700 1 -- 172.21.15.43:0/107651860 shutdown_connections 2024-04-25T13:43:09.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.466+0000 7fdcf91a2700 1 -- 172.21.15.43:0/107651860 wait complete. 2024-04-25T13:43:09.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.467+0000 7fdcf91a2700 1 Processor -- start 2024-04-25T13:43:09.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.467+0000 7fdcf91a2700 1 -- start start 2024-04-25T13:43:09.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf91a2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcf4103390 0x7fdcf419f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:09.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf91a2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcf4107cc0 0x7fdcf419fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:09.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf91a2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcf4108610 0x7fdcf41998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:09.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf91a2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf41130f0 con 0x7fdcf4108610 2024-04-25T13:43:09.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf91a2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf4112f70 con 0x7fdcf4107cc0 2024-04-25T13:43:09.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf91a2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf4113270 con 0x7fdcf4103390 2024-04-25T13:43:09.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf359e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcf4108610 0x7fdcf41998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:09.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf359e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcf4108610 0x7fdcf41998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38552/0 (socket says 172.21.15.43:38552) 2024-04-25T13:43:09.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf359e700 1 -- 172.21.15.43:0/1823179192 learned_addr learned my addr 172.21.15.43:0/1823179192 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:09.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf259c700 1 --2- 172.21.15.43:0/1823179192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcf4107cc0 0x7fdcf419fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:09.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf2d9d700 1 --2- 172.21.15.43:0/1823179192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcf4103390 0x7fdcf419f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:09.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf359e700 1 -- 172.21.15.43:0/1823179192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcf4103390 msgr2=0x7fdcf419f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:09.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf359e700 1 --2- 172.21.15.43:0/1823179192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcf4103390 0x7fdcf419f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:09.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf359e700 1 -- 172.21.15.43:0/1823179192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcf4107cc0 msgr2=0x7fdcf419fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:09.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf359e700 1 --2- 172.21.15.43:0/1823179192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcf4107cc0 0x7fdcf419fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:09.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf359e700 1 -- 172.21.15.43:0/1823179192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf4199ef0 con 0x7fdcf4108610 2024-04-25T13:43:09.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.468+0000 7fdcf359e700 1 --2- 172.21.15.43:0/1823179192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcf4108610 0x7fdcf41998b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009850 tx=0x7fdcec007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:09.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.469+0000 7fdcebfff700 1 -- 172.21.15.43:0/1823179192 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec01f070 con 0x7fdcf4108610 2024-04-25T13:43:09.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.469+0000 7fdcf91a2700 1 -- 172.21.15.43:0/1823179192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf419a180 con 0x7fdcf4108610 2024-04-25T13:43:09.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.469+0000 7fdcebfff700 1 -- 172.21.15.43:0/1823179192 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcec005500 con 0x7fdcf4108610 2024-04-25T13:43:09.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.469+0000 7fdcebfff700 1 -- 172.21.15.43:0/1823179192 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec01b8f0 con 0x7fdcf4108610 2024-04-25T13:43:09.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.469+0000 7fdcf91a2700 1 -- 172.21.15.43:0/1823179192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf419a6b0 con 0x7fdcf4108610 2024-04-25T13:43:09.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.470+0000 7fdcf91a2700 1 -- 172.21.15.43:0/1823179192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdcf4063e20 con 0x7fdcf4108610 2024-04-25T13:43:09.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.471+0000 7fdcebfff700 1 -- 172.21.15.43:0/1823179192 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fdcec022070 con 0x7fdcf4108610 2024-04-25T13:43:09.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.472+0000 7fdcebfff700 1 --2- 172.21.15.43:0/1823179192 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdce00afc10 0x7fdce00b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:09.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.472+0000 7fdcf2d9d700 1 --2- 172.21.15.43:0/1823179192 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdce00afc10 0x7fdce00b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:09.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.472+0000 7fdcebfff700 1 -- 172.21.15.43:0/1823179192 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fdcec00f020 con 0x7fdcf4108610 2024-04-25T13:43:09.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.472+0000 7fdcebfff700 1 --2- 172.21.15.43:0/1823179192 >> [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947] conn(0x7fdce00badc0 0x7fdce00bd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:09.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.472+0000 7fdcebfff700 1 -- 172.21.15.43:0/1823179192 --> [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdcec0075c0 con 0x7fdce00badc0 2024-04-25T13:43:09.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.472+0000 7fdcebfff700 1 -- 172.21.15.43:0/1823179192 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fdcec0e0db0 con 0x7fdcf4108610 2024-04-25T13:43:09.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.473+0000 7fdcf259c700 1 --2- 172.21.15.43:0/1823179192 >> [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947] conn(0x7fdce00badc0 0x7fdce00bd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:09.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.473+0000 7fdcf2d9d700 1 --2- 172.21.15.43:0/1823179192 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdce00afc10 0x7fdce00b2120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdcf419a9f0 tx=0x7fdcdc00a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:09.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.473+0000 7fdcf259c700 1 --2- 172.21.15.43:0/1823179192 >> [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947] conn(0x7fdce00badc0 0x7fdce00bd2b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:09.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.474+0000 7fdcebfff700 1 -- 172.21.15.43:0/1823179192 <== osd.11 v2:172.21.15.175:6824/1911970947 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdcec0075c0 con 0x7fdce00badc0 2024-04-25T13:43:09.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.490+0000 7fdcf91a2700 1 -- 172.21.15.43:0/1823179192 --> [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdcf4064250 con 0x7fdce00badc0 2024-04-25T13:43:09.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.491+0000 7fdcebfff700 1 -- 172.21.15.43:0/1823179192 <== osd.11 v2:172.21.15.175:6824/1911970947 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdcf4064250 con 0x7fdce00badc0 2024-04-25T13:43:09.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.491+0000 7fdcf91a2700 1 -- 172.21.15.43:0/1823179192 >> [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947] conn(0x7fdce00badc0 msgr2=0x7fdce00bd2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:09.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.491+0000 7fdcf91a2700 1 --2- 172.21.15.43:0/1823179192 >> [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947] conn(0x7fdce00badc0 0x7fdce00bd2b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:09.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.491+0000 7fdcf91a2700 1 -- 172.21.15.43:0/1823179192 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdce00afc10 msgr2=0x7fdce00b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:09.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.491+0000 7fdcf91a2700 1 --2- 172.21.15.43:0/1823179192 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fdce00afc10 0x7fdce00b2120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdcf419a9f0 tx=0x7fdcdc00a380 comp rx=0 tx=0).stop 2024-04-25T13:43:09.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.491+0000 7fdcf91a2700 1 -- 172.21.15.43:0/1823179192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcf4108610 msgr2=0x7fdcf41998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:09.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.491+0000 7fdcf91a2700 1 --2- 172.21.15.43:0/1823179192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcf4108610 0x7fdcf41998b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009850 tx=0x7fdcec007d90 comp rx=0 tx=0).stop 2024-04-25T13:43:09.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.491+0000 7fdcf359e700 1 -- 172.21.15.43:0/1823179192 reap_dead start 2024-04-25T13:43:09.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.491+0000 7fdcf91a2700 1 -- 172.21.15.43:0/1823179192 shutdown_connections 2024-04-25T13:43:09.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.491+0000 7fdcf91a2700 1 -- 172.21.15.43:0/1823179192 >> 172.21.15.43:0/1823179192 conn(0x7fdcf40fecc0 msgr2=0x7fdcf4109570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:09.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.491+0000 7fdcf91a2700 1 -- 172.21.15.43:0/1823179192 shutdown_connections 2024-04-25T13:43:09.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:07.491+0000 7fdcf91a2700 1 -- 172.21.15.43:0/1823179192 wait complete. 2024-04-25T13:43:09.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:09 smithi161 ceph-mon[32696]: pgmap v317: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 314 B/s wr, 5 op/s; 6.2 KiB/s, 0 objects/s recovering 2024-04-25T13:43:09.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:09 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:09.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:09 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:09.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:09 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:09.853 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:09 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:09.878 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:09 smithi043 ceph-mon[29195]: pgmap v317: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 314 B/s wr, 5 op/s; 6.2 KiB/s, 0 objects/s recovering 2024-04-25T13:43:09.878 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:09 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:09.878 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:09 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:09.878 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:09 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:09.878 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:09 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:09.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:09 smithi175 ceph-mon[32649]: pgmap v317: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 314 B/s wr, 5 op/s; 6.2 KiB/s, 0 objects/s recovering 2024-04-25T13:43:09.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:09 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:09.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:09 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:09.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:09 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:09.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:09 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:10.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.598+0000 7fc0ff3bf700 1 -- 172.21.15.43:0/361394415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0f8108d90 msgr2=0x7fc0f81091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.598+0000 7fc0ff3bf700 1 --2- 172.21.15.43:0/361394415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0f8108d90 0x7fc0f81091a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80099c0 tx=0x7fc0e8009cd0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.598+0000 7fc0ff3bf700 1 -- 172.21.15.43:0/361394415 shutdown_connections 2024-04-25T13:43:10.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.598+0000 7fc0ff3bf700 1 --2- 172.21.15.43:0/361394415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0f81096e0 0x7fc0f8111040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.598+0000 7fc0ff3bf700 1 --2- 172.21.15.43:0/361394415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0f8104460 0x7fc0f8104870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.598+0000 7fc0ff3bf700 1 --2- 172.21.15.43:0/361394415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0f8108d90 0x7fc0f81091a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.598+0000 7fc0ff3bf700 1 -- 172.21.15.43:0/361394415 >> 172.21.15.43:0/361394415 conn(0x7fc0f80ffd40 msgr2=0x7fc0f8102160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.598+0000 7fc0ff3bf700 1 -- 172.21.15.43:0/361394415 shutdown_connections 2024-04-25T13:43:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.598+0000 7fc0ff3bf700 1 -- 172.21.15.43:0/361394415 wait complete. 2024-04-25T13:43:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.599+0000 7fc0ff3bf700 1 Processor -- start 2024-04-25T13:43:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.599+0000 7fc0ff3bf700 1 -- start start 2024-04-25T13:43:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.599+0000 7fc0ff3bf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0f8104460 0x7fc0f81a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0ff3bf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0f8108d90 0x7fc0f81a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0ff3bf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0f81096e0 0x7fc0f819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0ff3bf700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f81141a0 con 0x7fc0f81096e0 2024-04-25T13:43:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0ff3bf700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f8114020 con 0x7fc0f8108d90 2024-04-25T13:43:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0ff3bf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f8114320 con 0x7fc0f8104460 2024-04-25T13:43:10.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0fd95c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0f81096e0 0x7fc0f819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0fd95c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0f81096e0 0x7fc0f819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38578/0 (socket says 172.21.15.43:38578) 2024-04-25T13:43:10.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0fd95c700 1 -- 172.21.15.43:0/1829502773 learned_addr learned my addr 172.21.15.43:0/1829502773 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:10.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0fc95a700 1 --2- 172.21.15.43:0/1829502773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0f8108d90 0x7fc0f81a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0fd15b700 1 --2- 172.21.15.43:0/1829502773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0f8104460 0x7fc0f81a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0fd95c700 1 -- 172.21.15.43:0/1829502773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0f8104460 msgr2=0x7fc0f81a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0fd95c700 1 --2- 172.21.15.43:0/1829502773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0f8104460 0x7fc0f81a0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0fd95c700 1 -- 172.21.15.43:0/1829502773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0f8108d90 msgr2=0x7fc0f81a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0fd95c700 1 --2- 172.21.15.43:0/1829502773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0f8108d90 0x7fc0f81a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0fd95c700 1 -- 172.21.15.43:0/1829502773 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f819b0d0 con 0x7fc0f81096e0 2024-04-25T13:43:10.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0fd95c700 1 --2- 172.21.15.43:0/1829502773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0f81096e0 0x7fc0f819aa20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000ef30 tx=0x7fc0f000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:10.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0ee7fc700 1 -- 172.21.15.43:0/1829502773 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f00092e0 con 0x7fc0f81096e0 2024-04-25T13:43:10.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0ff3bf700 1 -- 172.21.15.43:0/1829502773 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f819b360 con 0x7fc0f81096e0 2024-04-25T13:43:10.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0ee7fc700 1 -- 172.21.15.43:0/1829502773 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc0f0004bb0 con 0x7fc0f81096e0 2024-04-25T13:43:10.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.600+0000 7fc0ee7fc700 1 -- 172.21.15.43:0/1829502773 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0004020 con 0x7fc0f81096e0 2024-04-25T13:43:10.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.601+0000 7fc0ff3bf700 1 -- 172.21.15.43:0/1829502773 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f81a7690 con 0x7fc0f81096e0 2024-04-25T13:43:10.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.601+0000 7fc0ff3bf700 1 -- 172.21.15.43:0/1829502773 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0f8063de0 con 0x7fc0f81096e0 2024-04-25T13:43:10.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.603+0000 7fc0ee7fc700 1 -- 172.21.15.43:0/1829502773 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fc0f001b030 con 0x7fc0f81096e0 2024-04-25T13:43:10.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.603+0000 7fc0ee7fc700 1 --2- 172.21.15.43:0/1829502773 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc0e40afc10 0x7fc0e40b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.604+0000 7fc0fd15b700 1 --2- 172.21.15.43:0/1829502773 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc0e40afc10 0x7fc0e40b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.604+0000 7fc0ee7fc700 1 -- 172.21.15.43:0/1829502773 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fc0f00df8e0 con 0x7fc0f81096e0 2024-04-25T13:43:10.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.604+0000 7fc0ee7fc700 1 --2- 172.21.15.43:0/1829502773 >> [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677] conn(0x7fc0e40badc0 0x7fc0e40bd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.604+0000 7fc0ee7fc700 1 -- 172.21.15.43:0/1829502773 --> [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0f0005ab0 con 0x7fc0e40badc0 2024-04-25T13:43:10.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.604+0000 7fc0ee7fc700 1 -- 172.21.15.43:0/1829502773 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fc0f00dfd30 con 0x7fc0f81096e0 2024-04-25T13:43:10.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.604+0000 7fc0fc95a700 1 --2- 172.21.15.43:0/1829502773 >> [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677] conn(0x7fc0e40badc0 0x7fc0e40bd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.604+0000 7fc0fd15b700 1 --2- 172.21.15.43:0/1829502773 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc0e40afc10 0x7fc0e40b2120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc0f819bb60 tx=0x7fc0f4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:10.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.604+0000 7fc0fc95a700 1 --2- 172.21.15.43:0/1829502773 >> [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677] conn(0x7fc0e40badc0 0x7fc0e40bd2b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:10.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.605+0000 7fc0ee7fc700 1 -- 172.21.15.43:0/1829502773 <== osd.9 v2:172.21.15.43:6826/844074677 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc0f0005ab0 con 0x7fc0e40badc0 2024-04-25T13:43:10.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.622+0000 7fc0ff3bf700 1 -- 172.21.15.43:0/1829502773 --> [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc0f8064260 con 0x7fc0e40badc0 2024-04-25T13:43:10.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.622+0000 7fc0ee7fc700 1 -- 172.21.15.43:0/1829502773 <== osd.9 v2:172.21.15.43:6826/844074677 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc0f8064260 con 0x7fc0e40badc0 2024-04-25T13:43:10.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.622+0000 7fc0ff3bf700 1 -- 172.21.15.43:0/1829502773 >> [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677] conn(0x7fc0e40badc0 msgr2=0x7fc0e40bd2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.622+0000 7fc0ff3bf700 1 --2- 172.21.15.43:0/1829502773 >> [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677] conn(0x7fc0e40badc0 0x7fc0e40bd2b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.622+0000 7fc0ff3bf700 1 -- 172.21.15.43:0/1829502773 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc0e40afc10 msgr2=0x7fc0e40b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.622+0000 7fc0ff3bf700 1 --2- 172.21.15.43:0/1829502773 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc0e40afc10 0x7fc0e40b2120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc0f819bb60 tx=0x7fc0f4009260 comp rx=0 tx=0).stop 2024-04-25T13:43:10.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.622+0000 7fc0ff3bf700 1 -- 172.21.15.43:0/1829502773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0f81096e0 msgr2=0x7fc0f819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.622+0000 7fc0ff3bf700 1 --2- 172.21.15.43:0/1829502773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0f81096e0 0x7fc0f819aa20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000ef30 tx=0x7fc0f000c3a0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.622+0000 7fc0fd95c700 1 -- 172.21.15.43:0/1829502773 reap_dead start 2024-04-25T13:43:10.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.623+0000 7fc0ff3bf700 1 -- 172.21.15.43:0/1829502773 shutdown_connections 2024-04-25T13:43:10.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.623+0000 7fc0ff3bf700 1 -- 172.21.15.43:0/1829502773 >> 172.21.15.43:0/1829502773 conn(0x7fc0f80ffd40 msgr2=0x7fc0f8102160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:10.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.623+0000 7fc0ff3bf700 1 -- 172.21.15.43:0/1829502773 shutdown_connections 2024-04-25T13:43:10.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:09.623+0000 7fc0ff3bf700 1 -- 172.21.15.43:0/1829502773 wait complete. 2024-04-25T13:43:11.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.533+0000 7fd92feda700 1 -- 172.21.15.43:0/2150680690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd928109730 msgr2=0x7fd928111090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.533+0000 7fd92feda700 1 --2- 172.21.15.43:0/2150680690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd928109730 0x7fd928111090 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd9200099c0 tx=0x7fd920009cd0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.533+0000 7fd92feda700 1 -- 172.21.15.43:0/2150680690 shutdown_connections 2024-04-25T13:43:11.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.533+0000 7fd92feda700 1 --2- 172.21.15.43:0/2150680690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd928109730 0x7fd928111090 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.533+0000 7fd92feda700 1 --2- 172.21.15.43:0/2150680690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9281044b0 0x7fd9281048c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.533+0000 7fd92feda700 1 --2- 172.21.15.43:0/2150680690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd928108de0 0x7fd9281091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.533+0000 7fd92feda700 1 -- 172.21.15.43:0/2150680690 >> 172.21.15.43:0/2150680690 conn(0x7fd9280ffda0 msgr2=0x7fd9281021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:11.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.533+0000 7fd92feda700 1 -- 172.21.15.43:0/2150680690 shutdown_connections 2024-04-25T13:43:11.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.533+0000 7fd92feda700 1 -- 172.21.15.43:0/2150680690 wait complete. 2024-04-25T13:43:11.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.534+0000 7fd92feda700 1 Processor -- start 2024-04-25T13:43:11.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.534+0000 7fd92feda700 1 -- start start 2024-04-25T13:43:11.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.534+0000 7fd92feda700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9281044b0 0x7fd9281a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.534+0000 7fd92feda700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd928108de0 0x7fd9281a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.534+0000 7fd92feda700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd928109730 0x7fd92819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.534+0000 7fd92feda700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd928114210 con 0x7fd9281044b0 2024-04-25T13:43:11.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.534+0000 7fd92feda700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fd928114090 con 0x7fd928109730 2024-04-25T13:43:11.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.534+0000 7fd92feda700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd928114390 con 0x7fd928108de0 2024-04-25T13:43:11.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd92dc76700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9281044b0 0x7fd9281a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd92dc76700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9281044b0 0x7fd9281a07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36204/0 (socket says 172.21.15.43:36204) 2024-04-25T13:43:11.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd92dc76700 1 -- 172.21.15.43:0/274044407 learned_addr learned my addr 172.21.15.43:0/274044407 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:11.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd92e477700 1 --2- 172.21.15.43:0/274044407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd928109730 0x7fd92819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd92d475700 1 --2- 172.21.15.43:0/274044407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd928108de0 0x7fd9281a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd92dc76700 1 -- 172.21.15.43:0/274044407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd928108de0 msgr2=0x7fd9281a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd92dc76700 1 --2- 172.21.15.43:0/274044407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd928108de0 0x7fd9281a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd92dc76700 1 -- 172.21.15.43:0/274044407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd928109730 msgr2=0x7fd92819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd92dc76700 1 --2- 172.21.15.43:0/274044407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd928109730 0x7fd92819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd92dc76700 1 -- 172.21.15.43:0/274044407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92819b080 con 0x7fd9281044b0 2024-04-25T13:43:11.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd92d475700 1 --2- 172.21.15.43:0/274044407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd928108de0 0x7fd9281a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:11.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd92dc76700 1 --2- 172.21.15.43:0/274044407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9281044b0 0x7fd9281a07b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd91800ef10 tx=0x7fd91800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd926ffd700 1 -- 172.21.15.43:0/274044407 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91800ca70 con 0x7fd9281044b0 2024-04-25T13:43:11.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd926ffd700 1 -- 172.21.15.43:0/274044407 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd918019070 con 0x7fd9281044b0 2024-04-25T13:43:11.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd92feda700 1 -- 172.21.15.43:0/274044407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd92819b310 con 0x7fd9281044b0 2024-04-25T13:43:11.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd926ffd700 1 -- 172.21.15.43:0/274044407 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918014480 con 0x7fd9281044b0 2024-04-25T13:43:11.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.535+0000 7fd92feda700 1 -- 172.21.15.43:0/274044407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9281a7640 con 0x7fd9281044b0 2024-04-25T13:43:11.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.536+0000 7fd92feda700 1 -- 172.21.15.43:0/274044407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd928063e20 con 0x7fd9281044b0 2024-04-25T13:43:11.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.539+0000 7fd926ffd700 1 -- 172.21.15.43:0/274044407 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fd918012050 con 0x7fd9281044b0 2024-04-25T13:43:11.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.539+0000 7fd926ffd700 1 --2- 172.21.15.43:0/274044407 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd9100afc90 0x7fd9100b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.539+0000 7fd92d475700 1 --2- 172.21.15.43:0/274044407 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd9100afc90 0x7fd9100b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.539+0000 7fd926ffd700 1 -- 172.21.15.43:0/274044407 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fd9180dfbb0 con 0x7fd9281044b0 2024-04-25T13:43:11.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.539+0000 7fd926ffd700 1 --2- 172.21.15.43:0/274044407 >> [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282] conn(0x7fd9100bae40 0x7fd9100bd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.539+0000 7fd926ffd700 1 -- 172.21.15.43:0/274044407 --> [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9100bda00 con 0x7fd9100bae40 2024-04-25T13:43:11.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.539+0000 7fd926ffd700 1 -- 172.21.15.43:0/274044407 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fd9180e0000 con 0x7fd9281044b0 2024-04-25T13:43:11.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.540+0000 7fd92d475700 1 --2- 172.21.15.43:0/274044407 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd9100afc90 0x7fd9100b21a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd928107bc0 tx=0x7fd91c009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.540+0000 7fd92e477700 1 --2- 172.21.15.43:0/274044407 >> [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282] conn(0x7fd9100bae40 0x7fd9100bd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.540+0000 7fd92e477700 1 --2- 172.21.15.43:0/274044407 >> [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282] conn(0x7fd9100bae40 0x7fd9100bd330 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.541+0000 7fd926ffd700 1 -- 172.21.15.43:0/274044407 <== osd.8 v2:172.21.15.175:6816/2453339282 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd9100bda00 con 0x7fd9100bae40 2024-04-25T13:43:11.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.558+0000 7fd92feda700 1 -- 172.21.15.43:0/274044407 --> [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd928064220 con 0x7fd9100bae40 2024-04-25T13:43:11.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.559+0000 7fd926ffd700 1 -- 172.21.15.43:0/274044407 <== osd.8 v2:172.21.15.175:6816/2453339282 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd928064220 con 0x7fd9100bae40 2024-04-25T13:43:11.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.559+0000 7fd92feda700 1 -- 172.21.15.43:0/274044407 >> [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282] conn(0x7fd9100bae40 msgr2=0x7fd9100bd330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.559+0000 7fd92feda700 1 --2- 172.21.15.43:0/274044407 >> [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282] conn(0x7fd9100bae40 0x7fd9100bd330 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.559+0000 7fd92feda700 1 -- 172.21.15.43:0/274044407 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd9100afc90 msgr2=0x7fd9100b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.559+0000 7fd92feda700 1 --2- 172.21.15.43:0/274044407 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd9100afc90 0x7fd9100b21a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd928107bc0 tx=0x7fd91c009550 comp rx=0 tx=0).stop 2024-04-25T13:43:11.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.559+0000 7fd92feda700 1 -- 172.21.15.43:0/274044407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9281044b0 msgr2=0x7fd9281a07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.559+0000 7fd92feda700 1 --2- 172.21.15.43:0/274044407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9281044b0 0x7fd9281a07b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd91800ef10 tx=0x7fd91800c3a0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.559+0000 7fd92e477700 1 -- 172.21.15.43:0/274044407 reap_dead start 2024-04-25T13:43:11.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.559+0000 7fd92feda700 1 -- 172.21.15.43:0/274044407 shutdown_connections 2024-04-25T13:43:11.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.559+0000 7fd92feda700 1 -- 172.21.15.43:0/274044407 >> 172.21.15.43:0/274044407 conn(0x7fd9280ffda0 msgr2=0x7fd928108590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:11.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.560+0000 7fd92feda700 1 -- 172.21.15.43:0/274044407 shutdown_connections 2024-04-25T13:43:11.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:10.560+0000 7fd92feda700 1 -- 172.21.15.43:0/274044407 wait complete. 2024-04-25T13:43:11.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:11 smithi161 ceph-mon[32696]: pgmap v318: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 285 B/s wr, 5 op/s; 5.6 KiB/s, 0 objects/s recovering 2024-04-25T13:43:11.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:11 smithi175 ceph-mon[32649]: pgmap v318: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 285 B/s wr, 5 op/s; 5.6 KiB/s, 0 objects/s recovering 2024-04-25T13:43:11.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:11 smithi043 ceph-mon[29195]: pgmap v318: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 285 B/s wr, 5 op/s; 5.6 KiB/s, 0 objects/s recovering 2024-04-25T13:43:12.153 INFO:teuthology.orchestra.run.smithi043.stdout:184683593778 2024-04-25T13:43:12.153 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-04-25T13:43:12.169 INFO:teuthology.orchestra.run.smithi043.stdout:304942678041 2024-04-25T13:43:12.170 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-04-25T13:43:12.589 INFO:teuthology.orchestra.run.smithi043.stdout:111669149763 2024-04-25T13:43:12.589 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-25T13:43:13.109 INFO:teuthology.orchestra.run.smithi043.stdout:231928234025 2024-04-25T13:43:13.110 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-04-25T13:43:13.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.796+0000 7f83fb58a700 1 -- 172.21.15.43:0/1219558708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83f4105350 msgr2=0x7f83f4105760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.796+0000 7f83fb58a700 1 --2- 172.21.15.43:0/1219558708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83f4105350 0x7f83f4105760 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00b0a0 tx=0x7f83ec00b3b0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.796+0000 7f83fb58a700 1 -- 172.21.15.43:0/1219558708 shutdown_connections 2024-04-25T13:43:13.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.796+0000 7f83fb58a700 1 --2- 172.21.15.43:0/1219558708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83f410e7c0 0x7f83f4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.796+0000 7f83fb58a700 1 --2- 172.21.15.43:0/1219558708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83f4105350 0x7f83f4105760 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.796+0000 7f83fb58a700 1 --2- 172.21.15.43:0/1219558708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f4105ca0 0x7f83f410e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.796+0000 7f83fb58a700 1 -- 172.21.15.43:0/1219558708 >> 172.21.15.43:0/1219558708 conn(0x7f83f40fee00 msgr2=0x7f83f4101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:13.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.797+0000 7f83fb58a700 1 -- 172.21.15.43:0/1219558708 shutdown_connections 2024-04-25T13:43:13.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.797+0000 7f83fb58a700 1 -- 172.21.15.43:0/1219558708 wait complete. 2024-04-25T13:43:13.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.797+0000 7f83fb58a700 1 Processor -- start 2024-04-25T13:43:13.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.798+0000 7f83fb58a700 1 -- start start 2024-04-25T13:43:13.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.798+0000 7f83fb58a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f4105350 0x7f83f419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.798+0000 7f83fb58a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83f4105ca0 0x7f83f419d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.798+0000 7f83fb58a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83f410e7c0 0x7f83f41a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.798+0000 7f83fb58a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f83f41141c0 con 0x7f83f4105ca0 2024-04-25T13:43:13.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.798+0000 7f83fb58a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f83f4114040 con 0x7f83f4105350 2024-04-25T13:43:13.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.798+0000 7f83fb58a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f83f4114340 con 0x7f83f410e7c0 2024-04-25T13:43:13.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.798+0000 7f83f8b25700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83f4105ca0 0x7f83f419d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.798+0000 7f83f8b25700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83f4105ca0 0x7f83f419d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36220/0 (socket says 172.21.15.43:36220) 2024-04-25T13:43:13.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.798+0000 7f83f8b25700 1 -- 172.21.15.43:0/3733385557 learned_addr learned my addr 172.21.15.43:0/3733385557 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:13.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.798+0000 7f83f9326700 1 --2- 172.21.15.43:0/3733385557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f4105350 0x7f83f419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.798+0000 7f83f9b27700 1 --2- 172.21.15.43:0/3733385557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83f410e7c0 0x7f83f41a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.798+0000 7f83f8b25700 1 -- 172.21.15.43:0/3733385557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83f410e7c0 msgr2=0x7f83f41a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.798+0000 7f83f8b25700 1 --2- 172.21.15.43:0/3733385557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83f410e7c0 0x7f83f41a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.799+0000 7f83f8b25700 1 -- 172.21.15.43:0/3733385557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f4105350 msgr2=0x7f83f419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.799+0000 7f83f8b25700 1 --2- 172.21.15.43:0/3733385557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f4105350 0x7f83f419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.799+0000 7f83f8b25700 1 -- 172.21.15.43:0/3733385557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f41a1c60 con 0x7f83f4105ca0 2024-04-25T13:43:13.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.799+0000 7f83f9326700 1 --2- 172.21.15.43:0/3733385557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f4105350 0x7f83f419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:43:13.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.799+0000 7f83f8b25700 1 --2- 172.21.15.43:0/3733385557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83f4105ca0 0x7f83f419d330 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f83f000e9a0 tx=0x7f83f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:13.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.799+0000 7f83ea7fc700 1 -- 172.21.15.43:0/3733385557 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f000ca10 con 0x7f83f4105ca0 2024-04-25T13:43:13.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.799+0000 7f83fb58a700 1 -- 172.21.15.43:0/3733385557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f41a1ef0 con 0x7f83f4105ca0 2024-04-25T13:43:13.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.799+0000 7f83ea7fc700 1 -- 172.21.15.43:0/3733385557 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83f000cbb0 con 0x7f83f4105ca0 2024-04-25T13:43:13.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.799+0000 7f83fb58a700 1 -- 172.21.15.43:0/3733385557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f41a9870 con 0x7f83f4105ca0 2024-04-25T13:43:13.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.799+0000 7f83ea7fc700 1 -- 172.21.15.43:0/3733385557 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f0018680 con 0x7f83f4105ca0 2024-04-25T13:43:13.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.800+0000 7f83fb58a700 1 -- 172.21.15.43:0/3733385557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f83f40ffd10 con 0x7f83f4105ca0 2024-04-25T13:43:13.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.802+0000 7f83ea7fc700 1 -- 172.21.15.43:0/3733385557 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f83f0010430 con 0x7f83f4105ca0 2024-04-25T13:43:13.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.803+0000 7f83ea7fc700 1 --2- 172.21.15.43:0/3733385557 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f83e00afc10 0x7f83e00b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.803+0000 7f83ea7fc700 1 -- 172.21.15.43:0/3733385557 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f83f00dfea0 con 0x7f83f4105ca0 2024-04-25T13:43:13.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.803+0000 7f83f9326700 1 --2- 172.21.15.43:0/3733385557 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f83e00afc10 0x7f83e00b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.803+0000 7f83ea7fc700 1 --2- 172.21.15.43:0/3733385557 >> [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329] conn(0x7f83e00badc0 0x7f83e00bd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.803+0000 7f83ea7fc700 1 -- 172.21.15.43:0/3733385557 --> [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83f0019ec0 con 0x7f83e00badc0 2024-04-25T13:43:13.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.803+0000 7f83ea7fc700 1 -- 172.21.15.43:0/3733385557 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f83f00e0250 con 0x7f83f4105ca0 2024-04-25T13:43:13.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.803+0000 7f83f9326700 1 --2- 172.21.15.43:0/3733385557 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f83e00afc10 0x7f83e00b2120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009900 tx=0x7f83ec00b700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:13.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.804+0000 7f83f9b27700 1 --2- 172.21.15.43:0/3733385557 >> [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329] conn(0x7f83e00badc0 0x7f83e00bd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.804+0000 7f83f9b27700 1 --2- 172.21.15.43:0/3733385557 >> [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329] conn(0x7f83e00badc0 0x7f83e00bd2b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:13.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.805+0000 7f83ea7fc700 1 -- 172.21.15.43:0/3733385557 <== osd.5 v2:172.21.15.175:6808/1053472329 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f83f0019ec0 con 0x7f83e00badc0 2024-04-25T13:43:13.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.821+0000 7f83fb58a700 1 -- 172.21.15.43:0/3733385557 --> [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f83f406c7f0 con 0x7f83e00badc0 2024-04-25T13:43:13.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.822+0000 7f83ea7fc700 1 -- 172.21.15.43:0/3733385557 <== osd.5 v2:172.21.15.175:6808/1053472329 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f83f406c7f0 con 0x7f83e00badc0 2024-04-25T13:43:13.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.822+0000 7f83fb58a700 1 -- 172.21.15.43:0/3733385557 >> [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329] conn(0x7f83e00badc0 msgr2=0x7f83e00bd2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.822+0000 7f83fb58a700 1 --2- 172.21.15.43:0/3733385557 >> [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329] conn(0x7f83e00badc0 0x7f83e00bd2b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.822+0000 7f83fb58a700 1 -- 172.21.15.43:0/3733385557 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f83e00afc10 msgr2=0x7f83e00b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.822+0000 7f83fb58a700 1 --2- 172.21.15.43:0/3733385557 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f83e00afc10 0x7f83e00b2120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009900 tx=0x7f83ec00b700 comp rx=0 tx=0).stop 2024-04-25T13:43:13.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.823+0000 7f83fb58a700 1 -- 172.21.15.43:0/3733385557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83f4105ca0 msgr2=0x7f83f419d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.823+0000 7f83fb58a700 1 --2- 172.21.15.43:0/3733385557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83f4105ca0 0x7f83f419d330 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f83f000e9a0 tx=0x7f83f000ecb0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.823+0000 7f83f9b27700 1 -- 172.21.15.43:0/3733385557 reap_dead start 2024-04-25T13:43:13.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.823+0000 7f83fb58a700 1 -- 172.21.15.43:0/3733385557 shutdown_connections 2024-04-25T13:43:13.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.823+0000 7f83fb58a700 1 -- 172.21.15.43:0/3733385557 >> 172.21.15.43:0/3733385557 conn(0x7f83f40fee00 msgr2=0x7f83f40ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:13.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.823+0000 7f83fb58a700 1 -- 172.21.15.43:0/3733385557 shutdown_connections 2024-04-25T13:43:13.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:12.823+0000 7f83fb58a700 1 -- 172.21.15.43:0/3733385557 wait complete. 2024-04-25T13:43:13.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:13 smithi043 ceph-mon[29195]: pgmap v319: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s; 4.9 KiB/s, 0 objects/s recovering 2024-04-25T13:43:13.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:13 smithi161 ceph-mon[32696]: pgmap v319: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s; 4.9 KiB/s, 0 objects/s recovering 2024-04-25T13:43:13.863 INFO:teuthology.orchestra.run.smithi043.stdout:158913790010 2024-04-25T13:43:13.863 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-25T13:43:13.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:13 smithi175 ceph-mon[32649]: pgmap v319: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s; 4.9 KiB/s, 0 objects/s recovering 2024-04-25T13:43:15.072 INFO:teuthology.orchestra.run.smithi043.stdout:257698037796 2024-04-25T13:43:15.072 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-04-25T13:43:15.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.478+0000 7fc9fc0a8700 1 -- 172.21.15.43:0/3856563180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9f41091a0 msgr2=0x7fc9f41095b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.478+0000 7fc9fc0a8700 1 --2- 172.21.15.43:0/3856563180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9f41091a0 0x7fc9f41095b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009990 tx=0x7fc9f0009ca0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.478+0000 7fc9fc0a8700 1 -- 172.21.15.43:0/3856563180 shutdown_connections 2024-04-25T13:43:15.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.478+0000 7fc9fc0a8700 1 --2- 172.21.15.43:0/3856563180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4104200 0x7fc9f410fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.478+0000 7fc9fc0a8700 1 --2- 172.21.15.43:0/3856563180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9f41091a0 0x7fc9f41095b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.478+0000 7fc9fc0a8700 1 --2- 172.21.15.43:0/3856563180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9f41038b0 0x7fc9f4103cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.478+0000 7fc9fc0a8700 1 -- 172.21.15.43:0/3856563180 >> 172.21.15.43:0/3856563180 conn(0x7fc9f40fe3f0 msgr2=0x7fc9f4100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:15.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.478+0000 7fc9fc0a8700 1 -- 172.21.15.43:0/3856563180 shutdown_connections 2024-04-25T13:43:15.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.478+0000 7fc9fc0a8700 1 -- 172.21.15.43:0/3856563180 wait complete. 2024-04-25T13:43:15.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.479+0000 7fc9fc0a8700 1 Processor -- start 2024-04-25T13:43:15.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.479+0000 7fc9fc0a8700 1 -- start start 2024-04-25T13:43:15.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.479+0000 7fc9fc0a8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9f41038b0 0x7fc9f41a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.479+0000 7fc9fc0a8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4104200 0x7fc9f41a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.479+0000 7fc9fc0a8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9f41091a0 0x7fc9f419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.479+0000 7fc9fc0a8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f41130f0 con 0x7fc9f41091a0 2024-04-25T13:43:15.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.479+0000 7fc9fc0a8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f4112f70 con 0x7fc9f41038b0 2024-04-25T13:43:15.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.479+0000 7fc9fc0a8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f4113270 con 0x7fc9f4104200 2024-04-25T13:43:15.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.479+0000 7fc9fa645700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9f41091a0 0x7fc9f419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.479+0000 7fc9fa645700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9f41091a0 0x7fc9f419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36240/0 (socket says 172.21.15.43:36240) 2024-04-25T13:43:15.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.479+0000 7fc9fa645700 1 -- 172.21.15.43:0/2259050581 learned_addr learned my addr 172.21.15.43:0/2259050581 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:15.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.479+0000 7fc9f9e44700 1 --2- 172.21.15.43:0/2259050581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9f41038b0 0x7fc9f41a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.479+0000 7fc9f9643700 1 --2- 172.21.15.43:0/2259050581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4104200 0x7fc9f41a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.480+0000 7fc9fa645700 1 -- 172.21.15.43:0/2259050581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4104200 msgr2=0x7fc9f41a0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.480+0000 7fc9fa645700 1 --2- 172.21.15.43:0/2259050581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4104200 0x7fc9f41a0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.480+0000 7fc9fa645700 1 -- 172.21.15.43:0/2259050581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9f41038b0 msgr2=0x7fc9f41a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.480+0000 7fc9fa645700 1 --2- 172.21.15.43:0/2259050581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9f41038b0 0x7fc9f41a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.480+0000 7fc9fa645700 1 -- 172.21.15.43:0/2259050581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f419afe0 con 0x7fc9f41091a0 2024-04-25T13:43:15.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.480+0000 7fc9f9e44700 1 --2- 172.21.15.43:0/2259050581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9f41038b0 0x7fc9f41a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:15.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.480+0000 7fc9fa645700 1 --2- 172.21.15.43:0/2259050581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9f41091a0 0x7fc9f419a9a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec007d70 tx=0x7fc9ec00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:15.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.480+0000 7fc9eaffd700 1 -- 172.21.15.43:0/2259050581 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec016020 con 0x7fc9f41091a0 2024-04-25T13:43:15.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.480+0000 7fc9fc0a8700 1 -- 172.21.15.43:0/2259050581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f419b2d0 con 0x7fc9f41091a0 2024-04-25T13:43:15.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.480+0000 7fc9eaffd700 1 -- 172.21.15.43:0/2259050581 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9ec00ad40 con 0x7fc9f41091a0 2024-04-25T13:43:15.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.480+0000 7fc9eaffd700 1 -- 172.21.15.43:0/2259050581 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0115e0 con 0x7fc9f41091a0 2024-04-25T13:43:15.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.480+0000 7fc9fc0a8700 1 -- 172.21.15.43:0/2259050581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f419b7c0 con 0x7fc9f41091a0 2024-04-25T13:43:15.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.481+0000 7fc9fc0a8700 1 -- 172.21.15.43:0/2259050581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9f4102af0 con 0x7fc9f41091a0 2024-04-25T13:43:15.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.483+0000 7fc9eaffd700 1 -- 172.21.15.43:0/2259050581 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fc9ec019020 con 0x7fc9f41091a0 2024-04-25T13:43:15.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.483+0000 7fc9eaffd700 1 --2- 172.21.15.43:0/2259050581 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc9e00afc10 0x7fc9e00b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.483+0000 7fc9f9e44700 1 --2- 172.21.15.43:0/2259050581 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc9e00afc10 0x7fc9e00b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.484+0000 7fc9eaffd700 1 -- 172.21.15.43:0/2259050581 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fc9ec0df460 con 0x7fc9f41091a0 2024-04-25T13:43:15.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.484+0000 7fc9eaffd700 1 --2- 172.21.15.43:0/2259050581 >> [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698] conn(0x7fc9e00badb0 0x7fc9e00bd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.484+0000 7fc9eaffd700 1 -- 172.21.15.43:0/2259050581 --> [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9ec024e50 con 0x7fc9e00badb0 2024-04-25T13:43:15.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.484+0000 7fc9eaffd700 1 -- 172.21.15.43:0/2259050581 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fc9ec0df8b0 con 0x7fc9f41091a0 2024-04-25T13:43:15.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.484+0000 7fc9f9e44700 1 --2- 172.21.15.43:0/2259050581 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc9e00afc10 0x7fc9e00b2120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000b5c0 tx=0x7fc9f0005940 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:15.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.484+0000 7fc9f9643700 1 --2- 172.21.15.43:0/2259050581 >> [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698] conn(0x7fc9e00badb0 0x7fc9e00bd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.485+0000 7fc9f9643700 1 --2- 172.21.15.43:0/2259050581 >> [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698] conn(0x7fc9e00badb0 0x7fc9e00bd2a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:15.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.485+0000 7fc9eaffd700 1 -- 172.21.15.43:0/2259050581 <== osd.2 v2:172.21.15.175:6800/1555612698 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9ec024e50 con 0x7fc9e00badb0 2024-04-25T13:43:15.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.514+0000 7fc9fc0a8700 1 -- 172.21.15.43:0/2259050581 --> [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc9f41048c0 con 0x7fc9e00badb0 2024-04-25T13:43:15.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.516+0000 7fc9eaffd700 1 -- 172.21.15.43:0/2259050581 <== osd.2 v2:172.21.15.175:6800/1555612698 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc9f41048c0 con 0x7fc9e00badb0 2024-04-25T13:43:15.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.516+0000 7fc9fc0a8700 1 -- 172.21.15.43:0/2259050581 >> [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698] conn(0x7fc9e00badb0 msgr2=0x7fc9e00bd2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.516+0000 7fc9fc0a8700 1 --2- 172.21.15.43:0/2259050581 >> [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698] conn(0x7fc9e00badb0 0x7fc9e00bd2a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.517+0000 7fc9fc0a8700 1 -- 172.21.15.43:0/2259050581 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc9e00afc10 msgr2=0x7fc9e00b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.517+0000 7fc9fc0a8700 1 --2- 172.21.15.43:0/2259050581 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc9e00afc10 0x7fc9e00b2120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000b5c0 tx=0x7fc9f0005940 comp rx=0 tx=0).stop 2024-04-25T13:43:15.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.517+0000 7fc9fc0a8700 1 -- 172.21.15.43:0/2259050581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9f41091a0 msgr2=0x7fc9f419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.517+0000 7fc9fc0a8700 1 --2- 172.21.15.43:0/2259050581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9f41091a0 0x7fc9f419a9a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec007d70 tx=0x7fc9ec00a340 comp rx=0 tx=0).stop 2024-04-25T13:43:15.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.517+0000 7fc9fa645700 1 -- 172.21.15.43:0/2259050581 reap_dead start 2024-04-25T13:43:15.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.517+0000 7fc9fc0a8700 1 -- 172.21.15.43:0/2259050581 shutdown_connections 2024-04-25T13:43:15.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.517+0000 7fc9fc0a8700 1 -- 172.21.15.43:0/2259050581 >> 172.21.15.43:0/2259050581 conn(0x7fc9f40fe3f0 msgr2=0x7fc9f4101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:15.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.518+0000 7fc9fc0a8700 1 -- 172.21.15.43:0/2259050581 shutdown_connections 2024-04-25T13:43:15.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.518+0000 7fc9fc0a8700 1 -- 172.21.15.43:0/2259050581 wait complete. 2024-04-25T13:43:15.686 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:15 smithi043 ceph-mon[29195]: pgmap v320: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T13:43:15.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.802+0000 7efdc0344700 1 -- 172.21.15.43:0/3306044533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb8104490 msgr2=0x7efdb81048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.802+0000 7efdc0344700 1 --2- 172.21.15.43:0/3306044533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb8104490 0x7efdb81048a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7efdb40099c0 tx=0x7efdb4009cd0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.802+0000 7efdc0344700 1 -- 172.21.15.43:0/3306044533 shutdown_connections 2024-04-25T13:43:15.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.802+0000 7efdc0344700 1 --2- 172.21.15.43:0/3306044533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb8109710 0x7efdb8111070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.802+0000 7efdc0344700 1 --2- 172.21.15.43:0/3306044533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb8104490 0x7efdb81048a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.802+0000 7efdc0344700 1 --2- 172.21.15.43:0/3306044533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb8108dc0 0x7efdb81091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.802+0000 7efdc0344700 1 -- 172.21.15.43:0/3306044533 >> 172.21.15.43:0/3306044533 conn(0x7efdb80ffda0 msgr2=0x7efdb81021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:15.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.802+0000 7efdc0344700 1 -- 172.21.15.43:0/3306044533 shutdown_connections 2024-04-25T13:43:15.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.802+0000 7efdc0344700 1 -- 172.21.15.43:0/3306044533 wait complete. 2024-04-25T13:43:15.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.803+0000 7efdc0344700 1 Processor -- start 2024-04-25T13:43:15.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.803+0000 7efdc0344700 1 -- start start 2024-04-25T13:43:15.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.803+0000 7efdc0344700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb8104490 0x7efdb8076aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.803+0000 7efdc0344700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb8108dc0 0x7efdb8076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.803+0000 7efdc0344700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb8109710 0x7efdb8077520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.803+0000 7efdc0344700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81141f0 con 0x7efdb8108dc0 2024-04-25T13:43:15.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.803+0000 7efdc0344700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7efdb8114070 con 0x7efdb8104490 2024-04-25T13:43:15.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.803+0000 7efdc0344700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efdb8114370 con 0x7efdb8109710 2024-04-25T13:43:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.803+0000 7efdbd8df700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb8108dc0 0x7efdb8076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.803+0000 7efdbd8df700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb8108dc0 0x7efdb8076fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36250/0 (socket says 172.21.15.43:36250) 2024-04-25T13:43:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.803+0000 7efdbd8df700 1 -- 172.21.15.43:0/2704446223 learned_addr learned my addr 172.21.15.43:0/2704446223 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.804+0000 7efdbe0e0700 1 --2- 172.21.15.43:0/2704446223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb8104490 0x7efdb8076aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.804+0000 7efdbe8e1700 1 --2- 172.21.15.43:0/2704446223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb8109710 0x7efdb8077520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.804+0000 7efdbd8df700 1 -- 172.21.15.43:0/2704446223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb8109710 msgr2=0x7efdb8077520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.804+0000 7efdbd8df700 1 --2- 172.21.15.43:0/2704446223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb8109710 0x7efdb8077520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.804+0000 7efdbd8df700 1 -- 172.21.15.43:0/2704446223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb8104490 msgr2=0x7efdb8076aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.804+0000 7efdbd8df700 1 --2- 172.21.15.43:0/2704446223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb8104490 0x7efdb8076aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.804+0000 7efdbd8df700 1 -- 172.21.15.43:0/2704446223 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb81a8f60 con 0x7efdb8108dc0 2024-04-25T13:43:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.804+0000 7efdbd8df700 1 --2- 172.21.15.43:0/2704446223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb8108dc0 0x7efdb8076fe0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efda800d950 tx=0x7efda800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.804+0000 7efdaf7fe700 1 -- 172.21.15.43:0/2704446223 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda8016070 con 0x7efdb8108dc0 2024-04-25T13:43:15.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.804+0000 7efdaf7fe700 1 -- 172.21.15.43:0/2704446223 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efda8004830 con 0x7efdb8108dc0 2024-04-25T13:43:15.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.804+0000 7efdaf7fe700 1 -- 172.21.15.43:0/2704446223 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda8005420 con 0x7efdb8108dc0 2024-04-25T13:43:15.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.804+0000 7efdc0344700 1 -- 172.21.15.43:0/2704446223 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb81a9250 con 0x7efdb8108dc0 2024-04-25T13:43:15.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.804+0000 7efdc0344700 1 -- 172.21.15.43:0/2704446223 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb81a9740 con 0x7efdb8108dc0 2024-04-25T13:43:15.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.805+0000 7efdc0344700 1 -- 172.21.15.43:0/2704446223 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efdb8063da0 con 0x7efdb8108dc0 2024-04-25T13:43:15.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.807+0000 7efdaf7fe700 1 -- 172.21.15.43:0/2704446223 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7efda80055e0 con 0x7efdb8108dc0 2024-04-25T13:43:15.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.808+0000 7efdaf7fe700 1 --2- 172.21.15.43:0/2704446223 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efda40afc90 0x7efda40b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.808+0000 7efdbe0e0700 1 --2- 172.21.15.43:0/2704446223 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efda40afc90 0x7efda40b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.808+0000 7efdaf7fe700 1 -- 172.21.15.43:0/2704446223 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7efda80df470 con 0x7efdb8108dc0 2024-04-25T13:43:15.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.808+0000 7efdaf7fe700 1 --2- 172.21.15.43:0/2704446223 >> [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800] conn(0x7efda40bae40 0x7efda40bd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.808+0000 7efdaf7fe700 1 -- 172.21.15.43:0/2704446223 --> [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efda40bda00 con 0x7efda40bae40 2024-04-25T13:43:15.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.808+0000 7efdaf7fe700 1 -- 172.21.15.43:0/2704446223 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7efda80df820 con 0x7efdb8108dc0 2024-04-25T13:43:15.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.808+0000 7efdbe0e0700 1 --2- 172.21.15.43:0/2704446223 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efda40afc90 0x7efda40b21a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efdb4003760 tx=0x7efdb401a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:15.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.808+0000 7efdbe8e1700 1 --2- 172.21.15.43:0/2704446223 >> [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800] conn(0x7efda40bae40 0x7efda40bd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.809+0000 7efdbe8e1700 1 --2- 172.21.15.43:0/2704446223 >> [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800] conn(0x7efda40bae40 0x7efda40bd330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:15.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.810+0000 7efdaf7fe700 1 -- 172.21.15.43:0/2704446223 <== osd.10 v2:172.21.15.161:6824/2874955800 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efda40bda00 con 0x7efda40bae40 2024-04-25T13:43:15.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.826+0000 7efdc0344700 1 -- 172.21.15.43:0/2704446223 --> [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efdb80641f0 con 0x7efda40bae40 2024-04-25T13:43:15.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.827+0000 7efdaf7fe700 1 -- 172.21.15.43:0/2704446223 <== osd.10 v2:172.21.15.161:6824/2874955800 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efdb80641f0 con 0x7efda40bae40 2024-04-25T13:43:15.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.827+0000 7efdc0344700 1 -- 172.21.15.43:0/2704446223 >> [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800] conn(0x7efda40bae40 msgr2=0x7efda40bd330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.827+0000 7efdc0344700 1 --2- 172.21.15.43:0/2704446223 >> [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800] conn(0x7efda40bae40 0x7efda40bd330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.827+0000 7efdc0344700 1 -- 172.21.15.43:0/2704446223 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efda40afc90 msgr2=0x7efda40b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.827+0000 7efdc0344700 1 --2- 172.21.15.43:0/2704446223 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7efda40afc90 0x7efda40b21a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efdb4003760 tx=0x7efdb401a040 comp rx=0 tx=0).stop 2024-04-25T13:43:15.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.827+0000 7efdc0344700 1 -- 172.21.15.43:0/2704446223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb8108dc0 msgr2=0x7efdb8076fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.827+0000 7efdc0344700 1 --2- 172.21.15.43:0/2704446223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb8108dc0 0x7efdb8076fe0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efda800d950 tx=0x7efda800dc60 comp rx=0 tx=0).stop 2024-04-25T13:43:15.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.827+0000 7efdbe8e1700 1 -- 172.21.15.43:0/2704446223 reap_dead start 2024-04-25T13:43:15.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.828+0000 7efdc0344700 1 -- 172.21.15.43:0/2704446223 shutdown_connections 2024-04-25T13:43:15.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.828+0000 7efdc0344700 1 -- 172.21.15.43:0/2704446223 >> 172.21.15.43:0/2704446223 conn(0x7efdb80ffda0 msgr2=0x7efdb81021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:15.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.828+0000 7efdc0344700 1 -- 172.21.15.43:0/2704446223 shutdown_connections 2024-04-25T13:43:15.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:15.828+0000 7efdc0344700 1 -- 172.21.15.43:0/2704446223 wait complete. 2024-04-25T13:43:15.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:15 smithi175 ceph-mon[32649]: pgmap v320: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T13:43:16.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:15 smithi161 ceph-mon[32696]: pgmap v320: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T13:43:17.208 INFO:teuthology.orchestra.run.smithi043.stdout:77309411402 2024-04-25T13:43:17.208 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-25T13:43:17.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:17 smithi043 ceph-mon[29195]: pgmap v321: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T13:43:17.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:17 smithi175 ceph-mon[32649]: pgmap v321: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T13:43:18.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:17 smithi161 ceph-mon[32696]: pgmap v321: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T13:43:18.111 INFO:teuthology.orchestra.run.smithi043.stdout:279172874271 2024-04-25T13:43:18.112 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-04-25T13:43:18.112 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:43:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.317+0000 7f60da92e700 1 -- 172.21.15.43:0/3036519533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d4107cc0 msgr2=0x7f60d41080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.317+0000 7f60da92e700 1 --2- 172.21.15.43:0/3036519533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d4107cc0 0x7f60d41080d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f60c80099c0 tx=0x7f60c8009cd0 comp rx=0 tx=0).stop 2024-04-25T13:43:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.318+0000 7f60da92e700 1 -- 172.21.15.43:0/3036519533 shutdown_connections 2024-04-25T13:43:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.318+0000 7f60da92e700 1 --2- 172.21.15.43:0/3036519533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60d4108610 0x7f60d410ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.318+0000 7f60da92e700 1 --2- 172.21.15.43:0/3036519533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60d4103390 0x7f60d41037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.318+0000 7f60da92e700 1 --2- 172.21.15.43:0/3036519533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d4107cc0 0x7f60d41080d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.318+0000 7f60da92e700 1 -- 172.21.15.43:0/3036519533 >> 172.21.15.43:0/3036519533 conn(0x7f60d40fec90 msgr2=0x7f60d41010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.318+0000 7f60da92e700 1 -- 172.21.15.43:0/3036519533 shutdown_connections 2024-04-25T13:43:18.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.318+0000 7f60da92e700 1 -- 172.21.15.43:0/3036519533 wait complete. 2024-04-25T13:43:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.318+0000 7f60da92e700 1 Processor -- start 2024-04-25T13:43:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.318+0000 7f60da92e700 1 -- start start 2024-04-25T13:43:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60da92e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60d4103390 0x7f60d41a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60da92e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d4107cc0 0x7f60d41a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60da92e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60d4108610 0x7f60d419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60da92e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f60d41130d0 con 0x7f60d4107cc0 2024-04-25T13:43:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60da92e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f60d4112f50 con 0x7f60d4103390 2024-04-25T13:43:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60da92e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f60d4113250 con 0x7f60d4108610 2024-04-25T13:43:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60d37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d4107cc0 0x7f60d41a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60d37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d4107cc0 0x7f60d41a0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36278/0 (socket says 172.21.15.43:36278) 2024-04-25T13:43:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60d37fe700 1 -- 172.21.15.43:0/3281190966 learned_addr learned my addr 172.21.15.43:0/3281190966 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60d8ecb700 1 --2- 172.21.15.43:0/3281190966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60d4108610 0x7f60d419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60d3fff700 1 --2- 172.21.15.43:0/3281190966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60d4103390 0x7f60d41a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60d37fe700 1 -- 172.21.15.43:0/3281190966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60d4108610 msgr2=0x7f60d419aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60d37fe700 1 --2- 172.21.15.43:0/3281190966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60d4108610 0x7f60d419aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60d37fe700 1 -- 172.21.15.43:0/3281190966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60d4103390 msgr2=0x7f60d41a08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60d37fe700 1 --2- 172.21.15.43:0/3281190966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60d4103390 0x7f60d41a08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60d37fe700 1 -- 172.21.15.43:0/3281190966 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d419b170 con 0x7f60d4107cc0 2024-04-25T13:43:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.319+0000 7f60d8ecb700 1 --2- 172.21.15.43:0/3281190966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60d4108610 0x7f60d419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.320+0000 7f60d37fe700 1 --2- 172.21.15.43:0/3281190966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d4107cc0 0x7f60d41a0de0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f60c800b580 tx=0x7f60c800f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.320+0000 7f60d17fa700 1 -- 172.21.15.43:0/3281190966 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c8026070 con 0x7f60d4107cc0 2024-04-25T13:43:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.320+0000 7f60d17fa700 1 -- 172.21.15.43:0/3281190966 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60c8005030 con 0x7f60d4107cc0 2024-04-25T13:43:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.320+0000 7f60da92e700 1 -- 172.21.15.43:0/3281190966 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d419b400 con 0x7f60d4107cc0 2024-04-25T13:43:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.320+0000 7f60d17fa700 1 -- 172.21.15.43:0/3281190966 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c80049f0 con 0x7f60d4107cc0 2024-04-25T13:43:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.320+0000 7f60da92e700 1 -- 172.21.15.43:0/3281190966 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d419b8e0 con 0x7f60d4107cc0 2024-04-25T13:43:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.321+0000 7f60da92e700 1 -- 172.21.15.43:0/3281190966 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f60d4063d60 con 0x7f60d4107cc0 2024-04-25T13:43:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.322+0000 7f60d17fa700 1 -- 172.21.15.43:0/3281190966 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f60c8029070 con 0x7f60d4107cc0 2024-04-25T13:43:18.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.323+0000 7f60d17fa700 1 --2- 172.21.15.43:0/3281190966 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f60bc0afc10 0x7f60bc0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:18.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.323+0000 7f60d17fa700 1 -- 172.21.15.43:0/3281190966 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f60c80e0450 con 0x7f60d4107cc0 2024-04-25T13:43:18.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.323+0000 7f60d3fff700 1 --2- 172.21.15.43:0/3281190966 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f60bc0afc10 0x7f60bc0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:18.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.324+0000 7f60d17fa700 1 --2- 172.21.15.43:0/3281190966 >> [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348] conn(0x7f60bc0badc0 0x7f60bc0bd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:18.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.324+0000 7f60d17fa700 1 -- 172.21.15.43:0/3281190966 --> [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f60bc0bd980 con 0x7f60bc0badc0 2024-04-25T13:43:18.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.324+0000 7f60d17fa700 1 -- 172.21.15.43:0/3281190966 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f60c80e08a0 con 0x7f60d4107cc0 2024-04-25T13:43:18.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.324+0000 7f60d8ecb700 1 --2- 172.21.15.43:0/3281190966 >> [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348] conn(0x7f60bc0badc0 0x7f60bc0bd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:18.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.324+0000 7f60d3fff700 1 --2- 172.21.15.43:0/3281190966 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f60bc0afc10 0x7f60bc0b2120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f60c4005fd0 tx=0x7f60c4005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:18.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.325+0000 7f60d8ecb700 1 --2- 172.21.15.43:0/3281190966 >> [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348] conn(0x7f60bc0badc0 0x7f60bc0bd2b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:18.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.325+0000 7f60d17fa700 1 -- 172.21.15.43:0/3281190966 <== osd.0 v2:172.21.15.43:6802/532985348 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f60bc0bd980 con 0x7f60bc0badc0 2024-04-25T13:43:18.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.342+0000 7f60da92e700 1 -- 172.21.15.43:0/3281190966 --> [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f60d40641e0 con 0x7f60bc0badc0 2024-04-25T13:43:18.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.343+0000 7f60d17fa700 1 -- 172.21.15.43:0/3281190966 <== osd.0 v2:172.21.15.43:6802/532985348 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f60d40641e0 con 0x7f60bc0badc0 2024-04-25T13:43:18.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.343+0000 7f60da92e700 1 -- 172.21.15.43:0/3281190966 >> [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348] conn(0x7f60bc0badc0 msgr2=0x7f60bc0bd2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:18.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.343+0000 7f60da92e700 1 --2- 172.21.15.43:0/3281190966 >> [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348] conn(0x7f60bc0badc0 0x7f60bc0bd2b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:18.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.343+0000 7f60da92e700 1 -- 172.21.15.43:0/3281190966 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f60bc0afc10 msgr2=0x7f60bc0b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:18.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.343+0000 7f60da92e700 1 --2- 172.21.15.43:0/3281190966 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f60bc0afc10 0x7f60bc0b2120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f60c4005fd0 tx=0x7f60c4005f60 comp rx=0 tx=0).stop 2024-04-25T13:43:18.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.343+0000 7f60da92e700 1 -- 172.21.15.43:0/3281190966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d4107cc0 msgr2=0x7f60d41a0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:18.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.343+0000 7f60da92e700 1 --2- 172.21.15.43:0/3281190966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d4107cc0 0x7f60d41a0de0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f60c800b580 tx=0x7f60c800f510 comp rx=0 tx=0).stop 2024-04-25T13:43:18.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.343+0000 7f60d8ecb700 1 -- 172.21.15.43:0/3281190966 reap_dead start 2024-04-25T13:43:18.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.344+0000 7f60da92e700 1 -- 172.21.15.43:0/3281190966 shutdown_connections 2024-04-25T13:43:18.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.344+0000 7f60da92e700 1 -- 172.21.15.43:0/3281190966 >> 172.21.15.43:0/3281190966 conn(0x7f60d40fec90 msgr2=0x7f60d406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:18.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.344+0000 7f60da92e700 1 -- 172.21.15.43:0/3281190966 shutdown_connections 2024-04-25T13:43:18.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:18.344+0000 7f60da92e700 1 -- 172.21.15.43:0/3281190966 wait complete. 2024-04-25T13:43:19.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:19 smithi175 ceph-mon[32649]: pgmap v322: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T13:43:19.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:19 smithi043 ceph-mon[29195]: pgmap v322: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T13:43:20.047 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:43:20.049 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:43:20.050 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:43:20.058 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:43:20.062 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:43:20.065 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:43:20.068 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:43:20.069 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:43:20.082 INFO:teuthology.orchestra.run.smithi043.stdout:34359738452 2024-04-25T13:43:20.083 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-25T13:43:20.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:19 smithi161 ceph-mon[32696]: pgmap v322: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T13:43:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.842+0000 7f90ac6ef700 1 -- 172.21.15.43:0/3789494824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90a4108df0 msgr2=0x7f90a4109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.842+0000 7f90ac6ef700 1 --2- 172.21.15.43:0/3789494824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90a4108df0 0x7f90a4109200 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f90940099c0 tx=0x7f9094009cd0 comp rx=0 tx=0).stop 2024-04-25T13:43:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.842+0000 7f90ac6ef700 1 -- 172.21.15.43:0/3789494824 shutdown_connections 2024-04-25T13:43:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.842+0000 7f90ac6ef700 1 --2- 172.21.15.43:0/3789494824 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90a4109740 0x7f90a41110a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.842+0000 7f90ac6ef700 1 --2- 172.21.15.43:0/3789494824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90a41044c0 0x7f90a41048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.842+0000 7f90ac6ef700 1 --2- 172.21.15.43:0/3789494824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90a4108df0 0x7f90a4109200 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.842+0000 7f90ac6ef700 1 -- 172.21.15.43:0/3789494824 >> 172.21.15.43:0/3789494824 conn(0x7f90a40ffd90 msgr2=0x7f90a41021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.842+0000 7f90ac6ef700 1 -- 172.21.15.43:0/3789494824 shutdown_connections 2024-04-25T13:43:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.842+0000 7f90ac6ef700 1 -- 172.21.15.43:0/3789494824 wait complete. 2024-04-25T13:43:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.843+0000 7f90ac6ef700 1 Processor -- start 2024-04-25T13:43:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.843+0000 7f90ac6ef700 1 -- start start 2024-04-25T13:43:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.843+0000 7f90ac6ef700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90a41044c0 0x7f90a4076aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.843+0000 7f90ac6ef700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90a4108df0 0x7f90a4076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.843+0000 7f90ac6ef700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90a4109740 0x7f90a4077520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.843+0000 7f90ac6ef700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f90a41142c0 con 0x7f90a4109740 2024-04-25T13:43:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.843+0000 7f90ac6ef700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f90a4114140 con 0x7f90a4108df0 2024-04-25T13:43:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.843+0000 7f90ac6ef700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90a4114440 con 0x7f90a41044c0 2024-04-25T13:43:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.843+0000 7f90aac8c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90a4109740 0x7f90a4077520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.843+0000 7f90aac8c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90a4109740 0x7f90a4077520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47766/0 (socket says 172.21.15.43:47766) 2024-04-25T13:43:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.843+0000 7f90aac8c700 1 -- 172.21.15.43:0/762884076 learned_addr learned my addr 172.21.15.43:0/762884076 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.844+0000 7f90aa48b700 1 --2- 172.21.15.43:0/762884076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90a41044c0 0x7f90a4076aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.844+0000 7f90a9c8a700 1 --2- 172.21.15.43:0/762884076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90a4108df0 0x7f90a4076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.844+0000 7f90aac8c700 1 -- 172.21.15.43:0/762884076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90a41044c0 msgr2=0x7f90a4076aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.844+0000 7f90aac8c700 1 --2- 172.21.15.43:0/762884076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90a41044c0 0x7f90a4076aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.844+0000 7f90aac8c700 1 -- 172.21.15.43:0/762884076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90a4108df0 msgr2=0x7f90a4076fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.844+0000 7f90aac8c700 1 --2- 172.21.15.43:0/762884076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90a4108df0 0x7f90a4076fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.844+0000 7f90aac8c700 1 -- 172.21.15.43:0/762884076 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a41a9110 con 0x7f90a4109740 2024-04-25T13:43:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.844+0000 7f90a9c8a700 1 --2- 172.21.15.43:0/762884076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90a4108df0 0x7f90a4076fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.844+0000 7f90aac8c700 1 --2- 172.21.15.43:0/762884076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90a4109740 0x7f90a4077520 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f909c007ee0 tx=0x7f909c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.844+0000 7f909b7fe700 1 -- 172.21.15.43:0/762884076 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c00dbd0 con 0x7f90a4109740 2024-04-25T13:43:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.844+0000 7f90ac6ef700 1 -- 172.21.15.43:0/762884076 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a41a9400 con 0x7f90a4109740 2024-04-25T13:43:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.844+0000 7f909b7fe700 1 -- 172.21.15.43:0/762884076 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f909c00dd70 con 0x7f90a4109740 2024-04-25T13:43:20.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.844+0000 7f909b7fe700 1 -- 172.21.15.43:0/762884076 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c0058d0 con 0x7f90a4109740 2024-04-25T13:43:20.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.844+0000 7f90ac6ef700 1 -- 172.21.15.43:0/762884076 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a41a9910 con 0x7f90a4109740 2024-04-25T13:43:20.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.845+0000 7f90ac6ef700 1 -- 172.21.15.43:0/762884076 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90a4051190 con 0x7f90a4109740 2024-04-25T13:43:20.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.848+0000 7f909b7fe700 1 -- 172.21.15.43:0/762884076 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f909c01a020 con 0x7f90a4109740 2024-04-25T13:43:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.848+0000 7f909b7fe700 1 --2- 172.21.15.43:0/762884076 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f90900afc10 0x7f90900b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.848+0000 7f90aa48b700 1 --2- 172.21.15.43:0/762884076 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f90900afc10 0x7f90900b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.849+0000 7f909b7fe700 1 -- 172.21.15.43:0/762884076 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f909c0def50 con 0x7f90a4109740 2024-04-25T13:43:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.849+0000 7f90aa48b700 1 --2- 172.21.15.43:0/762884076 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f90900afc10 0x7f90900b2120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009a10 tx=0x7f90a0009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:20.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:20.852+0000 7f909b7fe700 1 -- 172.21.15.43:0/762884076 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f909c010070 con 0x7f90a4109740 2024-04-25T13:43:21.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:21.072+0000 7f90ac6ef700 1 -- 172.21.15.43:0/762884076 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f90a402e510 con 0x7f90a4109740 2024-04-25T13:43:21.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:21.073+0000 7f909b7fe700 1 -- 172.21.15.43:0/762884076 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f909c0a7670 con 0x7f90a4109740 2024-04-25T13:43:21.074 INFO:teuthology.orchestra.run.smithi043.stdout:55834574927 2024-04-25T13:43:21.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:21.075+0000 7f90ac6ef700 1 -- 172.21.15.43:0/762884076 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f90900afc10 msgr2=0x7f90900b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:21.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:21.075+0000 7f90ac6ef700 1 --2- 172.21.15.43:0/762884076 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f90900afc10 0x7f90900b2120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009a10 tx=0x7f90a0009190 comp rx=0 tx=0).stop 2024-04-25T13:43:21.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:21.075+0000 7f90ac6ef700 1 -- 172.21.15.43:0/762884076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90a4109740 msgr2=0x7f90a4077520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:21.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:21.075+0000 7f90ac6ef700 1 --2- 172.21.15.43:0/762884076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90a4109740 0x7f90a4077520 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f909c007ee0 tx=0x7f909c00d3b0 comp rx=0 tx=0).stop 2024-04-25T13:43:21.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:21.075+0000 7f90ac6ef700 1 -- 172.21.15.43:0/762884076 shutdown_connections 2024-04-25T13:43:21.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:21.075+0000 7f90ac6ef700 1 --2- 172.21.15.43:0/762884076 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f90900afc10 0x7f90900b2120 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:21.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:21.075+0000 7f90ac6ef700 1 --2- 172.21.15.43:0/762884076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90a4109740 0x7f90a4077520 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:21.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:21.075+0000 7f90ac6ef700 1 --2- 172.21.15.43:0/762884076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90a41044c0 0x7f90a4076aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:21.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:21.075+0000 7f90ac6ef700 1 --2- 172.21.15.43:0/762884076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90a4108df0 0x7f90a4076fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:21.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:21.075+0000 7f90ac6ef700 1 -- 172.21.15.43:0/762884076 >> 172.21.15.43:0/762884076 conn(0x7f90a40ffd90 msgr2=0x7f90a41021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:21.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:21.075+0000 7f90ac6ef700 1 -- 172.21.15.43:0/762884076 shutdown_connections 2024-04-25T13:43:21.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:21.075+0000 7f90ac6ef700 1 -- 172.21.15.43:0/762884076 wait complete. 2024-04-25T13:43:21.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:21 smithi175 ceph-mon[32649]: pgmap v323: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-25T13:43:21.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:21 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/762884076' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-25T13:43:21.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:21 smithi043 ceph-mon[29195]: pgmap v323: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-25T13:43:21.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:21 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/762884076' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-25T13:43:22.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:21 smithi161 ceph-mon[32696]: pgmap v323: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-25T13:43:22.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:21 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/762884076' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-25T13:43:23.850 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:23 smithi043 ceph-mon[29195]: pgmap v324: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-25T13:43:23.885 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574924 got 55834574927 for osd.1 2024-04-25T13:43:23.885 DEBUG:teuthology.parallel:result is None 2024-04-25T13:43:23.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:23 smithi175 ceph-mon[32649]: pgmap v324: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-25T13:43:24.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:23 smithi161 ceph-mon[32696]: pgmap v324: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-25T13:43:25.808 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:25 smithi043 ceph-mon[29195]: pgmap v325: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-25T13:43:25.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:25 smithi175 ceph-mon[32649]: pgmap v325: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-25T13:43:26.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:25 smithi161 ceph-mon[32696]: pgmap v325: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-25T13:43:27.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:27 smithi043 ceph-mon[29195]: pgmap v326: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-25T13:43:27.804 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:43:27.805 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:43:27.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:27 smithi175 ceph-mon[32649]: pgmap v326: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-25T13:43:28.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:27 smithi161 ceph-mon[32696]: pgmap v326: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-04-25T13:43:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.150+0000 7fc6d08a9700 1 -- 172.21.15.43:0/2025648890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6cc109710 msgr2=0x7fc6cc111070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.150+0000 7fc6d08a9700 1 --2- 172.21.15.43:0/2025648890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6cc109710 0x7fc6cc111070 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400b0d0 tx=0x7fc6c400b3e0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.150+0000 7fc6d08a9700 1 -- 172.21.15.43:0/2025648890 shutdown_connections 2024-04-25T13:43:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.150+0000 7fc6d08a9700 1 --2- 172.21.15.43:0/2025648890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6cc109710 0x7fc6cc111070 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.150+0000 7fc6d08a9700 1 --2- 172.21.15.43:0/2025648890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6cc104490 0x7fc6cc1048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.150+0000 7fc6d08a9700 1 --2- 172.21.15.43:0/2025648890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6cc108dc0 0x7fc6cc1091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.150+0000 7fc6d08a9700 1 -- 172.21.15.43:0/2025648890 >> 172.21.15.43:0/2025648890 conn(0x7fc6cc0ffda0 msgr2=0x7fc6cc1021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.150+0000 7fc6d08a9700 1 -- 172.21.15.43:0/2025648890 shutdown_connections 2024-04-25T13:43:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.150+0000 7fc6d08a9700 1 -- 172.21.15.43:0/2025648890 wait complete. 2024-04-25T13:43:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.151+0000 7fc6d08a9700 1 Processor -- start 2024-04-25T13:43:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6d08a9700 1 -- start start 2024-04-25T13:43:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6d08a9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6cc104490 0x7fc6cc1a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6d08a9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6cc108dc0 0x7fc6cc1a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6d08a9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6cc109710 0x7fc6cc19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6d08a9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc114210 con 0x7fc6cc108dc0 2024-04-25T13:43:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6d08a9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc114090 con 0x7fc6cc104490 2024-04-25T13:43:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6d08a9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc114390 con 0x7fc6cc109710 2024-04-25T13:43:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6c3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6cc108dc0 0x7fc6cc1a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6c3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6cc108dc0 0x7fc6cc1a0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47780/0 (socket says 172.21.15.43:47780) 2024-04-25T13:43:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6c3fff700 1 -- 172.21.15.43:0/1918184301 learned_addr learned my addr 172.21.15.43:0/1918184301 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6cad9d700 1 --2- 172.21.15.43:0/1918184301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6cc109710 0x7fc6cc19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6ca59c700 1 --2- 172.21.15.43:0/1918184301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6cc104490 0x7fc6cc1a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6c3fff700 1 -- 172.21.15.43:0/1918184301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6cc109710 msgr2=0x7fc6cc19a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6c3fff700 1 --2- 172.21.15.43:0/1918184301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6cc109710 0x7fc6cc19a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6c3fff700 1 -- 172.21.15.43:0/1918184301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6cc104490 msgr2=0x7fc6cc1a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6c3fff700 1 --2- 172.21.15.43:0/1918184301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6cc104490 0x7fc6cc1a0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6c3fff700 1 -- 172.21.15.43:0/1918184301 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6cc19b060 con 0x7fc6cc108dc0 2024-04-25T13:43:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.152+0000 7fc6ca59c700 1 --2- 172.21.15.43:0/1918184301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6cc104490 0x7fc6cc1a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.153+0000 7fc6c3fff700 1 --2- 172.21.15.43:0/1918184301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6cc108dc0 0x7fc6cc1a0cd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400d950 tx=0x7fc6b400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.153+0000 7fc6c37fe700 1 -- 172.21.15.43:0/1918184301 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4016070 con 0x7fc6cc108dc0 2024-04-25T13:43:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.153+0000 7fc6d08a9700 1 -- 172.21.15.43:0/1918184301 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6cc19b350 con 0x7fc6cc108dc0 2024-04-25T13:43:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.153+0000 7fc6c37fe700 1 -- 172.21.15.43:0/1918184301 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6b4004830 con 0x7fc6cc108dc0 2024-04-25T13:43:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.153+0000 7fc6c37fe700 1 -- 172.21.15.43:0/1918184301 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b40053e0 con 0x7fc6cc108dc0 2024-04-25T13:43:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.153+0000 7fc6d08a9700 1 -- 172.21.15.43:0/1918184301 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6cc1a7620 con 0x7fc6cc108dc0 2024-04-25T13:43:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.154+0000 7fc6d08a9700 1 -- 172.21.15.43:0/1918184301 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6cc051190 con 0x7fc6cc108dc0 2024-04-25T13:43:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.155+0000 7fc6c37fe700 1 -- 172.21.15.43:0/1918184301 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fc6b4005580 con 0x7fc6cc108dc0 2024-04-25T13:43:28.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.156+0000 7fc6c37fe700 1 --2- 172.21.15.43:0/1918184301 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc6b80afc10 0x7fc6b80b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:28.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.156+0000 7fc6ca59c700 1 --2- 172.21.15.43:0/1918184301 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc6b80afc10 0x7fc6b80b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:28.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.156+0000 7fc6c37fe700 1 -- 172.21.15.43:0/1918184301 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fc6b40df320 con 0x7fc6cc108dc0 2024-04-25T13:43:28.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.157+0000 7fc6ca59c700 1 --2- 172.21.15.43:0/1918184301 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc6b80afc10 0x7fc6b80b2120 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc005fd0 tx=0x7fc6bc005de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:28.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.160+0000 7fc6c37fe700 1 -- 172.21.15.43:0/1918184301 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc6b401f020 con 0x7fc6cc108dc0 2024-04-25T13:43:28.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.370+0000 7fc6d08a9700 1 -- 172.21.15.43:0/1918184301 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc6cc02e510 con 0x7fc6cc108dc0 2024-04-25T13:43:28.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.370+0000 7fc6c37fe700 1 -- 172.21.15.43:0/1918184301 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc6b40a7a40 con 0x7fc6cc108dc0 2024-04-25T13:43:28.371 INFO:teuthology.orchestra.run.smithi043.stdout:158913790013 2024-04-25T13:43:28.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.373+0000 7fc6d08a9700 1 -- 172.21.15.43:0/1918184301 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc6b80afc10 msgr2=0x7fc6b80b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.373+0000 7fc6d08a9700 1 --2- 172.21.15.43:0/1918184301 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc6b80afc10 0x7fc6b80b2120 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc005fd0 tx=0x7fc6bc005de0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.373+0000 7fc6d08a9700 1 -- 172.21.15.43:0/1918184301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6cc108dc0 msgr2=0x7fc6cc1a0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.373+0000 7fc6d08a9700 1 --2- 172.21.15.43:0/1918184301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6cc108dc0 0x7fc6cc1a0cd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400d950 tx=0x7fc6b400dc60 comp rx=0 tx=0).stop 2024-04-25T13:43:28.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.373+0000 7fc6d08a9700 1 -- 172.21.15.43:0/1918184301 shutdown_connections 2024-04-25T13:43:28.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.373+0000 7fc6d08a9700 1 --2- 172.21.15.43:0/1918184301 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc6b80afc10 0x7fc6b80b2120 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.373+0000 7fc6d08a9700 1 --2- 172.21.15.43:0/1918184301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6cc109710 0x7fc6cc19a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.373+0000 7fc6d08a9700 1 --2- 172.21.15.43:0/1918184301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6cc104490 0x7fc6cc1a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.373+0000 7fc6d08a9700 1 --2- 172.21.15.43:0/1918184301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6cc108dc0 0x7fc6cc1a0cd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.373+0000 7fc6d08a9700 1 -- 172.21.15.43:0/1918184301 >> 172.21.15.43:0/1918184301 conn(0x7fc6cc0ffda0 msgr2=0x7fc6cc108560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:28.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.373+0000 7fc6d08a9700 1 -- 172.21.15.43:0/1918184301 shutdown_connections 2024-04-25T13:43:28.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:28.373+0000 7fc6d08a9700 1 -- 172.21.15.43:0/1918184301 wait complete. 2024-04-25T13:43:28.866 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:28 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1918184301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-25T13:43:28.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:28 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1918184301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-25T13:43:29.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:28 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1918184301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-25T13:43:29.886 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:29 smithi043 ceph-mon[29195]: pgmap v327: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-25T13:43:29.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:29 smithi175 ceph-mon[32649]: pgmap v327: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-25T13:43:30.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:29 smithi161 ceph-mon[32696]: pgmap v327: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-25T13:43:30.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.838+0000 7fb6cc513700 1 -- 172.21.15.43:0/3790550117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6c4103390 msgr2=0x7fb6c41037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:30.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.838+0000 7fb6cc513700 1 --2- 172.21.15.43:0/3790550117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6c4103390 0x7fb6c41037a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb6c00099c0 tx=0x7fb6c0009cd0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.839+0000 7fb6cc513700 1 -- 172.21.15.43:0/3790550117 shutdown_connections 2024-04-25T13:43:30.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.839+0000 7fb6cc513700 1 --2- 172.21.15.43:0/3790550117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6c4108610 0x7fb6c410ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.839+0000 7fb6cc513700 1 --2- 172.21.15.43:0/3790550117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6c4103390 0x7fb6c41037a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.839+0000 7fb6cc513700 1 --2- 172.21.15.43:0/3790550117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6c4107cc0 0x7fb6c41080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.839+0000 7fb6cc513700 1 -- 172.21.15.43:0/3790550117 >> 172.21.15.43:0/3790550117 conn(0x7fb6c40fec90 msgr2=0x7fb6c41010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:30.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.839+0000 7fb6cc513700 1 -- 172.21.15.43:0/3790550117 shutdown_connections 2024-04-25T13:43:30.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.839+0000 7fb6cc513700 1 -- 172.21.15.43:0/3790550117 wait complete. 2024-04-25T13:43:30.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.840+0000 7fb6cc513700 1 Processor -- start 2024-04-25T13:43:30.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.840+0000 7fb6cc513700 1 -- start start 2024-04-25T13:43:30.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.840+0000 7fb6cc513700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6c4103390 0x7fb6c419f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:30.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.840+0000 7fb6cc513700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6c4107cc0 0x7fb6c419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:30.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.840+0000 7fb6cc513700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6c4108610 0x7fb6c41999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:30.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.840+0000 7fb6cc513700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4113140 con 0x7fb6c4108610 2024-04-25T13:43:30.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.840+0000 7fb6cc513700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4112fc0 con 0x7fb6c4103390 2024-04-25T13:43:30.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.840+0000 7fb6cc513700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c41132c0 con 0x7fb6c4107cc0 2024-04-25T13:43:30.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.841+0000 7fb6caab0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6c4108610 0x7fb6c41999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:30.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.841+0000 7fb6caab0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6c4108610 0x7fb6c41999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41356/0 (socket says 172.21.15.43:41356) 2024-04-25T13:43:30.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.841+0000 7fb6caab0700 1 -- 172.21.15.43:0/874806067 learned_addr learned my addr 172.21.15.43:0/874806067 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:30.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.841+0000 7fb6ca2af700 1 --2- 172.21.15.43:0/874806067 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6c4103390 0x7fb6c419f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:30.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.841+0000 7fb6c9aae700 1 --2- 172.21.15.43:0/874806067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6c4107cc0 0x7fb6c419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:30.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.841+0000 7fb6caab0700 1 -- 172.21.15.43:0/874806067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6c4107cc0 msgr2=0x7fb6c419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:30.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.841+0000 7fb6caab0700 1 --2- 172.21.15.43:0/874806067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6c4107cc0 0x7fb6c419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.841+0000 7fb6caab0700 1 -- 172.21.15.43:0/874806067 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6c4103390 msgr2=0x7fb6c419f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:30.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.841+0000 7fb6caab0700 1 --2- 172.21.15.43:0/874806067 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6c4103390 0x7fb6c419f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.841+0000 7fb6caab0700 1 -- 172.21.15.43:0/874806067 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c4199fe0 con 0x7fb6c4108610 2024-04-25T13:43:30.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.841+0000 7fb6c9aae700 1 --2- 172.21.15.43:0/874806067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6c4107cc0 0x7fb6c419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:30.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.841+0000 7fb6caab0700 1 --2- 172.21.15.43:0/874806067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6c4108610 0x7fb6c41999a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc007ee0 tx=0x7fb6bc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:30.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.841+0000 7fb6b77fe700 1 -- 172.21.15.43:0/874806067 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc00ddd0 con 0x7fb6c4108610 2024-04-25T13:43:30.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.842+0000 7fb6cc513700 1 -- 172.21.15.43:0/874806067 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c419a2d0 con 0x7fb6c4108610 2024-04-25T13:43:30.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.842+0000 7fb6b77fe700 1 -- 172.21.15.43:0/874806067 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6bc004020 con 0x7fb6c4108610 2024-04-25T13:43:30.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.842+0000 7fb6b77fe700 1 -- 172.21.15.43:0/874806067 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc015660 con 0x7fb6c4108610 2024-04-25T13:43:30.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.842+0000 7fb6cc513700 1 -- 172.21.15.43:0/874806067 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c406b4e0 con 0x7fb6c4108610 2024-04-25T13:43:30.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.843+0000 7fb6cc513700 1 -- 172.21.15.43:0/874806067 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c4104840 con 0x7fb6c4108610 2024-04-25T13:43:30.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.844+0000 7fb6b77fe700 1 -- 172.21.15.43:0/874806067 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fb6bc003a00 con 0x7fb6c4108610 2024-04-25T13:43:30.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.845+0000 7fb6b77fe700 1 --2- 172.21.15.43:0/874806067 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb6b00afc10 0x7fb6b00b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:30.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.845+0000 7fb6ca2af700 1 --2- 172.21.15.43:0/874806067 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb6b00afc10 0x7fb6b00b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:30.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.845+0000 7fb6b77fe700 1 -- 172.21.15.43:0/874806067 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fb6bc0deb90 con 0x7fb6c4108610 2024-04-25T13:43:30.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.845+0000 7fb6ca2af700 1 --2- 172.21.15.43:0/874806067 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb6b00afc10 0x7fb6b00b2120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb6c419aae0 tx=0x7fb6c0005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:30.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:30.850+0000 7fb6b77fe700 1 -- 172.21.15.43:0/874806067 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb6bc010070 con 0x7fb6c4108610 2024-04-25T13:43:31.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:31.062+0000 7fb6cc513700 1 -- 172.21.15.43:0/874806067 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb6c419aed0 con 0x7fb6c4108610 2024-04-25T13:43:31.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:31.063+0000 7fb6b77fe700 1 -- 172.21.15.43:0/874806067 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb6bc0a7250 con 0x7fb6c4108610 2024-04-25T13:43:31.063 INFO:teuthology.orchestra.run.smithi043.stdout:111669149767 2024-04-25T13:43:31.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:31.065+0000 7fb6cc513700 1 -- 172.21.15.43:0/874806067 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb6b00afc10 msgr2=0x7fb6b00b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:31.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:31.065+0000 7fb6cc513700 1 --2- 172.21.15.43:0/874806067 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb6b00afc10 0x7fb6b00b2120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb6c419aae0 tx=0x7fb6c0005fb0 comp rx=0 tx=0).stop 2024-04-25T13:43:31.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:31.065+0000 7fb6cc513700 1 -- 172.21.15.43:0/874806067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6c4108610 msgr2=0x7fb6c41999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:31.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:31.065+0000 7fb6cc513700 1 --2- 172.21.15.43:0/874806067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6c4108610 0x7fb6c41999a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc007ee0 tx=0x7fb6bc00d3b0 comp rx=0 tx=0).stop 2024-04-25T13:43:31.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:31.065+0000 7fb6cc513700 1 -- 172.21.15.43:0/874806067 shutdown_connections 2024-04-25T13:43:31.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:31.065+0000 7fb6cc513700 1 --2- 172.21.15.43:0/874806067 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb6b00afc10 0x7fb6b00b2120 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:31.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:31.065+0000 7fb6cc513700 1 --2- 172.21.15.43:0/874806067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6c4108610 0x7fb6c41999a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:31.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:31.065+0000 7fb6cc513700 1 --2- 172.21.15.43:0/874806067 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6c4103390 0x7fb6c419f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:31.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:31.065+0000 7fb6cc513700 1 --2- 172.21.15.43:0/874806067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6c4107cc0 0x7fb6c419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:31.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:31.065+0000 7fb6cc513700 1 -- 172.21.15.43:0/874806067 >> 172.21.15.43:0/874806067 conn(0x7fb6c40fec90 msgr2=0x7fb6c41010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:31.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:31.065+0000 7fb6cc513700 1 -- 172.21.15.43:0/874806067 shutdown_connections 2024-04-25T13:43:31.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:31.065+0000 7fb6cc513700 1 -- 172.21.15.43:0/874806067 wait complete. 2024-04-25T13:43:31.789 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:31 smithi043 ceph-mon[29195]: pgmap v328: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:31.789 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:31 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/874806067' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-25T13:43:31.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:31 smithi175 ceph-mon[32649]: pgmap v328: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:31.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:31 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/874806067' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-25T13:43:32.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.100+0000 7ff7b1dda700 1 -- 172.21.15.43:0/2121456354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ac109700 msgr2=0x7ff7ac111060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:32.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.100+0000 7ff7b1dda700 1 --2- 172.21.15.43:0/2121456354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ac109700 0x7ff7ac111060 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400b0d0 tx=0x7ff7a400b3e0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.100+0000 7ff7b1dda700 1 -- 172.21.15.43:0/2121456354 shutdown_connections 2024-04-25T13:43:32.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.100+0000 7ff7b1dda700 1 --2- 172.21.15.43:0/2121456354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ac109700 0x7ff7ac111060 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.100+0000 7ff7b1dda700 1 --2- 172.21.15.43:0/2121456354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7ac102990 0x7ff7ac102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.100+0000 7ff7b1dda700 1 --2- 172.21.15.43:0/2121456354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7ac108db0 0x7ff7ac1091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.100+0000 7ff7b1dda700 1 -- 172.21.15.43:0/2121456354 >> 172.21.15.43:0/2121456354 conn(0x7ff7ac0fe370 msgr2=0x7ff7ac1007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:32.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.100+0000 7ff7b1dda700 1 -- 172.21.15.43:0/2121456354 shutdown_connections 2024-04-25T13:43:32.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.100+0000 7ff7b1dda700 1 -- 172.21.15.43:0/2121456354 wait complete. 2024-04-25T13:43:32.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.101+0000 7ff7b1dda700 1 Processor -- start 2024-04-25T13:43:32.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.101+0000 7ff7b1dda700 1 -- start start 2024-04-25T13:43:32.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.101+0000 7ff7b1dda700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7ac102990 0x7ff7ac1a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:32.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7b1dda700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7ac108db0 0x7ff7ac1a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:32.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7b1dda700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ac109700 0x7ff7ac19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:32.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7b1dda700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac1141e0 con 0x7ff7ac109700 2024-04-25T13:43:32.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7b1dda700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac114060 con 0x7ff7ac108db0 2024-04-25T13:43:32.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7b1dda700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac114360 con 0x7ff7ac102990 2024-04-25T13:43:32.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7abfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ac109700 0x7ff7ac19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:32.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7abfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ac109700 0x7ff7ac19a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41368/0 (socket says 172.21.15.43:41368) 2024-04-25T13:43:32.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7abfff700 1 -- 172.21.15.43:0/758573981 learned_addr learned my addr 172.21.15.43:0/758573981 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:32.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7aaffd700 1 --2- 172.21.15.43:0/758573981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7ac108db0 0x7ff7ac1a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:32.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7ab7fe700 1 --2- 172.21.15.43:0/758573981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7ac102990 0x7ff7ac1a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:32.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7abfff700 1 -- 172.21.15.43:0/758573981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7ac102990 msgr2=0x7ff7ac1a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:32.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7abfff700 1 --2- 172.21.15.43:0/758573981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7ac102990 0x7ff7ac1a0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7abfff700 1 -- 172.21.15.43:0/758573981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7ac108db0 msgr2=0x7ff7ac1a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:32.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7abfff700 1 --2- 172.21.15.43:0/758573981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7ac108db0 0x7ff7ac1a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7abfff700 1 -- 172.21.15.43:0/758573981 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ac19b010 con 0x7ff7ac109700 2024-04-25T13:43:32.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7abfff700 1 --2- 172.21.15.43:0/758573981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ac109700 0x7ff7ac19a960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009850 tx=0x7ff7a4007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:32.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7a8ff9700 1 -- 172.21.15.43:0/758573981 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a401f030 con 0x7ff7ac109700 2024-04-25T13:43:32.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:31 smithi161 ceph-mon[32696]: pgmap v328: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:32.104 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:31 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/874806067' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-25T13:43:32.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.102+0000 7ff7a8ff9700 1 -- 172.21.15.43:0/758573981 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff7a401bad0 con 0x7ff7ac109700 2024-04-25T13:43:32.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.103+0000 7ff7b1dda700 1 -- 172.21.15.43:0/758573981 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ac19b2a0 con 0x7ff7ac109700 2024-04-25T13:43:32.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.103+0000 7ff7a8ff9700 1 -- 172.21.15.43:0/758573981 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4012bb0 con 0x7ff7ac109700 2024-04-25T13:43:32.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.103+0000 7ff7b1dda700 1 -- 172.21.15.43:0/758573981 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ac1a75d0 con 0x7ff7ac109700 2024-04-25T13:43:32.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.104+0000 7ff7b1dda700 1 -- 172.21.15.43:0/758573981 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7ac051190 con 0x7ff7ac109700 2024-04-25T13:43:32.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.105+0000 7ff7a8ff9700 1 -- 172.21.15.43:0/758573981 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7ff7a4022030 con 0x7ff7ac109700 2024-04-25T13:43:32.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.106+0000 7ff7a8ff9700 1 --2- 172.21.15.43:0/758573981 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff7940afc10 0x7ff7940b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:32.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.106+0000 7ff7ab7fe700 1 --2- 172.21.15.43:0/758573981 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff7940afc10 0x7ff7940b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:32.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.106+0000 7ff7a8ff9700 1 -- 172.21.15.43:0/758573981 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7ff7a400f020 con 0x7ff7ac109700 2024-04-25T13:43:32.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.106+0000 7ff7ab7fe700 1 --2- 172.21.15.43:0/758573981 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff7940afc10 0x7ff7940b2120 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff79c005950 tx=0x7ff79c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:32.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.109+0000 7ff7a8ff9700 1 -- 172.21.15.43:0/758573981 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff7a4029020 con 0x7ff7ac109700 2024-04-25T13:43:32.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.322+0000 7ff7b1dda700 1 -- 172.21.15.43:0/758573981 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff7ac02e510 con 0x7ff7ac109700 2024-04-25T13:43:32.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.322+0000 7ff7a8ff9700 1 -- 172.21.15.43:0/758573981 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff7a40a91e0 con 0x7ff7ac109700 2024-04-25T13:43:32.322 INFO:teuthology.orchestra.run.smithi043.stdout:206158430258 2024-04-25T13:43:32.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.324+0000 7ff7b1dda700 1 -- 172.21.15.43:0/758573981 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff7940afc10 msgr2=0x7ff7940b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:32.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.324+0000 7ff7b1dda700 1 --2- 172.21.15.43:0/758573981 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff7940afc10 0x7ff7940b2120 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff79c005950 tx=0x7ff79c0058e0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.324+0000 7ff7b1dda700 1 -- 172.21.15.43:0/758573981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ac109700 msgr2=0x7ff7ac19a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:32.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.324+0000 7ff7b1dda700 1 --2- 172.21.15.43:0/758573981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ac109700 0x7ff7ac19a960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009850 tx=0x7ff7a4007e40 comp rx=0 tx=0).stop 2024-04-25T13:43:32.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.324+0000 7ff7b1dda700 1 -- 172.21.15.43:0/758573981 shutdown_connections 2024-04-25T13:43:32.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.324+0000 7ff7b1dda700 1 --2- 172.21.15.43:0/758573981 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff7940afc10 0x7ff7940b2120 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.324+0000 7ff7b1dda700 1 --2- 172.21.15.43:0/758573981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ac109700 0x7ff7ac19a960 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.324+0000 7ff7b1dda700 1 --2- 172.21.15.43:0/758573981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7ac102990 0x7ff7ac1a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.324+0000 7ff7b1dda700 1 --2- 172.21.15.43:0/758573981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7ac108db0 0x7ff7ac1a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.324+0000 7ff7b1dda700 1 -- 172.21.15.43:0/758573981 >> 172.21.15.43:0/758573981 conn(0x7ff7ac0fe370 msgr2=0x7ff7ac0fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:32.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.324+0000 7ff7b1dda700 1 -- 172.21.15.43:0/758573981 shutdown_connections 2024-04-25T13:43:32.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:32.325+0000 7ff7b1dda700 1 -- 172.21.15.43:0/758573981 wait complete. 2024-04-25T13:43:32.904 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:32 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/758573981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-25T13:43:32.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:32 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/758573981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-25T13:43:33.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:32 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/758573981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-25T13:43:33.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.219+0000 7f9814358700 1 -- 172.21.15.43:0/2489457010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f980c108dd0 msgr2=0x7f980c1091e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:33.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.219+0000 7f9814358700 1 --2- 172.21.15.43:0/2489457010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f980c108dd0 0x7f980c1091e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f97fc0099c0 tx=0x7f97fc009cd0 comp rx=0 tx=0).stop 2024-04-25T13:43:33.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.219+0000 7f9814358700 1 -- 172.21.15.43:0/2489457010 shutdown_connections 2024-04-25T13:43:33.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.219+0000 7f9814358700 1 --2- 172.21.15.43:0/2489457010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f980c109720 0x7f980c111080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:33.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.219+0000 7f9814358700 1 --2- 172.21.15.43:0/2489457010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f980c1044a0 0x7f980c1048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:33.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.219+0000 7f9814358700 1 --2- 172.21.15.43:0/2489457010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f980c108dd0 0x7f980c1091e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:33.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.219+0000 7f9814358700 1 -- 172.21.15.43:0/2489457010 >> 172.21.15.43:0/2489457010 conn(0x7f980c0ffeb0 msgr2=0x7f980c1022d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:33.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.219+0000 7f9814358700 1 -- 172.21.15.43:0/2489457010 shutdown_connections 2024-04-25T13:43:33.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.219+0000 7f9814358700 1 -- 172.21.15.43:0/2489457010 wait complete. 2024-04-25T13:43:33.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f9814358700 1 Processor -- start 2024-04-25T13:43:33.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f9814358700 1 -- start start 2024-04-25T13:43:33.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f9814358700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f980c1044a0 0x7f980c1a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:33.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f9814358700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f980c108dd0 0x7f980c1a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:33.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f9814358700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f980c109720 0x7f980c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:33.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f9814358700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f980c1141e0 con 0x7f980c1044a0 2024-04-25T13:43:33.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f9814358700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f980c114060 con 0x7f980c109720 2024-04-25T13:43:33.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f9814358700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f980c114360 con 0x7f980c108dd0 2024-04-25T13:43:33.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f98120f4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f980c1044a0 0x7f980c1a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:33.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f98118f3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f980c108dd0 0x7f980c1a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:33.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f98120f4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f980c1044a0 0x7f980c1a0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41388/0 (socket says 172.21.15.43:41388) 2024-04-25T13:43:33.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f98120f4700 1 -- 172.21.15.43:0/234747386 learned_addr learned my addr 172.21.15.43:0/234747386 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:33.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f98128f5700 1 --2- 172.21.15.43:0/234747386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f980c109720 0x7f980c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:33.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f98120f4700 1 -- 172.21.15.43:0/234747386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f980c108dd0 msgr2=0x7f980c1a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:33.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f98120f4700 1 --2- 172.21.15.43:0/234747386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f980c108dd0 0x7f980c1a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:33.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f98120f4700 1 -- 172.21.15.43:0/234747386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f980c109720 msgr2=0x7f980c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:33.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.220+0000 7f98120f4700 1 --2- 172.21.15.43:0/234747386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f980c109720 0x7f980c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:33.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.221+0000 7f98120f4700 1 -- 172.21.15.43:0/234747386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980c19b0f0 con 0x7f980c1044a0 2024-04-25T13:43:33.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.221+0000 7f98128f5700 1 --2- 172.21.15.43:0/234747386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f980c109720 0x7f980c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:33.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.221+0000 7f98120f4700 1 --2- 172.21.15.43:0/234747386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f980c1044a0 0x7f980c1a0820 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f980800d950 tx=0x7f980800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:33.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.221+0000 7f98037fe700 1 -- 172.21.15.43:0/234747386 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9808016070 con 0x7f980c1044a0 2024-04-25T13:43:33.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.221+0000 7f9814358700 1 -- 172.21.15.43:0/234747386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f980c19b3e0 con 0x7f980c1044a0 2024-04-25T13:43:33.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.221+0000 7f98037fe700 1 -- 172.21.15.43:0/234747386 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9808009dd0 con 0x7f980c1044a0 2024-04-25T13:43:33.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.221+0000 7f98037fe700 1 -- 172.21.15.43:0/234747386 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980800f3c0 con 0x7f980c1044a0 2024-04-25T13:43:33.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.221+0000 7f9814358700 1 -- 172.21.15.43:0/234747386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f980c1a76b0 con 0x7f980c1044a0 2024-04-25T13:43:33.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.222+0000 7f9814358700 1 -- 172.21.15.43:0/234747386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f980c051190 con 0x7f980c1044a0 2024-04-25T13:43:33.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.224+0000 7f98037fe700 1 -- 172.21.15.43:0/234747386 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f9808019070 con 0x7f980c1044a0 2024-04-25T13:43:33.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.224+0000 7f98037fe700 1 --2- 172.21.15.43:0/234747386 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f97f80afc10 0x7f97f80b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:33.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.225+0000 7f98037fe700 1 -- 172.21.15.43:0/234747386 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f98080dedd0 con 0x7f980c1044a0 2024-04-25T13:43:33.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.225+0000 7f98118f3700 1 --2- 172.21.15.43:0/234747386 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f97f80afc10 0x7f97f80b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:33.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.225+0000 7f98118f3700 1 --2- 172.21.15.43:0/234747386 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f97f80afc10 0x7f97f80b2120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009990 tx=0x7f97fc005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:33.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.230+0000 7f98037fe700 1 -- 172.21.15.43:0/234747386 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f98080a74f0 con 0x7f980c1044a0 2024-04-25T13:43:33.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.450+0000 7f9814358700 1 -- 172.21.15.43:0/234747386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f980c02e510 con 0x7f980c1044a0 2024-04-25T13:43:33.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.450+0000 7f98037fe700 1 -- 172.21.15.43:0/234747386 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f98080a6df0 con 0x7f980c1044a0 2024-04-25T13:43:33.451 INFO:teuthology.orchestra.run.smithi043.stdout:184683593784 2024-04-25T13:43:33.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.453+0000 7f9814358700 1 -- 172.21.15.43:0/234747386 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f97f80afc10 msgr2=0x7f97f80b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:33.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.453+0000 7f9814358700 1 --2- 172.21.15.43:0/234747386 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f97f80afc10 0x7f97f80b2120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009990 tx=0x7f97fc005fb0 comp rx=0 tx=0).stop 2024-04-25T13:43:33.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.453+0000 7f9814358700 1 -- 172.21.15.43:0/234747386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f980c1044a0 msgr2=0x7f980c1a0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:33.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.453+0000 7f9814358700 1 --2- 172.21.15.43:0/234747386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f980c1044a0 0x7f980c1a0820 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f980800d950 tx=0x7f980800dc60 comp rx=0 tx=0).stop 2024-04-25T13:43:33.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.453+0000 7f9814358700 1 -- 172.21.15.43:0/234747386 shutdown_connections 2024-04-25T13:43:33.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.453+0000 7f9814358700 1 --2- 172.21.15.43:0/234747386 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f97f80afc10 0x7f97f80b2120 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:33.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.453+0000 7f9814358700 1 --2- 172.21.15.43:0/234747386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f980c109720 0x7f980c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:33.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.453+0000 7f9814358700 1 --2- 172.21.15.43:0/234747386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f980c1044a0 0x7f980c1a0820 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:33.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.453+0000 7f9814358700 1 --2- 172.21.15.43:0/234747386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f980c108dd0 0x7f980c1a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:33.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.453+0000 7f9814358700 1 -- 172.21.15.43:0/234747386 >> 172.21.15.43:0/234747386 conn(0x7f980c0ffeb0 msgr2=0x7f980c108570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:33.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.453+0000 7f9814358700 1 -- 172.21.15.43:0/234747386 shutdown_connections 2024-04-25T13:43:33.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:33.453+0000 7f9814358700 1 -- 172.21.15.43:0/234747386 wait complete. 2024-04-25T13:43:33.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:33 smithi043 ceph-mon[29195]: pgmap v329: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T13:43:33.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:33 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/234747386' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-25T13:43:33.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:33 smithi175 ceph-mon[32649]: pgmap v329: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T13:43:33.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:33 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/234747386' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-25T13:43:34.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:33 smithi161 ceph-mon[32696]: pgmap v329: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T13:43:34.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:33 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/234747386' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-25T13:43:34.494 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430253 got 206158430258 for osd.7 2024-04-25T13:43:34.494 DEBUG:teuthology.parallel:result is None 2024-04-25T13:43:35.776 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790010 got 158913790013 for osd.5 2024-04-25T13:43:35.777 DEBUG:teuthology.parallel:result is None 2024-04-25T13:43:35.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:35 smithi043 ceph-mon[29195]: pgmap v330: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T13:43:35.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:35 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3555799408' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-25T13:43:36.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:35 smithi161 ceph-mon[32696]: pgmap v330: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T13:43:36.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:35 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3555799408' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-25T13:43:36.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:35 smithi175 ceph-mon[32649]: pgmap v330: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T13:43:36.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:35 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3555799408' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-25T13:43:36.571 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:43:37.011 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149763 got 111669149767 for osd.3 2024-04-25T13:43:37.011 DEBUG:teuthology.parallel:result is None 2024-04-25T13:43:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.190+0000 7f360f232700 1 -- 172.21.15.43:0/355122391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3608107cc0 msgr2=0x7f36081080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.190+0000 7f360f232700 1 --2- 172.21.15.43:0/355122391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3608107cc0 0x7f36081080d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0099c0 tx=0x7f35fc009cd0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.190+0000 7f360f232700 1 -- 172.21.15.43:0/355122391 shutdown_connections 2024-04-25T13:43:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.190+0000 7f360f232700 1 --2- 172.21.15.43:0/355122391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3608108610 0x7f360810ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.190+0000 7f360f232700 1 --2- 172.21.15.43:0/355122391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3608103390 0x7f36081037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.190+0000 7f360f232700 1 --2- 172.21.15.43:0/355122391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3608107cc0 0x7f36081080d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.190+0000 7f360f232700 1 -- 172.21.15.43:0/355122391 >> 172.21.15.43:0/355122391 conn(0x7f36080fecc0 msgr2=0x7f36081010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.191+0000 7f360f232700 1 -- 172.21.15.43:0/355122391 shutdown_connections 2024-04-25T13:43:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.191+0000 7f360f232700 1 -- 172.21.15.43:0/355122391 wait complete. 2024-04-25T13:43:37.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.191+0000 7f360f232700 1 Processor -- start 2024-04-25T13:43:37.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.191+0000 7f360f232700 1 -- start start 2024-04-25T13:43:37.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360f232700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3608103390 0x7f360819ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360f232700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3608107cc0 0x7f360819bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360f232700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3608108610 0x7f36081a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360f232700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3608113120 con 0x7f3608108610 2024-04-25T13:43:37.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360f232700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f3608112fa0 con 0x7f3608103390 2024-04-25T13:43:37.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360f232700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36081132a0 con 0x7f3608107cc0 2024-04-25T13:43:37.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360d7cf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3608108610 0x7f36081a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360d7cf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3608108610 0x7f36081a6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41434/0 (socket says 172.21.15.43:41434) 2024-04-25T13:43:37.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360d7cf700 1 -- 172.21.15.43:0/3967167626 learned_addr learned my addr 172.21.15.43:0/3967167626 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:37.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f3607fff700 1 --2- 172.21.15.43:0/3967167626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3608107cc0 0x7f360819bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360cfce700 1 --2- 172.21.15.43:0/3967167626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3608103390 0x7f360819ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360d7cf700 1 -- 172.21.15.43:0/3967167626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3608107cc0 msgr2=0x7f360819bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360d7cf700 1 --2- 172.21.15.43:0/3967167626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3608107cc0 0x7f360819bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360d7cf700 1 -- 172.21.15.43:0/3967167626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3608103390 msgr2=0x7f360819ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360d7cf700 1 --2- 172.21.15.43:0/3967167626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3608103390 0x7f360819ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360d7cf700 1 -- 172.21.15.43:0/3967167626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360819c850 con 0x7f3608108610 2024-04-25T13:43:37.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360cfce700 1 --2- 172.21.15.43:0/3967167626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3608103390 0x7f360819ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:37.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.192+0000 7f360d7cf700 1 --2- 172.21.15.43:0/3967167626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3608108610 0x7f36081a6ae0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3600007ee0 tx=0x7f360000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.193+0000 7f3605ffb700 1 -- 172.21.15.43:0/3967167626 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360000dbd0 con 0x7f3608108610 2024-04-25T13:43:37.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.193+0000 7f3605ffb700 1 -- 172.21.15.43:0/3967167626 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f360000dd70 con 0x7f3608108610 2024-04-25T13:43:37.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.193+0000 7f360f232700 1 -- 172.21.15.43:0/3967167626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36081a7140 con 0x7f3608108610 2024-04-25T13:43:37.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.193+0000 7f3605ffb700 1 -- 172.21.15.43:0/3967167626 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36000058d0 con 0x7f3608108610 2024-04-25T13:43:37.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.193+0000 7f360f232700 1 -- 172.21.15.43:0/3967167626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36081a7600 con 0x7f3608108610 2024-04-25T13:43:37.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.194+0000 7f360f232700 1 -- 172.21.15.43:0/3967167626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3608051190 con 0x7f3608108610 2024-04-25T13:43:37.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.196+0000 7f3605ffb700 1 -- 172.21.15.43:0/3967167626 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f360001a020 con 0x7f3608108610 2024-04-25T13:43:37.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.197+0000 7f3605ffb700 1 --2- 172.21.15.43:0/3967167626 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f35f00afc90 0x7f35f00b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.197+0000 7f360cfce700 1 --2- 172.21.15.43:0/3967167626 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f35f00afc90 0x7f35f00b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.197+0000 7f3605ffb700 1 -- 172.21.15.43:0/3967167626 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f36000dee70 con 0x7f3608108610 2024-04-25T13:43:37.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.197+0000 7f360cfce700 1 --2- 172.21.15.43:0/3967167626 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f35f00afc90 0x7f35f00b21a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f35f8005950 tx=0x7f35f80058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.201+0000 7f3605ffb700 1 -- 172.21.15.43:0/3967167626 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3600010070 con 0x7f3608108610 2024-04-25T13:43:37.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.413+0000 7f360f232700 1 -- 172.21.15.43:0/3967167626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f360802e510 con 0x7f3608108610 2024-04-25T13:43:37.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.414+0000 7f3605ffb700 1 -- 172.21.15.43:0/3967167626 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f36000a7590 con 0x7f3608108610 2024-04-25T13:43:37.414 INFO:teuthology.orchestra.run.smithi043.stdout:257698037802 2024-04-25T13:43:37.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.416+0000 7f360f232700 1 -- 172.21.15.43:0/3967167626 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f35f00afc90 msgr2=0x7f35f00b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.416+0000 7f360f232700 1 --2- 172.21.15.43:0/3967167626 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f35f00afc90 0x7f35f00b21a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f35f8005950 tx=0x7f35f80058e0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.416+0000 7f360f232700 1 -- 172.21.15.43:0/3967167626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3608108610 msgr2=0x7f36081a6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.416+0000 7f360f232700 1 --2- 172.21.15.43:0/3967167626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3608108610 0x7f36081a6ae0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3600007ee0 tx=0x7f360000d3b0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.416+0000 7f360f232700 1 -- 172.21.15.43:0/3967167626 shutdown_connections 2024-04-25T13:43:37.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.416+0000 7f360f232700 1 --2- 172.21.15.43:0/3967167626 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f35f00afc90 0x7f35f00b21a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.416+0000 7f360f232700 1 --2- 172.21.15.43:0/3967167626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3608108610 0x7f36081a6ae0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.416+0000 7f360f232700 1 --2- 172.21.15.43:0/3967167626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3608103390 0x7f360819ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.416+0000 7f360f232700 1 --2- 172.21.15.43:0/3967167626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3608107cc0 0x7f360819bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.416+0000 7f360f232700 1 -- 172.21.15.43:0/3967167626 >> 172.21.15.43:0/3967167626 conn(0x7f36080fecc0 msgr2=0x7f3608109570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:37.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.416+0000 7f360f232700 1 -- 172.21.15.43:0/3967167626 shutdown_connections 2024-04-25T13:43:37.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:37.416+0000 7f360f232700 1 -- 172.21.15.43:0/3967167626 wait complete. 2024-04-25T13:43:37.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.386+0000 7f56ee53e700 1 -- 172.21.15.43:0/2184497976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e81044a0 msgr2=0x7f56e81048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.386+0000 7f56ee53e700 1 --2- 172.21.15.43:0/2184497976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e81044a0 0x7f56e81048b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f56d80099c0 tx=0x7f56d8009cd0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.386+0000 7f56ee53e700 1 -- 172.21.15.43:0/2184497976 shutdown_connections 2024-04-25T13:43:37.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.386+0000 7f56ee53e700 1 --2- 172.21.15.43:0/2184497976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56e8109720 0x7f56e8111080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.386+0000 7f56ee53e700 1 --2- 172.21.15.43:0/2184497976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e81044a0 0x7f56e81048b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.386+0000 7f56ee53e700 1 --2- 172.21.15.43:0/2184497976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e8108dd0 0x7f56e81091e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.386+0000 7f56ee53e700 1 -- 172.21.15.43:0/2184497976 >> 172.21.15.43:0/2184497976 conn(0x7f56e80ffdb0 msgr2=0x7f56e8102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:37.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.386+0000 7f56ee53e700 1 -- 172.21.15.43:0/2184497976 shutdown_connections 2024-04-25T13:43:37.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.386+0000 7f56ee53e700 1 -- 172.21.15.43:0/2184497976 wait complete. 2024-04-25T13:43:37.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.387+0000 7f56ee53e700 1 Processor -- start 2024-04-25T13:43:37.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.387+0000 7f56ee53e700 1 -- start start 2024-04-25T13:43:37.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56ee53e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e81044a0 0x7f56e81a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56ee53e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56e8108dd0 0x7f56e81a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56ee53e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e8109720 0x7f56e819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56ee53e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f56e8114220 con 0x7f56e81044a0 2024-04-25T13:43:37.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56ee53e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81140a0 con 0x7f56e8108dd0 2024-04-25T13:43:37.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56ee53e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81143a0 con 0x7f56e8109720 2024-04-25T13:43:37.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56e7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e81044a0 0x7f56e81a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56e7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e81044a0 0x7f56e81a0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41412/0 (socket says 172.21.15.43:41412) 2024-04-25T13:43:37.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56e7fff700 1 -- 172.21.15.43:0/3555799408 learned_addr learned my addr 172.21.15.43:0/3555799408 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:37.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56ecadb700 1 --2- 172.21.15.43:0/3555799408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e8109720 0x7f56e819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56e77fe700 1 --2- 172.21.15.43:0/3555799408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56e8108dd0 0x7f56e81a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56e7fff700 1 -- 172.21.15.43:0/3555799408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e8109720 msgr2=0x7f56e819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56e7fff700 1 --2- 172.21.15.43:0/3555799408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e8109720 0x7f56e819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56e7fff700 1 -- 172.21.15.43:0/3555799408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56e8108dd0 msgr2=0x7f56e81a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56e7fff700 1 --2- 172.21.15.43:0/3555799408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56e8108dd0 0x7f56e81a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56e7fff700 1 -- 172.21.15.43:0/3555799408 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e819b130 con 0x7f56e81044a0 2024-04-25T13:43:37.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.388+0000 7f56e7fff700 1 --2- 172.21.15.43:0/3555799408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e81044a0 0x7f56e81a0860 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f56d8000c00 tx=0x7f56d80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.491 INFO:teuthology.orchestra.run.smithi043.stdout:137438953538 2024-04-25T13:43:37.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.389+0000 7f56e57fa700 1 -- 172.21.15.43:0/3555799408 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8004830 con 0x7f56e81044a0 2024-04-25T13:43:37.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.389+0000 7f56e57fa700 1 -- 172.21.15.43:0/3555799408 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56d800f7f0 con 0x7f56e81044a0 2024-04-25T13:43:37.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.389+0000 7f56ee53e700 1 -- 172.21.15.43:0/3555799408 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e819b3c0 con 0x7f56e81044a0 2024-04-25T13:43:37.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.389+0000 7f56e57fa700 1 -- 172.21.15.43:0/3555799408 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d80053a0 con 0x7f56e81044a0 2024-04-25T13:43:37.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.389+0000 7f56ee53e700 1 -- 172.21.15.43:0/3555799408 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e819b890 con 0x7f56e81044a0 2024-04-25T13:43:37.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.390+0000 7f56ee53e700 1 -- 172.21.15.43:0/3555799408 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e8051190 con 0x7f56e81044a0 2024-04-25T13:43:37.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.391+0000 7f56e57fa700 1 -- 172.21.15.43:0/3555799408 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f56d8029060 con 0x7f56e81044a0 2024-04-25T13:43:37.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.392+0000 7f56e57fa700 1 --2- 172.21.15.43:0/3555799408 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f56d40afc90 0x7f56d40b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.392+0000 7f56e77fe700 1 --2- 172.21.15.43:0/3555799408 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f56d40afc90 0x7f56d40b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.392+0000 7f56e57fa700 1 -- 172.21.15.43:0/3555799408 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f56d80dfd70 con 0x7f56e81044a0 2024-04-25T13:43:37.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.392+0000 7f56e77fe700 1 --2- 172.21.15.43:0/3555799408 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f56d40afc90 0x7f56d40b21a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f56e8107430 tx=0x7f56d000b3c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.395+0000 7f56e57fa700 1 -- 172.21.15.43:0/3555799408 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f56d8013070 con 0x7f56e81044a0 2024-04-25T13:43:37.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.606+0000 7f56ee53e700 1 -- 172.21.15.43:0/3555799408 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f56e802e510 con 0x7f56e81044a0 2024-04-25T13:43:37.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.606+0000 7f56e57fa700 1 -- 172.21.15.43:0/3555799408 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f56d80a8520 con 0x7f56e81044a0 2024-04-25T13:43:37.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.608+0000 7f56ee53e700 1 -- 172.21.15.43:0/3555799408 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f56d40afc90 msgr2=0x7f56d40b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.608+0000 7f56ee53e700 1 --2- 172.21.15.43:0/3555799408 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f56d40afc90 0x7f56d40b21a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f56e8107430 tx=0x7f56d000b3c0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.608+0000 7f56ee53e700 1 -- 172.21.15.43:0/3555799408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e81044a0 msgr2=0x7f56e81a0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.608+0000 7f56ee53e700 1 --2- 172.21.15.43:0/3555799408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e81044a0 0x7f56e81a0860 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f56d8000c00 tx=0x7f56d80047b0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.608+0000 7f56ee53e700 1 -- 172.21.15.43:0/3555799408 shutdown_connections 2024-04-25T13:43:37.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.608+0000 7f56ee53e700 1 --2- 172.21.15.43:0/3555799408 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f56d40afc90 0x7f56d40b21a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.608+0000 7f56ee53e700 1 --2- 172.21.15.43:0/3555799408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e8109720 0x7f56e819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.608+0000 7f56ee53e700 1 --2- 172.21.15.43:0/3555799408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56e81044a0 0x7f56e81a0860 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.608+0000 7f56ee53e700 1 --2- 172.21.15.43:0/3555799408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56e8108dd0 0x7f56e81a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.608+0000 7f56ee53e700 1 -- 172.21.15.43:0/3555799408 >> 172.21.15.43:0/3555799408 conn(0x7f56e80ffdb0 msgr2=0x7f56e8102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:37.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.608+0000 7f56ee53e700 1 -- 172.21.15.43:0/3555799408 shutdown_connections 2024-04-25T13:43:37.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:35.608+0000 7f56ee53e700 1 -- 172.21.15.43:0/3555799408 wait complete. 2024-04-25T13:43:37.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:37 smithi043 ceph-mon[29195]: pgmap v331: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:37.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:37 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3967167626' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-25T13:43:38.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:37 smithi161 ceph-mon[32696]: pgmap v331: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:38.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:37 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3967167626' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-25T13:43:38.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:37 smithi175 ceph-mon[32649]: pgmap v331: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:38.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:37 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3967167626' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-25T13:43:38.247 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953532 got 137438953538 for osd.4 2024-04-25T13:43:38.248 DEBUG:teuthology.parallel:result is None 2024-04-25T13:43:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.001+0000 7ff3e5513700 1 -- 172.21.15.43:0/3702422743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3e0107c90 msgr2=0x7ff3e01080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.001+0000 7ff3e5513700 1 --2- 172.21.15.43:0/3702422743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3e0107c90 0x7ff3e01080a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40099c0 tx=0x7ff3d4009cd0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.001+0000 7ff3e5513700 1 -- 172.21.15.43:0/3702422743 shutdown_connections 2024-04-25T13:43:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.001+0000 7ff3e5513700 1 --2- 172.21.15.43:0/3702422743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3e01085e0 0x7ff3e010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.001+0000 7ff3e5513700 1 --2- 172.21.15.43:0/3702422743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e0103360 0x7ff3e0103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.001+0000 7ff3e5513700 1 --2- 172.21.15.43:0/3702422743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3e0107c90 0x7ff3e01080a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.001+0000 7ff3e5513700 1 -- 172.21.15.43:0/3702422743 >> 172.21.15.43:0/3702422743 conn(0x7ff3e00fecb0 msgr2=0x7ff3e01010d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.002+0000 7ff3e5513700 1 -- 172.21.15.43:0/3702422743 shutdown_connections 2024-04-25T13:43:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.002+0000 7ff3e5513700 1 -- 172.21.15.43:0/3702422743 wait complete. 2024-04-25T13:43:39.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.002+0000 7ff3e5513700 1 Processor -- start 2024-04-25T13:43:39.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.002+0000 7ff3e5513700 1 -- start start 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.003+0000 7ff3e5513700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e0103360 0x7ff3e01a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.003+0000 7ff3e5513700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3e0107c90 0x7ff3e01a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.003+0000 7ff3e5513700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3e01085e0 0x7ff3e019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.003+0000 7ff3e5513700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e0114260 con 0x7ff3e01085e0 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.003+0000 7ff3e5513700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e01140e0 con 0x7ff3e0107c90 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.003+0000 7ff3e5513700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e01143e0 con 0x7ff3e0103360 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.003+0000 7ff3df7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3e01085e0 0x7ff3e019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.003+0000 7ff3df7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3e01085e0 0x7ff3e019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41462/0 (socket says 172.21.15.43:41462) 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.003+0000 7ff3df7fe700 1 -- 172.21.15.43:0/1297751039 learned_addr learned my addr 172.21.15.43:0/1297751039 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.003+0000 7ff3deffd700 1 --2- 172.21.15.43:0/1297751039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e0103360 0x7ff3e01a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.003+0000 7ff3de7fc700 1 --2- 172.21.15.43:0/1297751039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3e0107c90 0x7ff3e01a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.003+0000 7ff3de7fc700 1 -- 172.21.15.43:0/1297751039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e0103360 msgr2=0x7ff3e01a0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.003+0000 7ff3de7fc700 1 --2- 172.21.15.43:0/1297751039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e0103360 0x7ff3e01a0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.003+0000 7ff3de7fc700 1 -- 172.21.15.43:0/1297751039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3e01085e0 msgr2=0x7ff3e019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.003+0000 7ff3de7fc700 1 --2- 172.21.15.43:0/1297751039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3e01085e0 0x7ff3e019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.004+0000 7ff3de7fc700 1 -- 172.21.15.43:0/1297751039 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e019b130 con 0x7ff3e0107c90 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.004+0000 7ff3deffd700 1 --2- 172.21.15.43:0/1297751039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e0103360 0x7ff3e01a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.004+0000 7ff3df7fe700 1 --2- 172.21.15.43:0/1297751039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3e01085e0 0x7ff3e019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.004+0000 7ff3de7fc700 1 --2- 172.21.15.43:0/1297751039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3e0107c90 0x7ff3e01a0da0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40098e0 tx=0x7ff3d40057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.004+0000 7ff3c7fff700 1 -- 172.21.15.43:0/1297751039 <== mon.2 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4027070 con 0x7ff3e0107c90 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.004+0000 7ff3c7fff700 1 -- 172.21.15.43:0/1297751039 <== mon.2 v2:172.21.15.161:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff3d400fc80 con 0x7ff3e0107c90 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.004+0000 7ff3c7fff700 1 -- 172.21.15.43:0/1297751039 <== mon.2 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4022d90 con 0x7ff3e0107c90 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.005+0000 7ff3e5513700 1 -- 172.21.15.43:0/1297751039 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e019b3c0 con 0x7ff3e0107c90 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.005+0000 7ff3e5513700 1 -- 172.21.15.43:0/1297751039 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e019b850 con 0x7ff3e0107c90 2024-04-25T13:43:39.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.006+0000 7ff3e5513700 1 -- 172.21.15.43:0/1297751039 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e0051190 con 0x7ff3e0107c90 2024-04-25T13:43:39.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.008+0000 7ff3c7fff700 1 -- 172.21.15.43:0/1297751039 <== mon.2 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7ff3d402a070 con 0x7ff3e0107c90 2024-04-25T13:43:39.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.008+0000 7ff3c7fff700 1 --2- 172.21.15.43:0/1297751039 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff3c80b4020 0x7ff3c80b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.008+0000 7ff3deffd700 1 --2- 172.21.15.43:0/1297751039 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff3c80b4020 0x7ff3c80b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.008+0000 7ff3c7fff700 1 -- 172.21.15.43:0/1297751039 <== mon.2 v2:172.21.15.161:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7ff3d40e00d0 con 0x7ff3e0107c90 2024-04-25T13:43:39.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.009+0000 7ff3deffd700 1 --2- 172.21.15.43:0/1297751039 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff3c80b4020 0x7ff3c80b6530 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff3e019bbc0 tx=0x7ff3d000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:39.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.012+0000 7ff3c7fff700 1 -- 172.21.15.43:0/1297751039 <== mon.2 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff3d4013070 con 0x7ff3e0107c90 2024-04-25T13:43:39.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.220+0000 7ff3e5513700 1 -- 172.21.15.43:0/1297751039 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7ff3e002e510 con 0x7ff3e0107c90 2024-04-25T13:43:39.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.221+0000 7ff3c7fff700 1 -- 172.21.15.43:0/1297751039 <== mon.2 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff3d40a8880 con 0x7ff3e0107c90 2024-04-25T13:43:39.221 INFO:teuthology.orchestra.run.smithi043.stdout:231928234031 2024-04-25T13:43:39.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.223+0000 7ff3e5513700 1 -- 172.21.15.43:0/1297751039 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff3c80b4020 msgr2=0x7ff3c80b6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.223+0000 7ff3e5513700 1 --2- 172.21.15.43:0/1297751039 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff3c80b4020 0x7ff3c80b6530 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff3e019bbc0 tx=0x7ff3d000b410 comp rx=0 tx=0).stop 2024-04-25T13:43:39.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.223+0000 7ff3e5513700 1 -- 172.21.15.43:0/1297751039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3e0107c90 msgr2=0x7ff3e01a0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.223+0000 7ff3e5513700 1 --2- 172.21.15.43:0/1297751039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3e0107c90 0x7ff3e01a0da0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40098e0 tx=0x7ff3d40057c0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.223+0000 7ff3e5513700 1 -- 172.21.15.43:0/1297751039 shutdown_connections 2024-04-25T13:43:39.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.223+0000 7ff3e5513700 1 --2- 172.21.15.43:0/1297751039 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff3c80b4020 0x7ff3c80b6530 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.223+0000 7ff3e5513700 1 --2- 172.21.15.43:0/1297751039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3e01085e0 0x7ff3e019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.223+0000 7ff3e5513700 1 --2- 172.21.15.43:0/1297751039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3e0103360 0x7ff3e01a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.223+0000 7ff3e5513700 1 --2- 172.21.15.43:0/1297751039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3e0107c90 0x7ff3e01a0da0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.223+0000 7ff3e5513700 1 -- 172.21.15.43:0/1297751039 >> 172.21.15.43:0/1297751039 conn(0x7ff3e00fecb0 msgr2=0x7ff3e0101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:39.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.223+0000 7ff3e5513700 1 -- 172.21.15.43:0/1297751039 shutdown_connections 2024-04-25T13:43:39.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:39.223+0000 7ff3e5513700 1 -- 172.21.15.43:0/1297751039 wait complete. 2024-04-25T13:43:39.602 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593778 got 184683593784 for osd.6 2024-04-25T13:43:39.602 DEBUG:teuthology.parallel:result is None 2024-04-25T13:43:39.917 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:39 smithi043 ceph-mon[29195]: pgmap v332: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T13:43:39.917 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:39 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1297751039' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-25T13:43:39.982 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:39 smithi175 ceph-mon[32649]: pgmap v332: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T13:43:39.983 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:39 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1297751039' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-25T13:43:40.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:39 smithi161 ceph-mon[32696]: pgmap v332: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T13:43:40.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:39 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1297751039' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-25T13:43:41.017 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234025 got 231928234031 for osd.8 2024-04-25T13:43:41.017 DEBUG:teuthology.parallel:result is None 2024-04-25T13:43:41.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.765+0000 7f23e8a84700 1 -- 172.21.15.43:0/962768259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23e4108630 msgr2=0x7f23e410ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:41.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.765+0000 7f23e8a84700 1 --2- 172.21.15.43:0/962768259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23e4108630 0x7f23e410ff90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00b0d0 tx=0x7f23dc00b3e0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.766 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:41 smithi043 ceph-mon[29195]: pgmap v333: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:41.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.765+0000 7f23e8a84700 1 -- 172.21.15.43:0/962768259 shutdown_connections 2024-04-25T13:43:41.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.765+0000 7f23e8a84700 1 --2- 172.21.15.43:0/962768259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23e4108630 0x7f23e410ff90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.765+0000 7f23e8a84700 1 --2- 172.21.15.43:0/962768259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23e41033b0 0x7f23e41037c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.765+0000 7f23e8a84700 1 --2- 172.21.15.43:0/962768259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e4107ce0 0x7f23e41080f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.765+0000 7f23e8a84700 1 -- 172.21.15.43:0/962768259 >> 172.21.15.43:0/962768259 conn(0x7f23e40fee00 msgr2=0x7f23e4101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:41.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.766+0000 7f23e8a84700 1 -- 172.21.15.43:0/962768259 shutdown_connections 2024-04-25T13:43:41.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.766+0000 7f23e8a84700 1 -- 172.21.15.43:0/962768259 wait complete. 2024-04-25T13:43:41.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.766+0000 7f23e8a84700 1 Processor -- start 2024-04-25T13:43:41.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.766+0000 7f23e8a84700 1 -- start start 2024-04-25T13:43:41.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e8a84700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e41033b0 0x7f23e41a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:41.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e8a84700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23e4107ce0 0x7f23e41a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:41.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e8a84700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23e4108630 0x7f23e419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:41.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e8a84700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f23e4113110 con 0x7f23e4107ce0 2024-04-25T13:43:41.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e8a84700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f23e4112f90 con 0x7f23e4108630 2024-04-25T13:43:41.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e8a84700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f23e4113290 con 0x7f23e41033b0 2024-04-25T13:43:41.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e1d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23e4107ce0 0x7f23e41a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:41.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e1d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23e4107ce0 0x7f23e41a0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56302/0 (socket says 172.21.15.43:56302) 2024-04-25T13:43:41.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e1d9b700 1 -- 172.21.15.43:0/4214161120 learned_addr learned my addr 172.21.15.43:0/4214161120 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:41.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e259c700 1 --2- 172.21.15.43:0/4214161120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e41033b0 0x7f23e41a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e2d9d700 1 --2- 172.21.15.43:0/4214161120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23e4108630 0x7f23e419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e1d9b700 1 -- 172.21.15.43:0/4214161120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e41033b0 msgr2=0x7f23e41a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e1d9b700 1 --2- 172.21.15.43:0/4214161120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e41033b0 0x7f23e41a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e1d9b700 1 -- 172.21.15.43:0/4214161120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23e4108630 msgr2=0x7f23e419a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e1d9b700 1 --2- 172.21.15.43:0/4214161120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23e4108630 0x7f23e419a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e1d9b700 1 -- 172.21.15.43:0/4214161120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e419b050 con 0x7f23e4107ce0 2024-04-25T13:43:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e2d9d700 1 --2- 172.21.15.43:0/4214161120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23e4108630 0x7f23e419a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:41.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.767+0000 7f23e1d9b700 1 --2- 172.21.15.43:0/4214161120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23e4107ce0 0x7f23e41a0cc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f23d800d980 tx=0x7f23d800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:41.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.768+0000 7f23d37fe700 1 -- 172.21.15.43:0/4214161120 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8017070 con 0x7f23e4107ce0 2024-04-25T13:43:41.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.768+0000 7f23e8a84700 1 -- 172.21.15.43:0/4214161120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e419b340 con 0x7f23e4107ce0 2024-04-25T13:43:41.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.768+0000 7f23d37fe700 1 -- 172.21.15.43:0/4214161120 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23d8009dc0 con 0x7f23e4107ce0 2024-04-25T13:43:41.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.768+0000 7f23e8a84700 1 -- 172.21.15.43:0/4214161120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e41a7610 con 0x7f23e4107ce0 2024-04-25T13:43:41.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.768+0000 7f23d37fe700 1 -- 172.21.15.43:0/4214161120 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d800f3c0 con 0x7f23e4107ce0 2024-04-25T13:43:41.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.769+0000 7f23e8a84700 1 -- 172.21.15.43:0/4214161120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e4051190 con 0x7f23e4107ce0 2024-04-25T13:43:41.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.770+0000 7f23d37fe700 1 -- 172.21.15.43:0/4214161120 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f23d8009930 con 0x7f23e4107ce0 2024-04-25T13:43:41.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.771+0000 7f23d37fe700 1 --2- 172.21.15.43:0/4214161120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f23cc0afc90 0x7f23cc0b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:41.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.771+0000 7f23e259c700 1 --2- 172.21.15.43:0/4214161120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f23cc0afc90 0x7f23cc0b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:41.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.771+0000 7f23d37fe700 1 -- 172.21.15.43:0/4214161120 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f23d80deb60 con 0x7f23e4107ce0 2024-04-25T13:43:41.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.772+0000 7f23e259c700 1 --2- 172.21.15.43:0/4214161120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f23cc0afc90 0x7f23cc0b21a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f23e419bae0 tx=0x7f23d400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:41.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.775+0000 7f23d37fe700 1 -- 172.21.15.43:0/4214161120 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f23d80a7300 con 0x7f23e4107ce0 2024-04-25T13:43:41.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.986+0000 7f23e8a84700 1 -- 172.21.15.43:0/4214161120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f23e41a77e0 con 0x7f23e4107ce0 2024-04-25T13:43:41.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.986+0000 7f23d37fe700 1 -- 172.21.15.43:0/4214161120 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f23d80a6c00 con 0x7f23e4107ce0 2024-04-25T13:43:41.986 INFO:teuthology.orchestra.run.smithi043.stdout:304942678048 2024-04-25T13:43:41.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.988+0000 7f23e8a84700 1 -- 172.21.15.43:0/4214161120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f23cc0afc90 msgr2=0x7f23cc0b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:41.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.988+0000 7f23e8a84700 1 --2- 172.21.15.43:0/4214161120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f23cc0afc90 0x7f23cc0b21a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f23e419bae0 tx=0x7f23d400b410 comp rx=0 tx=0).stop 2024-04-25T13:43:41.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.988+0000 7f23e8a84700 1 -- 172.21.15.43:0/4214161120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23e4107ce0 msgr2=0x7f23e41a0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:41.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.988+0000 7f23e8a84700 1 --2- 172.21.15.43:0/4214161120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23e4107ce0 0x7f23e41a0cc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f23d800d980 tx=0x7f23d800dc90 comp rx=0 tx=0).stop 2024-04-25T13:43:41.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.988+0000 7f23e8a84700 1 -- 172.21.15.43:0/4214161120 shutdown_connections 2024-04-25T13:43:41.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.988+0000 7f23e8a84700 1 --2- 172.21.15.43:0/4214161120 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f23cc0afc90 0x7f23cc0b21a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.988+0000 7f23e8a84700 1 --2- 172.21.15.43:0/4214161120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23e4108630 0x7f23e419a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.988+0000 7f23e8a84700 1 --2- 172.21.15.43:0/4214161120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e41033b0 0x7f23e41a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.988+0000 7f23e8a84700 1 --2- 172.21.15.43:0/4214161120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23e4107ce0 0x7f23e41a0cc0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.988+0000 7f23e8a84700 1 -- 172.21.15.43:0/4214161120 >> 172.21.15.43:0/4214161120 conn(0x7f23e40fee00 msgr2=0x7f23e4101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:41.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.988+0000 7f23e8a84700 1 -- 172.21.15.43:0/4214161120 shutdown_connections 2024-04-25T13:43:41.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:41.988+0000 7f23e8a84700 1 -- 172.21.15.43:0/4214161120 wait complete. 2024-04-25T13:43:42.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:41 smithi161 ceph-mon[32696]: pgmap v333: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:42.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:41 smithi175 ceph-mon[32649]: pgmap v333: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:42.642 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037796 got 257698037802 for osd.9 2024-04-25T13:43:42.643 DEBUG:teuthology.parallel:result is None 2024-04-25T13:43:42.871 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:42 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/4214161120' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-25T13:43:43.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:42 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/4214161120' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-25T13:43:43.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:42 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/4214161120' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-25T13:43:43.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.229+0000 7f06ab5b6700 1 -- 172.21.15.43:0/2308934157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a4107ef0 msgr2=0x7f06a4108300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:43.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.229+0000 7f06ab5b6700 1 --2- 172.21.15.43:0/2308934157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a4107ef0 0x7f06a4108300 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f06940099c0 tx=0x7f0694009cd0 comp rx=0 tx=0).stop 2024-04-25T13:43:43.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.229+0000 7f06ab5b6700 1 -- 172.21.15.43:0/2308934157 shutdown_connections 2024-04-25T13:43:43.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.229+0000 7f06ab5b6700 1 --2- 172.21.15.43:0/2308934157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06a4108840 0x7f06a41101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:43.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.229+0000 7f06ab5b6700 1 --2- 172.21.15.43:0/2308934157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06a4103ae0 0x7f06a4103ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:43.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.229+0000 7f06ab5b6700 1 --2- 172.21.15.43:0/2308934157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a4107ef0 0x7f06a4108300 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:43.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.229+0000 7f06ab5b6700 1 -- 172.21.15.43:0/2308934157 >> 172.21.15.43:0/2308934157 conn(0x7f06a40fe3b0 msgr2=0x7f06a4100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:43.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.229+0000 7f06ab5b6700 1 -- 172.21.15.43:0/2308934157 shutdown_connections 2024-04-25T13:43:43.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.229+0000 7f06ab5b6700 1 -- 172.21.15.43:0/2308934157 wait complete. 2024-04-25T13:43:43.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.230+0000 7f06ab5b6700 1 Processor -- start 2024-04-25T13:43:43.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.230+0000 7f06ab5b6700 1 -- start start 2024-04-25T13:43:43.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.230+0000 7f06ab5b6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06a4103ae0 0x7f06a4199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:43.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.230+0000 7f06ab5b6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a4107ef0 0x7f06a419a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:43.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.230+0000 7f06ab5b6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06a4108840 0x7f06a419e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:43.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.230+0000 7f06ab5b6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f06a4113300 con 0x7f06a4107ef0 2024-04-25T13:43:43.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.230+0000 7f06ab5b6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f06a4113180 con 0x7f06a4103ae0 2024-04-25T13:43:43.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.230+0000 7f06ab5b6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f06a4113480 con 0x7f06a4108840 2024-04-25T13:43:43.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.230+0000 7f06a8b51700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a4107ef0 0x7f06a419a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:43.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.230+0000 7f06a8b51700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a4107ef0 0x7f06a419a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56318/0 (socket says 172.21.15.43:56318) 2024-04-25T13:43:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.230+0000 7f06a8b51700 1 -- 172.21.15.43:0/1202244179 learned_addr learned my addr 172.21.15.43:0/1202244179 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.231+0000 7f06a9352700 1 --2- 172.21.15.43:0/1202244179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06a4103ae0 0x7f06a4199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.231+0000 7f06a9b53700 1 --2- 172.21.15.43:0/1202244179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06a4108840 0x7f06a419e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.231+0000 7f06a8b51700 1 -- 172.21.15.43:0/1202244179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06a4108840 msgr2=0x7f06a419e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.231+0000 7f06a8b51700 1 --2- 172.21.15.43:0/1202244179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06a4108840 0x7f06a419e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.231+0000 7f06a8b51700 1 -- 172.21.15.43:0/1202244179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06a4103ae0 msgr2=0x7f06a4199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.231+0000 7f06a8b51700 1 --2- 172.21.15.43:0/1202244179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06a4103ae0 0x7f06a4199d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.231+0000 7f06a8b51700 1 -- 172.21.15.43:0/1202244179 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a419ebe0 con 0x7f06a4107ef0 2024-04-25T13:43:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.231+0000 7f06a8b51700 1 --2- 172.21.15.43:0/1202244179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a4107ef0 0x7f06a419a2b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f069400b580 tx=0x7f06940057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.231+0000 7f069a7fc700 1 -- 172.21.15.43:0/1202244179 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0694027070 con 0x7f06a4107ef0 2024-04-25T13:43:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.231+0000 7f069a7fc700 1 -- 172.21.15.43:0/1202244179 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f069400fd30 con 0x7f06a4107ef0 2024-04-25T13:43:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.231+0000 7f069a7fc700 1 -- 172.21.15.43:0/1202244179 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06940173f0 con 0x7f06a4107ef0 2024-04-25T13:43:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.231+0000 7f06ab5b6700 1 -- 172.21.15.43:0/1202244179 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a419ee70 con 0x7f06a4107ef0 2024-04-25T13:43:43.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.231+0000 7f06ab5b6700 1 -- 172.21.15.43:0/1202244179 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a419f300 con 0x7f06a4107ef0 2024-04-25T13:43:43.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.232+0000 7f068ffff700 1 -- 172.21.15.43:0/1202244179 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0684005330 con 0x7f06a4107ef0 2024-04-25T13:43:43.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.235+0000 7f069a7fc700 1 -- 172.21.15.43:0/1202244179 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f069402a070 con 0x7f06a4107ef0 2024-04-25T13:43:43.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.236+0000 7f069a7fc700 1 --2- 172.21.15.43:0/1202244179 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f06900afc10 0x7f06900b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:43.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.236+0000 7f069a7fc700 1 -- 172.21.15.43:0/1202244179 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f06940e01e0 con 0x7f06a4107ef0 2024-04-25T13:43:43.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.236+0000 7f06a9352700 1 --2- 172.21.15.43:0/1202244179 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f06900afc10 0x7f06900b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:43.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.236+0000 7f06a9352700 1 --2- 172.21.15.43:0/1202244179 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f06900afc10 0x7f06900b2120 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f06a0005950 tx=0x7f06a000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:43.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.238+0000 7f069a7fc700 1 -- 172.21.15.43:0/1202244179 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f069405eff0 con 0x7f06a4107ef0 2024-04-25T13:43:43.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.466+0000 7f068ffff700 1 -- 172.21.15.43:0/1202244179 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f06840058f0 con 0x7f06a4107ef0 2024-04-25T13:43:43.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.467+0000 7f069a7fc700 1 -- 172.21.15.43:0/1202244179 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0694013070 con 0x7f06a4107ef0 2024-04-25T13:43:43.467 INFO:teuthology.orchestra.run.smithi043.stdout:77309411407 2024-04-25T13:43:43.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.469+0000 7f068ffff700 1 -- 172.21.15.43:0/1202244179 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f06900afc10 msgr2=0x7f06900b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:43.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.469+0000 7f068ffff700 1 --2- 172.21.15.43:0/1202244179 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f06900afc10 0x7f06900b2120 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f06a0005950 tx=0x7f06a000b410 comp rx=0 tx=0).stop 2024-04-25T13:43:43.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.469+0000 7f068ffff700 1 -- 172.21.15.43:0/1202244179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a4107ef0 msgr2=0x7f06a419a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:43.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.469+0000 7f068ffff700 1 --2- 172.21.15.43:0/1202244179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a4107ef0 0x7f06a419a2b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f069400b580 tx=0x7f06940057c0 comp rx=0 tx=0).stop 2024-04-25T13:43:43.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.469+0000 7f068ffff700 1 -- 172.21.15.43:0/1202244179 shutdown_connections 2024-04-25T13:43:43.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.469+0000 7f068ffff700 1 --2- 172.21.15.43:0/1202244179 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f06900afc10 0x7f06900b2120 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:43.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.469+0000 7f068ffff700 1 --2- 172.21.15.43:0/1202244179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06a4108840 0x7f06a419e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:43.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.469+0000 7f068ffff700 1 --2- 172.21.15.43:0/1202244179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06a4103ae0 0x7f06a4199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:43.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.469+0000 7f068ffff700 1 --2- 172.21.15.43:0/1202244179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a4107ef0 0x7f06a419a2b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:43.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.469+0000 7f068ffff700 1 -- 172.21.15.43:0/1202244179 >> 172.21.15.43:0/1202244179 conn(0x7f06a40fe3b0 msgr2=0x7f06a41076f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:43.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.469+0000 7f068ffff700 1 -- 172.21.15.43:0/1202244179 shutdown_connections 2024-04-25T13:43:43.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.469+0000 7f068ffff700 1 -- 172.21.15.43:0/1202244179 wait complete. 2024-04-25T13:43:43.831 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:43 smithi043 ceph-mon[29195]: pgmap v334: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T13:43:43.831 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:43 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2519485647' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-25T13:43:43.831 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:43 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1202244179' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-25T13:43:43.859 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678041 got 304942678048 for osd.11 2024-04-25T13:43:43.859 DEBUG:teuthology.parallel:result is None 2024-04-25T13:43:44.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.089+0000 7f56b4030700 1 -- 172.21.15.43:0/2138921657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac102f20 msgr2=0x7f56ac103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:44.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.089+0000 7f56b4030700 1 --2- 172.21.15.43:0/2138921657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac102f20 0x7f56ac103330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009990 tx=0x7f56a8009ca0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.090+0000 7f56b4030700 1 -- 172.21.15.43:0/2138921657 shutdown_connections 2024-04-25T13:43:44.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.090+0000 7f56b4030700 1 --2- 172.21.15.43:0/2138921657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56ac110ad0 0x7f56ac112ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.090+0000 7f56b4030700 1 --2- 172.21.15.43:0/2138921657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac102f20 0x7f56ac103330 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.090+0000 7f56b4030700 1 --2- 172.21.15.43:0/2138921657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56ac103900 0x7f56ac110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.090+0000 7f56b4030700 1 -- 172.21.15.43:0/2138921657 >> 172.21.15.43:0/2138921657 conn(0x7f56ac0fec90 msgr2=0x7f56ac1010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:44.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.090+0000 7f56b4030700 1 -- 172.21.15.43:0/2138921657 shutdown_connections 2024-04-25T13:43:44.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.090+0000 7f56b4030700 1 -- 172.21.15.43:0/2138921657 wait complete. 2024-04-25T13:43:44.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.090+0000 7f56b4030700 1 Processor -- start 2024-04-25T13:43:44.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.090+0000 7f56b4030700 1 -- start start 2024-04-25T13:43:44.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b4030700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac102f20 0x7f56ac19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:44.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b4030700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56ac103900 0x7f56ac19d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:44.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b4030700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56ac110ad0 0x7f56ac1a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:44.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b4030700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac116440 con 0x7f56ac102f20 2024-04-25T13:43:44.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b4030700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac1162c0 con 0x7f56ac110ad0 2024-04-25T13:43:44.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b4030700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac1165c0 con 0x7f56ac103900 2024-04-25T13:43:44.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b1dcc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac102f20 0x7f56ac19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:44.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b1dcc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac102f20 0x7f56ac19cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56310/0 (socket says 172.21.15.43:56310) 2024-04-25T13:43:44.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b1dcc700 1 -- 172.21.15.43:0/2519485647 learned_addr learned my addr 172.21.15.43:0/2519485647 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:44.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b15cb700 1 --2- 172.21.15.43:0/2519485647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56ac103900 0x7f56ac19d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:44.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b1dcc700 1 -- 172.21.15.43:0/2519485647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56ac103900 msgr2=0x7f56ac19d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:44.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b1dcc700 1 --2- 172.21.15.43:0/2519485647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56ac103900 0x7f56ac19d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b1dcc700 1 -- 172.21.15.43:0/2519485647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56ac110ad0 msgr2=0x7f56ac1a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:44.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b25cd700 1 --2- 172.21.15.43:0/2519485647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56ac110ad0 0x7f56ac1a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:44.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b1dcc700 1 --2- 172.21.15.43:0/2519485647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56ac110ad0 0x7f56ac1a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b1dcc700 1 -- 172.21.15.43:0/2519485647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac1a1cc0 con 0x7f56ac102f20 2024-04-25T13:43:44.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b25cd700 1 --2- 172.21.15.43:0/2519485647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56ac110ad0 0x7f56ac1a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:44.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56b1dcc700 1 --2- 172.21.15.43:0/2519485647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac102f20 0x7f56ac19cdf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f56a80057c0 tx=0x7f56a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:44.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.091+0000 7f56a2ffd700 1 -- 172.21.15.43:0/2519485647 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a8027070 con 0x7f56ac102f20 2024-04-25T13:43:44.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.092+0000 7f56a2ffd700 1 -- 172.21.15.43:0/2519485647 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56a8003ff0 con 0x7f56ac102f20 2024-04-25T13:43:44.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.092+0000 7f56b4030700 1 -- 172.21.15.43:0/2519485647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ac1a1f50 con 0x7f56ac102f20 2024-04-25T13:43:44.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.092+0000 7f56a2ffd700 1 -- 172.21.15.43:0/2519485647 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a8022d60 con 0x7f56ac102f20 2024-04-25T13:43:44.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.092+0000 7f56b4030700 1 -- 172.21.15.43:0/2519485647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ac1a98d0 con 0x7f56ac102f20 2024-04-25T13:43:44.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.093+0000 7f56b4030700 1 -- 172.21.15.43:0/2519485647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ac051190 con 0x7f56ac102f20 2024-04-25T13:43:44.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.094+0000 7f56a2ffd700 1 -- 172.21.15.43:0/2519485647 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f56a802a070 con 0x7f56ac102f20 2024-04-25T13:43:44.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.095+0000 7f56a2ffd700 1 --2- 172.21.15.43:0/2519485647 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f56980afc90 0x7f56980b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:44.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.095+0000 7f56b15cb700 1 --2- 172.21.15.43:0/2519485647 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f56980afc90 0x7f56980b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:44.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.095+0000 7f56a2ffd700 1 -- 172.21.15.43:0/2519485647 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f56a80e0600 con 0x7f56ac102f20 2024-04-25T13:43:44.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.096+0000 7f56b15cb700 1 --2- 172.21.15.43:0/2519485647 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f56980afc90 0x7f56980b21a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f569c006fd0 tx=0x7f569c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:44.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.099+0000 7f56a2ffd700 1 -- 172.21.15.43:0/2519485647 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f56a8031080 con 0x7f56ac102f20 2024-04-25T13:43:44.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.320+0000 7f56b4030700 1 -- 172.21.15.43:0/2519485647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f56ac02e510 con 0x7f56ac102f20 2024-04-25T13:43:44.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.320+0000 7f56a2ffd700 1 -- 172.21.15.43:0/2519485647 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f56a8013070 con 0x7f56ac102f20 2024-04-25T13:43:44.010 INFO:teuthology.orchestra.run.smithi043.stdout:34359738457 2024-04-25T13:43:44.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.322+0000 7f56b4030700 1 -- 172.21.15.43:0/2519485647 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f56980afc90 msgr2=0x7f56980b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:44.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.322+0000 7f56b4030700 1 --2- 172.21.15.43:0/2519485647 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f56980afc90 0x7f56980b21a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f569c006fd0 tx=0x7f569c008040 comp rx=0 tx=0).stop 2024-04-25T13:43:44.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.322+0000 7f56b4030700 1 -- 172.21.15.43:0/2519485647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac102f20 msgr2=0x7f56ac19cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:44.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.322+0000 7f56b4030700 1 --2- 172.21.15.43:0/2519485647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac102f20 0x7f56ac19cdf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f56a80057c0 tx=0x7f56a80057f0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.323+0000 7f56b4030700 1 -- 172.21.15.43:0/2519485647 shutdown_connections 2024-04-25T13:43:44.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.323+0000 7f56b4030700 1 --2- 172.21.15.43:0/2519485647 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f56980afc90 0x7f56980b21a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.323+0000 7f56b4030700 1 --2- 172.21.15.43:0/2519485647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56ac110ad0 0x7f56ac1a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.323+0000 7f56b4030700 1 --2- 172.21.15.43:0/2519485647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac102f20 0x7f56ac19cdf0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.323+0000 7f56b4030700 1 --2- 172.21.15.43:0/2519485647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56ac103900 0x7f56ac19d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.323+0000 7f56b4030700 1 -- 172.21.15.43:0/2519485647 >> 172.21.15.43:0/2519485647 conn(0x7f56ac0fec90 msgr2=0x7f56ac1126e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:44.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.323+0000 7f56b4030700 1 -- 172.21.15.43:0/2519485647 shutdown_connections 2024-04-25T13:43:44.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:43.323+0000 7f56b4030700 1 -- 172.21.15.43:0/2519485647 wait complete. 2024-04-25T13:43:44.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:43 smithi161 ceph-mon[32696]: pgmap v334: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T13:43:44.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:43 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2519485647' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-25T13:43:44.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:43 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1202244179' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-25T13:43:44.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:43 smithi175 ceph-mon[32649]: pgmap v334: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T13:43:44.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:43 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2519485647' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-25T13:43:44.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:43 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1202244179' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-25T13:43:44.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.936+0000 7fc345741700 1 -- 172.21.15.43:0/415176940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3401085d0 msgr2=0x7fc34010ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:44.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.936+0000 7fc345741700 1 --2- 172.21.15.43:0/415176940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3401085d0 0x7fc34010ff30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc33800b0d0 tx=0x7fc33800b3e0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.936+0000 7fc345741700 1 -- 172.21.15.43:0/415176940 shutdown_connections 2024-04-25T13:43:44.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.936+0000 7fc345741700 1 --2- 172.21.15.43:0/415176940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3401085d0 0x7fc34010ff30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.936+0000 7fc345741700 1 --2- 172.21.15.43:0/415176940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc340103350 0x7fc340103760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.936+0000 7fc345741700 1 --2- 172.21.15.43:0/415176940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc340107c80 0x7fc340108090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.936+0000 7fc345741700 1 -- 172.21.15.43:0/415176940 >> 172.21.15.43:0/415176940 conn(0x7fc3400fec30 msgr2=0x7fc340101050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:44.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.936+0000 7fc345741700 1 -- 172.21.15.43:0/415176940 shutdown_connections 2024-04-25T13:43:44.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.936+0000 7fc345741700 1 -- 172.21.15.43:0/415176940 wait complete. 2024-04-25T13:43:44.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.937+0000 7fc345741700 1 Processor -- start 2024-04-25T13:43:44.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.938+0000 7fc345741700 1 -- start start 2024-04-25T13:43:44.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.938+0000 7fc345741700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc340103350 0x7fc34019f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:44.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.938+0000 7fc345741700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc340107c80 0x7fc34019fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:44.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.938+0000 7fc345741700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3401085d0 0x7fc3401998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:44.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.938+0000 7fc345741700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401130b0 con 0x7fc340103350 2024-04-25T13:43:44.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.938+0000 7fc345741700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fc340112f30 con 0x7fc340107c80 2024-04-25T13:43:44.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.938+0000 7fc345741700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc340113230 con 0x7fc3401085d0 2024-04-25T13:43:44.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.938+0000 7fc33effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc340103350 0x7fc34019f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:44.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.938+0000 7fc33effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc340103350 0x7fc34019f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56338/0 (socket says 172.21.15.43:56338) 2024-04-25T13:43:44.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.938+0000 7fc33effd700 1 -- 172.21.15.43:0/4162195835 learned_addr learned my addr 172.21.15.43:0/4162195835 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:44.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.938+0000 7fc3367fc700 1 --2- 172.21.15.43:0/4162195835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc340107c80 0x7fc34019fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:44.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.938+0000 7fc33f7fe700 1 --2- 172.21.15.43:0/4162195835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3401085d0 0x7fc3401998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:44.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.939+0000 7fc33effd700 1 -- 172.21.15.43:0/4162195835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3401085d0 msgr2=0x7fc3401998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:44.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.939+0000 7fc33effd700 1 --2- 172.21.15.43:0/4162195835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3401085d0 0x7fc3401998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.939+0000 7fc33effd700 1 -- 172.21.15.43:0/4162195835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc340107c80 msgr2=0x7fc34019fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:44.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.939+0000 7fc33effd700 1 --2- 172.21.15.43:0/4162195835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc340107c80 0x7fc34019fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:44.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.939+0000 7fc33effd700 1 -- 172.21.15.43:0/4162195835 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc340199f60 con 0x7fc340103350 2024-04-25T13:43:44.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.939+0000 7fc33effd700 1 --2- 172.21.15.43:0/4162195835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc340103350 0x7fc34019f690 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc33000d950 tx=0x7fc33000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:44.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.939+0000 7fc33cff9700 1 -- 172.21.15.43:0/4162195835 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc330016070 con 0x7fc340103350 2024-04-25T13:43:44.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.939+0000 7fc345741700 1 -- 172.21.15.43:0/4162195835 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc34019a250 con 0x7fc340103350 2024-04-25T13:43:44.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.939+0000 7fc33cff9700 1 -- 172.21.15.43:0/4162195835 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc33000fd20 con 0x7fc340103350 2024-04-25T13:43:44.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.939+0000 7fc33cff9700 1 -- 172.21.15.43:0/4162195835 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33000e3b0 con 0x7fc340103350 2024-04-25T13:43:44.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.939+0000 7fc345741700 1 -- 172.21.15.43:0/4162195835 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3401a6520 con 0x7fc340103350 2024-04-25T13:43:44.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.940+0000 7fc345741700 1 -- 172.21.15.43:0/4162195835 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc340051190 con 0x7fc340103350 2024-04-25T13:43:44.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.943+0000 7fc33cff9700 1 -- 172.21.15.43:0/4162195835 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fc330019070 con 0x7fc340103350 2024-04-25T13:43:44.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.944+0000 7fc33cff9700 1 --2- 172.21.15.43:0/4162195835 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc32c0afc10 0x7fc32c0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:44.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.944+0000 7fc3367fc700 1 --2- 172.21.15.43:0/4162195835 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc32c0afc10 0x7fc32c0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:44.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.944+0000 7fc33cff9700 1 -- 172.21.15.43:0/4162195835 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fc3300debe0 con 0x7fc340103350 2024-04-25T13:43:44.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.945+0000 7fc3367fc700 1 --2- 172.21.15.43:0/4162195835 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc32c0afc10 0x7fc32c0b2120 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc3401021d0 tx=0x7fc32800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:44.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:44.947+0000 7fc33cff9700 1 -- 172.21.15.43:0/4162195835 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc3300a7300 con 0x7fc340103350 2024-04-25T13:43:45.086 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738452 got 34359738457 for osd.0 2024-04-25T13:43:45.086 DEBUG:teuthology.parallel:result is None 2024-04-25T13:43:45.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:45.177+0000 7fc345741700 1 -- 172.21.15.43:0/4162195835 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fc34010b060 con 0x7fc340103350 2024-04-25T13:43:45.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:45.178+0000 7fc33cff9700 1 -- 172.21.15.43:0/4162195835 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc3300a6c00 con 0x7fc340103350 2024-04-25T13:43:45.178 INFO:teuthology.orchestra.run.smithi043.stdout:279172874277 2024-04-25T13:43:45.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:45.180+0000 7fc345741700 1 -- 172.21.15.43:0/4162195835 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc32c0afc10 msgr2=0x7fc32c0b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:45.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:45.180+0000 7fc345741700 1 --2- 172.21.15.43:0/4162195835 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc32c0afc10 0x7fc32c0b2120 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc3401021d0 tx=0x7fc32800b410 comp rx=0 tx=0).stop 2024-04-25T13:43:45.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:45.180+0000 7fc345741700 1 -- 172.21.15.43:0/4162195835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc340103350 msgr2=0x7fc34019f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:45.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:45.180+0000 7fc345741700 1 --2- 172.21.15.43:0/4162195835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc340103350 0x7fc34019f690 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc33000d950 tx=0x7fc33000dc60 comp rx=0 tx=0).stop 2024-04-25T13:43:45.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:45.180+0000 7fc345741700 1 -- 172.21.15.43:0/4162195835 shutdown_connections 2024-04-25T13:43:45.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:45.180+0000 7fc345741700 1 --2- 172.21.15.43:0/4162195835 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc32c0afc10 0x7fc32c0b2120 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:45.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:45.180+0000 7fc345741700 1 --2- 172.21.15.43:0/4162195835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3401085d0 0x7fc3401998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:45.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:45.180+0000 7fc345741700 1 --2- 172.21.15.43:0/4162195835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc340103350 0x7fc34019f690 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:45.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:45.180+0000 7fc345741700 1 --2- 172.21.15.43:0/4162195835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc340107c80 0x7fc34019fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:45.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:45.180+0000 7fc345741700 1 -- 172.21.15.43:0/4162195835 >> 172.21.15.43:0/4162195835 conn(0x7fc3400fec30 msgr2=0x7fc340109530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:45.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:45.180+0000 7fc345741700 1 -- 172.21.15.43:0/4162195835 shutdown_connections 2024-04-25T13:43:45.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:45.180+0000 7fc345741700 1 -- 172.21.15.43:0/4162195835 wait complete. 2024-04-25T13:43:45.546 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411402 got 77309411407 for osd.2 2024-04-25T13:43:45.546 DEBUG:teuthology.parallel:result is None 2024-04-25T13:43:45.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:45 smithi043 ceph-mon[29195]: pgmap v335: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T13:43:45.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:45 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/4162195835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-25T13:43:46.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:45 smithi161 ceph-mon[32696]: pgmap v335: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T13:43:46.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:45 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/4162195835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-25T13:43:46.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:45 smithi175 ceph-mon[32649]: pgmap v335: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T13:43:46.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:45 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/4162195835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-25T13:43:46.209 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874271 got 279172874277 for osd.10 2024-04-25T13:43:46.209 DEBUG:teuthology.parallel:result is None 2024-04-25T13:43:46.209 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-25T13:43:46.209 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T13:43:46.471 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:43:46.890 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:46 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:46.890 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:46 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:46.890 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:46 smithi043 ceph-mon[29195]: pgmap v336: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:46.890 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:46 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:43:46.890 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:46 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:43:46.891 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:46 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:47.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:46 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:47.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:46 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:47.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:46 smithi161 ceph-mon[32696]: pgmap v336: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:47.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:46 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:43:47.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:46 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:43:47.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:46 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:47.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:46 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:47.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:46 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:47.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:46 smithi175 ceph-mon[32649]: pgmap v336: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:47.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:46 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:43:47.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:46 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:43:47.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:46 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' 2024-04-25T13:43:48.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.230+0000 7f25aa171700 1 -- 172.21.15.43:0/3146838826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a4103390 msgr2=0x7f25a41037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:48.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.230+0000 7f25aa171700 1 --2- 172.21.15.43:0/3146838826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a4103390 0x7f25a41037a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f25940099c0 tx=0x7f2594009cd0 comp rx=0 tx=0).stop 2024-04-25T13:43:48.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.230+0000 7f25aa171700 1 -- 172.21.15.43:0/3146838826 shutdown_connections 2024-04-25T13:43:48.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.230+0000 7f25aa171700 1 --2- 172.21.15.43:0/3146838826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a4108610 0x7f25a410ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:48.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.230+0000 7f25aa171700 1 --2- 172.21.15.43:0/3146838826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a4103390 0x7f25a41037a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:48.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.230+0000 7f25aa171700 1 --2- 172.21.15.43:0/3146838826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25a4107cc0 0x7f25a41080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:48.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.230+0000 7f25aa171700 1 -- 172.21.15.43:0/3146838826 >> 172.21.15.43:0/3146838826 conn(0x7f25a40fec90 msgr2=0x7f25a41010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:48.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.230+0000 7f25aa171700 1 -- 172.21.15.43:0/3146838826 shutdown_connections 2024-04-25T13:43:48.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.230+0000 7f25aa171700 1 -- 172.21.15.43:0/3146838826 wait complete. 2024-04-25T13:43:48.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f25aa171700 1 Processor -- start 2024-04-25T13:43:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f25aa171700 1 -- start start 2024-04-25T13:43:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f25aa171700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a4103390 0x7f25a41a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f25aa171700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a4107cc0 0x7f25a41a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f25aa171700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25a4108610 0x7f25a419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f25aa171700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f25a4113140 con 0x7f25a4107cc0 2024-04-25T13:43:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f25aa171700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f25a4112fc0 con 0x7f25a4108610 2024-04-25T13:43:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f25aa171700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f25a41132c0 con 0x7f25a4103390 2024-04-25T13:43:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f259bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a4107cc0 0x7f25a41a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f259bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a4107cc0 0x7f25a41a0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56366/0 (socket says 172.21.15.43:56366) 2024-04-25T13:43:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f259bfff700 1 -- 172.21.15.43:0/3707271568 learned_addr learned my addr 172.21.15.43:0/3707271568 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f25a37fe700 1 --2- 172.21.15.43:0/3707271568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a4103390 0x7f25a41a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f25a3fff700 1 --2- 172.21.15.43:0/3707271568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25a4108610 0x7f25a419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f259bfff700 1 -- 172.21.15.43:0/3707271568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a4103390 msgr2=0x7f25a41a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f259bfff700 1 --2- 172.21.15.43:0/3707271568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a4103390 0x7f25a41a0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f259bfff700 1 -- 172.21.15.43:0/3707271568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25a4108610 msgr2=0x7f25a419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f259bfff700 1 --2- 172.21.15.43:0/3707271568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25a4108610 0x7f25a419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.231+0000 7f259bfff700 1 -- 172.21.15.43:0/3707271568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a419b140 con 0x7f25a4107cc0 2024-04-25T13:43:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.232+0000 7f259bfff700 1 --2- 172.21.15.43:0/3707271568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a4107cc0 0x7f25a41a0db0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f258c00c8f0 tx=0x7f258c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.232+0000 7f25a17fa700 1 -- 172.21.15.43:0/3707271568 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c007b00 con 0x7f25a4107cc0 2024-04-25T13:43:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.232+0000 7f25a17fa700 1 -- 172.21.15.43:0/3707271568 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f258c007ca0 con 0x7f25a4107cc0 2024-04-25T13:43:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.232+0000 7f25aa171700 1 -- 172.21.15.43:0/3707271568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a419b430 con 0x7f25a4107cc0 2024-04-25T13:43:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.232+0000 7f25a17fa700 1 -- 172.21.15.43:0/3707271568 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c018660 con 0x7f25a4107cc0 2024-04-25T13:43:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.232+0000 7f25aa171700 1 -- 172.21.15.43:0/3707271568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a41a7700 con 0x7f25a4107cc0 2024-04-25T13:43:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.233+0000 7f25aa171700 1 -- 172.21.15.43:0/3707271568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a4051190 con 0x7f25a4107cc0 2024-04-25T13:43:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.235+0000 7f25a17fa700 1 -- 172.21.15.43:0/3707271568 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f258c00f450 con 0x7f25a4107cc0 2024-04-25T13:43:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.235+0000 7f25a17fa700 1 --2- 172.21.15.43:0/3707271568 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f25900afc10 0x7f25900b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.235+0000 7f25a37fe700 1 --2- 172.21.15.43:0/3707271568 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f25900afc10 0x7f25900b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.235+0000 7f25a17fa700 1 -- 172.21.15.43:0/3707271568 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f258c0df230 con 0x7f25a4107cc0 2024-04-25T13:43:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.236+0000 7f25a37fe700 1 --2- 172.21.15.43:0/3707271568 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f25900afc10 0x7f25900b2120 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f25a419bbd0 tx=0x7f2594005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:48.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.239+0000 7f25a17fa700 1 -- 172.21.15.43:0/3707271568 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f258c014030 con 0x7f25a4107cc0 2024-04-25T13:43:48.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.440+0000 7f25aa171700 1 -- 172.21.15.43:0/3707271568 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f25a4063ad0 con 0x7f25900afc10 2024-04-25T13:43:48.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.450+0000 7f25a17fa700 1 -- 172.21.15.43:0/3707271568 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340335 (secure 0 0 0) 0x7f25a4063ad0 con 0x7f25900afc10 2024-04-25T13:43:48.455 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:43:48.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.454+0000 7f25aa171700 1 -- 172.21.15.43:0/3707271568 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f25900afc10 msgr2=0x7f25900b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:48.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.454+0000 7f25aa171700 1 --2- 172.21.15.43:0/3707271568 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f25900afc10 0x7f25900b2120 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f25a419bbd0 tx=0x7f2594005fb0 comp rx=0 tx=0).stop 2024-04-25T13:43:48.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.454+0000 7f25aa171700 1 -- 172.21.15.43:0/3707271568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a4107cc0 msgr2=0x7f25a41a0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:48.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.454+0000 7f25aa171700 1 --2- 172.21.15.43:0/3707271568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a4107cc0 0x7f25a41a0db0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f258c00c8f0 tx=0x7f258c00ccb0 comp rx=0 tx=0).stop 2024-04-25T13:43:48.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.454+0000 7f25aa171700 1 -- 172.21.15.43:0/3707271568 shutdown_connections 2024-04-25T13:43:48.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.454+0000 7f25aa171700 1 --2- 172.21.15.43:0/3707271568 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f25900afc10 0x7f25900b2120 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:48.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.454+0000 7f25aa171700 1 --2- 172.21.15.43:0/3707271568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25a4108610 0x7f25a419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:48.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.454+0000 7f25aa171700 1 --2- 172.21.15.43:0/3707271568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a4103390 0x7f25a41a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:48.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.454+0000 7f25aa171700 1 --2- 172.21.15.43:0/3707271568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a4107cc0 0x7f25a41a0db0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:48.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.454+0000 7f25aa171700 1 -- 172.21.15.43:0/3707271568 >> 172.21.15.43:0/3707271568 conn(0x7f25a40fec90 msgr2=0x7f25a406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:48.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.454+0000 7f25aa171700 1 -- 172.21.15.43:0/3707271568 shutdown_connections 2024-04-25T13:43:48.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:48.454+0000 7f25aa171700 1 -- 172.21.15.43:0/3707271568 wait complete. 2024-04-25T13:43:48.460 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T13:43:49.178 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-04-25T13:43:47.959158+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656936,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":518,"num_read_kb":362,"num_write":285,"num_write_kb":2268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":3013534,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387016,"kb_used_data":12848,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554808,"statfs":{"total":1151940427776,"available":1151544123392,"internally_reserved":0,"allocated":13156352,"data_stored":7336118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003553"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.195494+0000","last_change":"2024-04-25T13:42:09.059038+0000","last_active":"2024-04-25T13:42:59.195494+0000","last_peered":"2024-04-25T13:42:59.195494+0000","last_clean":"2024-04-25T13:42:59.195494+0000","last_became_active":"2024-04-25T13:42:09.058719+0000","last_became_peered":"2024-04-25T13:42:09.058719+0000","last_unstale":"2024-04-25T13:42:59.195494+0000","last_undegraded":"2024-04-25T13:42:59.195494+0000","last_fullsized":"2024-04-25T13:42:59.195494+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:44.573718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199683+0000","last_change":"2024-04-25T13:42:09.057862+0000","last_active":"2024-04-25T13:42:59.199683+0000","last_peered":"2024-04-25T13:42:59.199683+0000","last_clean":"2024-04-25T13:42:59.199683+0000","last_became_active":"2024-04-25T13:42:09.057511+0000","last_became_peered":"2024-04-25T13:42:09.057511+0000","last_unstale":"2024-04-25T13:42:59.199683+0000","last_undegraded":"2024-04-25T13:42:59.199683+0000","last_fullsized":"2024-04-25T13:42:59.199683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:20.911339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199067+0000","last_change":"2024-04-25T13:42:09.060432+0000","last_active":"2024-04-25T13:42:59.199067+0000","last_peered":"2024-04-25T13:42:59.199067+0000","last_clean":"2024-04-25T13:42:59.199067+0000","last_became_active":"2024-04-25T13:42:09.060081+0000","last_became_peered":"2024-04-25T13:42:09.060081+0000","last_unstale":"2024-04-25T13:42:59.199067+0000","last_undegraded":"2024-04-25T13:42:59.199067+0000","last_fullsized":"2024-04-25T13:42:59.199067+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:50.008694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.248673+0000","last_change":"2024-04-25T13:42:09.040319+0000","last_active":"2024-04-25T13:42:59.248673+0000","last_peered":"2024-04-25T13:42:59.248673+0000","last_clean":"2024-04-25T13:42:59.248673+0000","last_became_active":"2024-04-25T13:42:09.039949+0000","last_became_peered":"2024-04-25T13:42:09.039949+0000","last_unstale":"2024-04-25T13:42:59.248673+0000","last_undegraded":"2024-04-25T13:42:59.248673+0000","last_fullsized":"2024-04-25T13:42:59.248673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:03.242055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.195843+0000","last_change":"2024-04-25T13:42:09.040642+0000","last_active":"2024-04-25T13:42:59.195843+0000","last_peered":"2024-04-25T13:42:59.195843+0000","last_clean":"2024-04-25T13:42:59.195843+0000","last_became_active":"2024-04-25T13:42:09.039339+0000","last_became_peered":"2024-04-25T13:42:09.039339+0000","last_unstale":"2024-04-25T13:42:59.195843+0000","last_undegraded":"2024-04-25T13:42:59.195843+0000","last_fullsized":"2024-04-25T13:42:59.195843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:50.216939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.196561+0000","last_change":"2024-04-25T13:42:09.034848+0000","last_active":"2024-04-25T13:42:59.196561+0000","last_peered":"2024-04-25T13:42:59.196561+0000","last_clean":"2024-04-25T13:42:59.196561+0000","last_became_active":"2024-04-25T13:42:09.034452+0000","last_became_peered":"2024-04-25T13:42:09.034452+0000","last_unstale":"2024-04-25T13:42:59.196561+0000","last_undegraded":"2024-04-25T13:42:59.196561+0000","last_fullsized":"2024-04-25T13:42:59.196561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:45.963322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.201711+0000","last_change":"2024-04-25T13:42:09.054656+0000","last_active":"2024-04-25T13:42:59.201711+0000","last_peered":"2024-04-25T13:42:59.201711+0000","last_clean":"2024-04-25T13:42:59.201711+0000","last_became_active":"2024-04-25T13:42:09.054276+0000","last_became_peered":"2024-04-25T13:42:09.054276+0000","last_unstale":"2024-04-25T13:42:59.201711+0000","last_undegraded":"2024-04-25T13:42:59.201711+0000","last_fullsized":"2024-04-25T13:42:59.201711+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:19.818362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747133+0000","last_change":"2024-04-25T13:42:09.054227+0000","last_active":"2024-04-25T13:42:59.747133+0000","last_peered":"2024-04-25T13:42:59.747133+0000","last_clean":"2024-04-25T13:42:59.747133+0000","last_became_active":"2024-04-25T13:42:09.051893+0000","last_became_peered":"2024-04-25T13:42:09.051893+0000","last_unstale":"2024-04-25T13:42:59.747133+0000","last_undegraded":"2024-04-25T13:42:59.747133+0000","last_fullsized":"2024-04-25T13:42:59.747133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:37.120057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198612+0000","last_change":"2024-04-25T13:42:09.039618+0000","last_active":"2024-04-25T13:42:59.198612+0000","last_peered":"2024-04-25T13:42:59.198612+0000","last_clean":"2024-04-25T13:42:59.198612+0000","last_became_active":"2024-04-25T13:42:09.039264+0000","last_became_peered":"2024-04-25T13:42:09.039264+0000","last_unstale":"2024-04-25T13:42:59.198612+0000","last_undegraded":"2024-04-25T13:42:59.198612+0000","last_fullsized":"2024-04-25T13:42:59.198612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:50.352365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197468+0000","last_change":"2024-04-25T13:42:09.037323+0000","last_active":"2024-04-25T13:42:59.197468+0000","last_peered":"2024-04-25T13:42:59.197468+0000","last_clean":"2024-04-25T13:42:59.197468+0000","last_became_active":"2024-04-25T13:42:09.036614+0000","last_became_peered":"2024-04-25T13:42:09.036614+0000","last_unstale":"2024-04-25T13:42:59.197468+0000","last_undegraded":"2024-04-25T13:42:59.197468+0000","last_fullsized":"2024-04-25T13:42:59.197468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:09.872287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202545+0000","last_change":"2024-04-25T13:42:09.056812+0000","last_active":"2024-04-25T13:42:59.202545+0000","last_peered":"2024-04-25T13:42:59.202545+0000","last_clean":"2024-04-25T13:42:59.202545+0000","last_became_active":"2024-04-25T13:42:09.054990+0000","last_became_peered":"2024-04-25T13:42:09.054990+0000","last_unstale":"2024-04-25T13:42:59.202545+0000","last_undegraded":"2024-04-25T13:42:59.202545+0000","last_fullsized":"2024-04-25T13:42:59.202545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:30.855059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.203368+0000","last_change":"2024-04-25T13:42:59.202829+0000","last_active":"2024-04-25T13:42:59.203368+0000","last_peered":"2024-04-25T13:42:59.203368+0000","last_clean":"2024-04-25T13:42:59.203368+0000","last_became_active":"2024-04-25T13:42:59.202386+0000","last_became_peered":"2024-04-25T13:42:59.202386+0000","last_unstale":"2024-04-25T13:42:59.203368+0000","last_undegraded":"2024-04-25T13:42:59.203368+0000","last_fullsized":"2024-04-25T13:42:59.203368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:47.195497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193443+0000","last_change":"2024-04-25T13:42:09.043105+0000","last_active":"2024-04-25T13:42:59.193443+0000","last_peered":"2024-04-25T13:42:59.193443+0000","last_clean":"2024-04-25T13:42:59.193443+0000","last_became_active":"2024-04-25T13:42:09.042457+0000","last_became_peered":"2024-04-25T13:42:09.042457+0000","last_unstale":"2024-04-25T13:42:59.193443+0000","last_undegraded":"2024-04-25T13:42:59.193443+0000","last_fullsized":"2024-04-25T13:42:59.193443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:58.924985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198422+0000","last_change":"2024-04-25T13:42:09.046658+0000","last_active":"2024-04-25T13:42:59.198422+0000","last_peered":"2024-04-25T13:42:59.198422+0000","last_clean":"2024-04-25T13:42:59.198422+0000","last_became_active":"2024-04-25T13:42:09.046323+0000","last_became_peered":"2024-04-25T13:42:09.046323+0000","last_unstale":"2024-04-25T13:42:59.198422+0000","last_undegraded":"2024-04-25T13:42:59.198422+0000","last_fullsized":"2024-04-25T13:42:59.198422+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:51.362734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198164+0000","last_change":"2024-04-25T13:42:09.049787+0000","last_active":"2024-04-25T13:42:59.198164+0000","last_peered":"2024-04-25T13:42:59.198164+0000","last_clean":"2024-04-25T13:42:59.198164+0000","last_became_active":"2024-04-25T13:42:09.049432+0000","last_became_peered":"2024-04-25T13:42:09.049432+0000","last_unstale":"2024-04-25T13:42:59.198164+0000","last_undegraded":"2024-04-25T13:42:59.198164+0000","last_fullsized":"2024-04-25T13:42:59.198164+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:23.507471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197077+0000","last_change":"2024-04-25T13:42:09.060318+0000","last_active":"2024-04-25T13:42:59.197077+0000","last_peered":"2024-04-25T13:42:59.197077+0000","last_clean":"2024-04-25T13:42:59.197077+0000","last_became_active":"2024-04-25T13:42:09.059948+0000","last_became_peered":"2024-04-25T13:42:09.059948+0000","last_unstale":"2024-04-25T13:42:59.197077+0000","last_undegraded":"2024-04-25T13:42:59.197077+0000","last_fullsized":"2024-04-25T13:42:59.197077+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:10.840181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.194982+0000","last_change":"2024-04-25T13:42:09.060432+0000","last_active":"2024-04-25T13:42:59.194982+0000","last_peered":"2024-04-25T13:42:59.194982+0000","last_clean":"2024-04-25T13:42:59.194982+0000","last_became_active":"2024-04-25T13:42:09.059525+0000","last_became_peered":"2024-04-25T13:42:09.059525+0000","last_unstale":"2024-04-25T13:42:59.194982+0000","last_undegraded":"2024-04-25T13:42:59.194982+0000","last_fullsized":"2024-04-25T13:42:59.194982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:46:41.360324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.200334+0000","last_change":"2024-04-25T13:42:09.035591+0000","last_active":"2024-04-25T13:42:59.200334+0000","last_peered":"2024-04-25T13:42:59.200334+0000","last_clean":"2024-04-25T13:42:59.200334+0000","last_became_active":"2024-04-25T13:42:09.035219+0000","last_became_peered":"2024-04-25T13:42:09.035219+0000","last_unstale":"2024-04-25T13:42:59.200334+0000","last_undegraded":"2024-04-25T13:42:59.200334+0000","last_fullsized":"2024-04-25T13:42:59.200334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:35:04.362044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.204803+0000","last_change":"2024-04-25T13:42:09.057623+0000","last_active":"2024-04-25T13:42:59.204803+0000","last_peered":"2024-04-25T13:42:59.204803+0000","last_clean":"2024-04-25T13:42:59.204803+0000","last_became_active":"2024-04-25T13:42:09.057276+0000","last_became_peered":"2024-04-25T13:42:09.057276+0000","last_unstale":"2024-04-25T13:42:59.204803+0000","last_undegraded":"2024-04-25T13:42:59.204803+0000","last_fullsized":"2024-04-25T13:42:59.204803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:28.975079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.204270+0000","last_change":"2024-04-25T13:42:13.081052+0000","last_active":"2024-04-25T13:42:59.204270+0000","last_peered":"2024-04-25T13:42:59.204270+0000","last_clean":"2024-04-25T13:42:59.204270+0000","last_became_active":"2024-04-25T13:42:13.080546+0000","last_became_peered":"2024-04-25T13:42:13.080546+0000","last_unstale":"2024-04-25T13:42:59.204270+0000","last_undegraded":"2024-04-25T13:42:59.204270+0000","last_fullsized":"2024-04-25T13:42:59.204270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:59.648007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.200762+0000","last_change":"2024-04-25T13:42:08.040591+0000","last_active":"2024-04-25T13:42:59.200762+0000","last_peered":"2024-04-25T13:42:59.200762+0000","last_clean":"2024-04-25T13:42:59.200762+0000","last_became_active":"2024-04-25T13:42:08.040221+0000","last_became_peered":"2024-04-25T13:42:08.040221+0000","last_unstale":"2024-04-25T13:42:59.200762+0000","last_undegraded":"2024-04-25T13:42:59.200762+0000","last_fullsized":"2024-04-25T13:42:59.200762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:09.755426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747515+0000","last_change":"2024-04-25T13:42:09.061907+0000","last_active":"2024-04-25T13:42:59.747515+0000","last_peered":"2024-04-25T13:42:59.747515+0000","last_clean":"2024-04-25T13:42:59.747515+0000","last_became_active":"2024-04-25T13:42:09.061520+0000","last_became_peered":"2024-04-25T13:42:09.061520+0000","last_unstale":"2024-04-25T13:42:59.747515+0000","last_undegraded":"2024-04-25T13:42:59.747515+0000","last_fullsized":"2024-04-25T13:42:59.747515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:45.549889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.247901+0000","last_change":"2024-04-25T13:42:13.080709+0000","last_active":"2024-04-25T13:42:59.247901+0000","last_peered":"2024-04-25T13:42:59.247901+0000","last_clean":"2024-04-25T13:42:59.247901+0000","last_became_active":"2024-04-25T13:42:13.080234+0000","last_became_peered":"2024-04-25T13:42:13.080234+0000","last_unstale":"2024-04-25T13:42:59.247901+0000","last_undegraded":"2024-04-25T13:42:59.247901+0000","last_fullsized":"2024-04-25T13:42:59.247901+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:29.231166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747792+0000","last_change":"2024-04-25T13:42:08.044450+0000","last_active":"2024-04-25T13:42:59.747792+0000","last_peered":"2024-04-25T13:42:59.747792+0000","last_clean":"2024-04-25T13:42:59.747792+0000","last_became_active":"2024-04-25T13:42:08.043674+0000","last_became_peered":"2024-04-25T13:42:08.043674+0000","last_unstale":"2024-04-25T13:42:59.747792+0000","last_undegraded":"2024-04-25T13:42:59.747792+0000","last_fullsized":"2024-04-25T13:42:59.747792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:12.784756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199916+0000","last_change":"2024-04-25T13:42:09.060369+0000","last_active":"2024-04-25T13:42:59.199916+0000","last_peered":"2024-04-25T13:42:59.199916+0000","last_clean":"2024-04-25T13:42:59.199916+0000","last_became_active":"2024-04-25T13:42:09.060002+0000","last_became_peered":"2024-04-25T13:42:09.060002+0000","last_unstale":"2024-04-25T13:42:59.199916+0000","last_undegraded":"2024-04-25T13:42:59.199916+0000","last_fullsized":"2024-04-25T13:42:59.199916+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:26.601583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.248401+0000","last_change":"2024-04-25T13:42:13.083165+0000","last_active":"2024-04-25T13:42:59.248401+0000","last_peered":"2024-04-25T13:42:59.248401+0000","last_clean":"2024-04-25T13:42:59.248401+0000","last_became_active":"2024-04-25T13:42:13.082767+0000","last_became_peered":"2024-04-25T13:42:13.082767+0000","last_unstale":"2024-04-25T13:42:59.248401+0000","last_undegraded":"2024-04-25T13:42:59.248401+0000","last_fullsized":"2024-04-25T13:42:59.248401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:35.559831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198093+0000","last_change":"2024-04-25T13:42:08.041789+0000","last_active":"2024-04-25T13:42:59.198093+0000","last_peered":"2024-04-25T13:42:59.198093+0000","last_clean":"2024-04-25T13:42:59.198093+0000","last_became_active":"2024-04-25T13:42:08.041371+0000","last_became_peered":"2024-04-25T13:42:08.041371+0000","last_unstale":"2024-04-25T13:42:59.198093+0000","last_undegraded":"2024-04-25T13:42:59.198093+0000","last_fullsized":"2024-04-25T13:42:59.198093+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:33.748758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198430+0000","last_change":"2024-04-25T13:42:09.045209+0000","last_active":"2024-04-25T13:42:59.198430+0000","last_peered":"2024-04-25T13:42:59.198430+0000","last_clean":"2024-04-25T13:42:59.198430+0000","last_became_active":"2024-04-25T13:42:09.044750+0000","last_became_peered":"2024-04-25T13:42:09.044750+0000","last_unstale":"2024-04-25T13:42:59.198430+0000","last_undegraded":"2024-04-25T13:42:59.198430+0000","last_fullsized":"2024-04-25T13:42:59.198430+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:03.279395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.247871+0000","last_change":"2024-04-25T13:42:13.083154+0000","last_active":"2024-04-25T13:42:59.247871+0000","last_peered":"2024-04-25T13:42:59.247871+0000","last_clean":"2024-04-25T13:42:59.247871+0000","last_became_active":"2024-04-25T13:42:13.082679+0000","last_became_peered":"2024-04-25T13:42:13.082679+0000","last_unstale":"2024-04-25T13:42:59.247871+0000","last_undegraded":"2024-04-25T13:42:59.247871+0000","last_fullsized":"2024-04-25T13:42:59.247871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:14.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.209147+0000","last_change":"2024-04-25T13:42:59.208488+0000","last_active":"2024-04-25T13:42:59.209147+0000","last_peered":"2024-04-25T13:42:59.209147+0000","last_clean":"2024-04-25T13:42:59.209147+0000","last_became_active":"2024-04-25T13:42:59.203828+0000","last_became_peered":"2024-04-25T13:42:59.203828+0000","last_unstale":"2024-04-25T13:42:59.209147+0000","last_undegraded":"2024-04-25T13:42:59.209147+0000","last_fullsized":"2024-04-25T13:42:59.209147+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:22.094449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198912+0000","last_change":"2024-04-25T13:42:09.038159+0000","last_active":"2024-04-25T13:42:59.198912+0000","last_peered":"2024-04-25T13:42:59.198912+0000","last_clean":"2024-04-25T13:42:59.198912+0000","last_became_active":"2024-04-25T13:42:09.037702+0000","last_became_peered":"2024-04-25T13:42:09.037702+0000","last_unstale":"2024-04-25T13:42:59.198912+0000","last_undegraded":"2024-04-25T13:42:59.198912+0000","last_fullsized":"2024-04-25T13:42:59.198912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:44.856392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.204632+0000","last_change":"2024-04-25T13:42:13.074307+0000","last_active":"2024-04-25T13:42:59.204632+0000","last_peered":"2024-04-25T13:42:59.204632+0000","last_clean":"2024-04-25T13:42:59.204632+0000","last_became_active":"2024-04-25T13:42:13.073665+0000","last_became_peered":"2024-04-25T13:42:13.073665+0000","last_unstale":"2024-04-25T13:42:59.204632+0000","last_undegraded":"2024-04-25T13:42:59.204632+0000","last_fullsized":"2024-04-25T13:42:59.204632+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:24.652912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":116,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:43:43.276571+0000","last_change":"2024-04-25T13:42:59.212984+0000","last_active":"2024-04-25T13:43:43.276571+0000","last_peered":"2024-04-25T13:43:43.276571+0000","last_clean":"2024-04-25T13:43:43.276571+0000","last_became_active":"2024-04-25T13:42:59.205743+0000","last_became_peered":"2024-04-25T13:42:59.205743+0000","last_unstale":"2024-04-25T13:43:43.276571+0000","last_undegraded":"2024-04-25T13:43:43.276571+0000","last_fullsized":"2024-04-25T13:43:43.276571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:51.023051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.196528+0000","last_change":"2024-04-25T13:42:09.037183+0000","last_active":"2024-04-25T13:42:59.196528+0000","last_peered":"2024-04-25T13:42:59.196528+0000","last_clean":"2024-04-25T13:42:59.196528+0000","last_became_active":"2024-04-25T13:42:09.036778+0000","last_became_peered":"2024-04-25T13:42:09.036778+0000","last_unstale":"2024-04-25T13:42:59.196528+0000","last_undegraded":"2024-04-25T13:42:59.196528+0000","last_fullsized":"2024-04-25T13:42:59.196528+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:24:20.009326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.210633+0000","last_change":"2024-04-25T13:42:59.210633+0000","last_active":"2024-04-25T13:42:59.210633+0000","last_peered":"2024-04-25T13:42:59.210633+0000","last_clean":"2024-04-25T13:42:59.210633+0000","last_became_active":"2024-04-25T13:42:59.210053+0000","last_became_peered":"2024-04-25T13:42:59.210053+0000","last_unstale":"2024-04-25T13:42:59.210633+0000","last_undegraded":"2024-04-25T13:42:59.210633+0000","last_fullsized":"2024-04-25T13:42:59.210633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:08:28.115422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.196692+0000","last_change":"2024-04-25T13:42:08.037902+0000","last_active":"2024-04-25T13:42:59.196692+0000","last_peered":"2024-04-25T13:42:59.196692+0000","last_clean":"2024-04-25T13:42:59.196692+0000","last_became_active":"2024-04-25T13:42:08.037284+0000","last_became_peered":"2024-04-25T13:42:08.037284+0000","last_unstale":"2024-04-25T13:42:59.196692+0000","last_undegraded":"2024-04-25T13:42:59.196692+0000","last_fullsized":"2024-04-25T13:42:59.196692+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:10.374637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198884+0000","last_change":"2024-04-25T13:42:09.057856+0000","last_active":"2024-04-25T13:42:59.198884+0000","last_peered":"2024-04-25T13:42:59.198884+0000","last_clean":"2024-04-25T13:42:59.198884+0000","last_became_active":"2024-04-25T13:42:09.057464+0000","last_became_peered":"2024-04-25T13:42:09.057464+0000","last_unstale":"2024-04-25T13:42:59.198884+0000","last_undegraded":"2024-04-25T13:42:59.198884+0000","last_fullsized":"2024-04-25T13:42:59.198884+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:03.403058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.249824+0000","last_change":"2024-04-25T13:42:59.249824+0000","last_active":"2024-04-25T13:42:59.249824+0000","last_peered":"2024-04-25T13:42:59.249824+0000","last_clean":"2024-04-25T13:42:59.249824+0000","last_became_active":"2024-04-25T13:42:59.249260+0000","last_became_peered":"2024-04-25T13:42:59.249260+0000","last_unstale":"2024-04-25T13:42:59.249824+0000","last_undegraded":"2024-04-25T13:42:59.249824+0000","last_fullsized":"2024-04-25T13:42:59.249824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:41.905531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193193+0000","last_change":"2024-04-25T13:42:08.030750+0000","last_active":"2024-04-25T13:42:59.193193+0000","last_peered":"2024-04-25T13:42:59.193193+0000","last_clean":"2024-04-25T13:42:59.193193+0000","last_became_active":"2024-04-25T13:42:08.030353+0000","last_became_peered":"2024-04-25T13:42:08.030353+0000","last_unstale":"2024-04-25T13:42:59.193193+0000","last_undegraded":"2024-04-25T13:42:59.193193+0000","last_fullsized":"2024-04-25T13:42:59.193193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:11.658589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747263+0000","last_change":"2024-04-25T13:42:09.048800+0000","last_active":"2024-04-25T13:42:59.747263+0000","last_peered":"2024-04-25T13:42:59.747263+0000","last_clean":"2024-04-25T13:42:59.747263+0000","last_became_active":"2024-04-25T13:42:09.047777+0000","last_became_peered":"2024-04-25T13:42:09.047777+0000","last_unstale":"2024-04-25T13:42:59.747263+0000","last_undegraded":"2024-04-25T13:42:59.747263+0000","last_fullsized":"2024-04-25T13:42:59.747263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:44.739359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.200798+0000","last_change":"2024-04-25T13:42:13.073583+0000","last_active":"2024-04-25T13:42:59.200798+0000","last_peered":"2024-04-25T13:42:59.200798+0000","last_clean":"2024-04-25T13:42:59.200798+0000","last_became_active":"2024-04-25T13:42:13.073154+0000","last_became_peered":"2024-04-25T13:42:13.073154+0000","last_unstale":"2024-04-25T13:42:59.200798+0000","last_undegraded":"2024-04-25T13:42:59.200798+0000","last_fullsized":"2024-04-25T13:42:59.200798+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:42.720347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199352+0000","last_change":"2024-04-25T13:42:08.035263+0000","last_active":"2024-04-25T13:42:59.199352+0000","last_peered":"2024-04-25T13:42:59.199352+0000","last_clean":"2024-04-25T13:42:59.199352+0000","last_became_active":"2024-04-25T13:42:08.034903+0000","last_became_peered":"2024-04-25T13:42:08.034903+0000","last_unstale":"2024-04-25T13:42:59.199352+0000","last_undegraded":"2024-04-25T13:42:59.199352+0000","last_fullsized":"2024-04-25T13:42:59.199352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:22.715159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199169+0000","last_change":"2024-04-25T13:42:09.037640+0000","last_active":"2024-04-25T13:42:59.199169+0000","last_peered":"2024-04-25T13:42:59.199169+0000","last_clean":"2024-04-25T13:42:59.199169+0000","last_became_active":"2024-04-25T13:42:09.037286+0000","last_became_peered":"2024-04-25T13:42:09.037286+0000","last_unstale":"2024-04-25T13:42:59.199169+0000","last_undegraded":"2024-04-25T13:42:59.199169+0000","last_fullsized":"2024-04-25T13:42:59.199169+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:28.704489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747124+0000","last_change":"2024-04-25T13:42:13.079379+0000","last_active":"2024-04-25T13:42:59.747124+0000","last_peered":"2024-04-25T13:42:59.747124+0000","last_clean":"2024-04-25T13:42:59.747124+0000","last_became_active":"2024-04-25T13:42:13.078771+0000","last_became_peered":"2024-04-25T13:42:13.078771+0000","last_unstale":"2024-04-25T13:42:59.747124+0000","last_undegraded":"2024-04-25T13:42:59.747124+0000","last_fullsized":"2024-04-25T13:42:59.747124+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:35.955154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:43:44.277345+0000","last_change":"2024-04-25T13:42:08.032562+0000","last_active":"2024-04-25T13:43:44.277345+0000","last_peered":"2024-04-25T13:43:44.277345+0000","last_clean":"2024-04-25T13:43:44.277345+0000","last_became_active":"2024-04-25T13:42:08.032090+0000","last_became_peered":"2024-04-25T13:42:08.032090+0000","last_unstale":"2024-04-25T13:43:44.277345+0000","last_undegraded":"2024-04-25T13:43:44.277345+0000","last_fullsized":"2024-04-25T13:43:44.277345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:13:52.822642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198524+0000","last_change":"2024-04-25T13:42:09.041724+0000","last_active":"2024-04-25T13:42:59.198524+0000","last_peered":"2024-04-25T13:42:59.198524+0000","last_clean":"2024-04-25T13:42:59.198524+0000","last_became_active":"2024-04-25T13:42:09.041386+0000","last_became_peered":"2024-04-25T13:42:09.041386+0000","last_unstale":"2024-04-25T13:42:59.198524+0000","last_undegraded":"2024-04-25T13:42:59.198524+0000","last_fullsized":"2024-04-25T13:42:59.198524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:29.676814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198593+0000","last_change":"2024-04-25T13:42:13.075365+0000","last_active":"2024-04-25T13:42:59.198593+0000","last_peered":"2024-04-25T13:42:59.198593+0000","last_clean":"2024-04-25T13:42:59.198593+0000","last_became_active":"2024-04-25T13:42:13.074886+0000","last_became_peered":"2024-04-25T13:42:13.074886+0000","last_unstale":"2024-04-25T13:42:59.198593+0000","last_undegraded":"2024-04-25T13:42:59.198593+0000","last_fullsized":"2024-04-25T13:42:59.198593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:30.647002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202816+0000","last_change":"2024-04-25T13:42:08.036830+0000","last_active":"2024-04-25T13:42:59.202816+0000","last_peered":"2024-04-25T13:42:59.202816+0000","last_clean":"2024-04-25T13:42:59.202816+0000","last_became_active":"2024-04-25T13:42:08.036418+0000","last_became_peered":"2024-04-25T13:42:08.036418+0000","last_unstale":"2024-04-25T13:42:59.202816+0000","last_undegraded":"2024-04-25T13:42:59.202816+0000","last_fullsized":"2024-04-25T13:42:59.202816+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:06.402677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199790+0000","last_change":"2024-04-25T13:42:09.063305+0000","last_active":"2024-04-25T13:42:59.199790+0000","last_peered":"2024-04-25T13:42:59.199790+0000","last_clean":"2024-04-25T13:42:59.199790+0000","last_became_active":"2024-04-25T13:42:09.062961+0000","last_became_peered":"2024-04-25T13:42:09.062961+0000","last_unstale":"2024-04-25T13:42:59.199790+0000","last_undegraded":"2024-04-25T13:42:59.199790+0000","last_fullsized":"2024-04-25T13:42:59.199790+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:34.653515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.248331+0000","last_change":"2024-04-25T13:42:13.073271+0000","last_active":"2024-04-25T13:42:59.248331+0000","last_peered":"2024-04-25T13:42:59.248331+0000","last_clean":"2024-04-25T13:42:59.248331+0000","last_became_active":"2024-04-25T13:42:13.072800+0000","last_became_peered":"2024-04-25T13:42:13.072800+0000","last_unstale":"2024-04-25T13:42:59.248331+0000","last_undegraded":"2024-04-25T13:42:59.248331+0000","last_fullsized":"2024-04-25T13:42:59.248331+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:40.115311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197611+0000","last_change":"2024-04-25T13:42:08.032607+0000","last_active":"2024-04-25T13:42:59.197611+0000","last_peered":"2024-04-25T13:42:59.197611+0000","last_clean":"2024-04-25T13:42:59.197611+0000","last_became_active":"2024-04-25T13:42:08.031474+0000","last_became_peered":"2024-04-25T13:42:08.031474+0000","last_unstale":"2024-04-25T13:42:59.197611+0000","last_undegraded":"2024-04-25T13:42:59.197611+0000","last_fullsized":"2024-04-25T13:42:59.197611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:02:37.648480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198585+0000","last_change":"2024-04-25T13:42:09.043148+0000","last_active":"2024-04-25T13:42:59.198585+0000","last_peered":"2024-04-25T13:42:59.198585+0000","last_clean":"2024-04-25T13:42:59.198585+0000","last_became_active":"2024-04-25T13:42:09.042787+0000","last_became_peered":"2024-04-25T13:42:09.042787+0000","last_unstale":"2024-04-25T13:42:59.198585+0000","last_undegraded":"2024-04-25T13:42:59.198585+0000","last_fullsized":"2024-04-25T13:42:59.198585+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:29.318123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198914+0000","last_change":"2024-04-25T13:42:13.076116+0000","last_active":"2024-04-25T13:42:59.198914+0000","last_peered":"2024-04-25T13:42:59.198914+0000","last_clean":"2024-04-25T13:42:59.198914+0000","last_became_active":"2024-04-25T13:42:13.075592+0000","last_became_peered":"2024-04-25T13:42:13.075592+0000","last_unstale":"2024-04-25T13:42:59.198914+0000","last_undegraded":"2024-04-25T13:42:59.198914+0000","last_fullsized":"2024-04-25T13:42:59.198914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:06.496966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":227,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:43:45.326892+0000","last_change":"2024-04-25T13:42:59.257852+0000","last_active":"2024-04-25T13:43:45.326892+0000","last_peered":"2024-04-25T13:43:45.326892+0000","last_clean":"2024-04-25T13:43:45.326892+0000","last_became_active":"2024-04-25T13:42:59.250778+0000","last_became_peered":"2024-04-25T13:42:59.250778+0000","last_unstale":"2024-04-25T13:43:45.326892+0000","last_undegraded":"2024-04-25T13:43:45.326892+0000","last_fullsized":"2024-04-25T13:43:45.326892+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:03.171663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62333,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":35,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":60681,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197936+0000","last_change":"2024-04-25T13:42:09.052062+0000","last_active":"2024-04-25T13:42:59.197936+0000","last_peered":"2024-04-25T13:42:59.197936+0000","last_clean":"2024-04-25T13:42:59.197936+0000","last_became_active":"2024-04-25T13:42:09.051642+0000","last_became_peered":"2024-04-25T13:42:09.051642+0000","last_unstale":"2024-04-25T13:42:59.197936+0000","last_undegraded":"2024-04-25T13:42:59.197936+0000","last_fullsized":"2024-04-25T13:42:59.197936+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:31.228502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199278+0000","last_change":"2024-04-25T13:42:13.083232+0000","last_active":"2024-04-25T13:42:59.199278+0000","last_peered":"2024-04-25T13:42:59.199278+0000","last_clean":"2024-04-25T13:42:59.199278+0000","last_became_active":"2024-04-25T13:42:13.082708+0000","last_became_peered":"2024-04-25T13:42:13.082708+0000","last_unstale":"2024-04-25T13:42:59.199278+0000","last_undegraded":"2024-04-25T13:42:59.199278+0000","last_fullsized":"2024-04-25T13:42:59.199278+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:07.302207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.204358+0000","last_change":"2024-04-25T13:42:08.043775+0000","last_active":"2024-04-25T13:42:59.204358+0000","last_peered":"2024-04-25T13:42:59.204358+0000","last_clean":"2024-04-25T13:42:59.204358+0000","last_became_active":"2024-04-25T13:42:08.043399+0000","last_became_peered":"2024-04-25T13:42:08.043399+0000","last_unstale":"2024-04-25T13:42:59.204358+0000","last_undegraded":"2024-04-25T13:42:59.204358+0000","last_fullsized":"2024-04-25T13:42:59.204358+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:41.768248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193223+0000","last_change":"2024-04-25T13:42:09.051145+0000","last_active":"2024-04-25T13:42:59.193223+0000","last_peered":"2024-04-25T13:42:59.193223+0000","last_clean":"2024-04-25T13:42:59.193223+0000","last_became_active":"2024-04-25T13:42:09.050796+0000","last_became_peered":"2024-04-25T13:42:09.050796+0000","last_unstale":"2024-04-25T13:42:59.193223+0000","last_undegraded":"2024-04-25T13:42:59.193223+0000","last_fullsized":"2024-04-25T13:42:59.193223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:37.195227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.194562+0000","last_change":"2024-04-25T13:42:13.079728+0000","last_active":"2024-04-25T13:42:59.194562+0000","last_peered":"2024-04-25T13:42:59.194562+0000","last_clean":"2024-04-25T13:42:59.194562+0000","last_became_active":"2024-04-25T13:42:13.079198+0000","last_became_peered":"2024-04-25T13:42:13.079198+0000","last_unstale":"2024-04-25T13:42:59.194562+0000","last_undegraded":"2024-04-25T13:42:59.194562+0000","last_fullsized":"2024-04-25T13:42:59.194562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:25.267778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198702+0000","last_change":"2024-04-25T13:42:08.043885+0000","last_active":"2024-04-25T13:42:59.198702+0000","last_peered":"2024-04-25T13:42:59.198702+0000","last_clean":"2024-04-25T13:42:59.198702+0000","last_became_active":"2024-04-25T13:42:08.043363+0000","last_became_peered":"2024-04-25T13:42:08.043363+0000","last_unstale":"2024-04-25T13:42:59.198702+0000","last_undegraded":"2024-04-25T13:42:59.198702+0000","last_fullsized":"2024-04-25T13:42:59.198702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:42.592286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202215+0000","last_change":"2024-04-25T13:42:09.054000+0000","last_active":"2024-04-25T13:42:59.202215+0000","last_peered":"2024-04-25T13:42:59.202215+0000","last_clean":"2024-04-25T13:42:59.202215+0000","last_became_active":"2024-04-25T13:42:09.053538+0000","last_became_peered":"2024-04-25T13:42:09.053538+0000","last_unstale":"2024-04-25T13:42:59.202215+0000","last_undegraded":"2024-04-25T13:42:59.202215+0000","last_fullsized":"2024-04-25T13:42:59.202215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:47.504591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.200255+0000","last_change":"2024-04-25T13:42:13.086157+0000","last_active":"2024-04-25T13:42:59.200255+0000","last_peered":"2024-04-25T13:42:59.200255+0000","last_clean":"2024-04-25T13:42:59.200255+0000","last_became_active":"2024-04-25T13:42:13.085613+0000","last_became_peered":"2024-04-25T13:42:13.085613+0000","last_unstale":"2024-04-25T13:42:59.200255+0000","last_undegraded":"2024-04-25T13:42:59.200255+0000","last_fullsized":"2024-04-25T13:42:59.200255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:11.707675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:43:43.273969+0000","last_change":"2024-04-25T13:42:08.034028+0000","last_active":"2024-04-25T13:43:43.273969+0000","last_peered":"2024-04-25T13:43:43.273969+0000","last_clean":"2024-04-25T13:43:43.273969+0000","last_became_active":"2024-04-25T13:42:08.033641+0000","last_became_peered":"2024-04-25T13:42:08.033641+0000","last_unstale":"2024-04-25T13:43:43.273969+0000","last_undegraded":"2024-04-25T13:43:43.273969+0000","last_fullsized":"2024-04-25T13:43:43.273969+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:34.081325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202141+0000","last_change":"2024-04-25T13:42:09.054594+0000","last_active":"2024-04-25T13:42:59.202141+0000","last_peered":"2024-04-25T13:42:59.202141+0000","last_clean":"2024-04-25T13:42:59.202141+0000","last_became_active":"2024-04-25T13:42:09.054215+0000","last_became_peered":"2024-04-25T13:42:09.054215+0000","last_unstale":"2024-04-25T13:42:59.202141+0000","last_undegraded":"2024-04-25T13:42:59.202141+0000","last_fullsized":"2024-04-25T13:42:59.202141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:56.129188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193760+0000","last_change":"2024-04-25T13:42:13.081325+0000","last_active":"2024-04-25T13:42:59.193760+0000","last_peered":"2024-04-25T13:42:59.193760+0000","last_clean":"2024-04-25T13:42:59.193760+0000","last_became_active":"2024-04-25T13:42:13.080641+0000","last_became_peered":"2024-04-25T13:42:13.080641+0000","last_unstale":"2024-04-25T13:42:59.193760+0000","last_undegraded":"2024-04-25T13:42:59.193760+0000","last_fullsized":"2024-04-25T13:42:59.193760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:45.839180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.195575+0000","last_change":"2024-04-25T13:42:08.037915+0000","last_active":"2024-04-25T13:42:59.195575+0000","last_peered":"2024-04-25T13:42:59.195575+0000","last_clean":"2024-04-25T13:42:59.195575+0000","last_became_active":"2024-04-25T13:42:08.037324+0000","last_became_peered":"2024-04-25T13:42:08.037324+0000","last_unstale":"2024-04-25T13:42:59.195575+0000","last_undegraded":"2024-04-25T13:42:59.195575+0000","last_fullsized":"2024-04-25T13:42:59.195575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:38.842821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198099+0000","last_change":"2024-04-25T13:42:09.038795+0000","last_active":"2024-04-25T13:42:59.198099+0000","last_peered":"2024-04-25T13:42:59.198099+0000","last_clean":"2024-04-25T13:42:59.198099+0000","last_became_active":"2024-04-25T13:42:09.037635+0000","last_became_peered":"2024-04-25T13:42:09.037635+0000","last_unstale":"2024-04-25T13:42:59.198099+0000","last_undegraded":"2024-04-25T13:42:59.198099+0000","last_fullsized":"2024-04-25T13:42:59.198099+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:46.616137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197995+0000","last_change":"2024-04-25T13:42:13.081548+0000","last_active":"2024-04-25T13:42:59.197995+0000","last_peered":"2024-04-25T13:42:59.197995+0000","last_clean":"2024-04-25T13:42:59.197995+0000","last_became_active":"2024-04-25T13:42:13.080827+0000","last_became_peered":"2024-04-25T13:42:13.080827+0000","last_unstale":"2024-04-25T13:42:59.197995+0000","last_undegraded":"2024-04-25T13:42:59.197995+0000","last_fullsized":"2024-04-25T13:42:59.197995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:04.265824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.196299+0000","last_change":"2024-04-25T13:42:08.034171+0000","last_active":"2024-04-25T13:42:59.196299+0000","last_peered":"2024-04-25T13:42:59.196299+0000","last_clean":"2024-04-25T13:42:59.196299+0000","last_became_active":"2024-04-25T13:42:08.033769+0000","last_became_peered":"2024-04-25T13:42:08.033769+0000","last_unstale":"2024-04-25T13:42:59.196299+0000","last_undegraded":"2024-04-25T13:42:59.196299+0000","last_fullsized":"2024-04-25T13:42:59.196299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:18.702989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.195010+0000","last_change":"2024-04-25T13:42:09.032212+0000","last_active":"2024-04-25T13:42:59.195010+0000","last_peered":"2024-04-25T13:42:59.195010+0000","last_clean":"2024-04-25T13:42:59.195010+0000","last_became_active":"2024-04-25T13:42:09.031833+0000","last_became_peered":"2024-04-25T13:42:09.031833+0000","last_unstale":"2024-04-25T13:42:59.195010+0000","last_undegraded":"2024-04-25T13:42:59.195010+0000","last_fullsized":"2024-04-25T13:42:59.195010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:27.681540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.196361+0000","last_change":"2024-04-25T13:42:13.097322+0000","last_active":"2024-04-25T13:42:59.196361+0000","last_peered":"2024-04-25T13:42:59.196361+0000","last_clean":"2024-04-25T13:42:59.196361+0000","last_became_active":"2024-04-25T13:42:13.096869+0000","last_became_peered":"2024-04-25T13:42:13.096869+0000","last_unstale":"2024-04-25T13:42:59.196361+0000","last_undegraded":"2024-04-25T13:42:59.196361+0000","last_fullsized":"2024-04-25T13:42:59.196361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:53.041859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.200516+0000","last_change":"2024-04-25T13:42:08.041834+0000","last_active":"2024-04-25T13:42:59.200516+0000","last_peered":"2024-04-25T13:42:59.200516+0000","last_clean":"2024-04-25T13:42:59.200516+0000","last_became_active":"2024-04-25T13:42:08.041246+0000","last_became_peered":"2024-04-25T13:42:08.041246+0000","last_unstale":"2024-04-25T13:42:59.200516+0000","last_undegraded":"2024-04-25T13:42:59.200516+0000","last_fullsized":"2024-04-25T13:42:59.200516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:34.256539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.196878+0000","last_change":"2024-04-25T13:42:09.044640+0000","last_active":"2024-04-25T13:42:59.196878+0000","last_peered":"2024-04-25T13:42:59.196878+0000","last_clean":"2024-04-25T13:42:59.196878+0000","last_became_active":"2024-04-25T13:42:09.044267+0000","last_became_peered":"2024-04-25T13:42:09.044267+0000","last_unstale":"2024-04-25T13:42:59.196878+0000","last_undegraded":"2024-04-25T13:42:59.196878+0000","last_fullsized":"2024-04-25T13:42:59.196878+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:47.934990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193690+0000","last_change":"2024-04-25T13:42:13.065858+0000","last_active":"2024-04-25T13:42:59.193690+0000","last_peered":"2024-04-25T13:42:59.193690+0000","last_clean":"2024-04-25T13:42:59.193690+0000","last_became_active":"2024-04-25T13:42:13.065315+0000","last_became_peered":"2024-04-25T13:42:13.065315+0000","last_unstale":"2024-04-25T13:42:59.193690+0000","last_undegraded":"2024-04-25T13:42:59.193690+0000","last_fullsized":"2024-04-25T13:42:59.193690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:41.116887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.201849+0000","last_change":"2024-04-25T13:42:08.031548+0000","last_active":"2024-04-25T13:42:59.201849+0000","last_peered":"2024-04-25T13:42:59.201849+0000","last_clean":"2024-04-25T13:42:59.201849+0000","last_became_active":"2024-04-25T13:42:08.031147+0000","last_became_peered":"2024-04-25T13:42:08.031147+0000","last_unstale":"2024-04-25T13:42:59.201849+0000","last_undegraded":"2024-04-25T13:42:59.201849+0000","last_fullsized":"2024-04-25T13:42:59.201849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:37.941234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.196710+0000","last_change":"2024-04-25T13:42:09.048203+0000","last_active":"2024-04-25T13:42:59.196710+0000","last_peered":"2024-04-25T13:42:59.196710+0000","last_clean":"2024-04-25T13:42:59.196710+0000","last_became_active":"2024-04-25T13:42:09.047848+0000","last_became_peered":"2024-04-25T13:42:09.047848+0000","last_unstale":"2024-04-25T13:42:59.196710+0000","last_undegraded":"2024-04-25T13:42:59.196710+0000","last_fullsized":"2024-04-25T13:42:59.196710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:27.829387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193772+0000","last_change":"2024-04-25T13:42:13.097390+0000","last_active":"2024-04-25T13:42:59.193772+0000","last_peered":"2024-04-25T13:42:59.193772+0000","last_clean":"2024-04-25T13:42:59.193772+0000","last_became_active":"2024-04-25T13:42:13.096795+0000","last_became_peered":"2024-04-25T13:42:13.096795+0000","last_unstale":"2024-04-25T13:42:59.193772+0000","last_undegraded":"2024-04-25T13:42:59.193772+0000","last_fullsized":"2024-04-25T13:42:59.193772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:15.401248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199594+0000","last_change":"2024-04-25T13:42:09.038362+0000","last_active":"2024-04-25T13:42:59.199594+0000","last_peered":"2024-04-25T13:42:59.199594+0000","last_clean":"2024-04-25T13:42:59.199594+0000","last_became_active":"2024-04-25T13:42:09.037974+0000","last_became_peered":"2024-04-25T13:42:09.037974+0000","last_unstale":"2024-04-25T13:42:59.199594+0000","last_undegraded":"2024-04-25T13:42:59.199594+0000","last_fullsized":"2024-04-25T13:42:59.199594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:37.471217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:43:45.277252+0000","last_change":"2024-04-25T13:42:08.033967+0000","last_active":"2024-04-25T13:43:45.277252+0000","last_peered":"2024-04-25T13:43:45.277252+0000","last_clean":"2024-04-25T13:43:45.277252+0000","last_became_active":"2024-04-25T13:42:08.032906+0000","last_became_peered":"2024-04-25T13:42:08.032906+0000","last_unstale":"2024-04-25T13:43:45.277252+0000","last_undegraded":"2024-04-25T13:43:45.277252+0000","last_fullsized":"2024-04-25T13:43:45.277252+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:49:10.012114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"80'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202253+0000","last_change":"2024-04-25T13:42:13.072944+0000","last_active":"2024-04-25T13:42:59.202253+0000","last_peered":"2024-04-25T13:42:59.202253+0000","last_clean":"2024-04-25T13:42:59.202253+0000","last_became_active":"2024-04-25T13:42:13.070990+0000","last_became_peered":"2024-04-25T13:42:13.070990+0000","last_unstale":"2024-04-25T13:42:59.202253+0000","last_undegraded":"2024-04-25T13:42:59.202253+0000","last_fullsized":"2024-04-25T13:42:59.202253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:18:24.946987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747248+0000","last_change":"2024-04-25T13:42:09.054270+0000","last_active":"2024-04-25T13:42:59.747248+0000","last_peered":"2024-04-25T13:42:59.747248+0000","last_clean":"2024-04-25T13:42:59.747248+0000","last_became_active":"2024-04-25T13:42:09.052333+0000","last_became_peered":"2024-04-25T13:42:09.052333+0000","last_unstale":"2024-04-25T13:42:59.747248+0000","last_undegraded":"2024-04-25T13:42:59.747248+0000","last_fullsized":"2024-04-25T13:42:59.747248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:52.401036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.248191+0000","last_change":"2024-04-25T13:42:08.033855+0000","last_active":"2024-04-25T13:42:59.248191+0000","last_peered":"2024-04-25T13:42:59.248191+0000","last_clean":"2024-04-25T13:42:59.248191+0000","last_became_active":"2024-04-25T13:42:08.033437+0000","last_became_peered":"2024-04-25T13:42:08.033437+0000","last_unstale":"2024-04-25T13:42:59.248191+0000","last_undegraded":"2024-04-25T13:42:59.248191+0000","last_fullsized":"2024-04-25T13:42:59.248191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:15.009423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.201829+0000","last_change":"2024-04-25T13:40:53.040500+0000","last_active":"2024-04-25T13:42:59.201829+0000","last_peered":"2024-04-25T13:42:59.201829+0000","last_clean":"2024-04-25T13:42:59.201829+0000","last_became_active":"2024-04-25T13:40:53.034705+0000","last_became_peered":"2024-04-25T13:40:53.034705+0000","last_unstale":"2024-04-25T13:42:59.201829+0000","last_undegraded":"2024-04-25T13:42:59.201829+0000","last_fullsized":"2024-04-25T13:42:59.201829+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:37:26.143320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:37:26.143320+0000","last_clean_scrub_stamp":"2024-04-25T13:37:26.143320+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:39.342123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.208952+0000","last_change":"2024-04-25T13:42:59.201994+0000","last_active":"2024-04-25T13:42:59.208952+0000","last_peered":"2024-04-25T13:42:59.208952+0000","last_clean":"2024-04-25T13:42:59.208952+0000","last_became_active":"2024-04-25T13:42:59.201508+0000","last_became_peered":"2024-04-25T13:42:59.201508+0000","last_unstale":"2024-04-25T13:42:59.208952+0000","last_undegraded":"2024-04-25T13:42:59.208952+0000","last_fullsized":"2024-04-25T13:42:59.208952+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:18.941675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193059+0000","last_change":"2024-04-25T13:42:09.048826+0000","last_active":"2024-04-25T13:42:59.193059+0000","last_peered":"2024-04-25T13:42:59.193059+0000","last_clean":"2024-04-25T13:42:59.193059+0000","last_became_active":"2024-04-25T13:42:09.048454+0000","last_became_peered":"2024-04-25T13:42:09.048454+0000","last_unstale":"2024-04-25T13:42:59.193059+0000","last_undegraded":"2024-04-25T13:42:59.193059+0000","last_fullsized":"2024-04-25T13:42:59.193059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:39:21.258720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202054+0000","last_change":"2024-04-25T13:42:08.037788+0000","last_active":"2024-04-25T13:42:59.202054+0000","last_peered":"2024-04-25T13:42:59.202054+0000","last_clean":"2024-04-25T13:42:59.202054+0000","last_became_active":"2024-04-25T13:42:08.036707+0000","last_became_peered":"2024-04-25T13:42:08.036707+0000","last_unstale":"2024-04-25T13:42:59.202054+0000","last_undegraded":"2024-04-25T13:42:59.202054+0000","last_fullsized":"2024-04-25T13:42:59.202054+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:09.835773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.194149+0000","last_change":"2024-04-25T13:42:13.079707+0000","last_active":"2024-04-25T13:42:59.194149+0000","last_peered":"2024-04-25T13:42:59.194149+0000","last_clean":"2024-04-25T13:42:59.194149+0000","last_became_active":"2024-04-25T13:42:13.079191+0000","last_became_peered":"2024-04-25T13:42:13.079191+0000","last_unstale":"2024-04-25T13:42:59.194149+0000","last_undegraded":"2024-04-25T13:42:59.194149+0000","last_fullsized":"2024-04-25T13:42:59.194149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:28.733884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197950+0000","last_change":"2024-04-25T13:42:08.043402+0000","last_active":"2024-04-25T13:42:59.197950+0000","last_peered":"2024-04-25T13:42:59.197950+0000","last_clean":"2024-04-25T13:42:59.197950+0000","last_became_active":"2024-04-25T13:42:08.043059+0000","last_became_peered":"2024-04-25T13:42:08.043059+0000","last_unstale":"2024-04-25T13:42:59.197950+0000","last_undegraded":"2024-04-25T13:42:59.197950+0000","last_fullsized":"2024-04-25T13:42:59.197950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:36.533869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193846+0000","last_change":"2024-04-25T13:42:09.037287+0000","last_active":"2024-04-25T13:42:59.193846+0000","last_peered":"2024-04-25T13:42:59.193846+0000","last_clean":"2024-04-25T13:42:59.193846+0000","last_became_active":"2024-04-25T13:42:09.036944+0000","last_became_peered":"2024-04-25T13:42:09.036944+0000","last_unstale":"2024-04-25T13:42:59.193846+0000","last_undegraded":"2024-04-25T13:42:59.193846+0000","last_fullsized":"2024-04-25T13:42:59.193846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:43.675505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747140+0000","last_change":"2024-04-25T13:42:13.097645+0000","last_active":"2024-04-25T13:42:59.747140+0000","last_peered":"2024-04-25T13:42:59.747140+0000","last_clean":"2024-04-25T13:42:59.747140+0000","last_became_active":"2024-04-25T13:42:13.096881+0000","last_became_peered":"2024-04-25T13:42:13.096881+0000","last_unstale":"2024-04-25T13:42:59.747140+0000","last_undegraded":"2024-04-25T13:42:59.747140+0000","last_fullsized":"2024-04-25T13:42:59.747140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:03.957250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.200479+0000","last_change":"2024-04-25T13:42:08.044040+0000","last_active":"2024-04-25T13:42:59.200479+0000","last_peered":"2024-04-25T13:42:59.200479+0000","last_clean":"2024-04-25T13:42:59.200479+0000","last_became_active":"2024-04-25T13:42:08.043590+0000","last_became_peered":"2024-04-25T13:42:08.043590+0000","last_unstale":"2024-04-25T13:42:59.200479+0000","last_undegraded":"2024-04-25T13:42:59.200479+0000","last_fullsized":"2024-04-25T13:42:59.200479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:12.780050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747515+0000","last_change":"2024-04-25T13:42:09.051254+0000","last_active":"2024-04-25T13:42:59.747515+0000","last_peered":"2024-04-25T13:42:59.747515+0000","last_clean":"2024-04-25T13:42:59.747515+0000","last_became_active":"2024-04-25T13:42:09.050899+0000","last_became_peered":"2024-04-25T13:42:09.050899+0000","last_unstale":"2024-04-25T13:42:59.747515+0000","last_undegraded":"2024-04-25T13:42:59.747515+0000","last_fullsized":"2024-04-25T13:42:59.747515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:48.851445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.204159+0000","last_change":"2024-04-25T13:42:13.070375+0000","last_active":"2024-04-25T13:42:59.204159+0000","last_peered":"2024-04-25T13:42:59.204159+0000","last_clean":"2024-04-25T13:42:59.204159+0000","last_became_active":"2024-04-25T13:42:13.069571+0000","last_became_peered":"2024-04-25T13:42:13.069571+0000","last_unstale":"2024-04-25T13:42:59.204159+0000","last_undegraded":"2024-04-25T13:42:59.204159+0000","last_fullsized":"2024-04-25T13:42:59.204159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:40.878206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.248681+0000","last_change":"2024-04-25T13:42:08.043596+0000","last_active":"2024-04-25T13:42:59.248681+0000","last_peered":"2024-04-25T13:42:59.248681+0000","last_clean":"2024-04-25T13:42:59.248681+0000","last_became_active":"2024-04-25T13:42:08.043233+0000","last_became_peered":"2024-04-25T13:42:08.043233+0000","last_unstale":"2024-04-25T13:42:59.248681+0000","last_undegraded":"2024-04-25T13:42:59.248681+0000","last_fullsized":"2024-04-25T13:42:59.248681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:31.126367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199821+0000","last_change":"2024-04-25T13:42:09.045131+0000","last_active":"2024-04-25T13:42:59.199821+0000","last_peered":"2024-04-25T13:42:59.199821+0000","last_clean":"2024-04-25T13:42:59.199821+0000","last_became_active":"2024-04-25T13:42:09.044566+0000","last_became_peered":"2024-04-25T13:42:09.044566+0000","last_unstale":"2024-04-25T13:42:59.199821+0000","last_undegraded":"2024-04-25T13:42:59.199821+0000","last_fullsized":"2024-04-25T13:42:59.199821+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:25.540538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.248441+0000","last_change":"2024-04-25T13:42:13.097509+0000","last_active":"2024-04-25T13:42:59.248441+0000","last_peered":"2024-04-25T13:42:59.248441+0000","last_clean":"2024-04-25T13:42:59.248441+0000","last_became_active":"2024-04-25T13:42:13.096970+0000","last_became_peered":"2024-04-25T13:42:13.096970+0000","last_unstale":"2024-04-25T13:42:59.248441+0000","last_undegraded":"2024-04-25T13:42:59.248441+0000","last_fullsized":"2024-04-25T13:42:59.248441+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:38.891212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197217+0000","last_change":"2024-04-25T13:42:08.033992+0000","last_active":"2024-04-25T13:42:59.197217+0000","last_peered":"2024-04-25T13:42:59.197217+0000","last_clean":"2024-04-25T13:42:59.197217+0000","last_became_active":"2024-04-25T13:42:08.033603+0000","last_became_peered":"2024-04-25T13:42:08.033603+0000","last_unstale":"2024-04-25T13:42:59.197217+0000","last_undegraded":"2024-04-25T13:42:59.197217+0000","last_fullsized":"2024-04-25T13:42:59.197217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:06.552660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.195686+0000","last_change":"2024-04-25T13:42:09.040719+0000","last_active":"2024-04-25T13:42:59.195686+0000","last_peered":"2024-04-25T13:42:59.195686+0000","last_clean":"2024-04-25T13:42:59.195686+0000","last_became_active":"2024-04-25T13:42:09.038144+0000","last_became_peered":"2024-04-25T13:42:09.038144+0000","last_unstale":"2024-04-25T13:42:59.195686+0000","last_undegraded":"2024-04-25T13:42:59.195686+0000","last_fullsized":"2024-04-25T13:42:59.195686+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:20.095587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.200615+0000","last_change":"2024-04-25T13:42:13.086133+0000","last_active":"2024-04-25T13:42:59.200615+0000","last_peered":"2024-04-25T13:42:59.200615+0000","last_clean":"2024-04-25T13:42:59.200615+0000","last_became_active":"2024-04-25T13:42:13.085616+0000","last_became_peered":"2024-04-25T13:42:13.085616+0000","last_unstale":"2024-04-25T13:42:59.200615+0000","last_undegraded":"2024-04-25T13:42:59.200615+0000","last_fullsized":"2024-04-25T13:42:59.200615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:45.939319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747260+0000","last_change":"2024-04-25T13:42:08.028526+0000","last_active":"2024-04-25T13:42:59.747260+0000","last_peered":"2024-04-25T13:42:59.747260+0000","last_clean":"2024-04-25T13:42:59.747260+0000","last_became_active":"2024-04-25T13:42:08.028056+0000","last_became_peered":"2024-04-25T13:42:08.028056+0000","last_unstale":"2024-04-25T13:42:59.747260+0000","last_undegraded":"2024-04-25T13:42:59.747260+0000","last_fullsized":"2024-04-25T13:42:59.747260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:47.433236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.194078+0000","last_change":"2024-04-25T13:42:09.058985+0000","last_active":"2024-04-25T13:42:59.194078+0000","last_peered":"2024-04-25T13:42:59.194078+0000","last_clean":"2024-04-25T13:42:59.194078+0000","last_became_active":"2024-04-25T13:42:09.058638+0000","last_became_peered":"2024-04-25T13:42:09.058638+0000","last_unstale":"2024-04-25T13:42:59.194078+0000","last_undegraded":"2024-04-25T13:42:59.194078+0000","last_fullsized":"2024-04-25T13:42:59.194078+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:04.956881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"80'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.249020+0000","last_change":"2024-04-25T13:42:13.074598+0000","last_active":"2024-04-25T13:42:59.249020+0000","last_peered":"2024-04-25T13:42:59.249020+0000","last_clean":"2024-04-25T13:42:59.249020+0000","last_became_active":"2024-04-25T13:42:13.074129+0000","last_became_peered":"2024-04-25T13:42:13.074129+0000","last_unstale":"2024-04-25T13:42:59.249020+0000","last_undegraded":"2024-04-25T13:42:59.249020+0000","last_fullsized":"2024-04-25T13:42:59.249020+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:31.054517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.204011+0000","last_change":"2024-04-25T13:42:08.043962+0000","last_active":"2024-04-25T13:42:59.204011+0000","last_peered":"2024-04-25T13:42:59.204011+0000","last_clean":"2024-04-25T13:42:59.204011+0000","last_became_active":"2024-04-25T13:42:08.043526+0000","last_became_peered":"2024-04-25T13:42:08.043526+0000","last_unstale":"2024-04-25T13:42:59.204011+0000","last_undegraded":"2024-04-25T13:42:59.204011+0000","last_fullsized":"2024-04-25T13:42:59.204011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:22.766138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747419+0000","last_change":"2024-04-25T13:42:09.048574+0000","last_active":"2024-04-25T13:42:59.747419+0000","last_peered":"2024-04-25T13:42:59.747419+0000","last_clean":"2024-04-25T13:42:59.747419+0000","last_became_active":"2024-04-25T13:42:09.047982+0000","last_became_peered":"2024-04-25T13:42:09.047982+0000","last_unstale":"2024-04-25T13:42:59.747419+0000","last_undegraded":"2024-04-25T13:42:59.747419+0000","last_fullsized":"2024-04-25T13:42:59.747419+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:00.898772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.248349+0000","last_change":"2024-04-25T13:42:13.097637+0000","last_active":"2024-04-25T13:42:59.248349+0000","last_peered":"2024-04-25T13:42:59.248349+0000","last_clean":"2024-04-25T13:42:59.248349+0000","last_became_active":"2024-04-25T13:42:13.096790+0000","last_became_peered":"2024-04-25T13:42:13.096790+0000","last_unstale":"2024-04-25T13:42:59.248349+0000","last_undegraded":"2024-04-25T13:42:59.248349+0000","last_fullsized":"2024-04-25T13:42:59.248349+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:54.174615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.195975+0000","last_change":"2024-04-25T13:42:08.040207+0000","last_active":"2024-04-25T13:42:59.195975+0000","last_peered":"2024-04-25T13:42:59.195975+0000","last_clean":"2024-04-25T13:42:59.195975+0000","last_became_active":"2024-04-25T13:42:08.039809+0000","last_became_peered":"2024-04-25T13:42:08.039809+0000","last_unstale":"2024-04-25T13:42:59.195975+0000","last_undegraded":"2024-04-25T13:42:59.195975+0000","last_fullsized":"2024-04-25T13:42:59.195975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:12.084793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202834+0000","last_change":"2024-04-25T13:42:09.048040+0000","last_active":"2024-04-25T13:42:59.202834+0000","last_peered":"2024-04-25T13:42:59.202834+0000","last_clean":"2024-04-25T13:42:59.202834+0000","last_became_active":"2024-04-25T13:42:09.047662+0000","last_became_peered":"2024-04-25T13:42:09.047662+0000","last_unstale":"2024-04-25T13:42:59.202834+0000","last_undegraded":"2024-04-25T13:42:59.202834+0000","last_fullsized":"2024-04-25T13:42:59.202834+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:10:17.675167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197653+0000","last_change":"2024-04-25T13:42:13.072706+0000","last_active":"2024-04-25T13:42:59.197653+0000","last_peered":"2024-04-25T13:42:59.197653+0000","last_clean":"2024-04-25T13:42:59.197653+0000","last_became_active":"2024-04-25T13:42:13.071525+0000","last_became_peered":"2024-04-25T13:42:13.071525+0000","last_unstale":"2024-04-25T13:42:59.197653+0000","last_undegraded":"2024-04-25T13:42:59.197653+0000","last_fullsized":"2024-04-25T13:42:59.197653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:20.351817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.205160+0000","last_change":"2024-04-25T13:42:08.033975+0000","last_active":"2024-04-25T13:42:59.205160+0000","last_peered":"2024-04-25T13:42:59.205160+0000","last_clean":"2024-04-25T13:42:59.205160+0000","last_became_active":"2024-04-25T13:42:08.033302+0000","last_became_peered":"2024-04-25T13:42:08.033302+0000","last_unstale":"2024-04-25T13:42:59.205160+0000","last_undegraded":"2024-04-25T13:42:59.205160+0000","last_fullsized":"2024-04-25T13:42:59.205160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:57:57.561629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202488+0000","last_change":"2024-04-25T13:42:09.052457+0000","last_active":"2024-04-25T13:42:59.202488+0000","last_peered":"2024-04-25T13:42:59.202488+0000","last_clean":"2024-04-25T13:42:59.202488+0000","last_became_active":"2024-04-25T13:42:09.052052+0000","last_became_peered":"2024-04-25T13:42:09.052052+0000","last_unstale":"2024-04-25T13:42:59.202488+0000","last_undegraded":"2024-04-25T13:42:59.202488+0000","last_fullsized":"2024-04-25T13:42:59.202488+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:42.589178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.249819+0000","last_change":"2024-04-25T13:42:59.249819+0000","last_active":"2024-04-25T13:42:59.249819+0000","last_peered":"2024-04-25T13:42:59.249819+0000","last_clean":"2024-04-25T13:42:59.249819+0000","last_became_active":"2024-04-25T13:42:59.249291+0000","last_became_peered":"2024-04-25T13:42:59.249291+0000","last_unstale":"2024-04-25T13:42:59.249819+0000","last_undegraded":"2024-04-25T13:42:59.249819+0000","last_fullsized":"2024-04-25T13:42:59.249819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:27:22.383094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10,1,4],"acting":[0,10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199033+0000","last_change":"2024-04-25T13:42:08.044578+0000","last_active":"2024-04-25T13:42:59.199033+0000","last_peered":"2024-04-25T13:42:59.199033+0000","last_clean":"2024-04-25T13:42:59.199033+0000","last_became_active":"2024-04-25T13:42:08.044194+0000","last_became_peered":"2024-04-25T13:42:08.044194+0000","last_unstale":"2024-04-25T13:42:59.199033+0000","last_undegraded":"2024-04-25T13:42:59.199033+0000","last_fullsized":"2024-04-25T13:42:59.199033+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:58.413832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202281+0000","last_change":"2024-04-25T13:42:09.051150+0000","last_active":"2024-04-25T13:42:59.202281+0000","last_peered":"2024-04-25T13:42:59.202281+0000","last_clean":"2024-04-25T13:42:59.202281+0000","last_became_active":"2024-04-25T13:42:09.050747+0000","last_became_peered":"2024-04-25T13:42:09.050747+0000","last_unstale":"2024-04-25T13:42:59.202281+0000","last_undegraded":"2024-04-25T13:42:59.202281+0000","last_fullsized":"2024-04-25T13:42:59.202281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:10.923728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197321+0000","last_change":"2024-04-25T13:42:13.075405+0000","last_active":"2024-04-25T13:42:59.197321+0000","last_peered":"2024-04-25T13:42:59.197321+0000","last_clean":"2024-04-25T13:42:59.197321+0000","last_became_active":"2024-04-25T13:42:13.074989+0000","last_became_peered":"2024-04-25T13:42:13.074989+0000","last_unstale":"2024-04-25T13:42:59.197321+0000","last_undegraded":"2024-04-25T13:42:59.197321+0000","last_fullsized":"2024-04-25T13:42:59.197321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:44.544984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193787+0000","last_change":"2024-04-25T13:42:08.033305+0000","last_active":"2024-04-25T13:42:59.193787+0000","last_peered":"2024-04-25T13:42:59.193787+0000","last_clean":"2024-04-25T13:42:59.193787+0000","last_became_active":"2024-04-25T13:42:08.032879+0000","last_became_peered":"2024-04-25T13:42:08.032879+0000","last_unstale":"2024-04-25T13:42:59.193787+0000","last_undegraded":"2024-04-25T13:42:59.193787+0000","last_fullsized":"2024-04-25T13:42:59.193787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:53.170913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.203131+0000","last_change":"2024-04-25T13:42:09.054682+0000","last_active":"2024-04-25T13:42:59.203131+0000","last_peered":"2024-04-25T13:42:59.203131+0000","last_clean":"2024-04-25T13:42:59.203131+0000","last_became_active":"2024-04-25T13:42:09.051962+0000","last_became_peered":"2024-04-25T13:42:09.051962+0000","last_unstale":"2024-04-25T13:42:59.203131+0000","last_undegraded":"2024-04-25T13:42:59.203131+0000","last_fullsized":"2024-04-25T13:42:59.203131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:50.799284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.194134+0000","last_change":"2024-04-25T13:42:09.040062+0000","last_active":"2024-04-25T13:42:59.194134+0000","last_peered":"2024-04-25T13:42:59.194134+0000","last_clean":"2024-04-25T13:42:59.194134+0000","last_became_active":"2024-04-25T13:42:09.039692+0000","last_became_peered":"2024-04-25T13:42:09.039692+0000","last_unstale":"2024-04-25T13:42:59.194134+0000","last_undegraded":"2024-04-25T13:42:59.194134+0000","last_fullsized":"2024-04-25T13:42:59.194134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:48.527698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.249561+0000","last_change":"2024-04-25T13:42:59.249561+0000","last_active":"2024-04-25T13:42:59.249561+0000","last_peered":"2024-04-25T13:42:59.249561+0000","last_clean":"2024-04-25T13:42:59.249561+0000","last_became_active":"2024-04-25T13:42:59.249065+0000","last_became_peered":"2024-04-25T13:42:59.249065+0000","last_unstale":"2024-04-25T13:42:59.249561+0000","last_undegraded":"2024-04-25T13:42:59.249561+0000","last_fullsized":"2024-04-25T13:42:59.249561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:06.549834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.204006+0000","last_change":"2024-04-25T13:42:09.064663+0000","last_active":"2024-04-25T13:42:59.204006+0000","last_peered":"2024-04-25T13:42:59.204006+0000","last_clean":"2024-04-25T13:42:59.204006+0000","last_became_active":"2024-04-25T13:42:09.064202+0000","last_became_peered":"2024-04-25T13:42:09.064202+0000","last_unstale":"2024-04-25T13:42:59.204006+0000","last_undegraded":"2024-04-25T13:42:59.204006+0000","last_fullsized":"2024-04-25T13:42:59.204006+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:48.611882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199061+0000","last_change":"2024-04-25T13:42:09.066196+0000","last_active":"2024-04-25T13:42:59.199061+0000","last_peered":"2024-04-25T13:42:59.199061+0000","last_clean":"2024-04-25T13:42:59.199061+0000","last_became_active":"2024-04-25T13:42:09.065793+0000","last_became_peered":"2024-04-25T13:42:09.065793+0000","last_unstale":"2024-04-25T13:42:59.199061+0000","last_undegraded":"2024-04-25T13:42:59.199061+0000","last_fullsized":"2024-04-25T13:42:59.199061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:26.557457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193855+0000","last_change":"2024-04-25T13:42:09.063229+0000","last_active":"2024-04-25T13:42:59.193855+0000","last_peered":"2024-04-25T13:42:59.193855+0000","last_clean":"2024-04-25T13:42:59.193855+0000","last_became_active":"2024-04-25T13:42:09.062884+0000","last_became_peered":"2024-04-25T13:42:09.062884+0000","last_unstale":"2024-04-25T13:42:59.193855+0000","last_undegraded":"2024-04-25T13:42:59.193855+0000","last_fullsized":"2024-04-25T13:42:59.193855+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:17.478141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.194781+0000","last_change":"2024-04-25T13:42:09.031731+0000","last_active":"2024-04-25T13:42:59.194781+0000","last_peered":"2024-04-25T13:42:59.194781+0000","last_clean":"2024-04-25T13:42:59.194781+0000","last_became_active":"2024-04-25T13:42:09.031316+0000","last_became_peered":"2024-04-25T13:42:09.031316+0000","last_unstale":"2024-04-25T13:42:59.194781+0000","last_undegraded":"2024-04-25T13:42:59.194781+0000","last_fullsized":"2024-04-25T13:42:59.194781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:34.210437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.204977+0000","last_change":"2024-04-25T13:42:09.034429+0000","last_active":"2024-04-25T13:42:59.204977+0000","last_peered":"2024-04-25T13:42:59.204977+0000","last_clean":"2024-04-25T13:42:59.204977+0000","last_became_active":"2024-04-25T13:42:09.033917+0000","last_became_peered":"2024-04-25T13:42:09.033917+0000","last_unstale":"2024-04-25T13:42:59.204977+0000","last_undegraded":"2024-04-25T13:42:59.204977+0000","last_fullsized":"2024-04-25T13:42:59.204977+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:16.572251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747670+0000","last_change":"2024-04-25T13:42:09.060585+0000","last_active":"2024-04-25T13:42:59.747670+0000","last_peered":"2024-04-25T13:42:59.747670+0000","last_clean":"2024-04-25T13:42:59.747670+0000","last_became_active":"2024-04-25T13:42:09.058624+0000","last_became_peered":"2024-04-25T13:42:09.058624+0000","last_unstale":"2024-04-25T13:42:59.747670+0000","last_undegraded":"2024-04-25T13:42:59.747670+0000","last_fullsized":"2024-04-25T13:42:59.747670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:30.996402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199423+0000","last_change":"2024-04-25T13:42:09.057544+0000","last_active":"2024-04-25T13:42:59.199423+0000","last_peered":"2024-04-25T13:42:59.199423+0000","last_clean":"2024-04-25T13:42:59.199423+0000","last_became_active":"2024-04-25T13:42:09.057127+0000","last_became_peered":"2024-04-25T13:42:09.057127+0000","last_unstale":"2024-04-25T13:42:59.199423+0000","last_undegraded":"2024-04-25T13:42:59.199423+0000","last_fullsized":"2024-04-25T13:42:59.199423+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:57.394029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747405+0000","last_change":"2024-04-25T13:42:09.057102+0000","last_active":"2024-04-25T13:42:59.747405+0000","last_peered":"2024-04-25T13:42:59.747405+0000","last_clean":"2024-04-25T13:42:59.747405+0000","last_became_active":"2024-04-25T13:42:09.056785+0000","last_became_peered":"2024-04-25T13:42:09.056785+0000","last_unstale":"2024-04-25T13:42:59.747405+0000","last_undegraded":"2024-04-25T13:42:59.747405+0000","last_fullsized":"2024-04-25T13:42:59.747405+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:57.278485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198084+0000","last_change":"2024-04-25T13:42:09.045717+0000","last_active":"2024-04-25T13:42:59.198084+0000","last_peered":"2024-04-25T13:42:59.198084+0000","last_clean":"2024-04-25T13:42:59.198084+0000","last_became_active":"2024-04-25T13:42:09.045346+0000","last_became_peered":"2024-04-25T13:42:09.045346+0000","last_unstale":"2024-04-25T13:42:59.198084+0000","last_undegraded":"2024-04-25T13:42:59.198084+0000","last_fullsized":"2024-04-25T13:42:59.198084+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:53.731004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193484+0000","last_change":"2024-04-25T13:42:09.061956+0000","last_active":"2024-04-25T13:42:59.193484+0000","last_peered":"2024-04-25T13:42:59.193484+0000","last_clean":"2024-04-25T13:42:59.193484+0000","last_became_active":"2024-04-25T13:42:09.061589+0000","last_became_peered":"2024-04-25T13:42:09.061589+0000","last_unstale":"2024-04-25T13:42:59.193484+0000","last_undegraded":"2024-04-25T13:42:59.193484+0000","last_fullsized":"2024-04-25T13:42:59.193484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:34.535044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.203233+0000","last_change":"2024-04-25T13:42:59.203233+0000","last_active":"2024-04-25T13:42:59.203233+0000","last_peered":"2024-04-25T13:42:59.203233+0000","last_clean":"2024-04-25T13:42:59.203233+0000","last_became_active":"2024-04-25T13:42:59.202767+0000","last_became_peered":"2024-04-25T13:42:59.202767+0000","last_unstale":"2024-04-25T13:42:59.203233+0000","last_undegraded":"2024-04-25T13:42:59.203233+0000","last_fullsized":"2024-04-25T13:42:59.203233+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:15.541405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66334,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":437,"num_read_kb":293,"num_write":160,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":61694,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":199002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678049,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":917504,"data_stored":449115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874278,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32748,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712404,"statfs":{"total":95995035648,"available":95961501696,"internally_reserved":0,"allocated":1609728,"data_stored":1098716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037804,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36260,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708892,"statfs":{"total":95995035648,"available":95957905408,"internally_reserved":0,"allocated":937984,"data_stored":453447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234033,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":449271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430262,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1527808,"data_stored":1045180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593788,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":444527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":991232,"data_stored":507783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":937984,"data_stored":445915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":445165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149771,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":444721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953541,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":511510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790017,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1536000,"data_stored":1040768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":62977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":63911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:43:49.185 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T13:43:49.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:49 smithi161 ceph-mon[32696]: pgmap v337: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T13:43:49.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:49 smithi161 ceph-mon[32696]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T13:43:49.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:49 smithi175 ceph-mon[32649]: pgmap v337: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T13:43:49.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:49 smithi175 ceph-mon[32649]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T13:43:49.435 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:43:49.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:49 smithi043 ceph-mon[29195]: pgmap v337: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T13:43:49.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:49 smithi043 ceph-mon[29195]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T13:43:51.146 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:51 smithi043 ceph-mon[29195]: pgmap v338: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:51.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.160+0000 7f056d406700 1 -- 172.21.15.43:0/532516637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0568107cc0 msgr2=0x7f05681080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:51.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.160+0000 7f056d406700 1 --2- 172.21.15.43:0/532516637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0568107cc0 0x7f05681080d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f055c0099c0 tx=0x7f055c009cd0 comp rx=0 tx=0).stop 2024-04-25T13:43:51.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.160+0000 7f056d406700 1 -- 172.21.15.43:0/532516637 shutdown_connections 2024-04-25T13:43:51.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.160+0000 7f056d406700 1 --2- 172.21.15.43:0/532516637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0568108610 0x7f056810ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:51.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.160+0000 7f056d406700 1 --2- 172.21.15.43:0/532516637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0568103390 0x7f05681037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:51.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.160+0000 7f056d406700 1 --2- 172.21.15.43:0/532516637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0568107cc0 0x7f05681080d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:51.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.160+0000 7f056d406700 1 -- 172.21.15.43:0/532516637 >> 172.21.15.43:0/532516637 conn(0x7f05680fec90 msgr2=0x7f05681010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:51.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.160+0000 7f056d406700 1 -- 172.21.15.43:0/532516637 shutdown_connections 2024-04-25T13:43:51.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.160+0000 7f056d406700 1 -- 172.21.15.43:0/532516637 wait complete. 2024-04-25T13:43:51.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.161+0000 7f056d406700 1 Processor -- start 2024-04-25T13:43:51.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.161+0000 7f056d406700 1 -- start start 2024-04-25T13:43:51.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.161+0000 7f056d406700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0568103390 0x7f05681a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:51.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.161+0000 7f056d406700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0568107cc0 0x7f05681a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:51.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.161+0000 7f056d406700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0568108610 0x7f056819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:51.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.161+0000 7f056d406700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f05681130d0 con 0x7f0568103390 2024-04-25T13:43:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.161+0000 7f056d406700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f0568112f50 con 0x7f0568107cc0 2024-04-25T13:43:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.161+0000 7f056d406700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0568113250 con 0x7f0568108610 2024-04-25T13:43:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.162+0000 7f0566ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0568103390 0x7f05681a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.162+0000 7f0566ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0568103390 0x7f05681a07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51768/0 (socket says 172.21.15.43:51768) 2024-04-25T13:43:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.162+0000 7f0566ffd700 1 -- 172.21.15.43:0/636887699 learned_addr learned my addr 172.21.15.43:0/636887699 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.162+0000 7f05667fc700 1 --2- 172.21.15.43:0/636887699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0568107cc0 0x7f05681a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.162+0000 7f05677fe700 1 --2- 172.21.15.43:0/636887699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0568108610 0x7f056819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.162+0000 7f0566ffd700 1 -- 172.21.15.43:0/636887699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0568108610 msgr2=0x7f056819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.162+0000 7f0566ffd700 1 --2- 172.21.15.43:0/636887699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0568108610 0x7f056819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.162+0000 7f0566ffd700 1 -- 172.21.15.43:0/636887699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0568107cc0 msgr2=0x7f05681a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.162+0000 7f0566ffd700 1 --2- 172.21.15.43:0/636887699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0568107cc0 0x7f05681a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.162+0000 7f0566ffd700 1 -- 172.21.15.43:0/636887699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056819b040 con 0x7f0568103390 2024-04-25T13:43:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.162+0000 7f0566ffd700 1 --2- 172.21.15.43:0/636887699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0568103390 0x7f05681a07e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f055800c9b0 tx=0x7f055800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:51.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.162+0000 7f054ffff700 1 -- 172.21.15.43:0/636887699 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558007b00 con 0x7f0568103390 2024-04-25T13:43:51.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.162+0000 7f054ffff700 1 -- 172.21.15.43:0/636887699 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0558007ca0 con 0x7f0568103390 2024-04-25T13:43:51.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.162+0000 7f056d406700 1 -- 172.21.15.43:0/636887699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f056819b330 con 0x7f0568103390 2024-04-25T13:43:51.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.162+0000 7f054ffff700 1 -- 172.21.15.43:0/636887699 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558018660 con 0x7f0568103390 2024-04-25T13:43:51.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.162+0000 7f056d406700 1 -- 172.21.15.43:0/636887699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f056819b840 con 0x7f0568103390 2024-04-25T13:43:51.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.163+0000 7f056d406700 1 -- 172.21.15.43:0/636887699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0568051190 con 0x7f0568103390 2024-04-25T13:43:51.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.165+0000 7f054ffff700 1 -- 172.21.15.43:0/636887699 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f055800f450 con 0x7f0568103390 2024-04-25T13:43:51.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.166+0000 7f054ffff700 1 --2- 172.21.15.43:0/636887699 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f05500afc10 0x7f05500b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:51.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.166+0000 7f05667fc700 1 --2- 172.21.15.43:0/636887699 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f05500afc10 0x7f05500b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:51.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.166+0000 7f054ffff700 1 -- 172.21.15.43:0/636887699 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f05580df3a0 con 0x7f0568103390 2024-04-25T13:43:51.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.166+0000 7f05667fc700 1 --2- 172.21.15.43:0/636887699 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f05500afc10 0x7f05500b2120 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f055c009990 tx=0x7f055c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:51.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.169+0000 7f054ffff700 1 -- 172.21.15.43:0/636887699 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0558014030 con 0x7f0568103390 2024-04-25T13:43:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:51 smithi161 ceph-mon[32696]: pgmap v338: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:51.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.373+0000 7f056d406700 1 -- 172.21.15.43:0/636887699 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0568063ad0 con 0x7f05500afc10 2024-04-25T13:43:51.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.382+0000 7f054ffff700 1 -- 172.21.15.43:0/636887699 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340335 (secure 0 0 0) 0x7f055c07b180 con 0x7f05500afc10 2024-04-25T13:43:51.386 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:43:51.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.385+0000 7f056d406700 1 -- 172.21.15.43:0/636887699 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f05500afc10 msgr2=0x7f05500b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:51.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.385+0000 7f056d406700 1 --2- 172.21.15.43:0/636887699 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f05500afc10 0x7f05500b2120 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f055c009990 tx=0x7f055c005fb0 comp rx=0 tx=0).stop 2024-04-25T13:43:51.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.385+0000 7f056d406700 1 -- 172.21.15.43:0/636887699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0568103390 msgr2=0x7f05681a07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:51.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.385+0000 7f056d406700 1 --2- 172.21.15.43:0/636887699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0568103390 0x7f05681a07e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f055800c9b0 tx=0x7f055800ccc0 comp rx=0 tx=0).stop 2024-04-25T13:43:51.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.385+0000 7f056d406700 1 -- 172.21.15.43:0/636887699 shutdown_connections 2024-04-25T13:43:51.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.385+0000 7f056d406700 1 --2- 172.21.15.43:0/636887699 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f05500afc10 0x7f05500b2120 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:51.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.385+0000 7f056d406700 1 --2- 172.21.15.43:0/636887699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0568108610 0x7f056819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:51.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.385+0000 7f056d406700 1 --2- 172.21.15.43:0/636887699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0568103390 0x7f05681a07e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:51.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.385+0000 7f056d406700 1 --2- 172.21.15.43:0/636887699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0568107cc0 0x7f05681a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:51.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.385+0000 7f056d406700 1 -- 172.21.15.43:0/636887699 >> 172.21.15.43:0/636887699 conn(0x7f05680fec90 msgr2=0x7f056806b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:51.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.385+0000 7f056d406700 1 -- 172.21.15.43:0/636887699 shutdown_connections 2024-04-25T13:43:51.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:51.385+0000 7f056d406700 1 -- 172.21.15.43:0/636887699 wait complete. 2024-04-25T13:43:51.390 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T13:43:51.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:51 smithi175 ceph-mon[32649]: pgmap v338: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:52.151 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:52 smithi043 ceph-mon[29195]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T13:43:52.181 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-04-25T13:43:49.960069+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656936,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":528,"num_read_kb":362,"num_write":285,"num_write_kb":2268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":3013534,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387016,"kb_used_data":12848,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554808,"statfs":{"total":1151940427776,"available":1151544123392,"internally_reserved":0,"allocated":13156352,"data_stored":7336118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003913"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.195494+0000","last_change":"2024-04-25T13:42:09.059038+0000","last_active":"2024-04-25T13:42:59.195494+0000","last_peered":"2024-04-25T13:42:59.195494+0000","last_clean":"2024-04-25T13:42:59.195494+0000","last_became_active":"2024-04-25T13:42:09.058719+0000","last_became_peered":"2024-04-25T13:42:09.058719+0000","last_unstale":"2024-04-25T13:42:59.195494+0000","last_undegraded":"2024-04-25T13:42:59.195494+0000","last_fullsized":"2024-04-25T13:42:59.195494+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:44.573718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199683+0000","last_change":"2024-04-25T13:42:09.057862+0000","last_active":"2024-04-25T13:42:59.199683+0000","last_peered":"2024-04-25T13:42:59.199683+0000","last_clean":"2024-04-25T13:42:59.199683+0000","last_became_active":"2024-04-25T13:42:09.057511+0000","last_became_peered":"2024-04-25T13:42:09.057511+0000","last_unstale":"2024-04-25T13:42:59.199683+0000","last_undegraded":"2024-04-25T13:42:59.199683+0000","last_fullsized":"2024-04-25T13:42:59.199683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:20.911339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199067+0000","last_change":"2024-04-25T13:42:09.060432+0000","last_active":"2024-04-25T13:42:59.199067+0000","last_peered":"2024-04-25T13:42:59.199067+0000","last_clean":"2024-04-25T13:42:59.199067+0000","last_became_active":"2024-04-25T13:42:09.060081+0000","last_became_peered":"2024-04-25T13:42:09.060081+0000","last_unstale":"2024-04-25T13:42:59.199067+0000","last_undegraded":"2024-04-25T13:42:59.199067+0000","last_fullsized":"2024-04-25T13:42:59.199067+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:50.008694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.248673+0000","last_change":"2024-04-25T13:42:09.040319+0000","last_active":"2024-04-25T13:42:59.248673+0000","last_peered":"2024-04-25T13:42:59.248673+0000","last_clean":"2024-04-25T13:42:59.248673+0000","last_became_active":"2024-04-25T13:42:09.039949+0000","last_became_peered":"2024-04-25T13:42:09.039949+0000","last_unstale":"2024-04-25T13:42:59.248673+0000","last_undegraded":"2024-04-25T13:42:59.248673+0000","last_fullsized":"2024-04-25T13:42:59.248673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:03.242055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.195843+0000","last_change":"2024-04-25T13:42:09.040642+0000","last_active":"2024-04-25T13:42:59.195843+0000","last_peered":"2024-04-25T13:42:59.195843+0000","last_clean":"2024-04-25T13:42:59.195843+0000","last_became_active":"2024-04-25T13:42:09.039339+0000","last_became_peered":"2024-04-25T13:42:09.039339+0000","last_unstale":"2024-04-25T13:42:59.195843+0000","last_undegraded":"2024-04-25T13:42:59.195843+0000","last_fullsized":"2024-04-25T13:42:59.195843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:50.216939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.196561+0000","last_change":"2024-04-25T13:42:09.034848+0000","last_active":"2024-04-25T13:42:59.196561+0000","last_peered":"2024-04-25T13:42:59.196561+0000","last_clean":"2024-04-25T13:42:59.196561+0000","last_became_active":"2024-04-25T13:42:09.034452+0000","last_became_peered":"2024-04-25T13:42:09.034452+0000","last_unstale":"2024-04-25T13:42:59.196561+0000","last_undegraded":"2024-04-25T13:42:59.196561+0000","last_fullsized":"2024-04-25T13:42:59.196561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:45.963322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.201711+0000","last_change":"2024-04-25T13:42:09.054656+0000","last_active":"2024-04-25T13:42:59.201711+0000","last_peered":"2024-04-25T13:42:59.201711+0000","last_clean":"2024-04-25T13:42:59.201711+0000","last_became_active":"2024-04-25T13:42:09.054276+0000","last_became_peered":"2024-04-25T13:42:09.054276+0000","last_unstale":"2024-04-25T13:42:59.201711+0000","last_undegraded":"2024-04-25T13:42:59.201711+0000","last_fullsized":"2024-04-25T13:42:59.201711+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:19.818362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747133+0000","last_change":"2024-04-25T13:42:09.054227+0000","last_active":"2024-04-25T13:42:59.747133+0000","last_peered":"2024-04-25T13:42:59.747133+0000","last_clean":"2024-04-25T13:42:59.747133+0000","last_became_active":"2024-04-25T13:42:09.051893+0000","last_became_peered":"2024-04-25T13:42:09.051893+0000","last_unstale":"2024-04-25T13:42:59.747133+0000","last_undegraded":"2024-04-25T13:42:59.747133+0000","last_fullsized":"2024-04-25T13:42:59.747133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:37.120057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198612+0000","last_change":"2024-04-25T13:42:09.039618+0000","last_active":"2024-04-25T13:42:59.198612+0000","last_peered":"2024-04-25T13:42:59.198612+0000","last_clean":"2024-04-25T13:42:59.198612+0000","last_became_active":"2024-04-25T13:42:09.039264+0000","last_became_peered":"2024-04-25T13:42:09.039264+0000","last_unstale":"2024-04-25T13:42:59.198612+0000","last_undegraded":"2024-04-25T13:42:59.198612+0000","last_fullsized":"2024-04-25T13:42:59.198612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:50.352365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197468+0000","last_change":"2024-04-25T13:42:09.037323+0000","last_active":"2024-04-25T13:42:59.197468+0000","last_peered":"2024-04-25T13:42:59.197468+0000","last_clean":"2024-04-25T13:42:59.197468+0000","last_became_active":"2024-04-25T13:42:09.036614+0000","last_became_peered":"2024-04-25T13:42:09.036614+0000","last_unstale":"2024-04-25T13:42:59.197468+0000","last_undegraded":"2024-04-25T13:42:59.197468+0000","last_fullsized":"2024-04-25T13:42:59.197468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:09.872287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202545+0000","last_change":"2024-04-25T13:42:09.056812+0000","last_active":"2024-04-25T13:42:59.202545+0000","last_peered":"2024-04-25T13:42:59.202545+0000","last_clean":"2024-04-25T13:42:59.202545+0000","last_became_active":"2024-04-25T13:42:09.054990+0000","last_became_peered":"2024-04-25T13:42:09.054990+0000","last_unstale":"2024-04-25T13:42:59.202545+0000","last_undegraded":"2024-04-25T13:42:59.202545+0000","last_fullsized":"2024-04-25T13:42:59.202545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:30.855059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.203368+0000","last_change":"2024-04-25T13:42:59.202829+0000","last_active":"2024-04-25T13:42:59.203368+0000","last_peered":"2024-04-25T13:42:59.203368+0000","last_clean":"2024-04-25T13:42:59.203368+0000","last_became_active":"2024-04-25T13:42:59.202386+0000","last_became_peered":"2024-04-25T13:42:59.202386+0000","last_unstale":"2024-04-25T13:42:59.203368+0000","last_undegraded":"2024-04-25T13:42:59.203368+0000","last_fullsized":"2024-04-25T13:42:59.203368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:47.195497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193443+0000","last_change":"2024-04-25T13:42:09.043105+0000","last_active":"2024-04-25T13:42:59.193443+0000","last_peered":"2024-04-25T13:42:59.193443+0000","last_clean":"2024-04-25T13:42:59.193443+0000","last_became_active":"2024-04-25T13:42:09.042457+0000","last_became_peered":"2024-04-25T13:42:09.042457+0000","last_unstale":"2024-04-25T13:42:59.193443+0000","last_undegraded":"2024-04-25T13:42:59.193443+0000","last_fullsized":"2024-04-25T13:42:59.193443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:58.924985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198422+0000","last_change":"2024-04-25T13:42:09.046658+0000","last_active":"2024-04-25T13:42:59.198422+0000","last_peered":"2024-04-25T13:42:59.198422+0000","last_clean":"2024-04-25T13:42:59.198422+0000","last_became_active":"2024-04-25T13:42:09.046323+0000","last_became_peered":"2024-04-25T13:42:09.046323+0000","last_unstale":"2024-04-25T13:42:59.198422+0000","last_undegraded":"2024-04-25T13:42:59.198422+0000","last_fullsized":"2024-04-25T13:42:59.198422+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:51.362734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198164+0000","last_change":"2024-04-25T13:42:09.049787+0000","last_active":"2024-04-25T13:42:59.198164+0000","last_peered":"2024-04-25T13:42:59.198164+0000","last_clean":"2024-04-25T13:42:59.198164+0000","last_became_active":"2024-04-25T13:42:09.049432+0000","last_became_peered":"2024-04-25T13:42:09.049432+0000","last_unstale":"2024-04-25T13:42:59.198164+0000","last_undegraded":"2024-04-25T13:42:59.198164+0000","last_fullsized":"2024-04-25T13:42:59.198164+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:23.507471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197077+0000","last_change":"2024-04-25T13:42:09.060318+0000","last_active":"2024-04-25T13:42:59.197077+0000","last_peered":"2024-04-25T13:42:59.197077+0000","last_clean":"2024-04-25T13:42:59.197077+0000","last_became_active":"2024-04-25T13:42:09.059948+0000","last_became_peered":"2024-04-25T13:42:09.059948+0000","last_unstale":"2024-04-25T13:42:59.197077+0000","last_undegraded":"2024-04-25T13:42:59.197077+0000","last_fullsized":"2024-04-25T13:42:59.197077+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:10.840181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.194982+0000","last_change":"2024-04-25T13:42:09.060432+0000","last_active":"2024-04-25T13:42:59.194982+0000","last_peered":"2024-04-25T13:42:59.194982+0000","last_clean":"2024-04-25T13:42:59.194982+0000","last_became_active":"2024-04-25T13:42:09.059525+0000","last_became_peered":"2024-04-25T13:42:09.059525+0000","last_unstale":"2024-04-25T13:42:59.194982+0000","last_undegraded":"2024-04-25T13:42:59.194982+0000","last_fullsized":"2024-04-25T13:42:59.194982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:46:41.360324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.200334+0000","last_change":"2024-04-25T13:42:09.035591+0000","last_active":"2024-04-25T13:42:59.200334+0000","last_peered":"2024-04-25T13:42:59.200334+0000","last_clean":"2024-04-25T13:42:59.200334+0000","last_became_active":"2024-04-25T13:42:09.035219+0000","last_became_peered":"2024-04-25T13:42:09.035219+0000","last_unstale":"2024-04-25T13:42:59.200334+0000","last_undegraded":"2024-04-25T13:42:59.200334+0000","last_fullsized":"2024-04-25T13:42:59.200334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:35:04.362044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.204803+0000","last_change":"2024-04-25T13:42:09.057623+0000","last_active":"2024-04-25T13:42:59.204803+0000","last_peered":"2024-04-25T13:42:59.204803+0000","last_clean":"2024-04-25T13:42:59.204803+0000","last_became_active":"2024-04-25T13:42:09.057276+0000","last_became_peered":"2024-04-25T13:42:09.057276+0000","last_unstale":"2024-04-25T13:42:59.204803+0000","last_undegraded":"2024-04-25T13:42:59.204803+0000","last_fullsized":"2024-04-25T13:42:59.204803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:28.975079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.204270+0000","last_change":"2024-04-25T13:42:13.081052+0000","last_active":"2024-04-25T13:42:59.204270+0000","last_peered":"2024-04-25T13:42:59.204270+0000","last_clean":"2024-04-25T13:42:59.204270+0000","last_became_active":"2024-04-25T13:42:13.080546+0000","last_became_peered":"2024-04-25T13:42:13.080546+0000","last_unstale":"2024-04-25T13:42:59.204270+0000","last_undegraded":"2024-04-25T13:42:59.204270+0000","last_fullsized":"2024-04-25T13:42:59.204270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:59.648007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.200762+0000","last_change":"2024-04-25T13:42:08.040591+0000","last_active":"2024-04-25T13:42:59.200762+0000","last_peered":"2024-04-25T13:42:59.200762+0000","last_clean":"2024-04-25T13:42:59.200762+0000","last_became_active":"2024-04-25T13:42:08.040221+0000","last_became_peered":"2024-04-25T13:42:08.040221+0000","last_unstale":"2024-04-25T13:42:59.200762+0000","last_undegraded":"2024-04-25T13:42:59.200762+0000","last_fullsized":"2024-04-25T13:42:59.200762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:09.755426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747515+0000","last_change":"2024-04-25T13:42:09.061907+0000","last_active":"2024-04-25T13:42:59.747515+0000","last_peered":"2024-04-25T13:42:59.747515+0000","last_clean":"2024-04-25T13:42:59.747515+0000","last_became_active":"2024-04-25T13:42:09.061520+0000","last_became_peered":"2024-04-25T13:42:09.061520+0000","last_unstale":"2024-04-25T13:42:59.747515+0000","last_undegraded":"2024-04-25T13:42:59.747515+0000","last_fullsized":"2024-04-25T13:42:59.747515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:45.549889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.247901+0000","last_change":"2024-04-25T13:42:13.080709+0000","last_active":"2024-04-25T13:42:59.247901+0000","last_peered":"2024-04-25T13:42:59.247901+0000","last_clean":"2024-04-25T13:42:59.247901+0000","last_became_active":"2024-04-25T13:42:13.080234+0000","last_became_peered":"2024-04-25T13:42:13.080234+0000","last_unstale":"2024-04-25T13:42:59.247901+0000","last_undegraded":"2024-04-25T13:42:59.247901+0000","last_fullsized":"2024-04-25T13:42:59.247901+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:29.231166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747792+0000","last_change":"2024-04-25T13:42:08.044450+0000","last_active":"2024-04-25T13:42:59.747792+0000","last_peered":"2024-04-25T13:42:59.747792+0000","last_clean":"2024-04-25T13:42:59.747792+0000","last_became_active":"2024-04-25T13:42:08.043674+0000","last_became_peered":"2024-04-25T13:42:08.043674+0000","last_unstale":"2024-04-25T13:42:59.747792+0000","last_undegraded":"2024-04-25T13:42:59.747792+0000","last_fullsized":"2024-04-25T13:42:59.747792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:12.784756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199916+0000","last_change":"2024-04-25T13:42:09.060369+0000","last_active":"2024-04-25T13:42:59.199916+0000","last_peered":"2024-04-25T13:42:59.199916+0000","last_clean":"2024-04-25T13:42:59.199916+0000","last_became_active":"2024-04-25T13:42:09.060002+0000","last_became_peered":"2024-04-25T13:42:09.060002+0000","last_unstale":"2024-04-25T13:42:59.199916+0000","last_undegraded":"2024-04-25T13:42:59.199916+0000","last_fullsized":"2024-04-25T13:42:59.199916+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:26.601583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.248401+0000","last_change":"2024-04-25T13:42:13.083165+0000","last_active":"2024-04-25T13:42:59.248401+0000","last_peered":"2024-04-25T13:42:59.248401+0000","last_clean":"2024-04-25T13:42:59.248401+0000","last_became_active":"2024-04-25T13:42:13.082767+0000","last_became_peered":"2024-04-25T13:42:13.082767+0000","last_unstale":"2024-04-25T13:42:59.248401+0000","last_undegraded":"2024-04-25T13:42:59.248401+0000","last_fullsized":"2024-04-25T13:42:59.248401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:35.559831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198093+0000","last_change":"2024-04-25T13:42:08.041789+0000","last_active":"2024-04-25T13:42:59.198093+0000","last_peered":"2024-04-25T13:42:59.198093+0000","last_clean":"2024-04-25T13:42:59.198093+0000","last_became_active":"2024-04-25T13:42:08.041371+0000","last_became_peered":"2024-04-25T13:42:08.041371+0000","last_unstale":"2024-04-25T13:42:59.198093+0000","last_undegraded":"2024-04-25T13:42:59.198093+0000","last_fullsized":"2024-04-25T13:42:59.198093+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:33.748758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198430+0000","last_change":"2024-04-25T13:42:09.045209+0000","last_active":"2024-04-25T13:42:59.198430+0000","last_peered":"2024-04-25T13:42:59.198430+0000","last_clean":"2024-04-25T13:42:59.198430+0000","last_became_active":"2024-04-25T13:42:09.044750+0000","last_became_peered":"2024-04-25T13:42:09.044750+0000","last_unstale":"2024-04-25T13:42:59.198430+0000","last_undegraded":"2024-04-25T13:42:59.198430+0000","last_fullsized":"2024-04-25T13:42:59.198430+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:03.279395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.247871+0000","last_change":"2024-04-25T13:42:13.083154+0000","last_active":"2024-04-25T13:42:59.247871+0000","last_peered":"2024-04-25T13:42:59.247871+0000","last_clean":"2024-04-25T13:42:59.247871+0000","last_became_active":"2024-04-25T13:42:13.082679+0000","last_became_peered":"2024-04-25T13:42:13.082679+0000","last_unstale":"2024-04-25T13:42:59.247871+0000","last_undegraded":"2024-04-25T13:42:59.247871+0000","last_fullsized":"2024-04-25T13:42:59.247871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:14.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.209147+0000","last_change":"2024-04-25T13:42:59.208488+0000","last_active":"2024-04-25T13:42:59.209147+0000","last_peered":"2024-04-25T13:42:59.209147+0000","last_clean":"2024-04-25T13:42:59.209147+0000","last_became_active":"2024-04-25T13:42:59.203828+0000","last_became_peered":"2024-04-25T13:42:59.203828+0000","last_unstale":"2024-04-25T13:42:59.209147+0000","last_undegraded":"2024-04-25T13:42:59.209147+0000","last_fullsized":"2024-04-25T13:42:59.209147+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:22.094449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198912+0000","last_change":"2024-04-25T13:42:09.038159+0000","last_active":"2024-04-25T13:42:59.198912+0000","last_peered":"2024-04-25T13:42:59.198912+0000","last_clean":"2024-04-25T13:42:59.198912+0000","last_became_active":"2024-04-25T13:42:09.037702+0000","last_became_peered":"2024-04-25T13:42:09.037702+0000","last_unstale":"2024-04-25T13:42:59.198912+0000","last_undegraded":"2024-04-25T13:42:59.198912+0000","last_fullsized":"2024-04-25T13:42:59.198912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:44.856392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.204632+0000","last_change":"2024-04-25T13:42:13.074307+0000","last_active":"2024-04-25T13:42:59.204632+0000","last_peered":"2024-04-25T13:42:59.204632+0000","last_clean":"2024-04-25T13:42:59.204632+0000","last_became_active":"2024-04-25T13:42:13.073665+0000","last_became_peered":"2024-04-25T13:42:13.073665+0000","last_unstale":"2024-04-25T13:42:59.204632+0000","last_undegraded":"2024-04-25T13:42:59.204632+0000","last_fullsized":"2024-04-25T13:42:59.204632+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:24.652912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":121,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:43:48.283891+0000","last_change":"2024-04-25T13:42:59.212984+0000","last_active":"2024-04-25T13:43:48.283891+0000","last_peered":"2024-04-25T13:43:48.283891+0000","last_clean":"2024-04-25T13:43:48.283891+0000","last_became_active":"2024-04-25T13:42:59.205743+0000","last_became_peered":"2024-04-25T13:42:59.205743+0000","last_unstale":"2024-04-25T13:43:48.283891+0000","last_undegraded":"2024-04-25T13:43:48.283891+0000","last_fullsized":"2024-04-25T13:43:48.283891+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:51.023051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.196528+0000","last_change":"2024-04-25T13:42:09.037183+0000","last_active":"2024-04-25T13:42:59.196528+0000","last_peered":"2024-04-25T13:42:59.196528+0000","last_clean":"2024-04-25T13:42:59.196528+0000","last_became_active":"2024-04-25T13:42:09.036778+0000","last_became_peered":"2024-04-25T13:42:09.036778+0000","last_unstale":"2024-04-25T13:42:59.196528+0000","last_undegraded":"2024-04-25T13:42:59.196528+0000","last_fullsized":"2024-04-25T13:42:59.196528+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:24:20.009326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.210633+0000","last_change":"2024-04-25T13:42:59.210633+0000","last_active":"2024-04-25T13:42:59.210633+0000","last_peered":"2024-04-25T13:42:59.210633+0000","last_clean":"2024-04-25T13:42:59.210633+0000","last_became_active":"2024-04-25T13:42:59.210053+0000","last_became_peered":"2024-04-25T13:42:59.210053+0000","last_unstale":"2024-04-25T13:42:59.210633+0000","last_undegraded":"2024-04-25T13:42:59.210633+0000","last_fullsized":"2024-04-25T13:42:59.210633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:08:28.115422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.196692+0000","last_change":"2024-04-25T13:42:08.037902+0000","last_active":"2024-04-25T13:42:59.196692+0000","last_peered":"2024-04-25T13:42:59.196692+0000","last_clean":"2024-04-25T13:42:59.196692+0000","last_became_active":"2024-04-25T13:42:08.037284+0000","last_became_peered":"2024-04-25T13:42:08.037284+0000","last_unstale":"2024-04-25T13:42:59.196692+0000","last_undegraded":"2024-04-25T13:42:59.196692+0000","last_fullsized":"2024-04-25T13:42:59.196692+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:10.374637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198884+0000","last_change":"2024-04-25T13:42:09.057856+0000","last_active":"2024-04-25T13:42:59.198884+0000","last_peered":"2024-04-25T13:42:59.198884+0000","last_clean":"2024-04-25T13:42:59.198884+0000","last_became_active":"2024-04-25T13:42:09.057464+0000","last_became_peered":"2024-04-25T13:42:09.057464+0000","last_unstale":"2024-04-25T13:42:59.198884+0000","last_undegraded":"2024-04-25T13:42:59.198884+0000","last_fullsized":"2024-04-25T13:42:59.198884+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:03.403058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.249824+0000","last_change":"2024-04-25T13:42:59.249824+0000","last_active":"2024-04-25T13:42:59.249824+0000","last_peered":"2024-04-25T13:42:59.249824+0000","last_clean":"2024-04-25T13:42:59.249824+0000","last_became_active":"2024-04-25T13:42:59.249260+0000","last_became_peered":"2024-04-25T13:42:59.249260+0000","last_unstale":"2024-04-25T13:42:59.249824+0000","last_undegraded":"2024-04-25T13:42:59.249824+0000","last_fullsized":"2024-04-25T13:42:59.249824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:41.905531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193193+0000","last_change":"2024-04-25T13:42:08.030750+0000","last_active":"2024-04-25T13:42:59.193193+0000","last_peered":"2024-04-25T13:42:59.193193+0000","last_clean":"2024-04-25T13:42:59.193193+0000","last_became_active":"2024-04-25T13:42:08.030353+0000","last_became_peered":"2024-04-25T13:42:08.030353+0000","last_unstale":"2024-04-25T13:42:59.193193+0000","last_undegraded":"2024-04-25T13:42:59.193193+0000","last_fullsized":"2024-04-25T13:42:59.193193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:11.658589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747263+0000","last_change":"2024-04-25T13:42:09.048800+0000","last_active":"2024-04-25T13:42:59.747263+0000","last_peered":"2024-04-25T13:42:59.747263+0000","last_clean":"2024-04-25T13:42:59.747263+0000","last_became_active":"2024-04-25T13:42:09.047777+0000","last_became_peered":"2024-04-25T13:42:09.047777+0000","last_unstale":"2024-04-25T13:42:59.747263+0000","last_undegraded":"2024-04-25T13:42:59.747263+0000","last_fullsized":"2024-04-25T13:42:59.747263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:44.739359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.200798+0000","last_change":"2024-04-25T13:42:13.073583+0000","last_active":"2024-04-25T13:42:59.200798+0000","last_peered":"2024-04-25T13:42:59.200798+0000","last_clean":"2024-04-25T13:42:59.200798+0000","last_became_active":"2024-04-25T13:42:13.073154+0000","last_became_peered":"2024-04-25T13:42:13.073154+0000","last_unstale":"2024-04-25T13:42:59.200798+0000","last_undegraded":"2024-04-25T13:42:59.200798+0000","last_fullsized":"2024-04-25T13:42:59.200798+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:42.720347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199352+0000","last_change":"2024-04-25T13:42:08.035263+0000","last_active":"2024-04-25T13:42:59.199352+0000","last_peered":"2024-04-25T13:42:59.199352+0000","last_clean":"2024-04-25T13:42:59.199352+0000","last_became_active":"2024-04-25T13:42:08.034903+0000","last_became_peered":"2024-04-25T13:42:08.034903+0000","last_unstale":"2024-04-25T13:42:59.199352+0000","last_undegraded":"2024-04-25T13:42:59.199352+0000","last_fullsized":"2024-04-25T13:42:59.199352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:22.715159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199169+0000","last_change":"2024-04-25T13:42:09.037640+0000","last_active":"2024-04-25T13:42:59.199169+0000","last_peered":"2024-04-25T13:42:59.199169+0000","last_clean":"2024-04-25T13:42:59.199169+0000","last_became_active":"2024-04-25T13:42:09.037286+0000","last_became_peered":"2024-04-25T13:42:09.037286+0000","last_unstale":"2024-04-25T13:42:59.199169+0000","last_undegraded":"2024-04-25T13:42:59.199169+0000","last_fullsized":"2024-04-25T13:42:59.199169+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:28.704489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747124+0000","last_change":"2024-04-25T13:42:13.079379+0000","last_active":"2024-04-25T13:42:59.747124+0000","last_peered":"2024-04-25T13:42:59.747124+0000","last_clean":"2024-04-25T13:42:59.747124+0000","last_became_active":"2024-04-25T13:42:13.078771+0000","last_became_peered":"2024-04-25T13:42:13.078771+0000","last_unstale":"2024-04-25T13:42:59.747124+0000","last_undegraded":"2024-04-25T13:42:59.747124+0000","last_fullsized":"2024-04-25T13:42:59.747124+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:35.955154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:43:44.277345+0000","last_change":"2024-04-25T13:42:08.032562+0000","last_active":"2024-04-25T13:43:44.277345+0000","last_peered":"2024-04-25T13:43:44.277345+0000","last_clean":"2024-04-25T13:43:44.277345+0000","last_became_active":"2024-04-25T13:42:08.032090+0000","last_became_peered":"2024-04-25T13:42:08.032090+0000","last_unstale":"2024-04-25T13:43:44.277345+0000","last_undegraded":"2024-04-25T13:43:44.277345+0000","last_fullsized":"2024-04-25T13:43:44.277345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:13:52.822642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198524+0000","last_change":"2024-04-25T13:42:09.041724+0000","last_active":"2024-04-25T13:42:59.198524+0000","last_peered":"2024-04-25T13:42:59.198524+0000","last_clean":"2024-04-25T13:42:59.198524+0000","last_became_active":"2024-04-25T13:42:09.041386+0000","last_became_peered":"2024-04-25T13:42:09.041386+0000","last_unstale":"2024-04-25T13:42:59.198524+0000","last_undegraded":"2024-04-25T13:42:59.198524+0000","last_fullsized":"2024-04-25T13:42:59.198524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:29.676814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198593+0000","last_change":"2024-04-25T13:42:13.075365+0000","last_active":"2024-04-25T13:42:59.198593+0000","last_peered":"2024-04-25T13:42:59.198593+0000","last_clean":"2024-04-25T13:42:59.198593+0000","last_became_active":"2024-04-25T13:42:13.074886+0000","last_became_peered":"2024-04-25T13:42:13.074886+0000","last_unstale":"2024-04-25T13:42:59.198593+0000","last_undegraded":"2024-04-25T13:42:59.198593+0000","last_fullsized":"2024-04-25T13:42:59.198593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:30.647002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202816+0000","last_change":"2024-04-25T13:42:08.036830+0000","last_active":"2024-04-25T13:42:59.202816+0000","last_peered":"2024-04-25T13:42:59.202816+0000","last_clean":"2024-04-25T13:42:59.202816+0000","last_became_active":"2024-04-25T13:42:08.036418+0000","last_became_peered":"2024-04-25T13:42:08.036418+0000","last_unstale":"2024-04-25T13:42:59.202816+0000","last_undegraded":"2024-04-25T13:42:59.202816+0000","last_fullsized":"2024-04-25T13:42:59.202816+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:06.402677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199790+0000","last_change":"2024-04-25T13:42:09.063305+0000","last_active":"2024-04-25T13:42:59.199790+0000","last_peered":"2024-04-25T13:42:59.199790+0000","last_clean":"2024-04-25T13:42:59.199790+0000","last_became_active":"2024-04-25T13:42:09.062961+0000","last_became_peered":"2024-04-25T13:42:09.062961+0000","last_unstale":"2024-04-25T13:42:59.199790+0000","last_undegraded":"2024-04-25T13:42:59.199790+0000","last_fullsized":"2024-04-25T13:42:59.199790+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:34.653515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.248331+0000","last_change":"2024-04-25T13:42:13.073271+0000","last_active":"2024-04-25T13:42:59.248331+0000","last_peered":"2024-04-25T13:42:59.248331+0000","last_clean":"2024-04-25T13:42:59.248331+0000","last_became_active":"2024-04-25T13:42:13.072800+0000","last_became_peered":"2024-04-25T13:42:13.072800+0000","last_unstale":"2024-04-25T13:42:59.248331+0000","last_undegraded":"2024-04-25T13:42:59.248331+0000","last_fullsized":"2024-04-25T13:42:59.248331+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:40.115311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197611+0000","last_change":"2024-04-25T13:42:08.032607+0000","last_active":"2024-04-25T13:42:59.197611+0000","last_peered":"2024-04-25T13:42:59.197611+0000","last_clean":"2024-04-25T13:42:59.197611+0000","last_became_active":"2024-04-25T13:42:08.031474+0000","last_became_peered":"2024-04-25T13:42:08.031474+0000","last_unstale":"2024-04-25T13:42:59.197611+0000","last_undegraded":"2024-04-25T13:42:59.197611+0000","last_fullsized":"2024-04-25T13:42:59.197611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:02:37.648480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198585+0000","last_change":"2024-04-25T13:42:09.043148+0000","last_active":"2024-04-25T13:42:59.198585+0000","last_peered":"2024-04-25T13:42:59.198585+0000","last_clean":"2024-04-25T13:42:59.198585+0000","last_became_active":"2024-04-25T13:42:09.042787+0000","last_became_peered":"2024-04-25T13:42:09.042787+0000","last_unstale":"2024-04-25T13:42:59.198585+0000","last_undegraded":"2024-04-25T13:42:59.198585+0000","last_fullsized":"2024-04-25T13:42:59.198585+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:29.318123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198914+0000","last_change":"2024-04-25T13:42:13.076116+0000","last_active":"2024-04-25T13:42:59.198914+0000","last_peered":"2024-04-25T13:42:59.198914+0000","last_clean":"2024-04-25T13:42:59.198914+0000","last_became_active":"2024-04-25T13:42:13.075592+0000","last_became_peered":"2024-04-25T13:42:13.075592+0000","last_unstale":"2024-04-25T13:42:59.198914+0000","last_undegraded":"2024-04-25T13:42:59.198914+0000","last_fullsized":"2024-04-25T13:42:59.198914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:06.496966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":227,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:43:45.326892+0000","last_change":"2024-04-25T13:42:59.257852+0000","last_active":"2024-04-25T13:43:45.326892+0000","last_peered":"2024-04-25T13:43:45.326892+0000","last_clean":"2024-04-25T13:43:45.326892+0000","last_became_active":"2024-04-25T13:42:59.250778+0000","last_became_peered":"2024-04-25T13:42:59.250778+0000","last_unstale":"2024-04-25T13:43:45.326892+0000","last_undegraded":"2024-04-25T13:43:45.326892+0000","last_fullsized":"2024-04-25T13:43:45.326892+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:03.171663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62333,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":35,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":60681,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197936+0000","last_change":"2024-04-25T13:42:09.052062+0000","last_active":"2024-04-25T13:42:59.197936+0000","last_peered":"2024-04-25T13:42:59.197936+0000","last_clean":"2024-04-25T13:42:59.197936+0000","last_became_active":"2024-04-25T13:42:09.051642+0000","last_became_peered":"2024-04-25T13:42:09.051642+0000","last_unstale":"2024-04-25T13:42:59.197936+0000","last_undegraded":"2024-04-25T13:42:59.197936+0000","last_fullsized":"2024-04-25T13:42:59.197936+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:31.228502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199278+0000","last_change":"2024-04-25T13:42:13.083232+0000","last_active":"2024-04-25T13:42:59.199278+0000","last_peered":"2024-04-25T13:42:59.199278+0000","last_clean":"2024-04-25T13:42:59.199278+0000","last_became_active":"2024-04-25T13:42:13.082708+0000","last_became_peered":"2024-04-25T13:42:13.082708+0000","last_unstale":"2024-04-25T13:42:59.199278+0000","last_undegraded":"2024-04-25T13:42:59.199278+0000","last_fullsized":"2024-04-25T13:42:59.199278+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:07.302207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.204358+0000","last_change":"2024-04-25T13:42:08.043775+0000","last_active":"2024-04-25T13:42:59.204358+0000","last_peered":"2024-04-25T13:42:59.204358+0000","last_clean":"2024-04-25T13:42:59.204358+0000","last_became_active":"2024-04-25T13:42:08.043399+0000","last_became_peered":"2024-04-25T13:42:08.043399+0000","last_unstale":"2024-04-25T13:42:59.204358+0000","last_undegraded":"2024-04-25T13:42:59.204358+0000","last_fullsized":"2024-04-25T13:42:59.204358+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:41.768248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193223+0000","last_change":"2024-04-25T13:42:09.051145+0000","last_active":"2024-04-25T13:42:59.193223+0000","last_peered":"2024-04-25T13:42:59.193223+0000","last_clean":"2024-04-25T13:42:59.193223+0000","last_became_active":"2024-04-25T13:42:09.050796+0000","last_became_peered":"2024-04-25T13:42:09.050796+0000","last_unstale":"2024-04-25T13:42:59.193223+0000","last_undegraded":"2024-04-25T13:42:59.193223+0000","last_fullsized":"2024-04-25T13:42:59.193223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:37.195227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.194562+0000","last_change":"2024-04-25T13:42:13.079728+0000","last_active":"2024-04-25T13:42:59.194562+0000","last_peered":"2024-04-25T13:42:59.194562+0000","last_clean":"2024-04-25T13:42:59.194562+0000","last_became_active":"2024-04-25T13:42:13.079198+0000","last_became_peered":"2024-04-25T13:42:13.079198+0000","last_unstale":"2024-04-25T13:42:59.194562+0000","last_undegraded":"2024-04-25T13:42:59.194562+0000","last_fullsized":"2024-04-25T13:42:59.194562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:25.267778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198702+0000","last_change":"2024-04-25T13:42:08.043885+0000","last_active":"2024-04-25T13:42:59.198702+0000","last_peered":"2024-04-25T13:42:59.198702+0000","last_clean":"2024-04-25T13:42:59.198702+0000","last_became_active":"2024-04-25T13:42:08.043363+0000","last_became_peered":"2024-04-25T13:42:08.043363+0000","last_unstale":"2024-04-25T13:42:59.198702+0000","last_undegraded":"2024-04-25T13:42:59.198702+0000","last_fullsized":"2024-04-25T13:42:59.198702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:42.592286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202215+0000","last_change":"2024-04-25T13:42:09.054000+0000","last_active":"2024-04-25T13:42:59.202215+0000","last_peered":"2024-04-25T13:42:59.202215+0000","last_clean":"2024-04-25T13:42:59.202215+0000","last_became_active":"2024-04-25T13:42:09.053538+0000","last_became_peered":"2024-04-25T13:42:09.053538+0000","last_unstale":"2024-04-25T13:42:59.202215+0000","last_undegraded":"2024-04-25T13:42:59.202215+0000","last_fullsized":"2024-04-25T13:42:59.202215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:47.504591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.200255+0000","last_change":"2024-04-25T13:42:13.086157+0000","last_active":"2024-04-25T13:42:59.200255+0000","last_peered":"2024-04-25T13:42:59.200255+0000","last_clean":"2024-04-25T13:42:59.200255+0000","last_became_active":"2024-04-25T13:42:13.085613+0000","last_became_peered":"2024-04-25T13:42:13.085613+0000","last_unstale":"2024-04-25T13:42:59.200255+0000","last_undegraded":"2024-04-25T13:42:59.200255+0000","last_fullsized":"2024-04-25T13:42:59.200255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:11.707675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:43:48.283352+0000","last_change":"2024-04-25T13:42:08.034028+0000","last_active":"2024-04-25T13:43:48.283352+0000","last_peered":"2024-04-25T13:43:48.283352+0000","last_clean":"2024-04-25T13:43:48.283352+0000","last_became_active":"2024-04-25T13:42:08.033641+0000","last_became_peered":"2024-04-25T13:42:08.033641+0000","last_unstale":"2024-04-25T13:43:48.283352+0000","last_undegraded":"2024-04-25T13:43:48.283352+0000","last_fullsized":"2024-04-25T13:43:48.283352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:34.081325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":77,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202141+0000","last_change":"2024-04-25T13:42:09.054594+0000","last_active":"2024-04-25T13:42:59.202141+0000","last_peered":"2024-04-25T13:42:59.202141+0000","last_clean":"2024-04-25T13:42:59.202141+0000","last_became_active":"2024-04-25T13:42:09.054215+0000","last_became_peered":"2024-04-25T13:42:09.054215+0000","last_unstale":"2024-04-25T13:42:59.202141+0000","last_undegraded":"2024-04-25T13:42:59.202141+0000","last_fullsized":"2024-04-25T13:42:59.202141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:56.129188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193760+0000","last_change":"2024-04-25T13:42:13.081325+0000","last_active":"2024-04-25T13:42:59.193760+0000","last_peered":"2024-04-25T13:42:59.193760+0000","last_clean":"2024-04-25T13:42:59.193760+0000","last_became_active":"2024-04-25T13:42:13.080641+0000","last_became_peered":"2024-04-25T13:42:13.080641+0000","last_unstale":"2024-04-25T13:42:59.193760+0000","last_undegraded":"2024-04-25T13:42:59.193760+0000","last_fullsized":"2024-04-25T13:42:59.193760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:45.839180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.195575+0000","last_change":"2024-04-25T13:42:08.037915+0000","last_active":"2024-04-25T13:42:59.195575+0000","last_peered":"2024-04-25T13:42:59.195575+0000","last_clean":"2024-04-25T13:42:59.195575+0000","last_became_active":"2024-04-25T13:42:08.037324+0000","last_became_peered":"2024-04-25T13:42:08.037324+0000","last_unstale":"2024-04-25T13:42:59.195575+0000","last_undegraded":"2024-04-25T13:42:59.195575+0000","last_fullsized":"2024-04-25T13:42:59.195575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:38.842821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198099+0000","last_change":"2024-04-25T13:42:09.038795+0000","last_active":"2024-04-25T13:42:59.198099+0000","last_peered":"2024-04-25T13:42:59.198099+0000","last_clean":"2024-04-25T13:42:59.198099+0000","last_became_active":"2024-04-25T13:42:09.037635+0000","last_became_peered":"2024-04-25T13:42:09.037635+0000","last_unstale":"2024-04-25T13:42:59.198099+0000","last_undegraded":"2024-04-25T13:42:59.198099+0000","last_fullsized":"2024-04-25T13:42:59.198099+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:46.616137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197995+0000","last_change":"2024-04-25T13:42:13.081548+0000","last_active":"2024-04-25T13:42:59.197995+0000","last_peered":"2024-04-25T13:42:59.197995+0000","last_clean":"2024-04-25T13:42:59.197995+0000","last_became_active":"2024-04-25T13:42:13.080827+0000","last_became_peered":"2024-04-25T13:42:13.080827+0000","last_unstale":"2024-04-25T13:42:59.197995+0000","last_undegraded":"2024-04-25T13:42:59.197995+0000","last_fullsized":"2024-04-25T13:42:59.197995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:04.265824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.196299+0000","last_change":"2024-04-25T13:42:08.034171+0000","last_active":"2024-04-25T13:42:59.196299+0000","last_peered":"2024-04-25T13:42:59.196299+0000","last_clean":"2024-04-25T13:42:59.196299+0000","last_became_active":"2024-04-25T13:42:08.033769+0000","last_became_peered":"2024-04-25T13:42:08.033769+0000","last_unstale":"2024-04-25T13:42:59.196299+0000","last_undegraded":"2024-04-25T13:42:59.196299+0000","last_fullsized":"2024-04-25T13:42:59.196299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:18.702989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.195010+0000","last_change":"2024-04-25T13:42:09.032212+0000","last_active":"2024-04-25T13:42:59.195010+0000","last_peered":"2024-04-25T13:42:59.195010+0000","last_clean":"2024-04-25T13:42:59.195010+0000","last_became_active":"2024-04-25T13:42:09.031833+0000","last_became_peered":"2024-04-25T13:42:09.031833+0000","last_unstale":"2024-04-25T13:42:59.195010+0000","last_undegraded":"2024-04-25T13:42:59.195010+0000","last_fullsized":"2024-04-25T13:42:59.195010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:27.681540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.196361+0000","last_change":"2024-04-25T13:42:13.097322+0000","last_active":"2024-04-25T13:42:59.196361+0000","last_peered":"2024-04-25T13:42:59.196361+0000","last_clean":"2024-04-25T13:42:59.196361+0000","last_became_active":"2024-04-25T13:42:13.096869+0000","last_became_peered":"2024-04-25T13:42:13.096869+0000","last_unstale":"2024-04-25T13:42:59.196361+0000","last_undegraded":"2024-04-25T13:42:59.196361+0000","last_fullsized":"2024-04-25T13:42:59.196361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:53.041859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.200516+0000","last_change":"2024-04-25T13:42:08.041834+0000","last_active":"2024-04-25T13:42:59.200516+0000","last_peered":"2024-04-25T13:42:59.200516+0000","last_clean":"2024-04-25T13:42:59.200516+0000","last_became_active":"2024-04-25T13:42:08.041246+0000","last_became_peered":"2024-04-25T13:42:08.041246+0000","last_unstale":"2024-04-25T13:42:59.200516+0000","last_undegraded":"2024-04-25T13:42:59.200516+0000","last_fullsized":"2024-04-25T13:42:59.200516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:34.256539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.196878+0000","last_change":"2024-04-25T13:42:09.044640+0000","last_active":"2024-04-25T13:42:59.196878+0000","last_peered":"2024-04-25T13:42:59.196878+0000","last_clean":"2024-04-25T13:42:59.196878+0000","last_became_active":"2024-04-25T13:42:09.044267+0000","last_became_peered":"2024-04-25T13:42:09.044267+0000","last_unstale":"2024-04-25T13:42:59.196878+0000","last_undegraded":"2024-04-25T13:42:59.196878+0000","last_fullsized":"2024-04-25T13:42:59.196878+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:47.934990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193690+0000","last_change":"2024-04-25T13:42:13.065858+0000","last_active":"2024-04-25T13:42:59.193690+0000","last_peered":"2024-04-25T13:42:59.193690+0000","last_clean":"2024-04-25T13:42:59.193690+0000","last_became_active":"2024-04-25T13:42:13.065315+0000","last_became_peered":"2024-04-25T13:42:13.065315+0000","last_unstale":"2024-04-25T13:42:59.193690+0000","last_undegraded":"2024-04-25T13:42:59.193690+0000","last_fullsized":"2024-04-25T13:42:59.193690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:41.116887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.201849+0000","last_change":"2024-04-25T13:42:08.031548+0000","last_active":"2024-04-25T13:42:59.201849+0000","last_peered":"2024-04-25T13:42:59.201849+0000","last_clean":"2024-04-25T13:42:59.201849+0000","last_became_active":"2024-04-25T13:42:08.031147+0000","last_became_peered":"2024-04-25T13:42:08.031147+0000","last_unstale":"2024-04-25T13:42:59.201849+0000","last_undegraded":"2024-04-25T13:42:59.201849+0000","last_fullsized":"2024-04-25T13:42:59.201849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:37.941234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.196710+0000","last_change":"2024-04-25T13:42:09.048203+0000","last_active":"2024-04-25T13:42:59.196710+0000","last_peered":"2024-04-25T13:42:59.196710+0000","last_clean":"2024-04-25T13:42:59.196710+0000","last_became_active":"2024-04-25T13:42:09.047848+0000","last_became_peered":"2024-04-25T13:42:09.047848+0000","last_unstale":"2024-04-25T13:42:59.196710+0000","last_undegraded":"2024-04-25T13:42:59.196710+0000","last_fullsized":"2024-04-25T13:42:59.196710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:27.829387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193772+0000","last_change":"2024-04-25T13:42:13.097390+0000","last_active":"2024-04-25T13:42:59.193772+0000","last_peered":"2024-04-25T13:42:59.193772+0000","last_clean":"2024-04-25T13:42:59.193772+0000","last_became_active":"2024-04-25T13:42:13.096795+0000","last_became_peered":"2024-04-25T13:42:13.096795+0000","last_unstale":"2024-04-25T13:42:59.193772+0000","last_undegraded":"2024-04-25T13:42:59.193772+0000","last_fullsized":"2024-04-25T13:42:59.193772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:15.401248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199594+0000","last_change":"2024-04-25T13:42:09.038362+0000","last_active":"2024-04-25T13:42:59.199594+0000","last_peered":"2024-04-25T13:42:59.199594+0000","last_clean":"2024-04-25T13:42:59.199594+0000","last_became_active":"2024-04-25T13:42:09.037974+0000","last_became_peered":"2024-04-25T13:42:09.037974+0000","last_unstale":"2024-04-25T13:42:59.199594+0000","last_undegraded":"2024-04-25T13:42:59.199594+0000","last_fullsized":"2024-04-25T13:42:59.199594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:37.471217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:43:45.277252+0000","last_change":"2024-04-25T13:42:08.033967+0000","last_active":"2024-04-25T13:43:45.277252+0000","last_peered":"2024-04-25T13:43:45.277252+0000","last_clean":"2024-04-25T13:43:45.277252+0000","last_became_active":"2024-04-25T13:42:08.032906+0000","last_became_peered":"2024-04-25T13:42:08.032906+0000","last_unstale":"2024-04-25T13:43:45.277252+0000","last_undegraded":"2024-04-25T13:43:45.277252+0000","last_fullsized":"2024-04-25T13:43:45.277252+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:49:10.012114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"80'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202253+0000","last_change":"2024-04-25T13:42:13.072944+0000","last_active":"2024-04-25T13:42:59.202253+0000","last_peered":"2024-04-25T13:42:59.202253+0000","last_clean":"2024-04-25T13:42:59.202253+0000","last_became_active":"2024-04-25T13:42:13.070990+0000","last_became_peered":"2024-04-25T13:42:13.070990+0000","last_unstale":"2024-04-25T13:42:59.202253+0000","last_undegraded":"2024-04-25T13:42:59.202253+0000","last_fullsized":"2024-04-25T13:42:59.202253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:18:24.946987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747248+0000","last_change":"2024-04-25T13:42:09.054270+0000","last_active":"2024-04-25T13:42:59.747248+0000","last_peered":"2024-04-25T13:42:59.747248+0000","last_clean":"2024-04-25T13:42:59.747248+0000","last_became_active":"2024-04-25T13:42:09.052333+0000","last_became_peered":"2024-04-25T13:42:09.052333+0000","last_unstale":"2024-04-25T13:42:59.747248+0000","last_undegraded":"2024-04-25T13:42:59.747248+0000","last_fullsized":"2024-04-25T13:42:59.747248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:52.401036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.248191+0000","last_change":"2024-04-25T13:42:08.033855+0000","last_active":"2024-04-25T13:42:59.248191+0000","last_peered":"2024-04-25T13:42:59.248191+0000","last_clean":"2024-04-25T13:42:59.248191+0000","last_became_active":"2024-04-25T13:42:08.033437+0000","last_became_peered":"2024-04-25T13:42:08.033437+0000","last_unstale":"2024-04-25T13:42:59.248191+0000","last_undegraded":"2024-04-25T13:42:59.248191+0000","last_fullsized":"2024-04-25T13:42:59.248191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:15.009423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.201829+0000","last_change":"2024-04-25T13:40:53.040500+0000","last_active":"2024-04-25T13:42:59.201829+0000","last_peered":"2024-04-25T13:42:59.201829+0000","last_clean":"2024-04-25T13:42:59.201829+0000","last_became_active":"2024-04-25T13:40:53.034705+0000","last_became_peered":"2024-04-25T13:40:53.034705+0000","last_unstale":"2024-04-25T13:42:59.201829+0000","last_undegraded":"2024-04-25T13:42:59.201829+0000","last_fullsized":"2024-04-25T13:42:59.201829+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:37:26.143320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:37:26.143320+0000","last_clean_scrub_stamp":"2024-04-25T13:37:26.143320+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:15:39.342123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.208952+0000","last_change":"2024-04-25T13:42:59.201994+0000","last_active":"2024-04-25T13:42:59.208952+0000","last_peered":"2024-04-25T13:42:59.208952+0000","last_clean":"2024-04-25T13:42:59.208952+0000","last_became_active":"2024-04-25T13:42:59.201508+0000","last_became_peered":"2024-04-25T13:42:59.201508+0000","last_unstale":"2024-04-25T13:42:59.208952+0000","last_undegraded":"2024-04-25T13:42:59.208952+0000","last_fullsized":"2024-04-25T13:42:59.208952+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:18.941675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193059+0000","last_change":"2024-04-25T13:42:09.048826+0000","last_active":"2024-04-25T13:42:59.193059+0000","last_peered":"2024-04-25T13:42:59.193059+0000","last_clean":"2024-04-25T13:42:59.193059+0000","last_became_active":"2024-04-25T13:42:09.048454+0000","last_became_peered":"2024-04-25T13:42:09.048454+0000","last_unstale":"2024-04-25T13:42:59.193059+0000","last_undegraded":"2024-04-25T13:42:59.193059+0000","last_fullsized":"2024-04-25T13:42:59.193059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:39:21.258720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202054+0000","last_change":"2024-04-25T13:42:08.037788+0000","last_active":"2024-04-25T13:42:59.202054+0000","last_peered":"2024-04-25T13:42:59.202054+0000","last_clean":"2024-04-25T13:42:59.202054+0000","last_became_active":"2024-04-25T13:42:08.036707+0000","last_became_peered":"2024-04-25T13:42:08.036707+0000","last_unstale":"2024-04-25T13:42:59.202054+0000","last_undegraded":"2024-04-25T13:42:59.202054+0000","last_fullsized":"2024-04-25T13:42:59.202054+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:09.835773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.194149+0000","last_change":"2024-04-25T13:42:13.079707+0000","last_active":"2024-04-25T13:42:59.194149+0000","last_peered":"2024-04-25T13:42:59.194149+0000","last_clean":"2024-04-25T13:42:59.194149+0000","last_became_active":"2024-04-25T13:42:13.079191+0000","last_became_peered":"2024-04-25T13:42:13.079191+0000","last_unstale":"2024-04-25T13:42:59.194149+0000","last_undegraded":"2024-04-25T13:42:59.194149+0000","last_fullsized":"2024-04-25T13:42:59.194149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:28.733884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197950+0000","last_change":"2024-04-25T13:42:08.043402+0000","last_active":"2024-04-25T13:42:59.197950+0000","last_peered":"2024-04-25T13:42:59.197950+0000","last_clean":"2024-04-25T13:42:59.197950+0000","last_became_active":"2024-04-25T13:42:08.043059+0000","last_became_peered":"2024-04-25T13:42:08.043059+0000","last_unstale":"2024-04-25T13:42:59.197950+0000","last_undegraded":"2024-04-25T13:42:59.197950+0000","last_fullsized":"2024-04-25T13:42:59.197950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:36.533869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193846+0000","last_change":"2024-04-25T13:42:09.037287+0000","last_active":"2024-04-25T13:42:59.193846+0000","last_peered":"2024-04-25T13:42:59.193846+0000","last_clean":"2024-04-25T13:42:59.193846+0000","last_became_active":"2024-04-25T13:42:09.036944+0000","last_became_peered":"2024-04-25T13:42:09.036944+0000","last_unstale":"2024-04-25T13:42:59.193846+0000","last_undegraded":"2024-04-25T13:42:59.193846+0000","last_fullsized":"2024-04-25T13:42:59.193846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:43.675505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747140+0000","last_change":"2024-04-25T13:42:13.097645+0000","last_active":"2024-04-25T13:42:59.747140+0000","last_peered":"2024-04-25T13:42:59.747140+0000","last_clean":"2024-04-25T13:42:59.747140+0000","last_became_active":"2024-04-25T13:42:13.096881+0000","last_became_peered":"2024-04-25T13:42:13.096881+0000","last_unstale":"2024-04-25T13:42:59.747140+0000","last_undegraded":"2024-04-25T13:42:59.747140+0000","last_fullsized":"2024-04-25T13:42:59.747140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:03.957250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.200479+0000","last_change":"2024-04-25T13:42:08.044040+0000","last_active":"2024-04-25T13:42:59.200479+0000","last_peered":"2024-04-25T13:42:59.200479+0000","last_clean":"2024-04-25T13:42:59.200479+0000","last_became_active":"2024-04-25T13:42:08.043590+0000","last_became_peered":"2024-04-25T13:42:08.043590+0000","last_unstale":"2024-04-25T13:42:59.200479+0000","last_undegraded":"2024-04-25T13:42:59.200479+0000","last_fullsized":"2024-04-25T13:42:59.200479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:12.780050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747515+0000","last_change":"2024-04-25T13:42:09.051254+0000","last_active":"2024-04-25T13:42:59.747515+0000","last_peered":"2024-04-25T13:42:59.747515+0000","last_clean":"2024-04-25T13:42:59.747515+0000","last_became_active":"2024-04-25T13:42:09.050899+0000","last_became_peered":"2024-04-25T13:42:09.050899+0000","last_unstale":"2024-04-25T13:42:59.747515+0000","last_undegraded":"2024-04-25T13:42:59.747515+0000","last_fullsized":"2024-04-25T13:42:59.747515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:48.851445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.204159+0000","last_change":"2024-04-25T13:42:13.070375+0000","last_active":"2024-04-25T13:42:59.204159+0000","last_peered":"2024-04-25T13:42:59.204159+0000","last_clean":"2024-04-25T13:42:59.204159+0000","last_became_active":"2024-04-25T13:42:13.069571+0000","last_became_peered":"2024-04-25T13:42:13.069571+0000","last_unstale":"2024-04-25T13:42:59.204159+0000","last_undegraded":"2024-04-25T13:42:59.204159+0000","last_fullsized":"2024-04-25T13:42:59.204159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:52:40.878206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.248681+0000","last_change":"2024-04-25T13:42:08.043596+0000","last_active":"2024-04-25T13:42:59.248681+0000","last_peered":"2024-04-25T13:42:59.248681+0000","last_clean":"2024-04-25T13:42:59.248681+0000","last_became_active":"2024-04-25T13:42:08.043233+0000","last_became_peered":"2024-04-25T13:42:08.043233+0000","last_unstale":"2024-04-25T13:42:59.248681+0000","last_undegraded":"2024-04-25T13:42:59.248681+0000","last_fullsized":"2024-04-25T13:42:59.248681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:31.126367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199821+0000","last_change":"2024-04-25T13:42:09.045131+0000","last_active":"2024-04-25T13:42:59.199821+0000","last_peered":"2024-04-25T13:42:59.199821+0000","last_clean":"2024-04-25T13:42:59.199821+0000","last_became_active":"2024-04-25T13:42:09.044566+0000","last_became_peered":"2024-04-25T13:42:09.044566+0000","last_unstale":"2024-04-25T13:42:59.199821+0000","last_undegraded":"2024-04-25T13:42:59.199821+0000","last_fullsized":"2024-04-25T13:42:59.199821+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:25.540538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.248441+0000","last_change":"2024-04-25T13:42:13.097509+0000","last_active":"2024-04-25T13:42:59.248441+0000","last_peered":"2024-04-25T13:42:59.248441+0000","last_clean":"2024-04-25T13:42:59.248441+0000","last_became_active":"2024-04-25T13:42:13.096970+0000","last_became_peered":"2024-04-25T13:42:13.096970+0000","last_unstale":"2024-04-25T13:42:59.248441+0000","last_undegraded":"2024-04-25T13:42:59.248441+0000","last_fullsized":"2024-04-25T13:42:59.248441+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:38.891212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197217+0000","last_change":"2024-04-25T13:42:08.033992+0000","last_active":"2024-04-25T13:42:59.197217+0000","last_peered":"2024-04-25T13:42:59.197217+0000","last_clean":"2024-04-25T13:42:59.197217+0000","last_became_active":"2024-04-25T13:42:08.033603+0000","last_became_peered":"2024-04-25T13:42:08.033603+0000","last_unstale":"2024-04-25T13:42:59.197217+0000","last_undegraded":"2024-04-25T13:42:59.197217+0000","last_fullsized":"2024-04-25T13:42:59.197217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:06.552660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.195686+0000","last_change":"2024-04-25T13:42:09.040719+0000","last_active":"2024-04-25T13:42:59.195686+0000","last_peered":"2024-04-25T13:42:59.195686+0000","last_clean":"2024-04-25T13:42:59.195686+0000","last_became_active":"2024-04-25T13:42:09.038144+0000","last_became_peered":"2024-04-25T13:42:09.038144+0000","last_unstale":"2024-04-25T13:42:59.195686+0000","last_undegraded":"2024-04-25T13:42:59.195686+0000","last_fullsized":"2024-04-25T13:42:59.195686+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:20.095587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.200615+0000","last_change":"2024-04-25T13:42:13.086133+0000","last_active":"2024-04-25T13:42:59.200615+0000","last_peered":"2024-04-25T13:42:59.200615+0000","last_clean":"2024-04-25T13:42:59.200615+0000","last_became_active":"2024-04-25T13:42:13.085616+0000","last_became_peered":"2024-04-25T13:42:13.085616+0000","last_unstale":"2024-04-25T13:42:59.200615+0000","last_undegraded":"2024-04-25T13:42:59.200615+0000","last_fullsized":"2024-04-25T13:42:59.200615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:45.939319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747260+0000","last_change":"2024-04-25T13:42:08.028526+0000","last_active":"2024-04-25T13:42:59.747260+0000","last_peered":"2024-04-25T13:42:59.747260+0000","last_clean":"2024-04-25T13:42:59.747260+0000","last_became_active":"2024-04-25T13:42:08.028056+0000","last_became_peered":"2024-04-25T13:42:08.028056+0000","last_unstale":"2024-04-25T13:42:59.747260+0000","last_undegraded":"2024-04-25T13:42:59.747260+0000","last_fullsized":"2024-04-25T13:42:59.747260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:47.433236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.194078+0000","last_change":"2024-04-25T13:42:09.058985+0000","last_active":"2024-04-25T13:42:59.194078+0000","last_peered":"2024-04-25T13:42:59.194078+0000","last_clean":"2024-04-25T13:42:59.194078+0000","last_became_active":"2024-04-25T13:42:09.058638+0000","last_became_peered":"2024-04-25T13:42:09.058638+0000","last_unstale":"2024-04-25T13:42:59.194078+0000","last_undegraded":"2024-04-25T13:42:59.194078+0000","last_fullsized":"2024-04-25T13:42:59.194078+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:04.956881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"80'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.249020+0000","last_change":"2024-04-25T13:42:13.074598+0000","last_active":"2024-04-25T13:42:59.249020+0000","last_peered":"2024-04-25T13:42:59.249020+0000","last_clean":"2024-04-25T13:42:59.249020+0000","last_became_active":"2024-04-25T13:42:13.074129+0000","last_became_peered":"2024-04-25T13:42:13.074129+0000","last_unstale":"2024-04-25T13:42:59.249020+0000","last_undegraded":"2024-04-25T13:42:59.249020+0000","last_fullsized":"2024-04-25T13:42:59.249020+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:31.054517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.204011+0000","last_change":"2024-04-25T13:42:08.043962+0000","last_active":"2024-04-25T13:42:59.204011+0000","last_peered":"2024-04-25T13:42:59.204011+0000","last_clean":"2024-04-25T13:42:59.204011+0000","last_became_active":"2024-04-25T13:42:08.043526+0000","last_became_peered":"2024-04-25T13:42:08.043526+0000","last_unstale":"2024-04-25T13:42:59.204011+0000","last_undegraded":"2024-04-25T13:42:59.204011+0000","last_fullsized":"2024-04-25T13:42:59.204011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:22.766138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747419+0000","last_change":"2024-04-25T13:42:09.048574+0000","last_active":"2024-04-25T13:42:59.747419+0000","last_peered":"2024-04-25T13:42:59.747419+0000","last_clean":"2024-04-25T13:42:59.747419+0000","last_became_active":"2024-04-25T13:42:09.047982+0000","last_became_peered":"2024-04-25T13:42:09.047982+0000","last_unstale":"2024-04-25T13:42:59.747419+0000","last_undegraded":"2024-04-25T13:42:59.747419+0000","last_fullsized":"2024-04-25T13:42:59.747419+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:00.898772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.248349+0000","last_change":"2024-04-25T13:42:13.097637+0000","last_active":"2024-04-25T13:42:59.248349+0000","last_peered":"2024-04-25T13:42:59.248349+0000","last_clean":"2024-04-25T13:42:59.248349+0000","last_became_active":"2024-04-25T13:42:13.096790+0000","last_became_peered":"2024-04-25T13:42:13.096790+0000","last_unstale":"2024-04-25T13:42:59.248349+0000","last_undegraded":"2024-04-25T13:42:59.248349+0000","last_fullsized":"2024-04-25T13:42:59.248349+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:54.174615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.195975+0000","last_change":"2024-04-25T13:42:08.040207+0000","last_active":"2024-04-25T13:42:59.195975+0000","last_peered":"2024-04-25T13:42:59.195975+0000","last_clean":"2024-04-25T13:42:59.195975+0000","last_became_active":"2024-04-25T13:42:08.039809+0000","last_became_peered":"2024-04-25T13:42:08.039809+0000","last_unstale":"2024-04-25T13:42:59.195975+0000","last_undegraded":"2024-04-25T13:42:59.195975+0000","last_fullsized":"2024-04-25T13:42:59.195975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:12.084793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202834+0000","last_change":"2024-04-25T13:42:09.048040+0000","last_active":"2024-04-25T13:42:59.202834+0000","last_peered":"2024-04-25T13:42:59.202834+0000","last_clean":"2024-04-25T13:42:59.202834+0000","last_became_active":"2024-04-25T13:42:09.047662+0000","last_became_peered":"2024-04-25T13:42:09.047662+0000","last_unstale":"2024-04-25T13:42:59.202834+0000","last_undegraded":"2024-04-25T13:42:59.202834+0000","last_fullsized":"2024-04-25T13:42:59.202834+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:10:17.675167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197653+0000","last_change":"2024-04-25T13:42:13.072706+0000","last_active":"2024-04-25T13:42:59.197653+0000","last_peered":"2024-04-25T13:42:59.197653+0000","last_clean":"2024-04-25T13:42:59.197653+0000","last_became_active":"2024-04-25T13:42:13.071525+0000","last_became_peered":"2024-04-25T13:42:13.071525+0000","last_unstale":"2024-04-25T13:42:59.197653+0000","last_undegraded":"2024-04-25T13:42:59.197653+0000","last_fullsized":"2024-04-25T13:42:59.197653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:20.351817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.205160+0000","last_change":"2024-04-25T13:42:08.033975+0000","last_active":"2024-04-25T13:42:59.205160+0000","last_peered":"2024-04-25T13:42:59.205160+0000","last_clean":"2024-04-25T13:42:59.205160+0000","last_became_active":"2024-04-25T13:42:08.033302+0000","last_became_peered":"2024-04-25T13:42:08.033302+0000","last_unstale":"2024-04-25T13:42:59.205160+0000","last_undegraded":"2024-04-25T13:42:59.205160+0000","last_fullsized":"2024-04-25T13:42:59.205160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:57:57.561629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202488+0000","last_change":"2024-04-25T13:42:09.052457+0000","last_active":"2024-04-25T13:42:59.202488+0000","last_peered":"2024-04-25T13:42:59.202488+0000","last_clean":"2024-04-25T13:42:59.202488+0000","last_became_active":"2024-04-25T13:42:09.052052+0000","last_became_peered":"2024-04-25T13:42:09.052052+0000","last_unstale":"2024-04-25T13:42:59.202488+0000","last_undegraded":"2024-04-25T13:42:59.202488+0000","last_fullsized":"2024-04-25T13:42:59.202488+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:42.589178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.249819+0000","last_change":"2024-04-25T13:42:59.249819+0000","last_active":"2024-04-25T13:42:59.249819+0000","last_peered":"2024-04-25T13:42:59.249819+0000","last_clean":"2024-04-25T13:42:59.249819+0000","last_became_active":"2024-04-25T13:42:59.249291+0000","last_became_peered":"2024-04-25T13:42:59.249291+0000","last_unstale":"2024-04-25T13:42:59.249819+0000","last_undegraded":"2024-04-25T13:42:59.249819+0000","last_fullsized":"2024-04-25T13:42:59.249819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:27:22.383094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10,1,4],"acting":[0,10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199033+0000","last_change":"2024-04-25T13:42:08.044578+0000","last_active":"2024-04-25T13:42:59.199033+0000","last_peered":"2024-04-25T13:42:59.199033+0000","last_clean":"2024-04-25T13:42:59.199033+0000","last_became_active":"2024-04-25T13:42:08.044194+0000","last_became_peered":"2024-04-25T13:42:08.044194+0000","last_unstale":"2024-04-25T13:42:59.199033+0000","last_undegraded":"2024-04-25T13:42:59.199033+0000","last_fullsized":"2024-04-25T13:42:59.199033+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:58.413832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.202281+0000","last_change":"2024-04-25T13:42:09.051150+0000","last_active":"2024-04-25T13:42:59.202281+0000","last_peered":"2024-04-25T13:42:59.202281+0000","last_clean":"2024-04-25T13:42:59.202281+0000","last_became_active":"2024-04-25T13:42:09.050747+0000","last_became_peered":"2024-04-25T13:42:09.050747+0000","last_unstale":"2024-04-25T13:42:59.202281+0000","last_undegraded":"2024-04-25T13:42:59.202281+0000","last_fullsized":"2024-04-25T13:42:59.202281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:10.923728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.197321+0000","last_change":"2024-04-25T13:42:13.075405+0000","last_active":"2024-04-25T13:42:59.197321+0000","last_peered":"2024-04-25T13:42:59.197321+0000","last_clean":"2024-04-25T13:42:59.197321+0000","last_became_active":"2024-04-25T13:42:13.074989+0000","last_became_peered":"2024-04-25T13:42:13.074989+0000","last_unstale":"2024-04-25T13:42:59.197321+0000","last_undegraded":"2024-04-25T13:42:59.197321+0000","last_fullsized":"2024-04-25T13:42:59.197321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:12.048188+0000","last_clean_scrub_stamp":"2024-04-25T13:42:12.048188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:44.544984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193787+0000","last_change":"2024-04-25T13:42:08.033305+0000","last_active":"2024-04-25T13:42:59.193787+0000","last_peered":"2024-04-25T13:42:59.193787+0000","last_clean":"2024-04-25T13:42:59.193787+0000","last_became_active":"2024-04-25T13:42:08.032879+0000","last_became_peered":"2024-04-25T13:42:08.032879+0000","last_unstale":"2024-04-25T13:42:59.193787+0000","last_undegraded":"2024-04-25T13:42:59.193787+0000","last_fullsized":"2024-04-25T13:42:59.193787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:06.999777+0000","last_clean_scrub_stamp":"2024-04-25T13:42:06.999777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:53.170913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.203131+0000","last_change":"2024-04-25T13:42:09.054682+0000","last_active":"2024-04-25T13:42:59.203131+0000","last_peered":"2024-04-25T13:42:59.203131+0000","last_clean":"2024-04-25T13:42:59.203131+0000","last_became_active":"2024-04-25T13:42:09.051962+0000","last_became_peered":"2024-04-25T13:42:09.051962+0000","last_unstale":"2024-04-25T13:42:59.203131+0000","last_undegraded":"2024-04-25T13:42:59.203131+0000","last_fullsized":"2024-04-25T13:42:59.203131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:50.799284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.194134+0000","last_change":"2024-04-25T13:42:09.040062+0000","last_active":"2024-04-25T13:42:59.194134+0000","last_peered":"2024-04-25T13:42:59.194134+0000","last_clean":"2024-04-25T13:42:59.194134+0000","last_became_active":"2024-04-25T13:42:09.039692+0000","last_became_peered":"2024-04-25T13:42:09.039692+0000","last_unstale":"2024-04-25T13:42:59.194134+0000","last_undegraded":"2024-04-25T13:42:59.194134+0000","last_fullsized":"2024-04-25T13:42:59.194134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:48.527698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.249561+0000","last_change":"2024-04-25T13:42:59.249561+0000","last_active":"2024-04-25T13:42:59.249561+0000","last_peered":"2024-04-25T13:42:59.249561+0000","last_clean":"2024-04-25T13:42:59.249561+0000","last_became_active":"2024-04-25T13:42:59.249065+0000","last_became_peered":"2024-04-25T13:42:59.249065+0000","last_unstale":"2024-04-25T13:42:59.249561+0000","last_undegraded":"2024-04-25T13:42:59.249561+0000","last_fullsized":"2024-04-25T13:42:59.249561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:06.549834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.204006+0000","last_change":"2024-04-25T13:42:09.064663+0000","last_active":"2024-04-25T13:42:59.204006+0000","last_peered":"2024-04-25T13:42:59.204006+0000","last_clean":"2024-04-25T13:42:59.204006+0000","last_became_active":"2024-04-25T13:42:09.064202+0000","last_became_peered":"2024-04-25T13:42:09.064202+0000","last_unstale":"2024-04-25T13:42:59.204006+0000","last_undegraded":"2024-04-25T13:42:59.204006+0000","last_fullsized":"2024-04-25T13:42:59.204006+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:48.611882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199061+0000","last_change":"2024-04-25T13:42:09.066196+0000","last_active":"2024-04-25T13:42:59.199061+0000","last_peered":"2024-04-25T13:42:59.199061+0000","last_clean":"2024-04-25T13:42:59.199061+0000","last_became_active":"2024-04-25T13:42:09.065793+0000","last_became_peered":"2024-04-25T13:42:09.065793+0000","last_unstale":"2024-04-25T13:42:59.199061+0000","last_undegraded":"2024-04-25T13:42:59.199061+0000","last_fullsized":"2024-04-25T13:42:59.199061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:26.557457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193855+0000","last_change":"2024-04-25T13:42:09.063229+0000","last_active":"2024-04-25T13:42:59.193855+0000","last_peered":"2024-04-25T13:42:59.193855+0000","last_clean":"2024-04-25T13:42:59.193855+0000","last_became_active":"2024-04-25T13:42:09.062884+0000","last_became_peered":"2024-04-25T13:42:09.062884+0000","last_unstale":"2024-04-25T13:42:59.193855+0000","last_undegraded":"2024-04-25T13:42:59.193855+0000","last_fullsized":"2024-04-25T13:42:59.193855+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:17.478141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.194781+0000","last_change":"2024-04-25T13:42:09.031731+0000","last_active":"2024-04-25T13:42:59.194781+0000","last_peered":"2024-04-25T13:42:59.194781+0000","last_clean":"2024-04-25T13:42:59.194781+0000","last_became_active":"2024-04-25T13:42:09.031316+0000","last_became_peered":"2024-04-25T13:42:09.031316+0000","last_unstale":"2024-04-25T13:42:59.194781+0000","last_undegraded":"2024-04-25T13:42:59.194781+0000","last_fullsized":"2024-04-25T13:42:59.194781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:34.210437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.204977+0000","last_change":"2024-04-25T13:42:09.034429+0000","last_active":"2024-04-25T13:42:59.204977+0000","last_peered":"2024-04-25T13:42:59.204977+0000","last_clean":"2024-04-25T13:42:59.204977+0000","last_became_active":"2024-04-25T13:42:09.033917+0000","last_became_peered":"2024-04-25T13:42:09.033917+0000","last_unstale":"2024-04-25T13:42:59.204977+0000","last_undegraded":"2024-04-25T13:42:59.204977+0000","last_fullsized":"2024-04-25T13:42:59.204977+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:16.572251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747670+0000","last_change":"2024-04-25T13:42:09.060585+0000","last_active":"2024-04-25T13:42:59.747670+0000","last_peered":"2024-04-25T13:42:59.747670+0000","last_clean":"2024-04-25T13:42:59.747670+0000","last_became_active":"2024-04-25T13:42:09.058624+0000","last_became_peered":"2024-04-25T13:42:09.058624+0000","last_unstale":"2024-04-25T13:42:59.747670+0000","last_undegraded":"2024-04-25T13:42:59.747670+0000","last_fullsized":"2024-04-25T13:42:59.747670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:30.996402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.199423+0000","last_change":"2024-04-25T13:42:09.057544+0000","last_active":"2024-04-25T13:42:59.199423+0000","last_peered":"2024-04-25T13:42:59.199423+0000","last_clean":"2024-04-25T13:42:59.199423+0000","last_became_active":"2024-04-25T13:42:09.057127+0000","last_became_peered":"2024-04-25T13:42:09.057127+0000","last_unstale":"2024-04-25T13:42:59.199423+0000","last_undegraded":"2024-04-25T13:42:59.199423+0000","last_fullsized":"2024-04-25T13:42:59.199423+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:57.394029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.747405+0000","last_change":"2024-04-25T13:42:09.057102+0000","last_active":"2024-04-25T13:42:59.747405+0000","last_peered":"2024-04-25T13:42:59.747405+0000","last_clean":"2024-04-25T13:42:59.747405+0000","last_became_active":"2024-04-25T13:42:09.056785+0000","last_became_peered":"2024-04-25T13:42:09.056785+0000","last_unstale":"2024-04-25T13:42:59.747405+0000","last_undegraded":"2024-04-25T13:42:59.747405+0000","last_fullsized":"2024-04-25T13:42:59.747405+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:57.278485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.198084+0000","last_change":"2024-04-25T13:42:09.045717+0000","last_active":"2024-04-25T13:42:59.198084+0000","last_peered":"2024-04-25T13:42:59.198084+0000","last_clean":"2024-04-25T13:42:59.198084+0000","last_became_active":"2024-04-25T13:42:09.045346+0000","last_became_peered":"2024-04-25T13:42:09.045346+0000","last_unstale":"2024-04-25T13:42:59.198084+0000","last_undegraded":"2024-04-25T13:42:59.198084+0000","last_fullsized":"2024-04-25T13:42:59.198084+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:53.731004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.193484+0000","last_change":"2024-04-25T13:42:09.061956+0000","last_active":"2024-04-25T13:42:59.193484+0000","last_peered":"2024-04-25T13:42:59.193484+0000","last_clean":"2024-04-25T13:42:59.193484+0000","last_became_active":"2024-04-25T13:42:09.061589+0000","last_became_peered":"2024-04-25T13:42:09.061589+0000","last_unstale":"2024-04-25T13:42:59.193484+0000","last_undegraded":"2024-04-25T13:42:59.193484+0000","last_fullsized":"2024-04-25T13:42:59.193484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:34.535044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-25T13:42:59.203233+0000","last_change":"2024-04-25T13:42:59.203233+0000","last_active":"2024-04-25T13:42:59.203233+0000","last_peered":"2024-04-25T13:42:59.203233+0000","last_clean":"2024-04-25T13:42:59.203233+0000","last_became_active":"2024-04-25T13:42:59.202767+0000","last_became_peered":"2024-04-25T13:42:59.202767+0000","last_unstale":"2024-04-25T13:42:59.203233+0000","last_undegraded":"2024-04-25T13:42:59.203233+0000","last_fullsized":"2024-04-25T13:42:59.203233+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:08.007658+0000","last_clean_scrub_stamp":"2024-04-25T13:42:08.007658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:15.541405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66334,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":447,"num_read_kb":293,"num_write":160,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":61694,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":199002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678050,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":917504,"data_stored":449115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874278,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32748,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712404,"statfs":{"total":95995035648,"available":95961501696,"internally_reserved":0,"allocated":1609728,"data_stored":1098716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037805,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36260,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708892,"statfs":{"total":95995035648,"available":95957905408,"internally_reserved":0,"allocated":937984,"data_stored":453447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234033,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":449271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430262,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1527808,"data_stored":1045180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593788,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":444527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":991232,"data_stored":507783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":937984,"data_stored":445915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":445165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149771,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":444721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953542,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":511510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790018,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1536000,"data_stored":1040768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":62977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":63911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:43:52.186 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-25T13:43:52.187 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T13:43:52.187 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-25T13:43:52.187 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-25T13:43:52.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:52 smithi161 ceph-mon[32696]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T13:43:52.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:52 smithi175 ceph-mon[32649]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T13:43:52.437 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:43:53.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:53 smithi043 ceph-mon[29195]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T13:43:53.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:53 smithi161 ceph-mon[32696]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T13:43:53.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:53 smithi175 ceph-mon[32649]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T13:43:54.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.283+0000 7f8df1cb2700 1 -- 172.21.15.43:0/3659138974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dec1033c0 msgr2=0x7f8dec1037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:54.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.283+0000 7f8df1cb2700 1 --2- 172.21.15.43:0/3659138974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dec1033c0 0x7f8dec1037d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0099c0 tx=0x7f8ddc009cd0 comp rx=0 tx=0).stop 2024-04-25T13:43:54.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.283+0000 7f8df1cb2700 1 -- 172.21.15.43:0/3659138974 shutdown_connections 2024-04-25T13:43:54.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.283+0000 7f8df1cb2700 1 --2- 172.21.15.43:0/3659138974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8dec108640 0x7f8dec10ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:54.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.283+0000 7f8df1cb2700 1 --2- 172.21.15.43:0/3659138974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dec1033c0 0x7f8dec1037d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:54.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.283+0000 7f8df1cb2700 1 --2- 172.21.15.43:0/3659138974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dec107cf0 0x7f8dec108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:54.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.283+0000 7f8df1cb2700 1 -- 172.21.15.43:0/3659138974 >> 172.21.15.43:0/3659138974 conn(0x7f8dec0fedb0 msgr2=0x7f8dec1011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:54.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.283+0000 7f8df1cb2700 1 -- 172.21.15.43:0/3659138974 shutdown_connections 2024-04-25T13:43:54.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.283+0000 7f8df1cb2700 1 -- 172.21.15.43:0/3659138974 wait complete. 2024-04-25T13:43:54.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.284+0000 7f8df1cb2700 1 Processor -- start 2024-04-25T13:43:54.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.284+0000 7f8df1cb2700 1 -- start start 2024-04-25T13:43:54.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.284+0000 7f8df1cb2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8dec1033c0 0x7f8dec1a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:54.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.284+0000 7f8df1cb2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dec107cf0 0x7f8dec1a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:54.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.284+0000 7f8df1cb2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dec108640 0x7f8dec19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:54.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.284+0000 7f8df1cb2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec113140 con 0x7f8dec108640 2024-04-25T13:43:54.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.284+0000 7f8df1cb2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec112fc0 con 0x7f8dec107cf0 2024-04-25T13:43:54.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.284+0000 7f8df1cb2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec1132c0 con 0x7f8dec1033c0 2024-04-25T13:43:54.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.284+0000 7f8debfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dec108640 0x7f8dec19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:54.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.284+0000 7f8deb7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8dec1033c0 0x7f8dec1a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:54.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.284+0000 7f8debfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dec108640 0x7f8dec19aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51784/0 (socket says 172.21.15.43:51784) 2024-04-25T13:43:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.284+0000 7f8debfff700 1 -- 172.21.15.43:0/298193889 learned_addr learned my addr 172.21.15.43:0/298193889 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.284+0000 7f8deaffd700 1 --2- 172.21.15.43:0/298193889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dec107cf0 0x7f8dec1a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.285+0000 7f8debfff700 1 -- 172.21.15.43:0/298193889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8dec1033c0 msgr2=0x7f8dec1a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.285+0000 7f8debfff700 1 --2- 172.21.15.43:0/298193889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8dec1033c0 0x7f8dec1a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.285+0000 7f8debfff700 1 -- 172.21.15.43:0/298193889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dec107cf0 msgr2=0x7f8dec1a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.285+0000 7f8debfff700 1 --2- 172.21.15.43:0/298193889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dec107cf0 0x7f8dec1a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.285+0000 7f8debfff700 1 -- 172.21.15.43:0/298193889 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dec19b0e0 con 0x7f8dec108640 2024-04-25T13:43:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.285+0000 7f8debfff700 1 --2- 172.21.15.43:0/298193889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dec108640 0x7f8dec19aa30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8de4007ee0 tx=0x7f8de400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.285+0000 7f8de8ff9700 1 -- 172.21.15.43:0/298193889 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de4004bb0 con 0x7f8dec108640 2024-04-25T13:43:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.285+0000 7f8de8ff9700 1 -- 172.21.15.43:0/298193889 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8de4004d50 con 0x7f8dec108640 2024-04-25T13:43:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.285+0000 7f8df1cb2700 1 -- 172.21.15.43:0/298193889 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dec19b3d0 con 0x7f8dec108640 2024-04-25T13:43:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.285+0000 7f8de8ff9700 1 -- 172.21.15.43:0/298193889 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de40058b0 con 0x7f8dec108640 2024-04-25T13:43:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.285+0000 7f8df1cb2700 1 -- 172.21.15.43:0/298193889 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dec1a76a0 con 0x7f8dec108640 2024-04-25T13:43:54.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.286+0000 7f8df1cb2700 1 -- 172.21.15.43:0/298193889 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dec051190 con 0x7f8dec108640 2024-04-25T13:43:54.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.288+0000 7f8de8ff9700 1 -- 172.21.15.43:0/298193889 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f8de401a020 con 0x7f8dec108640 2024-04-25T13:43:54.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.289+0000 7f8de8ff9700 1 --2- 172.21.15.43:0/298193889 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8dd40afc90 0x7f8dd40b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:54.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.289+0000 7f8deb7fe700 1 --2- 172.21.15.43:0/298193889 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8dd40afc90 0x7f8dd40b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:54.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.289+0000 7f8de8ff9700 1 -- 172.21.15.43:0/298193889 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f8de40ded10 con 0x7f8dec108640 2024-04-25T13:43:54.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.289+0000 7f8deb7fe700 1 --2- 172.21.15.43:0/298193889 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8dd40afc90 0x7f8dd40b21a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009990 tx=0x7f8ddc005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:54.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.292+0000 7f8de8ff9700 1 -- 172.21.15.43:0/298193889 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8de4010070 con 0x7f8dec108640 2024-04-25T13:43:54.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.548+0000 7f8df1cb2700 1 -- 172.21.15.43:0/298193889 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8dec02e510 con 0x7f8dec108640 2024-04-25T13:43:54.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.549+0000 7f8de8ff9700 1 -- 172.21.15.43:0/298193889 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8de40a7430 con 0x7f8dec108640 2024-04-25T13:43:54.550 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:43:54.550 INFO:teuthology.orchestra.run.smithi043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T13:43:54.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.551+0000 7f8df1cb2700 1 -- 172.21.15.43:0/298193889 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8dd40afc90 msgr2=0x7f8dd40b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:54.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.551+0000 7f8df1cb2700 1 --2- 172.21.15.43:0/298193889 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8dd40afc90 0x7f8dd40b21a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009990 tx=0x7f8ddc005fb0 comp rx=0 tx=0).stop 2024-04-25T13:43:54.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.551+0000 7f8df1cb2700 1 -- 172.21.15.43:0/298193889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dec108640 msgr2=0x7f8dec19aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:54.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.551+0000 7f8df1cb2700 1 --2- 172.21.15.43:0/298193889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dec108640 0x7f8dec19aa30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8de4007ee0 tx=0x7f8de400d3b0 comp rx=0 tx=0).stop 2024-04-25T13:43:54.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.551+0000 7f8df1cb2700 1 -- 172.21.15.43:0/298193889 shutdown_connections 2024-04-25T13:43:54.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.551+0000 7f8df1cb2700 1 --2- 172.21.15.43:0/298193889 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8dd40afc90 0x7f8dd40b21a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:54.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.551+0000 7f8df1cb2700 1 --2- 172.21.15.43:0/298193889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dec108640 0x7f8dec19aa30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:54.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.551+0000 7f8df1cb2700 1 --2- 172.21.15.43:0/298193889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8dec1033c0 0x7f8dec1a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:54.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.551+0000 7f8df1cb2700 1 --2- 172.21.15.43:0/298193889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dec107cf0 0x7f8dec1a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:54.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.551+0000 7f8df1cb2700 1 -- 172.21.15.43:0/298193889 >> 172.21.15.43:0/298193889 conn(0x7f8dec0fedb0 msgr2=0x7f8dec075cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:54.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.551+0000 7f8df1cb2700 1 -- 172.21.15.43:0/298193889 shutdown_connections 2024-04-25T13:43:54.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:54.551+0000 7f8df1cb2700 1 -- 172.21.15.43:0/298193889 wait complete. 2024-04-25T13:43:55.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:55 smithi043 ceph-mon[29195]: pgmap v340: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T13:43:55.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:55 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/298193889' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-25T13:43:55.288 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-25T13:43:55.288 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:43:55.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:55 smithi161 ceph-mon[32696]: pgmap v340: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T13:43:55.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:55 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/298193889' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-25T13:43:55.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.409+0000 7f8944fd7640 1 -- 172.21.15.43:0/2844927754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89401029c0 msgr2=0x7f89401036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:55.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.409+0000 7f8944fd7640 1 --2- 172.21.15.43:0/2844927754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89401029c0 0x7f89401036c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8930009900 tx=0x7f893002a410 comp rx=0 tx=0).stop 2024-04-25T13:43:55.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.409+0000 7f8944fd7640 1 -- 172.21.15.43:0/2844927754 shutdown_connections 2024-04-25T13:43:55.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.409+0000 7f8944fd7640 1 --2- 172.21.15.43:0/2844927754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8940108900 0x7f894010ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.409+0000 7f8944fd7640 1 --2- 172.21.15.43:0/2844927754 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8940103c00 0x7f8940104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.409+0000 7f8944fd7640 1 --2- 172.21.15.43:0/2844927754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89401029c0 0x7f89401036c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.409+0000 7f8944fd7640 1 -- 172.21.15.43:0/2844927754 >> 172.21.15.43:0/2844927754 conn(0x7f89400fdbd0 msgr2=0x7f8940100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:55.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.409+0000 7f8944fd7640 1 -- 172.21.15.43:0/2844927754 shutdown_connections 2024-04-25T13:43:55.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.409+0000 7f8944fd7640 1 -- 172.21.15.43:0/2844927754 wait complete. 2024-04-25T13:43:55.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.410+0000 7f8944fd7640 1 Processor -- start 2024-04-25T13:43:55.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.410+0000 7f8944fd7640 1 -- start start 2024-04-25T13:43:55.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.410+0000 7f8944fd7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89401029c0 0x7f894019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:55.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.410+0000 7f8944fd7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8940103c00 0x7f894019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.410+0000 7f8944fd7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8940108900 0x7f89401a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.410+0000 7f8944fd7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f894010f4e0 con 0x7f8940108900 2024-04-25T13:43:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.410+0000 7f8944fd7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f894010f360 con 0x7f8940103c00 2024-04-25T13:43:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.410+0000 7f8944fd7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f894010f660 con 0x7f89401029c0 2024-04-25T13:43:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.410+0000 7f893ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8940108900 0x7f89401a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.410+0000 7f893ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8940108900 0x7f89401a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51810/0 (socket says 172.21.15.43:51810) 2024-04-25T13:43:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.410+0000 7f893ed9d640 1 -- 172.21.15.43:0/3589629705 learned_addr learned my addr 172.21.15.43:0/3589629705 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.411+0000 7f893dd9b640 1 --2- 172.21.15.43:0/3589629705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8940103c00 0x7f894019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.411+0000 7f893e59c640 1 --2- 172.21.15.43:0/3589629705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89401029c0 0x7f894019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.411+0000 7f893ed9d640 1 -- 172.21.15.43:0/3589629705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89401029c0 msgr2=0x7f894019a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.411+0000 7f893ed9d640 1 --2- 172.21.15.43:0/3589629705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89401029c0 0x7f894019a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.411+0000 7f893ed9d640 1 -- 172.21.15.43:0/3589629705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8940103c00 msgr2=0x7f894019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.411+0000 7f893ed9d640 1 --2- 172.21.15.43:0/3589629705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8940103c00 0x7f894019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.411+0000 7f893ed9d640 1 -- 172.21.15.43:0/3589629705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89401a1d10 con 0x7f8940108900 2024-04-25T13:43:55.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.411+0000 7f893ed9d640 1 --2- 172.21.15.43:0/3589629705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8940108900 0x7f89401a16a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f893800b970 tx=0x7f893800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:55.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.411+0000 7f89377fe640 1 -- 172.21.15.43:0/3589629705 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938019070 con 0x7f8940108900 2024-04-25T13:43:55.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.411+0000 7f89377fe640 1 -- 172.21.15.43:0/3589629705 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8938014440 con 0x7f8940108900 2024-04-25T13:43:55.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.411+0000 7f8944fd7640 1 -- 172.21.15.43:0/3589629705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89401a1fa0 con 0x7f8940108900 2024-04-25T13:43:55.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.411+0000 7f89377fe640 1 -- 172.21.15.43:0/3589629705 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89380075d0 con 0x7f8940108900 2024-04-25T13:43:55.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.411+0000 7f8944fd7640 1 -- 172.21.15.43:0/3589629705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89401a2530 con 0x7f8940108900 2024-04-25T13:43:55.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.412+0000 7f8944fd7640 1 -- 172.21.15.43:0/3589629705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8940107710 con 0x7f8940108900 2024-04-25T13:43:55.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.414+0000 7f89377fe640 1 -- 172.21.15.43:0/3589629705 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f893801c070 con 0x7f8940108900 2024-04-25T13:43:55.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.414+0000 7f89377fe640 1 --2- 172.21.15.43:0/3589629705 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f892c0afc00 0x7f892c0b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:55.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.415+0000 7f893e59c640 1 --2- 172.21.15.43:0/3589629705 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f892c0afc00 0x7f892c0b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:55.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.415+0000 7f89377fe640 1 -- 172.21.15.43:0/3589629705 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f89380de9c0 con 0x7f8940108900 2024-04-25T13:43:55.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.415+0000 7f893e59c640 1 --2- 172.21.15.43:0/3589629705 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f892c0afc00 0x7f892c0b2110 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f89300057c0 tx=0x7f8930005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:55.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.418+0000 7f89377fe640 1 -- 172.21.15.43:0/3589629705 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f89380a6b40 con 0x7f8940108900 2024-04-25T13:43:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:55 smithi175 ceph-mon[32649]: pgmap v340: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T13:43:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:55 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/298193889' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-25T13:43:55.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.607+0000 7f8944fd7640 1 -- 172.21.15.43:0/3589629705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89400637a0 con 0x7f8940108900 2024-04-25T13:43:55.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.609+0000 7f89377fe640 1 -- 172.21.15.43:0/3589629705 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24645 (secure 0 0 0) 0x7f89380af210 con 0x7f8940108900 2024-04-25T13:43:55.609 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:43:55.610 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":82,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:42:59.189836+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:43:55.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.611+0000 7f8944fd7640 1 -- 172.21.15.43:0/3589629705 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f892c0afc00 msgr2=0x7f892c0b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:55.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.611+0000 7f8944fd7640 1 --2- 172.21.15.43:0/3589629705 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f892c0afc00 0x7f892c0b2110 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f89300057c0 tx=0x7f8930005720 comp rx=0 tx=0).stop 2024-04-25T13:43:55.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.611+0000 7f8944fd7640 1 -- 172.21.15.43:0/3589629705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8940108900 msgr2=0x7f89401a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:55.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.611+0000 7f8944fd7640 1 --2- 172.21.15.43:0/3589629705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8940108900 0x7f89401a16a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f893800b970 tx=0x7f893800be30 comp rx=0 tx=0).stop 2024-04-25T13:43:55.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.611+0000 7f8944fd7640 1 -- 172.21.15.43:0/3589629705 shutdown_connections 2024-04-25T13:43:55.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.611+0000 7f8944fd7640 1 --2- 172.21.15.43:0/3589629705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8940108900 0x7f89401a16a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.611+0000 7f8944fd7640 1 --2- 172.21.15.43:0/3589629705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8940103c00 0x7f894019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.611+0000 7f8944fd7640 1 --2- 172.21.15.43:0/3589629705 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f892c0afc00 0x7f892c0b2110 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.611+0000 7f8944fd7640 1 --2- 172.21.15.43:0/3589629705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89401029c0 0x7f894019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.611+0000 7f8944fd7640 1 -- 172.21.15.43:0/3589629705 >> 172.21.15.43:0/3589629705 conn(0x7f89400fdbd0 msgr2=0x7f89401048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:55.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.612+0000 7f8944fd7640 1 -- 172.21.15.43:0/3589629705 shutdown_connections 2024-04-25T13:43:55.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.612+0000 7f8944fd7640 1 -- 172.21.15.43:0/3589629705 wait complete. 2024-04-25T13:43:55.623 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:37:25.931659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:06.202688+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:07.348534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:42:11.056739+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:43:55.624 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:43:55.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.739+0000 7f657a0e7640 1 -- 172.21.15.43:0/1647204334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574109a30 msgr2=0x7f657410be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:55.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.739+0000 7f657a0e7640 1 --2- 172.21.15.43:0/1647204334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574109a30 0x7f657410be50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f656c009900 tx=0x7f656c02a410 comp rx=0 tx=0).stop 2024-04-25T13:43:55.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.739+0000 7f657a0e7640 1 -- 172.21.15.43:0/1647204334 shutdown_connections 2024-04-25T13:43:55.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.739+0000 7f657a0e7640 1 --2- 172.21.15.43:0/1647204334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574109a30 0x7f657410be50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.739+0000 7f657a0e7640 1 --2- 172.21.15.43:0/1647204334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6574104d30 0x7f6574105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.739+0000 7f657a0e7640 1 --2- 172.21.15.43:0/1647204334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6574103af0 0x7f65741047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.739+0000 7f657a0e7640 1 -- 172.21.15.43:0/1647204334 >> 172.21.15.43:0/1647204334 conn(0x7f65740fece0 msgr2=0x7f6574101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:55.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.739+0000 7f657a0e7640 1 -- 172.21.15.43:0/1647204334 shutdown_connections 2024-04-25T13:43:55.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.739+0000 7f657a0e7640 1 -- 172.21.15.43:0/1647204334 wait complete. 2024-04-25T13:43:55.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.739+0000 7f657a0e7640 1 Processor -- start 2024-04-25T13:43:55.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.740+0000 7f657a0e7640 1 -- start start 2024-04-25T13:43:55.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.740+0000 7f657a0e7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6574103af0 0x7f657419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:55.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.740+0000 7f657a0e7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6574104d30 0x7f657419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:55.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.740+0000 7f657a0e7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574109a30 0x7f65741a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:55.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.740+0000 7f657a0e7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f657410f4b0 con 0x7f6574109a30 2024-04-25T13:43:55.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.740+0000 7f657a0e7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f657410f330 con 0x7f6574104d30 2024-04-25T13:43:55.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.740+0000 7f657a0e7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f657410f630 con 0x7f6574103af0 2024-04-25T13:43:55.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.740+0000 7f6573fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574109a30 0x7f65741a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:55.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.740+0000 7f6573fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574109a30 0x7f65741a15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51836/0 (socket says 172.21.15.43:51836) 2024-04-25T13:43:55.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.740+0000 7f6573fff640 1 -- 172.21.15.43:0/3677946338 learned_addr learned my addr 172.21.15.43:0/3677946338 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:55.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.740+0000 7f6573fff640 1 -- 172.21.15.43:0/3677946338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6574103af0 msgr2=0x7f657419a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:55.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.740+0000 7f6573fff640 1 --2- 172.21.15.43:0/3677946338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6574103af0 0x7f657419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.740+0000 7f6573fff640 1 -- 172.21.15.43:0/3677946338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6574104d30 msgr2=0x7f657419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:55.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.740+0000 7f6573fff640 1 --2- 172.21.15.43:0/3677946338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6574104d30 0x7f657419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.740+0000 7f6573fff640 1 -- 172.21.15.43:0/3677946338 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65741a1c40 con 0x7f6574109a30 2024-04-25T13:43:55.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.740+0000 7f6573fff640 1 --2- 172.21.15.43:0/3677946338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574109a30 0x7f65741a15d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f656c005ab0 tx=0x7f656c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:55.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.741+0000 7f6570ff9640 1 -- 172.21.15.43:0/3677946338 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c03f030 con 0x7f6574109a30 2024-04-25T13:43:55.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.741+0000 7f6570ff9640 1 -- 172.21.15.43:0/3677946338 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f656c003c90 con 0x7f6574109a30 2024-04-25T13:43:55.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.741+0000 7f6570ff9640 1 -- 172.21.15.43:0/3677946338 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c035070 con 0x7f6574109a30 2024-04-25T13:43:55.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.741+0000 7f657a0e7640 1 -- 172.21.15.43:0/3677946338 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65741a1ed0 con 0x7f6574109a30 2024-04-25T13:43:55.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.741+0000 7f657a0e7640 1 -- 172.21.15.43:0/3677946338 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65741a2330 con 0x7f6574109a30 2024-04-25T13:43:55.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.742+0000 7f657a0e7640 1 -- 172.21.15.43:0/3677946338 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6574108840 con 0x7f6574109a30 2024-04-25T13:43:55.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.743+0000 7f6570ff9640 1 -- 172.21.15.43:0/3677946338 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f656c042030 con 0x7f6574109a30 2024-04-25T13:43:55.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.744+0000 7f6570ff9640 1 --2- 172.21.15.43:0/3677946338 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f65600afb80 0x7f65600b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:55.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.744+0000 7f65737fe640 1 --2- 172.21.15.43:0/3677946338 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f65600afb80 0x7f65600b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:55.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.745+0000 7f6570ff9640 1 -- 172.21.15.43:0/3677946338 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f656c0ffc50 con 0x7f6574109a30 2024-04-25T13:43:55.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.745+0000 7f65737fe640 1 --2- 172.21.15.43:0/3677946338 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f65600afb80 0x7f65600b2090 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f65741046f0 tx=0x7f65640093c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:55.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.749+0000 7f6570ff9640 1 -- 172.21.15.43:0/3677946338 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f656c0c8370 con 0x7f6574109a30 2024-04-25T13:43:55.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.936+0000 7f657a0e7640 1 -- 172.21.15.43:0/3677946338 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f65740637d0 con 0x7f6574109a30 2024-04-25T13:43:55.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.936+0000 7f6570ff9640 1 -- 172.21.15.43:0/3677946338 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f656c0c7c70 con 0x7f6574109a30 2024-04-25T13:43:55.936 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T13:43:55.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.938+0000 7f657a0e7640 1 -- 172.21.15.43:0/3677946338 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f65600afb80 msgr2=0x7f65600b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:55.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.938+0000 7f657a0e7640 1 --2- 172.21.15.43:0/3677946338 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f65600afb80 0x7f65600b2090 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f65741046f0 tx=0x7f65640093c0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.938+0000 7f657a0e7640 1 -- 172.21.15.43:0/3677946338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574109a30 msgr2=0x7f65741a15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:55.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.938+0000 7f657a0e7640 1 --2- 172.21.15.43:0/3677946338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574109a30 0x7f65741a15d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f656c005ab0 tx=0x7f656c0042f0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.938+0000 7f657a0e7640 1 -- 172.21.15.43:0/3677946338 shutdown_connections 2024-04-25T13:43:55.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.938+0000 7f657a0e7640 1 --2- 172.21.15.43:0/3677946338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574109a30 0x7f65741a15d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.938+0000 7f657a0e7640 1 --2- 172.21.15.43:0/3677946338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6574104d30 0x7f657419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.938+0000 7f657a0e7640 1 --2- 172.21.15.43:0/3677946338 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f65600afb80 0x7f65600b2090 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.938+0000 7f657a0e7640 1 --2- 172.21.15.43:0/3677946338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6574103af0 0x7f657419a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:55.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.938+0000 7f657a0e7640 1 -- 172.21.15.43:0/3677946338 >> 172.21.15.43:0/3677946338 conn(0x7f65740fece0 msgr2=0x7f6574105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:55.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.938+0000 7f657a0e7640 1 -- 172.21.15.43:0/3677946338 shutdown_connections 2024-04-25T13:43:55.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:55.939+0000 7f657a0e7640 1 -- 172.21.15.43:0/3677946338 wait complete. 2024-04-25T13:43:55.950 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:43:56.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.067+0000 7ff79845a640 1 -- 172.21.15.43:0/4274978103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff790103b10 msgr2=0x7ff790104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:56.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.067+0000 7ff79845a640 1 --2- 172.21.15.43:0/4274978103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff790103b10 0x7ff790104810 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009900 tx=0x7ff78c02a410 comp rx=0 tx=0).stop 2024-04-25T13:43:56.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.067+0000 7ff79845a640 1 -- 172.21.15.43:0/4274978103 shutdown_connections 2024-04-25T13:43:56.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.067+0000 7ff79845a640 1 --2- 172.21.15.43:0/4274978103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff790109a50 0x7ff79010be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.067+0000 7ff79845a640 1 --2- 172.21.15.43:0/4274978103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff790104d50 0x7ff790105160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.067+0000 7ff79845a640 1 --2- 172.21.15.43:0/4274978103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff790103b10 0x7ff790104810 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.067+0000 7ff79845a640 1 -- 172.21.15.43:0/4274978103 >> 172.21.15.43:0/4274978103 conn(0x7ff7900fed40 msgr2=0x7ff7901011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:56.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.067+0000 7ff79845a640 1 -- 172.21.15.43:0/4274978103 shutdown_connections 2024-04-25T13:43:56.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.067+0000 7ff79845a640 1 -- 172.21.15.43:0/4274978103 wait complete. 2024-04-25T13:43:56.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff79845a640 1 Processor -- start 2024-04-25T13:43:56.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff79845a640 1 -- start start 2024-04-25T13:43:56.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff79845a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff790103b10 0x7ff79019a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:56.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff79845a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff790104d50 0x7ff79019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:56.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff79845a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff790109a50 0x7ff7901a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:56.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff79845a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff79010f4a0 con 0x7ff790104d50 2024-04-25T13:43:56.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff79845a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ff79010f320 con 0x7ff790109a50 2024-04-25T13:43:56.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff79845a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff79010f620 con 0x7ff790103b10 2024-04-25T13:43:56.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff7959f5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff790104d50 0x7ff79019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:56.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff7959f5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff790104d50 0x7ff79019a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51848/0 (socket says 172.21.15.43:51848) 2024-04-25T13:43:56.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff7959f5640 1 -- 172.21.15.43:0/3398110271 learned_addr learned my addr 172.21.15.43:0/3398110271 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:56.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff7969f7640 1 --2- 172.21.15.43:0/3398110271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff790109a50 0x7ff7901a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:56.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff7961f6640 1 --2- 172.21.15.43:0/3398110271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff790103b10 0x7ff79019a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:56.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff7959f5640 1 -- 172.21.15.43:0/3398110271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff790103b10 msgr2=0x7ff79019a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:56.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff7959f5640 1 --2- 172.21.15.43:0/3398110271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff790103b10 0x7ff79019a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff7959f5640 1 -- 172.21.15.43:0/3398110271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff790109a50 msgr2=0x7ff7901a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:56.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff7959f5640 1 --2- 172.21.15.43:0/3398110271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff790109a50 0x7ff7901a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff7959f5640 1 -- 172.21.15.43:0/3398110271 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7901a1d50 con 0x7ff790104d50 2024-04-25T13:43:56.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.068+0000 7ff7959f5640 1 --2- 172.21.15.43:0/3398110271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff790104d50 0x7ff79019a750 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff78000d950 tx=0x7ff78000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:56.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.069+0000 7ff7877fe640 1 -- 172.21.15.43:0/3398110271 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780017030 con 0x7ff790104d50 2024-04-25T13:43:56.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.069+0000 7ff7877fe640 1 -- 172.21.15.43:0/3398110271 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff780004020 con 0x7ff790104d50 2024-04-25T13:43:56.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.069+0000 7ff79845a640 1 -- 172.21.15.43:0/3398110271 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7901a1fe0 con 0x7ff790104d50 2024-04-25T13:43:56.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.069+0000 7ff7877fe640 1 -- 172.21.15.43:0/3398110271 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7800055d0 con 0x7ff790104d50 2024-04-25T13:43:56.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.069+0000 7ff79845a640 1 -- 172.21.15.43:0/3398110271 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7901a24a0 con 0x7ff790104d50 2024-04-25T13:43:56.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.070+0000 7ff79845a640 1 -- 172.21.15.43:0/3398110271 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff790108860 con 0x7ff790104d50 2024-04-25T13:43:56.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.071+0000 7ff7877fe640 1 -- 172.21.15.43:0/3398110271 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7ff780009a30 con 0x7ff790104d50 2024-04-25T13:43:56.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.072+0000 7ff7877fe640 1 --2- 172.21.15.43:0/3398110271 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff77c0afb80 0x7ff77c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:56.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.072+0000 7ff7961f6640 1 --2- 172.21.15.43:0/3398110271 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff77c0afb80 0x7ff77c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:56.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.072+0000 7ff7877fe640 1 -- 172.21.15.43:0/3398110271 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7ff7800df2b0 con 0x7ff790104d50 2024-04-25T13:43:56.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.073+0000 7ff7961f6640 1 --2- 172.21.15.43:0/3398110271 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff77c0afb80 0x7ff77c0b2090 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0057c0 tx=0x7ff78c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:56.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.076+0000 7ff7877fe640 1 -- 172.21.15.43:0/3398110271 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff7800a79d0 con 0x7ff790104d50 2024-04-25T13:43:56.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:56 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3589629705' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:43:56.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:56 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3677946338' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:43:56.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.262+0000 7ff79845a640 1 -- 172.21.15.43:0/3398110271 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff7900637a0 con 0x7ff790104d50 2024-04-25T13:43:56.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.262+0000 7ff7877fe640 1 -- 172.21.15.43:0/3398110271 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7ff7800a72d0 con 0x7ff790104d50 2024-04-25T13:43:56.262 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:43:56.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.264+0000 7ff79845a640 1 -- 172.21.15.43:0/3398110271 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff77c0afb80 msgr2=0x7ff77c0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:56.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.264+0000 7ff79845a640 1 --2- 172.21.15.43:0/3398110271 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff77c0afb80 0x7ff77c0b2090 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0057c0 tx=0x7ff78c000bc0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.264+0000 7ff79845a640 1 -- 172.21.15.43:0/3398110271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff790104d50 msgr2=0x7ff79019a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:56.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.264+0000 7ff79845a640 1 --2- 172.21.15.43:0/3398110271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff790104d50 0x7ff79019a750 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff78000d950 tx=0x7ff78000de10 comp rx=0 tx=0).stop 2024-04-25T13:43:56.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.264+0000 7ff79845a640 1 -- 172.21.15.43:0/3398110271 shutdown_connections 2024-04-25T13:43:56.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.264+0000 7ff79845a640 1 --2- 172.21.15.43:0/3398110271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff790109a50 0x7ff7901a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.264+0000 7ff79845a640 1 --2- 172.21.15.43:0/3398110271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff790104d50 0x7ff79019a750 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.264+0000 7ff79845a640 1 --2- 172.21.15.43:0/3398110271 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff77c0afb80 0x7ff77c0b2090 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.264+0000 7ff79845a640 1 --2- 172.21.15.43:0/3398110271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff790103b10 0x7ff79019a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.264+0000 7ff79845a640 1 -- 172.21.15.43:0/3398110271 >> 172.21.15.43:0/3398110271 conn(0x7ff7900fed40 msgr2=0x7ff790105a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:56.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.264+0000 7ff79845a640 1 -- 172.21.15.43:0/3398110271 shutdown_connections 2024-04-25T13:43:56.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.264+0000 7ff79845a640 1 -- 172.21.15.43:0/3398110271 wait complete. 2024-04-25T13:43:56.276 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:43:56.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:56 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3589629705' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:43:56.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:56 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3677946338' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:43:56.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.391+0000 7f96f0506640 1 -- 172.21.15.43:0/1702563077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e81029f0 msgr2=0x7f96e81036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:56.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.391+0000 7f96f0506640 1 --2- 172.21.15.43:0/1702563077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e81029f0 0x7f96e81036f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009900 tx=0x7f96e402a410 comp rx=0 tx=0).stop 2024-04-25T13:43:56.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.391+0000 7f96f0506640 1 -- 172.21.15.43:0/1702563077 shutdown_connections 2024-04-25T13:43:56.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.391+0000 7f96f0506640 1 --2- 172.21.15.43:0/1702563077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96e8108930 0x7f96e810ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.391+0000 7f96f0506640 1 --2- 172.21.15.43:0/1702563077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96e8103c30 0x7f96e8104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.391+0000 7f96f0506640 1 --2- 172.21.15.43:0/1702563077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e81029f0 0x7f96e81036f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.391+0000 7f96f0506640 1 -- 172.21.15.43:0/1702563077 >> 172.21.15.43:0/1702563077 conn(0x7f96e80fdbc0 msgr2=0x7f96e8100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:56.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.391+0000 7f96f0506640 1 -- 172.21.15.43:0/1702563077 shutdown_connections 2024-04-25T13:43:56.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.391+0000 7f96f0506640 1 -- 172.21.15.43:0/1702563077 wait complete. 2024-04-25T13:43:56.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.392+0000 7f96f0506640 1 Processor -- start 2024-04-25T13:43:56.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.392+0000 7f96f0506640 1 -- start start 2024-04-25T13:43:56.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.392+0000 7f96f0506640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96e81029f0 0x7f96e819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:56.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.392+0000 7f96f0506640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e8103c30 0x7f96e819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:56.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.392+0000 7f96f0506640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96e8108930 0x7f96e81a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:56.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.392+0000 7f96f0506640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f96e810f4d0 con 0x7f96e8103c30 2024-04-25T13:43:56.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.392+0000 7f96f0506640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f96e810f350 con 0x7f96e8108930 2024-04-25T13:43:56.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.392+0000 7f96f0506640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96e810f650 con 0x7f96e81029f0 2024-04-25T13:43:56.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.392+0000 7f96edaa1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e8103c30 0x7f96e819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:56.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.392+0000 7f96edaa1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e8103c30 0x7f96e819a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51870/0 (socket says 172.21.15.43:51870) 2024-04-25T13:43:56.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.392+0000 7f96edaa1640 1 -- 172.21.15.43:0/90824866 learned_addr learned my addr 172.21.15.43:0/90824866 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:56.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.392+0000 7f96ee2a2640 1 --2- 172.21.15.43:0/90824866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96e81029f0 0x7f96e819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:56.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.392+0000 7f96eeaa3640 1 --2- 172.21.15.43:0/90824866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96e8108930 0x7f96e81a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:56.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.393+0000 7f96edaa1640 1 -- 172.21.15.43:0/90824866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96e81029f0 msgr2=0x7f96e819a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:56.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.393+0000 7f96edaa1640 1 --2- 172.21.15.43:0/90824866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96e81029f0 0x7f96e819a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.393+0000 7f96edaa1640 1 -- 172.21.15.43:0/90824866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96e8108930 msgr2=0x7f96e81a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:56.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.393+0000 7f96edaa1640 1 --2- 172.21.15.43:0/90824866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96e8108930 0x7f96e81a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.393+0000 7f96edaa1640 1 -- 172.21.15.43:0/90824866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e81a1c20 con 0x7f96e8103c30 2024-04-25T13:43:56.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.393+0000 7f96eeaa3640 1 --2- 172.21.15.43:0/90824866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96e8108930 0x7f96e81a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:56.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.393+0000 7f96edaa1640 1 --2- 172.21.15.43:0/90824866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e8103c30 0x7f96e819a740 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f96d800c970 tx=0x7f96d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:56.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.393+0000 7f96df7fe640 1 -- 172.21.15.43:0/90824866 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d8007bb0 con 0x7f96e8103c30 2024-04-25T13:43:56.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.393+0000 7f96df7fe640 1 -- 172.21.15.43:0/90824866 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96d8007d50 con 0x7f96e8103c30 2024-04-25T13:43:56.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.393+0000 7f96f0506640 1 -- 172.21.15.43:0/90824866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e81a1f10 con 0x7f96e8103c30 2024-04-25T13:43:56.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.393+0000 7f96df7fe640 1 -- 172.21.15.43:0/90824866 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d8004e40 con 0x7f96e8103c30 2024-04-25T13:43:56.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.393+0000 7f96f0506640 1 -- 172.21.15.43:0/90824866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e81a2320 con 0x7f96e8103c30 2024-04-25T13:43:56.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.394+0000 7f96f0506640 1 -- 172.21.15.43:0/90824866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e8107740 con 0x7f96e8103c30 2024-04-25T13:43:56.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.395+0000 7f96df7fe640 1 -- 172.21.15.43:0/90824866 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f96d8005000 con 0x7f96e8103c30 2024-04-25T13:43:56.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.396+0000 7f96df7fe640 1 --2- 172.21.15.43:0/90824866 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f96d40afb80 0x7f96d40b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:56.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.396+0000 7f96df7fe640 1 -- 172.21.15.43:0/90824866 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f96d80df260 con 0x7f96e8103c30 2024-04-25T13:43:56.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.396+0000 7f96ee2a2640 1 --2- 172.21.15.43:0/90824866 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f96d40afb80 0x7f96d40b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:56.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.397+0000 7f96ee2a2640 1 --2- 172.21.15.43:0/90824866 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f96d40afb80 0x7f96d40b2090 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f96e4005760 tx=0x7f96e4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:56.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.400+0000 7f96df7fe640 1 -- 172.21.15.43:0/90824866 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f96d8014030 con 0x7f96e8103c30 2024-04-25T13:43:56.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:56 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3589629705' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:43:56.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:56 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3677946338' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:43:56.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.586+0000 7f96f0506640 1 -- 172.21.15.43:0/90824866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f96e80637d0 con 0x7f96e8103c30 2024-04-25T13:43:56.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.586+0000 7f96df7fe640 1 -- 172.21.15.43:0/90824866 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7f96d80a7980 con 0x7f96e8103c30 2024-04-25T13:43:56.586 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-25T13:43:56.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.588+0000 7f96f0506640 1 -- 172.21.15.43:0/90824866 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f96d40afb80 msgr2=0x7f96d40b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:56.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.588+0000 7f96f0506640 1 --2- 172.21.15.43:0/90824866 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f96d40afb80 0x7f96d40b2090 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f96e4005760 tx=0x7f96e4000bc0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.588+0000 7f96f0506640 1 -- 172.21.15.43:0/90824866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e8103c30 msgr2=0x7f96e819a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:56.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.588+0000 7f96f0506640 1 --2- 172.21.15.43:0/90824866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e8103c30 0x7f96e819a740 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f96d800c970 tx=0x7f96d800ce30 comp rx=0 tx=0).stop 2024-04-25T13:43:56.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.588+0000 7f96f0506640 1 -- 172.21.15.43:0/90824866 shutdown_connections 2024-04-25T13:43:56.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.588+0000 7f96f0506640 1 --2- 172.21.15.43:0/90824866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96e8108930 0x7f96e81a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.588+0000 7f96f0506640 1 --2- 172.21.15.43:0/90824866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e8103c30 0x7f96e819a740 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.588+0000 7f96f0506640 1 --2- 172.21.15.43:0/90824866 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f96d40afb80 0x7f96d40b2090 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.588+0000 7f96f0506640 1 --2- 172.21.15.43:0/90824866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96e81029f0 0x7f96e819a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.588+0000 7f96f0506640 1 -- 172.21.15.43:0/90824866 >> 172.21.15.43:0/90824866 conn(0x7f96e80fdbc0 msgr2=0x7f96e8104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:56.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.589+0000 7f96f0506640 1 -- 172.21.15.43:0/90824866 shutdown_connections 2024-04-25T13:43:56.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.589+0000 7f96f0506640 1 -- 172.21.15.43:0/90824866 wait complete. 2024-04-25T13:43:56.600 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:43:56.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.715+0000 7fa0ab6b6640 1 -- 172.21.15.43:0/1428165325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a41033d0 msgr2=0x7fa0a41037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.715+0000 7fa0ab6b6640 1 --2- 172.21.15.43:0/1428165325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a41033d0 0x7fa0a41037e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa094009900 tx=0x7fa09402a410 comp rx=0 tx=0).stop 2024-04-25T13:43:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.715+0000 7fa0ab6b6640 1 -- 172.21.15.43:0/1428165325 shutdown_connections 2024-04-25T13:43:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.715+0000 7fa0ab6b6640 1 --2- 172.21.15.43:0/1428165325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a41080d0 0x7fa0a410a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.715+0000 7fa0ab6b6640 1 --2- 172.21.15.43:0/1428165325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a41033d0 0x7fa0a41037e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.715+0000 7fa0ab6b6640 1 --2- 172.21.15.43:0/1428165325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0a4102190 0x7fa0a4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.715+0000 7fa0ab6b6640 1 -- 172.21.15.43:0/1428165325 >> 172.21.15.43:0/1428165325 conn(0x7fa0a40fd380 msgr2=0x7fa0a40ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.715+0000 7fa0ab6b6640 1 -- 172.21.15.43:0/1428165325 shutdown_connections 2024-04-25T13:43:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.715+0000 7fa0ab6b6640 1 -- 172.21.15.43:0/1428165325 wait complete. 2024-04-25T13:43:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.716+0000 7fa0ab6b6640 1 Processor -- start 2024-04-25T13:43:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.716+0000 7fa0ab6b6640 1 -- start start 2024-04-25T13:43:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.716+0000 7fa0ab6b6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a4102190 0x7fa0a4199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.716+0000 7fa0ab6b6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0a41033d0 0x7fa0a4199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.716+0000 7fa0ab6b6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a41080d0 0x7fa0a41a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.716+0000 7fa0ab6b6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a410db60 con 0x7fa0a41080d0 2024-04-25T13:43:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.716+0000 7fa0ab6b6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a410d9e0 con 0x7fa0a41033d0 2024-04-25T13:43:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.716+0000 7fa0ab6b6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a410dce0 con 0x7fa0a4102190 2024-04-25T13:43:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.716+0000 7fa0a9c53640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a41080d0 0x7fa0a41a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.716+0000 7fa0a9c53640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a41080d0 0x7fa0a41a04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51888/0 (socket says 172.21.15.43:51888) 2024-04-25T13:43:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.716+0000 7fa0a9c53640 1 -- 172.21.15.43:0/694054162 learned_addr learned my addr 172.21.15.43:0/694054162 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.717+0000 7fa0a9452640 1 --2- 172.21.15.43:0/694054162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a4102190 0x7fa0a4199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.717+0000 7fa0a8c51640 1 --2- 172.21.15.43:0/694054162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0a41033d0 0x7fa0a4199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.717+0000 7fa0a9c53640 1 -- 172.21.15.43:0/694054162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a4102190 msgr2=0x7fa0a4199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.717+0000 7fa0a9c53640 1 --2- 172.21.15.43:0/694054162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a4102190 0x7fa0a4199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.717+0000 7fa0a9c53640 1 -- 172.21.15.43:0/694054162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0a41033d0 msgr2=0x7fa0a4199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.717+0000 7fa0a9c53640 1 --2- 172.21.15.43:0/694054162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0a41033d0 0x7fa0a4199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.717+0000 7fa0a9c53640 1 -- 172.21.15.43:0/694054162 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a41a0aa0 con 0x7fa0a41080d0 2024-04-25T13:43:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.717+0000 7fa0a9c53640 1 --2- 172.21.15.43:0/694054162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a41080d0 0x7fa0a41a04e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00cce0 tx=0x7fa09c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.717+0000 7fa09a7fc640 1 -- 172.21.15.43:0/694054162 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09c00f450 con 0x7fa0a41080d0 2024-04-25T13:43:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.717+0000 7fa09a7fc640 1 -- 172.21.15.43:0/694054162 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa09c00fa80 con 0x7fa0a41080d0 2024-04-25T13:43:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.717+0000 7fa09a7fc640 1 -- 172.21.15.43:0/694054162 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09c018ad0 con 0x7fa0a41080d0 2024-04-25T13:43:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.717+0000 7fa0ab6b6640 1 -- 172.21.15.43:0/694054162 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0a41a0d90 con 0x7fa0a41080d0 2024-04-25T13:43:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.717+0000 7fa0ab6b6640 1 -- 172.21.15.43:0/694054162 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0a41a1220 con 0x7fa0a41080d0 2024-04-25T13:43:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.718+0000 7fa0ab6b6640 1 -- 172.21.15.43:0/694054162 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0a41077d0 con 0x7fa0a41080d0 2024-04-25T13:43:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.721+0000 7fa09a7fc640 1 -- 172.21.15.43:0/694054162 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fa09c00f5f0 con 0x7fa0a41080d0 2024-04-25T13:43:56.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.721+0000 7fa09a7fc640 1 --2- 172.21.15.43:0/694054162 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa0900afc00 0x7fa0900b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:56.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.721+0000 7fa0a9452640 1 --2- 172.21.15.43:0/694054162 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa0900afc00 0x7fa0900b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:56.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.721+0000 7fa09a7fc640 1 -- 172.21.15.43:0/694054162 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fa09c0df920 con 0x7fa0a41080d0 2024-04-25T13:43:56.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.722+0000 7fa0a9452640 1 --2- 172.21.15.43:0/694054162 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa0900afc00 0x7fa0900b2110 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4102d90 tx=0x7fa0a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:56.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.725+0000 7fa09a7fc640 1 -- 172.21.15.43:0/694054162 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa09c014030 con 0x7fa0a41080d0 2024-04-25T13:43:56.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.912+0000 7fa0ab6b6640 1 -- 172.21.15.43:0/694054162 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa0a40637d0 con 0x7fa0a41080d0 2024-04-25T13:43:56.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.913+0000 7fa09a7fc640 1 -- 172.21.15.43:0/694054162 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v82) ==== 103+0+11 (secure 0 0 0) 0x7fa09c0a8150 con 0x7fa0a41080d0 2024-04-25T13:43:56.913 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:43:56.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.915+0000 7fa0ab6b6640 1 -- 172.21.15.43:0/694054162 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa0900afc00 msgr2=0x7fa0900b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:56.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.915+0000 7fa0ab6b6640 1 --2- 172.21.15.43:0/694054162 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa0900afc00 0x7fa0900b2110 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4102d90 tx=0x7fa0a0005f90 comp rx=0 tx=0).stop 2024-04-25T13:43:56.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.915+0000 7fa0ab6b6640 1 -- 172.21.15.43:0/694054162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a41080d0 msgr2=0x7fa0a41a04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:56.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.915+0000 7fa0ab6b6640 1 --2- 172.21.15.43:0/694054162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a41080d0 0x7fa0a41a04e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00cce0 tx=0x7fa09c00a620 comp rx=0 tx=0).stop 2024-04-25T13:43:56.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.915+0000 7fa0ab6b6640 1 -- 172.21.15.43:0/694054162 shutdown_connections 2024-04-25T13:43:56.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.915+0000 7fa0ab6b6640 1 --2- 172.21.15.43:0/694054162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0a41080d0 0x7fa0a41a04e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.915+0000 7fa0ab6b6640 1 --2- 172.21.15.43:0/694054162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0a41033d0 0x7fa0a4199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.915+0000 7fa0ab6b6640 1 --2- 172.21.15.43:0/694054162 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fa0900afc00 0x7fa0900b2110 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.915+0000 7fa0ab6b6640 1 --2- 172.21.15.43:0/694054162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a4102190 0x7fa0a4199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:56.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.915+0000 7fa0ab6b6640 1 -- 172.21.15.43:0/694054162 >> 172.21.15.43:0/694054162 conn(0x7fa0a40fd380 msgr2=0x7fa0a40fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:56.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.915+0000 7fa0ab6b6640 1 -- 172.21.15.43:0/694054162 shutdown_connections 2024-04-25T13:43:56.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:56.915+0000 7fa0ab6b6640 1 -- 172.21.15.43:0/694054162 wait complete. 2024-04-25T13:43:56.926 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:57.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.040+0000 7febe3005640 1 -- 172.21.15.43:0/833566413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febdc108920 msgr2=0x7febdc10ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:57.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.040+0000 7febe3005640 1 --2- 172.21.15.43:0/833566413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febdc108920 0x7febdc10ad40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7febd4009ca0 tx=0x7febd402a8c0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.040+0000 7febe3005640 1 -- 172.21.15.43:0/833566413 shutdown_connections 2024-04-25T13:43:57.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.040+0000 7febe3005640 1 --2- 172.21.15.43:0/833566413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febdc108920 0x7febdc10ad40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.040+0000 7febe3005640 1 --2- 172.21.15.43:0/833566413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febdc103c20 0x7febdc104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.040+0000 7febe3005640 1 --2- 172.21.15.43:0/833566413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febdc1029e0 0x7febdc1036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.040+0000 7febe3005640 1 -- 172.21.15.43:0/833566413 >> 172.21.15.43:0/833566413 conn(0x7febdc0fdbd0 msgr2=0x7febdc100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:57.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.040+0000 7febe3005640 1 -- 172.21.15.43:0/833566413 shutdown_connections 2024-04-25T13:43:57.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.040+0000 7febe3005640 1 -- 172.21.15.43:0/833566413 wait complete. 2024-04-25T13:43:57.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.040+0000 7febe3005640 1 Processor -- start 2024-04-25T13:43:57.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.040+0000 7febe3005640 1 -- start start 2024-04-25T13:43:57.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febe3005640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febdc1029e0 0x7febdc0757d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:57.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febe3005640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febdc103c20 0x7febdc19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:57.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febe3005640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febdc108920 0x7febdc1a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:57.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febe3005640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7febdc10e3f0 con 0x7febdc1029e0 2024-04-25T13:43:57.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febe3005640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7febdc10e270 con 0x7febdc108920 2024-04-25T13:43:57.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febe3005640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7febdc10e570 con 0x7febdc103c20 2024-04-25T13:43:57.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febe0da1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febdc1029e0 0x7febdc0757d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:57.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febe0da1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febdc1029e0 0x7febdc0757d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51894/0 (socket says 172.21.15.43:51894) 2024-04-25T13:43:57.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febe0da1640 1 -- 172.21.15.43:0/3194056855 learned_addr learned my addr 172.21.15.43:0/3194056855 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:57.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febe15a2640 1 --2- 172.21.15.43:0/3194056855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febdc108920 0x7febdc1a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:57.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febdbfff640 1 --2- 172.21.15.43:0/3194056855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febdc103c20 0x7febdc19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:57.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febe0da1640 1 -- 172.21.15.43:0/3194056855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febdc103c20 msgr2=0x7febdc19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:57.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febe0da1640 1 --2- 172.21.15.43:0/3194056855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febdc103c20 0x7febdc19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febe0da1640 1 -- 172.21.15.43:0/3194056855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febdc108920 msgr2=0x7febdc1a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:57.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febe0da1640 1 --2- 172.21.15.43:0/3194056855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febdc108920 0x7febdc1a1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febe0da1640 1 -- 172.21.15.43:0/3194056855 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febdc1a1c60 con 0x7febdc1029e0 2024-04-25T13:43:57.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febe0da1640 1 --2- 172.21.15.43:0/3194056855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febdc1029e0 0x7febdc0757d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7febd000d740 tx=0x7febd000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:57.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.041+0000 7febd9ffb640 1 -- 172.21.15.43:0/3194056855 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0017070 con 0x7febdc1029e0 2024-04-25T13:43:57.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.042+0000 7febd9ffb640 1 -- 172.21.15.43:0/3194056855 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febd000de50 con 0x7febdc1029e0 2024-04-25T13:43:57.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.042+0000 7febe3005640 1 -- 172.21.15.43:0/3194056855 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febdc1a1f50 con 0x7febdc1029e0 2024-04-25T13:43:57.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.042+0000 7febd9ffb640 1 -- 172.21.15.43:0/3194056855 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0003bb0 con 0x7febdc1029e0 2024-04-25T13:43:57.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.042+0000 7febe3005640 1 -- 172.21.15.43:0/3194056855 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febdc1a23b0 con 0x7febdc1029e0 2024-04-25T13:43:57.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.043+0000 7febe3005640 1 -- 172.21.15.43:0/3194056855 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febdc06a190 con 0x7febdc1029e0 2024-04-25T13:43:57.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.044+0000 7febd9ffb640 1 -- 172.21.15.43:0/3194056855 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7febd0003d50 con 0x7febdc1029e0 2024-04-25T13:43:57.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.045+0000 7febd9ffb640 1 --2- 172.21.15.43:0/3194056855 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7febcc0afb80 0x7febcc0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:57.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.045+0000 7febdbfff640 1 --2- 172.21.15.43:0/3194056855 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7febcc0afb80 0x7febcc0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:57.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.045+0000 7febd9ffb640 1 -- 172.21.15.43:0/3194056855 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7febd00deab0 con 0x7febdc1029e0 2024-04-25T13:43:57.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.045+0000 7febdbfff640 1 --2- 172.21.15.43:0/3194056855 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7febcc0afb80 0x7febcc0b2090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7febdc0751e0 tx=0x7febc800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:57.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.049+0000 7febd9ffb640 1 -- 172.21.15.43:0/3194056855 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7febd00a6b20 con 0x7febdc1029e0 2024-04-25T13:43:57.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:57 smithi043 ceph-mon[29195]: pgmap v341: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:57.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:57 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3398110271' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:43:57.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:57 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/90824866' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:43:57.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:57 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/694054162' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:43:57.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.278+0000 7febe3005640 1 -- 172.21.15.43:0/3194056855 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febdc02dc10 con 0x7febdc1029e0 2024-04-25T13:43:57.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.279+0000 7febd9ffb640 1 -- 172.21.15.43:0/3194056855 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11876 (secure 0 0 0) 0x7febd00aae20 con 0x7febdc1029e0 2024-04-25T13:43:57.279 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:43:57.279 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2642701222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2642701222},{"type":"v1","addr":"172.21.15.43:6839","nonce":2642701222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6841/3777483996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":3777483996},{"type":"v1","addr":"172.21.15.43:6841","nonce":3777483996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T13:42:08.401075+0000","modified":"2024-04-25T13:42:36.143414+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24542,"mds_1":24509,"mds_2":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6839/3323587585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3323587585},{"type":"v1","addr":"172.21.15.175:6839","nonce":3323587585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.161:6837/1464384320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1464384320},{"type":"v1","addr":"172.21.15.161:6837","nonce":1464384320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6839/1243414461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":1243414461},{"type":"v1","addr":"172.21.15.161:6839","nonce":1243414461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24542,"qdb_cluster":[24542,24502,24509]},"id":1}]} 2024-04-25T13:43:57.279 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 24 2024-04-25T13:43:57.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.281+0000 7febe3005640 1 -- 172.21.15.43:0/3194056855 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7febcc0afb80 msgr2=0x7febcc0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:57.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.281+0000 7febe3005640 1 --2- 172.21.15.43:0/3194056855 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7febcc0afb80 0x7febcc0b2090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7febdc0751e0 tx=0x7febc800b390 comp rx=0 tx=0).stop 2024-04-25T13:43:57.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.281+0000 7febe3005640 1 -- 172.21.15.43:0/3194056855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febdc1029e0 msgr2=0x7febdc0757d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:57.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.281+0000 7febe3005640 1 --2- 172.21.15.43:0/3194056855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febdc1029e0 0x7febdc0757d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7febd000d740 tx=0x7febd000dc00 comp rx=0 tx=0).stop 2024-04-25T13:43:57.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.281+0000 7febe3005640 1 -- 172.21.15.43:0/3194056855 shutdown_connections 2024-04-25T13:43:57.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.281+0000 7febe3005640 1 --2- 172.21.15.43:0/3194056855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febdc108920 0x7febdc1a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.281+0000 7febe3005640 1 --2- 172.21.15.43:0/3194056855 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7febcc0afb80 0x7febcc0b2090 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.281+0000 7febe3005640 1 --2- 172.21.15.43:0/3194056855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febdc103c20 0x7febdc19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.281+0000 7febe3005640 1 --2- 172.21.15.43:0/3194056855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febdc1029e0 0x7febdc0757d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.281+0000 7febe3005640 1 -- 172.21.15.43:0/3194056855 >> 172.21.15.43:0/3194056855 conn(0x7febdc0fdbd0 msgr2=0x7febdc104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:57.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.281+0000 7febe3005640 1 -- 172.21.15.43:0/3194056855 shutdown_connections 2024-04-25T13:43:57.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.281+0000 7febe3005640 1 -- 172.21.15.43:0/3194056855 wait complete. 2024-04-25T13:43:57.293 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:43:57.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:57 smithi161 ceph-mon[32696]: pgmap v341: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:57.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:57 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3398110271' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:43:57.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:57 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/90824866' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:43:57.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:57 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/694054162' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:43:57.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.404+0000 7f680e185640 1 -- 172.21.15.43:0/3604210352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68081029e0 msgr2=0x7f68081036e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:57.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.404+0000 7f680e185640 1 --2- 172.21.15.43:0/3604210352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68081029e0 0x7f68081036e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009ca0 tx=0x7f67f802a8c0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.404+0000 7f680e185640 1 -- 172.21.15.43:0/3604210352 shutdown_connections 2024-04-25T13:43:57.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.404+0000 7f680e185640 1 --2- 172.21.15.43:0/3604210352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6808108920 0x7f680810ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.404+0000 7f680e185640 1 --2- 172.21.15.43:0/3604210352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6808103c20 0x7f6808104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.404+0000 7f680e185640 1 --2- 172.21.15.43:0/3604210352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68081029e0 0x7f68081036e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.404+0000 7f680e185640 1 -- 172.21.15.43:0/3604210352 >> 172.21.15.43:0/3604210352 conn(0x7f68080fdbd0 msgr2=0x7f6808100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:57.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.404+0000 7f680e185640 1 -- 172.21.15.43:0/3604210352 shutdown_connections 2024-04-25T13:43:57.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.404+0000 7f680e185640 1 -- 172.21.15.43:0/3604210352 wait complete. 2024-04-25T13:43:57.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.405+0000 7f680e185640 1 Processor -- start 2024-04-25T13:43:57.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.405+0000 7f680e185640 1 -- start start 2024-04-25T13:43:57.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.405+0000 7f680e185640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68081029e0 0x7f6808075840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:57.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.405+0000 7f680e185640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6808103c20 0x7f680819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:57.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.405+0000 7f680e185640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6808108920 0x7f68081a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:57.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.405+0000 7f680e185640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f680810e3e0 con 0x7f6808103c20 2024-04-25T13:43:57.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.405+0000 7f680e185640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f680810e260 con 0x7f6808108920 2024-04-25T13:43:57.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.405+0000 7f680e185640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f680810e560 con 0x7f68081029e0 2024-04-25T13:43:57.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.405+0000 7f6806ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6808103c20 0x7f680819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:57.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.406+0000 7f6806ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6808103c20 0x7f680819ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51912/0 (socket says 172.21.15.43:51912) 2024-04-25T13:43:57.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.406+0000 7f6806ffd640 1 -- 172.21.15.43:0/2607840277 learned_addr learned my addr 172.21.15.43:0/2607840277 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:57.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.406+0000 7f6807fff640 1 --2- 172.21.15.43:0/2607840277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6808108920 0x7f68081a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:57.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.406+0000 7f68077fe640 1 --2- 172.21.15.43:0/2607840277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68081029e0 0x7f6808075840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:57.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.406+0000 7f6806ffd640 1 -- 172.21.15.43:0/2607840277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68081029e0 msgr2=0x7f6808075840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:57.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.406+0000 7f6806ffd640 1 --2- 172.21.15.43:0/2607840277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68081029e0 0x7f6808075840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.406+0000 7f6806ffd640 1 -- 172.21.15.43:0/2607840277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6808108920 msgr2=0x7f68081a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:57.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.406+0000 7f6806ffd640 1 --2- 172.21.15.43:0/2607840277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6808108920 0x7f68081a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.406+0000 7f6806ffd640 1 -- 172.21.15.43:0/2607840277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68081a1cc0 con 0x7f6808103c20 2024-04-25T13:43:57.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.406+0000 7f68077fe640 1 --2- 172.21.15.43:0/2607840277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68081029e0 0x7f6808075840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:57.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.406+0000 7f6806ffd640 1 --2- 172.21.15.43:0/2607840277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6808103c20 0x7f680819ef50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00c890 tx=0x7f67fc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:57.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.406+0000 7f6804ff9640 1 -- 172.21.15.43:0/2607840277 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc004220 con 0x7f6808103c20 2024-04-25T13:43:57.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.406+0000 7f680e185640 1 -- 172.21.15.43:0/2607840277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68081a1fb0 con 0x7f6808103c20 2024-04-25T13:43:57.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.406+0000 7f6804ff9640 1 -- 172.21.15.43:0/2607840277 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67fc007e40 con 0x7f6808103c20 2024-04-25T13:43:57.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.406+0000 7f6804ff9640 1 -- 172.21.15.43:0/2607840277 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc004a00 con 0x7f6808103c20 2024-04-25T13:43:57.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.406+0000 7f680e185640 1 -- 172.21.15.43:0/2607840277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68081a2470 con 0x7f6808103c20 2024-04-25T13:43:57.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.407+0000 7f680e185640 1 -- 172.21.15.43:0/2607840277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6808107730 con 0x7f6808103c20 2024-04-25T13:43:57.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.409+0000 7f6804ff9640 1 -- 172.21.15.43:0/2607840277 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f67fc0079b0 con 0x7f6808103c20 2024-04-25T13:43:57.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.409+0000 7f6804ff9640 1 --2- 172.21.15.43:0/2607840277 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f67f00afb80 0x7f67f00b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:57.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.409+0000 7f68077fe640 1 --2- 172.21.15.43:0/2607840277 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f67f00afb80 0x7f67f00b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:57.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.409+0000 7f6804ff9640 1 -- 172.21.15.43:0/2607840277 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f67fc0df200 con 0x7f6808103c20 2024-04-25T13:43:57.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.410+0000 7f68077fe640 1 --2- 172.21.15.43:0/2607840277 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f67f00afb80 0x7f67f00b2090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f67f8006010 tx=0x7f67f80319a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:57.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.413+0000 7f6804ff9640 1 -- 172.21.15.43:0/2607840277 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f67fc014030 con 0x7f6808103c20 2024-04-25T13:43:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:57 smithi175 ceph-mon[32649]: pgmap v341: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:43:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:57 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3398110271' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:43:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:57 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/90824866' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:43:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:57 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/694054162' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:43:57.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.600+0000 7f680e185640 1 -- 172.21.15.43:0/2607840277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f680802dd20 con 0x7f6808103c20 2024-04-25T13:43:57.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.602+0000 7f6804ff9640 1 -- 172.21.15.43:0/2607840277 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24645 (secure 0 0 0) 0x7f67fc0a7920 con 0x7f6808103c20 2024-04-25T13:43:57.602 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:43:57.602 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":82,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:42:59.189836+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:43:57.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.604+0000 7f680e185640 1 -- 172.21.15.43:0/2607840277 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f67f00afb80 msgr2=0x7f67f00b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:57.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.604+0000 7f680e185640 1 --2- 172.21.15.43:0/2607840277 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f67f00afb80 0x7f67f00b2090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f67f8006010 tx=0x7f67f80319a0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.604+0000 7f680e185640 1 -- 172.21.15.43:0/2607840277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6808103c20 msgr2=0x7f680819ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:57.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.604+0000 7f680e185640 1 --2- 172.21.15.43:0/2607840277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6808103c20 0x7f680819ef50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00c890 tx=0x7f67fc00cd50 comp rx=0 tx=0).stop 2024-04-25T13:43:57.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.604+0000 7f680e185640 1 -- 172.21.15.43:0/2607840277 shutdown_connections 2024-04-25T13:43:57.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.604+0000 7f680e185640 1 --2- 172.21.15.43:0/2607840277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6808108920 0x7f68081a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.604+0000 7f680e185640 1 --2- 172.21.15.43:0/2607840277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6808103c20 0x7f680819ef50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.604+0000 7f680e185640 1 --2- 172.21.15.43:0/2607840277 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f67f00afb80 0x7f67f00b2090 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.604+0000 7f680e185640 1 --2- 172.21.15.43:0/2607840277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68081029e0 0x7f6808075840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.604+0000 7f680e185640 1 -- 172.21.15.43:0/2607840277 >> 172.21.15.43:0/2607840277 conn(0x7f68080fdbd0 msgr2=0x7f6808104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:57.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.604+0000 7f680e185640 1 -- 172.21.15.43:0/2607840277 shutdown_connections 2024-04-25T13:43:57.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.604+0000 7f680e185640 1 -- 172.21.15.43:0/2607840277 wait complete. 2024-04-25T13:43:57.616 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:37:25.931659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:06.202688+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:07.348534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:42:11.056739+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:43:57.617 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:43:57.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.731+0000 7f7e93bb2640 1 -- 172.21.15.43:0/1643579770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e8c109a30 msgr2=0x7f7e8c10be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:57.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.731+0000 7f7e93bb2640 1 --2- 172.21.15.43:0/1643579770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e8c109a30 0x7f7e8c10be50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009ca0 tx=0x7f7e8402a8c0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.731+0000 7f7e93bb2640 1 -- 172.21.15.43:0/1643579770 shutdown_connections 2024-04-25T13:43:57.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.731+0000 7f7e93bb2640 1 --2- 172.21.15.43:0/1643579770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e8c109a30 0x7f7e8c10be50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.731+0000 7f7e93bb2640 1 --2- 172.21.15.43:0/1643579770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e8c104d30 0x7f7e8c105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.731+0000 7f7e93bb2640 1 --2- 172.21.15.43:0/1643579770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e8c103af0 0x7f7e8c1047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.731+0000 7f7e93bb2640 1 -- 172.21.15.43:0/1643579770 >> 172.21.15.43:0/1643579770 conn(0x7f7e8c0fece0 msgr2=0x7f7e8c101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:57.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.732+0000 7f7e93bb2640 1 -- 172.21.15.43:0/1643579770 shutdown_connections 2024-04-25T13:43:57.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.732+0000 7f7e93bb2640 1 -- 172.21.15.43:0/1643579770 wait complete. 2024-04-25T13:43:57.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.732+0000 7f7e93bb2640 1 Processor -- start 2024-04-25T13:43:57.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.732+0000 7f7e93bb2640 1 -- start start 2024-04-25T13:43:57.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.732+0000 7f7e93bb2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e8c103af0 0x7f7e8c19a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:57.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.732+0000 7f7e93bb2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e8c104d30 0x7f7e8c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:57.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.732+0000 7f7e93bb2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e8c109a30 0x7f7e8c1a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:57.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.732+0000 7f7e93bb2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c10f520 con 0x7f7e8c104d30 2024-04-25T13:43:57.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.732+0000 7f7e93bb2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c10f3a0 con 0x7f7e8c103af0 2024-04-25T13:43:57.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.732+0000 7f7e93bb2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c10f6a0 con 0x7f7e8c109a30 2024-04-25T13:43:57.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.732+0000 7f7e9114d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e8c104d30 0x7f7e8c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:57.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.733+0000 7f7e9114d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e8c104d30 0x7f7e8c19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51930/0 (socket says 172.21.15.43:51930) 2024-04-25T13:43:57.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.733+0000 7f7e9114d640 1 -- 172.21.15.43:0/1854654298 learned_addr learned my addr 172.21.15.43:0/1854654298 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:57.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.733+0000 7f7e9194e640 1 --2- 172.21.15.43:0/1854654298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e8c103af0 0x7f7e8c19a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:57.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.733+0000 7f7e9214f640 1 --2- 172.21.15.43:0/1854654298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e8c109a30 0x7f7e8c1a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:57.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.733+0000 7f7e9114d640 1 -- 172.21.15.43:0/1854654298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e8c109a30 msgr2=0x7f7e8c1a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:57.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.733+0000 7f7e9114d640 1 --2- 172.21.15.43:0/1854654298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e8c109a30 0x7f7e8c1a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.733+0000 7f7e9114d640 1 -- 172.21.15.43:0/1854654298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e8c103af0 msgr2=0x7f7e8c19a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:57.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.733+0000 7f7e9114d640 1 --2- 172.21.15.43:0/1854654298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e8c103af0 0x7f7e8c19a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.733+0000 7f7e9114d640 1 -- 172.21.15.43:0/1854654298 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c1a1b80 con 0x7f7e8c104d30 2024-04-25T13:43:57.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.733+0000 7f7e9114d640 1 --2- 172.21.15.43:0/1854654298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e8c104d30 0x7f7e8c19a630 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00c920 tx=0x7f7e7c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:57.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.733+0000 7f7e82ffd640 1 -- 172.21.15.43:0/1854654298 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c007c70 con 0x7f7e8c104d30 2024-04-25T13:43:57.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.733+0000 7f7e82ffd640 1 -- 172.21.15.43:0/1854654298 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e7c007e10 con 0x7f7e8c104d30 2024-04-25T13:43:57.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.733+0000 7f7e93bb2640 1 -- 172.21.15.43:0/1854654298 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8c1a1e70 con 0x7f7e8c104d30 2024-04-25T13:43:57.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.733+0000 7f7e82ffd640 1 -- 172.21.15.43:0/1854654298 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c018710 con 0x7f7e8c104d30 2024-04-25T13:43:57.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.733+0000 7f7e93bb2640 1 -- 172.21.15.43:0/1854654298 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8c1a2330 con 0x7f7e8c104d30 2024-04-25T13:43:57.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.734+0000 7f7e93bb2640 1 -- 172.21.15.43:0/1854654298 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e8c108840 con 0x7f7e8c104d30 2024-04-25T13:43:57.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.736+0000 7f7e82ffd640 1 -- 172.21.15.43:0/1854654298 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f7e7c00f450 con 0x7f7e8c104d30 2024-04-25T13:43:57.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.736+0000 7f7e82ffd640 1 --2- 172.21.15.43:0/1854654298 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f7e780afc00 0x7f7e780b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:57.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.737+0000 7f7e9194e640 1 --2- 172.21.15.43:0/1854654298 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f7e780afc00 0x7f7e780b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:57.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.737+0000 7f7e82ffd640 1 -- 172.21.15.43:0/1854654298 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f7e7c0df4f0 con 0x7f7e8c104d30 2024-04-25T13:43:57.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.737+0000 7f7e9194e640 1 --2- 172.21.15.43:0/1854654298 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f7e780afc00 0x7f7e780b2110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7e88005fd0 tx=0x7f7e8800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:57.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.740+0000 7f7e82ffd640 1 -- 172.21.15.43:0/1854654298 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7e7c014030 con 0x7f7e8c104d30 2024-04-25T13:43:57.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.953+0000 7f7e93bb2640 1 -- 172.21.15.43:0/1854654298 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7e8c02dce0 con 0x7f7e8c104d30 2024-04-25T13:43:57.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.954+0000 7f7e82ffd640 1 -- 172.21.15.43:0/1854654298 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f7e7c0a7d20 con 0x7f7e8c104d30 2024-04-25T13:43:57.954 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T13:43:57.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.958+0000 7f7e93bb2640 1 -- 172.21.15.43:0/1854654298 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f7e780afc00 msgr2=0x7f7e780b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:57.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.958+0000 7f7e93bb2640 1 --2- 172.21.15.43:0/1854654298 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f7e780afc00 0x7f7e780b2110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7e88005fd0 tx=0x7f7e8800b390 comp rx=0 tx=0).stop 2024-04-25T13:43:57.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.958+0000 7f7e93bb2640 1 -- 172.21.15.43:0/1854654298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e8c104d30 msgr2=0x7f7e8c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:57.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.958+0000 7f7e93bb2640 1 --2- 172.21.15.43:0/1854654298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e8c104d30 0x7f7e8c19a630 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00c920 tx=0x7f7e7c00cde0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.958+0000 7f7e93bb2640 1 -- 172.21.15.43:0/1854654298 shutdown_connections 2024-04-25T13:43:57.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.958+0000 7f7e93bb2640 1 --2- 172.21.15.43:0/1854654298 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f7e780afc00 0x7f7e780b2110 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.958+0000 7f7e93bb2640 1 --2- 172.21.15.43:0/1854654298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e8c109a30 0x7f7e8c1a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.958+0000 7f7e93bb2640 1 --2- 172.21.15.43:0/1854654298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e8c104d30 0x7f7e8c19a630 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.958+0000 7f7e93bb2640 1 --2- 172.21.15.43:0/1854654298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e8c103af0 0x7f7e8c19a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:57.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.958+0000 7f7e93bb2640 1 -- 172.21.15.43:0/1854654298 >> 172.21.15.43:0/1854654298 conn(0x7f7e8c0fece0 msgr2=0x7f7e8c105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:57.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.959+0000 7f7e93bb2640 1 -- 172.21.15.43:0/1854654298 shutdown_connections 2024-04-25T13:43:57.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:57.959+0000 7f7e93bb2640 1 -- 172.21.15.43:0/1854654298 wait complete. 2024-04-25T13:43:57.973 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:43:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.090+0000 7f0be9f00640 1 -- 172.21.15.43:0/3771848447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be4103c20 msgr2=0x7f0be4104030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.090+0000 7f0be9f00640 1 --2- 172.21.15.43:0/3771848447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be4103c20 0x7f0be4104030 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009900 tx=0x7f0bd802a410 comp rx=0 tx=0).stop 2024-04-25T13:43:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.090+0000 7f0be9f00640 1 -- 172.21.15.43:0/3771848447 shutdown_connections 2024-04-25T13:43:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.090+0000 7f0be9f00640 1 --2- 172.21.15.43:0/3771848447 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be4108920 0x7f0be410ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.090+0000 7f0be9f00640 1 --2- 172.21.15.43:0/3771848447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be4103c20 0x7f0be4104030 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.090+0000 7f0be9f00640 1 --2- 172.21.15.43:0/3771848447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be41029e0 0x7f0be41036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.090+0000 7f0be9f00640 1 -- 172.21.15.43:0/3771848447 >> 172.21.15.43:0/3771848447 conn(0x7f0be40fdbd0 msgr2=0x7f0be4100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.090+0000 7f0be9f00640 1 -- 172.21.15.43:0/3771848447 shutdown_connections 2024-04-25T13:43:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.090+0000 7f0be9f00640 1 -- 172.21.15.43:0/3771848447 wait complete. 2024-04-25T13:43:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.091+0000 7f0be9f00640 1 Processor -- start 2024-04-25T13:43:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.091+0000 7f0be9f00640 1 -- start start 2024-04-25T13:43:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.091+0000 7f0be9f00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be41029e0 0x7f0be4199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.091+0000 7f0be9f00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be4103c20 0x7f0be41998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.091+0000 7f0be9f00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be4108920 0x7f0be41a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.091+0000 7f0be9f00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0be410e3b0 con 0x7f0be41029e0 2024-04-25T13:43:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.091+0000 7f0be9f00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f0be410e230 con 0x7f0be4108920 2024-04-25T13:43:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.091+0000 7f0be9f00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0be410e530 con 0x7f0be4103c20 2024-04-25T13:43:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.091+0000 7f0be37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be41029e0 0x7f0be4199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.091+0000 7f0be37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be41029e0 0x7f0be4199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51960/0 (socket says 172.21.15.43:51960) 2024-04-25T13:43:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.091+0000 7f0be37fe640 1 -- 172.21.15.43:0/2097201518 learned_addr learned my addr 172.21.15.43:0/2097201518 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:58.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.091+0000 7f0be2ffd640 1 --2- 172.21.15.43:0/2097201518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be4103c20 0x7f0be41998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:58.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.091+0000 7f0be3fff640 1 --2- 172.21.15.43:0/2097201518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be4108920 0x7f0be41a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:58.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.092+0000 7f0be37fe640 1 -- 172.21.15.43:0/2097201518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be4103c20 msgr2=0x7f0be41998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:58.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.092+0000 7f0be37fe640 1 --2- 172.21.15.43:0/2097201518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be4103c20 0x7f0be41998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.092+0000 7f0be37fe640 1 -- 172.21.15.43:0/2097201518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be4108920 msgr2=0x7f0be41a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:58.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.092+0000 7f0be37fe640 1 --2- 172.21.15.43:0/2097201518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be4108920 0x7f0be41a0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.092+0000 7f0be37fe640 1 -- 172.21.15.43:0/2097201518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be41a0ea0 con 0x7f0be41029e0 2024-04-25T13:43:58.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.092+0000 7f0be2ffd640 1 --2- 172.21.15.43:0/2097201518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be4103c20 0x7f0be41998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:58.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.092+0000 7f0be3fff640 1 --2- 172.21.15.43:0/2097201518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be4108920 0x7f0be41a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:58.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.092+0000 7f0be37fe640 1 --2- 172.21.15.43:0/2097201518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be41029e0 0x7f0be4199360 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400eb00 tx=0x7f0bd4009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:58.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.092+0000 7f0be0ff9640 1 -- 172.21.15.43:0/2097201518 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd401c070 con 0x7f0be41029e0 2024-04-25T13:43:58.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.092+0000 7f0be0ff9640 1 -- 172.21.15.43:0/2097201518 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0bd400bba0 con 0x7f0be41029e0 2024-04-25T13:43:58.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.092+0000 7f0be9f00640 1 -- 172.21.15.43:0/2097201518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be4069ef0 con 0x7f0be41029e0 2024-04-25T13:43:58.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.092+0000 7f0be0ff9640 1 -- 172.21.15.43:0/2097201518 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4003cc0 con 0x7f0be41029e0 2024-04-25T13:43:58.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.092+0000 7f0be9f00640 1 -- 172.21.15.43:0/2097201518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be406a3f0 con 0x7f0be41029e0 2024-04-25T13:43:58.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.093+0000 7f0be9f00640 1 -- 172.21.15.43:0/2097201518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0be406c3c0 con 0x7f0be41029e0 2024-04-25T13:43:58.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.094+0000 7f0be0ff9640 1 -- 172.21.15.43:0/2097201518 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7f0bd401f070 con 0x7f0be41029e0 2024-04-25T13:43:58.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.095+0000 7f0be0ff9640 1 --2- 172.21.15.43:0/2097201518 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0bcc0afb80 0x7f0bcc0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:58.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.095+0000 7f0be2ffd640 1 --2- 172.21.15.43:0/2097201518 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0bcc0afb80 0x7f0bcc0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:58.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.095+0000 7f0be0ff9640 1 -- 172.21.15.43:0/2097201518 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f0bd40e10b0 con 0x7f0be41029e0 2024-04-25T13:43:58.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.096+0000 7f0be2ffd640 1 --2- 172.21.15.43:0/2097201518 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0bcc0afb80 0x7f0bcc0b2090 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8005f70 tx=0x7f0bd8005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:58.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.099+0000 7f0be0ff9640 1 -- 172.21.15.43:0/2097201518 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0bd4026070 con 0x7f0be41029e0 2024-04-25T13:43:58.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.283+0000 7f0be9f00640 1 -- 172.21.15.43:0/2097201518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0be4107410 con 0x7f0be41029e0 2024-04-25T13:43:58.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.283+0000 7f0be0ff9640 1 -- 172.21.15.43:0/2097201518 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7f0bd40a9770 con 0x7f0be41029e0 2024-04-25T13:43:58.283 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:43:58.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.285+0000 7f0be9f00640 1 -- 172.21.15.43:0/2097201518 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0bcc0afb80 msgr2=0x7f0bcc0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:58.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.285+0000 7f0be9f00640 1 --2- 172.21.15.43:0/2097201518 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0bcc0afb80 0x7f0bcc0b2090 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8005f70 tx=0x7f0bd8005720 comp rx=0 tx=0).stop 2024-04-25T13:43:58.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.285+0000 7f0be9f00640 1 -- 172.21.15.43:0/2097201518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be41029e0 msgr2=0x7f0be4199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:58.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.285+0000 7f0be9f00640 1 --2- 172.21.15.43:0/2097201518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be41029e0 0x7f0be4199360 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400eb00 tx=0x7f0bd4009ea0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.285+0000 7f0be9f00640 1 -- 172.21.15.43:0/2097201518 shutdown_connections 2024-04-25T13:43:58.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.285+0000 7f0be9f00640 1 --2- 172.21.15.43:0/2097201518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0be4108920 0x7f0be41a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.285+0000 7f0be9f00640 1 --2- 172.21.15.43:0/2097201518 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0bcc0afb80 0x7f0bcc0b2090 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.285+0000 7f0be9f00640 1 --2- 172.21.15.43:0/2097201518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0be4103c20 0x7f0be41998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.285+0000 7f0be9f00640 1 --2- 172.21.15.43:0/2097201518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be41029e0 0x7f0be4199360 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.285+0000 7f0be9f00640 1 -- 172.21.15.43:0/2097201518 >> 172.21.15.43:0/2097201518 conn(0x7f0be40fdbd0 msgr2=0x7f0be4104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:58.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.285+0000 7f0be9f00640 1 -- 172.21.15.43:0/2097201518 shutdown_connections 2024-04-25T13:43:58.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.285+0000 7f0be9f00640 1 -- 172.21.15.43:0/2097201518 wait complete. 2024-04-25T13:43:58.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:58 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3194056855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:43:58.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:58 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2607840277' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:43:58.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:58 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1854654298' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:43:58.297 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:43:58.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:58 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3194056855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:43:58.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:58 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2607840277' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:43:58.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:58 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1854654298' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:43:58.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.411+0000 7fbd135d5640 1 -- 172.21.15.43:0/332199758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd0c102170 msgr2=0x7fbd0c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:58.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.411+0000 7fbd135d5640 1 --2- 172.21.15.43:0/332199758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd0c102170 0x7fbd0c102e70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009900 tx=0x7fbd0802a410 comp rx=0 tx=0).stop 2024-04-25T13:43:58.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.411+0000 7fbd135d5640 1 -- 172.21.15.43:0/332199758 shutdown_connections 2024-04-25T13:43:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.411+0000 7fbd135d5640 1 --2- 172.21.15.43:0/332199758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd0c1080b0 0x7fbd0c10a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.411+0000 7fbd135d5640 1 --2- 172.21.15.43:0/332199758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd0c1033b0 0x7fbd0c1037c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.411+0000 7fbd135d5640 1 --2- 172.21.15.43:0/332199758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd0c102170 0x7fbd0c102e70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.411+0000 7fbd135d5640 1 -- 172.21.15.43:0/332199758 >> 172.21.15.43:0/332199758 conn(0x7fbd0c0fd380 msgr2=0x7fbd0c0ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.411+0000 7fbd135d5640 1 -- 172.21.15.43:0/332199758 shutdown_connections 2024-04-25T13:43:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.411+0000 7fbd135d5640 1 -- 172.21.15.43:0/332199758 wait complete. 2024-04-25T13:43:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.412+0000 7fbd135d5640 1 Processor -- start 2024-04-25T13:43:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.412+0000 7fbd135d5640 1 -- start start 2024-04-25T13:43:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.412+0000 7fbd135d5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd0c102170 0x7fbd0c19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.412+0000 7fbd135d5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd0c1033b0 0x7fbd0c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.412+0000 7fbd135d5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd0c1080b0 0x7fbd0c1a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.412+0000 7fbd135d5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c10d2b0 con 0x7fbd0c1033b0 2024-04-25T13:43:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.412+0000 7fbd135d5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c10d130 con 0x7fbd0c102170 2024-04-25T13:43:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.412+0000 7fbd135d5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c10d430 con 0x7fbd0c1080b0 2024-04-25T13:43:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.412+0000 7fbd10b70640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd0c1033b0 0x7fbd0c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.412+0000 7fbd10b70640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd0c1033b0 0x7fbd0c19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51988/0 (socket says 172.21.15.43:51988) 2024-04-25T13:43:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.412+0000 7fbd10b70640 1 -- 172.21.15.43:0/2907333981 learned_addr learned my addr 172.21.15.43:0/2907333981 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.413+0000 7fbd11371640 1 --2- 172.21.15.43:0/2907333981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd0c102170 0x7fbd0c19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.413+0000 7fbd10b70640 1 -- 172.21.15.43:0/2907333981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd0c1080b0 msgr2=0x7fbd0c1a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.413+0000 7fbd10b70640 1 --2- 172.21.15.43:0/2907333981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd0c1080b0 0x7fbd0c1a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.413+0000 7fbd10b70640 1 -- 172.21.15.43:0/2907333981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd0c102170 msgr2=0x7fbd0c19a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.413+0000 7fbd10b70640 1 --2- 172.21.15.43:0/2907333981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd0c102170 0x7fbd0c19a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.413+0000 7fbd10b70640 1 -- 172.21.15.43:0/2907333981 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0c1a1cb0 con 0x7fbd0c1033b0 2024-04-25T13:43:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.413+0000 7fbd10b70640 1 --2- 172.21.15.43:0/2907333981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd0c1033b0 0x7fbd0c19a6b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00d950 tx=0x7fbcfc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.413+0000 7fbd027fc640 1 -- 172.21.15.43:0/2907333981 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc017070 con 0x7fbd0c1033b0 2024-04-25T13:43:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.413+0000 7fbd135d5640 1 -- 172.21.15.43:0/2907333981 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd0c1a1fa0 con 0x7fbd0c1033b0 2024-04-25T13:43:58.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.413+0000 7fbd027fc640 1 -- 172.21.15.43:0/2907333981 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbcfc009c30 con 0x7fbd0c1033b0 2024-04-25T13:43:58.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.413+0000 7fbd027fc640 1 -- 172.21.15.43:0/2907333981 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc00f620 con 0x7fbd0c1033b0 2024-04-25T13:43:58.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.413+0000 7fbd135d5640 1 -- 172.21.15.43:0/2907333981 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd0c1a2400 con 0x7fbd0c1033b0 2024-04-25T13:43:58.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.414+0000 7fbd135d5640 1 -- 172.21.15.43:0/2907333981 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd0c1a2660 con 0x7fbd0c1033b0 2024-04-25T13:43:58.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.416+0000 7fbd027fc640 1 -- 172.21.15.43:0/2907333981 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7fbcfc005030 con 0x7fbd0c1033b0 2024-04-25T13:43:58.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.416+0000 7fbd027fc640 1 --2- 172.21.15.43:0/2907333981 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbcf80afb80 0x7fbcf80b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:58.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.416+0000 7fbd11371640 1 --2- 172.21.15.43:0/2907333981 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbcf80afb80 0x7fbcf80b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:58.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.416+0000 7fbd027fc640 1 -- 172.21.15.43:0/2907333981 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fbcfc0ded10 con 0x7fbd0c1033b0 2024-04-25T13:43:58.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.417+0000 7fbd11371640 1 --2- 172.21.15.43:0/2907333981 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbcf80afb80 0x7fbcf80b2090 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbd08005760 tx=0x7fbd08000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:58.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.420+0000 7fbd027fc640 1 -- 172.21.15.43:0/2907333981 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbcfc0a7430 con 0x7fbd0c1033b0 2024-04-25T13:43:58.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:58 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3194056855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:43:58.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:58 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2607840277' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:43:58.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:58 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1854654298' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:43:58.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.607+0000 7fbd135d5640 1 -- 172.21.15.43:0/2907333981 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbd0c1a2830 con 0x7fbd0c1033b0 2024-04-25T13:43:58.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.607+0000 7fbd027fc640 1 -- 172.21.15.43:0/2907333981 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7fbcfc009de0 con 0x7fbd0c1033b0 2024-04-25T13:43:58.607 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-25T13:43:58.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.609+0000 7fbd135d5640 1 -- 172.21.15.43:0/2907333981 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbcf80afb80 msgr2=0x7fbcf80b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:58.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.609+0000 7fbd135d5640 1 --2- 172.21.15.43:0/2907333981 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbcf80afb80 0x7fbcf80b2090 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbd08005760 tx=0x7fbd08000bc0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.609+0000 7fbd135d5640 1 -- 172.21.15.43:0/2907333981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd0c1033b0 msgr2=0x7fbd0c19a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:58.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.609+0000 7fbd135d5640 1 --2- 172.21.15.43:0/2907333981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd0c1033b0 0x7fbd0c19a6b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00d950 tx=0x7fbcfc00de10 comp rx=0 tx=0).stop 2024-04-25T13:43:58.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.609+0000 7fbd135d5640 1 -- 172.21.15.43:0/2907333981 shutdown_connections 2024-04-25T13:43:58.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.609+0000 7fbd135d5640 1 --2- 172.21.15.43:0/2907333981 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbcf80afb80 0x7fbcf80b2090 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.609+0000 7fbd135d5640 1 --2- 172.21.15.43:0/2907333981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd0c1080b0 0x7fbd0c1a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.609+0000 7fbd135d5640 1 --2- 172.21.15.43:0/2907333981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd0c1033b0 0x7fbd0c19a6b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.609+0000 7fbd135d5640 1 --2- 172.21.15.43:0/2907333981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd0c102170 0x7fbd0c19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.609+0000 7fbd135d5640 1 -- 172.21.15.43:0/2907333981 >> 172.21.15.43:0/2907333981 conn(0x7fbd0c0fd380 msgr2=0x7fbd0c1060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:58.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.609+0000 7fbd135d5640 1 -- 172.21.15.43:0/2907333981 shutdown_connections 2024-04-25T13:43:58.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.609+0000 7fbd135d5640 1 -- 172.21.15.43:0/2907333981 wait complete. 2024-04-25T13:43:58.621 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:43:58.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.736+0000 7faa8feaa640 1 -- 172.21.15.43:0/3925964362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa88109790 msgr2=0x7faa8810bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:58.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.736+0000 7faa8feaa640 1 --2- 172.21.15.43:0/3925964362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa88109790 0x7faa8810bca0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faa80009ca0 tx=0x7faa8002a8c0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.736+0000 7faa8feaa640 1 -- 172.21.15.43:0/3925964362 shutdown_connections 2024-04-25T13:43:58.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.736+0000 7faa8feaa640 1 --2- 172.21.15.43:0/3925964362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa88109790 0x7faa8810bca0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.736+0000 7faa8feaa640 1 --2- 172.21.15.43:0/3925964362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa88106c20 0x7faa88109100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.736+0000 7faa8feaa640 1 --2- 172.21.15.43:0/3925964362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa88101e90 0x7faa881022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.736+0000 7faa8feaa640 1 -- 172.21.15.43:0/3925964362 >> 172.21.15.43:0/3925964362 conn(0x7faa880fd380 msgr2=0x7faa880ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:58.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.736+0000 7faa8feaa640 1 -- 172.21.15.43:0/3925964362 shutdown_connections 2024-04-25T13:43:58.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.736+0000 7faa8feaa640 1 -- 172.21.15.43:0/3925964362 wait complete. 2024-04-25T13:43:58.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8feaa640 1 Processor -- start 2024-04-25T13:43:58.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8feaa640 1 -- start start 2024-04-25T13:43:58.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8feaa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa88101e90 0x7faa88104360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:58.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8feaa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa88106c20 0x7faa88102a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:58.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8feaa640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa88109790 0x7faa88102f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:58.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8feaa640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faa8810f520 con 0x7faa88109790 2024-04-25T13:43:58.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8feaa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7faa8810f3a0 con 0x7faa88106c20 2024-04-25T13:43:58.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8feaa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa8810f6a0 con 0x7faa88101e90 2024-04-25T13:43:58.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8e447640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa88109790 0x7faa88102f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:58.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8e447640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa88109790 0x7faa88102f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52016/0 (socket says 172.21.15.43:52016) 2024-04-25T13:43:58.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8e447640 1 -- 172.21.15.43:0/708370910 learned_addr learned my addr 172.21.15.43:0/708370910 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:58.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8dc46640 1 --2- 172.21.15.43:0/708370910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa88101e90 0x7faa88104360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:58.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8d445640 1 --2- 172.21.15.43:0/708370910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa88106c20 0x7faa88102a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:58.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8e447640 1 -- 172.21.15.43:0/708370910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa88101e90 msgr2=0x7faa88104360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:58.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8e447640 1 --2- 172.21.15.43:0/708370910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa88101e90 0x7faa88104360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8e447640 1 -- 172.21.15.43:0/708370910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa88106c20 msgr2=0x7faa88102a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:58.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8e447640 1 --2- 172.21.15.43:0/708370910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa88106c20 0x7faa88102a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8e447640 1 -- 172.21.15.43:0/708370910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa88103670 con 0x7faa88109790 2024-04-25T13:43:58.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8dc46640 1 --2- 172.21.15.43:0/708370910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa88101e90 0x7faa88104360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:58.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.737+0000 7faa8d445640 1 --2- 172.21.15.43:0/708370910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa88106c20 0x7faa88102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:58.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.738+0000 7faa8e447640 1 --2- 172.21.15.43:0/708370910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa88109790 0x7faa88102f40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7faa80031040 tx=0x7faa80003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:58.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.738+0000 7faa7effd640 1 -- 172.21.15.43:0/708370910 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa80003d60 con 0x7faa88109790 2024-04-25T13:43:58.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.738+0000 7faa7effd640 1 -- 172.21.15.43:0/708370910 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa800044d0 con 0x7faa88109790 2024-04-25T13:43:58.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.738+0000 7faa8feaa640 1 -- 172.21.15.43:0/708370910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa881a4180 con 0x7faa88109790 2024-04-25T13:43:58.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.738+0000 7faa7effd640 1 -- 172.21.15.43:0/708370910 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa80030c50 con 0x7faa88109790 2024-04-25T13:43:58.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.738+0000 7faa8feaa640 1 -- 172.21.15.43:0/708370910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa881a45e0 con 0x7faa88109790 2024-04-25T13:43:58.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.739+0000 7faa8feaa640 1 -- 172.21.15.43:0/708370910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa8810fce0 con 0x7faa88109790 2024-04-25T13:43:58.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.740+0000 7faa7effd640 1 -- 172.21.15.43:0/708370910 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 147571+0+0 (secure 0 0 0) 0x7faa80004040 con 0x7faa88109790 2024-04-25T13:43:58.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.741+0000 7faa7effd640 1 --2- 172.21.15.43:0/708370910 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7faa740afb80 0x7faa740b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:58.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.741+0000 7faa7effd640 1 -- 172.21.15.43:0/708370910 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7faa80100710 con 0x7faa88109790 2024-04-25T13:43:58.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.741+0000 7faa8dc46640 1 --2- 172.21.15.43:0/708370910 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7faa740afb80 0x7faa740b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:58.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.742+0000 7faa8dc46640 1 --2- 172.21.15.43:0/708370910 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7faa740afb80 0x7faa740b2090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faa8806b5a0 tx=0x7faa84005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:58.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.745+0000 7faa7effd640 1 -- 172.21.15.43:0/708370910 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7faa800c8f40 con 0x7faa88109790 2024-04-25T13:43:58.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.931+0000 7faa8feaa640 1 -- 172.21.15.43:0/708370910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7faa880feea0 con 0x7faa88109790 2024-04-25T13:43:58.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.932+0000 7faa7effd640 1 -- 172.21.15.43:0/708370910 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v82) ==== 103+0+11 (secure 0 0 0) 0x7faa800c8840 con 0x7faa88109790 2024-04-25T13:43:58.932 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:43:58.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.934+0000 7faa8feaa640 1 -- 172.21.15.43:0/708370910 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7faa740afb80 msgr2=0x7faa740b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:58.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.934+0000 7faa8feaa640 1 --2- 172.21.15.43:0/708370910 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7faa740afb80 0x7faa740b2090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faa8806b5a0 tx=0x7faa84005f90 comp rx=0 tx=0).stop 2024-04-25T13:43:58.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.934+0000 7faa8feaa640 1 -- 172.21.15.43:0/708370910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa88109790 msgr2=0x7faa88102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:58.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.934+0000 7faa8feaa640 1 --2- 172.21.15.43:0/708370910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa88109790 0x7faa88102f40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7faa80031040 tx=0x7faa80003970 comp rx=0 tx=0).stop 2024-04-25T13:43:58.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.934+0000 7faa8feaa640 1 -- 172.21.15.43:0/708370910 shutdown_connections 2024-04-25T13:43:58.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.934+0000 7faa8feaa640 1 --2- 172.21.15.43:0/708370910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa88109790 0x7faa88102f40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.934+0000 7faa8feaa640 1 --2- 172.21.15.43:0/708370910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa88106c20 0x7faa88102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.934+0000 7faa8feaa640 1 --2- 172.21.15.43:0/708370910 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7faa740afb80 0x7faa740b2090 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.934+0000 7faa8feaa640 1 --2- 172.21.15.43:0/708370910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa88101e90 0x7faa88104360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:58.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.934+0000 7faa8feaa640 1 -- 172.21.15.43:0/708370910 >> 172.21.15.43:0/708370910 conn(0x7faa880fd380 msgr2=0x7faa88107bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:58.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.934+0000 7faa8feaa640 1 -- 172.21.15.43:0/708370910 shutdown_connections 2024-04-25T13:43:58.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:58.934+0000 7faa8feaa640 1 -- 172.21.15.43:0/708370910 wait complete. 2024-04-25T13:43:58.945 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:59.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.066+0000 7fc51d8d1640 1 -- 172.21.15.43:0/588271013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc518103ad0 msgr2=0x7fc5181047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:59.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.066+0000 7fc51d8d1640 1 --2- 172.21.15.43:0/588271013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc518103ad0 0x7fc5181047d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc508009900 tx=0x7fc50802a410 comp rx=0 tx=0).stop 2024-04-25T13:43:59.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.066+0000 7fc51d8d1640 1 -- 172.21.15.43:0/588271013 shutdown_connections 2024-04-25T13:43:59.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.066+0000 7fc51d8d1640 1 --2- 172.21.15.43:0/588271013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc518109a10 0x7fc51810be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.066+0000 7fc51d8d1640 1 --2- 172.21.15.43:0/588271013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc518104d10 0x7fc518105120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.066+0000 7fc51d8d1640 1 --2- 172.21.15.43:0/588271013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc518103ad0 0x7fc5181047d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.066+0000 7fc51d8d1640 1 -- 172.21.15.43:0/588271013 >> 172.21.15.43:0/588271013 conn(0x7fc5180fecc0 msgr2=0x7fc518101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.066+0000 7fc51d8d1640 1 -- 172.21.15.43:0/588271013 shutdown_connections 2024-04-25T13:43:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.066+0000 7fc51d8d1640 1 -- 172.21.15.43:0/588271013 wait complete. 2024-04-25T13:43:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.066+0000 7fc51d8d1640 1 Processor -- start 2024-04-25T13:43:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc51d8d1640 1 -- start start 2024-04-25T13:43:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc51d8d1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc518103ad0 0x7fc51819a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc51d8d1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc518104d10 0x7fc51819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc51d8d1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc518109a10 0x7fc5181a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc51d8d1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc51810f480 con 0x7fc518104d10 2024-04-25T13:43:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc51d8d1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fc51810f300 con 0x7fc518103ad0 2024-04-25T13:43:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc51d8d1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc51810f600 con 0x7fc518109a10 2024-04-25T13:43:59.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc5167fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc518104d10 0x7fc51819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:59.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc5167fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc518104d10 0x7fc51819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52038/0 (socket says 172.21.15.43:52038) 2024-04-25T13:43:59.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc5167fc640 1 -- 172.21.15.43:0/1154996110 learned_addr learned my addr 172.21.15.43:0/1154996110 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:59.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc5177fe640 1 --2- 172.21.15.43:0/1154996110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc518109a10 0x7fc5181a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:59.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc516ffd640 1 --2- 172.21.15.43:0/1154996110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc518103ad0 0x7fc51819a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:59.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc5167fc640 1 -- 172.21.15.43:0/1154996110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc518109a10 msgr2=0x7fc5181a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:59.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc5167fc640 1 --2- 172.21.15.43:0/1154996110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc518109a10 0x7fc5181a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc5167fc640 1 -- 172.21.15.43:0/1154996110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc518103ad0 msgr2=0x7fc51819a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:59.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc5167fc640 1 --2- 172.21.15.43:0/1154996110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc518103ad0 0x7fc51819a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.067+0000 7fc5167fc640 1 -- 172.21.15.43:0/1154996110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5181a1c50 con 0x7fc518104d10 2024-04-25T13:43:59.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.068+0000 7fc5167fc640 1 --2- 172.21.15.43:0/1154996110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc518104d10 0x7fc51819a650 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00e9f0 tx=0x7fc50c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:59.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.068+0000 7fc51c8cf640 1 -- 172.21.15.43:0/1154996110 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c00cd80 con 0x7fc518104d10 2024-04-25T13:43:59.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.068+0000 7fc51d8d1640 1 -- 172.21.15.43:0/1154996110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5181a1f40 con 0x7fc518104d10 2024-04-25T13:43:59.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.068+0000 7fc51c8cf640 1 -- 172.21.15.43:0/1154996110 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc50c0108c0 con 0x7fc518104d10 2024-04-25T13:43:59.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.068+0000 7fc51c8cf640 1 -- 172.21.15.43:0/1154996110 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c0187c0 con 0x7fc518104d10 2024-04-25T13:43:59.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.068+0000 7fc51d8d1640 1 -- 172.21.15.43:0/1154996110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5181a2400 con 0x7fc518104d10 2024-04-25T13:43:59.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.069+0000 7fc51d8d1640 1 -- 172.21.15.43:0/1154996110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc518069310 con 0x7fc518104d10 2024-04-25T13:43:59.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.070+0000 7fc51c8cf640 1 -- 172.21.15.43:0/1154996110 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fc50c010430 con 0x7fc518104d10 2024-04-25T13:43:59.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.071+0000 7fc51c8cf640 1 --2- 172.21.15.43:0/1154996110 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc5000afaf0 0x7fc5000b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:59.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.071+0000 7fc51c8cf640 1 -- 172.21.15.43:0/1154996110 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9121+0+0 (secure 0 0 0) 0x7fc50c0df330 con 0x7fc518104d10 2024-04-25T13:43:59.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.071+0000 7fc516ffd640 1 --2- 172.21.15.43:0/1154996110 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc5000afaf0 0x7fc5000b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:59.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.072+0000 7fc516ffd640 1 --2- 172.21.15.43:0/1154996110 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc5000afaf0 0x7fc5000b2000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc5080057c0 tx=0x7fc508005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:59.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.076+0000 7fc51c8cf640 1 -- 172.21.15.43:0/1154996110 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc50c0a7c30 con 0x7fc518104d10 2024-04-25T13:43:59.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:59 smithi043 ceph-mon[29195]: pgmap v342: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T13:43:59.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:59 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-04-25T13:43:59.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:59 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2097201518' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:43:59.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:59 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2907333981' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:43:59.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:43:59 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/708370910' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:43:59.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.305+0000 7fc51d8d1640 1 -- 172.21.15.43:0/1154996110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc518108820 con 0x7fc518104d10 2024-04-25T13:43:59.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.306+0000 7fc51c8cf640 1 -- 172.21.15.43:0/1154996110 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11876 (secure 0 0 0) 0x7fc50c0a7530 con 0x7fc518104d10 2024-04-25T13:43:59.306 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:43:59.306 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2642701222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2642701222},{"type":"v1","addr":"172.21.15.43:6839","nonce":2642701222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6841/3777483996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":3777483996},{"type":"v1","addr":"172.21.15.43:6841","nonce":3777483996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T13:42:08.401075+0000","modified":"2024-04-25T13:42:36.143414+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24542,"mds_1":24509,"mds_2":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6839/3323587585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3323587585},{"type":"v1","addr":"172.21.15.175:6839","nonce":3323587585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.161:6837/1464384320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1464384320},{"type":"v1","addr":"172.21.15.161:6837","nonce":1464384320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6839/1243414461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":1243414461},{"type":"v1","addr":"172.21.15.161:6839","nonce":1243414461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24542,"qdb_cluster":[24542,24502,24509]},"id":1}]} 2024-04-25T13:43:59.306 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 24 2024-04-25T13:43:59.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.308+0000 7fc51d8d1640 1 -- 172.21.15.43:0/1154996110 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc5000afaf0 msgr2=0x7fc5000b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:59.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.308+0000 7fc51d8d1640 1 --2- 172.21.15.43:0/1154996110 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc5000afaf0 0x7fc5000b2000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc5080057c0 tx=0x7fc508005720 comp rx=0 tx=0).stop 2024-04-25T13:43:59.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.308+0000 7fc51d8d1640 1 -- 172.21.15.43:0/1154996110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc518104d10 msgr2=0x7fc51819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:59.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.308+0000 7fc51d8d1640 1 --2- 172.21.15.43:0/1154996110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc518104d10 0x7fc51819a650 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00e9f0 tx=0x7fc50c00eeb0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.308+0000 7fc51d8d1640 1 -- 172.21.15.43:0/1154996110 shutdown_connections 2024-04-25T13:43:59.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.308+0000 7fc51d8d1640 1 --2- 172.21.15.43:0/1154996110 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fc5000afaf0 0x7fc5000b2000 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.308+0000 7fc51d8d1640 1 --2- 172.21.15.43:0/1154996110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc518109a10 0x7fc5181a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.308+0000 7fc51d8d1640 1 --2- 172.21.15.43:0/1154996110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc518104d10 0x7fc51819a650 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.308+0000 7fc51d8d1640 1 --2- 172.21.15.43:0/1154996110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc518103ad0 0x7fc51819a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.308+0000 7fc51d8d1640 1 -- 172.21.15.43:0/1154996110 >> 172.21.15.43:0/1154996110 conn(0x7fc5180fecc0 msgr2=0x7fc5181059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:59.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.308+0000 7fc51d8d1640 1 -- 172.21.15.43:0/1154996110 shutdown_connections 2024-04-25T13:43:59.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.308+0000 7fc51d8d1640 1 -- 172.21.15.43:0/1154996110 wait complete. 2024-04-25T13:43:59.320 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:43:59.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:59 smithi161 ceph-mon[32696]: pgmap v342: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T13:43:59.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:59 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-04-25T13:43:59.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:59 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2097201518' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:43:59.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:59 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2907333981' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:43:59.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:43:59 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/708370910' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:43:59.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:59 smithi175 ceph-mon[32649]: pgmap v342: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T13:43:59.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:59 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-04-25T13:43:59.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:59 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2097201518' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:43:59.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:59 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2907333981' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:43:59.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:43:59 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/708370910' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:43:59.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.432+0000 7f28fa727640 1 -- 172.21.15.43:0/196997576 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f4109a50 msgr2=0x7f28f410be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:59.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.432+0000 7f28fa727640 1 --2- 172.21.15.43:0/196997576 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f4109a50 0x7f28f410be70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f28ec009ca0 tx=0x7f28ec02a8c0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.432+0000 7f28fa727640 1 -- 172.21.15.43:0/196997576 shutdown_connections 2024-04-25T13:43:59.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.432+0000 7f28fa727640 1 --2- 172.21.15.43:0/196997576 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f4109a50 0x7f28f410be70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.432+0000 7f28fa727640 1 --2- 172.21.15.43:0/196997576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28f4104d50 0x7f28f4105160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.432+0000 7f28fa727640 1 --2- 172.21.15.43:0/196997576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28f4103b10 0x7f28f4104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.432+0000 7f28fa727640 1 -- 172.21.15.43:0/196997576 >> 172.21.15.43:0/196997576 conn(0x7f28f40fed40 msgr2=0x7f28f41011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:59.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.432+0000 7f28fa727640 1 -- 172.21.15.43:0/196997576 shutdown_connections 2024-04-25T13:43:59.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.432+0000 7f28fa727640 1 -- 172.21.15.43:0/196997576 wait complete. 2024-04-25T13:43:59.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.433+0000 7f28fa727640 1 Processor -- start 2024-04-25T13:43:59.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.433+0000 7f28fa727640 1 -- start start 2024-04-25T13:43:59.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.433+0000 7f28fa727640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28f4103b10 0x7f28f4077960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.433+0000 7f28fa727640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f4104d50 0x7f28f4076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.433+0000 7f28fa727640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28f4109a50 0x7f28f4076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.433+0000 7f28fa727640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f28f410f5b0 con 0x7f28f4104d50 2024-04-25T13:43:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.433+0000 7f28fa727640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f28f410f430 con 0x7f28f4103b10 2024-04-25T13:43:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.433+0000 7f28fa727640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f28f410f730 con 0x7f28f4109a50 2024-04-25T13:43:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28f37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f4104d50 0x7f28f4076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28f3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28f4103b10 0x7f28f4077960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28f3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28f4103b10 0x7f28f4077960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.43:35126/0 (socket says 172.21.15.43:35126) 2024-04-25T13:43:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28f37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f4104d50 0x7f28f4076000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52056/0 (socket says 172.21.15.43:52056) 2024-04-25T13:43:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28f3fff640 1 -- 172.21.15.43:0/2950449054 learned_addr learned my addr 172.21.15.43:0/2950449054 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28f8cc4640 1 --2- 172.21.15.43:0/2950449054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28f4109a50 0x7f28f4076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28f37fe640 1 -- 172.21.15.43:0/2950449054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28f4109a50 msgr2=0x7f28f4076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28f37fe640 1 --2- 172.21.15.43:0/2950449054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28f4109a50 0x7f28f4076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28f37fe640 1 -- 172.21.15.43:0/2950449054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28f4103b10 msgr2=0x7f28f4077960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28f37fe640 1 --2- 172.21.15.43:0/2950449054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28f4103b10 0x7f28f4077960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28f37fe640 1 -- 172.21.15.43:0/2950449054 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f4076c70 con 0x7f28f4104d50 2024-04-25T13:43:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28f8cc4640 1 --2- 172.21.15.43:0/2950449054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28f4109a50 0x7f28f4076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28f37fe640 1 --2- 172.21.15.43:0/2950449054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f4104d50 0x7f28f4076000 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f28e800b3f0 tx=0x7f28e800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28f17fa640 1 -- 172.21.15.43:0/2950449054 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8015020 con 0x7f28f4104d50 2024-04-25T13:43:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28f17fa640 1 -- 172.21.15.43:0/2950449054 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28e8011cc0 con 0x7f28f4104d50 2024-04-25T13:43:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28fa727640 1 -- 172.21.15.43:0/2950449054 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f41a4270 con 0x7f28f4104d50 2024-04-25T13:43:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28f17fa640 1 -- 172.21.15.43:0/2950449054 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8010cc0 con 0x7f28f4104d50 2024-04-25T13:43:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.434+0000 7f28fa727640 1 -- 172.21.15.43:0/2950449054 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f41a4730 con 0x7f28f4104d50 2024-04-25T13:43:59.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.436+0000 7f28fa727640 1 -- 172.21.15.43:0/2950449054 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f4108860 con 0x7f28f4104d50 2024-04-25T13:43:59.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.437+0000 7f28f17fa640 1 -- 172.21.15.43:0/2950449054 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f28e8018020 con 0x7f28f4104d50 2024-04-25T13:43:59.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.438+0000 7f28f17fa640 1 --2- 172.21.15.43:0/2950449054 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f28dc0afaf0 0x7f28dc0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:59.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.438+0000 7f28f3fff640 1 --2- 172.21.15.43:0/2950449054 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f28dc0afaf0 0x7f28dc0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:59.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.438+0000 7f28f17fa640 1 -- 172.21.15.43:0/2950449054 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9121+0+0 (secure 0 0 0) 0x7f28e80dedb0 con 0x7f28f4104d50 2024-04-25T13:43:59.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.438+0000 7f28f3fff640 1 --2- 172.21.15.43:0/2950449054 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f28dc0afaf0 0x7f28dc0b2000 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009c30 tx=0x7f28e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:59.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.441+0000 7f28f17fa640 1 -- 172.21.15.43:0/2950449054 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f28e801f020 con 0x7f28f4104d50 2024-04-25T13:43:59.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.628+0000 7f28fa727640 1 -- 172.21.15.43:0/2950449054 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28f40637a0 con 0x7f28f4104d50 2024-04-25T13:43:59.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.630+0000 7f28f17fa640 1 -- 172.21.15.43:0/2950449054 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24693 (secure 0 0 0) 0x7f28e80a7610 con 0x7f28f4104d50 2024-04-25T13:43:59.630 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:43:59.630 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":83,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:43:59.042188+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:43:59.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.632+0000 7f28fa727640 1 -- 172.21.15.43:0/2950449054 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f28dc0afaf0 msgr2=0x7f28dc0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:59.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.632+0000 7f28fa727640 1 --2- 172.21.15.43:0/2950449054 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f28dc0afaf0 0x7f28dc0b2000 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009c30 tx=0x7f28e4005f90 comp rx=0 tx=0).stop 2024-04-25T13:43:59.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.632+0000 7f28fa727640 1 -- 172.21.15.43:0/2950449054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f4104d50 msgr2=0x7f28f4076000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:59.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.632+0000 7f28fa727640 1 --2- 172.21.15.43:0/2950449054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f4104d50 0x7f28f4076000 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f28e800b3f0 tx=0x7f28e800b8b0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.632+0000 7f28fa727640 1 -- 172.21.15.43:0/2950449054 shutdown_connections 2024-04-25T13:43:59.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.632+0000 7f28fa727640 1 --2- 172.21.15.43:0/2950449054 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f28dc0afaf0 0x7f28dc0b2000 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.632+0000 7f28fa727640 1 --2- 172.21.15.43:0/2950449054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28f4109a50 0x7f28f4076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.632+0000 7f28fa727640 1 --2- 172.21.15.43:0/2950449054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f4104d50 0x7f28f4076000 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.632+0000 7f28fa727640 1 --2- 172.21.15.43:0/2950449054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28f4103b10 0x7f28f4077960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.632+0000 7f28fa727640 1 -- 172.21.15.43:0/2950449054 >> 172.21.15.43:0/2950449054 conn(0x7f28f40fed40 msgr2=0x7f28f4105a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:59.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.632+0000 7f28fa727640 1 -- 172.21.15.43:0/2950449054 shutdown_connections 2024-04-25T13:43:59.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.632+0000 7f28fa727640 1 -- 172.21.15.43:0/2950449054 wait complete. 2024-04-25T13:43:59.645 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:59.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.756+0000 7f57e87b7640 1 -- 172.21.15.43:0/258401674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57e0109890 msgr2=0x7f57e010bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:59.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.756+0000 7f57e87b7640 1 --2- 172.21.15.43:0/258401674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57e0109890 0x7f57e010bcb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009ca0 tx=0x7f57d802a8c0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.756+0000 7f57e87b7640 1 -- 172.21.15.43:0/258401674 shutdown_connections 2024-04-25T13:43:59.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.756+0000 7f57e87b7640 1 --2- 172.21.15.43:0/258401674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57e0109890 0x7f57e010bcb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.756+0000 7f57e87b7640 1 --2- 172.21.15.43:0/258401674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e0106f30 0x7f57e0109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.756+0000 7f57e87b7640 1 --2- 172.21.15.43:0/258401674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57e01045d0 0x7f57e01069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.756+0000 7f57e87b7640 1 -- 172.21.15.43:0/258401674 >> 172.21.15.43:0/258401674 conn(0x7f57e00fdbd0 msgr2=0x7f57e0100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:59.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.756+0000 7f57e87b7640 1 -- 172.21.15.43:0/258401674 shutdown_connections 2024-04-25T13:43:59.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.756+0000 7f57e87b7640 1 -- 172.21.15.43:0/258401674 wait complete. 2024-04-25T13:43:59.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.757+0000 7f57e87b7640 1 Processor -- start 2024-04-25T13:43:59.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.757+0000 7f57e87b7640 1 -- start start 2024-04-25T13:43:59.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.757+0000 7f57e87b7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57e01045d0 0x7f57e019a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:59.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.757+0000 7f57e87b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e0106f30 0x7f57e019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:59.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.757+0000 7f57e87b7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57e0109890 0x7f57e01a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:59.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.757+0000 7f57e87b7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f57e010f510 con 0x7f57e01045d0 2024-04-25T13:43:59.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.757+0000 7f57e87b7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f57e010f390 con 0x7f57e0109890 2024-04-25T13:43:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.757+0000 7f57e87b7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f57e010f690 con 0x7f57e0106f30 2024-04-25T13:43:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.757+0000 7f57e6553640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57e01045d0 0x7f57e019a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.757+0000 7f57e6553640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57e01045d0 0x7f57e019a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60390/0 (socket says 172.21.15.43:60390) 2024-04-25T13:43:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.757+0000 7f57e6553640 1 -- 172.21.15.43:0/1250807698 learned_addr learned my addr 172.21.15.43:0/1250807698 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:43:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.758+0000 7f57e6d54640 1 --2- 172.21.15.43:0/1250807698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57e0109890 0x7f57e01a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.758+0000 7f57e5d52640 1 --2- 172.21.15.43:0/1250807698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e0106f30 0x7f57e019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.758+0000 7f57e6553640 1 -- 172.21.15.43:0/1250807698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e0106f30 msgr2=0x7f57e019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.758+0000 7f57e6553640 1 --2- 172.21.15.43:0/1250807698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e0106f30 0x7f57e019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.758+0000 7f57e6553640 1 -- 172.21.15.43:0/1250807698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57e0109890 msgr2=0x7f57e01a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.758+0000 7f57e6553640 1 --2- 172.21.15.43:0/1250807698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57e0109890 0x7f57e01a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.758+0000 7f57e6553640 1 -- 172.21.15.43:0/1250807698 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e01a1cc0 con 0x7f57e01045d0 2024-04-25T13:43:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.758+0000 7f57e6553640 1 --2- 172.21.15.43:0/1250807698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57e01045d0 0x7f57e019a180 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f57dc005fd0 tx=0x7f57dc00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.758+0000 7f57d77fe640 1 -- 172.21.15.43:0/1250807698 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc017070 con 0x7f57e01045d0 2024-04-25T13:43:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.758+0000 7f57d77fe640 1 -- 172.21.15.43:0/1250807698 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57dc009c30 con 0x7f57e01045d0 2024-04-25T13:43:59.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.758+0000 7f57e87b7640 1 -- 172.21.15.43:0/1250807698 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e01a1fb0 con 0x7f57e01045d0 2024-04-25T13:43:59.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.758+0000 7f57d77fe640 1 -- 172.21.15.43:0/1250807698 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc003c70 con 0x7f57e01045d0 2024-04-25T13:43:59.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.758+0000 7f57e87b7640 1 -- 172.21.15.43:0/1250807698 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e01a2410 con 0x7f57e01045d0 2024-04-25T13:43:59.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.759+0000 7f57e87b7640 1 -- 172.21.15.43:0/1250807698 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e006a190 con 0x7f57e01045d0 2024-04-25T13:43:59.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.761+0000 7f57d77fe640 1 -- 172.21.15.43:0/1250807698 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f57dc003e10 con 0x7f57e01045d0 2024-04-25T13:43:59.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.761+0000 7f57d77fe640 1 --2- 172.21.15.43:0/1250807698 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f57cc0afaf0 0x7f57cc0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:59.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.762+0000 7f57e5d52640 1 --2- 172.21.15.43:0/1250807698 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f57cc0afaf0 0x7f57cc0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:59.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.762+0000 7f57d77fe640 1 -- 172.21.15.43:0/1250807698 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9121+0+0 (secure 0 0 0) 0x7f57dc0df3a0 con 0x7f57e01045d0 2024-04-25T13:43:59.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.762+0000 7f57e5d52640 1 --2- 172.21.15.43:0/1250807698 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f57cc0afaf0 0x7f57cc0b2000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f57d0005fd0 tx=0x7f57d0005cf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:59.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.765+0000 7f57d77fe640 1 -- 172.21.15.43:0/1250807698 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f57dc020030 con 0x7f57e01045d0 2024-04-25T13:43:59.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.991+0000 7f57e87b7640 1 -- 172.21.15.43:0/1250807698 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57e002dc10 con 0x7f57e01045d0 2024-04-25T13:43:59.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.992+0000 7f57d77fe640 1 -- 172.21.15.43:0/1250807698 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11876 (secure 0 0 0) 0x7f57dc0a7c40 con 0x7f57e01045d0 2024-04-25T13:43:59.992 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:43:59.992 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2642701222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2642701222},{"type":"v1","addr":"172.21.15.43:6839","nonce":2642701222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6841/3777483996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":3777483996},{"type":"v1","addr":"172.21.15.43:6841","nonce":3777483996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T13:42:08.401075+0000","modified":"2024-04-25T13:42:36.143414+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24542,"mds_1":24509,"mds_2":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6839/3323587585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3323587585},{"type":"v1","addr":"172.21.15.175:6839","nonce":3323587585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.161:6837/1464384320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1464384320},{"type":"v1","addr":"172.21.15.161:6837","nonce":1464384320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6839/1243414461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":1243414461},{"type":"v1","addr":"172.21.15.161:6839","nonce":1243414461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24542,"qdb_cluster":[24542,24502,24509]},"id":1}]} 2024-04-25T13:43:59.993 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 24 2024-04-25T13:43:59.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.994+0000 7f57e87b7640 1 -- 172.21.15.43:0/1250807698 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f57cc0afaf0 msgr2=0x7f57cc0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:59.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.994+0000 7f57e87b7640 1 --2- 172.21.15.43:0/1250807698 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f57cc0afaf0 0x7f57cc0b2000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f57d0005fd0 tx=0x7f57d0005cf0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.994+0000 7f57e87b7640 1 -- 172.21.15.43:0/1250807698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57e01045d0 msgr2=0x7f57e019a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:59.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.994+0000 7f57e87b7640 1 --2- 172.21.15.43:0/1250807698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57e01045d0 0x7f57e019a180 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f57dc005fd0 tx=0x7f57dc00dde0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.994+0000 7f57e87b7640 1 -- 172.21.15.43:0/1250807698 shutdown_connections 2024-04-25T13:43:59.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.994+0000 7f57e87b7640 1 --2- 172.21.15.43:0/1250807698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57e0109890 0x7f57e01a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.994+0000 7f57e87b7640 1 --2- 172.21.15.43:0/1250807698 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f57cc0afaf0 0x7f57cc0b2000 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.994+0000 7f57e87b7640 1 --2- 172.21.15.43:0/1250807698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57e0106f30 0x7f57e019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.994+0000 7f57e87b7640 1 --2- 172.21.15.43:0/1250807698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57e01045d0 0x7f57e019a180 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:59.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.995+0000 7f57e87b7640 1 -- 172.21.15.43:0/1250807698 >> 172.21.15.43:0/1250807698 conn(0x7f57e00fdbd0 msgr2=0x7f57e01065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:59.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.995+0000 7f57e87b7640 1 -- 172.21.15.43:0/1250807698 shutdown_connections 2024-04-25T13:43:59.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:43:59.995+0000 7f57e87b7640 1 -- 172.21.15.43:0/1250807698 wait complete. 2024-04-25T13:44:00.006 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-25T13:42:08.401075+0000', 'modified': '2024-04-25T13:42:36.143414+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24542, 'mds_1': 24509, 'mds_2': 24502}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24463': {'gid': 24463, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6835/1225446538', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 1225446538}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 1225446538}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.161:6835/2378707176', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6834', 'nonce': 2378707176}, {'type': 'v1', 'addr': '172.21.15.161:6835', 'nonce': 2378707176}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6837/2732559521', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 2732559521}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 2732559521}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.175:6839/3323587585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 3323587585}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 3323587585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24509': {'gid': 24509, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.161:6837/1464384320', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6836', 'nonce': 1464384320}, {'type': 'v1', 'addr': '172.21.15.161:6837', 'nonce': 1464384320}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24542': {'gid': 24542, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.161:6839/1243414461', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6838', 'nonce': 1243414461}, {'type': 'v1', 'addr': '172.21.15.161:6839', 'nonce': 1243414461}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24542, 'qdb_cluster': [24542, 24502, 24509]} 2024-04-25T13:44:00.006 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-25T13:44:00.007 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-25T13:44:00.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.124+0000 7fe9d3901640 1 -- 172.21.15.43:0/680813568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9cc104d30 msgr2=0x7fe9cc105140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.124+0000 7fe9d3901640 1 --2- 172.21.15.43:0/680813568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9cc104d30 0x7fe9cc105140 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009900 tx=0x7fe9c002a410 comp rx=0 tx=0).stop 2024-04-25T13:44:00.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.124+0000 7fe9d3901640 1 -- 172.21.15.43:0/680813568 shutdown_connections 2024-04-25T13:44:00.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.124+0000 7fe9d3901640 1 --2- 172.21.15.43:0/680813568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9cc109a30 0x7fe9cc10be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.124+0000 7fe9d3901640 1 --2- 172.21.15.43:0/680813568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9cc104d30 0x7fe9cc105140 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.124+0000 7fe9d3901640 1 --2- 172.21.15.43:0/680813568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9cc103af0 0x7fe9cc1047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.124+0000 7fe9d3901640 1 -- 172.21.15.43:0/680813568 >> 172.21.15.43:0/680813568 conn(0x7fe9cc0fece0 msgr2=0x7fe9cc101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.124+0000 7fe9d3901640 1 -- 172.21.15.43:0/680813568 shutdown_connections 2024-04-25T13:44:00.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.124+0000 7fe9d3901640 1 -- 172.21.15.43:0/680813568 wait complete. 2024-04-25T13:44:00.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.125+0000 7fe9d3901640 1 Processor -- start 2024-04-25T13:44:00.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.125+0000 7fe9d3901640 1 -- start start 2024-04-25T13:44:00.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.125+0000 7fe9d3901640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9cc103af0 0x7fe9cc19a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.125+0000 7fe9d3901640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9cc104d30 0x7fe9cc19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.125+0000 7fe9d3901640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9cc109a30 0x7fe9cc1a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.125+0000 7fe9d3901640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc10f520 con 0x7fe9cc103af0 2024-04-25T13:44:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.125+0000 7fe9d3901640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc10f3a0 con 0x7fe9cc109a30 2024-04-25T13:44:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.125+0000 7fe9d3901640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc10f6a0 con 0x7fe9cc104d30 2024-04-25T13:44:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.125+0000 7fe9d169d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9cc103af0 0x7fe9cc19a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.125+0000 7fe9d169d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9cc103af0 0x7fe9cc19a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60408/0 (socket says 172.21.15.43:60408) 2024-04-25T13:44:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.125+0000 7fe9d169d640 1 -- 172.21.15.43:0/2440774507 learned_addr learned my addr 172.21.15.43:0/2440774507 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.125+0000 7fe9d1e9e640 1 --2- 172.21.15.43:0/2440774507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9cc109a30 0x7fe9cc1a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.125+0000 7fe9d0e9c640 1 --2- 172.21.15.43:0/2440774507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9cc104d30 0x7fe9cc19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.126+0000 7fe9d169d640 1 -- 172.21.15.43:0/2440774507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9cc104d30 msgr2=0x7fe9cc19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.126+0000 7fe9d169d640 1 --2- 172.21.15.43:0/2440774507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9cc104d30 0x7fe9cc19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.126+0000 7fe9d169d640 1 -- 172.21.15.43:0/2440774507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9cc109a30 msgr2=0x7fe9cc1a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.126+0000 7fe9d169d640 1 --2- 172.21.15.43:0/2440774507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9cc109a30 0x7fe9cc1a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.126+0000 7fe9d169d640 1 -- 172.21.15.43:0/2440774507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9cc1a1c40 con 0x7fe9cc103af0 2024-04-25T13:44:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.126+0000 7fe9d0e9c640 1 --2- 172.21.15.43:0/2440774507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9cc104d30 0x7fe9cc19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:44:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.126+0000 7fe9d169d640 1 --2- 172.21.15.43:0/2440774507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9cc103af0 0x7fe9cc19a1b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400cce0 tx=0x7fe9c400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.126+0000 7fe9ca7fc640 1 -- 172.21.15.43:0/2440774507 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400f450 con 0x7fe9cc103af0 2024-04-25T13:44:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.126+0000 7fe9ca7fc640 1 -- 172.21.15.43:0/2440774507 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9c400fa80 con 0x7fe9cc103af0 2024-04-25T13:44:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.126+0000 7fe9d3901640 1 -- 172.21.15.43:0/2440774507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9cc1a1f30 con 0x7fe9cc103af0 2024-04-25T13:44:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.126+0000 7fe9ca7fc640 1 -- 172.21.15.43:0/2440774507 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4018ad0 con 0x7fe9cc103af0 2024-04-25T13:44:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.126+0000 7fe9d3901640 1 -- 172.21.15.43:0/2440774507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9cc1a2470 con 0x7fe9cc103af0 2024-04-25T13:44:00.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9da7b0740 1 Processor -- start 2024-04-25T13:44:00.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9da7b0740 1 -- start start 2024-04-25T13:44:00.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9da7b0740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d6811270 0x5621d6bb2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9da7b0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67e83b0 0x5621d6bb28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9da7b0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 0x5621d6bb97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9da7b0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5621d6b17740 con 0x5621d67e83b0 2024-04-25T13:44:00.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9da7b0740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x5621d6ab33a0 con 0x5621d6811270 2024-04-25T13:44:00.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9da7b0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5621d6b13700 con 0x5621d67f0590 2024-04-25T13:44:00.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9ca7fc640 1 -- 172.21.15.43:0/2440774507 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fe9c4018c70 con 0x7fe9cc103af0 2024-04-25T13:44:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9d0e9c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 0x5621d6bb97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9d0e9c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 0x5621d6bb97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.43:50514/0 (socket says 172.21.15.43:50514) 2024-04-25T13:44:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9d0e9c640 1 -- 172.21.15.43:0/2348572652 learned_addr learned my addr 172.21.15.43:0/2348572652 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9d169d640 1 --2- 172.21.15.43:0/2348572652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67e83b0 0x5621d6bb28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9d1e9e640 1 --2- 172.21.15.43:0/2348572652 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d6811270 0x5621d6bb2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9d0e9c640 1 -- 172.21.15.43:0/2348572652 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d6811270 msgr2=0x5621d6bb2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9d0e9c640 1 --2- 172.21.15.43:0/2348572652 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d6811270 0x5621d6bb2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9d0e9c640 1 -- 172.21.15.43:0/2348572652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67e83b0 msgr2=0x5621d6bb28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9d0e9c640 1 --2- 172.21.15.43:0/2348572652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67e83b0 0x5621d6bb28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.129+0000 7fe9d0e9c640 1 -- 172.21.15.43:0/2348572652 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621d6acf750 con 0x5621d67f0590 2024-04-25T13:44:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.130+0000 7fe9d0e9c640 1 --2- 172.21.15.43:0/2348572652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 0x5621d6bb97f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0000c00 tx=0x7fe9c0031850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20a695e6aedceceb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.130+0000 7fe9ca7fc640 1 --2- 172.21.15.43:0/2440774507 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe9b40afb70 0x7fe9b40b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.130+0000 7fe9b37fe640 1 -- 172.21.15.43:0/2348572652 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0035030 con 0x5621d67f0590 2024-04-25T13:44:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.130+0000 7fe9d1e9e640 1 --2- 172.21.15.43:0/2440774507 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe9b40afb70 0x7fe9b40b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.130+0000 7fe9b37fe640 1 -- 172.21.15.43:0/2348572652 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9c00044c0 con 0x5621d67f0590 2024-04-25T13:44:00.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.130+0000 7fe9b37fe640 1 -- 172.21.15.43:0/2348572652 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0003c20 con 0x5621d67f0590 2024-04-25T13:44:00.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.130+0000 7fe9ca7fc640 1 -- 172.21.15.43:0/2440774507 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7fe9c40df350 con 0x7fe9cc103af0 2024-04-25T13:44:00.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.131+0000 7fe9da7b0740 1 -- 172.21.15.43:0/2348572652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 msgr2=0x5621d6bb97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.131+0000 7fe9d1e9e640 1 --2- 172.21.15.43:0/2440774507 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe9b40afb70 0x7fe9b40b2080 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5621d6bb3540 tx=0x7fe9bc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.131+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/2348572652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 0x5621d6bb97f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0000c00 tx=0x7fe9c0031850 comp rx=0 tx=0).stop 2024-04-25T13:44:00.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.131+0000 7fe9da7b0740 1 -- 172.21.15.43:0/2348572652 shutdown_connections 2024-04-25T13:44:00.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.131+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/2348572652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 0x5621d6bb97f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.131+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/2348572652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67e83b0 0x5621d6bb28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.131+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/2348572652 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d6811270 0x5621d6bb2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.131+0000 7fe9da7b0740 1 -- 172.21.15.43:0/2348572652 >> 172.21.15.43:0/2348572652 conn(0x5621d68053c0 msgr2=0x5621d6badd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.131+0000 7fe9da7b0740 1 -- 172.21.15.43:0/2348572652 shutdown_connections 2024-04-25T13:44:00.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.131+0000 7fe9da7b0740 1 -- 172.21.15.43:0/2348572652 wait complete. 2024-04-25T13:44:00.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.131+0000 7fe9da7b0740 1 -- start start 2024-04-25T13:44:00.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.131+0000 7fe9da7b0740 1 Processor -- start 2024-04-25T13:44:00.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9da7b0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67e83b0 0x5621d6bbc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9da7b0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 0x5621d6bbc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9da7b0740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d6811270 0x5621d6bc3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9da7b0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5621d6bba1e0 con 0x5621d67e83b0 2024-04-25T13:44:00.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9da7b0740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x5621d6a9efe0 con 0x5621d6811270 2024-04-25T13:44:00.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9da7b0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5621d6bba360 con 0x5621d67f0590 2024-04-25T13:44:00.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9da7b0740 10 client.0 _ll_register_callbacks cb 0x5621d6ab5150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:44:00.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9d169d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67e83b0 0x5621d6bbc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9d169d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67e83b0 0x5621d6bbc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60432/0 (socket says 172.21.15.43:60432) 2024-04-25T13:44:00.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9d169d640 1 -- 172.21.15.43:0/169272867 learned_addr learned my addr 172.21.15.43:0/169272867 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:00.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9d0e9c640 1 --2- 172.21.15.43:0/169272867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 0x5621d6bbc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9d1e9e640 1 --2- 172.21.15.43:0/169272867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d6811270 0x5621d6bc3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9d169d640 1 -- 172.21.15.43:0/169272867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 msgr2=0x5621d6bbc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9d169d640 1 --2- 172.21.15.43:0/169272867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 0x5621d6bbc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9d169d640 1 -- 172.21.15.43:0/169272867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d6811270 msgr2=0x5621d6bc3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9d169d640 1 --2- 172.21.15.43:0/169272867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d6811270 0x5621d6bc3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9d169d640 1 -- 172.21.15.43:0/169272867 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621d68292d0 con 0x5621d67e83b0 2024-04-25T13:44:00.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.132+0000 7fe9d1e9e640 1 --2- 172.21.15.43:0/169272867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d6811270 0x5621d6bc3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:44:00.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.133+0000 7fe9d169d640 1 --2- 172.21.15.43:0/169272867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67e83b0 0x5621d6bbc1d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe9c40a4720 tx=0x7fe9c40076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99d505487973119 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.133+0000 7fe9b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T13:44:00.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.133+0000 7fe9b0ff9640 1 -- 172.21.15.43:0/169272867 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c40a7280 con 0x5621d67e83b0 2024-04-25T13:44:00.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.133+0000 7fe9da7b0740 1 -- 172.21.15.43:0/169272867 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5621d6b25350 con 0x5621d67e83b0 2024-04-25T13:44:00.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.133+0000 7fe9b0ff9640 1 -- 172.21.15.43:0/169272867 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7fe9c40afe80 con 0x5621d67e83b0 2024-04-25T13:44:00.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.133+0000 7fe9b0ff9640 1 -- 172.21.15.43:0/169272867 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe9c40a6c20 con 0x5621d67e83b0 2024-04-25T13:44:00.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.133+0000 7fe9da7b0740 10 client.15246 fetch_fsmap learned FSMap version 24 2024-04-25T13:44:00.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.133+0000 7fe9da7b0740 1 -- 172.21.15.43:0/169272867 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5621d68f36b0 con 0x5621d67e83b0 2024-04-25T13:44:00.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.133+0000 7fe9b0ff9640 1 -- 172.21.15.43:0/169272867 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5621d6b25350 con 0x5621d67e83b0 2024-04-25T13:44:00.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.133+0000 7fe9b0ff9640 1 -- 172.21.15.43:0/169272867 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe9c4004b60 con 0x5621d67e83b0 2024-04-25T13:44:00.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.133+0000 7fe9da7b0740 10 client.15246 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T13:44:00.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.133+0000 7fe9da7b0740 10 client.15246 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T13:44:00.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.133+0000 7fe9da7b0740 20 client.15246 populate_metadata read hostname 'smithi043' 2024-04-25T13:44:00.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.133+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/169272867 >> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] conn(0x5621d67cfe40 0x5621d6bc9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.133+0000 7fe9da7b0740 4 client.15246 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:44:00.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.133+0000 7fe9da7b0740 1 -- 172.21.15.43:0/169272867 --> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621d6b1f1c0 con 0x5621d67cfe40 2024-04-25T13:44:00.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.134+0000 7fe9d0e9c640 1 --2- 172.21.15.43:0/169272867 >> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] conn(0x5621d67cfe40 0x5621d6bc9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.134+0000 7fe9d0e9c640 1 --2- 172.21.15.43:0/169272867 >> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] conn(0x5621d67cfe40 0x5621d6bc9f50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa5f703cb6097b97 server_cookie=afec33493887efbe in_seq=0 out_seq=0 2024-04-25T13:44:00.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.134+0000 7fe9b0ff9640 10 client.15246 ms_handle_connect on v2:172.21.15.175:6838/3323587585 2024-04-25T13:44:00.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.135+0000 7fe9b0ff9640 1 -- 172.21.15.43:0/169272867 <== mds.2 v2:172.21.15.175:6838/3323587585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5621d6b1f1c0 con 0x5621d67cfe40 2024-04-25T13:44:00.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.135+0000 7fe9b0ff9640 10 client.15246 handle_command_reply: tid=0 2024-04-25T13:44:00.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.135+0000 7fe9da7b0740 1 client.15246 shutdown 2024-04-25T13:44:00.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.135+0000 7fe9da7b0740 1 -- 172.21.15.43:0/169272867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67e83b0 msgr2=0x5621d6bbc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.135+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/169272867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67e83b0 0x5621d6bbc1d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe9c40a4720 tx=0x7fe9c40076d0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.135+0000 7fe9da7b0740 1 -- 172.21.15.43:0/169272867 shutdown_connections 2024-04-25T13:44:00.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.135+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/169272867 >> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] conn(0x5621d67cfe40 0x5621d6bc9f50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.135+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/169272867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d6811270 0x5621d6bc3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.135+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/169272867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 0x5621d6bbc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.135+0000 7fe9b0ff9640 0 client.15246 ms_handle_reset on v2:172.21.15.175:6838/3323587585 2024-04-25T13:44:00.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.135+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/169272867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67e83b0 0x5621d6bbc1d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.135+0000 7fe9da7b0740 1 -- 172.21.15.43:0/169272867 >> 172.21.15.43:0/169272867 conn(0x5621d68053c0 msgr2=0x5621d6bacd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.135+0000 7fe9da7b0740 1 -- 172.21.15.43:0/169272867 shutdown_connections 2024-04-25T13:44:00.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.135+0000 7fe9da7b0740 1 -- 172.21.15.43:0/169272867 wait complete. 2024-04-25T13:44:00.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.136+0000 7fe9da7b0740 20 client.15246 trim_cache size 0 max 16384 2024-04-25T13:44:00.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.154+0000 7fe9da7b0740 1 Processor -- start 2024-04-25T13:44:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9da7b0740 1 -- start start 2024-04-25T13:44:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9da7b0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67e83b0 0x5621d6ba8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9da7b0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67f0590 0x5621d6bc3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9da7b0740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d6811270 0x5621d6bc3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9da7b0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5621d6bc8290 con 0x5621d67f0590 2024-04-25T13:44:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9da7b0740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x5621d6bc8960 con 0x5621d6811270 2024-04-25T13:44:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9da7b0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5621d6bc9030 con 0x5621d67e83b0 2024-04-25T13:44:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9d0e9c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67f0590 0x5621d6bc3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9d0e9c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67f0590 0x5621d6bc3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60442/0 (socket says 172.21.15.43:60442) 2024-04-25T13:44:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9d0e9c640 1 -- 172.21.15.43:0/3017034422 learned_addr learned my addr 172.21.15.43:0/3017034422 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9d1e9e640 1 --2- 172.21.15.43:0/3017034422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d6811270 0x5621d6bc3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9d0e9c640 1 -- 172.21.15.43:0/3017034422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67e83b0 msgr2=0x5621d6ba8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9d0e9c640 1 --2- 172.21.15.43:0/3017034422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67e83b0 0x5621d6ba8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9d0e9c640 1 -- 172.21.15.43:0/3017034422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d6811270 msgr2=0x5621d6bc3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9d0e9c640 1 --2- 172.21.15.43:0/3017034422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d6811270 0x5621d6bc3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9d0e9c640 1 -- 172.21.15.43:0/3017034422 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621d6bb5740 con 0x5621d67f0590 2024-04-25T13:44:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9d0e9c640 1 --2- 172.21.15.43:0/3017034422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67f0590 0x5621d6bc3600 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0031660 tx=0x7fe9c002aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a955b0cfcc65274 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9b2ffd640 1 -- 172.21.15.43:0/3017034422 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0056070 con 0x5621d67f0590 2024-04-25T13:44:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9b2ffd640 1 -- 172.21.15.43:0/3017034422 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9c00518c0 con 0x5621d67f0590 2024-04-25T13:44:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.155+0000 7fe9b2ffd640 1 -- 172.21.15.43:0/3017034422 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0035040 con 0x5621d67f0590 2024-04-25T13:44:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.156+0000 7fe9da7b0740 1 -- 172.21.15.43:0/3017034422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67f0590 msgr2=0x5621d6bc3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.156+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/3017034422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67f0590 0x5621d6bc3600 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0031660 tx=0x7fe9c002aa90 comp rx=0 tx=0).stop 2024-04-25T13:44:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.156+0000 7fe9da7b0740 1 -- 172.21.15.43:0/3017034422 shutdown_connections 2024-04-25T13:44:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.156+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/3017034422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d6811270 0x5621d6bc3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.156+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/3017034422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d67f0590 0x5621d6bc3600 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.156+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/3017034422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67e83b0 0x5621d6ba8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.156+0000 7fe9da7b0740 1 -- 172.21.15.43:0/3017034422 >> 172.21.15.43:0/3017034422 conn(0x5621d68053c0 msgr2=0x5621d6bb66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.156+0000 7fe9da7b0740 1 -- 172.21.15.43:0/3017034422 shutdown_connections 2024-04-25T13:44:00.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.156+0000 7fe9da7b0740 1 -- 172.21.15.43:0/3017034422 wait complete. 2024-04-25T13:44:00.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.157+0000 7fe9da7b0740 1 -- start start 2024-04-25T13:44:00.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.157+0000 7fe9da7b0740 1 Processor -- start 2024-04-25T13:44:00.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.157+0000 7fe9da7b0740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d67e83b0 0x5621d6bbf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.157+0000 7fe9da7b0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 0x5621d6bbfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.157+0000 7fe9da7b0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d6811270 0x5621d6bc2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.157+0000 7fe9da7b0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5621d6bc9dd0 con 0x5621d6811270 2024-04-25T13:44:00.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.157+0000 7fe9da7b0740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x5621d6bc9700 con 0x5621d67e83b0 2024-04-25T13:44:00.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.157+0000 7fe9da7b0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5621d6bca4a0 con 0x5621d67f0590 2024-04-25T13:44:00.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.157+0000 7fe9da7b0740 10 client.0 _ll_register_callbacks cb 0x7fe9c400af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:44:00.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.157+0000 7fe9d1e9e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d6811270 0x5621d6bc2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.157+0000 7fe9d1e9e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d6811270 0x5621d6bc2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60452/0 (socket says 172.21.15.43:60452) 2024-04-25T13:44:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.157+0000 7fe9d1e9e640 1 -- 172.21.15.43:0/2522726379 learned_addr learned my addr 172.21.15.43:0/2522726379 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.157+0000 7fe9d169d640 1 --2- 172.21.15.43:0/2522726379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d67e83b0 0x5621d6bbf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.157+0000 7fe9d0e9c640 1 --2- 172.21.15.43:0/2522726379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 0x5621d6bbfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.158+0000 7fe9d1e9e640 1 -- 172.21.15.43:0/2522726379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 msgr2=0x5621d6bbfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.158+0000 7fe9d1e9e640 1 --2- 172.21.15.43:0/2522726379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 0x5621d6bbfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.158+0000 7fe9d1e9e640 1 -- 172.21.15.43:0/2522726379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d67e83b0 msgr2=0x5621d6bbf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.158+0000 7fe9d1e9e640 1 --2- 172.21.15.43:0/2522726379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d67e83b0 0x5621d6bbf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.158+0000 7fe9d1e9e640 1 -- 172.21.15.43:0/2522726379 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621d6bbb250 con 0x5621d6811270 2024-04-25T13:44:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.158+0000 7fe9d1e9e640 1 --2- 172.21.15.43:0/2522726379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d6811270 0x5621d6bc2af0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc015770 tx=0x7fe9bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a3e484b3517df1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.158+0000 7fe9b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T13:44:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.158+0000 7fe9b0ff9640 1 -- 172.21.15.43:0/2522726379 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0147b0 con 0x5621d6811270 2024-04-25T13:44:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.158+0000 7fe9b0ff9640 1 -- 172.21.15.43:0/2522726379 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7fe9bc014950 con 0x5621d6811270 2024-04-25T13:44:00.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.158+0000 7fe9da7b0740 1 -- 172.21.15.43:0/2522726379 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9c00518c0 con 0x5621d6811270 2024-04-25T13:44:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.158+0000 7fe9b0ff9640 1 -- 172.21.15.43:0/2522726379 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe9bc034050 con 0x5621d6811270 2024-04-25T13:44:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.158+0000 7fe9da7b0740 10 client.15252 fetch_fsmap learned FSMap version 24 2024-04-25T13:44:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.158+0000 7fe9da7b0740 1 -- 172.21.15.43:0/2522726379 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5621d6c32dd0 con 0x5621d6811270 2024-04-25T13:44:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.158+0000 7fe9b0ff9640 1 -- 172.21.15.43:0/2522726379 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9c00518c0 con 0x5621d6811270 2024-04-25T13:44:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.158+0000 7fe9b0ff9640 1 -- 172.21.15.43:0/2522726379 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe9bc02bc20 con 0x5621d6811270 2024-04-25T13:44:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.158+0000 7fe9da7b0740 10 client.15252 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T13:44:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.159+0000 7fe9da7b0740 10 client.15252 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T13:44:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.159+0000 7fe9da7b0740 20 client.15252 populate_metadata read hostname 'smithi043' 2024-04-25T13:44:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.159+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/2522726379 >> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] conn(0x5621d67a5280 0x5621d6c365c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.159+0000 7fe9da7b0740 4 client.15252 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:44:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.159+0000 7fe9da7b0740 1 -- 172.21.15.43:0/2522726379 --> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] -- command(tid 0: {"prefix": "status"}) -- 0x5621d6a9a9a0 con 0x5621d67a5280 2024-04-25T13:44:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.159+0000 7fe9d169d640 1 --2- 172.21.15.43:0/2522726379 >> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] conn(0x5621d67a5280 0x5621d6c365c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.159+0000 7fe9d169d640 1 --2- 172.21.15.43:0/2522726379 >> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] conn(0x5621d67a5280 0x5621d6c365c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6e88a0fcdde1b9c2 server_cookie=e2a7cff9e3f2853f in_seq=0 out_seq=0 2024-04-25T13:44:00.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.159+0000 7fe9b0ff9640 10 client.15252 ms_handle_connect on v2:172.21.15.175:6838/3323587585 2024-04-25T13:44:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.159+0000 7fe9b0ff9640 1 -- 172.21.15.43:0/2522726379 <== mds.2 v2:172.21.15.175:6838/3323587585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5621d6a9a9a0 con 0x5621d67a5280 2024-04-25T13:44:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.159+0000 7fe9b0ff9640 10 client.15252 handle_command_reply: tid=0 2024-04-25T13:44:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.159+0000 7fe9da7b0740 1 client.15252 shutdown 2024-04-25T13:44:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.159+0000 7fe9da7b0740 1 -- 172.21.15.43:0/2522726379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d6811270 msgr2=0x5621d6bc2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.159+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/2522726379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d6811270 0x5621d6bc2af0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc015770 tx=0x7fe9bc0046c0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9da7b0740 1 -- 172.21.15.43:0/2522726379 shutdown_connections 2024-04-25T13:44:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/2522726379 >> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] conn(0x5621d67a5280 0x5621d6c365c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/2522726379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d6811270 0x5621d6bc2af0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/2522726379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5621d67f0590 0x5621d6bbfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9b0ff9640 0 client.15252 ms_handle_reset on v2:172.21.15.175:6838/3323587585 2024-04-25T13:44:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9da7b0740 1 --2- 172.21.15.43:0/2522726379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5621d67e83b0 0x5621d6bbf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9da7b0740 1 -- 172.21.15.43:0/2522726379 >> 172.21.15.43:0/2522726379 conn(0x5621d68053c0 msgr2=0x5621d6bad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9da7b0740 1 -- 172.21.15.43:0/2522726379 shutdown_connections 2024-04-25T13:44:00.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9da7b0740 1 -- 172.21.15.43:0/2522726379 wait complete. 2024-04-25T13:44:00.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9da7b0740 20 client.15252 trim_cache size 0 max 16384 2024-04-25T13:44:00.167 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T13:44:00.167 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "394efb6c-0308-11ef-bc93-c7b262605968", 2024-04-25T13:44:00.167 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 2, 2024-04-25T13:44:00.167 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24502, 2024-04-25T13:44:00.167 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T13:44:00.167 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T13:44:00.167 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T13:44:00.167 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 85.025568644000003, 2024-04-25T13:44:00.167 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 24, 2024-04-25T13:44:00.167 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 84, 2024-04-25T13:44:00.168 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 80, 2024-04-25T13:44:00.168 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 126.163445158 2024-04-25T13:44:00.168 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T13:44:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9d3901640 1 -- 172.21.15.43:0/2440774507 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe9b40afb70 msgr2=0x7fe9b40b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9d3901640 1 --2- 172.21.15.43:0/2440774507 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe9b40afb70 0x7fe9b40b2080 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5621d6bb3540 tx=0x7fe9bc008040 comp rx=0 tx=0).stop 2024-04-25T13:44:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9d3901640 1 -- 172.21.15.43:0/2440774507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9cc103af0 msgr2=0x7fe9cc19a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9d3901640 1 --2- 172.21.15.43:0/2440774507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9cc103af0 0x7fe9cc19a1b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400cce0 tx=0x7fe9c400a620 comp rx=0 tx=0).stop 2024-04-25T13:44:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9d3901640 1 -- 172.21.15.43:0/2440774507 shutdown_connections 2024-04-25T13:44:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9d3901640 1 --2- 172.21.15.43:0/2440774507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9cc109a30 0x7fe9cc1a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9d3901640 1 --2- 172.21.15.43:0/2440774507 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe9b40afb70 0x7fe9b40b2080 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9d3901640 1 --2- 172.21.15.43:0/2440774507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9cc104d30 0x7fe9cc19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9d3901640 1 --2- 172.21.15.43:0/2440774507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9cc103af0 0x7fe9cc19a1b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9d3901640 1 -- 172.21.15.43:0/2440774507 >> 172.21.15.43:0/2440774507 conn(0x7fe9cc0fece0 msgr2=0x7fe9cc105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9d3901640 1 -- 172.21.15.43:0/2440774507 shutdown_connections 2024-04-25T13:44:00.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.160+0000 7fe9d3901640 1 -- 172.21.15.43:0/2440774507 wait complete. 2024-04-25T13:44:00.171 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-25T13:44:00.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.286+0000 7f1a5c6b6640 1 -- 172.21.15.43:0/315874477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a54109a40 msgr2=0x7f1a5410be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.286+0000 7f1a5c6b6640 1 --2- 172.21.15.43:0/315874477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a54109a40 0x7f1a5410be60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1a44009900 tx=0x7f1a4402a410 comp rx=0 tx=0).stop 2024-04-25T13:44:00.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.286+0000 7f1a5c6b6640 1 -- 172.21.15.43:0/315874477 shutdown_connections 2024-04-25T13:44:00.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.286+0000 7f1a5c6b6640 1 --2- 172.21.15.43:0/315874477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a54109a40 0x7f1a5410be60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.286+0000 7f1a5c6b6640 1 --2- 172.21.15.43:0/315874477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a54104d40 0x7f1a54105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.286+0000 7f1a5c6b6640 1 --2- 172.21.15.43:0/315874477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a54103b00 0x7f1a54104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.286+0000 7f1a5c6b6640 1 -- 172.21.15.43:0/315874477 >> 172.21.15.43:0/315874477 conn(0x7f1a540fecf0 msgr2=0x7f1a541011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.286+0000 7f1a5c6b6640 1 -- 172.21.15.43:0/315874477 shutdown_connections 2024-04-25T13:44:00.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.286+0000 7f1a5c6b6640 1 -- 172.21.15.43:0/315874477 wait complete. 2024-04-25T13:44:00.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.286+0000 7f1a5c6b6640 1 Processor -- start 2024-04-25T13:44:00.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.286+0000 7f1a5c6b6640 1 -- start start 2024-04-25T13:44:00.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a5c6b6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a54103b00 0x7f1a5419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a5c6b6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a54104d40 0x7f1a5419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a5c6b6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a54109a40 0x7f1a541a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a5c6b6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5410f4c0 con 0x7f1a54104d40 2024-04-25T13:44:00.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a5c6b6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5410f340 con 0x7f1a54109a40 2024-04-25T13:44:00.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a5c6b6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5410f640 con 0x7f1a54103b00 2024-04-25T13:44:00.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a59c51640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a54104d40 0x7f1a5419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a59c51640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a54104d40 0x7f1a5419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60466/0 (socket says 172.21.15.43:60466) 2024-04-25T13:44:00.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a59c51640 1 -- 172.21.15.43:0/3038193976 learned_addr learned my addr 172.21.15.43:0/3038193976 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:00.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a5a452640 1 --2- 172.21.15.43:0/3038193976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a54103b00 0x7f1a5419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a5ac53640 1 --2- 172.21.15.43:0/3038193976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a54109a40 0x7f1a541a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a59c51640 1 -- 172.21.15.43:0/3038193976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a54103b00 msgr2=0x7f1a5419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a59c51640 1 --2- 172.21.15.43:0/3038193976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a54103b00 0x7f1a5419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a59c51640 1 -- 172.21.15.43:0/3038193976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a54109a40 msgr2=0x7f1a541a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a59c51640 1 --2- 172.21.15.43:0/3038193976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a54109a40 0x7f1a541a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a59c51640 1 -- 172.21.15.43:0/3038193976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a541a1c30 con 0x7f1a54104d40 2024-04-25T13:44:00.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a5ac53640 1 --2- 172.21.15.43:0/3038193976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a54109a40 0x7f1a541a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:44:00.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a59c51640 1 --2- 172.21.15.43:0/3038193976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a54104d40 0x7f1a5419a630 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800e9f0 tx=0x7f1a4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.287+0000 7f1a537fe640 1 -- 172.21.15.43:0/3038193976 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4800cd80 con 0x7f1a54104d40 2024-04-25T13:44:00.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.288+0000 7f1a537fe640 1 -- 172.21.15.43:0/3038193976 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a480108c0 con 0x7f1a54104d40 2024-04-25T13:44:00.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.288+0000 7f1a537fe640 1 -- 172.21.15.43:0/3038193976 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a480187c0 con 0x7f1a54104d40 2024-04-25T13:44:00.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.288+0000 7f1a5c6b6640 1 -- 172.21.15.43:0/3038193976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a541a1f20 con 0x7f1a54104d40 2024-04-25T13:44:00.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.288+0000 7f1a5c6b6640 1 -- 172.21.15.43:0/3038193976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a541a2390 con 0x7f1a54104d40 2024-04-25T13:44:00.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.290+0000 7f1a6356f740 1 Processor -- start 2024-04-25T13:44:00.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.290+0000 7f1a6356f740 1 -- start start 2024-04-25T13:44:00.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.290+0000 7f1a537fe640 1 -- 172.21.15.43:0/3038193976 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f1a48010430 con 0x7f1a54104d40 2024-04-25T13:44:00.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a6356f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfca270 0x55d39c36f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a6356f740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfa13b0 0x55d39c36fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a6356f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa9590 0x55d39c376c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a6356f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d39c2d0740 con 0x55d39bfa9590 2024-04-25T13:44:00.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a6356f740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x55d39c26c3a0 con 0x55d39bfa13b0 2024-04-25T13:44:00.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a6356f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d39c2cc700 con 0x55d39bfca270 2024-04-25T13:44:00.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a59c51640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa9590 0x55d39c376c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a59c51640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa9590 0x55d39c376c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60482/0 (socket says 172.21.15.43:60482) 2024-04-25T13:44:00.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a59c51640 1 -- 172.21.15.43:0/1209731943 learned_addr learned my addr 172.21.15.43:0/1209731943 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:00.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a5a452640 1 --2- 172.21.15.43:0/1209731943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfa13b0 0x55d39c36fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a5ac53640 1 --2- 172.21.15.43:0/1209731943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfca270 0x55d39c36f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a59c51640 1 -- 172.21.15.43:0/1209731943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfca270 msgr2=0x55d39c36f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a59c51640 1 --2- 172.21.15.43:0/1209731943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfca270 0x55d39c36f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a59c51640 1 -- 172.21.15.43:0/1209731943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfa13b0 msgr2=0x55d39c36fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a59c51640 1 --2- 172.21.15.43:0/1209731943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfa13b0 0x55d39c36fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a59c51640 1 -- 172.21.15.43:0/1209731943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d39c288750 con 0x55d39bfa9590 2024-04-25T13:44:00.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a5a452640 1 --2- 172.21.15.43:0/1209731943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfa13b0 0x55d39c36fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:44:00.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a537fe640 1 --2- 172.21.15.43:0/3038193976 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f1a3c0afaf0 0x7f1a3c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.291+0000 7f1a59c51640 1 --2- 172.21.15.43:0/1209731943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa9590 0x55d39c376c00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1a480e7500 tx=0x7f1a480e79c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80a918b1b8afd26 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.292+0000 7f1a5ac53640 1 --2- 172.21.15.43:0/3038193976 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f1a3c0afaf0 0x7f1a3c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.292+0000 7f1a50bfe640 1 -- 172.21.15.43:0/1209731943 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a480f2070 con 0x55d39bfa9590 2024-04-25T13:44:00.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.292+0000 7f1a537fe640 1 -- 172.21.15.43:0/3038193976 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f1a480df310 con 0x7f1a54104d40 2024-04-25T13:44:00.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.292+0000 7f1a50bfe640 1 -- 172.21.15.43:0/1209731943 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a480a6f80 con 0x55d39bfa9590 2024-04-25T13:44:00.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.292+0000 7f1a50bfe640 1 -- 172.21.15.43:0/1209731943 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a480a6be0 con 0x55d39bfa9590 2024-04-25T13:44:00.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.293+0000 7f1a6356f740 1 -- 172.21.15.43:0/1209731943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa9590 msgr2=0x55d39c376c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.293+0000 7f1a6356f740 1 --2- 172.21.15.43:0/1209731943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa9590 0x55d39c376c00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1a480e7500 tx=0x7f1a480e79c0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.293+0000 7f1a5ac53640 1 --2- 172.21.15.43:0/3038193976 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f1a3c0afaf0 0x7f1a3c0b2000 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1a44005760 tx=0x7f1a44005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.293+0000 7f1a6356f740 1 -- 172.21.15.43:0/1209731943 shutdown_connections 2024-04-25T13:44:00.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.293+0000 7f1a6356f740 1 --2- 172.21.15.43:0/1209731943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa9590 0x55d39c376c00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.293+0000 7f1a6356f740 1 --2- 172.21.15.43:0/1209731943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfa13b0 0x55d39c36fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.293+0000 7f1a6356f740 1 --2- 172.21.15.43:0/1209731943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfca270 0x55d39c36f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.293+0000 7f1a6356f740 1 -- 172.21.15.43:0/1209731943 >> 172.21.15.43:0/1209731943 conn(0x55d39bfbe3c0 msgr2=0x55d39c36b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.293+0000 7f1a6356f740 1 -- 172.21.15.43:0/1209731943 shutdown_connections 2024-04-25T13:44:00.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.293+0000 7f1a6356f740 1 -- 172.21.15.43:0/1209731943 wait complete. 2024-04-25T13:44:00.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.293+0000 7f1a6356f740 1 -- start start 2024-04-25T13:44:00.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.293+0000 7f1a6356f740 1 Processor -- start 2024-04-25T13:44:00.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a6356f740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfa13b0 0x55d39c379680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a6356f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa9590 0x55d39c379bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a6356f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfca270 0x55d39c380b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a6356f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d39c377650 con 0x55d39bfa9590 2024-04-25T13:44:00.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a6356f740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x55d39c257fe0 con 0x55d39bfa13b0 2024-04-25T13:44:00.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a6356f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d39c3777d0 con 0x55d39bfca270 2024-04-25T13:44:00.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a6356f740 10 client.0 _ll_register_callbacks cb 0x55d39c26e150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:44:00.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a59c51640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa9590 0x55d39c379bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a59c51640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa9590 0x55d39c379bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60494/0 (socket says 172.21.15.43:60494) 2024-04-25T13:44:00.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a59c51640 1 -- 172.21.15.43:0/485457449 learned_addr learned my addr 172.21.15.43:0/485457449 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:00.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a5ac53640 1 --2- 172.21.15.43:0/485457449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfca270 0x55d39c380b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a5a452640 1 --2- 172.21.15.43:0/485457449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfa13b0 0x55d39c379680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a59c51640 1 -- 172.21.15.43:0/485457449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfca270 msgr2=0x55d39c380b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a59c51640 1 --2- 172.21.15.43:0/485457449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfca270 0x55d39c380b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a59c51640 1 -- 172.21.15.43:0/485457449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfa13b0 msgr2=0x55d39c379680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a59c51640 1 --2- 172.21.15.43:0/485457449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfa13b0 0x55d39c379680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a59c51640 1 -- 172.21.15.43:0/485457449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d39bfe22d0 con 0x55d39bfa9590 2024-04-25T13:44:00.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a59c51640 1 --2- 172.21.15.43:0/485457449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa9590 0x55d39c379bc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1a480a73b0 tx=0x7f1a48010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b575ddefc4a6beb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T13:44:00.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a39ffb640 1 -- 172.21.15.43:0/485457449 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48010720 con 0x55d39bfa9590 2024-04-25T13:44:00.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.294+0000 7f1a39ffb640 1 -- 172.21.15.43:0/485457449 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f1a48010d50 con 0x55d39bfa9590 2024-04-25T13:44:00.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.295+0000 7f1a6356f740 1 -- 172.21.15.43:0/485457449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a480a6f80 con 0x55d39bfa9590 2024-04-25T13:44:00.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.295+0000 7f1a39ffb640 1 -- 172.21.15.43:0/485457449 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1a480a6be0 con 0x55d39bfa9590 2024-04-25T13:44:00.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.295+0000 7f1a6356f740 10 client.15264 fetch_fsmap learned FSMap version 24 2024-04-25T13:44:00.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.295+0000 7f1a6356f740 1 -- 172.21.15.43:0/485457449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d39c0ac6b0 con 0x55d39bfa9590 2024-04-25T13:44:00.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.295+0000 7f1a39ffb640 1 -- 172.21.15.43:0/485457449 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a480a6f80 con 0x55d39bfa9590 2024-04-25T13:44:00.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.295+0000 7f1a39ffb640 1 -- 172.21.15.43:0/485457449 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1a480afe40 con 0x55d39bfa9590 2024-04-25T13:44:00.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.295+0000 7f1a6356f740 10 client.15264 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T13:44:00.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.295+0000 7f1a6356f740 10 client.15264 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-25T13:44:00.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.295+0000 7f1a6356f740 20 client.15264 populate_metadata read hostname 'smithi043' 2024-04-25T13:44:00.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.295+0000 7f1a6356f740 1 --2- 172.21.15.43:0/485457449 >> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] conn(0x55d39bf88e40 0x55d39c386e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.295+0000 7f1a6356f740 4 client.15264 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:44:00.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.295+0000 7f1a6356f740 1 -- 172.21.15.43:0/485457449 --> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d39c2de350 con 0x55d39bf88e40 2024-04-25T13:44:00.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.295+0000 7f1a5a452640 1 --2- 172.21.15.43:0/485457449 >> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] conn(0x55d39bf88e40 0x55d39c386e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.296+0000 7f1a39ffb640 10 client.15264 ms_handle_connect on v2:172.21.15.161:6836/1464384320 2024-04-25T13:44:00.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.296+0000 7f1a5a452640 1 --2- 172.21.15.43:0/485457449 >> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] conn(0x55d39bf88e40 0x55d39c386e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cccb97a8617872c4 server_cookie=975f9394aa284ee3 in_seq=0 out_seq=0 2024-04-25T13:44:00.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.297+0000 7f1a39ffb640 1 -- 172.21.15.43:0/485457449 <== mds.1 v2:172.21.15.161:6836/1464384320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d39c2de350 con 0x55d39bf88e40 2024-04-25T13:44:00.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.297+0000 7f1a39ffb640 10 client.15264 handle_command_reply: tid=0 2024-04-25T13:44:00.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.297+0000 7f1a6356f740 1 client.15264 shutdown 2024-04-25T13:44:00.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.297+0000 7f1a6356f740 1 -- 172.21.15.43:0/485457449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa9590 msgr2=0x55d39c379bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.297+0000 7f1a6356f740 1 --2- 172.21.15.43:0/485457449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa9590 0x55d39c379bc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1a480a73b0 tx=0x7f1a48010cc0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.297+0000 7f1a6356f740 1 -- 172.21.15.43:0/485457449 shutdown_connections 2024-04-25T13:44:00.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.297+0000 7f1a6356f740 1 --2- 172.21.15.43:0/485457449 >> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] conn(0x55d39bf88e40 0x55d39c386e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.297+0000 7f1a6356f740 1 --2- 172.21.15.43:0/485457449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfca270 0x55d39c380b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.297+0000 7f1a6356f740 1 --2- 172.21.15.43:0/485457449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa9590 0x55d39c379bc0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.297+0000 7f1a6356f740 1 --2- 172.21.15.43:0/485457449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfa13b0 0x55d39c379680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.297+0000 7f1a39ffb640 0 client.15264 ms_handle_reset on v2:172.21.15.161:6836/1464384320 2024-04-25T13:44:00.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.297+0000 7f1a6356f740 1 -- 172.21.15.43:0/485457449 >> 172.21.15.43:0/485457449 conn(0x55d39bfbe3c0 msgr2=0x55d39c365d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.297+0000 7f1a6356f740 1 -- 172.21.15.43:0/485457449 shutdown_connections 2024-04-25T13:44:00.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.297+0000 7f1a6356f740 1 -- 172.21.15.43:0/485457449 wait complete. 2024-04-25T13:44:00.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.297+0000 7f1a6356f740 20 client.15264 trim_cache size 0 max 16384 2024-04-25T13:44:00.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.316+0000 7f1a6356f740 1 Processor -- start 2024-04-25T13:44:00.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.316+0000 7f1a6356f740 1 -- start start 2024-04-25T13:44:00.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.316+0000 7f1a6356f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa13b0 0x55d39c374170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.316+0000 7f1a6356f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfa9590 0x55d39c372dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.316+0000 7f1a6356f740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfca270 0x55d39c380a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.316+0000 7f1a6356f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d39c3851c0 con 0x55d39bfa13b0 2024-04-25T13:44:00.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.316+0000 7f1a6356f740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x55d39c385890 con 0x55d39bfca270 2024-04-25T13:44:00.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.316+0000 7f1a6356f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d39c385f60 con 0x55d39bfa9590 2024-04-25T13:44:00.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.316+0000 7f1a5a452640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa13b0 0x55d39c374170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.316+0000 7f1a5a452640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa13b0 0x55d39c374170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60504/0 (socket says 172.21.15.43:60504) 2024-04-25T13:44:00.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.316+0000 7f1a5a452640 1 -- 172.21.15.43:0/3500381133 learned_addr learned my addr 172.21.15.43:0/3500381133 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:00.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.317+0000 7f1a59c51640 1 --2- 172.21.15.43:0/3500381133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfa9590 0x55d39c372dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.317+0000 7f1a5ac53640 1 --2- 172.21.15.43:0/3500381133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfca270 0x55d39c380a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.317+0000 7f1a5a452640 1 -- 172.21.15.43:0/3500381133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfa9590 msgr2=0x55d39c372dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.317+0000 7f1a5a452640 1 --2- 172.21.15.43:0/3500381133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfa9590 0x55d39c372dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.317+0000 7f1a5a452640 1 -- 172.21.15.43:0/3500381133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfca270 msgr2=0x55d39c380a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.317+0000 7f1a5a452640 1 --2- 172.21.15.43:0/3500381133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfca270 0x55d39c380a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.317+0000 7f1a5a452640 1 -- 172.21.15.43:0/3500381133 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d39c36f330 con 0x55d39bfa13b0 2024-04-25T13:44:00.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.317+0000 7f1a5ac53640 1 --2- 172.21.15.43:0/3500381133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfca270 0x55d39c380a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:44:00.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.317+0000 7f1a5a452640 1 --2- 172.21.15.43:0/3500381133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa13b0 0x55d39c374170 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1a541033d0 tx=0x7f1a4c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5320bf4d495d50c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.317+0000 7f1a3bfff640 1 -- 172.21.15.43:0/3500381133 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c014190 con 0x55d39bfa13b0 2024-04-25T13:44:00.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.317+0000 7f1a3bfff640 1 -- 172.21.15.43:0/3500381133 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a4c022020 con 0x55d39bfa13b0 2024-04-25T13:44:00.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.317+0000 7f1a3bfff640 1 -- 172.21.15.43:0/3500381133 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c012740 con 0x55d39bfa13b0 2024-04-25T13:44:00.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.318+0000 7f1a6356f740 1 -- 172.21.15.43:0/3500381133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa13b0 msgr2=0x55d39c374170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.318+0000 7f1a6356f740 1 --2- 172.21.15.43:0/3500381133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa13b0 0x55d39c374170 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1a541033d0 tx=0x7f1a4c009f90 comp rx=0 tx=0).stop 2024-04-25T13:44:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.318+0000 7f1a6356f740 1 -- 172.21.15.43:0/3500381133 shutdown_connections 2024-04-25T13:44:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.318+0000 7f1a6356f740 1 --2- 172.21.15.43:0/3500381133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfca270 0x55d39c380a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.318+0000 7f1a6356f740 1 --2- 172.21.15.43:0/3500381133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfa9590 0x55d39c372dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.318+0000 7f1a6356f740 1 --2- 172.21.15.43:0/3500381133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfa13b0 0x55d39c374170 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.318+0000 7f1a6356f740 1 -- 172.21.15.43:0/3500381133 >> 172.21.15.43:0/3500381133 conn(0x55d39bfbe3c0 msgr2=0x55d39c379620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.318+0000 7f1a6356f740 1 -- 172.21.15.43:0/3500381133 shutdown_connections 2024-04-25T13:44:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.318+0000 7f1a6356f740 1 -- 172.21.15.43:0/3500381133 wait complete. 2024-04-25T13:44:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.318+0000 7f1a6356f740 1 -- start start 2024-04-25T13:44:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.318+0000 7f1a6356f740 1 Processor -- start 2024-04-25T13:44:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.318+0000 7f1a6356f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfa13b0 0x55d39c37ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.318+0000 7f1a6356f740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfa9590 0x55d39c37d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.318+0000 7f1a6356f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfca270 0x55d39c3802a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a6356f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d39c386d00 con 0x55d39bfca270 2024-04-25T13:44:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a6356f740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x55d39c386630 con 0x55d39bfa9590 2024-04-25T13:44:00.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a6356f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d39c3873d0 con 0x55d39bfa13b0 2024-04-25T13:44:00.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a6356f740 10 client.0 _ll_register_callbacks cb 0x7f1a480f0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:44:00.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a5ac53640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfca270 0x55d39c3802a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a5ac53640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfca270 0x55d39c3802a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60520/0 (socket says 172.21.15.43:60520) 2024-04-25T13:44:00.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a5ac53640 1 -- 172.21.15.43:0/1538017705 learned_addr learned my addr 172.21.15.43:0/1538017705 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:00.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a59c51640 1 --2- 172.21.15.43:0/1538017705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfa9590 0x55d39c37d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a5a452640 1 --2- 172.21.15.43:0/1538017705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfa13b0 0x55d39c37ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a5ac53640 1 -- 172.21.15.43:0/1538017705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfa13b0 msgr2=0x55d39c37ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a5ac53640 1 --2- 172.21.15.43:0/1538017705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfa13b0 0x55d39c37ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a5ac53640 1 -- 172.21.15.43:0/1538017705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfa9590 msgr2=0x55d39c37d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a5ac53640 1 --2- 172.21.15.43:0/1538017705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfa9590 0x55d39c37d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a5ac53640 1 -- 172.21.15.43:0/1538017705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d39c380860 con 0x55d39bfca270 2024-04-25T13:44:00.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a5ac53640 1 --2- 172.21.15.43:0/1538017705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfca270 0x55d39c3802a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1a44009900 tx=0x7f1a44009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbb3df0fed38ff8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T13:44:00.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a39ffb640 1 -- 172.21.15.43:0/1538017705 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44035040 con 0x55d39bfca270 2024-04-25T13:44:00.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a39ffb640 1 -- 172.21.15.43:0/1538017705 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f1a440037f0 con 0x55d39bfca270 2024-04-25T13:44:00.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a6356f740 1 -- 172.21.15.43:0/1538017705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a4c022020 con 0x55d39bfca270 2024-04-25T13:44:00.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.319+0000 7f1a39ffb640 1 -- 172.21.15.43:0/1538017705 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1a4405d050 con 0x55d39bfca270 2024-04-25T13:44:00.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.320+0000 7f1a6356f740 10 client.15270 fetch_fsmap learned FSMap version 24 2024-04-25T13:44:00.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.320+0000 7f1a6356f740 1 -- 172.21.15.43:0/1538017705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d39c3effa0 con 0x55d39bfca270 2024-04-25T13:44:00.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.320+0000 7f1a39ffb640 1 -- 172.21.15.43:0/1538017705 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a4c022020 con 0x55d39bfca270 2024-04-25T13:44:00.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.320+0000 7f1a39ffb640 1 -- 172.21.15.43:0/1538017705 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1a44054a40 con 0x55d39bfca270 2024-04-25T13:44:00.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.320+0000 7f1a6356f740 10 client.15270 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T13:44:00.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.320+0000 7f1a6356f740 10 client.15270 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-25T13:44:00.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.320+0000 7f1a6356f740 20 client.15270 populate_metadata read hostname 'smithi043' 2024-04-25T13:44:00.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.320+0000 7f1a6356f740 1 --2- 172.21.15.43:0/1538017705 >> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] conn(0x55d39bf5e280 0x55d39c3f1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.320+0000 7f1a6356f740 4 client.15270 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:44:00.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.320+0000 7f1a6356f740 1 -- 172.21.15.43:0/1538017705 --> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] -- command(tid 0: {"prefix": "status"}) -- 0x55d39c2d81c0 con 0x55d39bf5e280 2024-04-25T13:44:00.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.320+0000 7f1a5a452640 1 --2- 172.21.15.43:0/1538017705 >> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] conn(0x55d39bf5e280 0x55d39c3f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a39ffb640 10 client.15270 ms_handle_connect on v2:172.21.15.161:6836/1464384320 2024-04-25T13:44:00.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a5a452640 1 --2- 172.21.15.43:0/1538017705 >> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] conn(0x55d39bf5e280 0x55d39c3f1050 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=148fc693842d37e1 server_cookie=ab92f800cd66aed3 in_seq=0 out_seq=0 2024-04-25T13:44:00.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a39ffb640 1 -- 172.21.15.43:0/1538017705 <== mds.1 v2:172.21.15.161:6836/1464384320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d39c2d81c0 con 0x55d39bf5e280 2024-04-25T13:44:00.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a39ffb640 10 client.15270 handle_command_reply: tid=0 2024-04-25T13:44:00.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a6356f740 1 client.15270 shutdown 2024-04-25T13:44:00.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a6356f740 1 -- 172.21.15.43:0/1538017705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfca270 msgr2=0x55d39c3802a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a6356f740 1 --2- 172.21.15.43:0/1538017705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfca270 0x55d39c3802a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1a44009900 tx=0x7f1a44009260 comp rx=0 tx=0).stop 2024-04-25T13:44:00.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a6356f740 1 -- 172.21.15.43:0/1538017705 shutdown_connections 2024-04-25T13:44:00.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a6356f740 1 --2- 172.21.15.43:0/1538017705 >> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] conn(0x55d39bf5e280 0x55d39c3f1050 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a6356f740 1 --2- 172.21.15.43:0/1538017705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d39bfca270 0x55d39c3802a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a6356f740 1 --2- 172.21.15.43:0/1538017705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d39bfa9590 0x55d39c37d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a39ffb640 0 client.15270 ms_handle_reset on v2:172.21.15.161:6836/1464384320 2024-04-25T13:44:00.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a6356f740 1 --2- 172.21.15.43:0/1538017705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d39bfa13b0 0x55d39c37ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a6356f740 1 -- 172.21.15.43:0/1538017705 >> 172.21.15.43:0/1538017705 conn(0x55d39bfbe3c0 msgr2=0x55d39c379620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a6356f740 1 -- 172.21.15.43:0/1538017705 shutdown_connections 2024-04-25T13:44:00.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a6356f740 1 -- 172.21.15.43:0/1538017705 wait complete. 2024-04-25T13:44:00.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.321+0000 7f1a6356f740 20 client.15270 trim_cache size 0 max 16384 2024-04-25T13:44:00.328 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T13:44:00.328 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "394efb6c-0308-11ef-bc93-c7b262605968", 2024-04-25T13:44:00.328 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 1, 2024-04-25T13:44:00.328 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24509, 2024-04-25T13:44:00.328 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T13:44:00.329 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T13:44:00.329 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T13:44:00.329 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 86.193882094000003, 2024-04-25T13:44:00.329 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 24, 2024-04-25T13:44:00.329 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 84, 2024-04-25T13:44:00.329 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 80, 2024-04-25T13:44:00.329 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 129.25084373199999 2024-04-25T13:44:00.329 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T13:44:00.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.322+0000 7f1a5c6b6640 1 -- 172.21.15.43:0/3038193976 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f1a3c0afaf0 msgr2=0x7f1a3c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.322+0000 7f1a5c6b6640 1 --2- 172.21.15.43:0/3038193976 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f1a3c0afaf0 0x7f1a3c0b2000 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1a44005760 tx=0x7f1a44005a20 comp rx=0 tx=0).stop 2024-04-25T13:44:00.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.322+0000 7f1a5c6b6640 1 -- 172.21.15.43:0/3038193976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a54104d40 msgr2=0x7f1a5419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.322+0000 7f1a5c6b6640 1 --2- 172.21.15.43:0/3038193976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a54104d40 0x7f1a5419a630 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800e9f0 tx=0x7f1a4800eeb0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.322+0000 7f1a5c6b6640 1 -- 172.21.15.43:0/3038193976 shutdown_connections 2024-04-25T13:44:00.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.322+0000 7f1a5c6b6640 1 --2- 172.21.15.43:0/3038193976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a54109a40 0x7f1a541a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.322+0000 7f1a5c6b6640 1 --2- 172.21.15.43:0/3038193976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a54104d40 0x7f1a5419a630 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.322+0000 7f1a5c6b6640 1 --2- 172.21.15.43:0/3038193976 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f1a3c0afaf0 0x7f1a3c0b2000 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.322+0000 7f1a5c6b6640 1 --2- 172.21.15.43:0/3038193976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a54103b00 0x7f1a5419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.322+0000 7f1a5c6b6640 1 -- 172.21.15.43:0/3038193976 >> 172.21.15.43:0/3038193976 conn(0x7f1a540fecf0 msgr2=0x7f1a54105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.322+0000 7f1a5c6b6640 1 -- 172.21.15.43:0/3038193976 shutdown_connections 2024-04-25T13:44:00.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.322+0000 7f1a5c6b6640 1 -- 172.21.15.43:0/3038193976 wait complete. 2024-04-25T13:44:00.332 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:00 smithi043 ceph-mon[29195]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-04-25T13:44:00.332 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:00 smithi043 ceph-mon[29195]: osdmap e83: 12 total, 12 up, 12 in 2024-04-25T13:44:00.332 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:00 smithi043 ceph-mon[29195]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-25T13:44:00.332 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:00 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1154996110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:44:00.332 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:00 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2950449054' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:44:00.332 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:00 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1250807698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:44:00.333 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T13:44:00.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:00 smithi161 ceph-mon[32696]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-04-25T13:44:00.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:00 smithi161 ceph-mon[32696]: osdmap e83: 12 total, 12 up, 12 in 2024-04-25T13:44:00.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:00 smithi161 ceph-mon[32696]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-25T13:44:00.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:00 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1154996110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:44:00.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:00 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2950449054' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:44:00.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:00 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1250807698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:44:00.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:00 smithi175 ceph-mon[32649]: from='mgr.14150 172.21.15.43:0/3832403584' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-04-25T13:44:00.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:00 smithi175 ceph-mon[32649]: osdmap e83: 12 total, 12 up, 12 in 2024-04-25T13:44:00.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:00 smithi175 ceph-mon[32649]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-25T13:44:00.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:00 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1154996110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:44:00.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:00 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2950449054' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:44:00.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:00 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1250807698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:44:00.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.445+0000 7f0474e9f640 1 -- 172.21.15.43:0/1787801691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0470108920 msgr2=0x7f047010ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.445+0000 7f0474e9f640 1 --2- 172.21.15.43:0/1787801691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0470108920 0x7f047010ad40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0468009ca0 tx=0x7f046802a8c0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.445+0000 7f0474e9f640 1 -- 172.21.15.43:0/1787801691 shutdown_connections 2024-04-25T13:44:00.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.445+0000 7f0474e9f640 1 --2- 172.21.15.43:0/1787801691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0470108920 0x7f047010ad40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.445+0000 7f0474e9f640 1 --2- 172.21.15.43:0/1787801691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0470103c20 0x7f0470104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.445+0000 7f0474e9f640 1 --2- 172.21.15.43:0/1787801691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04701029e0 0x7f04701036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.445+0000 7f0474e9f640 1 -- 172.21.15.43:0/1787801691 >> 172.21.15.43:0/1787801691 conn(0x7f04700fdbd0 msgr2=0x7f0470100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.445+0000 7f0474e9f640 1 -- 172.21.15.43:0/1787801691 shutdown_connections 2024-04-25T13:44:00.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.445+0000 7f0474e9f640 1 -- 172.21.15.43:0/1787801691 wait complete. 2024-04-25T13:44:00.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.446+0000 7f0474e9f640 1 Processor -- start 2024-04-25T13:44:00.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.446+0000 7f0474e9f640 1 -- start start 2024-04-25T13:44:00.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.446+0000 7f0474e9f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04701029e0 0x7f047006a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.446+0000 7f0474e9f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0470103c20 0x7f047019f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.446+0000 7f0474e9f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0470108920 0x7f04701a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.446+0000 7f0474e9f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f047010e410 con 0x7f0470108920 2024-04-25T13:44:00.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.446+0000 7f0474e9f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f047010e290 con 0x7f0470103c20 2024-04-25T13:44:00.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.446+0000 7f0474e9f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f047010e590 con 0x7f04701029e0 2024-04-25T13:44:00.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.447+0000 7f046ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0470108920 0x7f04701a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.447+0000 7f046ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0470108920 0x7f04701a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60538/0 (socket says 172.21.15.43:60538) 2024-04-25T13:44:00.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.447+0000 7f046ed9d640 1 -- 172.21.15.43:0/4057327019 learned_addr learned my addr 172.21.15.43:0/4057327019 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:00.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.447+0000 7f0465d9b640 1 --2- 172.21.15.43:0/4057327019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0470103c20 0x7f047019f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.447+0000 7f046e59c640 1 --2- 172.21.15.43:0/4057327019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04701029e0 0x7f047006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.447+0000 7f046ed9d640 1 -- 172.21.15.43:0/4057327019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04701029e0 msgr2=0x7f047006a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.447+0000 7f046ed9d640 1 --2- 172.21.15.43:0/4057327019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04701029e0 0x7f047006a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.447+0000 7f046ed9d640 1 -- 172.21.15.43:0/4057327019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0470103c20 msgr2=0x7f047019f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.447+0000 7f046ed9d640 1 --2- 172.21.15.43:0/4057327019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0470103c20 0x7f047019f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.447+0000 7f046ed9d640 1 -- 172.21.15.43:0/4057327019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04701a1f30 con 0x7f0470108920 2024-04-25T13:44:00.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.447+0000 7f046ed9d640 1 --2- 172.21.15.43:0/4057327019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0470108920 0x7f04701a1710 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0468004af0 tx=0x7f04680093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.447+0000 7f0467fff640 1 -- 172.21.15.43:0/4057327019 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0468003cf0 con 0x7f0470108920 2024-04-25T13:44:00.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.447+0000 7f0467fff640 1 -- 172.21.15.43:0/4057327019 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04680044d0 con 0x7f0470108920 2024-04-25T13:44:00.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.447+0000 7f0474e9f640 1 -- 172.21.15.43:0/4057327019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04701a21c0 con 0x7f0470108920 2024-04-25T13:44:00.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.447+0000 7f0467fff640 1 -- 172.21.15.43:0/4057327019 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0468030c10 con 0x7f0470108920 2024-04-25T13:44:00.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.447+0000 7f0474e9f640 1 -- 172.21.15.43:0/4057327019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04701a2710 con 0x7f0470108920 2024-04-25T13:44:00.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.450+0000 7f0467fff640 1 -- 172.21.15.43:0/4057327019 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f0468004040 con 0x7f0470108920 2024-04-25T13:44:00.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.450+0000 7f047be2e740 1 Processor -- start 2024-04-25T13:44:00.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.450+0000 7f047be2e740 1 -- start start 2024-04-25T13:44:00.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f047be2e740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338d6270 0x55f533c77370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f047be2e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338ad3b0 0x55f533c778f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f047be2e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c7e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f047be2e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f533bdc740 con 0x55f5338b5590 2024-04-25T13:44:00.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f047be2e740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x55f533b783a0 con 0x55f5338d6270 2024-04-25T13:44:00.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f047be2e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f533bd8700 con 0x55f5338ad3b0 2024-04-25T13:44:00.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f0467fff640 1 --2- 172.21.15.43:0/4057327019 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f045c0afaf0 0x7f045c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f0465d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c7e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f0465d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c7e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60552/0 (socket says 172.21.15.43:60552) 2024-04-25T13:44:00.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f0465d9b640 1 -- 172.21.15.43:0/1558566318 learned_addr learned my addr 172.21.15.43:0/1558566318 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:00.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f046ed9d640 1 --2- 172.21.15.43:0/4057327019 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f045c0afaf0 0x7f045c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f046e59c640 1 --2- 172.21.15.43:0/1558566318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338ad3b0 0x55f533c778f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f0465d9b640 1 --2- 172.21.15.43:0/1558566318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338d6270 0x55f533c77370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f0467fff640 1 -- 172.21.15.43:0/4057327019 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f0468100470 con 0x7f0470108920 2024-04-25T13:44:00.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f0465d9b640 1 -- 172.21.15.43:0/1558566318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338ad3b0 msgr2=0x55f533c778f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f0465d9b640 1 --2- 172.21.15.43:0/1558566318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338ad3b0 0x55f533c778f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f0465d9b640 1 -- 172.21.15.43:0/1558566318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338d6270 msgr2=0x55f533c77370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f0465d9b640 1 --2- 172.21.15.43:0/1558566318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338d6270 0x55f533c77370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f0465d9b640 1 -- 172.21.15.43:0/1558566318 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f533b94750 con 0x55f5338b5590 2024-04-25T13:44:00.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f0465d9b640 1 --2- 172.21.15.43:0/1558566318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c7e7f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f04580058a0 tx=0x7f045800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d799903867340779 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.451+0000 7f046ed9d640 1 --2- 172.21.15.43:0/4057327019 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f045c0afaf0 0x7f045c0b2000 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f04680fdbf0 tx=0x7f046808eee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.452+0000 7f0464d99640 1 -- 172.21.15.43:0/1558566318 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045801e640 con 0x55f5338b5590 2024-04-25T13:44:00.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.452+0000 7f0464d99640 1 -- 172.21.15.43:0/1558566318 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04580108c0 con 0x55f5338b5590 2024-04-25T13:44:00.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.452+0000 7f0464d99640 1 -- 172.21.15.43:0/1558566318 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045801d840 con 0x55f5338b5590 2024-04-25T13:44:00.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.452+0000 7f047be2e740 1 -- 172.21.15.43:0/1558566318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 msgr2=0x55f533c7e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.452+0000 7f047be2e740 1 --2- 172.21.15.43:0/1558566318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c7e7f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f04580058a0 tx=0x7f045800b870 comp rx=0 tx=0).stop 2024-04-25T13:44:00.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.452+0000 7f047be2e740 1 -- 172.21.15.43:0/1558566318 shutdown_connections 2024-04-25T13:44:00.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.452+0000 7f047be2e740 1 --2- 172.21.15.43:0/1558566318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c7e7f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.452+0000 7f047be2e740 1 --2- 172.21.15.43:0/1558566318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338ad3b0 0x55f533c778f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.452+0000 7f047be2e740 1 --2- 172.21.15.43:0/1558566318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338d6270 0x55f533c77370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.452+0000 7f047be2e740 1 -- 172.21.15.43:0/1558566318 >> 172.21.15.43:0/1558566318 conn(0x55f5338ca3c0 msgr2=0x55f533c72d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.453+0000 7f047be2e740 1 -- 172.21.15.43:0/1558566318 shutdown_connections 2024-04-25T13:44:00.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.453+0000 7f047be2e740 1 -- 172.21.15.43:0/1558566318 wait complete. 2024-04-25T13:44:00.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.453+0000 7f047be2e740 1 -- start start 2024-04-25T13:44:00.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.453+0000 7f047be2e740 1 Processor -- start 2024-04-25T13:44:00.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.453+0000 7f047be2e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338ad3b0 0x55f533c81280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.453+0000 7f047be2e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c817c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.453+0000 7f047be2e740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338d6270 0x55f533c88720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.453+0000 7f047be2e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f533c7f240 con 0x55f5338b5590 2024-04-25T13:44:00.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.453+0000 7f047be2e740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x55f533b63fe0 con 0x55f5338d6270 2024-04-25T13:44:00.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.453+0000 7f047be2e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f533c7f3c0 con 0x55f5338ad3b0 2024-04-25T13:44:00.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.453+0000 7f047be2e740 10 client.0 _ll_register_callbacks cb 0x55f533b7a150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:44:00.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.453+0000 7f046e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c817c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.453+0000 7f046e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c817c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60560/0 (socket says 172.21.15.43:60560) 2024-04-25T13:44:00.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.453+0000 7f046e59c640 1 -- 172.21.15.43:0/2306974513 learned_addr learned my addr 172.21.15.43:0/2306974513 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:00.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f0465d9b640 1 --2- 172.21.15.43:0/2306974513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338d6270 0x55f533c88720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f0465d9b640 1 --2- 172.21.15.43:0/2306974513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338ad3b0 0x55f533c81280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f046e59c640 1 -- 172.21.15.43:0/2306974513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338ad3b0 msgr2=0x55f533c81280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f046e59c640 1 --2- 172.21.15.43:0/2306974513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338ad3b0 0x55f533c81280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f046e59c640 1 -- 172.21.15.43:0/2306974513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338d6270 msgr2=0x55f533c88720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f046e59c640 1 --2- 172.21.15.43:0/2306974513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338d6270 0x55f533c88720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f046e59c640 1 -- 172.21.15.43:0/2306974513 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5338ee2d0 con 0x55f5338b5590 2024-04-25T13:44:00.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f0465d9b640 1 --2- 172.21.15.43:0/2306974513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338ad3b0 0x55f533c81280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:44:00.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f046e59c640 1 --2- 172.21.15.43:0/2306974513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c817c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0460013710 tx=0x7f0460013bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1ef82ccff645ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f0455ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T13:44:00.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f0455ffb640 1 -- 172.21.15.43:0/2306974513 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0460011dd0 con 0x55f5338b5590 2024-04-25T13:44:00.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f0455ffb640 1 -- 172.21.15.43:0/2306974513 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f0460004030 con 0x55f5338b5590 2024-04-25T13:44:00.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f047be2e740 1 -- 172.21.15.43:0/2306974513 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04580108c0 con 0x55f5338b5590 2024-04-25T13:44:00.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f0455ffb640 1 -- 172.21.15.43:0/2306974513 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0460004270 con 0x55f5338b5590 2024-04-25T13:44:00.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f047be2e740 10 client.15282 fetch_fsmap learned FSMap version 24 2024-04-25T13:44:00.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f047be2e740 1 -- 172.21.15.43:0/2306974513 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f5339b86b0 con 0x55f5338b5590 2024-04-25T13:44:00.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.454+0000 7f0455ffb640 1 -- 172.21.15.43:0/2306974513 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04580108c0 con 0x55f5338b5590 2024-04-25T13:44:00.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.455+0000 7f0455ffb640 1 -- 172.21.15.43:0/2306974513 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f046001a070 con 0x55f5338b5590 2024-04-25T13:44:00.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.455+0000 7f047be2e740 10 client.15282 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T13:44:00.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.455+0000 7f047be2e740 10 client.15282 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T13:44:00.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.455+0000 7f047be2e740 20 client.15282 populate_metadata read hostname 'smithi043' 2024-04-25T13:44:00.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.455+0000 7f047be2e740 1 --2- 172.21.15.43:0/2306974513 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x55f533894e40 0x55f533c8f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.455+0000 7f047be2e740 4 client.15282 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:44:00.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.455+0000 7f047be2e740 1 -- 172.21.15.43:0/2306974513 --> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f533bea350 con 0x55f533894e40 2024-04-25T13:44:00.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.455+0000 7f0465d9b640 1 --2- 172.21.15.43:0/2306974513 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x55f533894e40 0x55f533c8f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.455+0000 7f0455ffb640 10 client.15282 ms_handle_connect on v2:172.21.15.161:6838/1243414461 2024-04-25T13:44:00.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.455+0000 7f0465d9b640 1 --2- 172.21.15.43:0/2306974513 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x55f533894e40 0x55f533c8f0a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cf3a2ff4ad69e2d server_cookie=cd4059e3429c87b in_seq=0 out_seq=0 2024-04-25T13:44:00.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.456+0000 7f0455ffb640 1 -- 172.21.15.43:0/2306974513 <== mds.0 v2:172.21.15.161:6838/1243414461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f533bea350 con 0x55f533894e40 2024-04-25T13:44:00.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.456+0000 7f0455ffb640 10 client.15282 handle_command_reply: tid=0 2024-04-25T13:44:00.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.456+0000 7f047be2e740 1 client.15282 shutdown 2024-04-25T13:44:00.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.457+0000 7f047be2e740 1 -- 172.21.15.43:0/2306974513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 msgr2=0x55f533c817c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.457+0000 7f047be2e740 1 --2- 172.21.15.43:0/2306974513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c817c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0460013710 tx=0x7f0460013bd0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.457+0000 7f047be2e740 1 -- 172.21.15.43:0/2306974513 shutdown_connections 2024-04-25T13:44:00.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.457+0000 7f047be2e740 1 --2- 172.21.15.43:0/2306974513 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x55f533894e40 0x55f533c8f0a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.457+0000 7f047be2e740 1 --2- 172.21.15.43:0/2306974513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338d6270 0x55f533c88720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.457+0000 7f0455ffb640 0 client.15282 ms_handle_reset on v2:172.21.15.161:6838/1243414461 2024-04-25T13:44:00.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.457+0000 7f047be2e740 1 --2- 172.21.15.43:0/2306974513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c817c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.457+0000 7f047be2e740 1 --2- 172.21.15.43:0/2306974513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338ad3b0 0x55f533c81280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.457+0000 7f047be2e740 1 -- 172.21.15.43:0/2306974513 >> 172.21.15.43:0/2306974513 conn(0x55f5338ca3c0 msgr2=0x55f533c71d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.457+0000 7f047be2e740 1 -- 172.21.15.43:0/2306974513 shutdown_connections 2024-04-25T13:44:00.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.457+0000 7f047be2e740 1 -- 172.21.15.43:0/2306974513 wait complete. 2024-04-25T13:44:00.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.457+0000 7f047be2e740 20 client.15282 trim_cache size 0 max 16384 2024-04-25T13:44:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.475+0000 7f047be2e740 1 Processor -- start 2024-04-25T13:44:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.475+0000 7f047be2e740 1 -- start start 2024-04-25T13:44:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f047be2e740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338ad3b0 0x55f533c7fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f047be2e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f047be2e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338d6270 0x55f533c72bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f047be2e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f533c8d3e0 con 0x55f5338b5590 2024-04-25T13:44:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f047be2e740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x55f533c8dab0 con 0x55f5338ad3b0 2024-04-25T13:44:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f047be2e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f533c8e180 con 0x55f5338d6270 2024-04-25T13:44:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f046e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f046e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c726b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60570/0 (socket says 172.21.15.43:60570) 2024-04-25T13:44:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f046e59c640 1 -- 172.21.15.43:0/1840425789 learned_addr learned my addr 172.21.15.43:0/1840425789 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f0465d9b640 1 --2- 172.21.15.43:0/1840425789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338ad3b0 0x55f533c7fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f046e59c640 1 -- 172.21.15.43:0/1840425789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338d6270 msgr2=0x55f533c72bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f046e59c640 1 --2- 172.21.15.43:0/1840425789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338d6270 0x55f533c72bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f046e59c640 1 -- 172.21.15.43:0/1840425789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338ad3b0 msgr2=0x55f533c7fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f046e59c640 1 --2- 172.21.15.43:0/1840425789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338ad3b0 0x55f533c7fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f046e59c640 1 -- 172.21.15.43:0/1840425789 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f533c7c0c0 con 0x55f5338b5590 2024-04-25T13:44:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f046e59c640 1 --2- 172.21.15.43:0/1840425789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c726b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f046000f600 tx=0x7f0460004080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c33d8ac8ede3c20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f0457fff640 1 -- 172.21.15.43:0/1840425789 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0460000e60 con 0x55f5338b5590 2024-04-25T13:44:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f0457fff640 1 -- 172.21.15.43:0/1840425789 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04600054c0 con 0x55f5338b5590 2024-04-25T13:44:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.476+0000 7f0457fff640 1 -- 172.21.15.43:0/1840425789 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04600035f0 con 0x55f5338b5590 2024-04-25T13:44:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.477+0000 7f047be2e740 1 -- 172.21.15.43:0/1840425789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 msgr2=0x55f533c726b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.477+0000 7f047be2e740 1 --2- 172.21.15.43:0/1840425789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c726b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f046000f600 tx=0x7f0460004080 comp rx=0 tx=0).stop 2024-04-25T13:44:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.477+0000 7f047be2e740 1 -- 172.21.15.43:0/1840425789 shutdown_connections 2024-04-25T13:44:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.477+0000 7f047be2e740 1 --2- 172.21.15.43:0/1840425789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338d6270 0x55f533c72bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.477+0000 7f047be2e740 1 --2- 172.21.15.43:0/1840425789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338b5590 0x55f533c726b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.477+0000 7f047be2e740 1 --2- 172.21.15.43:0/1840425789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338ad3b0 0x55f533c7fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.477+0000 7f047be2e740 1 -- 172.21.15.43:0/1840425789 >> 172.21.15.43:0/1840425789 conn(0x55f5338ca3c0 msgr2=0x55f533c7f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.477+0000 7f047be2e740 1 -- 172.21.15.43:0/1840425789 shutdown_connections 2024-04-25T13:44:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.477+0000 7f047be2e740 1 -- 172.21.15.43:0/1840425789 wait complete. 2024-04-25T13:44:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.477+0000 7f047be2e740 1 -- start start 2024-04-25T13:44:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.477+0000 7f047be2e740 1 Processor -- start 2024-04-25T13:44:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f047be2e740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338ad3b0 0x55f533c83410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f047be2e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338b5590 0x55f533c83950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f047be2e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338d6270 0x55f533c867f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f047be2e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f533c8ef20 con 0x55f5338d6270 2024-04-25T13:44:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f047be2e740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x55f533c8e850 con 0x55f5338ad3b0 2024-04-25T13:44:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f047be2e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f533c8f5f0 con 0x55f5338b5590 2024-04-25T13:44:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f047be2e740 10 client.0 _ll_register_callbacks cb 0x7f0460009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:44:00.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f0465d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338d6270 0x55f533c867f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f0465d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338d6270 0x55f533c867f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60584/0 (socket says 172.21.15.43:60584) 2024-04-25T13:44:00.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f0465d9b640 1 -- 172.21.15.43:0/4212793185 learned_addr learned my addr 172.21.15.43:0/4212793185 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:00.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f046e59c640 1 --2- 172.21.15.43:0/4212793185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338b5590 0x55f533c83950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f0465d9b640 1 --2- 172.21.15.43:0/4212793185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338ad3b0 0x55f533c83410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f0465d9b640 1 -- 172.21.15.43:0/4212793185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338b5590 msgr2=0x55f533c83950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f0465d9b640 1 --2- 172.21.15.43:0/4212793185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338b5590 0x55f533c83950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f0465d9b640 1 -- 172.21.15.43:0/4212793185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338ad3b0 msgr2=0x55f533c83410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:00.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f0465d9b640 1 --2- 172.21.15.43:0/4212793185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338ad3b0 0x55f533c83410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f0465d9b640 1 -- 172.21.15.43:0/4212793185 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f533c86db0 con 0x55f5338d6270 2024-04-25T13:44:00.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f0465d9b640 1 --2- 172.21.15.43:0/4212793185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338d6270 0x55f533c867f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0458012ed0 tx=0x7f045800bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448154a37bb36ea1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:00.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f0455ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T13:44:00.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f0455ffb640 1 -- 172.21.15.43:0/4212793185 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458023040 con 0x55f5338d6270 2024-04-25T13:44:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f0455ffb640 1 -- 172.21.15.43:0/4212793185 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f04580108c0 con 0x55f5338d6270 2024-04-25T13:44:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.478+0000 7f047be2e740 1 -- 172.21.15.43:0/4212793185 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04600054c0 con 0x55f5338d6270 2024-04-25T13:44:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.479+0000 7f0455ffb640 1 -- 172.21.15.43:0/4212793185 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0458010ac0 con 0x55f5338d6270 2024-04-25T13:44:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.479+0000 7f047be2e740 10 client.15288 fetch_fsmap learned FSMap version 24 2024-04-25T13:44:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.479+0000 7f047be2e740 1 -- 172.21.15.43:0/4212793185 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f533c88030 con 0x55f5338d6270 2024-04-25T13:44:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.479+0000 7f0455ffb640 1 -- 172.21.15.43:0/4212793185 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04600054c0 con 0x55f5338d6270 2024-04-25T13:44:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.479+0000 7f0455ffb640 1 -- 172.21.15.43:0/4212793185 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f045801c070 con 0x55f5338d6270 2024-04-25T13:44:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.479+0000 7f047be2e740 10 client.15288 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T13:44:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.479+0000 7f047be2e740 10 client.15288 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T13:44:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.479+0000 7f047be2e740 20 client.15288 populate_metadata read hostname 'smithi043' 2024-04-25T13:44:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.479+0000 7f047be2e740 1 --2- 172.21.15.43:0/4212793185 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x55f53386a280 0x55f533cfb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.479+0000 7f047be2e740 4 client.15288 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:44:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.479+0000 7f047be2e740 1 -- 172.21.15.43:0/4212793185 --> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] -- command(tid 0: {"prefix": "status"}) -- 0x55f533be41c0 con 0x55f53386a280 2024-04-25T13:44:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.479+0000 7f046e59c640 1 --2- 172.21.15.43:0/4212793185 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x55f53386a280 0x55f533cfb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.480+0000 7f046e59c640 1 --2- 172.21.15.43:0/4212793185 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x55f53386a280 0x55f533cfb360 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94e2cfe899f676f8 server_cookie=c7db4680fa79c1c8 in_seq=0 out_seq=0 2024-04-25T13:44:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.480+0000 7f0455ffb640 10 client.15288 ms_handle_connect on v2:172.21.15.161:6838/1243414461 2024-04-25T13:44:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.480+0000 7f0455ffb640 1 -- 172.21.15.43:0/4212793185 <== mds.0 v2:172.21.15.161:6838/1243414461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f533be41c0 con 0x55f53386a280 2024-04-25T13:44:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.480+0000 7f0455ffb640 10 client.15288 handle_command_reply: tid=0 2024-04-25T13:44:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.480+0000 7f047be2e740 1 client.15288 shutdown 2024-04-25T13:44:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.480+0000 7f047be2e740 1 -- 172.21.15.43:0/4212793185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338d6270 msgr2=0x55f533c867f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.480+0000 7f047be2e740 1 --2- 172.21.15.43:0/4212793185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338d6270 0x55f533c867f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0458012ed0 tx=0x7f045800bfd0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.480+0000 7f047be2e740 1 -- 172.21.15.43:0/4212793185 shutdown_connections 2024-04-25T13:44:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.480+0000 7f047be2e740 1 --2- 172.21.15.43:0/4212793185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5338d6270 0x55f533c867f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.480+0000 7f047be2e740 1 --2- 172.21.15.43:0/4212793185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5338b5590 0x55f533c83950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.480+0000 7f047be2e740 1 --2- 172.21.15.43:0/4212793185 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x55f53386a280 0x55f533cfb360 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.480+0000 7f047be2e740 1 --2- 172.21.15.43:0/4212793185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f5338ad3b0 0x55f533c83410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.480+0000 7f0455ffb640 0 client.15288 ms_handle_reset on v2:172.21.15.161:6838/1243414461 2024-04-25T13:44:00.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.480+0000 7f047be2e740 1 -- 172.21.15.43:0/4212793185 >> 172.21.15.43:0/4212793185 conn(0x55f5338ca3c0 msgr2=0x55f533c726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.480+0000 7f047be2e740 1 -- 172.21.15.43:0/4212793185 shutdown_connections 2024-04-25T13:44:00.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.480+0000 7f047be2e740 1 -- 172.21.15.43:0/4212793185 wait complete. 2024-04-25T13:44:00.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.481+0000 7f047be2e740 20 client.15288 trim_cache size 0 max 16384 2024-04-25T13:44:00.487 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T13:44:00.487 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "394efb6c-0308-11ef-bc93-c7b262605968", 2024-04-25T13:44:00.487 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-04-25T13:44:00.487 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24542, 2024-04-25T13:44:00.487 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T13:44:00.487 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T13:44:00.487 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T13:44:00.488 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 111.46290181099999, 2024-04-25T13:44:00.488 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 24, 2024-04-25T13:44:00.488 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 84, 2024-04-25T13:44:00.488 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 80, 2024-04-25T13:44:00.488 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 117.753838962 2024-04-25T13:44:00.488 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T13:44:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.481+0000 7f0474e9f640 1 -- 172.21.15.43:0/4057327019 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f045c0afaf0 msgr2=0x7f045c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.481+0000 7f0474e9f640 1 --2- 172.21.15.43:0/4057327019 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f045c0afaf0 0x7f045c0b2000 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f04680fdbf0 tx=0x7f046808eee0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.481+0000 7f0474e9f640 1 -- 172.21.15.43:0/4057327019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0470108920 msgr2=0x7f04701a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.481+0000 7f0474e9f640 1 --2- 172.21.15.43:0/4057327019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0470108920 0x7f04701a1710 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0468004af0 tx=0x7f04680093d0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.481+0000 7f0474e9f640 1 -- 172.21.15.43:0/4057327019 shutdown_connections 2024-04-25T13:44:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.481+0000 7f0474e9f640 1 --2- 172.21.15.43:0/4057327019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0470108920 0x7f04701a1710 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.481+0000 7f0474e9f640 1 --2- 172.21.15.43:0/4057327019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0470103c20 0x7f047019f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.481+0000 7f0474e9f640 1 --2- 172.21.15.43:0/4057327019 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f045c0afaf0 0x7f045c0b2000 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.481+0000 7f0474e9f640 1 --2- 172.21.15.43:0/4057327019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04701029e0 0x7f047006a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.481+0000 7f0474e9f640 1 -- 172.21.15.43:0/4057327019 >> 172.21.15.43:0/4057327019 conn(0x7f04700fdbd0 msgr2=0x7f0470104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.481+0000 7f0474e9f640 1 -- 172.21.15.43:0/4057327019 shutdown_connections 2024-04-25T13:44:00.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:00.481+0000 7f0474e9f640 1 -- 172.21.15.43:0/4057327019 wait complete. 2024-04-25T13:44:00.492 INFO:tasks.cephadm:Setup complete, yielding 2024-04-25T13:44:00.493 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T13:44:00.503 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T13:44:00.503 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-25T13:44:00.748 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:44:01.202 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:01 smithi043 ceph-mon[29195]: pgmap v344: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:44:01.203 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:01 smithi043 ceph-mon[29195]: osdmap e84: 12 total, 12 up, 12 in 2024-04-25T13:44:01.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:01 smithi161 ceph-mon[32696]: pgmap v344: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:44:01.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:01 smithi161 ceph-mon[32696]: osdmap e84: 12 total, 12 up, 12 in 2024-04-25T13:44:01.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:01 smithi175 ceph-mon[32649]: pgmap v344: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:44:01.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:01 smithi175 ceph-mon[32649]: osdmap e84: 12 total, 12 up, 12 in 2024-04-25T13:44:02.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.786+0000 7f448846d700 1 -- 172.21.15.43:0/1095161117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44801030d0 msgr2=0x7f44801034e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:02.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.786+0000 7f448846d700 1 --2- 172.21.15.43:0/1095161117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44801030d0 0x7f44801034e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f447c009990 tx=0x7f447c009ca0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.786+0000 7f448846d700 1 -- 172.21.15.43:0/1095161117 shutdown_connections 2024-04-25T13:44:02.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.786+0000 7f448846d700 1 --2- 172.21.15.43:0/1095161117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4480104ba0 0x7f448010b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.786+0000 7f448846d700 1 --2- 172.21.15.43:0/1095161117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44801030d0 0x7f44801034e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.786+0000 7f448846d700 1 --2- 172.21.15.43:0/1095161117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4480104200 0x7f4480104610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.786+0000 7f448846d700 1 -- 172.21.15.43:0/1095161117 >> 172.21.15.43:0/1095161117 conn(0x7f44800fe730 msgr2=0x7f4480100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:02.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.786+0000 7f448846d700 1 -- 172.21.15.43:0/1095161117 shutdown_connections 2024-04-25T13:44:02.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.786+0000 7f448846d700 1 -- 172.21.15.43:0/1095161117 wait complete. 2024-04-25T13:44:02.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.787+0000 7f448846d700 1 Processor -- start 2024-04-25T13:44:02.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.787+0000 7f448846d700 1 -- start start 2024-04-25T13:44:02.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.787+0000 7f448846d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44801030d0 0x7f448019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:02.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.787+0000 7f448846d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4480104200 0x7f448019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:02.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.787+0000 7f448846d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4480104ba0 0x7f44801a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:02.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.787+0000 7f448846d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f448010e9f0 con 0x7f4480104200 2024-04-25T13:44:02.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.787+0000 7f448846d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f448010e870 con 0x7f4480104ba0 2024-04-25T13:44:02.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.787+0000 7f448846d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f448010eb70 con 0x7f44801030d0 2024-04-25T13:44:02.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.787+0000 7f4485a08700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4480104200 0x7f448019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:02.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.787+0000 7f4485a08700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4480104200 0x7f448019ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60594/0 (socket says 172.21.15.43:60594) 2024-04-25T13:44:02.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.787+0000 7f4485a08700 1 -- 172.21.15.43:0/2895245423 learned_addr learned my addr 172.21.15.43:0/2895245423 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:02.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.787+0000 7f4486a0a700 1 --2- 172.21.15.43:0/2895245423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4480104ba0 0x7f44801a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:02.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.787+0000 7f4486209700 1 --2- 172.21.15.43:0/2895245423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44801030d0 0x7f448019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:02.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.788+0000 7f4485a08700 1 -- 172.21.15.43:0/2895245423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44801030d0 msgr2=0x7f448019a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:02.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.788+0000 7f4485a08700 1 --2- 172.21.15.43:0/2895245423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44801030d0 0x7f448019a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.788+0000 7f4485a08700 1 -- 172.21.15.43:0/2895245423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4480104ba0 msgr2=0x7f44801a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:02.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.788+0000 7f4485a08700 1 --2- 172.21.15.43:0/2895245423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4480104ba0 0x7f44801a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.788+0000 7f4485a08700 1 -- 172.21.15.43:0/2895245423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44801a22b0 con 0x7f4480104200 2024-04-25T13:44:02.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.788+0000 7f4485a08700 1 --2- 172.21.15.43:0/2895245423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4480104200 0x7f448019ac90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f447000d950 tx=0x7f447000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:02.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.788+0000 7f44777fe700 1 -- 172.21.15.43:0/2895245423 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4470016070 con 0x7f4480104200 2024-04-25T13:44:02.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.788+0000 7f448846d700 1 -- 172.21.15.43:0/2895245423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44801a25a0 con 0x7f4480104200 2024-04-25T13:44:02.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.788+0000 7f44777fe700 1 -- 172.21.15.43:0/2895245423 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4470009dd0 con 0x7f4480104200 2024-04-25T13:44:02.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.788+0000 7f44777fe700 1 -- 172.21.15.43:0/2895245423 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447000f3c0 con 0x7f4480104200 2024-04-25T13:44:02.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.788+0000 7f448846d700 1 -- 172.21.15.43:0/2895245423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44801a2b30 con 0x7f4480104200 2024-04-25T13:44:02.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.789+0000 7f448846d700 1 -- 172.21.15.43:0/2895245423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4480051190 con 0x7f4480104200 2024-04-25T13:44:02.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.791+0000 7f44777fe700 1 -- 172.21.15.43:0/2895245423 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f4470019070 con 0x7f4480104200 2024-04-25T13:44:02.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.791+0000 7f44777fe700 1 --2- 172.21.15.43:0/2895245423 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f446c0afb80 0x7f446c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:02.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.791+0000 7f4486209700 1 --2- 172.21.15.43:0/2895245423 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f446c0afb80 0x7f446c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:02.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.791+0000 7f44777fe700 1 -- 172.21.15.43:0/2895245423 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f44700debc0 con 0x7f4480104200 2024-04-25T13:44:02.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.792+0000 7f4486209700 1 --2- 172.21.15.43:0/2895245423 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f446c0afb80 0x7f446c0b2090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f447c003820 tx=0x7f447c01a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:02.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:02.795+0000 7f44777fe700 1 -- 172.21.15.43:0/2895245423 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f44700a7420 con 0x7f4480104200 2024-04-25T13:44:03.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:03.023+0000 7f448846d700 1 -- 172.21.15.43:0/2895245423 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f4480100830 con 0x7f446c0afb80 2024-04-25T13:44:03.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:03.024+0000 7f44777fe700 1 -- 172.21.15.43:0/2895245423 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f4480100830 con 0x7f446c0afb80 2024-04-25T13:44:03.024 INFO:teuthology.orchestra.run.smithi043.stdout:Backend: cephadm 2024-04-25T13:44:03.024 INFO:teuthology.orchestra.run.smithi043.stdout:Available: Yes 2024-04-25T13:44:03.024 INFO:teuthology.orchestra.run.smithi043.stdout:Paused: No 2024-04-25T13:44:03.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:03.026+0000 7f448846d700 1 -- 172.21.15.43:0/2895245423 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f446c0afb80 msgr2=0x7f446c0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:03.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:03.026+0000 7f448846d700 1 --2- 172.21.15.43:0/2895245423 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f446c0afb80 0x7f446c0b2090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f447c003820 tx=0x7f447c01a040 comp rx=0 tx=0).stop 2024-04-25T13:44:03.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:03.026+0000 7f448846d700 1 -- 172.21.15.43:0/2895245423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4480104200 msgr2=0x7f448019ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:03.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:03.026+0000 7f448846d700 1 --2- 172.21.15.43:0/2895245423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4480104200 0x7f448019ac90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f447000d950 tx=0x7f447000dc60 comp rx=0 tx=0).stop 2024-04-25T13:44:03.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:03.026+0000 7f448846d700 1 -- 172.21.15.43:0/2895245423 shutdown_connections 2024-04-25T13:44:03.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:03.026+0000 7f448846d700 1 --2- 172.21.15.43:0/2895245423 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f446c0afb80 0x7f446c0b2090 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:03.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:03.026+0000 7f448846d700 1 --2- 172.21.15.43:0/2895245423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4480104ba0 0x7f44801a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:03.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:03.026+0000 7f448846d700 1 --2- 172.21.15.43:0/2895245423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44801030d0 0x7f448019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:03.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:03.026+0000 7f448846d700 1 --2- 172.21.15.43:0/2895245423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4480104200 0x7f448019ac90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:03.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:03.026+0000 7f448846d700 1 -- 172.21.15.43:0/2895245423 >> 172.21.15.43:0/2895245423 conn(0x7f44800fe730 msgr2=0x7f4480100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:03.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:03.026+0000 7f448846d700 1 -- 172.21.15.43:0/2895245423 shutdown_connections 2024-04-25T13:44:03.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:03.026+0000 7f448846d700 1 -- 172.21.15.43:0/2895245423 wait complete. 2024-04-25T13:44:03.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:03 smithi161 ceph-mon[32696]: pgmap v346: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 7 op/s 2024-04-25T13:44:03.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:03 smithi175 ceph-mon[32649]: pgmap v346: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 7 op/s 2024-04-25T13:44:03.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:03 smithi043 ceph-mon[29195]: pgmap v346: 129 pgs: 129 active+clean; 642 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 7 op/s 2024-04-25T13:44:04.062 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-25T13:44:04.315 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:44:04.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:04 smithi161 ceph-mon[32696]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:04.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:04 smithi175 ceph-mon[32649]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:04.436 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:04 smithi043 ceph-mon[29195]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:05.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:05 smithi161 ceph-mon[32696]: pgmap v347: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 639 B/s wr, 7 op/s; 13 B/s, 0 objects/s recovering 2024-04-25T13:44:05.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:05 smithi175 ceph-mon[32649]: pgmap v347: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 639 B/s wr, 7 op/s; 13 B/s, 0 objects/s recovering 2024-04-25T13:44:05.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:05 smithi043 ceph-mon[29195]: pgmap v347: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 639 B/s wr, 7 op/s; 13 B/s, 0 objects/s recovering 2024-04-25T13:44:06.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.348+0000 7ff4a4a63700 1 -- 172.21.15.43:0/1916518136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4a0104210 msgr2=0x7ff4a0104620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:06.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.348+0000 7ff4a4a63700 1 --2- 172.21.15.43:0/1916518136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4a0104210 0x7ff4a0104620 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff490009990 tx=0x7ff490009ca0 comp rx=0 tx=0).stop 2024-04-25T13:44:06.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.348+0000 7ff4a4a63700 1 -- 172.21.15.43:0/1916518136 shutdown_connections 2024-04-25T13:44:06.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.348+0000 7ff4a4a63700 1 --2- 172.21.15.43:0/1916518136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4a0105ce0 0x7ff4a010c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:06.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.348+0000 7ff4a4a63700 1 --2- 172.21.15.43:0/1916518136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4a0104210 0x7ff4a0104620 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:06.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.348+0000 7ff4a4a63700 1 --2- 172.21.15.43:0/1916518136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4a0105340 0x7ff4a0105750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:06.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.348+0000 7ff4a4a63700 1 -- 172.21.15.43:0/1916518136 >> 172.21.15.43:0/1916518136 conn(0x7ff4a00ff870 msgr2=0x7ff4a0101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:06.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.348+0000 7ff4a4a63700 1 -- 172.21.15.43:0/1916518136 shutdown_connections 2024-04-25T13:44:06.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.348+0000 7ff4a4a63700 1 -- 172.21.15.43:0/1916518136 wait complete. 2024-04-25T13:44:06.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.349+0000 7ff4a4a63700 1 Processor -- start 2024-04-25T13:44:06.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.349+0000 7ff4a4a63700 1 -- start start 2024-04-25T13:44:06.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.349+0000 7ff4a4a63700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4a0104210 0x7ff4a0078440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:06.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.349+0000 7ff4a4a63700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4a0105340 0x7ff4a0076af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:06.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.349+0000 7ff4a4a63700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4a0105ce0 0x7ff4a0077030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:06.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.349+0000 7ff4a4a63700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a010fb50 con 0x7ff4a0105340 2024-04-25T13:44:06.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.349+0000 7ff4a4a63700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a010f9d0 con 0x7ff4a0104210 2024-04-25T13:44:06.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.349+0000 7ff4a4a63700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a010fcd0 con 0x7ff4a0105ce0 2024-04-25T13:44:06.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.349+0000 7ff49e59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4a0104210 0x7ff4a0078440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:06.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.349+0000 7ff49dd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4a0105340 0x7ff4a0076af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:06.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.349+0000 7ff49e59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4a0104210 0x7ff4a0078440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.43:49326/0 (socket says 172.21.15.43:49326) 2024-04-25T13:44:06.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.349+0000 7ff49e59c700 1 -- 172.21.15.43:0/287105390 learned_addr learned my addr 172.21.15.43:0/287105390 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:06.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.350+0000 7ff49ed9d700 1 --2- 172.21.15.43:0/287105390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4a0105ce0 0x7ff4a0077030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:06.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.350+0000 7ff49dd9b700 1 -- 172.21.15.43:0/287105390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4a0105ce0 msgr2=0x7ff4a0077030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:06.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.350+0000 7ff49dd9b700 1 --2- 172.21.15.43:0/287105390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4a0105ce0 0x7ff4a0077030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:06.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.350+0000 7ff49dd9b700 1 -- 172.21.15.43:0/287105390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4a0104210 msgr2=0x7ff4a0078440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:06.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.350+0000 7ff49dd9b700 1 --2- 172.21.15.43:0/287105390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4a0104210 0x7ff4a0078440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:06.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.350+0000 7ff49dd9b700 1 -- 172.21.15.43:0/287105390 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a0077790 con 0x7ff4a0105340 2024-04-25T13:44:06.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.350+0000 7ff49dd9b700 1 --2- 172.21.15.43:0/287105390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4a0105340 0x7ff4a0076af0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff49400d950 tx=0x7ff49400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:06.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.350+0000 7ff48f7fe700 1 -- 172.21.15.43:0/287105390 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494017070 con 0x7ff4a0105340 2024-04-25T13:44:06.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.350+0000 7ff48f7fe700 1 -- 172.21.15.43:0/287105390 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff494009dc0 con 0x7ff4a0105340 2024-04-25T13:44:06.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.350+0000 7ff4a4a63700 1 -- 172.21.15.43:0/287105390 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a01a48b0 con 0x7ff4a0105340 2024-04-25T13:44:06.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.350+0000 7ff48f7fe700 1 -- 172.21.15.43:0/287105390 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494010cd0 con 0x7ff4a0105340 2024-04-25T13:44:06.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.350+0000 7ff4a4a63700 1 -- 172.21.15.43:0/287105390 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a01a4d90 con 0x7ff4a0105340 2024-04-25T13:44:06.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.351+0000 7ff4a4a63700 1 -- 172.21.15.43:0/287105390 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a0051190 con 0x7ff4a0105340 2024-04-25T13:44:06.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.353+0000 7ff48f7fe700 1 -- 172.21.15.43:0/287105390 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7ff49401a070 con 0x7ff4a0105340 2024-04-25T13:44:06.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.353+0000 7ff48f7fe700 1 --2- 172.21.15.43:0/287105390 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff4880afb80 0x7ff4880b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:06.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.353+0000 7ff49e59c700 1 --2- 172.21.15.43:0/287105390 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff4880afb80 0x7ff4880b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:06.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.353+0000 7ff48f7fe700 1 -- 172.21.15.43:0/287105390 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7ff4940de990 con 0x7ff4a0105340 2024-04-25T13:44:06.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.354+0000 7ff49e59c700 1 --2- 172.21.15.43:0/287105390 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff4880afb80 0x7ff4880b2090 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff49000b5c0 tx=0x7ff49001a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:06.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.357+0000 7ff48f7fe700 1 -- 172.21.15.43:0/287105390 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff4940a71f0 con 0x7ff4a0105340 2024-04-25T13:44:06.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.574+0000 7ff4a4a63700 1 -- 172.21.15.43:0/287105390 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff4a0063ad0 con 0x7ff4880afb80 2024-04-25T13:44:06.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.588+0000 7ff48f7fe700 1 -- 172.21.15.43:0/287105390 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7ff4a0063ad0 con 0x7ff4880afb80 2024-04-25T13:44:06.589 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T13:44:06.589 INFO:teuthology.orchestra.run.smithi043.stdout:mds.a smithi043 running (2m) 20s ago 2m 81.2M - 19.0.0-3291-g994e2f20 d53c96779a29 2f7c26f4bdf0 2024-04-25T13:44:06.589 INFO:teuthology.orchestra.run.smithi043.stdout:mds.b smithi161 running (2m) 57s ago 2m 96.1M - 19.0.0-3291-g994e2f20 d53c96779a29 86b9b2d52162 2024-04-25T13:44:06.589 INFO:teuthology.orchestra.run.smithi043.stdout:mds.c smithi175 running (2m) 57s ago 2m 83.7M - 19.0.0-3291-g994e2f20 d53c96779a29 d610ee93c025 2024-04-25T13:44:06.589 INFO:teuthology.orchestra.run.smithi043.stdout:mds.d smithi043 running (2m) 20s ago 2m 80.8M - 19.0.0-3291-g994e2f20 d53c96779a29 021c444aa038 2024-04-25T13:44:06.589 INFO:teuthology.orchestra.run.smithi043.stdout:mds.e smithi161 running (2m) 57s ago 2m 83.1M - 19.0.0-3291-g994e2f20 d53c96779a29 10ebf54f1286 2024-04-25T13:44:06.589 INFO:teuthology.orchestra.run.smithi043.stdout:mds.f smithi175 running (2m) 57s ago 2m 85.0M - 19.0.0-3291-g994e2f20 d53c96779a29 3e9f9d20bd7c 2024-04-25T13:44:06.590 INFO:teuthology.orchestra.run.smithi043.stdout:mds.g smithi043 running (2m) 20s ago 2m 81.7M - 19.0.0-3291-g994e2f20 d53c96779a29 4921775bc5ab 2024-04-25T13:44:06.590 INFO:teuthology.orchestra.run.smithi043.stdout:mds.h smithi161 running (2m) 57s ago 2m 85.1M - 19.0.0-3291-g994e2f20 d53c96779a29 a7774c163592 2024-04-25T13:44:06.590 INFO:teuthology.orchestra.run.smithi043.stdout:mds.i smithi175 running (2m) 57s ago 2m 84.7M - 19.0.0-3291-g994e2f20 d53c96779a29 62894fc2b3e9 2024-04-25T13:44:06.590 INFO:teuthology.orchestra.run.smithi043.stdout:mds.j smithi043 running (2m) 20s ago 2m 83.7M - 19.0.0-3291-g994e2f20 d53c96779a29 ed5e607ea94a 2024-04-25T13:44:06.590 INFO:teuthology.orchestra.run.smithi043.stdout:mds.k smithi161 running (2m) 57s ago 2m 83.2M - 19.0.0-3291-g994e2f20 d53c96779a29 494c77886a81 2024-04-25T13:44:06.590 INFO:teuthology.orchestra.run.smithi043.stdout:mds.l smithi175 running (2m) 57s ago 2m 83.9M - 19.0.0-3291-g994e2f20 d53c96779a29 74aee0675832 2024-04-25T13:44:06.590 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.x smithi043 *:9283,8765 running (10m) 20s ago 10m 586M - 19.0.0-3291-g994e2f20 d53c96779a29 e53013c69ed7 2024-04-25T13:44:06.590 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.y smithi161 *:8443,8765 running (7m) 57s ago 7m 522M - 19.0.0-3291-g994e2f20 d53c96779a29 82c31b9b38fb 2024-04-25T13:44:06.590 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.z smithi175 *:8443,8765 running (7m) 57s ago 7m 519M - 19.0.0-3291-g994e2f20 d53c96779a29 9fc3d5ee637a 2024-04-25T13:44:06.590 INFO:teuthology.orchestra.run.smithi043.stdout:mon.a smithi043 running (10m) 20s ago 10m 118M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 7b328ba06618 2024-04-25T13:44:06.590 INFO:teuthology.orchestra.run.smithi043.stdout:mon.b smithi161 running (8m) 57s ago 8m 105M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 14956c53ff8c 2024-04-25T13:44:06.590 INFO:teuthology.orchestra.run.smithi043.stdout:mon.c smithi175 running (8m) 57s ago 8m 109M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 e114fb4bd2be 2024-04-25T13:44:06.590 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (7m) 20s ago 7m 122M 4273M 19.0.0-3291-g994e2f20 d53c96779a29 b8ac860d9b6c 2024-04-25T13:44:06.591 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi161 running (7m) 57s ago 7m 120M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 24b92d2c19f1 2024-04-25T13:44:06.591 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi175 running (6m) 57s ago 6m 112M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 568b274f1b6b 2024-04-25T13:44:06.591 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi043 running (6m) 20s ago 6m 111M 4273M 19.0.0-3291-g994e2f20 d53c96779a29 d45a644223d4 2024-04-25T13:44:06.591 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi161 running (5m) 57s ago 5m 110M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 a7bae7bcbf2c 2024-04-25T13:44:06.591 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi175 running (5m) 57s ago 5m 122M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 a42309889fb3 2024-04-25T13:44:06.591 INFO:teuthology.orchestra.run.smithi043.stdout:osd.6 smithi043 running (5m) 20s ago 5m 118M 4273M 19.0.0-3291-g994e2f20 d53c96779a29 59845db09814 2024-04-25T13:44:06.591 INFO:teuthology.orchestra.run.smithi043.stdout:osd.7 smithi161 running (4m) 57s ago 4m 109M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 9320861af33d 2024-04-25T13:44:06.591 INFO:teuthology.orchestra.run.smithi043.stdout:osd.8 smithi175 running (4m) 57s ago 4m 110M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 31dc633df15e 2024-04-25T13:44:06.591 INFO:teuthology.orchestra.run.smithi043.stdout:osd.9 smithi043 running (3m) 20s ago 3m 117M 4273M 19.0.0-3291-g994e2f20 d53c96779a29 8b5a23d664ad 2024-04-25T13:44:06.591 INFO:teuthology.orchestra.run.smithi043.stdout:osd.10 smithi161 running (3m) 57s ago 3m 119M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 a97233b2df9a 2024-04-25T13:44:06.591 INFO:teuthology.orchestra.run.smithi043.stdout:osd.11 smithi175 running (2m) 57s ago 2m 117M 4272M 19.0.0-3291-g994e2f20 d53c96779a29 36c60b97fd89 2024-04-25T13:44:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.590+0000 7ff4a4a63700 1 -- 172.21.15.43:0/287105390 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff4880afb80 msgr2=0x7ff4880b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.590+0000 7ff4a4a63700 1 --2- 172.21.15.43:0/287105390 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff4880afb80 0x7ff4880b2090 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff49000b5c0 tx=0x7ff49001a040 comp rx=0 tx=0).stop 2024-04-25T13:44:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.590+0000 7ff4a4a63700 1 -- 172.21.15.43:0/287105390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4a0105340 msgr2=0x7ff4a0076af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.590+0000 7ff4a4a63700 1 --2- 172.21.15.43:0/287105390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4a0105340 0x7ff4a0076af0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff49400d950 tx=0x7ff49400dc60 comp rx=0 tx=0).stop 2024-04-25T13:44:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.590+0000 7ff4a4a63700 1 -- 172.21.15.43:0/287105390 shutdown_connections 2024-04-25T13:44:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.590+0000 7ff4a4a63700 1 --2- 172.21.15.43:0/287105390 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff4880afb80 0x7ff4880b2090 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.590+0000 7ff4a4a63700 1 --2- 172.21.15.43:0/287105390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4a0105ce0 0x7ff4a0077030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:06.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.590+0000 7ff4a4a63700 1 --2- 172.21.15.43:0/287105390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4a0104210 0x7ff4a0078440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:06.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.590+0000 7ff4a4a63700 1 --2- 172.21.15.43:0/287105390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4a0105340 0x7ff4a0076af0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:06.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.590+0000 7ff4a4a63700 1 -- 172.21.15.43:0/287105390 >> 172.21.15.43:0/287105390 conn(0x7ff4a00ff870 msgr2=0x7ff4a0108570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:06.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.590+0000 7ff4a4a63700 1 -- 172.21.15.43:0/287105390 shutdown_connections 2024-04-25T13:44:06.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:06.590+0000 7ff4a4a63700 1 -- 172.21.15.43:0/287105390 wait complete. 2024-04-25T13:44:07.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:07 smithi043 ceph-mon[29195]: pgmap v348: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 639 B/s wr, 5 op/s; 13 B/s, 0 objects/s recovering 2024-04-25T13:44:07.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:07 smithi043 ceph-mon[29195]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:07.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:07 smithi161 ceph-mon[32696]: pgmap v348: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 639 B/s wr, 5 op/s; 13 B/s, 0 objects/s recovering 2024-04-25T13:44:07.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:07 smithi161 ceph-mon[32696]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:07.392 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-25T13:44:07.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:07 smithi175 ceph-mon[32649]: pgmap v348: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 639 B/s wr, 5 op/s; 13 B/s, 0 objects/s recovering 2024-04-25T13:44:07.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:07 smithi175 ceph-mon[32649]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:07.647 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:44:09.192 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:09 smithi043 ceph-mon[29195]: pgmap v349: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 574 B/s wr, 7 op/s; 12 B/s, 0 objects/s recovering 2024-04-25T13:44:09.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:09 smithi161 ceph-mon[32696]: pgmap v349: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 574 B/s wr, 7 op/s; 12 B/s, 0 objects/s recovering 2024-04-25T13:44:09.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:09 smithi175 ceph-mon[32649]: pgmap v349: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 574 B/s wr, 7 op/s; 12 B/s, 0 objects/s recovering 2024-04-25T13:44:09.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.443+0000 7f0d4283c700 1 -- 172.21.15.43:0/781343554 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3c06c160 msgr2=0x7f0d3c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:09.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.443+0000 7f0d4283c700 1 --2- 172.21.15.43:0/781343554 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3c06c160 0x7f0d3c106d90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009990 tx=0x7f0d2c009ca0 comp rx=0 tx=0).stop 2024-04-25T13:44:09.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.443+0000 7f0d4283c700 1 -- 172.21.15.43:0/781343554 shutdown_connections 2024-04-25T13:44:09.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.443+0000 7f0d4283c700 1 --2- 172.21.15.43:0/781343554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d3c109e90 0x7f0d3c10c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:09.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.443+0000 7f0d4283c700 1 --2- 172.21.15.43:0/781343554 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3c06c160 0x7f0d3c106d90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:09.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.443+0000 7f0d4283c700 1 --2- 172.21.15.43:0/781343554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d3c107360 0x7f0d3c109800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:09.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.443+0000 7f0d4283c700 1 -- 172.21.15.43:0/781343554 >> 172.21.15.43:0/781343554 conn(0x7f0d3c0fe740 msgr2=0x7f0d3c100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:09.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.443+0000 7f0d4283c700 1 -- 172.21.15.43:0/781343554 shutdown_connections 2024-04-25T13:44:09.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.443+0000 7f0d4283c700 1 -- 172.21.15.43:0/781343554 wait complete. 2024-04-25T13:44:09.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.444+0000 7f0d4283c700 1 Processor -- start 2024-04-25T13:44:09.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.444+0000 7f0d4283c700 1 -- start start 2024-04-25T13:44:09.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.444+0000 7f0d4283c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3c06c160 0x7f0d3c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:09.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.444+0000 7f0d4283c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d3c107360 0x7f0d3c19ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:09.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.444+0000 7f0d4283c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d3c109e90 0x7f0d3c1a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:09.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.444+0000 7f0d4283c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c10fb20 con 0x7f0d3c06c160 2024-04-25T13:44:09.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.444+0000 7f0d4283c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c10f9a0 con 0x7f0d3c107360 2024-04-25T13:44:09.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.444+0000 7f0d4283c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c10fca0 con 0x7f0d3c109e90 2024-04-25T13:44:09.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.444+0000 7f0d3bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3c06c160 0x7f0d3c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:09.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.444+0000 7f0d3bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3c06c160 0x7f0d3c19a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60636/0 (socket says 172.21.15.43:60636) 2024-04-25T13:44:09.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.444+0000 7f0d3bfff700 1 -- 172.21.15.43:0/90866820 learned_addr learned my addr 172.21.15.43:0/90866820 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:09.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.444+0000 7f0d3b7fe700 1 --2- 172.21.15.43:0/90866820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d3c107360 0x7f0d3c19ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:09.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.445+0000 7f0d40dd9700 1 --2- 172.21.15.43:0/90866820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d3c109e90 0x7f0d3c1a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:09.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.445+0000 7f0d3bfff700 1 -- 172.21.15.43:0/90866820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d3c109e90 msgr2=0x7f0d3c1a1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:09.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.445+0000 7f0d3bfff700 1 --2- 172.21.15.43:0/90866820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d3c109e90 0x7f0d3c1a1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:09.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.445+0000 7f0d3bfff700 1 -- 172.21.15.43:0/90866820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d3c107360 msgr2=0x7f0d3c19ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:09.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.445+0000 7f0d3bfff700 1 --2- 172.21.15.43:0/90866820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d3c107360 0x7f0d3c19ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:09.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.445+0000 7f0d3bfff700 1 -- 172.21.15.43:0/90866820 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c1a21d0 con 0x7f0d3c06c160 2024-04-25T13:44:09.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.445+0000 7f0d3bfff700 1 --2- 172.21.15.43:0/90866820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3c06c160 0x7f0d3c19a700 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c003820 tx=0x7f0d2c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:09.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.445+0000 7f0d397fa700 1 -- 172.21.15.43:0/90866820 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c026070 con 0x7f0d3c06c160 2024-04-25T13:44:09.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.445+0000 7f0d4283c700 1 -- 172.21.15.43:0/90866820 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d3c1a2460 con 0x7f0d3c06c160 2024-04-25T13:44:09.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.445+0000 7f0d4283c700 1 -- 172.21.15.43:0/90866820 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d3c1a2910 con 0x7f0d3c06c160 2024-04-25T13:44:09.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.445+0000 7f0d397fa700 1 -- 172.21.15.43:0/90866820 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d2c003f60 con 0x7f0d3c06c160 2024-04-25T13:44:09.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.445+0000 7f0d397fa700 1 -- 172.21.15.43:0/90866820 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c00fcd0 con 0x7f0d3c06c160 2024-04-25T13:44:09.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.446+0000 7f0d4283c700 1 -- 172.21.15.43:0/90866820 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d3c051190 con 0x7f0d3c06c160 2024-04-25T13:44:09.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.448+0000 7f0d397fa700 1 -- 172.21.15.43:0/90866820 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f0d2c029070 con 0x7f0d3c06c160 2024-04-25T13:44:09.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.449+0000 7f0d397fa700 1 --2- 172.21.15.43:0/90866820 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0d240afc00 0x7f0d240b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:09.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.449+0000 7f0d3b7fe700 1 --2- 172.21.15.43:0/90866820 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0d240afc00 0x7f0d240b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:09.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.449+0000 7f0d397fa700 1 -- 172.21.15.43:0/90866820 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f0d2c0e00e0 con 0x7f0d3c06c160 2024-04-25T13:44:09.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.449+0000 7f0d3b7fe700 1 --2- 172.21.15.43:0/90866820 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0d240afc00 0x7f0d240b2110 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c19b7b0 tx=0x7f0d3000a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:09.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.452+0000 7f0d397fa700 1 -- 172.21.15.43:0/90866820 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0d2c013070 con 0x7f0d3c06c160 2024-04-25T13:44:09.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.668+0000 7f0d4283c700 1 -- 172.21.15.43:0/90866820 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f0d3c063ad0 con 0x7f0d240afc00 2024-04-25T13:44:09.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.674+0000 7f0d397fa700 1 -- 172.21.15.43:0/90866820 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f0d3c063ad0 con 0x7f0d240afc00 2024-04-25T13:44:09.674 INFO:teuthology.orchestra.run.smithi043.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-25T13:44:09.674 INFO:teuthology.orchestra.run.smithi043.stdout:mds.all 12/12 61s ago 2m smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi161=b;smithi161=e;smithi161=h;smithi161=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-04-25T13:44:09.675 INFO:teuthology.orchestra.run.smithi043.stdout:mgr 3/3 61s ago 8m smithi043=x;smithi161=y;smithi175=z;count:3 2024-04-25T13:44:09.675 INFO:teuthology.orchestra.run.smithi043.stdout:mon 3/3 61s ago 8m smithi043:172.21.15.43=a;smithi161:172.21.15.161=b;smithi175:172.21.15.175=c;count:3 2024-04-25T13:44:09.675 INFO:teuthology.orchestra.run.smithi043.stdout:osd 12 61s ago - 2024-04-25T13:44:09.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.677+0000 7f0d4283c700 1 -- 172.21.15.43:0/90866820 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0d240afc00 msgr2=0x7f0d240b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:09.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.677+0000 7f0d4283c700 1 --2- 172.21.15.43:0/90866820 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0d240afc00 0x7f0d240b2110 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c19b7b0 tx=0x7f0d3000a380 comp rx=0 tx=0).stop 2024-04-25T13:44:09.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.677+0000 7f0d4283c700 1 -- 172.21.15.43:0/90866820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3c06c160 msgr2=0x7f0d3c19a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:09.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.677+0000 7f0d4283c700 1 --2- 172.21.15.43:0/90866820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3c06c160 0x7f0d3c19a700 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c003820 tx=0x7f0d2c0047b0 comp rx=0 tx=0).stop 2024-04-25T13:44:09.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.677+0000 7f0d4283c700 1 -- 172.21.15.43:0/90866820 shutdown_connections 2024-04-25T13:44:09.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.677+0000 7f0d4283c700 1 --2- 172.21.15.43:0/90866820 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f0d240afc00 0x7f0d240b2110 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:09.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.677+0000 7f0d4283c700 1 --2- 172.21.15.43:0/90866820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d3c109e90 0x7f0d3c1a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:09.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.677+0000 7f0d4283c700 1 --2- 172.21.15.43:0/90866820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3c06c160 0x7f0d3c19a700 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:09.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.677+0000 7f0d4283c700 1 --2- 172.21.15.43:0/90866820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d3c107360 0x7f0d3c19ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:09.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.677+0000 7f0d4283c700 1 -- 172.21.15.43:0/90866820 >> 172.21.15.43:0/90866820 conn(0x7f0d3c0fe740 msgr2=0x7f0d3c1055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:09.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.677+0000 7f0d4283c700 1 -- 172.21.15.43:0/90866820 shutdown_connections 2024-04-25T13:44:09.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:09.677+0000 7f0d4283c700 1 -- 172.21.15.43:0/90866820 wait complete. 2024-04-25T13:44:10.330 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:10 smithi043 ceph-mon[29195]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:10.332 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-25T13:44:10.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:10 smithi161 ceph-mon[32696]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:10.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:10 smithi175 ceph-mon[32649]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:10.583 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:44:11.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:11 smithi161 ceph-mon[32696]: pgmap v350: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 409 B/s wr, 6 op/s; 11 B/s, 0 objects/s recovering 2024-04-25T13:44:11.389 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:11 smithi043 ceph-mon[29195]: pgmap v350: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 409 B/s wr, 6 op/s; 11 B/s, 0 objects/s recovering 2024-04-25T13:44:11.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:11 smithi175 ceph-mon[32649]: pgmap v350: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 409 B/s wr, 6 op/s; 11 B/s, 0 objects/s recovering 2024-04-25T13:44:12.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.213+0000 7f65cc9bb700 1 -- 172.21.15.43:0/4235521949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c8104be0 msgr2=0x7f65c810b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:12.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.213+0000 7f65cc9bb700 1 --2- 172.21.15.43:0/4235521949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c8104be0 0x7f65c810b670 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f65c000b0a0 tx=0x7f65c000b3b0 comp rx=0 tx=0).stop 2024-04-25T13:44:12.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.213+0000 7f65cc9bb700 1 -- 172.21.15.43:0/4235521949 shutdown_connections 2024-04-25T13:44:12.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.213+0000 7f65cc9bb700 1 --2- 172.21.15.43:0/4235521949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c8104be0 0x7f65c810b670 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:12.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.213+0000 7f65cc9bb700 1 --2- 172.21.15.43:0/4235521949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c81036a0 0x7f65c8103ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:12.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.213+0000 7f65cc9bb700 1 --2- 172.21.15.43:0/4235521949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65c8104080 0x7f65c8104550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:12.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.213+0000 7f65cc9bb700 1 -- 172.21.15.43:0/4235521949 >> 172.21.15.43:0/4235521949 conn(0x7f65c80fdef0 msgr2=0x7f65c81003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:12.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.213+0000 7f65cc9bb700 1 -- 172.21.15.43:0/4235521949 shutdown_connections 2024-04-25T13:44:12.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.213+0000 7f65cc9bb700 1 -- 172.21.15.43:0/4235521949 wait complete. 2024-04-25T13:44:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.214+0000 7f65cc9bb700 1 Processor -- start 2024-04-25T13:44:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.214+0000 7f65cc9bb700 1 -- start start 2024-04-25T13:44:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.214+0000 7f65cc9bb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c81036a0 0x7f65c819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.214+0000 7f65cc9bb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c8104080 0x7f65c819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.214+0000 7f65cc9bb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65c8104be0 0x7f65c81a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.214+0000 7f65cc9bb700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f65c810ea40 con 0x7f65c8104080 2024-04-25T13:44:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.214+0000 7f65cc9bb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f65c810e8c0 con 0x7f65c81036a0 2024-04-25T13:44:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.214+0000 7f65cc9bb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f65c810ebc0 con 0x7f65c8104be0 2024-04-25T13:44:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.214+0000 7f65c5d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c8104080 0x7f65c819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.214+0000 7f65c5d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c8104080 0x7f65c819abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43208/0 (socket says 172.21.15.43:43208) 2024-04-25T13:44:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.214+0000 7f65c5d9b700 1 -- 172.21.15.43:0/1870493104 learned_addr learned my addr 172.21.15.43:0/1870493104 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.214+0000 7f65c659c700 1 --2- 172.21.15.43:0/1870493104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c81036a0 0x7f65c819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.214+0000 7f65c6d9d700 1 --2- 172.21.15.43:0/1870493104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65c8104be0 0x7f65c81a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.215+0000 7f65c5d9b700 1 -- 172.21.15.43:0/1870493104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65c8104be0 msgr2=0x7f65c81a1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.215+0000 7f65c5d9b700 1 --2- 172.21.15.43:0/1870493104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65c8104be0 0x7f65c81a1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.215+0000 7f65c5d9b700 1 -- 172.21.15.43:0/1870493104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c81036a0 msgr2=0x7f65c819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.215+0000 7f65c5d9b700 1 --2- 172.21.15.43:0/1870493104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c81036a0 0x7f65c819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.215+0000 7f65c5d9b700 1 -- 172.21.15.43:0/1870493104 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c81a21e0 con 0x7f65c8104080 2024-04-25T13:44:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.215+0000 7f65c5d9b700 1 --2- 172.21.15.43:0/1870493104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c8104080 0x7f65c819abc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00c920 tx=0x7f65bc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.215+0000 7f65b77fe700 1 -- 172.21.15.43:0/1870493104 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc007b00 con 0x7f65c8104080 2024-04-25T13:44:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.215+0000 7f65b77fe700 1 -- 172.21.15.43:0/1870493104 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65bc004cc0 con 0x7f65c8104080 2024-04-25T13:44:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.215+0000 7f65cc9bb700 1 -- 172.21.15.43:0/1870493104 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c81a24d0 con 0x7f65c8104080 2024-04-25T13:44:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.215+0000 7f65b77fe700 1 -- 172.21.15.43:0/1870493104 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc005440 con 0x7f65c8104080 2024-04-25T13:44:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.215+0000 7f65cc9bb700 1 -- 172.21.15.43:0/1870493104 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65c81a2a60 con 0x7f65c8104080 2024-04-25T13:44:12.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.216+0000 7f65cc9bb700 1 -- 172.21.15.43:0/1870493104 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65c8051190 con 0x7f65c8104080 2024-04-25T13:44:12.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.218+0000 7f65b77fe700 1 -- 172.21.15.43:0/1870493104 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f65bc004750 con 0x7f65c8104080 2024-04-25T13:44:12.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.218+0000 7f65b77fe700 1 --2- 172.21.15.43:0/1870493104 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f65b00afc00 0x7f65b00b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:12.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.218+0000 7f65b77fe700 1 -- 172.21.15.43:0/1870493104 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f65bc0deea0 con 0x7f65c8104080 2024-04-25T13:44:12.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.218+0000 7f65c659c700 1 --2- 172.21.15.43:0/1870493104 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f65b00afc00 0x7f65b00b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:12.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.219+0000 7f65c659c700 1 --2- 172.21.15.43:0/1870493104 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f65b00afc00 0x7f65b00b2110 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f65b8005950 tx=0x7f65b800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.222+0000 7f65b77fe700 1 -- 172.21.15.43:0/1870493104 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f65bc014030 con 0x7f65c8104080 2024-04-25T13:44:12.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.438+0000 7f65cc9bb700 1 -- 172.21.15.43:0/1870493104 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f65c81a2d20 con 0x7f65b00afc00 2024-04-25T13:44:12.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.440+0000 7f65b77fe700 1 -- 172.21.15.43:0/1870493104 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f65c81a2d20 con 0x7f65b00afc00 2024-04-25T13:44:12.439 INFO:teuthology.orchestra.run.smithi043.stdout:HOST ADDR LABELS STATUS 2024-04-25T13:44:12.440 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043 172.21.15.43 2024-04-25T13:44:12.440 INFO:teuthology.orchestra.run.smithi043.stdout:smithi161 172.21.15.161 2024-04-25T13:44:12.440 INFO:teuthology.orchestra.run.smithi043.stdout:smithi175 172.21.15.175 2024-04-25T13:44:12.440 INFO:teuthology.orchestra.run.smithi043.stdout:3 hosts in cluster 2024-04-25T13:44:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.442+0000 7f65cc9bb700 1 -- 172.21.15.43:0/1870493104 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f65b00afc00 msgr2=0x7f65b00b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.442+0000 7f65cc9bb700 1 --2- 172.21.15.43:0/1870493104 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f65b00afc00 0x7f65b00b2110 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f65b8005950 tx=0x7f65b800b410 comp rx=0 tx=0).stop 2024-04-25T13:44:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.442+0000 7f65cc9bb700 1 -- 172.21.15.43:0/1870493104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c8104080 msgr2=0x7f65c819abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.442+0000 7f65cc9bb700 1 --2- 172.21.15.43:0/1870493104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c8104080 0x7f65c819abc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00c920 tx=0x7f65bc00cc30 comp rx=0 tx=0).stop 2024-04-25T13:44:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.442+0000 7f65cc9bb700 1 -- 172.21.15.43:0/1870493104 shutdown_connections 2024-04-25T13:44:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.442+0000 7f65cc9bb700 1 --2- 172.21.15.43:0/1870493104 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f65b00afc00 0x7f65b00b2110 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.442+0000 7f65cc9bb700 1 --2- 172.21.15.43:0/1870493104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65c8104be0 0x7f65c81a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.442+0000 7f65cc9bb700 1 --2- 172.21.15.43:0/1870493104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c81036a0 0x7f65c819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.442+0000 7f65cc9bb700 1 --2- 172.21.15.43:0/1870493104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65c8104080 0x7f65c819abc0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.442+0000 7f65cc9bb700 1 -- 172.21.15.43:0/1870493104 >> 172.21.15.43:0/1870493104 conn(0x7f65c80fdef0 msgr2=0x7f65c80ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.442+0000 7f65cc9bb700 1 -- 172.21.15.43:0/1870493104 shutdown_connections 2024-04-25T13:44:12.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:12.442+0000 7f65cc9bb700 1 -- 172.21.15.43:0/1870493104 wait complete. 2024-04-25T13:44:13.230 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-25T13:44:13.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:13 smithi161 ceph-mon[32696]: pgmap v351: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 343 B/s wr, 6 op/s; 9 B/s, 0 objects/s recovering 2024-04-25T13:44:13.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:13 smithi161 ceph-mon[32696]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:13.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:13 smithi175 ceph-mon[32649]: pgmap v351: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 343 B/s wr, 6 op/s; 9 B/s, 0 objects/s recovering 2024-04-25T13:44:13.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:13 smithi175 ceph-mon[32649]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:13.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:13 smithi043 ceph-mon[29195]: pgmap v351: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 343 B/s wr, 6 op/s; 9 B/s, 0 objects/s recovering 2024-04-25T13:44:13.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:13 smithi043 ceph-mon[29195]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:13.485 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:44:15.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.164+0000 7f6bd8eb9700 1 -- 172.21.15.43:0/763747719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bd4109fd0 msgr2=0x7f6bd410c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:15.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.164+0000 7f6bd8eb9700 1 --2- 172.21.15.43:0/763747719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bd4109fd0 0x7f6bd410c3f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00b0a0 tx=0x7f6bcc00b3b0 comp rx=0 tx=0).stop 2024-04-25T13:44:15.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.164+0000 7f6bd8eb9700 1 -- 172.21.15.43:0/763747719 shutdown_connections 2024-04-25T13:44:15.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.164+0000 7f6bd8eb9700 1 --2- 172.21.15.43:0/763747719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bd4109fd0 0x7f6bd410c3f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:15.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.164+0000 7f6bd8eb9700 1 --2- 172.21.15.43:0/763747719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd4104d10 0x7f6bd4107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:15.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.164+0000 7f6bd8eb9700 1 --2- 172.21.15.43:0/763747719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd4107670 0x7f6bd4109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:15.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.164+0000 7f6bd8eb9700 1 -- 172.21.15.43:0/763747719 >> 172.21.15.43:0/763747719 conn(0x7f6bd40fe750 msgr2=0x7f6bd4100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:15.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.164+0000 7f6bd8eb9700 1 -- 172.21.15.43:0/763747719 shutdown_connections 2024-04-25T13:44:15.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.164+0000 7f6bd8eb9700 1 -- 172.21.15.43:0/763747719 wait complete. 2024-04-25T13:44:15.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.165+0000 7f6bd8eb9700 1 Processor -- start 2024-04-25T13:44:15.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd8eb9700 1 -- start start 2024-04-25T13:44:15.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd8eb9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd4104d10 0x7f6bd419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:15.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd8eb9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bd4107670 0x7f6bd419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:15.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd8eb9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd4109fd0 0x7f6bd41a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:15.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd8eb9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd410fb10 con 0x7f6bd4107670 2024-04-25T13:44:15.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd8eb9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd410f990 con 0x7f6bd4109fd0 2024-04-25T13:44:15.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd8eb9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd410fc90 con 0x7f6bd4104d10 2024-04-25T13:44:15.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd1d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bd4107670 0x7f6bd419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:15.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd1d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bd4107670 0x7f6bd419ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43222/0 (socket says 172.21.15.43:43222) 2024-04-25T13:44:15.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd1d9b700 1 -- 172.21.15.43:0/3152178530 learned_addr learned my addr 172.21.15.43:0/3152178530 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:15.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd259c700 1 --2- 172.21.15.43:0/3152178530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd4104d10 0x7f6bd419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:15.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd2d9d700 1 --2- 172.21.15.43:0/3152178530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd4109fd0 0x7f6bd41a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:15.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd1d9b700 1 -- 172.21.15.43:0/3152178530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd4104d10 msgr2=0x7f6bd419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:15.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd1d9b700 1 --2- 172.21.15.43:0/3152178530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd4104d10 0x7f6bd419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:15.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd1d9b700 1 -- 172.21.15.43:0/3152178530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd4109fd0 msgr2=0x7f6bd41a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:15.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd1d9b700 1 --2- 172.21.15.43:0/3152178530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd4109fd0 0x7f6bd41a1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:15.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.166+0000 7f6bd1d9b700 1 -- 172.21.15.43:0/3152178530 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd41a21b0 con 0x7f6bd4107670 2024-04-25T13:44:15.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.167+0000 7f6bd1d9b700 1 --2- 172.21.15.43:0/3152178530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bd4107670 0x7f6bd419ab90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800d980 tx=0x7f6bc800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:15.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.167+0000 7f6bc37fe700 1 -- 172.21.15.43:0/3152178530 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8016070 con 0x7f6bd4107670 2024-04-25T13:44:15.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.167+0000 7f6bd8eb9700 1 -- 172.21.15.43:0/3152178530 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd41a24a0 con 0x7f6bd4107670 2024-04-25T13:44:15.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.167+0000 7f6bc37fe700 1 -- 172.21.15.43:0/3152178530 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bc8004830 con 0x7f6bd4107670 2024-04-25T13:44:15.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.167+0000 7f6bc37fe700 1 -- 172.21.15.43:0/3152178530 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc80054c0 con 0x7f6bd4107670 2024-04-25T13:44:15.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.167+0000 7f6bd8eb9700 1 -- 172.21.15.43:0/3152178530 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd41a29e0 con 0x7f6bd4107670 2024-04-25T13:44:15.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.168+0000 7f6bd8eb9700 1 -- 172.21.15.43:0/3152178530 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bd4051190 con 0x7f6bd4107670 2024-04-25T13:44:15.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.169+0000 7f6bc37fe700 1 -- 172.21.15.43:0/3152178530 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f6bc8004220 con 0x7f6bd4107670 2024-04-25T13:44:15.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.170+0000 7f6bc37fe700 1 --2- 172.21.15.43:0/3152178530 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6bbc0afb80 0x7f6bbc0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:15.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.170+0000 7f6bd259c700 1 --2- 172.21.15.43:0/3152178530 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6bbc0afb80 0x7f6bbc0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:15.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.170+0000 7f6bc37fe700 1 -- 172.21.15.43:0/3152178530 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f6bc80ded30 con 0x7f6bd4107670 2024-04-25T13:44:15.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.171+0000 7f6bd259c700 1 --2- 172.21.15.43:0/3152178530 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6bbc0afb80 0x7f6bbc0b2090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4005950 tx=0x7f6bc400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:15.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.175+0000 7f6bc37fe700 1 -- 172.21.15.43:0/3152178530 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6bc801f020 con 0x7f6bd4107670 2024-04-25T13:44:15.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:15 smithi043 ceph-mon[29195]: pgmap v352: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 9 B/s, 0 objects/s recovering 2024-04-25T13:44:15.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:15 smithi161 ceph-mon[32696]: pgmap v352: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 9 B/s, 0 objects/s recovering 2024-04-25T13:44:15.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.393+0000 7f6bd8eb9700 1 -- 172.21.15.43:0/3152178530 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f6bd4063ad0 con 0x7f6bbc0afb80 2024-04-25T13:44:15.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.395+0000 7f6bc37fe700 1 -- 172.21.15.43:0/3152178530 <== mgr.14150 v2:172.21.15.43:6800/2478639579 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f6bd4063ad0 con 0x7f6bbc0afb80 2024-04-25T13:44:15.395 INFO:teuthology.orchestra.run.smithi043.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-25T13:44:15.395 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300GH480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-04-25T13:44:15.395 INFO:teuthology.orchestra.run.smithi043.stdout:smithi161 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233001X400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-25T13:44:15.395 INFO:teuthology.orchestra.run.smithi043.stdout:smithi175 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300M0400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-04-25T13:44:15.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.397+0000 7f6bd8eb9700 1 -- 172.21.15.43:0/3152178530 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6bbc0afb80 msgr2=0x7f6bbc0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:15.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.397+0000 7f6bd8eb9700 1 --2- 172.21.15.43:0/3152178530 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6bbc0afb80 0x7f6bbc0b2090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4005950 tx=0x7f6bc400b410 comp rx=0 tx=0).stop 2024-04-25T13:44:15.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.397+0000 7f6bd8eb9700 1 -- 172.21.15.43:0/3152178530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bd4107670 msgr2=0x7f6bd419ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:15.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.397+0000 7f6bd8eb9700 1 --2- 172.21.15.43:0/3152178530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bd4107670 0x7f6bd419ab90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800d980 tx=0x7f6bc800dc90 comp rx=0 tx=0).stop 2024-04-25T13:44:15.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.397+0000 7f6bd8eb9700 1 -- 172.21.15.43:0/3152178530 shutdown_connections 2024-04-25T13:44:15.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.397+0000 7f6bd8eb9700 1 --2- 172.21.15.43:0/3152178530 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f6bbc0afb80 0x7f6bbc0b2090 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:15.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.397+0000 7f6bd8eb9700 1 --2- 172.21.15.43:0/3152178530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd4109fd0 0x7f6bd41a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:15.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.397+0000 7f6bd8eb9700 1 --2- 172.21.15.43:0/3152178530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd4104d10 0x7f6bd419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:15.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.397+0000 7f6bd8eb9700 1 --2- 172.21.15.43:0/3152178530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bd4107670 0x7f6bd419ab90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:15.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.397+0000 7f6bd8eb9700 1 -- 172.21.15.43:0/3152178530 >> 172.21.15.43:0/3152178530 conn(0x7f6bd40fe750 msgr2=0x7f6bd4105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:15.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.397+0000 7f6bd8eb9700 1 -- 172.21.15.43:0/3152178530 shutdown_connections 2024-04-25T13:44:15.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:15.397+0000 7f6bd8eb9700 1 -- 172.21.15.43:0/3152178530 wait complete. 2024-04-25T13:44:15.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:15 smithi175 ceph-mon[32649]: pgmap v352: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 9 B/s, 0 objects/s recovering 2024-04-25T13:44:16.087 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T13:44:16.096 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T13:44:16.096 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-25T13:44:16.350 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:44:16.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:16 smithi161 ceph-mon[32696]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:16.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:16 smithi175 ceph-mon[32649]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:16.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:16 smithi043 ceph-mon[29195]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:17.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:17 smithi161 ceph-mon[32696]: pgmap v353: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:44:17.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:17 smithi175 ceph-mon[32649]: pgmap v353: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:44:17.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:17 smithi043 ceph-mon[29195]: pgmap v353: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:44:18.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.135+0000 7f3dd6aeb700 1 -- 172.21.15.43:0/1008691914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dd0103100 msgr2=0x7f3dd0103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:18.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.135+0000 7f3dd6aeb700 1 --2- 172.21.15.43:0/1008691914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dd0103100 0x7f3dd0103510 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4009990 tx=0x7f3dc4009ca0 comp rx=0 tx=0).stop 2024-04-25T13:44:18.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.135+0000 7f3dd6aeb700 1 -- 172.21.15.43:0/1008691914 shutdown_connections 2024-04-25T13:44:18.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.135+0000 7f3dd6aeb700 1 --2- 172.21.15.43:0/1008691914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd0104bd0 0x7f3dd010b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:18.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.135+0000 7f3dd6aeb700 1 --2- 172.21.15.43:0/1008691914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dd0103100 0x7f3dd0103510 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:18.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.135+0000 7f3dd6aeb700 1 --2- 172.21.15.43:0/1008691914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd0104230 0x7f3dd0104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:18.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.135+0000 7f3dd6aeb700 1 -- 172.21.15.43:0/1008691914 >> 172.21.15.43:0/1008691914 conn(0x7f3dd00fe760 msgr2=0x7f3dd0100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:18.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.135+0000 7f3dd6aeb700 1 -- 172.21.15.43:0/1008691914 shutdown_connections 2024-04-25T13:44:18.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.135+0000 7f3dd6aeb700 1 -- 172.21.15.43:0/1008691914 wait complete. 2024-04-25T13:44:18.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.135+0000 7f3dd6aeb700 1 Processor -- start 2024-04-25T13:44:18.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dd6aeb700 1 -- start start 2024-04-25T13:44:18.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dd6aeb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dd0103100 0x7f3dd0106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dd6aeb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd0104230 0x7f3dd0105570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dd6aeb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd0104bd0 0x7f3dd0105ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dd6aeb700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd010e9f0 con 0x7f3dd0103100 2024-04-25T13:44:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dd6aeb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd010e870 con 0x7f3dd0104230 2024-04-25T13:44:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dd6aeb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd010eb70 con 0x7f3dd0104bd0 2024-04-25T13:44:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dd4887700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dd0103100 0x7f3dd0106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dd4887700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dd0103100 0x7f3dd0106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43234/0 (socket says 172.21.15.43:43234) 2024-04-25T13:44:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dd4887700 1 -- 172.21.15.43:0/3020819680 learned_addr learned my addr 172.21.15.43:0/3020819680 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dd5088700 1 --2- 172.21.15.43:0/3020819680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd0104bd0 0x7f3dd0105ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dcffff700 1 --2- 172.21.15.43:0/3020819680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd0104230 0x7f3dd0105570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dd4887700 1 -- 172.21.15.43:0/3020819680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd0104bd0 msgr2=0x7f3dd0105ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:18.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dd4887700 1 --2- 172.21.15.43:0/3020819680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd0104bd0 0x7f3dd0105ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:18.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dd4887700 1 -- 172.21.15.43:0/3020819680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd0104230 msgr2=0x7f3dd0105570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:18.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dd4887700 1 --2- 172.21.15.43:0/3020819680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd0104230 0x7f3dd0105570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:18.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.136+0000 7f3dd4887700 1 -- 172.21.15.43:0/3020819680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd0106210 con 0x7f3dd0103100 2024-04-25T13:44:18.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.137+0000 7f3dd4887700 1 --2- 172.21.15.43:0/3020819680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dd0103100 0x7f3dd0106ec0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400b2e0 tx=0x7f3dc400bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:18.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.137+0000 7f3dcdffb700 1 -- 172.21.15.43:0/3020819680 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4026070 con 0x7f3dd0103100 2024-04-25T13:44:18.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.137+0000 7f3dcdffb700 1 -- 172.21.15.43:0/3020819680 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dc4003d20 con 0x7f3dd0103100 2024-04-25T13:44:18.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.137+0000 7f3dcdffb700 1 -- 172.21.15.43:0/3020819680 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc400fd20 con 0x7f3dd0103100 2024-04-25T13:44:18.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.137+0000 7f3dd6aeb700 1 -- 172.21.15.43:0/3020819680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd01a47d0 con 0x7f3dd0103100 2024-04-25T13:44:18.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.137+0000 7f3dd6aeb700 1 -- 172.21.15.43:0/3020819680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd01a4c20 con 0x7f3dd0103100 2024-04-25T13:44:18.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.138+0000 7f3dd6aeb700 1 -- 172.21.15.43:0/3020819680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd0051190 con 0x7f3dd0103100 2024-04-25T13:44:18.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.140+0000 7f3dcdffb700 1 -- 172.21.15.43:0/3020819680 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f3dc4029070 con 0x7f3dd0103100 2024-04-25T13:44:18.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.140+0000 7f3dcdffb700 1 --2- 172.21.15.43:0/3020819680 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3dc00afc00 0x7f3dc00b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:18.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.141+0000 7f3dcffff700 1 --2- 172.21.15.43:0/3020819680 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3dc00afc00 0x7f3dc00b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:18.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.141+0000 7f3dcdffb700 1 -- 172.21.15.43:0/3020819680 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f3dc40e0080 con 0x7f3dd0103100 2024-04-25T13:44:18.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.141+0000 7f3dcffff700 1 --2- 172.21.15.43:0/3020819680 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3dc00afc00 0x7f3dc00b2110 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0106870 tx=0x7f3dbc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:18.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.144+0000 7f3dcdffb700 1 -- 172.21.15.43:0/3020819680 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3dc4013070 con 0x7f3dd0103100 2024-04-25T13:44:18.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.398+0000 7f3dd6aeb700 1 -- 172.21.15.43:0/3020819680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3dd01a5040 con 0x7f3dd0103100 2024-04-25T13:44:18.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.398+0000 7f3dcdffb700 1 -- 172.21.15.43:0/3020819680 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3054 (secure 0 0 0) 0x7f3dc40a8970 con 0x7f3dd0103100 2024-04-25T13:44:18.398 INFO:teuthology.orchestra.run.smithi043.stdout:e24 2024-04-25T13:44:18.398 INFO:teuthology.orchestra.run.smithi043.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T13:44:18.398 INFO:teuthology.orchestra.run.smithi043.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T13:44:18.398 INFO:teuthology.orchestra.run.smithi043.stdout:legacy client fscid: 1 2024-04-25T13:44:18.399 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:44:18.399 INFO:teuthology.orchestra.run.smithi043.stdout:Filesystem 'cephfs' (1) 2024-04-25T13:44:18.399 INFO:teuthology.orchestra.run.smithi043.stdout:fs_name cephfs 2024-04-25T13:44:18.399 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 24 2024-04-25T13:44:18.399 INFO:teuthology.orchestra.run.smithi043.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T13:44:18.399 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-04-25T13:42:08.401075+0000 2024-04-25T13:44:18.399 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2024-04-25T13:42:36.143414+0000 2024-04-25T13:44:18.399 INFO:teuthology.orchestra.run.smithi043.stdout:tableserver 0 2024-04-25T13:44:18.399 INFO:teuthology.orchestra.run.smithi043.stdout:root 0 2024-04-25T13:44:18.399 INFO:teuthology.orchestra.run.smithi043.stdout:session_timeout 300 2024-04-25T13:44:18.399 INFO:teuthology.orchestra.run.smithi043.stdout:session_autoclose 300 2024-04-25T13:44:18.399 INFO:teuthology.orchestra.run.smithi043.stdout:max_file_size 1099511627776 2024-04-25T13:44:18.399 INFO:teuthology.orchestra.run.smithi043.stdout:max_xattr_size 65536 2024-04-25T13:44:18.399 INFO:teuthology.orchestra.run.smithi043.stdout:required_client_features {} 2024-04-25T13:44:18.400 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure 0 2024-04-25T13:44:18.400 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure_osd_epoch 0 2024-04-25T13:44:18.400 INFO:teuthology.orchestra.run.smithi043.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T13:44:18.400 INFO:teuthology.orchestra.run.smithi043.stdout:max_mds 3 2024-04-25T13:44:18.400 INFO:teuthology.orchestra.run.smithi043.stdout:in 0,1,2 2024-04-25T13:44:18.400 INFO:teuthology.orchestra.run.smithi043.stdout:up {0=24542,1=24509,2=24502} 2024-04-25T13:44:18.400 INFO:teuthology.orchestra.run.smithi043.stdout:failed 2024-04-25T13:44:18.400 INFO:teuthology.orchestra.run.smithi043.stdout:damaged 2024-04-25T13:44:18.400 INFO:teuthology.orchestra.run.smithi043.stdout:stopped 2024-04-25T13:44:18.400 INFO:teuthology.orchestra.run.smithi043.stdout:data_pools [3,4] 2024-04-25T13:44:18.400 INFO:teuthology.orchestra.run.smithi043.stdout:metadata_pool 2 2024-04-25T13:44:18.400 INFO:teuthology.orchestra.run.smithi043.stdout:inline_data disabled 2024-04-25T13:44:18.400 INFO:teuthology.orchestra.run.smithi043.stdout:balancer 2024-04-25T13:44:18.400 INFO:teuthology.orchestra.run.smithi043.stdout:bal_rank_mask -1 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi043.stdout:standby_count_wanted 0 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi043.stdout:qdb_cluster leader: 24542 members: 24542,24502,24509 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b{0:24542} state up:active seq 3 addr [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c{0:24481} state up:standby-replay seq 1 addr [v2:172.21.15.175:6836/2732559521,v1:172.21.15.175:6837/2732559521] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.h{1:24509} state up:active seq 12 addr [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.e{1:24470} state up:standby-replay seq 1 addr [v2:172.21.15.161:6834/2378707176,v1:172.21.15.161:6835/2378707176] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.i{2:24502} state up:active seq 12 addr [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.f{2:24463} state up:standby-replay seq 1 addr [v2:172.21.15.175:6834/1225446538,v1:172.21.15.175:6835/1225446538] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi043.stdout:Standby daemons: 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.j{-1:14556} state up:standby seq 1 addr [v2:172.21.15.43:6834/73004272,v1:172.21.15.43:6835/73004272] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d{-1:14568} state up:standby seq 1 addr [v2:172.21.15.43:6836/624870499,v1:172.21.15.43:6837/624870499] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.g{-1:14643} state up:standby seq 1 addr [v2:172.21.15.43:6838/2642701222,v1:172.21.15.43:6839/2642701222] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a{-1:14655} state up:standby seq 1 addr [v2:172.21.15.43:6840/3777483996,v1:172.21.15.43:6841/3777483996] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.l{-1:24418} state up:standby seq 1 addr [v2:172.21.15.175:6832/2054284229,v1:172.21.15.175:6833/2054284229] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.k{-1:24440} state up:standby seq 1 addr [v2:172.21.15.161:6832/519829901,v1:172.21.15.161:6833/519829901] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T13:44:18.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.400+0000 7f3dd6aeb700 1 -- 172.21.15.43:0/3020819680 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3dc00afc00 msgr2=0x7f3dc00b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:18.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.400+0000 7f3dd6aeb700 1 --2- 172.21.15.43:0/3020819680 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3dc00afc00 0x7f3dc00b2110 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0106870 tx=0x7f3dbc009260 comp rx=0 tx=0).stop 2024-04-25T13:44:18.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.400+0000 7f3dd6aeb700 1 -- 172.21.15.43:0/3020819680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dd0103100 msgr2=0x7f3dd0106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:18.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.400+0000 7f3dd6aeb700 1 --2- 172.21.15.43:0/3020819680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dd0103100 0x7f3dd0106ec0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400b2e0 tx=0x7f3dc400bb40 comp rx=0 tx=0).stop 2024-04-25T13:44:18.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.400+0000 7f3dd6aeb700 1 -- 172.21.15.43:0/3020819680 shutdown_connections 2024-04-25T13:44:18.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.400+0000 7f3dd6aeb700 1 --2- 172.21.15.43:0/3020819680 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3dc00afc00 0x7f3dc00b2110 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:18.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.400+0000 7f3dd6aeb700 1 --2- 172.21.15.43:0/3020819680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd0104bd0 0x7f3dd0105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:18.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.400+0000 7f3dd6aeb700 1 --2- 172.21.15.43:0/3020819680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dd0103100 0x7f3dd0106ec0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:18.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.400+0000 7f3dd6aeb700 1 --2- 172.21.15.43:0/3020819680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd0104230 0x7f3dd0105570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:18.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.400+0000 7f3dd6aeb700 1 -- 172.21.15.43:0/3020819680 >> 172.21.15.43:0/3020819680 conn(0x7f3dd00fe760 msgr2=0x7f3dd0100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:18.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.400+0000 7f3dd6aeb700 1 -- 172.21.15.43:0/3020819680 shutdown_connections 2024-04-25T13:44:18.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:18.401+0000 7f3dd6aeb700 1 -- 172.21.15.43:0/3020819680 wait complete. 2024-04-25T13:44:18.404 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 24 2024-04-25T13:44:19.066 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- bash -c 'ceph osd dump' 2024-04-25T13:44:19.316 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:44:19.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:19 smithi161 ceph-mon[32696]: pgmap v354: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T13:44:19.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:19 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3020819680' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T13:44:19.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:19 smithi175 ceph-mon[32649]: pgmap v354: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T13:44:19.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:19 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3020819680' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T13:44:19.436 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:19 smithi043 ceph-mon[29195]: pgmap v354: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T13:44:19.437 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:19 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3020819680' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T13:44:21.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.101+0000 7fb608de8700 1 -- 172.21.15.43:0/1095293618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb604105340 msgr2=0x7fb604105750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:21.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.101+0000 7fb608de8700 1 --2- 172.21.15.43:0/1095293618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb604105340 0x7fb604105750 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009990 tx=0x7fb5f8009ca0 comp rx=0 tx=0).stop 2024-04-25T13:44:21.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.101+0000 7fb608de8700 1 -- 172.21.15.43:0/1095293618 shutdown_connections 2024-04-25T13:44:21.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.101+0000 7fb608de8700 1 --2- 172.21.15.43:0/1095293618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb604105ce0 0x7fb60410c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:21.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.101+0000 7fb608de8700 1 --2- 172.21.15.43:0/1095293618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb604104210 0x7fb604104620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:21.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.101+0000 7fb608de8700 1 --2- 172.21.15.43:0/1095293618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb604105340 0x7fb604105750 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:21.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.101+0000 7fb608de8700 1 -- 172.21.15.43:0/1095293618 >> 172.21.15.43:0/1095293618 conn(0x7fb6040ff890 msgr2=0x7fb604101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:21.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.101+0000 7fb608de8700 1 -- 172.21.15.43:0/1095293618 shutdown_connections 2024-04-25T13:44:21.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.101+0000 7fb608de8700 1 -- 172.21.15.43:0/1095293618 wait complete. 2024-04-25T13:44:21.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.102+0000 7fb608de8700 1 Processor -- start 2024-04-25T13:44:21.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.102+0000 7fb608de8700 1 -- start start 2024-04-25T13:44:21.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.102+0000 7fb608de8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb604104210 0x7fb60419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:21.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.102+0000 7fb608de8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb604105340 0x7fb60419ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:21.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.102+0000 7fb608de8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb604105ce0 0x7fb6041a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:21.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.102+0000 7fb608de8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb60410fb70 con 0x7fb604105340 2024-04-25T13:44:21.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.102+0000 7fb608de8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fb60410f9f0 con 0x7fb604104210 2024-04-25T13:44:21.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.102+0000 7fb608de8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb60410fcf0 con 0x7fb604105ce0 2024-04-25T13:44:21.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.103+0000 7fb601d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb604105340 0x7fb60419ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:21.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.103+0000 7fb601d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb604105340 0x7fb60419ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38476/0 (socket says 172.21.15.43:38476) 2024-04-25T13:44:21.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.103+0000 7fb60259c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb604104210 0x7fb60419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:21.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.103+0000 7fb601d9b700 1 -- 172.21.15.43:0/3946680658 learned_addr learned my addr 172.21.15.43:0/3946680658 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:21.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.103+0000 7fb602d9d700 1 --2- 172.21.15.43:0/3946680658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb604105ce0 0x7fb6041a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:21.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.103+0000 7fb601d9b700 1 -- 172.21.15.43:0/3946680658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb604105ce0 msgr2=0x7fb6041a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.103+0000 7fb601d9b700 1 --2- 172.21.15.43:0/3946680658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb604105ce0 0x7fb6041a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.103+0000 7fb601d9b700 1 -- 172.21.15.43:0/3946680658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb604104210 msgr2=0x7fb60419a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.103+0000 7fb601d9b700 1 --2- 172.21.15.43:0/3946680658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb604104210 0x7fb60419a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.103+0000 7fb601d9b700 1 -- 172.21.15.43:0/3946680658 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6041a22b0 con 0x7fb604105340 2024-04-25T13:44:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.103+0000 7fb60259c700 1 --2- 172.21.15.43:0/3946680658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb604104210 0x7fb60419a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:44:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.103+0000 7fb601d9b700 1 --2- 172.21.15.43:0/3946680658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb604105340 0x7fb60419ace0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800b650 tx=0x7fb5f800bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.103+0000 7fb5f37fe700 1 -- 172.21.15.43:0/3946680658 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8027070 con 0x7fb604105340 2024-04-25T13:44:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.103+0000 7fb608de8700 1 -- 172.21.15.43:0/3946680658 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6041a2540 con 0x7fb604105340 2024-04-25T13:44:21.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.103+0000 7fb5f37fe700 1 -- 172.21.15.43:0/3946680658 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5f8022470 con 0x7fb604105340 2024-04-25T13:44:21.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.103+0000 7fb5f37fe700 1 -- 172.21.15.43:0/3946680658 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f800f6c0 con 0x7fb604105340 2024-04-25T13:44:21.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.104+0000 7fb608de8700 1 -- 172.21.15.43:0/3946680658 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6041a2990 con 0x7fb604105340 2024-04-25T13:44:21.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.105+0000 7fb608de8700 1 -- 172.21.15.43:0/3946680658 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb604051190 con 0x7fb604105340 2024-04-25T13:44:21.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.106+0000 7fb5f37fe700 1 -- 172.21.15.43:0/3946680658 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fb5f802a070 con 0x7fb604105340 2024-04-25T13:44:21.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.107+0000 7fb5f37fe700 1 --2- 172.21.15.43:0/3946680658 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb5ec0afb80 0x7fb5ec0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:21.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.107+0000 7fb60259c700 1 --2- 172.21.15.43:0/3946680658 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb5ec0afb80 0x7fb5ec0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:21.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.107+0000 7fb5f37fe700 1 -- 172.21.15.43:0/3946680658 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7fb5f80e04c0 con 0x7fb604105340 2024-04-25T13:44:21.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.107+0000 7fb60259c700 1 --2- 172.21.15.43:0/3946680658 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb5ec0afb80 0x7fb5ec0b2090 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb604105240 tx=0x7fb5f4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:21.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.110+0000 7fb5f37fe700 1 -- 172.21.15.43:0/3946680658 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb5f8031080 con 0x7fb604105340 2024-04-25T13:44:21.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.319+0000 7fb608de8700 1 -- 172.21.15.43:0/3946680658 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fb60402e510 con 0x7fb604105340 2024-04-25T13:44:21.319 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:21 smithi043 ceph-mon[29195]: pgmap v355: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:44:21.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.320+0000 7fb5f37fe700 1 -- 172.21.15.43:0/3946680658 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v84) ==== 56+0+5627 (secure 0 0 0) 0x7fb5f8013070 con 0x7fb604105340 2024-04-25T13:44:21.320 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 84 2024-04-25T13:44:21.320 INFO:teuthology.orchestra.run.smithi043.stdout:fsid 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:44:21.321 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-04-25T13:33:57.051082+0000 2024-04-25T13:44:21.321 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2024-04-25T13:44:00.049268+0000 2024-04-25T13:44:21.321 INFO:teuthology.orchestra.run.smithi043.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-25T13:44:21.321 INFO:teuthology.orchestra.run.smithi043.stdout:crush_version 27 2024-04-25T13:44:21.321 INFO:teuthology.orchestra.run.smithi043.stdout:full_ratio 0.95 2024-04-25T13:44:21.321 INFO:teuthology.orchestra.run.smithi043.stdout:backfillfull_ratio 0.9 2024-04-25T13:44:21.321 INFO:teuthology.orchestra.run.smithi043.stdout:nearfull_ratio 0.85 2024-04-25T13:44:21.321 INFO:teuthology.orchestra.run.smithi043.stdout:require_min_compat_client luminous 2024-04-25T13:44:21.321 INFO:teuthology.orchestra.run.smithi043.stdout:min_compat_client luminous 2024-04-25T13:44:21.321 INFO:teuthology.orchestra.run.smithi043.stdout:require_osd_release squid 2024-04-25T13:44:21.321 INFO:teuthology.orchestra.run.smithi043.stdout:stretch_mode_enabled false 2024-04-25T13:44:21.321 INFO:teuthology.orchestra.run.smithi043.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-04-25T13:44:21.321 INFO:teuthology.orchestra.run.smithi043.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-04-25T13:44:21.322 INFO:teuthology.orchestra.run.smithi043.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 76 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-04-25T13:44:21.322 INFO:teuthology.orchestra.run.smithi043.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-04-25T13:44:21.322 INFO:teuthology.orchestra.run.smithi043.stdout:max_osd 12 2024-04-25T13:44:21.322 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 up in weight 1 up_from 8 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6802/532985348,v1:172.21.15.43:6803/532985348] [v2:172.21.15.43:6804/532985348,v1:172.21.15.43:6805/532985348] exists,up c8e639a2-eae9-4bfb-8f2c-f94cc7d86943 2024-04-25T13:44:21.322 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 up in weight 1 up_from 13 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.161:6800/2031999337,v1:172.21.15.161:6801/2031999337] [v2:172.21.15.161:6802/2031999337,v1:172.21.15.161:6803/2031999337] exists,up 060783b1-704f-4e3a-ba2b-b07d8e6b8946 2024-04-25T13:44:21.322 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 up in weight 1 up_from 18 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6800/1555612698,v1:172.21.15.175:6801/1555612698] [v2:172.21.15.175:6802/1555612698,v1:172.21.15.175:6803/1555612698] exists,up 89fff4e4-9a15-4baf-830e-53c0b1dd33fc 2024-04-25T13:44:21.322 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 up in weight 1 up_from 26 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6810/253965514,v1:172.21.15.43:6811/253965514] [v2:172.21.15.43:6812/253965514,v1:172.21.15.43:6813/253965514] exists,up 86d23f16-1b89-475e-9700-03a3f131daa2 2024-04-25T13:44:21.322 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 up in weight 1 up_from 32 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.161:6808/2720970010,v1:172.21.15.161:6809/2720970010] [v2:172.21.15.161:6810/2720970010,v1:172.21.15.161:6811/2720970010] exists,up efd85b77-da0c-48de-9338-6d8f5493aef8 2024-04-25T13:44:21.322 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 up in weight 1 up_from 37 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6808/1053472329,v1:172.21.15.175:6809/1053472329] [v2:172.21.15.175:6810/1053472329,v1:172.21.15.175:6811/1053472329] exists,up 41a6e540-aec0-48a6-a114-8dc9e0a8c0cd 2024-04-25T13:44:21.322 INFO:teuthology.orchestra.run.smithi043.stdout:osd.6 up in weight 1 up_from 43 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6818/3787838261,v1:172.21.15.43:6819/3787838261] [v2:172.21.15.43:6820/3787838261,v1:172.21.15.43:6821/3787838261] exists,up 42edbda7-0a4e-467b-8432-fd2fed66e115 2024-04-25T13:44:21.322 INFO:teuthology.orchestra.run.smithi043.stdout:osd.7 up in weight 1 up_from 48 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.161:6816/729366149,v1:172.21.15.161:6817/729366149] [v2:172.21.15.161:6818/729366149,v1:172.21.15.161:6819/729366149] exists,up c2ddcb6f-9e91-4c87-a504-c1182a462b89 2024-04-25T13:44:21.323 INFO:teuthology.orchestra.run.smithi043.stdout:osd.8 up in weight 1 up_from 54 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6816/2453339282,v1:172.21.15.175:6817/2453339282] [v2:172.21.15.175:6818/2453339282,v1:172.21.15.175:6819/2453339282] exists,up edadbbdb-521a-4daf-ac1b-8dbed78b06fd 2024-04-25T13:44:21.323 INFO:teuthology.orchestra.run.smithi043.stdout:osd.9 up in weight 1 up_from 60 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6826/844074677,v1:172.21.15.43:6827/844074677] [v2:172.21.15.43:6828/844074677,v1:172.21.15.43:6829/844074677] exists,up 424f05d6-5bc6-411f-86be-25a4cfe48ae7 2024-04-25T13:44:21.323 INFO:teuthology.orchestra.run.smithi043.stdout:osd.10 up in weight 1 up_from 65 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.161:6824/2874955800,v1:172.21.15.161:6825/2874955800] [v2:172.21.15.161:6826/2874955800,v1:172.21.15.161:6827/2874955800] exists,up e36b0893-8620-4ece-a175-b86a0f944f79 2024-04-25T13:44:21.323 INFO:teuthology.orchestra.run.smithi043.stdout:osd.11 up in weight 1 up_from 71 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6824/1911970947,v1:172.21.15.175:6825/1911970947] [v2:172.21.15.175:6826/1911970947,v1:172.21.15.175:6827/1911970947] exists,up a2e5f0dd-7b17-47e1-b437-933d47a399a0 2024-04-25T13:44:21.323 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 2.10 [8,11] 2024-04-25T13:44:21.323 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 2.14 [2,4] 2024-04-25T13:44:21.323 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 2.1b [2,1] 2024-04-25T13:44:21.323 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 2.1c [8,11] 2024-04-25T13:44:21.323 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.21 [5,9] 2024-04-25T13:44:21.323 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.2c [4,9] 2024-04-25T13:44:21.324 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.34 [4,9] 2024-04-25T13:44:21.324 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 4.6 [5,8] 2024-04-25T13:44:21.324 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 4.b [9,10] 2024-04-25T13:44:21.324 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 4.1c [9,8] 2024-04-25T13:44:21.324 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 4.1f [9,8] 2024-04-25T13:44:21.324 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/775979394 expires 2024-04-26T13:34:57.835176+0000 2024-04-25T13:44:21.324 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/1063219824 expires 2024-04-26T13:34:57.835176+0000 2024-04-25T13:44:21.324 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:6801/1629086480 expires 2024-04-26T13:34:57.835176+0000 2024-04-25T13:44:21.324 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:6800/1629086480 expires 2024-04-26T13:34:57.835176+0000 2024-04-25T13:44:21.324 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:6800/3816223875 expires 2024-04-26T13:34:30.246627+0000 2024-04-25T13:44:21.324 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/1985552645 expires 2024-04-26T13:34:57.835176+0000 2024-04-25T13:44:21.324 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/1274235665 expires 2024-04-26T13:34:30.246627+0000 2024-04-25T13:44:21.324 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:6801/3816223875 expires 2024-04-26T13:34:30.246627+0000 2024-04-25T13:44:21.324 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/1022690204 expires 2024-04-26T13:34:30.246627+0000 2024-04-25T13:44:21.325 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/3992074212 expires 2024-04-26T13:34:30.246627+0000 2024-04-25T13:44:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.323+0000 7fb608de8700 1 -- 172.21.15.43:0/3946680658 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb5ec0afb80 msgr2=0x7fb5ec0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.323+0000 7fb608de8700 1 --2- 172.21.15.43:0/3946680658 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb5ec0afb80 0x7fb5ec0b2090 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb604105240 tx=0x7fb5f4009260 comp rx=0 tx=0).stop 2024-04-25T13:44:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.323+0000 7fb608de8700 1 -- 172.21.15.43:0/3946680658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb604105340 msgr2=0x7fb60419ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.323+0000 7fb608de8700 1 --2- 172.21.15.43:0/3946680658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb604105340 0x7fb60419ace0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800b650 tx=0x7fb5f800bb20 comp rx=0 tx=0).stop 2024-04-25T13:44:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.323+0000 7fb608de8700 1 -- 172.21.15.43:0/3946680658 shutdown_connections 2024-04-25T13:44:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.323+0000 7fb608de8700 1 --2- 172.21.15.43:0/3946680658 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb5ec0afb80 0x7fb5ec0b2090 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.323+0000 7fb608de8700 1 --2- 172.21.15.43:0/3946680658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb604105ce0 0x7fb6041a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.323+0000 7fb608de8700 1 --2- 172.21.15.43:0/3946680658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb604104210 0x7fb60419a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.323+0000 7fb608de8700 1 --2- 172.21.15.43:0/3946680658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb604105340 0x7fb60419ace0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.323+0000 7fb608de8700 1 -- 172.21.15.43:0/3946680658 >> 172.21.15.43:0/3946680658 conn(0x7fb6040ff890 msgr2=0x7fb604108570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:21.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.323+0000 7fb608de8700 1 -- 172.21.15.43:0/3946680658 shutdown_connections 2024-04-25T13:44:21.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:21.323+0000 7fb608de8700 1 -- 172.21.15.43:0/3946680658 wait complete. 2024-04-25T13:44:21.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:21 smithi161 ceph-mon[32696]: pgmap v355: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:44:21.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:21 smithi175 ceph-mon[32649]: pgmap v355: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:44:21.965 INFO:teuthology.run_tasks:Running task fs.ready... 2024-04-25T13:44:21.977 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:44:22.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.093+0000 7f8fc9582640 1 -- 172.21.15.43:0/2637799654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4104d50 msgr2=0x7f8fc4105160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:22.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.093+0000 7f8fc9582640 1 --2- 172.21.15.43:0/2637799654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4104d50 0x7f8fc4105160 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009900 tx=0x7f8fb802a410 comp rx=0 tx=0).stop 2024-04-25T13:44:22.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.093+0000 7f8fc9582640 1 -- 172.21.15.43:0/2637799654 shutdown_connections 2024-04-25T13:44:22.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.093+0000 7f8fc9582640 1 --2- 172.21.15.43:0/2637799654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc4109a50 0x7f8fc410be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.093+0000 7f8fc9582640 1 --2- 172.21.15.43:0/2637799654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4104d50 0x7f8fc4105160 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.093+0000 7f8fc9582640 1 --2- 172.21.15.43:0/2637799654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fc4103b10 0x7f8fc4104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.093+0000 7f8fc9582640 1 -- 172.21.15.43:0/2637799654 >> 172.21.15.43:0/2637799654 conn(0x7f8fc40fed40 msgr2=0x7f8fc41011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:22.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.093+0000 7f8fc9582640 1 -- 172.21.15.43:0/2637799654 shutdown_connections 2024-04-25T13:44:22.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.093+0000 7f8fc9582640 1 -- 172.21.15.43:0/2637799654 wait complete. 2024-04-25T13:44:22.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.094+0000 7f8fc9582640 1 Processor -- start 2024-04-25T13:44:22.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.094+0000 7f8fc9582640 1 -- start start 2024-04-25T13:44:22.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.094+0000 7f8fc9582640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4103b10 0x7f8fc419c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:22.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc9582640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc4104d50 0x7f8fc419c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:22.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc9582640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fc4109a50 0x7f8fc41a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:22.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc9582640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc410f4c0 con 0x7f8fc4103b10 2024-04-25T13:44:22.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc9582640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc410f340 con 0x7f8fc4104d50 2024-04-25T13:44:22.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc9582640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc410f640 con 0x7f8fc4109a50 2024-04-25T13:44:22.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc2ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4103b10 0x7f8fc419c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:22.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc2ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4103b10 0x7f8fc419c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38484/0 (socket says 172.21.15.43:38484) 2024-04-25T13:44:22.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc2ffd640 1 -- 172.21.15.43:0/2437305086 learned_addr learned my addr 172.21.15.43:0/2437305086 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:22.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc27fc640 1 --2- 172.21.15.43:0/2437305086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc4104d50 0x7f8fc419c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:22.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc2ffd640 1 -- 172.21.15.43:0/2437305086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fc4109a50 msgr2=0x7f8fc41a38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:22.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc2ffd640 1 --2- 172.21.15.43:0/2437305086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fc4109a50 0x7f8fc41a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc2ffd640 1 -- 172.21.15.43:0/2437305086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc4104d50 msgr2=0x7f8fc419c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:22.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc2ffd640 1 --2- 172.21.15.43:0/2437305086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc4104d50 0x7f8fc419c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc2ffd640 1 -- 172.21.15.43:0/2437305086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc41a3e60 con 0x7f8fc4103b10 2024-04-25T13:44:22.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc2ffd640 1 --2- 172.21.15.43:0/2437305086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4103b10 0x7f8fc419c3d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400c970 tx=0x7f8fb400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:22.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fabfff640 1 -- 172.21.15.43:0/2437305086 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4007c70 con 0x7f8fc4103b10 2024-04-25T13:44:22.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc9582640 1 -- 172.21.15.43:0/2437305086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc41a4150 con 0x7f8fc4103b10 2024-04-25T13:44:22.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fabfff640 1 -- 172.21.15.43:0/2437305086 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8fb4007e10 con 0x7f8fc4103b10 2024-04-25T13:44:22.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fc9582640 1 -- 172.21.15.43:0/2437305086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc41a46f0 con 0x7f8fc4103b10 2024-04-25T13:44:22.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.095+0000 7f8fabfff640 1 -- 172.21.15.43:0/2437305086 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40186f0 con 0x7f8fc4103b10 2024-04-25T13:44:22.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.096+0000 7f8fc9582640 1 -- 172.21.15.43:0/2437305086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc41a4a10 con 0x7f8fc4103b10 2024-04-25T13:44:22.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.098+0000 7f8fabfff640 1 -- 172.21.15.43:0/2437305086 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f8fb400fa90 con 0x7f8fc4103b10 2024-04-25T13:44:22.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.099+0000 7f8fabfff640 1 --2- 172.21.15.43:0/2437305086 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8fac0afaf0 0x7f8fac0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:22.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.099+0000 7f8fc27fc640 1 --2- 172.21.15.43:0/2437305086 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8fac0afaf0 0x7f8fac0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:22.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.099+0000 7f8fabfff640 1 -- 172.21.15.43:0/2437305086 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f8fb40df4e0 con 0x7f8fc4103b10 2024-04-25T13:44:22.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.099+0000 7f8fc27fc640 1 --2- 172.21.15.43:0/2437305086 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8fac0afaf0 0x7f8fac0b2000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8006010 tx=0x7f8fb8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:22.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.102+0000 7f8fabfff640 1 -- 172.21.15.43:0/2437305086 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8fb4014030 con 0x7f8fc4103b10 2024-04-25T13:44:22.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:22 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3946680658' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-25T13:44:22.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.291+0000 7f8fc9582640 1 -- 172.21.15.43:0/2437305086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8fc41a4be0 con 0x7f8fc4103b10 2024-04-25T13:44:22.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.293+0000 7f8fabfff640 1 -- 172.21.15.43:0/2437305086 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24693 (secure 0 0 0) 0x7f8fb40a7ce0 con 0x7f8fc4103b10 2024-04-25T13:44:22.293 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:44:22.293 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":84,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:44:00.049268+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:44:22.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.295+0000 7f8fc9582640 1 -- 172.21.15.43:0/2437305086 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8fac0afaf0 msgr2=0x7f8fac0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:22.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.295+0000 7f8fc9582640 1 --2- 172.21.15.43:0/2437305086 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8fac0afaf0 0x7f8fac0b2000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8006010 tx=0x7f8fb8000bc0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.295+0000 7f8fc9582640 1 -- 172.21.15.43:0/2437305086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4103b10 msgr2=0x7f8fc419c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:22.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.295+0000 7f8fc9582640 1 --2- 172.21.15.43:0/2437305086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4103b10 0x7f8fc419c3d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400c970 tx=0x7f8fb400ce30 comp rx=0 tx=0).stop 2024-04-25T13:44:22.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.295+0000 7f8fc9582640 1 -- 172.21.15.43:0/2437305086 shutdown_connections 2024-04-25T13:44:22.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.295+0000 7f8fc9582640 1 --2- 172.21.15.43:0/2437305086 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f8fac0afaf0 0x7f8fac0b2000 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.295+0000 7f8fc9582640 1 --2- 172.21.15.43:0/2437305086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fc4109a50 0x7f8fc41a38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.295+0000 7f8fc9582640 1 --2- 172.21.15.43:0/2437305086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc4104d50 0x7f8fc419c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.295+0000 7f8fc9582640 1 --2- 172.21.15.43:0/2437305086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4103b10 0x7f8fc419c3d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.295+0000 7f8fc9582640 1 -- 172.21.15.43:0/2437305086 >> 172.21.15.43:0/2437305086 conn(0x7f8fc40fed40 msgr2=0x7f8fc40ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:22.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.295+0000 7f8fc9582640 1 -- 172.21.15.43:0/2437305086 shutdown_connections 2024-04-25T13:44:22.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.295+0000 7f8fc9582640 1 -- 172.21.15.43:0/2437305086 wait complete. 2024-04-25T13:44:22.307 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:37:25.931659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:06.202688+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:07.348534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:42:11.056739+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:44:22.308 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:44:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.424+0000 7fe3918bd640 1 -- 172.21.15.43:0/2147747924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe38c108920 msgr2=0x7fe38c10ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.424+0000 7fe3918bd640 1 --2- 172.21.15.43:0/2147747924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe38c108920 0x7fe38c10ad40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe384009ca0 tx=0x7fe38402a8c0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.424+0000 7fe3918bd640 1 -- 172.21.15.43:0/2147747924 shutdown_connections 2024-04-25T13:44:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.424+0000 7fe3918bd640 1 --2- 172.21.15.43:0/2147747924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe38c108920 0x7fe38c10ad40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.424+0000 7fe3918bd640 1 --2- 172.21.15.43:0/2147747924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38c103c20 0x7fe38c104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.424+0000 7fe3918bd640 1 --2- 172.21.15.43:0/2147747924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe38c1029e0 0x7fe38c1036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.424+0000 7fe3918bd640 1 -- 172.21.15.43:0/2147747924 >> 172.21.15.43:0/2147747924 conn(0x7fe38c0fdbd0 msgr2=0x7fe38c100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.424+0000 7fe3918bd640 1 -- 172.21.15.43:0/2147747924 shutdown_connections 2024-04-25T13:44:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.424+0000 7fe3918bd640 1 -- 172.21.15.43:0/2147747924 wait complete. 2024-04-25T13:44:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.424+0000 7fe3918bd640 1 Processor -- start 2024-04-25T13:44:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe3918bd640 1 -- start start 2024-04-25T13:44:22.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe3918bd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe38c1029e0 0x7fe38c10d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:22.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe3918bd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38c103c20 0x7fe38c10b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:22.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe3918bd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe38c108920 0x7fe38c10be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:22.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe3918bd640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c10f520 con 0x7fe38c1029e0 2024-04-25T13:44:22.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe3918bd640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c10f3a0 con 0x7fe38c103c20 2024-04-25T13:44:22.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe3918bd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c10f6a0 con 0x7fe38c108920 2024-04-25T13:44:22.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe38affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe38c1029e0 0x7fe38c10d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:22.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe38affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe38c1029e0 0x7fe38c10d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38512/0 (socket says 172.21.15.43:38512) 2024-04-25T13:44:22.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe38affd640 1 -- 172.21.15.43:0/3001819035 learned_addr learned my addr 172.21.15.43:0/3001819035 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:22.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe38a7fc640 1 --2- 172.21.15.43:0/3001819035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38c103c20 0x7fe38c10b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:22.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe38b7fe640 1 --2- 172.21.15.43:0/3001819035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe38c108920 0x7fe38c10be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:22.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe38affd640 1 -- 172.21.15.43:0/3001819035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe38c108920 msgr2=0x7fe38c10be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:22.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe38affd640 1 --2- 172.21.15.43:0/3001819035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe38c108920 0x7fe38c10be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe38affd640 1 -- 172.21.15.43:0/3001819035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38c103c20 msgr2=0x7fe38c10b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:22.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe38affd640 1 --2- 172.21.15.43:0/3001819035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38c103c20 0x7fe38c10b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe38affd640 1 -- 172.21.15.43:0/3001819035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38c10c530 con 0x7fe38c1029e0 2024-04-25T13:44:22.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe38b7fe640 1 --2- 172.21.15.43:0/3001819035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe38c108920 0x7fe38c10be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:44:22.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.425+0000 7fe38a7fc640 1 --2- 172.21.15.43:0/3001819035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38c103c20 0x7fe38c10b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:44:22.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.426+0000 7fe38affd640 1 --2- 172.21.15.43:0/3001819035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe38c1029e0 0x7fe38c10d2b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe37c005d00 tx=0x7fe37c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:22.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.426+0000 7fe3908bb640 1 -- 172.21.15.43:0/3001819035 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37c017070 con 0x7fe38c1029e0 2024-04-25T13:44:22.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.426+0000 7fe3908bb640 1 -- 172.21.15.43:0/3001819035 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe37c009c30 con 0x7fe38c1029e0 2024-04-25T13:44:22.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.426+0000 7fe3908bb640 1 -- 172.21.15.43:0/3001819035 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37c00f620 con 0x7fe38c1029e0 2024-04-25T13:44:22.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.426+0000 7fe3918bd640 1 -- 172.21.15.43:0/3001819035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38c1a44e0 con 0x7fe38c1029e0 2024-04-25T13:44:22.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.426+0000 7fe3918bd640 1 -- 172.21.15.43:0/3001819035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe38c1a48f0 con 0x7fe38c1029e0 2024-04-25T13:44:22.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.427+0000 7fe3918bd640 1 -- 172.21.15.43:0/3001819035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe38c107730 con 0x7fe38c1029e0 2024-04-25T13:44:22.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.428+0000 7fe3908bb640 1 -- 172.21.15.43:0/3001819035 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fe37c01a070 con 0x7fe38c1029e0 2024-04-25T13:44:22.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:22 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3946680658' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-25T13:44:22.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.429+0000 7fe3908bb640 1 --2- 172.21.15.43:0/3001819035 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe3740afb70 0x7fe3740b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:22.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.429+0000 7fe38a7fc640 1 --2- 172.21.15.43:0/3001819035 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe3740afb70 0x7fe3740b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:22.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.429+0000 7fe3908bb640 1 -- 172.21.15.43:0/3001819035 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7fe37c0dea70 con 0x7fe38c1029e0 2024-04-25T13:44:22.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.429+0000 7fe38a7fc640 1 --2- 172.21.15.43:0/3001819035 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe3740afb70 0x7fe3740b2080 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe380005fd0 tx=0x7fe380005f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:22.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.433+0000 7fe3908bb640 1 -- 172.21.15.43:0/3001819035 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe37c009de0 con 0x7fe38c1029e0 2024-04-25T13:44:22.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:22 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3946680658' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-25T13:44:22.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.620+0000 7fe3918bd640 1 -- 172.21.15.43:0/3001819035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe38c02de40 con 0x7fe38c1029e0 2024-04-25T13:44:22.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.620+0000 7fe3908bb640 1 -- 172.21.15.43:0/3001819035 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7fe37c0a72f0 con 0x7fe38c1029e0 2024-04-25T13:44:22.620 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T13:44:22.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.622+0000 7fe3918bd640 1 -- 172.21.15.43:0/3001819035 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe3740afb70 msgr2=0x7fe3740b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:22.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.622+0000 7fe3918bd640 1 --2- 172.21.15.43:0/3001819035 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe3740afb70 0x7fe3740b2080 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe380005fd0 tx=0x7fe380005f40 comp rx=0 tx=0).stop 2024-04-25T13:44:22.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.622+0000 7fe3918bd640 1 -- 172.21.15.43:0/3001819035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe38c1029e0 msgr2=0x7fe38c10d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:22.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.622+0000 7fe3918bd640 1 --2- 172.21.15.43:0/3001819035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe38c1029e0 0x7fe38c10d2b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe37c005d00 tx=0x7fe37c00dde0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.622+0000 7fe3918bd640 1 -- 172.21.15.43:0/3001819035 shutdown_connections 2024-04-25T13:44:22.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.622+0000 7fe3918bd640 1 --2- 172.21.15.43:0/3001819035 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fe3740afb70 0x7fe3740b2080 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.622+0000 7fe3918bd640 1 --2- 172.21.15.43:0/3001819035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe38c108920 0x7fe38c10be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.622+0000 7fe3918bd640 1 --2- 172.21.15.43:0/3001819035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38c103c20 0x7fe38c10b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.622+0000 7fe3918bd640 1 --2- 172.21.15.43:0/3001819035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe38c1029e0 0x7fe38c10d2b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.622+0000 7fe3918bd640 1 -- 172.21.15.43:0/3001819035 >> 172.21.15.43:0/3001819035 conn(0x7fe38c0fdbd0 msgr2=0x7fe38c104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:22.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.622+0000 7fe3918bd640 1 -- 172.21.15.43:0/3001819035 shutdown_connections 2024-04-25T13:44:22.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.622+0000 7fe3918bd640 1 -- 172.21.15.43:0/3001819035 wait complete. 2024-04-25T13:44:22.634 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:44:22.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.750+0000 7f3cfc267640 1 -- 172.21.15.43:0/3679989144 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cf4108920 msgr2=0x7f3cf410ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:22.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.750+0000 7f3cfc267640 1 --2- 172.21.15.43:0/3679989144 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cf4108920 0x7f3cf410ad40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009ca0 tx=0x7f3cec02a8c0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.750+0000 7f3cfc267640 1 -- 172.21.15.43:0/3679989144 shutdown_connections 2024-04-25T13:44:22.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.750+0000 7f3cfc267640 1 --2- 172.21.15.43:0/3679989144 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cf4108920 0x7f3cf410ad40 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.750+0000 7f3cfc267640 1 --2- 172.21.15.43:0/3679989144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cf4103c20 0x7f3cf4104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.750+0000 7f3cfc267640 1 --2- 172.21.15.43:0/3679989144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf41029e0 0x7f3cf41036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.750+0000 7f3cfc267640 1 -- 172.21.15.43:0/3679989144 >> 172.21.15.43:0/3679989144 conn(0x7f3cf40fdbd0 msgr2=0x7f3cf4100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:22.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.750+0000 7f3cfc267640 1 -- 172.21.15.43:0/3679989144 shutdown_connections 2024-04-25T13:44:22.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.750+0000 7f3cfc267640 1 -- 172.21.15.43:0/3679989144 wait complete. 2024-04-25T13:44:22.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfc267640 1 Processor -- start 2024-04-25T13:44:22.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfc267640 1 -- start start 2024-04-25T13:44:22.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfc267640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cf41029e0 0x7f3cf4199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:22.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfc267640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf4103c20 0x7f3cf4199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:22.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfc267640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cf4108920 0x7f3cf41a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:22.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfc267640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf410e410 con 0x7f3cf41029e0 2024-04-25T13:44:22.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfc267640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf410e290 con 0x7f3cf4108920 2024-04-25T13:44:22.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfc267640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf410e590 con 0x7f3cf4103c20 2024-04-25T13:44:22.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfa003640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cf41029e0 0x7f3cf4199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:22.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfa003640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cf41029e0 0x7f3cf4199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38530/0 (socket says 172.21.15.43:38530) 2024-04-25T13:44:22.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfa003640 1 -- 172.21.15.43:0/3729447616 learned_addr learned my addr 172.21.15.43:0/3729447616 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:22.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cf9802640 1 --2- 172.21.15.43:0/3729447616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf4103c20 0x7f3cf4199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:22.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfa003640 1 -- 172.21.15.43:0/3729447616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf4103c20 msgr2=0x7f3cf4199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:22.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfa003640 1 --2- 172.21.15.43:0/3729447616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf4103c20 0x7f3cf4199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfa804640 1 --2- 172.21.15.43:0/3729447616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cf4108920 0x7f3cf41a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:22.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfa003640 1 -- 172.21.15.43:0/3729447616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cf4108920 msgr2=0x7f3cf41a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:22.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfa003640 1 --2- 172.21.15.43:0/3729447616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cf4108920 0x7f3cf41a0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfa003640 1 -- 172.21.15.43:0/3729447616 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf41a0e70 con 0x7f3cf41029e0 2024-04-25T13:44:22.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.751+0000 7f3cfa804640 1 --2- 172.21.15.43:0/3729447616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cf4108920 0x7f3cf41a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:44:22.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.752+0000 7f3cfa003640 1 --2- 172.21.15.43:0/3729447616 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cf41029e0 0x7f3cf4199330 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000eb00 tx=0x7f3cf0009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:22.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.752+0000 7f3ceb7fe640 1 -- 172.21.15.43:0/3729447616 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf001c070 con 0x7f3cf41029e0 2024-04-25T13:44:22.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.752+0000 7f3ceb7fe640 1 -- 172.21.15.43:0/3729447616 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3cf000bba0 con 0x7f3cf41029e0 2024-04-25T13:44:22.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.752+0000 7f3cfc267640 1 -- 172.21.15.43:0/3729447616 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf4069ef0 con 0x7f3cf41029e0 2024-04-25T13:44:22.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.752+0000 7f3ceb7fe640 1 -- 172.21.15.43:0/3729447616 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0003cc0 con 0x7f3cf41029e0 2024-04-25T13:44:22.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.752+0000 7f3cfc267640 1 -- 172.21.15.43:0/3729447616 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf406a3f0 con 0x7f3cf41029e0 2024-04-25T13:44:22.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.753+0000 7f3cfc267640 1 -- 172.21.15.43:0/3729447616 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cf406c2a0 con 0x7f3cf41029e0 2024-04-25T13:44:22.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.754+0000 7f3ceb7fe640 1 -- 172.21.15.43:0/3729447616 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f3cf001f070 con 0x7f3cf41029e0 2024-04-25T13:44:22.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.755+0000 7f3ceb7fe640 1 --2- 172.21.15.43:0/3729447616 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3ce00afaf0 0x7f3ce00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:22.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.755+0000 7f3cf9802640 1 --2- 172.21.15.43:0/3729447616 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3ce00afaf0 0x7f3ce00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:22.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.755+0000 7f3ceb7fe640 1 -- 172.21.15.43:0/3729447616 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f3cf00e0e90 con 0x7f3cf41029e0 2024-04-25T13:44:22.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.756+0000 7f3cf9802640 1 --2- 172.21.15.43:0/3729447616 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3ce00afaf0 0x7f3ce00b2000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3cf419a3d0 tx=0x7f3ce4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:22.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.759+0000 7f3ceb7fe640 1 -- 172.21.15.43:0/3729447616 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3cf0026070 con 0x7f3cf41029e0 2024-04-25T13:44:22.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.946+0000 7f3cfc267640 1 -- 172.21.15.43:0/3729447616 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3cf406afb0 con 0x7f3cf41029e0 2024-04-25T13:44:22.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.946+0000 7f3ceb7fe640 1 -- 172.21.15.43:0/3729447616 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f3cf00a96f0 con 0x7f3cf41029e0 2024-04-25T13:44:22.946 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:44:22.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.948+0000 7f3cfc267640 1 -- 172.21.15.43:0/3729447616 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3ce00afaf0 msgr2=0x7f3ce00b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:22.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.948+0000 7f3cfc267640 1 --2- 172.21.15.43:0/3729447616 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3ce00afaf0 0x7f3ce00b2000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3cf419a3d0 tx=0x7f3ce4005f90 comp rx=0 tx=0).stop 2024-04-25T13:44:22.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.948+0000 7f3cfc267640 1 -- 172.21.15.43:0/3729447616 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cf41029e0 msgr2=0x7f3cf4199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:22.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.948+0000 7f3cfc267640 1 --2- 172.21.15.43:0/3729447616 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cf41029e0 0x7f3cf4199330 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000eb00 tx=0x7f3cf0009ea0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.948+0000 7f3cfc267640 1 -- 172.21.15.43:0/3729447616 shutdown_connections 2024-04-25T13:44:22.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.948+0000 7f3cfc267640 1 --2- 172.21.15.43:0/3729447616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cf4108920 0x7f3cf41a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.948+0000 7f3cfc267640 1 --2- 172.21.15.43:0/3729447616 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3ce00afaf0 0x7f3ce00b2000 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.948+0000 7f3cfc267640 1 --2- 172.21.15.43:0/3729447616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf4103c20 0x7f3cf4199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.948+0000 7f3cfc267640 1 --2- 172.21.15.43:0/3729447616 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cf41029e0 0x7f3cf4199330 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:22.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.948+0000 7f3cfc267640 1 -- 172.21.15.43:0/3729447616 >> 172.21.15.43:0/3729447616 conn(0x7f3cf40fdbd0 msgr2=0x7f3cf4104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:22.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.948+0000 7f3cfc267640 1 -- 172.21.15.43:0/3729447616 shutdown_connections 2024-04-25T13:44:22.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:22.948+0000 7f3cfc267640 1 -- 172.21.15.43:0/3729447616 wait complete. 2024-04-25T13:44:22.961 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:44:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.075+0000 7fd45e7c7640 1 -- 172.21.15.43:0/2364429564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4581029f0 msgr2=0x7fd4581036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.075+0000 7fd45e7c7640 1 --2- 172.21.15.43:0/2364429564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4581029f0 0x7fd4581036f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd448009900 tx=0x7fd44802a410 comp rx=0 tx=0).stop 2024-04-25T13:44:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.075+0000 7fd45e7c7640 1 -- 172.21.15.43:0/2364429564 shutdown_connections 2024-04-25T13:44:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.075+0000 7fd45e7c7640 1 --2- 172.21.15.43:0/2364429564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd458108930 0x7fd45810ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.075+0000 7fd45e7c7640 1 --2- 172.21.15.43:0/2364429564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd458103c30 0x7fd458104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.075+0000 7fd45e7c7640 1 --2- 172.21.15.43:0/2364429564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4581029f0 0x7fd4581036f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.075+0000 7fd45e7c7640 1 -- 172.21.15.43:0/2364429564 >> 172.21.15.43:0/2364429564 conn(0x7fd4580fdbc0 msgr2=0x7fd458100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.075+0000 7fd45e7c7640 1 -- 172.21.15.43:0/2364429564 shutdown_connections 2024-04-25T13:44:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.075+0000 7fd45e7c7640 1 -- 172.21.15.43:0/2364429564 wait complete. 2024-04-25T13:44:23.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.076+0000 7fd45e7c7640 1 Processor -- start 2024-04-25T13:44:23.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.076+0000 7fd45e7c7640 1 -- start start 2024-04-25T13:44:23.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.076+0000 7fd45e7c7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4581029f0 0x7fd458075860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:23.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.076+0000 7fd45e7c7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd458103c30 0x7fd45819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:23.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.076+0000 7fd45e7c7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd458108930 0x7fd4581a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:23.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.076+0000 7fd45e7c7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd45810e3a0 con 0x7fd4581029f0 2024-04-25T13:44:23.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.076+0000 7fd45e7c7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fd45810e220 con 0x7fd458103c30 2024-04-25T13:44:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.076+0000 7fd45e7c7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd45810e520 con 0x7fd458108930 2024-04-25T13:44:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.077+0000 7fd457fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4581029f0 0x7fd458075860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.077+0000 7fd457fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4581029f0 0x7fd458075860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38550/0 (socket says 172.21.15.43:38550) 2024-04-25T13:44:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.077+0000 7fd457fff640 1 -- 172.21.15.43:0/5307060 learned_addr learned my addr 172.21.15.43:0/5307060 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.077+0000 7fd4577fe640 1 --2- 172.21.15.43:0/5307060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd458103c30 0x7fd45819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.077+0000 7fd45cd64640 1 --2- 172.21.15.43:0/5307060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd458108930 0x7fd4581a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.077+0000 7fd457fff640 1 -- 172.21.15.43:0/5307060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd458108930 msgr2=0x7fd4581a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.077+0000 7fd457fff640 1 --2- 172.21.15.43:0/5307060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd458108930 0x7fd4581a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.077+0000 7fd457fff640 1 -- 172.21.15.43:0/5307060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd458103c30 msgr2=0x7fd45819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.077+0000 7fd457fff640 1 --2- 172.21.15.43:0/5307060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd458103c30 0x7fd45819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.077+0000 7fd457fff640 1 -- 172.21.15.43:0/5307060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4581a1c90 con 0x7fd4581029f0 2024-04-25T13:44:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.077+0000 7fd457fff640 1 --2- 172.21.15.43:0/5307060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4581029f0 0x7fd458075860 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd448005760 tx=0x7fd448004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.077+0000 7fd4557fa640 1 -- 172.21.15.43:0/5307060 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44803f030 con 0x7fd4581029f0 2024-04-25T13:44:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.077+0000 7fd4557fa640 1 -- 172.21.15.43:0/5307060 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd448004440 con 0x7fd4581029f0 2024-04-25T13:44:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.077+0000 7fd45e7c7640 1 -- 172.21.15.43:0/5307060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4581a1f20 con 0x7fd4581029f0 2024-04-25T13:44:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.077+0000 7fd4557fa640 1 -- 172.21.15.43:0/5307060 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448035070 con 0x7fd4581029f0 2024-04-25T13:44:23.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.077+0000 7fd45e7c7640 1 -- 172.21.15.43:0/5307060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4581a2380 con 0x7fd4581029f0 2024-04-25T13:44:23.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.078+0000 7fd45e7c7640 1 -- 172.21.15.43:0/5307060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd458107740 con 0x7fd4581029f0 2024-04-25T13:44:23.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.080+0000 7fd4557fa640 1 -- 172.21.15.43:0/5307060 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fd448042030 con 0x7fd4581029f0 2024-04-25T13:44:23.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.081+0000 7fd4557fa640 1 --2- 172.21.15.43:0/5307060 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd4400afb70 0x7fd4400b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:23.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.081+0000 7fd4577fe640 1 --2- 172.21.15.43:0/5307060 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd4400afb70 0x7fd4400b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:23.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.081+0000 7fd4557fa640 1 -- 172.21.15.43:0/5307060 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7fd4480ff790 con 0x7fd4581029f0 2024-04-25T13:44:23.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.081+0000 7fd4577fe640 1 --2- 172.21.15.43:0/5307060 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd4400afb70 0x7fd4400b2080 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd458075200 tx=0x7fd44c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:23.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.085+0000 7fd4557fa640 1 -- 172.21.15.43:0/5307060 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd4480c7ff0 con 0x7fd4581029f0 2024-04-25T13:44:23.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:23 smithi043 ceph-mon[29195]: pgmap v356: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T13:44:23.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:23 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2437305086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:44:23.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:23 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3001819035' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:44:23.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:23 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3729447616' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:44:23.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.274+0000 7fd45e7c7640 1 -- 172.21.15.43:0/5307060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd45802dce0 con 0x7fd4581029f0 2024-04-25T13:44:23.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.275+0000 7fd4557fa640 1 -- 172.21.15.43:0/5307060 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7fd4480d0070 con 0x7fd4581029f0 2024-04-25T13:44:23.275 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-25T13:44:23.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.277+0000 7fd45e7c7640 1 -- 172.21.15.43:0/5307060 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd4400afb70 msgr2=0x7fd4400b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:23.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.277+0000 7fd45e7c7640 1 --2- 172.21.15.43:0/5307060 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd4400afb70 0x7fd4400b2080 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd458075200 tx=0x7fd44c005f90 comp rx=0 tx=0).stop 2024-04-25T13:44:23.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.277+0000 7fd45e7c7640 1 -- 172.21.15.43:0/5307060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4581029f0 msgr2=0x7fd458075860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:23.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.277+0000 7fd45e7c7640 1 --2- 172.21.15.43:0/5307060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4581029f0 0x7fd458075860 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd448005760 tx=0x7fd448004040 comp rx=0 tx=0).stop 2024-04-25T13:44:23.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.277+0000 7fd45e7c7640 1 -- 172.21.15.43:0/5307060 shutdown_connections 2024-04-25T13:44:23.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.277+0000 7fd45e7c7640 1 --2- 172.21.15.43:0/5307060 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fd4400afb70 0x7fd4400b2080 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.277+0000 7fd45e7c7640 1 --2- 172.21.15.43:0/5307060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd458108930 0x7fd4581a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.277+0000 7fd45e7c7640 1 --2- 172.21.15.43:0/5307060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd458103c30 0x7fd45819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.277+0000 7fd45e7c7640 1 --2- 172.21.15.43:0/5307060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4581029f0 0x7fd458075860 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.277+0000 7fd45e7c7640 1 -- 172.21.15.43:0/5307060 >> 172.21.15.43:0/5307060 conn(0x7fd4580fdbc0 msgr2=0x7fd458104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:23.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.277+0000 7fd45e7c7640 1 -- 172.21.15.43:0/5307060 shutdown_connections 2024-04-25T13:44:23.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.277+0000 7fd45e7c7640 1 -- 172.21.15.43:0/5307060 wait complete. 2024-04-25T13:44:23.289 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:44:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.406+0000 7f330b061640 1 -- 172.21.15.43:0/1145462328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3304103ef0 msgr2=0x7f33041027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.406+0000 7f330b061640 1 --2- 172.21.15.43:0/1145462328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3304103ef0 0x7f33041027d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009900 tx=0x7f32f802a410 comp rx=0 tx=0).stop 2024-04-25T13:44:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.406+0000 7f330b061640 1 -- 172.21.15.43:0/1145462328 shutdown_connections 2024-04-25T13:44:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.406+0000 7f330b061640 1 --2- 172.21.15.43:0/1145462328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3304108a20 0x7f330410ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.406+0000 7f330b061640 1 --2- 172.21.15.43:0/1145462328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33041043d0 0x7f3304102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.406+0000 7f330b061640 1 --2- 172.21.15.43:0/1145462328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3304103ef0 0x7f33041027d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.406+0000 7f330b061640 1 -- 172.21.15.43:0/1145462328 >> 172.21.15.43:0/1145462328 conn(0x7f33040fd350 msgr2=0x7f33040ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:23.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.406+0000 7f330b061640 1 -- 172.21.15.43:0/1145462328 shutdown_connections 2024-04-25T13:44:23.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.406+0000 7f330b061640 1 -- 172.21.15.43:0/1145462328 wait complete. 2024-04-25T13:44:23.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.406+0000 7f330b061640 1 Processor -- start 2024-04-25T13:44:23.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.406+0000 7f330b061640 1 -- start start 2024-04-25T13:44:23.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f330b061640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3304103ef0 0x7f3304102150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:23.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f330b061640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3304108a20 0x7f330419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:23.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f330b061640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f330419f000 0x7f33041a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:23.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f330b061640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f330410e390 con 0x7f330419f000 2024-04-25T13:44:23.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f330b061640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f330410e210 con 0x7f3304103ef0 2024-04-25T13:44:23.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f330b061640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f330410e510 con 0x7f3304108a20 2024-04-25T13:44:23.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f33095fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f330419f000 0x7f33041a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:23.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f33095fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f330419f000 0x7f33041a1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38566/0 (socket says 172.21.15.43:38566) 2024-04-25T13:44:23.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f33095fe640 1 -- 172.21.15.43:0/4031000542 learned_addr learned my addr 172.21.15.43:0/4031000542 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:23.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f3303fff640 1 --2- 172.21.15.43:0/4031000542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3304108a20 0x7f330419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:23.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f3308dfd640 1 --2- 172.21.15.43:0/4031000542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3304103ef0 0x7f3304102150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:23.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f33095fe640 1 -- 172.21.15.43:0/4031000542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3304108a20 msgr2=0x7f330419eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:23.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f33095fe640 1 --2- 172.21.15.43:0/4031000542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3304108a20 0x7f330419eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f33095fe640 1 -- 172.21.15.43:0/4031000542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3304103ef0 msgr2=0x7f3304102150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:23.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f33095fe640 1 --2- 172.21.15.43:0/4031000542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3304103ef0 0x7f3304102150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f33095fe640 1 -- 172.21.15.43:0/4031000542 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33041a1bd0 con 0x7f330419f000 2024-04-25T13:44:23.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f33095fe640 1 --2- 172.21.15.43:0/4031000542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f330419f000 0x7f33041a1440 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00eb10 tx=0x7f32fc00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:23.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f3301ffb640 1 -- 172.21.15.43:0/4031000542 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc00ce20 con 0x7f330419f000 2024-04-25T13:44:23.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f3301ffb640 1 -- 172.21.15.43:0/4031000542 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32fc005020 con 0x7f330419f000 2024-04-25T13:44:23.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.407+0000 7f330b061640 1 -- 172.21.15.43:0/4031000542 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33041a1ec0 con 0x7f330419f000 2024-04-25T13:44:23.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.408+0000 7f3301ffb640 1 -- 172.21.15.43:0/4031000542 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc010690 con 0x7f330419f000 2024-04-25T13:44:23.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.408+0000 7f330b061640 1 -- 172.21.15.43:0/4031000542 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33041a22d0 con 0x7f330419f000 2024-04-25T13:44:23.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.409+0000 7f330b061640 1 -- 172.21.15.43:0/4031000542 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f330406a190 con 0x7f330419f000 2024-04-25T13:44:23.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.410+0000 7f3301ffb640 1 -- 172.21.15.43:0/4031000542 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f32fc004a40 con 0x7f330419f000 2024-04-25T13:44:23.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.411+0000 7f3301ffb640 1 --2- 172.21.15.43:0/4031000542 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f32f40afaf0 0x7f32f40b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:23.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.411+0000 7f3308dfd640 1 --2- 172.21.15.43:0/4031000542 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f32f40afaf0 0x7f32f40b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:23.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.411+0000 7f3301ffb640 1 -- 172.21.15.43:0/4031000542 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f32fc0dfb40 con 0x7f330419f000 2024-04-25T13:44:23.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.411+0000 7f3308dfd640 1 --2- 172.21.15.43:0/4031000542 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f32f40afaf0 0x7f32f40b2000 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f32f8006010 tx=0x7f32f8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:23.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.414+0000 7f3301ffb640 1 -- 172.21.15.43:0/4031000542 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f330406a190 con 0x7f330419f000 2024-04-25T13:44:23.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:23 smithi175 ceph-mon[32649]: pgmap v356: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T13:44:23.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:23 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2437305086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:44:23.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:23 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3001819035' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:44:23.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:23 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3729447616' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:44:23.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.599+0000 7f330b061640 1 -- 172.21.15.43:0/4031000542 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f330402dbf0 con 0x7f330419f000 2024-04-25T13:44:23.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.600+0000 7f3301ffb640 1 -- 172.21.15.43:0/4031000542 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v84) ==== 103+0+11 (secure 0 0 0) 0x7f32fc0a8340 con 0x7f330419f000 2024-04-25T13:44:23.600 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:44:23.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.602+0000 7f330b061640 1 -- 172.21.15.43:0/4031000542 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f32f40afaf0 msgr2=0x7f32f40b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:23.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.602+0000 7f330b061640 1 --2- 172.21.15.43:0/4031000542 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f32f40afaf0 0x7f32f40b2000 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f32f8006010 tx=0x7f32f8000bc0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.602+0000 7f330b061640 1 -- 172.21.15.43:0/4031000542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f330419f000 msgr2=0x7f33041a1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:23.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.602+0000 7f330b061640 1 --2- 172.21.15.43:0/4031000542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f330419f000 0x7f33041a1440 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00eb10 tx=0x7f32fc00ef10 comp rx=0 tx=0).stop 2024-04-25T13:44:23.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.602+0000 7f330b061640 1 -- 172.21.15.43:0/4031000542 shutdown_connections 2024-04-25T13:44:23.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.602+0000 7f330b061640 1 --2- 172.21.15.43:0/4031000542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f330419f000 0x7f33041a1440 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.602+0000 7f330b061640 1 --2- 172.21.15.43:0/4031000542 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f32f40afaf0 0x7f32f40b2000 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.602+0000 7f330b061640 1 --2- 172.21.15.43:0/4031000542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3304108a20 0x7f330419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.602+0000 7f330b061640 1 --2- 172.21.15.43:0/4031000542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3304103ef0 0x7f3304102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.602+0000 7f330b061640 1 -- 172.21.15.43:0/4031000542 >> 172.21.15.43:0/4031000542 conn(0x7f33040fd350 msgr2=0x7f33040ff770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:23.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.602+0000 7f330b061640 1 -- 172.21.15.43:0/4031000542 shutdown_connections 2024-04-25T13:44:23.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.602+0000 7f330b061640 1 -- 172.21.15.43:0/4031000542 wait complete. 2024-04-25T13:44:23.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:23 smithi161 ceph-mon[32696]: pgmap v356: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T13:44:23.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:23 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2437305086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:44:23.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:23 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3001819035' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:44:23.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:23 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3729447616' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:44:23.614 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:44:23.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.726+0000 7fb00a4d1640 1 -- 172.21.15.43:0/312773709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb004102fd0 msgr2=0x7fb0041033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:23.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.726+0000 7fb00a4d1640 1 --2- 172.21.15.43:0/312773709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb004102fd0 0x7fb0041033e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7faff4009900 tx=0x7faff402a410 comp rx=0 tx=0).stop 2024-04-25T13:44:23.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.726+0000 7fb00a4d1640 1 -- 172.21.15.43:0/312773709 shutdown_connections 2024-04-25T13:44:23.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.726+0000 7fb00a4d1640 1 --2- 172.21.15.43:0/312773709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb004104690 0x7fb00410ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.726+0000 7fb00a4d1640 1 --2- 172.21.15.43:0/312773709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb004103b30 0x7fb004104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.726+0000 7fb00a4d1640 1 --2- 172.21.15.43:0/312773709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb004102fd0 0x7fb0041033e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.726+0000 7fb00a4d1640 1 -- 172.21.15.43:0/312773709 >> 172.21.15.43:0/312773709 conn(0x7fb0040fd370 msgr2=0x7fb0040ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:23.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.726+0000 7fb00a4d1640 1 -- 172.21.15.43:0/312773709 shutdown_connections 2024-04-25T13:44:23.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.726+0000 7fb00a4d1640 1 -- 172.21.15.43:0/312773709 wait complete. 2024-04-25T13:44:23.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.727+0000 7fb00a4d1640 1 Processor -- start 2024-04-25T13:44:23.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.727+0000 7fb00a4d1640 1 -- start start 2024-04-25T13:44:23.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.727+0000 7fb00a4d1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb004102fd0 0x7fb004199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:23.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.727+0000 7fb00a4d1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb004103b30 0x7fb00419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:23.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.727+0000 7fb00a4d1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb00419f450 0x7fb0041a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:23.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.727+0000 7fb00a4d1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb00410e640 con 0x7fb004102fd0 2024-04-25T13:44:23.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.727+0000 7fb00a4d1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fb00410e4c0 con 0x7fb004103b30 2024-04-25T13:44:23.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.727+0000 7fb00a4d1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb00410e7c0 con 0x7fb00419f450 2024-04-25T13:44:23.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.728+0000 7fb003fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb004102fd0 0x7fb004199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:23.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.728+0000 7fb003fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb004102fd0 0x7fb004199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38592/0 (socket says 172.21.15.43:38592) 2024-04-25T13:44:23.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.728+0000 7fb003fff640 1 -- 172.21.15.43:0/730598367 learned_addr learned my addr 172.21.15.43:0/730598367 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:23.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.728+0000 7fb008a6e640 1 --2- 172.21.15.43:0/730598367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb00419f450 0x7fb0041a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:23.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.728+0000 7fb0037fe640 1 --2- 172.21.15.43:0/730598367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb004103b30 0x7fb00419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:23.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.728+0000 7fb003fff640 1 -- 172.21.15.43:0/730598367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb00419f450 msgr2=0x7fb0041a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:23.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.728+0000 7fb003fff640 1 --2- 172.21.15.43:0/730598367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb00419f450 0x7fb0041a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.728+0000 7fb003fff640 1 -- 172.21.15.43:0/730598367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb004103b30 msgr2=0x7fb00419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:23.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.728+0000 7fb003fff640 1 --2- 172.21.15.43:0/730598367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb004103b30 0x7fb00419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.728+0000 7fb003fff640 1 -- 172.21.15.43:0/730598367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0041a1ee0 con 0x7fb004102fd0 2024-04-25T13:44:23.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.728+0000 7fb003fff640 1 --2- 172.21.15.43:0/730598367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb004102fd0 0x7fb004199f90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7faff4031460 tx=0x7faff4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:23.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.728+0000 7fb0017fa640 1 -- 172.21.15.43:0/730598367 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff403f030 con 0x7fb004102fd0 2024-04-25T13:44:23.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.728+0000 7fb0017fa640 1 -- 172.21.15.43:0/730598367 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faff4003a80 con 0x7fb004102fd0 2024-04-25T13:44:23.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.728+0000 7fb00a4d1640 1 -- 172.21.15.43:0/730598367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0041a2170 con 0x7fb004102fd0 2024-04-25T13:44:23.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.728+0000 7fb0017fa640 1 -- 172.21.15.43:0/730598367 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff4035070 con 0x7fb004102fd0 2024-04-25T13:44:23.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.728+0000 7fb00a4d1640 1 -- 172.21.15.43:0/730598367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0041a26e0 con 0x7fb004102fd0 2024-04-25T13:44:23.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.729+0000 7fb00a4d1640 1 -- 172.21.15.43:0/730598367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb00406b3a0 con 0x7fb004102fd0 2024-04-25T13:44:23.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.731+0000 7fb0017fa640 1 -- 172.21.15.43:0/730598367 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7faff4042030 con 0x7fb004102fd0 2024-04-25T13:44:23.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.731+0000 7fb0017fa640 1 --2- 172.21.15.43:0/730598367 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fafec0afaf0 0x7fafec0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:23.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.732+0000 7fb0017fa640 1 -- 172.21.15.43:0/730598367 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7faff40ffcc0 con 0x7fb004102fd0 2024-04-25T13:44:23.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.732+0000 7fb0037fe640 1 --2- 172.21.15.43:0/730598367 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fafec0afaf0 0x7fafec0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:23.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.732+0000 7fb0037fe640 1 --2- 172.21.15.43:0/730598367 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fafec0afaf0 0x7fafec0b2000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faff8005fd0 tx=0x7faff8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:23.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.735+0000 7fb0017fa640 1 -- 172.21.15.43:0/730598367 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7faff40c8520 con 0x7fb004102fd0 2024-04-25T13:44:23.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.959+0000 7fb00a4d1640 1 -- 172.21.15.43:0/730598367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0041083e0 con 0x7fb004102fd0 2024-04-25T13:44:23.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.959+0000 7fb0017fa640 1 -- 172.21.15.43:0/730598367 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11876 (secure 0 0 0) 0x7faff40c7e20 con 0x7fb004102fd0 2024-04-25T13:44:23.959 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:44:23.960 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2642701222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2642701222},{"type":"v1","addr":"172.21.15.43:6839","nonce":2642701222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6841/3777483996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":3777483996},{"type":"v1","addr":"172.21.15.43:6841","nonce":3777483996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T13:42:08.401075+0000","modified":"2024-04-25T13:42:36.143414+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24542,"mds_1":24509,"mds_2":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6839/3323587585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3323587585},{"type":"v1","addr":"172.21.15.175:6839","nonce":3323587585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.161:6837/1464384320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1464384320},{"type":"v1","addr":"172.21.15.161:6837","nonce":1464384320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6839/1243414461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":1243414461},{"type":"v1","addr":"172.21.15.161:6839","nonce":1243414461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24542,"qdb_cluster":[24542,24502,24509]},"id":1}]} 2024-04-25T13:44:23.960 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 24 2024-04-25T13:44:23.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.961+0000 7fb00a4d1640 1 -- 172.21.15.43:0/730598367 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fafec0afaf0 msgr2=0x7fafec0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:23.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.961+0000 7fb00a4d1640 1 --2- 172.21.15.43:0/730598367 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fafec0afaf0 0x7fafec0b2000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faff8005fd0 tx=0x7faff8005850 comp rx=0 tx=0).stop 2024-04-25T13:44:23.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.961+0000 7fb00a4d1640 1 -- 172.21.15.43:0/730598367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb004102fd0 msgr2=0x7fb004199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:23.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.961+0000 7fb00a4d1640 1 --2- 172.21.15.43:0/730598367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb004102fd0 0x7fb004199f90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7faff4031460 tx=0x7faff4004270 comp rx=0 tx=0).stop 2024-04-25T13:44:23.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.962+0000 7fb00a4d1640 1 -- 172.21.15.43:0/730598367 shutdown_connections 2024-04-25T13:44:23.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.962+0000 7fb00a4d1640 1 --2- 172.21.15.43:0/730598367 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fafec0afaf0 0x7fafec0b2000 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.962+0000 7fb00a4d1640 1 --2- 172.21.15.43:0/730598367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb00419f450 0x7fb0041a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.962+0000 7fb00a4d1640 1 --2- 172.21.15.43:0/730598367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb004103b30 0x7fb00419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.962+0000 7fb00a4d1640 1 --2- 172.21.15.43:0/730598367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb004102fd0 0x7fb004199f90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:23.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.962+0000 7fb00a4d1640 1 -- 172.21.15.43:0/730598367 >> 172.21.15.43:0/730598367 conn(0x7fb0040fd370 msgr2=0x7fb004109c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:23.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.962+0000 7fb00a4d1640 1 -- 172.21.15.43:0/730598367 shutdown_connections 2024-04-25T13:44:23.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:23.962+0000 7fb00a4d1640 1 -- 172.21.15.43:0/730598367 wait complete. 2024-04-25T13:44:23.974 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:44:24.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.086+0000 7f106b506640 1 -- 172.21.15.43:0/10249543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1064103c40 msgr2=0x7f1064104050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:24.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.086+0000 7f106b506640 1 --2- 172.21.15.43:0/10249543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1064103c40 0x7f1064104050 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1054009900 tx=0x7f105402a410 comp rx=0 tx=0).stop 2024-04-25T13:44:24.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.086+0000 7f106b506640 1 -- 172.21.15.43:0/10249543 shutdown_connections 2024-04-25T13:44:24.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.086+0000 7f106b506640 1 --2- 172.21.15.43:0/10249543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1064108940 0x7f106410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.086+0000 7f106b506640 1 --2- 172.21.15.43:0/10249543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1064103c40 0x7f1064104050 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.086+0000 7f106b506640 1 --2- 172.21.15.43:0/10249543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1064102a00 0x7f1064103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.086+0000 7f106b506640 1 -- 172.21.15.43:0/10249543 >> 172.21.15.43:0/10249543 conn(0x7f10640fdbf0 msgr2=0x7f10641000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:24.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.086+0000 7f106b506640 1 -- 172.21.15.43:0/10249543 shutdown_connections 2024-04-25T13:44:24.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.086+0000 7f106b506640 1 -- 172.21.15.43:0/10249543 wait complete. 2024-04-25T13:44:24.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.087+0000 7f106b506640 1 Processor -- start 2024-04-25T13:44:24.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.087+0000 7f106b506640 1 -- start start 2024-04-25T13:44:24.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.087+0000 7f106b506640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1064102a00 0x7f106419a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:24.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.087+0000 7f106b506640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1064103c40 0x7f106419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:24.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.087+0000 7f106b506640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1064108940 0x7f10641a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:24.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.087+0000 7f106b506640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f106410e3d0 con 0x7f1064102a00 2024-04-25T13:44:24.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.087+0000 7f106b506640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f106410e250 con 0x7f1064108940 2024-04-25T13:44:24.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.087+0000 7f106b506640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f106410e550 con 0x7f1064103c40 2024-04-25T13:44:24.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.087+0000 7f10692a2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1064102a00 0x7f106419a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:24.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.087+0000 7f10692a2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1064102a00 0x7f106419a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38624/0 (socket says 172.21.15.43:38624) 2024-04-25T13:44:24.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.087+0000 7f10692a2640 1 -- 172.21.15.43:0/3045126795 learned_addr learned my addr 172.21.15.43:0/3045126795 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:24.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.088+0000 7f1069aa3640 1 --2- 172.21.15.43:0/3045126795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1064108940 0x7f10641a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:24.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.088+0000 7f1068aa1640 1 --2- 172.21.15.43:0/3045126795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1064103c40 0x7f106419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:24.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.088+0000 7f10692a2640 1 -- 172.21.15.43:0/3045126795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1064103c40 msgr2=0x7f106419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:24.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.088+0000 7f10692a2640 1 --2- 172.21.15.43:0/3045126795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1064103c40 0x7f106419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.088+0000 7f10692a2640 1 -- 172.21.15.43:0/3045126795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1064108940 msgr2=0x7f10641a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:24.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.088+0000 7f10692a2640 1 --2- 172.21.15.43:0/3045126795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1064108940 0x7f10641a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.088+0000 7f10692a2640 1 -- 172.21.15.43:0/3045126795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10641a1c70 con 0x7f1064102a00 2024-04-25T13:44:24.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.088+0000 7f1068aa1640 1 --2- 172.21.15.43:0/3045126795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1064103c40 0x7f106419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:44:24.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.088+0000 7f10692a2640 1 --2- 172.21.15.43:0/3045126795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1064102a00 0x7f106419a130 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f106000e9f0 tx=0x7f106000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:24.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.088+0000 7f105a7fc640 1 -- 172.21.15.43:0/3045126795 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106000ccc0 con 0x7f1064102a00 2024-04-25T13:44:24.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.088+0000 7f105a7fc640 1 -- 172.21.15.43:0/3045126795 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10600035f0 con 0x7f1064102a00 2024-04-25T13:44:24.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.088+0000 7f106b506640 1 -- 172.21.15.43:0/3045126795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10641a1f60 con 0x7f1064102a00 2024-04-25T13:44:24.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.088+0000 7f105a7fc640 1 -- 172.21.15.43:0/3045126795 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106000ce60 con 0x7f1064102a00 2024-04-25T13:44:24.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.088+0000 7f106b506640 1 -- 172.21.15.43:0/3045126795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10641a23c0 con 0x7f1064102a00 2024-04-25T13:44:24.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.089+0000 7f106b506640 1 -- 172.21.15.43:0/3045126795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f106406a1c0 con 0x7f1064102a00 2024-04-25T13:44:24.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.091+0000 7f105a7fc640 1 -- 172.21.15.43:0/3045126795 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f1060004000 con 0x7f1064102a00 2024-04-25T13:44:24.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.092+0000 7f105a7fc640 1 --2- 172.21.15.43:0/3045126795 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f10500afb70 0x7f10500b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:24.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.092+0000 7f1068aa1640 1 --2- 172.21.15.43:0/3045126795 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f10500afb70 0x7f10500b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:24.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.092+0000 7f105a7fc640 1 -- 172.21.15.43:0/3045126795 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f10600df3a0 con 0x7f1064102a00 2024-04-25T13:44:24.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.092+0000 7f1068aa1640 1 --2- 172.21.15.43:0/3045126795 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f10500afb70 0x7f10500b2080 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1054006010 tx=0x7f1054031420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:24.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.095+0000 7f105a7fc640 1 -- 172.21.15.43:0/3045126795 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f106406a1c0 con 0x7f1064102a00 2024-04-25T13:44:24.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.284+0000 7f106b506640 1 -- 172.21.15.43:0/3045126795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10641a2950 con 0x7f1064102a00 2024-04-25T13:44:24.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.286+0000 7f105a7fc640 1 -- 172.21.15.43:0/3045126795 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24693 (secure 0 0 0) 0x7f10600a7c00 con 0x7f1064102a00 2024-04-25T13:44:24.286 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:44:24.286 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":84,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:44:00.049268+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:44:24.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.288+0000 7f106b506640 1 -- 172.21.15.43:0/3045126795 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f10500afb70 msgr2=0x7f10500b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:24.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.288+0000 7f106b506640 1 --2- 172.21.15.43:0/3045126795 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f10500afb70 0x7f10500b2080 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1054006010 tx=0x7f1054031420 comp rx=0 tx=0).stop 2024-04-25T13:44:24.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.288+0000 7f106b506640 1 -- 172.21.15.43:0/3045126795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1064102a00 msgr2=0x7f106419a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:24.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.288+0000 7f106b506640 1 --2- 172.21.15.43:0/3045126795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1064102a00 0x7f106419a130 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f106000e9f0 tx=0x7f106000eeb0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.288+0000 7f106b506640 1 -- 172.21.15.43:0/3045126795 shutdown_connections 2024-04-25T13:44:24.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.288+0000 7f106b506640 1 --2- 172.21.15.43:0/3045126795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1064108940 0x7f10641a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.288+0000 7f106b506640 1 --2- 172.21.15.43:0/3045126795 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f10500afb70 0x7f10500b2080 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.288+0000 7f106b506640 1 --2- 172.21.15.43:0/3045126795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1064103c40 0x7f106419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.288+0000 7f106b506640 1 --2- 172.21.15.43:0/3045126795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1064102a00 0x7f106419a130 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.288+0000 7f106b506640 1 -- 172.21.15.43:0/3045126795 >> 172.21.15.43:0/3045126795 conn(0x7f10640fdbf0 msgr2=0x7f1064074dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:24.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.288+0000 7f106b506640 1 -- 172.21.15.43:0/3045126795 shutdown_connections 2024-04-25T13:44:24.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.288+0000 7f106b506640 1 -- 172.21.15.43:0/3045126795 wait complete. 2024-04-25T13:44:24.298 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:24 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/5307060' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:44:24.299 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:24 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/4031000542' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:44:24.299 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:24 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/730598367' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:44:24.300 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:37:25.931659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:06.202688+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:07.348534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:42:11.056739+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:44:24.301 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:44:24.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.416+0000 7fbf7f7e3640 1 -- 172.21.15.43:0/1763645186 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf78103c30 msgr2=0x7fbf78104040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:24.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.416+0000 7fbf7f7e3640 1 --2- 172.21.15.43:0/1763645186 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf78103c30 0x7fbf78104040 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c009ca0 tx=0x7fbf6c02a8c0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.416+0000 7fbf7f7e3640 1 -- 172.21.15.43:0/1763645186 shutdown_connections 2024-04-25T13:44:24.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.416+0000 7fbf7f7e3640 1 --2- 172.21.15.43:0/1763645186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf78108930 0x7fbf7810ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.416+0000 7fbf7f7e3640 1 --2- 172.21.15.43:0/1763645186 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf78103c30 0x7fbf78104040 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.416+0000 7fbf7f7e3640 1 --2- 172.21.15.43:0/1763645186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf781029f0 0x7fbf781036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.416+0000 7fbf7f7e3640 1 -- 172.21.15.43:0/1763645186 >> 172.21.15.43:0/1763645186 conn(0x7fbf780fdbc0 msgr2=0x7fbf78100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:24.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.416+0000 7fbf7f7e3640 1 -- 172.21.15.43:0/1763645186 shutdown_connections 2024-04-25T13:44:24.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.416+0000 7fbf7f7e3640 1 -- 172.21.15.43:0/1763645186 wait complete. 2024-04-25T13:44:24.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.417+0000 7fbf7f7e3640 1 Processor -- start 2024-04-25T13:44:24.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.417+0000 7fbf7f7e3640 1 -- start start 2024-04-25T13:44:24.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.417+0000 7fbf7f7e3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf781029f0 0x7fbf7819a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:24.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.417+0000 7fbf7f7e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf78103c30 0x7fbf7819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:24.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.417+0000 7fbf7f7e3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf78108930 0x7fbf781a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:24.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.417+0000 7fbf7f7e3640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7810f530 con 0x7fbf78103c30 2024-04-25T13:44:24.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.417+0000 7fbf7f7e3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7810f3b0 con 0x7fbf781029f0 2024-04-25T13:44:24.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.417+0000 7fbf7f7e3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7810f6b0 con 0x7fbf78108930 2024-04-25T13:44:24.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.417+0000 7fbf7cd7e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf78103c30 0x7fbf7819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:24.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.417+0000 7fbf7cd7e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf78103c30 0x7fbf7819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38644/0 (socket says 172.21.15.43:38644) 2024-04-25T13:44:24.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.417+0000 7fbf7cd7e640 1 -- 172.21.15.43:0/1441325467 learned_addr learned my addr 172.21.15.43:0/1441325467 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:24.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.417+0000 7fbf7d57f640 1 --2- 172.21.15.43:0/1441325467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf781029f0 0x7fbf7819a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:24.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.418+0000 7fbf7dd80640 1 --2- 172.21.15.43:0/1441325467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf78108930 0x7fbf781a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:24.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.418+0000 7fbf7cd7e640 1 -- 172.21.15.43:0/1441325467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf78108930 msgr2=0x7fbf781a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:24.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.418+0000 7fbf7cd7e640 1 --2- 172.21.15.43:0/1441325467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf78108930 0x7fbf781a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.418+0000 7fbf7cd7e640 1 -- 172.21.15.43:0/1441325467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf781029f0 msgr2=0x7fbf7819a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:24.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.418+0000 7fbf7cd7e640 1 --2- 172.21.15.43:0/1441325467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf781029f0 0x7fbf7819a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.418+0000 7fbf7cd7e640 1 -- 172.21.15.43:0/1441325467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf781a1c30 con 0x7fbf78103c30 2024-04-25T13:44:24.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.418+0000 7fbf7d57f640 1 --2- 172.21.15.43:0/1441325467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf781029f0 0x7fbf7819a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:44:24.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.418+0000 7fbf7dd80640 1 --2- 172.21.15.43:0/1441325467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf78108930 0x7fbf781a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:44:24.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.418+0000 7fbf7cd7e640 1 --2- 172.21.15.43:0/1441325467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf78103c30 0x7fbf7819a630 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c006010 tx=0x7fbf6c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:24.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.418+0000 7fbf6a7fc640 1 -- 172.21.15.43:0/1441325467 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c003d30 con 0x7fbf78103c30 2024-04-25T13:44:24.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.418+0000 7fbf6a7fc640 1 -- 172.21.15.43:0/1441325467 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf6c0044d0 con 0x7fbf78103c30 2024-04-25T13:44:24.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.418+0000 7fbf7f7e3640 1 -- 172.21.15.43:0/1441325467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf781a1ec0 con 0x7fbf78103c30 2024-04-25T13:44:24.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.418+0000 7fbf6a7fc640 1 -- 172.21.15.43:0/1441325467 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c030c30 con 0x7fbf78103c30 2024-04-25T13:44:24.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.418+0000 7fbf7f7e3640 1 -- 172.21.15.43:0/1441325467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf781a2330 con 0x7fbf78103c30 2024-04-25T13:44:24.465 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:24 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/5307060' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:44:24.465 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:24 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/4031000542' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:44:24.465 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:24 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/730598367' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:44:24.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.419+0000 7fbf7f7e3640 1 -- 172.21.15.43:0/1441325467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf78107740 con 0x7fbf78103c30 2024-04-25T13:44:24.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.421+0000 7fbf6a7fc640 1 -- 172.21.15.43:0/1441325467 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fbf6c004040 con 0x7fbf78103c30 2024-04-25T13:44:24.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.421+0000 7fbf6a7fc640 1 --2- 172.21.15.43:0/1441325467 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbf640afaf0 0x7fbf640b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:24.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.421+0000 7fbf7d57f640 1 --2- 172.21.15.43:0/1441325467 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbf640afaf0 0x7fbf640b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:24.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.421+0000 7fbf6a7fc640 1 -- 172.21.15.43:0/1441325467 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7fbf6c1006c0 con 0x7fbf78103c30 2024-04-25T13:44:24.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.422+0000 7fbf7d57f640 1 --2- 172.21.15.43:0/1441325467 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbf640afaf0 0x7fbf640b2000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbf781035f0 tx=0x7fbf74005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:24.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.426+0000 7fbf6a7fc640 1 -- 172.21.15.43:0/1441325467 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbf6c0c8fb0 con 0x7fbf78103c30 2024-04-25T13:44:24.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:24 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/5307060' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:44:24.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:24 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/4031000542' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:44:24.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:24 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/730598367' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:44:24.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.614+0000 7fbf7f7e3640 1 -- 172.21.15.43:0/1441325467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbf780637a0 con 0x7fbf78103c30 2024-04-25T13:44:24.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.614+0000 7fbf6a7fc640 1 -- 172.21.15.43:0/1441325467 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7fbf6c0c88b0 con 0x7fbf78103c30 2024-04-25T13:44:24.614 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T13:44:24.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.616+0000 7fbf7f7e3640 1 -- 172.21.15.43:0/1441325467 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbf640afaf0 msgr2=0x7fbf640b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:24.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.616+0000 7fbf7f7e3640 1 --2- 172.21.15.43:0/1441325467 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbf640afaf0 0x7fbf640b2000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbf781035f0 tx=0x7fbf74005f90 comp rx=0 tx=0).stop 2024-04-25T13:44:24.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.616+0000 7fbf7f7e3640 1 -- 172.21.15.43:0/1441325467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf78103c30 msgr2=0x7fbf7819a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:24.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.616+0000 7fbf7f7e3640 1 --2- 172.21.15.43:0/1441325467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf78103c30 0x7fbf7819a630 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c006010 tx=0x7fbf6c009360 comp rx=0 tx=0).stop 2024-04-25T13:44:24.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.616+0000 7fbf7f7e3640 1 -- 172.21.15.43:0/1441325467 shutdown_connections 2024-04-25T13:44:24.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.616+0000 7fbf7f7e3640 1 --2- 172.21.15.43:0/1441325467 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fbf640afaf0 0x7fbf640b2000 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.616+0000 7fbf7f7e3640 1 --2- 172.21.15.43:0/1441325467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf78108930 0x7fbf781a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.616+0000 7fbf7f7e3640 1 --2- 172.21.15.43:0/1441325467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf78103c30 0x7fbf7819a630 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.616+0000 7fbf7f7e3640 1 --2- 172.21.15.43:0/1441325467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf781029f0 0x7fbf7819a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.616+0000 7fbf7f7e3640 1 -- 172.21.15.43:0/1441325467 >> 172.21.15.43:0/1441325467 conn(0x7fbf780fdbc0 msgr2=0x7fbf78104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:24.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.616+0000 7fbf7f7e3640 1 -- 172.21.15.43:0/1441325467 shutdown_connections 2024-04-25T13:44:24.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.616+0000 7fbf7f7e3640 1 -- 172.21.15.43:0/1441325467 wait complete. 2024-04-25T13:44:24.628 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:44:24.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.743+0000 7fb4d25b7640 1 -- 172.21.15.43:0/1902686785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4cc1050a0 msgr2=0x7fb4cc1054b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:24.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.743+0000 7fb4d25b7640 1 --2- 172.21.15.43:0/1902686785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4cc1050a0 0x7fb4cc1054b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009900 tx=0x7fb4bc02a410 comp rx=0 tx=0).stop 2024-04-25T13:44:24.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.743+0000 7fb4d25b7640 1 -- 172.21.15.43:0/1902686785 shutdown_connections 2024-04-25T13:44:24.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.743+0000 7fb4d25b7640 1 --2- 172.21.15.43:0/1902686785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4cc102250 0x7fb4cc10bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.743+0000 7fb4d25b7640 1 --2- 172.21.15.43:0/1902686785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4cc101750 0x7fb4cc101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.743+0000 7fb4d25b7640 1 --2- 172.21.15.43:0/1902686785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4cc1050a0 0x7fb4cc1054b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.743+0000 7fb4d25b7640 1 -- 172.21.15.43:0/1902686785 >> 172.21.15.43:0/1902686785 conn(0x7fb4cc0fd350 msgr2=0x7fb4cc0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:24.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.743+0000 7fb4d25b7640 1 -- 172.21.15.43:0/1902686785 shutdown_connections 2024-04-25T13:44:24.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.743+0000 7fb4d25b7640 1 -- 172.21.15.43:0/1902686785 wait complete. 2024-04-25T13:44:24.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.744+0000 7fb4d25b7640 1 Processor -- start 2024-04-25T13:44:24.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.744+0000 7fb4d25b7640 1 -- start start 2024-04-25T13:44:24.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.744+0000 7fb4d25b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4cc101750 0x7fb4cc104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:24.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.744+0000 7fb4d25b7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4cc102250 0x7fb4cc1028f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:24.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.744+0000 7fb4d25b7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4cc1050a0 0x7fb4cc102e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:24.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.744+0000 7fb4d25b7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc10f4a0 con 0x7fb4cc102250 2024-04-25T13:44:24.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.744+0000 7fb4d25b7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc10f320 con 0x7fb4cc1050a0 2024-04-25T13:44:24.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.744+0000 7fb4d25b7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc10f620 con 0x7fb4cc101750 2024-04-25T13:44:24.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.744+0000 7fb4cb7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4cc102250 0x7fb4cc1028f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:24.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.744+0000 7fb4cb7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4cc102250 0x7fb4cc1028f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38668/0 (socket says 172.21.15.43:38668) 2024-04-25T13:44:24.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.744+0000 7fb4cb7fe640 1 -- 172.21.15.43:0/84949096 learned_addr learned my addr 172.21.15.43:0/84949096 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:24.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.744+0000 7fb4cbfff640 1 --2- 172.21.15.43:0/84949096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4cc101750 0x7fb4cc104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:24.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.745+0000 7fb4d0b54640 1 --2- 172.21.15.43:0/84949096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4cc1050a0 0x7fb4cc102e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:24.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.745+0000 7fb4cb7fe640 1 -- 172.21.15.43:0/84949096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4cc101750 msgr2=0x7fb4cc104250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:24.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.745+0000 7fb4cb7fe640 1 --2- 172.21.15.43:0/84949096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4cc101750 0x7fb4cc104250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.745+0000 7fb4cb7fe640 1 -- 172.21.15.43:0/84949096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4cc1050a0 msgr2=0x7fb4cc102e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:24.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.745+0000 7fb4cb7fe640 1 --2- 172.21.15.43:0/84949096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4cc1050a0 0x7fb4cc102e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.745+0000 7fb4cb7fe640 1 -- 172.21.15.43:0/84949096 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc103560 con 0x7fb4cc102250 2024-04-25T13:44:24.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.745+0000 7fb4cb7fe640 1 --2- 172.21.15.43:0/84949096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4cc102250 0x7fb4cc1028f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000d950 tx=0x7fb4c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:24.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.745+0000 7fb4c97fa640 1 -- 172.21.15.43:0/84949096 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0017070 con 0x7fb4cc102250 2024-04-25T13:44:24.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.745+0000 7fb4c97fa640 1 -- 172.21.15.43:0/84949096 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4c0009c30 con 0x7fb4cc102250 2024-04-25T13:44:24.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.745+0000 7fb4d25b7640 1 -- 172.21.15.43:0/84949096 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4cc1a4210 con 0x7fb4cc102250 2024-04-25T13:44:24.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.745+0000 7fb4c97fa640 1 -- 172.21.15.43:0/84949096 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c000f620 con 0x7fb4cc102250 2024-04-25T13:44:24.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.745+0000 7fb4d25b7640 1 -- 172.21.15.43:0/84949096 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4cc1a46d0 con 0x7fb4cc102250 2024-04-25T13:44:24.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.746+0000 7fb4d25b7640 1 -- 172.21.15.43:0/84949096 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4cc108a30 con 0x7fb4cc102250 2024-04-25T13:44:24.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.748+0000 7fb4c97fa640 1 -- 172.21.15.43:0/84949096 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fb4c0010460 con 0x7fb4cc102250 2024-04-25T13:44:24.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.748+0000 7fb4c97fa640 1 --2- 172.21.15.43:0/84949096 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb4b40afaf0 0x7fb4b40b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:24.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.749+0000 7fb4cbfff640 1 --2- 172.21.15.43:0/84949096 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb4b40afaf0 0x7fb4b40b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:24.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.749+0000 7fb4c97fa640 1 -- 172.21.15.43:0/84949096 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7fb4c00debb0 con 0x7fb4cc102250 2024-04-25T13:44:24.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.749+0000 7fb4cbfff640 1 --2- 172.21.15.43:0/84949096 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb4b40afaf0 0x7fb4b40b2000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc005760 tx=0x7fb4bc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:24.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.752+0000 7fb4c97fa640 1 -- 172.21.15.43:0/84949096 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb4c00a7410 con 0x7fb4cc102250 2024-04-25T13:44:24.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.938+0000 7fb4d25b7640 1 -- 172.21.15.43:0/84949096 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb4cc0637a0 con 0x7fb4cc102250 2024-04-25T13:44:24.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.939+0000 7fb4c97fa640 1 -- 172.21.15.43:0/84949096 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7fb4c0009de0 con 0x7fb4cc102250 2024-04-25T13:44:24.939 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:44:24.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.941+0000 7fb4d25b7640 1 -- 172.21.15.43:0/84949096 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb4b40afaf0 msgr2=0x7fb4b40b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:24.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.941+0000 7fb4d25b7640 1 --2- 172.21.15.43:0/84949096 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb4b40afaf0 0x7fb4b40b2000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc005760 tx=0x7fb4bc000bc0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.941+0000 7fb4d25b7640 1 -- 172.21.15.43:0/84949096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4cc102250 msgr2=0x7fb4cc1028f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:24.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.941+0000 7fb4d25b7640 1 --2- 172.21.15.43:0/84949096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4cc102250 0x7fb4cc1028f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000d950 tx=0x7fb4c000de10 comp rx=0 tx=0).stop 2024-04-25T13:44:24.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.941+0000 7fb4d25b7640 1 -- 172.21.15.43:0/84949096 shutdown_connections 2024-04-25T13:44:24.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.941+0000 7fb4d25b7640 1 --2- 172.21.15.43:0/84949096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4cc1050a0 0x7fb4cc102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.941+0000 7fb4d25b7640 1 --2- 172.21.15.43:0/84949096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4cc102250 0x7fb4cc1028f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.941+0000 7fb4d25b7640 1 --2- 172.21.15.43:0/84949096 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fb4b40afaf0 0x7fb4b40b2000 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.941+0000 7fb4d25b7640 1 --2- 172.21.15.43:0/84949096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4cc101750 0x7fb4cc104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:24.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.941+0000 7fb4d25b7640 1 -- 172.21.15.43:0/84949096 >> 172.21.15.43:0/84949096 conn(0x7fb4cc0fd350 msgr2=0x7fb4cc105c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:24.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.941+0000 7fb4d25b7640 1 -- 172.21.15.43:0/84949096 shutdown_connections 2024-04-25T13:44:24.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:24.941+0000 7fb4d25b7640 1 -- 172.21.15.43:0/84949096 wait complete. 2024-04-25T13:44:24.953 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:44:25.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.071+0000 7faaaec84640 1 -- 172.21.15.43:0/1482214248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faaa8104d20 msgr2=0x7faaa8105130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:25.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.071+0000 7faaaec84640 1 --2- 172.21.15.43:0/1482214248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faaa8104d20 0x7faaa8105130 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009900 tx=0x7faa9c02a410 comp rx=0 tx=0).stop 2024-04-25T13:44:25.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.071+0000 7faaaec84640 1 -- 172.21.15.43:0/1482214248 shutdown_connections 2024-04-25T13:44:25.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.071+0000 7faaaec84640 1 --2- 172.21.15.43:0/1482214248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa8109a20 0x7faaa810be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.071+0000 7faaaec84640 1 --2- 172.21.15.43:0/1482214248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faaa8104d20 0x7faaa8105130 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.071+0000 7faaaec84640 1 --2- 172.21.15.43:0/1482214248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa8103ae0 0x7faaa81047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.071+0000 7faaaec84640 1 -- 172.21.15.43:0/1482214248 >> 172.21.15.43:0/1482214248 conn(0x7faaa80fecd0 msgr2=0x7faaa8101180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:25.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.071+0000 7faaaec84640 1 -- 172.21.15.43:0/1482214248 shutdown_connections 2024-04-25T13:44:25.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.071+0000 7faaaec84640 1 -- 172.21.15.43:0/1482214248 wait complete. 2024-04-25T13:44:25.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaaec84640 1 Processor -- start 2024-04-25T13:44:25.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaaec84640 1 -- start start 2024-04-25T13:44:25.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaaec84640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faaa8103ae0 0x7faaa819a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:25.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaaec84640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa8104d20 0x7faaa819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:25.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaaec84640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa8109a20 0x7faaa81a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:25.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaaec84640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faaa810f490 con 0x7faaa8103ae0 2024-04-25T13:44:25.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaaec84640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7faaa810f310 con 0x7faaa8109a20 2024-04-25T13:44:25.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaaec84640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faaa810f610 con 0x7faaa8104d20 2024-04-25T13:44:25.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaaca20640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faaa8103ae0 0x7faaa819a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:25.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaaca20640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faaa8103ae0 0x7faaa819a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38690/0 (socket says 172.21.15.43:38690) 2024-04-25T13:44:25.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaaca20640 1 -- 172.21.15.43:0/2480972663 learned_addr learned my addr 172.21.15.43:0/2480972663 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:25.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaa7fff640 1 --2- 172.21.15.43:0/2480972663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa8104d20 0x7faaa819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:25.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaad221640 1 --2- 172.21.15.43:0/2480972663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa8109a20 0x7faaa81a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:25.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaaca20640 1 -- 172.21.15.43:0/2480972663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa8104d20 msgr2=0x7faaa819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:25.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaaca20640 1 --2- 172.21.15.43:0/2480972663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa8104d20 0x7faaa819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaaca20640 1 -- 172.21.15.43:0/2480972663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa8109a20 msgr2=0x7faaa81a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:25.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaaca20640 1 --2- 172.21.15.43:0/2480972663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa8109a20 0x7faaa81a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaaca20640 1 -- 172.21.15.43:0/2480972663 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa81a1c30 con 0x7faaa8103ae0 2024-04-25T13:44:25.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.072+0000 7faaa7fff640 1 --2- 172.21.15.43:0/2480972663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa8104d20 0x7faaa819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:44:25.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.073+0000 7faaaca20640 1 --2- 172.21.15.43:0/2480972663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faaa8103ae0 0x7faaa819a0f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7faa9800e9f0 tx=0x7faa9800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:25.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.073+0000 7faaa5ffb640 1 -- 172.21.15.43:0/2480972663 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9800ccc0 con 0x7faaa8103ae0 2024-04-25T13:44:25.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.073+0000 7faaa5ffb640 1 -- 172.21.15.43:0/2480972663 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa980044b0 con 0x7faaa8103ae0 2024-04-25T13:44:25.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.073+0000 7faaaec84640 1 -- 172.21.15.43:0/2480972663 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa81a1f20 con 0x7faaa8103ae0 2024-04-25T13:44:25.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.073+0000 7faaa5ffb640 1 -- 172.21.15.43:0/2480972663 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa98010430 con 0x7faaa8103ae0 2024-04-25T13:44:25.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.073+0000 7faaaec84640 1 -- 172.21.15.43:0/2480972663 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa81a23e0 con 0x7faaa8103ae0 2024-04-25T13:44:25.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.074+0000 7faaaec84640 1 -- 172.21.15.43:0/2480972663 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa8108830 con 0x7faaa8103ae0 2024-04-25T13:44:25.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.075+0000 7faaa5ffb640 1 -- 172.21.15.43:0/2480972663 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7faa98003f90 con 0x7faaa8103ae0 2024-04-25T13:44:25.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.076+0000 7faaa5ffb640 1 --2- 172.21.15.43:0/2480972663 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7faa900afb70 0x7faa900b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:25.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.076+0000 7faaa7fff640 1 --2- 172.21.15.43:0/2480972663 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7faa900afb70 0x7faa900b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:25.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.076+0000 7faaa5ffb640 1 -- 172.21.15.43:0/2480972663 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7faa980df310 con 0x7faaa8103ae0 2024-04-25T13:44:25.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.076+0000 7faaa7fff640 1 --2- 172.21.15.43:0/2480972663 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7faa900afb70 0x7faa900b2080 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faa9c006010 tx=0x7faa9c031420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:25.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.081+0000 7faaa5ffb640 1 -- 172.21.15.43:0/2480972663 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7faa980a7b10 con 0x7faaa8103ae0 2024-04-25T13:44:25.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:25 smithi043 ceph-mon[29195]: pgmap v357: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T13:44:25.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:25 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3045126795' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:44:25.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:25 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1441325467' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:44:25.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:25 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/84949096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:44:25.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.267+0000 7faaaec84640 1 -- 172.21.15.43:0/2480972663 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faaa80637a0 con 0x7faaa8103ae0 2024-04-25T13:44:25.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.268+0000 7faaa5ffb640 1 -- 172.21.15.43:0/2480972663 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7faa980a7410 con 0x7faaa8103ae0 2024-04-25T13:44:25.268 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-25T13:44:25.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.269+0000 7faaaec84640 1 -- 172.21.15.43:0/2480972663 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7faa900afb70 msgr2=0x7faa900b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:25.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.269+0000 7faaaec84640 1 --2- 172.21.15.43:0/2480972663 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7faa900afb70 0x7faa900b2080 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faa9c006010 tx=0x7faa9c031420 comp rx=0 tx=0).stop 2024-04-25T13:44:25.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.270+0000 7faaaec84640 1 -- 172.21.15.43:0/2480972663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faaa8103ae0 msgr2=0x7faaa819a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:25.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.270+0000 7faaaec84640 1 --2- 172.21.15.43:0/2480972663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faaa8103ae0 0x7faaa819a0f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7faa9800e9f0 tx=0x7faa9800eeb0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.270+0000 7faaaec84640 1 -- 172.21.15.43:0/2480972663 shutdown_connections 2024-04-25T13:44:25.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.270+0000 7faaaec84640 1 --2- 172.21.15.43:0/2480972663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa8109a20 0x7faaa81a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.270+0000 7faaaec84640 1 --2- 172.21.15.43:0/2480972663 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7faa900afb70 0x7faa900b2080 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.270+0000 7faaaec84640 1 --2- 172.21.15.43:0/2480972663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa8104d20 0x7faaa819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.270+0000 7faaaec84640 1 --2- 172.21.15.43:0/2480972663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faaa8103ae0 0x7faaa819a0f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.270+0000 7faaaec84640 1 -- 172.21.15.43:0/2480972663 >> 172.21.15.43:0/2480972663 conn(0x7faaa80fecd0 msgr2=0x7faaa8105a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:25.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.270+0000 7faaaec84640 1 -- 172.21.15.43:0/2480972663 shutdown_connections 2024-04-25T13:44:25.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.270+0000 7faaaec84640 1 -- 172.21.15.43:0/2480972663 wait complete. 2024-04-25T13:44:25.281 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:44:25.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.396+0000 7f4f7ce42640 1 -- 172.21.15.43:0/3197457080 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f78101f20 msgr2=0x7f4f78106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:25.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.396+0000 7f4f7ce42640 1 --2- 172.21.15.43:0/3197457080 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f78101f20 0x7f4f78106b90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009900 tx=0x7f4f6802a410 comp rx=0 tx=0).stop 2024-04-25T13:44:25.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.396+0000 7f4f7ce42640 1 -- 172.21.15.43:0/3197457080 shutdown_connections 2024-04-25T13:44:25.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.396+0000 7f4f7ce42640 1 --2- 172.21.15.43:0/3197457080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f78109a30 0x7f4f7810be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.396+0000 7f4f7ce42640 1 --2- 172.21.15.43:0/3197457080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f781070d0 0x7f4f781094f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.396+0000 7f4f7ce42640 1 --2- 172.21.15.43:0/3197457080 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f78101f20 0x7f4f78106b90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.396+0000 7f4f7ce42640 1 -- 172.21.15.43:0/3197457080 >> 172.21.15.43:0/3197457080 conn(0x7f4f780fd380 msgr2=0x7f4f780ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:25.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.396+0000 7f4f7ce42640 1 -- 172.21.15.43:0/3197457080 shutdown_connections 2024-04-25T13:44:25.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.396+0000 7f4f7ce42640 1 -- 172.21.15.43:0/3197457080 wait complete. 2024-04-25T13:44:25.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.397+0000 7f4f7ce42640 1 Processor -- start 2024-04-25T13:44:25.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.397+0000 7f4f7ce42640 1 -- start start 2024-04-25T13:44:25.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.397+0000 7f4f7ce42640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f78101f20 0x7f4f7819a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:25.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.397+0000 7f4f7ce42640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f781070d0 0x7f4f7819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:25.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.397+0000 7f4f7ce42640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f78109a30 0x7f4f781a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:25.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.397+0000 7f4f7ce42640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7810f5a0 con 0x7f4f78109a30 2024-04-25T13:44:25.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.397+0000 7f4f7ce42640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7810f420 con 0x7f4f78101f20 2024-04-25T13:44:25.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.397+0000 7f4f7ce42640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7810f720 con 0x7f4f781070d0 2024-04-25T13:44:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.397+0000 7f4f76d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f78109a30 0x7f4f781a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.397+0000 7f4f76d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f78109a30 0x7f4f781a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38708/0 (socket says 172.21.15.43:38708) 2024-04-25T13:44:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.397+0000 7f4f76d9d640 1 -- 172.21.15.43:0/2299796647 learned_addr learned my addr 172.21.15.43:0/2299796647 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.397+0000 7f4f7659c640 1 --2- 172.21.15.43:0/2299796647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f78101f20 0x7f4f7819a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.397+0000 7f4f75d9b640 1 --2- 172.21.15.43:0/2299796647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f781070d0 0x7f4f7819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.398+0000 7f4f76d9d640 1 -- 172.21.15.43:0/2299796647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f781070d0 msgr2=0x7f4f7819a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.398+0000 7f4f76d9d640 1 --2- 172.21.15.43:0/2299796647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f781070d0 0x7f4f7819a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.398+0000 7f4f76d9d640 1 -- 172.21.15.43:0/2299796647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f78101f20 msgr2=0x7f4f7819a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.398+0000 7f4f76d9d640 1 --2- 172.21.15.43:0/2299796647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f78101f20 0x7f4f7819a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.398+0000 7f4f76d9d640 1 -- 172.21.15.43:0/2299796647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f781a1d20 con 0x7f4f78109a30 2024-04-25T13:44:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.398+0000 7f4f75d9b640 1 --2- 172.21.15.43:0/2299796647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f781070d0 0x7f4f7819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:44:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.398+0000 7f4f76d9d640 1 --2- 172.21.15.43:0/2299796647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f78109a30 0x7f4f781a16b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000eb10 tx=0x7f4f7000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.398+0000 7f4f677fe640 1 -- 172.21.15.43:0/2299796647 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70004b20 con 0x7f4f78109a30 2024-04-25T13:44:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.398+0000 7f4f7ce42640 1 -- 172.21.15.43:0/2299796647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f781a1fb0 con 0x7f4f78109a30 2024-04-25T13:44:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.398+0000 7f4f677fe640 1 -- 172.21.15.43:0/2299796647 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f70004cc0 con 0x7f4f78109a30 2024-04-25T13:44:25.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.398+0000 7f4f7ce42640 1 -- 172.21.15.43:0/2299796647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f781a2470 con 0x7f4f78109a30 2024-04-25T13:44:25.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.398+0000 7f4f677fe640 1 -- 172.21.15.43:0/2299796647 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70018630 con 0x7f4f78109a30 2024-04-25T13:44:25.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.399+0000 7f4f7ce42640 1 -- 172.21.15.43:0/2299796647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f780feea0 con 0x7f4f78109a30 2024-04-25T13:44:25.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.401+0000 7f4f677fe640 1 -- 172.21.15.43:0/2299796647 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f4f70005000 con 0x7f4f78109a30 2024-04-25T13:44:25.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.401+0000 7f4f677fe640 1 --2- 172.21.15.43:0/2299796647 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4f600afaf0 0x7f4f600b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:25.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.401+0000 7f4f677fe640 1 -- 172.21.15.43:0/2299796647 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f4f700dfd70 con 0x7f4f78109a30 2024-04-25T13:44:25.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.402+0000 7f4f7659c640 1 --2- 172.21.15.43:0/2299796647 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4f600afaf0 0x7f4f600b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:25.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.402+0000 7f4f7659c640 1 --2- 172.21.15.43:0/2299796647 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4f600afaf0 0x7f4f600b2000 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4f680057c0 tx=0x7f4f68005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:25.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.405+0000 7f4f677fe640 1 -- 172.21.15.43:0/2299796647 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4f700a85d0 con 0x7f4f78109a30 2024-04-25T13:44:25.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:25 smithi175 ceph-mon[32649]: pgmap v357: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T13:44:25.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:25 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3045126795' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:44:25.433 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:25 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1441325467' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:44:25.433 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:25 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/84949096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:44:25.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.593+0000 7f4f7ce42640 1 -- 172.21.15.43:0/2299796647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f4f780637a0 con 0x7f4f78109a30 2024-04-25T13:44:25.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.593+0000 7f4f677fe640 1 -- 172.21.15.43:0/2299796647 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v84) ==== 103+0+11 (secure 0 0 0) 0x7f4f700a7ed0 con 0x7f4f78109a30 2024-04-25T13:44:25.593 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:44:25.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.595+0000 7f4f7ce42640 1 -- 172.21.15.43:0/2299796647 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4f600afaf0 msgr2=0x7f4f600b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:25.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.595+0000 7f4f7ce42640 1 --2- 172.21.15.43:0/2299796647 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4f600afaf0 0x7f4f600b2000 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4f680057c0 tx=0x7f4f68005720 comp rx=0 tx=0).stop 2024-04-25T13:44:25.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.595+0000 7f4f7ce42640 1 -- 172.21.15.43:0/2299796647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f78109a30 msgr2=0x7f4f781a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:25.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.595+0000 7f4f7ce42640 1 --2- 172.21.15.43:0/2299796647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f78109a30 0x7f4f781a16b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000eb10 tx=0x7f4f7000c2d0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.596+0000 7f4f7ce42640 1 -- 172.21.15.43:0/2299796647 shutdown_connections 2024-04-25T13:44:25.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.596+0000 7f4f7ce42640 1 --2- 172.21.15.43:0/2299796647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f78109a30 0x7f4f781a16b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.596+0000 7f4f7ce42640 1 --2- 172.21.15.43:0/2299796647 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4f600afaf0 0x7f4f600b2000 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.596+0000 7f4f7ce42640 1 --2- 172.21.15.43:0/2299796647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f781070d0 0x7f4f7819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.596+0000 7f4f7ce42640 1 --2- 172.21.15.43:0/2299796647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f78101f20 0x7f4f7819a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.596+0000 7f4f7ce42640 1 -- 172.21.15.43:0/2299796647 >> 172.21.15.43:0/2299796647 conn(0x7f4f780fd380 msgr2=0x7f4f78105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:25.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.596+0000 7f4f7ce42640 1 -- 172.21.15.43:0/2299796647 shutdown_connections 2024-04-25T13:44:25.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.596+0000 7f4f7ce42640 1 -- 172.21.15.43:0/2299796647 wait complete. 2024-04-25T13:44:25.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:25 smithi161 ceph-mon[32696]: pgmap v357: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T13:44:25.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:25 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3045126795' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:44:25.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:25 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1441325467' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:44:25.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:25 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/84949096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:44:25.607 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:44:25.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.719+0000 7f3c52fe0640 1 -- 172.21.15.43:0/2960428906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4c109a40 msgr2=0x7f3c4c10be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:25.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.719+0000 7f3c52fe0640 1 --2- 172.21.15.43:0/2960428906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4c109a40 0x7f3c4c10be60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009ca0 tx=0x7f3c4402a8c0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.719+0000 7f3c52fe0640 1 -- 172.21.15.43:0/2960428906 shutdown_connections 2024-04-25T13:44:25.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.719+0000 7f3c52fe0640 1 --2- 172.21.15.43:0/2960428906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4c109a40 0x7f3c4c10be60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.719+0000 7f3c52fe0640 1 --2- 172.21.15.43:0/2960428906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c104d40 0x7f3c4c105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.719+0000 7f3c52fe0640 1 --2- 172.21.15.43:0/2960428906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c4c103b00 0x7f3c4c104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.719+0000 7f3c52fe0640 1 -- 172.21.15.43:0/2960428906 >> 172.21.15.43:0/2960428906 conn(0x7f3c4c0fed10 msgr2=0x7f3c4c1011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:25.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.719+0000 7f3c52fe0640 1 -- 172.21.15.43:0/2960428906 shutdown_connections 2024-04-25T13:44:25.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.719+0000 7f3c52fe0640 1 -- 172.21.15.43:0/2960428906 wait complete. 2024-04-25T13:44:25.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c52fe0640 1 Processor -- start 2024-04-25T13:44:25.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c52fe0640 1 -- start start 2024-04-25T13:44:25.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c52fe0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c103b00 0x7f3c4c19a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:25.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c52fe0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4c104d40 0x7f3c4c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:25.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c52fe0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c4c109a40 0x7f3c4c1a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:25.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c52fe0640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c10f510 con 0x7f3c4c104d40 2024-04-25T13:44:25.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c52fe0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c10f390 con 0x7f3c4c109a40 2024-04-25T13:44:25.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c52fe0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c10f690 con 0x7f3c4c103b00 2024-04-25T13:44:25.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c4bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4c104d40 0x7f3c4c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:25.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c4bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4c104d40 0x7f3c4c19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38722/0 (socket says 172.21.15.43:38722) 2024-04-25T13:44:25.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c4bfff640 1 -- 172.21.15.43:0/2285743985 learned_addr learned my addr 172.21.15.43:0/2285743985 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:25.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c50d7c640 1 --2- 172.21.15.43:0/2285743985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c103b00 0x7f3c4c19a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:25.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c5157d640 1 --2- 172.21.15.43:0/2285743985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c4c109a40 0x7f3c4c1a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:25.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c4bfff640 1 -- 172.21.15.43:0/2285743985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c103b00 msgr2=0x7f3c4c19a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:25.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c4bfff640 1 --2- 172.21.15.43:0/2285743985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c103b00 0x7f3c4c19a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c4bfff640 1 -- 172.21.15.43:0/2285743985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c4c109a40 msgr2=0x7f3c4c1a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:25.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.720+0000 7f3c4bfff640 1 --2- 172.21.15.43:0/2285743985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c4c109a40 0x7f3c4c1a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.721+0000 7f3c4bfff640 1 -- 172.21.15.43:0/2285743985 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c1a1c20 con 0x7f3c4c104d40 2024-04-25T13:44:25.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.721+0000 7f3c50d7c640 1 --2- 172.21.15.43:0/2285743985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c103b00 0x7f3c4c19a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:44:25.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.721+0000 7f3c5157d640 1 --2- 172.21.15.43:0/2285743985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c4c109a40 0x7f3c4c1a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:44:25.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.721+0000 7f3c4bfff640 1 --2- 172.21.15.43:0/2285743985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4c104d40 0x7f3c4c19a620 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800d950 tx=0x7f3c3800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:25.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.721+0000 7f3c49ffb640 1 -- 172.21.15.43:0/2285743985 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c38017030 con 0x7f3c4c104d40 2024-04-25T13:44:25.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.721+0000 7f3c49ffb640 1 -- 172.21.15.43:0/2285743985 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c38004020 con 0x7f3c4c104d40 2024-04-25T13:44:25.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.721+0000 7f3c52fe0640 1 -- 172.21.15.43:0/2285743985 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4c1a1f10 con 0x7f3c4c104d40 2024-04-25T13:44:25.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.721+0000 7f3c49ffb640 1 -- 172.21.15.43:0/2285743985 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c380055d0 con 0x7f3c4c104d40 2024-04-25T13:44:25.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.721+0000 7f3c52fe0640 1 -- 172.21.15.43:0/2285743985 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c4c1a2380 con 0x7f3c4c104d40 2024-04-25T13:44:25.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.722+0000 7f3c52fe0640 1 -- 172.21.15.43:0/2285743985 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c4c108850 con 0x7f3c4c104d40 2024-04-25T13:44:25.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.724+0000 7f3c49ffb640 1 -- 172.21.15.43:0/2285743985 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f3c38009a30 con 0x7f3c4c104d40 2024-04-25T13:44:25.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.724+0000 7f3c49ffb640 1 --2- 172.21.15.43:0/2285743985 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3c3c0afaf0 0x7f3c3c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:25.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.725+0000 7f3c50d7c640 1 --2- 172.21.15.43:0/2285743985 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3c3c0afaf0 0x7f3c3c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:25.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.725+0000 7f3c49ffb640 1 -- 172.21.15.43:0/2285743985 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f3c380dea30 con 0x7f3c4c104d40 2024-04-25T13:44:25.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.725+0000 7f3c50d7c640 1 --2- 172.21.15.43:0/2285743985 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3c3c0afaf0 0x7f3c3c0b2000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3c400058c0 tx=0x7f3c40005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:25.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.729+0000 7f3c49ffb640 1 -- 172.21.15.43:0/2285743985 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3c380a7290 con 0x7f3c4c104d40 2024-04-25T13:44:25.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.956+0000 7f3c52fe0640 1 -- 172.21.15.43:0/2285743985 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c4c02db50 con 0x7f3c4c104d40 2024-04-25T13:44:25.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.957+0000 7f3c49ffb640 1 -- 172.21.15.43:0/2285743985 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11876 (secure 0 0 0) 0x7f3c380a6b90 con 0x7f3c4c104d40 2024-04-25T13:44:25.957 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:44:25.957 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2642701222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2642701222},{"type":"v1","addr":"172.21.15.43:6839","nonce":2642701222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6841/3777483996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":3777483996},{"type":"v1","addr":"172.21.15.43:6841","nonce":3777483996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T13:42:08.401075+0000","modified":"2024-04-25T13:42:36.143414+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24542,"mds_1":24509,"mds_2":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6839/3323587585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3323587585},{"type":"v1","addr":"172.21.15.175:6839","nonce":3323587585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.161:6837/1464384320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1464384320},{"type":"v1","addr":"172.21.15.161:6837","nonce":1464384320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6839/1243414461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":1243414461},{"type":"v1","addr":"172.21.15.161:6839","nonce":1243414461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24542,"qdb_cluster":[24542,24502,24509]},"id":1}]} 2024-04-25T13:44:25.957 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 24 2024-04-25T13:44:25.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.958+0000 7f3c52fe0640 1 -- 172.21.15.43:0/2285743985 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3c3c0afaf0 msgr2=0x7f3c3c0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:25.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.959+0000 7f3c52fe0640 1 --2- 172.21.15.43:0/2285743985 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3c3c0afaf0 0x7f3c3c0b2000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3c400058c0 tx=0x7f3c40005850 comp rx=0 tx=0).stop 2024-04-25T13:44:25.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.959+0000 7f3c52fe0640 1 -- 172.21.15.43:0/2285743985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4c104d40 msgr2=0x7f3c4c19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:25.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.959+0000 7f3c52fe0640 1 --2- 172.21.15.43:0/2285743985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4c104d40 0x7f3c4c19a620 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800d950 tx=0x7f3c3800de10 comp rx=0 tx=0).stop 2024-04-25T13:44:25.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.959+0000 7f3c52fe0640 1 -- 172.21.15.43:0/2285743985 shutdown_connections 2024-04-25T13:44:25.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.959+0000 7f3c52fe0640 1 --2- 172.21.15.43:0/2285743985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c4c109a40 0x7f3c4c1a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.959+0000 7f3c52fe0640 1 --2- 172.21.15.43:0/2285743985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4c104d40 0x7f3c4c19a620 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.959+0000 7f3c52fe0640 1 --2- 172.21.15.43:0/2285743985 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f3c3c0afaf0 0x7f3c3c0b2000 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.959+0000 7f3c52fe0640 1 --2- 172.21.15.43:0/2285743985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c103b00 0x7f3c4c19a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:25.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.959+0000 7f3c52fe0640 1 -- 172.21.15.43:0/2285743985 >> 172.21.15.43:0/2285743985 conn(0x7f3c4c0fed10 msgr2=0x7f3c4c105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:25.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.959+0000 7f3c52fe0640 1 -- 172.21.15.43:0/2285743985 shutdown_connections 2024-04-25T13:44:25.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:25.959+0000 7f3c52fe0640 1 -- 172.21.15.43:0/2285743985 wait complete. 2024-04-25T13:44:25.971 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:44:26.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.084+0000 7f4fe392d640 1 -- 172.21.15.43:0/1597988202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fdc103c40 msgr2=0x7f4fdc104050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.084+0000 7f4fe392d640 1 --2- 172.21.15.43:0/1597988202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fdc103c40 0x7f4fdc104050 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009900 tx=0x7f4fcc02a410 comp rx=0 tx=0).stop 2024-04-25T13:44:26.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.084+0000 7f4fe392d640 1 -- 172.21.15.43:0/1597988202 shutdown_connections 2024-04-25T13:44:26.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.084+0000 7f4fe392d640 1 --2- 172.21.15.43:0/1597988202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fdc108940 0x7f4fdc10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.084+0000 7f4fe392d640 1 --2- 172.21.15.43:0/1597988202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fdc103c40 0x7f4fdc104050 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.084+0000 7f4fe392d640 1 --2- 172.21.15.43:0/1597988202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fdc102a00 0x7f4fdc103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.084+0000 7f4fe392d640 1 -- 172.21.15.43:0/1597988202 >> 172.21.15.43:0/1597988202 conn(0x7f4fdc0fdbf0 msgr2=0x7f4fdc1000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.084+0000 7f4fe392d640 1 -- 172.21.15.43:0/1597988202 shutdown_connections 2024-04-25T13:44:26.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.084+0000 7f4fe392d640 1 -- 172.21.15.43:0/1597988202 wait complete. 2024-04-25T13:44:26.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.084+0000 7f4fe392d640 1 Processor -- start 2024-04-25T13:44:26.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.084+0000 7f4fe392d640 1 -- start start 2024-04-25T13:44:26.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe392d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fdc102a00 0x7f4fdc075840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe392d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fdc103c40 0x7f4fdc19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe392d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fdc108940 0x7f4fdc1a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe392d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc10e3b0 con 0x7f4fdc103c40 2024-04-25T13:44:26.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe392d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc10e230 con 0x7f4fdc102a00 2024-04-25T13:44:26.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe392d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc10e530 con 0x7f4fdc108940 2024-04-25T13:44:26.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe0ec8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fdc103c40 0x7f4fdc19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe0ec8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fdc103c40 0x7f4fdc19eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38746/0 (socket says 172.21.15.43:38746) 2024-04-25T13:44:26.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe0ec8640 1 -- 172.21.15.43:0/1985162450 learned_addr learned my addr 172.21.15.43:0/1985162450 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe16c9640 1 --2- 172.21.15.43:0/1985162450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fdc102a00 0x7f4fdc075840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe1eca640 1 --2- 172.21.15.43:0/1985162450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fdc108940 0x7f4fdc1a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe0ec8640 1 -- 172.21.15.43:0/1985162450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fdc108940 msgr2=0x7f4fdc1a1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe0ec8640 1 --2- 172.21.15.43:0/1985162450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fdc108940 0x7f4fdc1a1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe0ec8640 1 -- 172.21.15.43:0/1985162450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fdc102a00 msgr2=0x7f4fdc075840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe0ec8640 1 --2- 172.21.15.43:0/1985162450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fdc102a00 0x7f4fdc075840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe0ec8640 1 -- 172.21.15.43:0/1985162450 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc1a1ba0 con 0x7f4fdc103c40 2024-04-25T13:44:26.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe16c9640 1 --2- 172.21.15.43:0/1985162450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fdc102a00 0x7f4fdc075840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:44:26.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fe0ec8640 1 --2- 172.21.15.43:0/1985162450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fdc103c40 0x7f4fdc19eec0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009230 tx=0x7f4fcc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.085+0000 7f4fd27fc640 1 -- 172.21.15.43:0/1985162450 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc03f030 con 0x7f4fdc103c40 2024-04-25T13:44:26.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.086+0000 7f4fd27fc640 1 -- 172.21.15.43:0/1985162450 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4fcc003c90 con 0x7f4fdc103c40 2024-04-25T13:44:26.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.086+0000 7f4fe392d640 1 -- 172.21.15.43:0/1985162450 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fdc1a1e30 con 0x7f4fdc103c40 2024-04-25T13:44:26.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.086+0000 7f4fd27fc640 1 -- 172.21.15.43:0/1985162450 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc035070 con 0x7f4fdc103c40 2024-04-25T13:44:26.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.086+0000 7f4fe392d640 1 -- 172.21.15.43:0/1985162450 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fdc1a2240 con 0x7f4fdc103c40 2024-04-25T13:44:26.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.087+0000 7f4fe392d640 1 -- 172.21.15.43:0/1985162450 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fdc107750 con 0x7f4fdc103c40 2024-04-25T13:44:26.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.088+0000 7f4fd27fc640 1 -- 172.21.15.43:0/1985162450 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f4fcc042030 con 0x7f4fdc103c40 2024-04-25T13:44:26.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.089+0000 7f4fd27fc640 1 --2- 172.21.15.43:0/1985162450 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4fc80afaf0 0x7f4fc80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.089+0000 7f4fe16c9640 1 --2- 172.21.15.43:0/1985162450 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4fc80afaf0 0x7f4fc80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.089+0000 7f4fd27fc640 1 -- 172.21.15.43:0/1985162450 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f4fcc0ff6c0 con 0x7f4fdc103c40 2024-04-25T13:44:26.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.089+0000 7f4fe16c9640 1 --2- 172.21.15.43:0/1985162450 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4fc80afaf0 0x7f4fc80b2000 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80058c0 tx=0x7f4fd8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.094+0000 7f4fd27fc640 1 -- 172.21.15.43:0/1985162450 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4fcc0c7ec0 con 0x7f4fdc103c40 2024-04-25T13:44:26.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.285+0000 7f4fe392d640 1 -- 172.21.15.43:0/1985162450 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4fdc02dd70 con 0x7f4fdc103c40 2024-04-25T13:44:26.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.287+0000 7f4fd27fc640 1 -- 172.21.15.43:0/1985162450 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24693 (secure 0 0 0) 0x7f4fcc0c77c0 con 0x7f4fdc103c40 2024-04-25T13:44:26.287 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:44:26.287 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":84,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:44:00.049268+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:44:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.289+0000 7f4fe392d640 1 -- 172.21.15.43:0/1985162450 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4fc80afaf0 msgr2=0x7f4fc80b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.289+0000 7f4fe392d640 1 --2- 172.21.15.43:0/1985162450 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4fc80afaf0 0x7f4fc80b2000 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80058c0 tx=0x7f4fd8005850 comp rx=0 tx=0).stop 2024-04-25T13:44:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.289+0000 7f4fe392d640 1 -- 172.21.15.43:0/1985162450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fdc103c40 msgr2=0x7f4fdc19eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.289+0000 7f4fe392d640 1 --2- 172.21.15.43:0/1985162450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fdc103c40 0x7f4fdc19eec0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009230 tx=0x7f4fcc0042f0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.289+0000 7f4fe392d640 1 -- 172.21.15.43:0/1985162450 shutdown_connections 2024-04-25T13:44:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.289+0000 7f4fe392d640 1 --2- 172.21.15.43:0/1985162450 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f4fc80afaf0 0x7f4fc80b2000 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.289+0000 7f4fe392d640 1 --2- 172.21.15.43:0/1985162450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fdc108940 0x7f4fdc1a1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.289+0000 7f4fe392d640 1 --2- 172.21.15.43:0/1985162450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fdc103c40 0x7f4fdc19eec0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.289+0000 7f4fe392d640 1 --2- 172.21.15.43:0/1985162450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fdc102a00 0x7f4fdc075840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.289+0000 7f4fe392d640 1 -- 172.21.15.43:0/1985162450 >> 172.21.15.43:0/1985162450 conn(0x7f4fdc0fdbf0 msgr2=0x7f4fdc104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.289+0000 7f4fe392d640 1 -- 172.21.15.43:0/1985162450 shutdown_connections 2024-04-25T13:44:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.289+0000 7f4fe392d640 1 -- 172.21.15.43:0/1985162450 wait complete. 2024-04-25T13:44:26.300 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:26 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2480972663' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:44:26.300 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:26 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2299796647' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:44:26.300 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:26 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2285743985' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:44:26.301 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-25T13:42:08.401075+0000', 'modified': '2024-04-25T13:42:36.143414+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24542, 'mds_1': 24509, 'mds_2': 24502}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24463': {'gid': 24463, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6835/1225446538', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 1225446538}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 1225446538}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.161:6835/2378707176', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6834', 'nonce': 2378707176}, {'type': 'v1', 'addr': '172.21.15.161:6835', 'nonce': 2378707176}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6837/2732559521', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 2732559521}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 2732559521}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.175:6839/3323587585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 3323587585}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 3323587585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24509': {'gid': 24509, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.161:6837/1464384320', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6836', 'nonce': 1464384320}, {'type': 'v1', 'addr': '172.21.15.161:6837', 'nonce': 1464384320}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24542': {'gid': 24542, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.161:6839/1243414461', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6838', 'nonce': 1243414461}, {'type': 'v1', 'addr': '172.21.15.161:6839', 'nonce': 1243414461}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24542, 'qdb_cluster': [24542, 24502, 24509]} 2024-04-25T13:44:26.302 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-25T13:44:26.302 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-25T13:44:26.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.415+0000 7ff0bdd5f640 1 -- 172.21.15.43:0/3419909048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b8104470 msgr2=0x7ff0b810abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.415+0000 7ff0bdd5f640 1 --2- 172.21.15.43:0/3419909048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b8104470 0x7ff0b810abc0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0009ca0 tx=0x7ff0b002a8c0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.415+0000 7ff0bdd5f640 1 -- 172.21.15.43:0/3419909048 shutdown_connections 2024-04-25T13:44:26.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.415+0000 7ff0bdd5f640 1 --2- 172.21.15.43:0/3419909048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b8104470 0x7ff0b810abc0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.415+0000 7ff0bdd5f640 1 --2- 172.21.15.43:0/3419909048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b8103950 0x7ff0b8103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.415+0000 7ff0bdd5f640 1 --2- 172.21.15.43:0/3419909048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b8102f70 0x7ff0b8103380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.415+0000 7ff0bdd5f640 1 -- 172.21.15.43:0/3419909048 >> 172.21.15.43:0/3419909048 conn(0x7ff0b80fd350 msgr2=0x7ff0b80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.415+0000 7ff0bdd5f640 1 -- 172.21.15.43:0/3419909048 shutdown_connections 2024-04-25T13:44:26.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.415+0000 7ff0bdd5f640 1 -- 172.21.15.43:0/3419909048 wait complete. 2024-04-25T13:44:26.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0bdd5f640 1 Processor -- start 2024-04-25T13:44:26.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0bdd5f640 1 -- start start 2024-04-25T13:44:26.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0bdd5f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b8102f70 0x7ff0b819a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0bdd5f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b8103950 0x7ff0b819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0bdd5f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b8104470 0x7ff0b81a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0bdd5f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b810e440 con 0x7ff0b8102f70 2024-04-25T13:44:26.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0bdd5f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b810e2c0 con 0x7ff0b8104470 2024-04-25T13:44:26.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0bdd5f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b810e5c0 con 0x7ff0b8103950 2024-04-25T13:44:26.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0b77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b8102f70 0x7ff0b819a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0b77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b8102f70 0x7ff0b819a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38764/0 (socket says 172.21.15.43:38764) 2024-04-25T13:44:26.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0b77fe640 1 -- 172.21.15.43:0/3870865268 learned_addr learned my addr 172.21.15.43:0/3870865268 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0b7fff640 1 --2- 172.21.15.43:0/3870865268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b8104470 0x7ff0b81a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0b6ffd640 1 --2- 172.21.15.43:0/3870865268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b8103950 0x7ff0b819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0b77fe640 1 -- 172.21.15.43:0/3870865268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b8103950 msgr2=0x7ff0b819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0b77fe640 1 --2- 172.21.15.43:0/3870865268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b8103950 0x7ff0b819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0b77fe640 1 -- 172.21.15.43:0/3870865268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b8104470 msgr2=0x7ff0b81a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0b77fe640 1 --2- 172.21.15.43:0/3870865268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b8104470 0x7ff0b81a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.416+0000 7ff0b77fe640 1 -- 172.21.15.43:0/3870865268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b81a1c00 con 0x7ff0b8102f70 2024-04-25T13:44:26.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.417+0000 7ff0b77fe640 1 --2- 172.21.15.43:0/3870865268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b8102f70 0x7ff0b819a0c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800e9f0 tx=0x7ff0a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.417+0000 7ff0b4ff9640 1 -- 172.21.15.43:0/3870865268 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a800ccc0 con 0x7ff0b8102f70 2024-04-25T13:44:26.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.417+0000 7ff0b4ff9640 1 -- 172.21.15.43:0/3870865268 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0a80054b0 con 0x7ff0b8102f70 2024-04-25T13:44:26.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.417+0000 7ff0bdd5f640 1 -- 172.21.15.43:0/3870865268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b81a1ef0 con 0x7ff0b8102f70 2024-04-25T13:44:26.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.417+0000 7ff0b4ff9640 1 -- 172.21.15.43:0/3870865268 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8010430 con 0x7ff0b8102f70 2024-04-25T13:44:26.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.417+0000 7ff0bdd5f640 1 -- 172.21.15.43:0/3870865268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b81a2300 con 0x7ff0b8102f70 2024-04-25T13:44:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0c4c0b740 1 Processor -- start 2024-04-25T13:44:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0b4ff9640 1 -- 172.21.15.43:0/3870865268 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7ff0a80046c0 con 0x7ff0b8102f70 2024-04-25T13:44:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0c4c0b740 1 -- start start 2024-04-25T13:44:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0c4c0b740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c329270 0x55758c6ca370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0c4c0b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c3003b0 0x55758c6ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0c4c0b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c308590 0x55758c6d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0c4c0b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55758c62f740 con 0x55758c308590 2024-04-25T13:44:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0c4c0b740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x55758c5cb3a0 con 0x55758c329270 2024-04-25T13:44:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0c4c0b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55758c62b700 con 0x55758c3003b0 2024-04-25T13:44:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0b6ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c308590 0x55758c6d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0b6ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c308590 0x55758c6d17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38780/0 (socket says 172.21.15.43:38780) 2024-04-25T13:44:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0b6ffd640 1 -- 172.21.15.43:0/1737581121 learned_addr learned my addr 172.21.15.43:0/1737581121 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0b77fe640 1 --2- 172.21.15.43:0/1737581121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c3003b0 0x55758c6ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0b7fff640 1 --2- 172.21.15.43:0/1737581121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c329270 0x55758c6ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0b4ff9640 1 --2- 172.21.15.43:0/3870865268 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff0a00afaf0 0x7ff0a00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0b6ffd640 1 -- 172.21.15.43:0/1737581121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c3003b0 msgr2=0x55758c6ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0b6ffd640 1 --2- 172.21.15.43:0/1737581121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c3003b0 0x55758c6ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0b6ffd640 1 -- 172.21.15.43:0/1737581121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c329270 msgr2=0x55758c6ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0b6ffd640 1 --2- 172.21.15.43:0/1737581121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c329270 0x55758c6ca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0b6ffd640 1 -- 172.21.15.43:0/1737581121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55758c5e7750 con 0x55758c308590 2024-04-25T13:44:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.420+0000 7ff0b7fff640 1 --2- 172.21.15.43:0/3870865268 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff0a00afaf0 0x7ff0a00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.421+0000 7ff0b4ff9640 1 -- 172.21.15.43:0/3870865268 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7ff0a80df2b0 con 0x7ff0b8102f70 2024-04-25T13:44:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.421+0000 7ff0b6ffd640 1 --2- 172.21.15.43:0/1737581121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c308590 0x55758c6d17f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00bcb0 tx=0x7ff0ac0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37db71dff0b54758 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.421+0000 7ff09dffb640 1 -- 172.21.15.43:0/1737581121 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac01c480 con 0x55758c308590 2024-04-25T13:44:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.421+0000 7ff09dffb640 1 -- 172.21.15.43:0/1737581121 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0ac01cab0 con 0x55758c308590 2024-04-25T13:44:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.421+0000 7ff09dffb640 1 -- 172.21.15.43:0/1737581121 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac011bb0 con 0x55758c308590 2024-04-25T13:44:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.422+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/1737581121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c308590 msgr2=0x55758c6d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.422+0000 7ff0b7fff640 1 --2- 172.21.15.43:0/3870865268 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff0a00afaf0 0x7ff0a00b2000 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55758c6cb540 tx=0x7ff0b003f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.422+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/1737581121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c308590 0x55758c6d17f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00bcb0 tx=0x7ff0ac0107a0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.422+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/1737581121 shutdown_connections 2024-04-25T13:44:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.422+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/1737581121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c308590 0x55758c6d17f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.422+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/1737581121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c3003b0 0x55758c6ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.422+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/1737581121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c329270 0x55758c6ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.422+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/1737581121 >> 172.21.15.43:0/1737581121 conn(0x55758c31d3c0 msgr2=0x55758c6c5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.422+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/1737581121 shutdown_connections 2024-04-25T13:44:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.422+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/1737581121 wait complete. 2024-04-25T13:44:26.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.422+0000 7ff0c4c0b740 1 -- start start 2024-04-25T13:44:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.422+0000 7ff0c4c0b740 1 Processor -- start 2024-04-25T13:44:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0c4c0b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c3003b0 0x55758c6d42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0c4c0b740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c308590 0x55758c6d4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0c4c0b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c329270 0x55758c6db790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0c4c0b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55758c6d2240 con 0x55758c3003b0 2024-04-25T13:44:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0c4c0b740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x55758c5b6fe0 con 0x55758c308590 2024-04-25T13:44:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0c4c0b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55758c6d23c0 con 0x55758c329270 2024-04-25T13:44:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0c4c0b740 10 client.0 _ll_register_callbacks cb 0x55758c5cd150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:44:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0b77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c3003b0 0x55758c6d42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0b77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c3003b0 0x55758c6d42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38794/0 (socket says 172.21.15.43:38794) 2024-04-25T13:44:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0b77fe640 1 -- 172.21.15.43:0/3138662191 learned_addr learned my addr 172.21.15.43:0/3138662191 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0b7fff640 1 --2- 172.21.15.43:0/3138662191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c329270 0x55758c6db790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0b6ffd640 1 --2- 172.21.15.43:0/3138662191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c308590 0x55758c6d4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0b77fe640 1 -- 172.21.15.43:0/3138662191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c329270 msgr2=0x55758c6db790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0b77fe640 1 --2- 172.21.15.43:0/3138662191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c329270 0x55758c6db790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0b77fe640 1 -- 172.21.15.43:0/3138662191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c308590 msgr2=0x55758c6d4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0b77fe640 1 --2- 172.21.15.43:0/3138662191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c308590 0x55758c6d4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0b77fe640 1 -- 172.21.15.43:0/3138662191 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55758c3412d0 con 0x55758c3003b0 2024-04-25T13:44:26.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0b7fff640 1 --2- 172.21.15.43:0/3138662191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c329270 0x55758c6db790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:44:26.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff0b77fe640 1 --2- 172.21.15.43:0/3138662191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c3003b0 0x55758c6d42f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8018000 tx=0x7ff0a80a7a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3bcc298cc3e860 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff096ffd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T13:44:26.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.423+0000 7ff096ffd640 1 -- 172.21.15.43:0/3138662191 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a80a71e0 con 0x55758c3003b0 2024-04-25T13:44:26.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.424+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/3138662191 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0ac01cab0 con 0x55758c3003b0 2024-04-25T13:44:26.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.424+0000 7ff096ffd640 1 -- 172.21.15.43:0/3138662191 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7ff0a80a1db0 con 0x55758c3003b0 2024-04-25T13:44:26.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.424+0000 7ff096ffd640 1 -- 172.21.15.43:0/3138662191 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff0a80a6b80 con 0x55758c3003b0 2024-04-25T13:44:26.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.424+0000 7ff0c4c0b740 10 client.15420 fetch_fsmap learned FSMap version 24 2024-04-25T13:44:26.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.424+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/3138662191 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55758c40b6b0 con 0x55758c3003b0 2024-04-25T13:44:26.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.424+0000 7ff096ffd640 1 -- 172.21.15.43:0/3138662191 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0ac01cab0 con 0x55758c3003b0 2024-04-25T13:44:26.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.424+0000 7ff096ffd640 1 -- 172.21.15.43:0/3138662191 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff0a80a6670 con 0x55758c3003b0 2024-04-25T13:44:26.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.424+0000 7ff0c4c0b740 10 client.15420 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T13:44:26.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.424+0000 7ff0c4c0b740 10 client.15420 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T13:44:26.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.424+0000 7ff0c4c0b740 20 client.15420 populate_metadata read hostname 'smithi043' 2024-04-25T13:44:26.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.424+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/3138662191 >> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] conn(0x55758c2e7e40 0x55758c6e2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.424+0000 7ff0c4c0b740 4 client.15420 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:44:26.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.424+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/3138662191 --> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55758c63d350 con 0x55758c2e7e40 2024-04-25T13:44:26.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.425+0000 7ff0b6ffd640 1 --2- 172.21.15.43:0/3138662191 >> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] conn(0x55758c2e7e40 0x55758c6e2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.425+0000 7ff096ffd640 10 client.15420 ms_handle_connect on v2:172.21.15.175:6838/3323587585 2024-04-25T13:44:26.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.425+0000 7ff0b6ffd640 1 --2- 172.21.15.43:0/3138662191 >> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] conn(0x55758c2e7e40 0x55758c6e2110 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7b927048a7cb971a server_cookie=5a8abd21aae4754d in_seq=0 out_seq=0 2024-04-25T13:44:26.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.426+0000 7ff096ffd640 1 -- 172.21.15.43:0/3138662191 <== mds.2 v2:172.21.15.175:6838/3323587585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55758c63d350 con 0x55758c2e7e40 2024-04-25T13:44:26.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.426+0000 7ff096ffd640 10 client.15420 handle_command_reply: tid=0 2024-04-25T13:44:26.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.426+0000 7ff0c4c0b740 1 client.15420 shutdown 2024-04-25T13:44:26.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.426+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/3138662191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c3003b0 msgr2=0x55758c6d42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.426+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/3138662191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c3003b0 0x55758c6d42f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8018000 tx=0x7ff0a80a7a30 comp rx=0 tx=0).stop 2024-04-25T13:44:26.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.426+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/3138662191 shutdown_connections 2024-04-25T13:44:26.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.426+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/3138662191 >> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] conn(0x55758c2e7e40 0x55758c6e2110 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.426+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/3138662191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c329270 0x55758c6db790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.426+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/3138662191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c308590 0x55758c6d4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.426+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/3138662191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c3003b0 0x55758c6d42f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.426+0000 7ff096ffd640 0 client.15420 ms_handle_reset on v2:172.21.15.175:6838/3323587585 2024-04-25T13:44:26.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.426+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/3138662191 >> 172.21.15.43:0/3138662191 conn(0x55758c31d3c0 msgr2=0x55758c6c4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.426+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/3138662191 shutdown_connections 2024-04-25T13:44:26.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.426+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/3138662191 wait complete. 2024-04-25T13:44:26.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.426+0000 7ff0c4c0b740 20 client.15420 trim_cache size 0 max 16384 2024-04-25T13:44:26.434 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:26 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2480972663' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:44:26.434 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:26 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2299796647' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:44:26.434 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:26 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2285743985' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:44:26.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.445+0000 7ff0c4c0b740 1 Processor -- start 2024-04-25T13:44:26.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.445+0000 7ff0c4c0b740 1 -- start start 2024-04-25T13:44:26.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.445+0000 7ff0c4c0b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c3003b0 0x55758c6cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.445+0000 7ff0c4c0b740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c308590 0x55758c6db720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.445+0000 7ff0c4c0b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c329270 0x55758c6dbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.445+0000 7ff0c4c0b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55758c6e0450 con 0x55758c3003b0 2024-04-25T13:44:26.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.445+0000 7ff0c4c0b740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x55758c6e0b20 con 0x55758c308590 2024-04-25T13:44:26.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.445+0000 7ff0c4c0b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55758c6e11f0 con 0x55758c329270 2024-04-25T13:44:26.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.445+0000 7ff0b77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c3003b0 0x55758c6cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.445+0000 7ff0b77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c3003b0 0x55758c6cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38802/0 (socket says 172.21.15.43:38802) 2024-04-25T13:44:26.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.445+0000 7ff0b77fe640 1 -- 172.21.15.43:0/52957071 learned_addr learned my addr 172.21.15.43:0/52957071 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.446+0000 7ff0b77fe640 1 -- 172.21.15.43:0/52957071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c329270 msgr2=0x55758c6dbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.446+0000 7ff0b77fe640 1 --2- 172.21.15.43:0/52957071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c329270 0x55758c6dbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.446+0000 7ff0b77fe640 1 -- 172.21.15.43:0/52957071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c308590 msgr2=0x55758c6db720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.446+0000 7ff0b6ffd640 1 --2- 172.21.15.43:0/52957071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c308590 0x55758c6db720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.446+0000 7ff0b77fe640 1 --2- 172.21.15.43:0/52957071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c308590 0x55758c6db720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.446+0000 7ff0b77fe640 1 -- 172.21.15.43:0/52957071 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55758c6cf110 con 0x55758c3003b0 2024-04-25T13:44:26.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.446+0000 7ff0b77fe640 1 --2- 172.21.15.43:0/52957071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c3003b0 0x55758c6cd9b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80a4680 tx=0x7ff0a8009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70070d2f7dcad963 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.446+0000 7ff09d7fa640 1 -- 172.21.15.43:0/52957071 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a80a6d60 con 0x55758c3003b0 2024-04-25T13:44:26.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.446+0000 7ff09d7fa640 1 -- 172.21.15.43:0/52957071 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0a80a6f20 con 0x55758c3003b0 2024-04-25T13:44:26.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.446+0000 7ff09d7fa640 1 -- 172.21.15.43:0/52957071 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a80a7410 con 0x55758c3003b0 2024-04-25T13:44:26.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.447+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/52957071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c3003b0 msgr2=0x55758c6cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.447+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/52957071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c3003b0 0x55758c6cd9b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80a4680 tx=0x7ff0a8009330 comp rx=0 tx=0).stop 2024-04-25T13:44:26.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.447+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/52957071 shutdown_connections 2024-04-25T13:44:26.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.447+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/52957071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c329270 0x55758c6dbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.447+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/52957071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c308590 0x55758c6db720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.447+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/52957071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c3003b0 0x55758c6cd9b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.447+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/52957071 >> 172.21.15.43:0/52957071 conn(0x55758c31d3c0 msgr2=0x55758c6d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.447+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/52957071 shutdown_connections 2024-04-25T13:44:26.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.447+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/52957071 wait complete. 2024-04-25T13:44:26.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.447+0000 7ff0c4c0b740 1 -- start start 2024-04-25T13:44:26.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0c4c0b740 1 Processor -- start 2024-04-25T13:44:26.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0c4c0b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c3003b0 0x55758c6d71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0c4c0b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c308590 0x55758c6d76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0c4c0b740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c329270 0x55758c6da620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0c4c0b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55758c6e1f90 con 0x55758c308590 2024-04-25T13:44:26.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0c4c0b740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x55758c6e18c0 con 0x55758c329270 2024-04-25T13:44:26.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0c4c0b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55758c6e2660 con 0x55758c3003b0 2024-04-25T13:44:26.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0c4c0b740 10 client.0 _ll_register_callbacks cb 0x7ff0a800cef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:44:26.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0b6ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c308590 0x55758c6d76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0b6ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c308590 0x55758c6d76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38808/0 (socket says 172.21.15.43:38808) 2024-04-25T13:44:26.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0b6ffd640 1 -- 172.21.15.43:0/4021358694 learned_addr learned my addr 172.21.15.43:0/4021358694 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0b77fe640 1 --2- 172.21.15.43:0/4021358694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c3003b0 0x55758c6d71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0b7fff640 1 --2- 172.21.15.43:0/4021358694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c329270 0x55758c6da620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0b6ffd640 1 -- 172.21.15.43:0/4021358694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c3003b0 msgr2=0x55758c6d71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0b6ffd640 1 --2- 172.21.15.43:0/4021358694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c3003b0 0x55758c6d71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0b6ffd640 1 -- 172.21.15.43:0/4021358694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c329270 msgr2=0x55758c6da620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0b6ffd640 1 --2- 172.21.15.43:0/4021358694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c329270 0x55758c6da620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.448+0000 7ff0b6ffd640 1 -- 172.21.15.43:0/4021358694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55758c6dabe0 con 0x55758c308590 2024-04-25T13:44:26.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.449+0000 7ff0b6ffd640 1 --2- 172.21.15.43:0/4021358694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c308590 0x55758c6d76e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00ba40 tx=0x7ff0ac00b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312b70e1f152fd10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.449+0000 7ff096ffd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T13:44:26.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.449+0000 7ff096ffd640 1 -- 172.21.15.43:0/4021358694 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac005850 con 0x55758c308590 2024-04-25T13:44:26.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.449+0000 7ff096ffd640 1 -- 172.21.15.43:0/4021358694 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7ff0ac005250 con 0x55758c308590 2024-04-25T13:44:26.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.449+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/4021358694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0a80a6f20 con 0x55758c308590 2024-04-25T13:44:26.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.449+0000 7ff096ffd640 1 -- 172.21.15.43:0/4021358694 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff0ac005470 con 0x55758c308590 2024-04-25T13:44:26.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.449+0000 7ff0c4c0b740 10 client.15426 fetch_fsmap learned FSMap version 24 2024-04-25T13:44:26.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.449+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/4021358694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55758c6dbf00 con 0x55758c308590 2024-04-25T13:44:26.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.449+0000 7ff096ffd640 1 -- 172.21.15.43:0/4021358694 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0a80a6f20 con 0x55758c308590 2024-04-25T13:44:26.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.449+0000 7ff096ffd640 1 -- 172.21.15.43:0/4021358694 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff0ac003680 con 0x55758c308590 2024-04-25T13:44:26.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.449+0000 7ff0c4c0b740 10 client.15426 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T13:44:26.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.449+0000 7ff0c4c0b740 10 client.15426 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T13:44:26.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.449+0000 7ff0c4c0b740 20 client.15426 populate_metadata read hostname 'smithi043' 2024-04-25T13:44:26.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.449+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/4021358694 >> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] conn(0x55758c2bd280 0x55758c74dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.449+0000 7ff0c4c0b740 4 client.15426 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:44:26.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.449+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/4021358694 --> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] -- command(tid 0: {"prefix": "status"}) -- 0x55758c6371c0 con 0x55758c2bd280 2024-04-25T13:44:26.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.450+0000 7ff0b77fe640 1 --2- 172.21.15.43:0/4021358694 >> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] conn(0x55758c2bd280 0x55758c74dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.450+0000 7ff096ffd640 10 client.15426 ms_handle_connect on v2:172.21.15.175:6838/3323587585 2024-04-25T13:44:26.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.450+0000 7ff0b77fe640 1 --2- 172.21.15.43:0/4021358694 >> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] conn(0x55758c2bd280 0x55758c74dfd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8c3d0bd246b43c18 server_cookie=6fd47dfa8fe554dd in_seq=0 out_seq=0 2024-04-25T13:44:26.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.450+0000 7ff096ffd640 1 -- 172.21.15.43:0/4021358694 <== mds.2 v2:172.21.15.175:6838/3323587585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55758c6371c0 con 0x55758c2bd280 2024-04-25T13:44:26.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.450+0000 7ff096ffd640 10 client.15426 handle_command_reply: tid=0 2024-04-25T13:44:26.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.450+0000 7ff0c4c0b740 1 client.15426 shutdown 2024-04-25T13:44:26.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.450+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/4021358694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c308590 msgr2=0x55758c6d76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.450+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/4021358694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c308590 0x55758c6d76e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00ba40 tx=0x7ff0ac00b400 comp rx=0 tx=0).stop 2024-04-25T13:44:26.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.450+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/4021358694 shutdown_connections 2024-04-25T13:44:26.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.450+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/4021358694 >> [v2:172.21.15.175:6838/3323587585,v1:172.21.15.175:6839/3323587585] conn(0x55758c2bd280 0x55758c74dfd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/4021358694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55758c329270 0x55758c6da620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/4021358694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55758c308590 0x55758c6d76e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0c4c0b740 1 --2- 172.21.15.43:0/4021358694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55758c3003b0 0x55758c6d71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff096ffd640 0 client.15426 ms_handle_reset on v2:172.21.15.175:6838/3323587585 2024-04-25T13:44:26.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/4021358694 >> 172.21.15.43:0/4021358694 conn(0x55758c31d3c0 msgr2=0x55758c6cd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/4021358694 shutdown_connections 2024-04-25T13:44:26.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0c4c0b740 1 -- 172.21.15.43:0/4021358694 wait complete. 2024-04-25T13:44:26.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0c4c0b740 20 client.15426 trim_cache size 0 max 16384 2024-04-25T13:44:26.456 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T13:44:26.457 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "394efb6c-0308-11ef-bc93-c7b262605968", 2024-04-25T13:44:26.457 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 2, 2024-04-25T13:44:26.457 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24502, 2024-04-25T13:44:26.457 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T13:44:26.457 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T13:44:26.457 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T13:44:26.457 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 111.316433704, 2024-04-25T13:44:26.457 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 24, 2024-04-25T13:44:26.457 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 84, 2024-04-25T13:44:26.457 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 80, 2024-04-25T13:44:26.457 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 152.454310725 2024-04-25T13:44:26.457 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T13:44:26.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0bdd5f640 1 -- 172.21.15.43:0/3870865268 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff0a00afaf0 msgr2=0x7ff0a00b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0bdd5f640 1 --2- 172.21.15.43:0/3870865268 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff0a00afaf0 0x7ff0a00b2000 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55758c6cb540 tx=0x7ff0b003f040 comp rx=0 tx=0).stop 2024-04-25T13:44:26.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0bdd5f640 1 -- 172.21.15.43:0/3870865268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b8102f70 msgr2=0x7ff0b819a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0bdd5f640 1 --2- 172.21.15.43:0/3870865268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b8102f70 0x7ff0b819a0c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800e9f0 tx=0x7ff0a800eeb0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0bdd5f640 1 -- 172.21.15.43:0/3870865268 shutdown_connections 2024-04-25T13:44:26.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0bdd5f640 1 --2- 172.21.15.43:0/3870865268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b8104470 0x7ff0b81a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0bdd5f640 1 --2- 172.21.15.43:0/3870865268 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7ff0a00afaf0 0x7ff0a00b2000 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0bdd5f640 1 --2- 172.21.15.43:0/3870865268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b8103950 0x7ff0b819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0bdd5f640 1 --2- 172.21.15.43:0/3870865268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b8102f70 0x7ff0b819a0c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0bdd5f640 1 -- 172.21.15.43:0/3870865268 >> 172.21.15.43:0/3870865268 conn(0x7ff0b80fd350 msgr2=0x7ff0b80fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0bdd5f640 1 -- 172.21.15.43:0/3870865268 shutdown_connections 2024-04-25T13:44:26.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.451+0000 7ff0bdd5f640 1 -- 172.21.15.43:0/3870865268 wait complete. 2024-04-25T13:44:26.463 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-25T13:44:26.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.576+0000 7fcc7192e640 1 -- 172.21.15.43:0/1133426978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc6c108a30 msgr2=0x7fcc6c10ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.576+0000 7fcc7192e640 1 --2- 172.21.15.43:0/1133426978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc6c108a30 0x7fcc6c10ae50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009ca0 tx=0x7fcc5c02a8c0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.576+0000 7fcc7192e640 1 -- 172.21.15.43:0/1133426978 shutdown_connections 2024-04-25T13:44:26.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.576+0000 7fcc7192e640 1 --2- 172.21.15.43:0/1133426978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc6c108a30 0x7fcc6c10ae50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.576+0000 7fcc7192e640 1 --2- 172.21.15.43:0/1133426978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc6c1043e0 0x7fcc6c102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.576+0000 7fcc7192e640 1 --2- 172.21.15.43:0/1133426978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc6c103f00 0x7fcc6c1027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.576+0000 7fcc7192e640 1 -- 172.21.15.43:0/1133426978 >> 172.21.15.43:0/1133426978 conn(0x7fcc6c0fd380 msgr2=0x7fcc6c0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.576+0000 7fcc7192e640 1 -- 172.21.15.43:0/1133426978 shutdown_connections 2024-04-25T13:44:26.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.576+0000 7fcc7192e640 1 -- 172.21.15.43:0/1133426978 wait complete. 2024-04-25T13:44:26.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.577+0000 7fcc7192e640 1 Processor -- start 2024-04-25T13:44:26.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.577+0000 7fcc7192e640 1 -- start start 2024-04-25T13:44:26.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.577+0000 7fcc7192e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc6c103f00 0x7fcc6c102140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.577+0000 7fcc7192e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc6c108a30 0x7fcc6c19eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.577+0000 7fcc7192e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc6c19eff0 0x7fcc6c1a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.577+0000 7fcc7192e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c10e440 con 0x7fcc6c103f00 2024-04-25T13:44:26.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.577+0000 7fcc7192e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c10e2c0 con 0x7fcc6c108a30 2024-04-25T13:44:26.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.577+0000 7fcc7192e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c10e5c0 con 0x7fcc6c19eff0 2024-04-25T13:44:26.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.577+0000 7fcc6affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc6c103f00 0x7fcc6c102140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.577+0000 7fcc6affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc6c103f00 0x7fcc6c102140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38828/0 (socket says 172.21.15.43:38828) 2024-04-25T13:44:26.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.577+0000 7fcc6affd640 1 -- 172.21.15.43:0/253845944 learned_addr learned my addr 172.21.15.43:0/253845944 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.577+0000 7fcc6b7fe640 1 --2- 172.21.15.43:0/253845944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc6c19eff0 0x7fcc6c1a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.577+0000 7fcc6a7fc640 1 --2- 172.21.15.43:0/253845944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc6c108a30 0x7fcc6c19eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.578+0000 7fcc6affd640 1 -- 172.21.15.43:0/253845944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc6c19eff0 msgr2=0x7fcc6c1a1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.578+0000 7fcc6affd640 1 --2- 172.21.15.43:0/253845944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc6c19eff0 0x7fcc6c1a1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.578+0000 7fcc6affd640 1 -- 172.21.15.43:0/253845944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc6c108a30 msgr2=0x7fcc6c19eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.578+0000 7fcc6affd640 1 --2- 172.21.15.43:0/253845944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc6c108a30 0x7fcc6c19eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.578+0000 7fcc6affd640 1 -- 172.21.15.43:0/253845944 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c1a1c30 con 0x7fcc6c103f00 2024-04-25T13:44:26.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.578+0000 7fcc6affd640 1 --2- 172.21.15.43:0/253845944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc6c103f00 0x7fcc6c102140 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400d740 tx=0x7fcc6400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.578+0000 7fcc7092c640 1 -- 172.21.15.43:0/253845944 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc64017070 con 0x7fcc6c103f00 2024-04-25T13:44:26.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.578+0000 7fcc7092c640 1 -- 172.21.15.43:0/253845944 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc6400de50 con 0x7fcc6c103f00 2024-04-25T13:44:26.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.578+0000 7fcc7092c640 1 -- 172.21.15.43:0/253845944 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc64004c60 con 0x7fcc6c103f00 2024-04-25T13:44:26.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.578+0000 7fcc7192e640 1 -- 172.21.15.43:0/253845944 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc6c1a1f20 con 0x7fcc6c103f00 2024-04-25T13:44:26.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.578+0000 7fcc7192e640 1 -- 172.21.15.43:0/253845944 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc6c1a2330 con 0x7fcc6c103f00 2024-04-25T13:44:26.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc787d9740 1 Processor -- start 2024-04-25T13:44:26.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc7092c640 1 -- 172.21.15.43:0/253845944 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7fcc64004e00 con 0x7fcc6c103f00 2024-04-25T13:44:26.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc787d9740 1 -- start start 2024-04-25T13:44:26.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc787d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccbae270 0x5637ccf4f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc787d9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb853b0 0x5637ccf4f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc787d9740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb8d590 0x5637ccf567f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc787d9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5637cceb4740 con 0x5637ccb853b0 2024-04-25T13:44:26.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc787d9740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x5637cce503a0 con 0x5637ccb8d590 2024-04-25T13:44:26.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc787d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5637cceb0700 con 0x5637ccbae270 2024-04-25T13:44:26.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc6affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb853b0 0x5637ccf4f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc6affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb853b0 0x5637ccf4f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38836/0 (socket says 172.21.15.43:38836) 2024-04-25T13:44:26.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc6affd640 1 -- 172.21.15.43:0/1770033838 learned_addr learned my addr 172.21.15.43:0/1770033838 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc6b7fe640 1 --2- 172.21.15.43:0/1770033838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccbae270 0x5637ccf4f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc6a7fc640 1 --2- 172.21.15.43:0/1770033838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb8d590 0x5637ccf567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc6affd640 1 -- 172.21.15.43:0/1770033838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccbae270 msgr2=0x5637ccf4f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc6affd640 1 --2- 172.21.15.43:0/1770033838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccbae270 0x5637ccf4f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc6affd640 1 -- 172.21.15.43:0/1770033838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb8d590 msgr2=0x5637ccf567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc6affd640 1 --2- 172.21.15.43:0/1770033838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb8d590 0x5637ccf567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.581+0000 7fcc6affd640 1 -- 172.21.15.43:0/1770033838 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637cce6c750 con 0x5637ccb853b0 2024-04-25T13:44:26.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.582+0000 7fcc7092c640 1 --2- 172.21.15.43:0/253845944 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcc580afb70 0x7fcc580b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.582+0000 7fcc6affd640 1 --2- 172.21.15.43:0/1770033838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb853b0 0x5637ccf4f8f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcc640e4c10 tx=0x7fcc640e6690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753c3043301a3e83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.582+0000 7fcc6b7fe640 1 --2- 172.21.15.43:0/253845944 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcc580afb70 0x7fcc580b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.582+0000 7fcc7092c640 1 -- 172.21.15.43:0/253845944 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7fcc640de810 con 0x7fcc6c103f00 2024-04-25T13:44:26.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.582+0000 7fcc61ffb640 1 -- 172.21.15.43:0/1770033838 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc640a28e0 con 0x5637ccb853b0 2024-04-25T13:44:26.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.582+0000 7fcc61ffb640 1 -- 172.21.15.43:0/1770033838 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc640a6530 con 0x5637ccb853b0 2024-04-25T13:44:26.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.582+0000 7fcc61ffb640 1 -- 172.21.15.43:0/1770033838 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc640a6190 con 0x5637ccb853b0 2024-04-25T13:44:26.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.583+0000 7fcc787d9740 1 -- 172.21.15.43:0/1770033838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb853b0 msgr2=0x5637ccf4f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.583+0000 7fcc6b7fe640 1 --2- 172.21.15.43:0/253845944 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcc580afb70 0x7fcc580b2080 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5637ccf50540 tx=0x7fcc5c031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.583+0000 7fcc787d9740 1 --2- 172.21.15.43:0/1770033838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb853b0 0x5637ccf4f8f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcc640e4c10 tx=0x7fcc640e6690 comp rx=0 tx=0).stop 2024-04-25T13:44:26.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.583+0000 7fcc787d9740 1 -- 172.21.15.43:0/1770033838 shutdown_connections 2024-04-25T13:44:26.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.583+0000 7fcc787d9740 1 --2- 172.21.15.43:0/1770033838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb8d590 0x5637ccf567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.583+0000 7fcc787d9740 1 --2- 172.21.15.43:0/1770033838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb853b0 0x5637ccf4f8f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.583+0000 7fcc787d9740 1 --2- 172.21.15.43:0/1770033838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccbae270 0x5637ccf4f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.583+0000 7fcc787d9740 1 -- 172.21.15.43:0/1770033838 >> 172.21.15.43:0/1770033838 conn(0x5637ccba23c0 msgr2=0x5637ccf4ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.583+0000 7fcc787d9740 1 -- 172.21.15.43:0/1770033838 shutdown_connections 2024-04-25T13:44:26.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.583+0000 7fcc787d9740 1 -- 172.21.15.43:0/1770033838 wait complete. 2024-04-25T13:44:26.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.583+0000 7fcc787d9740 1 -- start start 2024-04-25T13:44:26.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc787d9740 1 Processor -- start 2024-04-25T13:44:26.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc787d9740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb853b0 0x5637ccf592b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc787d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb8d590 0x5637ccf597f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc787d9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccbae270 0x5637ccf60750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc787d9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5637ccf57240 con 0x5637ccbae270 2024-04-25T13:44:26.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc787d9740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x5637cce3bfe0 con 0x5637ccb853b0 2024-04-25T13:44:26.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc787d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5637ccf573c0 con 0x5637ccb8d590 2024-04-25T13:44:26.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc787d9740 10 client.0 _ll_register_callbacks cb 0x5637cce52150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:44:26.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc6b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccbae270 0x5637ccf60750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc6a7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb8d590 0x5637ccf597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc6b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccbae270 0x5637ccf60750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38840/0 (socket says 172.21.15.43:38840) 2024-04-25T13:44:26.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc6a7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb8d590 0x5637ccf597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.43:34234/0 (socket says 172.21.15.43:34234) 2024-04-25T13:44:26.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc6b7fe640 1 -- 172.21.15.43:0/1985282742 learned_addr learned my addr 172.21.15.43:0/1985282742 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc6affd640 1 --2- 172.21.15.43:0/1985282742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb853b0 0x5637ccf592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc6b7fe640 1 -- 172.21.15.43:0/1985282742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb8d590 msgr2=0x5637ccf597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc6b7fe640 1 --2- 172.21.15.43:0/1985282742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb8d590 0x5637ccf597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc6b7fe640 1 -- 172.21.15.43:0/1985282742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb853b0 msgr2=0x5637ccf592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc6b7fe640 1 --2- 172.21.15.43:0/1985282742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb853b0 0x5637ccf592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc6b7fe640 1 -- 172.21.15.43:0/1985282742 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637ccbc62d0 con 0x5637ccbae270 2024-04-25T13:44:26.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.584+0000 7fcc6affd640 1 --2- 172.21.15.43:0/1985282742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb853b0 0x5637ccf592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:44:26.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.585+0000 7fcc6b7fe640 1 --2- 172.21.15.43:0/1985282742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccbae270 0x5637ccf60750 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c035000 tx=0x7fcc5c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14584bdf108ae03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.585+0000 7fcc4affd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T13:44:26.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.585+0000 7fcc4affd640 1 -- 172.21.15.43:0/1985282742 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c004250 con 0x5637ccbae270 2024-04-25T13:44:26.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.585+0000 7fcc4affd640 1 -- 172.21.15.43:0/1985282742 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7fcc5c0043f0 con 0x5637ccbae270 2024-04-25T13:44:26.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.585+0000 7fcc787d9740 1 -- 172.21.15.43:0/1985282742 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc640a6530 con 0x5637ccbae270 2024-04-25T13:44:26.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.585+0000 7fcc4affd640 1 -- 172.21.15.43:0/1985282742 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcc5c0045f0 con 0x5637ccbae270 2024-04-25T13:44:26.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.585+0000 7fcc787d9740 10 client.15438 fetch_fsmap learned FSMap version 24 2024-04-25T13:44:26.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.585+0000 7fcc787d9740 1 -- 172.21.15.43:0/1985282742 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5637ccc906b0 con 0x5637ccbae270 2024-04-25T13:44:26.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.585+0000 7fcc4affd640 1 -- 172.21.15.43:0/1985282742 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc640a6530 con 0x5637ccbae270 2024-04-25T13:44:26.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.585+0000 7fcc4affd640 1 -- 172.21.15.43:0/1985282742 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcc5c051070 con 0x5637ccbae270 2024-04-25T13:44:26.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.585+0000 7fcc787d9740 10 client.15438 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T13:44:26.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.585+0000 7fcc787d9740 10 client.15438 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-25T13:44:26.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.585+0000 7fcc787d9740 20 client.15438 populate_metadata read hostname 'smithi043' 2024-04-25T13:44:26.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.585+0000 7fcc787d9740 1 --2- 172.21.15.43:0/1985282742 >> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] conn(0x5637ccb6ce40 0x5637ccf670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.585+0000 7fcc787d9740 4 client.15438 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:44:26.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.585+0000 7fcc787d9740 1 -- 172.21.15.43:0/1985282742 --> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637ccec2350 con 0x5637ccb6ce40 2024-04-25T13:44:26.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.586+0000 7fcc6affd640 1 --2- 172.21.15.43:0/1985282742 >> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] conn(0x5637ccb6ce40 0x5637ccf670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.586+0000 7fcc6affd640 1 --2- 172.21.15.43:0/1985282742 >> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] conn(0x5637ccb6ce40 0x5637ccf670c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2b1351e6567f4f9d server_cookie=2b132fa2c4ec9bf4 in_seq=0 out_seq=0 2024-04-25T13:44:26.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.586+0000 7fcc4affd640 10 client.15438 ms_handle_connect on v2:172.21.15.161:6836/1464384320 2024-04-25T13:44:26.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.587+0000 7fcc4affd640 1 -- 172.21.15.43:0/1985282742 <== mds.1 v2:172.21.15.161:6836/1464384320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5637ccec2350 con 0x5637ccb6ce40 2024-04-25T13:44:26.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.587+0000 7fcc4affd640 10 client.15438 handle_command_reply: tid=0 2024-04-25T13:44:26.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.587+0000 7fcc787d9740 1 client.15438 shutdown 2024-04-25T13:44:26.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.587+0000 7fcc787d9740 1 -- 172.21.15.43:0/1985282742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccbae270 msgr2=0x5637ccf60750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.587+0000 7fcc787d9740 1 --2- 172.21.15.43:0/1985282742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccbae270 0x5637ccf60750 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c035000 tx=0x7fcc5c02a8c0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.587+0000 7fcc787d9740 1 -- 172.21.15.43:0/1985282742 shutdown_connections 2024-04-25T13:44:26.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.587+0000 7fcc787d9740 1 --2- 172.21.15.43:0/1985282742 >> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] conn(0x5637ccb6ce40 0x5637ccf670c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.587+0000 7fcc787d9740 1 --2- 172.21.15.43:0/1985282742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccbae270 0x5637ccf60750 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.587+0000 7fcc787d9740 1 --2- 172.21.15.43:0/1985282742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb8d590 0x5637ccf597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.587+0000 7fcc4affd640 0 client.15438 ms_handle_reset on v2:172.21.15.161:6836/1464384320 2024-04-25T13:44:26.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.587+0000 7fcc787d9740 1 --2- 172.21.15.43:0/1985282742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb853b0 0x5637ccf592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.587+0000 7fcc787d9740 1 -- 172.21.15.43:0/1985282742 >> 172.21.15.43:0/1985282742 conn(0x5637ccba23c0 msgr2=0x5637ccf49d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.587+0000 7fcc787d9740 1 -- 172.21.15.43:0/1985282742 shutdown_connections 2024-04-25T13:44:26.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.587+0000 7fcc787d9740 1 -- 172.21.15.43:0/1985282742 wait complete. 2024-04-25T13:44:26.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.587+0000 7fcc787d9740 20 client.15438 trim_cache size 0 max 16384 2024-04-25T13:44:26.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:26 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2480972663' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:44:26.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:26 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2299796647' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:44:26.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:26 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2285743985' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:44:26.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.606+0000 7fcc787d9740 1 Processor -- start 2024-04-25T13:44:26.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.606+0000 7fcc787d9740 1 -- start start 2024-04-25T13:44:26.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.606+0000 7fcc787d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb6ce40 0x5637ccf57f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.606+0000 7fcc787d9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb853b0 0x5637ccf60670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.606+0000 7fcc787d9740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb8d590 0x5637ccf60bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.606+0000 7fcc787d9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5637ccf65400 con 0x5637ccb853b0 2024-04-25T13:44:26.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.606+0000 7fcc787d9740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x5637ccf65ad0 con 0x5637ccb8d590 2024-04-25T13:44:26.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.606+0000 7fcc787d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5637ccf661a0 con 0x5637ccb6ce40 2024-04-25T13:44:26.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.606+0000 7fcc6a7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb853b0 0x5637ccf60670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.606+0000 7fcc6a7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb853b0 0x5637ccf60670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38848/0 (socket says 172.21.15.43:38848) 2024-04-25T13:44:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.606+0000 7fcc6a7fc640 1 -- 172.21.15.43:0/1348430266 learned_addr learned my addr 172.21.15.43:0/1348430266 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.607+0000 7fcc6b7fe640 1 --2- 172.21.15.43:0/1348430266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb8d590 0x5637ccf60bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.607+0000 7fcc6affd640 1 --2- 172.21.15.43:0/1348430266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb6ce40 0x5637ccf57f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.607+0000 7fcc6a7fc640 1 -- 172.21.15.43:0/1348430266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb6ce40 msgr2=0x5637ccf57f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.607+0000 7fcc6a7fc640 1 --2- 172.21.15.43:0/1348430266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb6ce40 0x5637ccf57f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.607+0000 7fcc6a7fc640 1 -- 172.21.15.43:0/1348430266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb8d590 msgr2=0x5637ccf60bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.607+0000 7fcc6a7fc640 1 --2- 172.21.15.43:0/1348430266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb8d590 0x5637ccf60bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.607+0000 7fcc6a7fc640 1 -- 172.21.15.43:0/1348430266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637ccf540c0 con 0x5637ccb853b0 2024-04-25T13:44:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.607+0000 7fcc6b7fe640 1 --2- 172.21.15.43:0/1348430266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb8d590 0x5637ccf60bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:44:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.607+0000 7fcc6affd640 1 --2- 172.21.15.43:0/1348430266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb6ce40 0x5637ccf57f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:44:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.607+0000 7fcc6a7fc640 1 --2- 172.21.15.43:0/1348430266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb853b0 0x5637ccf60670 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009d70 tx=0x7fcc54005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33a2ffc55637da5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.607+0000 7fcc617fa640 1 -- 172.21.15.43:0/1348430266 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc540120d0 con 0x5637ccb853b0 2024-04-25T13:44:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.607+0000 7fcc617fa640 1 -- 172.21.15.43:0/1348430266 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc54012270 con 0x5637ccb853b0 2024-04-25T13:44:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.607+0000 7fcc617fa640 1 -- 172.21.15.43:0/1348430266 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54004d00 con 0x5637ccb853b0 2024-04-25T13:44:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.608+0000 7fcc787d9740 1 -- 172.21.15.43:0/1348430266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb853b0 msgr2=0x5637ccf60670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.608+0000 7fcc787d9740 1 --2- 172.21.15.43:0/1348430266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb853b0 0x5637ccf60670 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009d70 tx=0x7fcc54005f90 comp rx=0 tx=0).stop 2024-04-25T13:44:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.608+0000 7fcc787d9740 1 -- 172.21.15.43:0/1348430266 shutdown_connections 2024-04-25T13:44:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.608+0000 7fcc787d9740 1 --2- 172.21.15.43:0/1348430266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb8d590 0x5637ccf60bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.608+0000 7fcc787d9740 1 --2- 172.21.15.43:0/1348430266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb853b0 0x5637ccf60670 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.608+0000 7fcc787d9740 1 --2- 172.21.15.43:0/1348430266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb6ce40 0x5637ccf57f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.608+0000 7fcc787d9740 1 -- 172.21.15.43:0/1348430266 >> 172.21.15.43:0/1348430266 conn(0x5637ccba23c0 msgr2=0x5637ccf577f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.608+0000 7fcc787d9740 1 -- 172.21.15.43:0/1348430266 shutdown_connections 2024-04-25T13:44:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.608+0000 7fcc787d9740 1 -- 172.21.15.43:0/1348430266 wait complete. 2024-04-25T13:44:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.608+0000 7fcc787d9740 1 -- start start 2024-04-25T13:44:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.608+0000 7fcc787d9740 1 Processor -- start 2024-04-25T13:44:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc787d9740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb6ce40 0x5637ccf5e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc787d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb853b0 0x5637ccf5e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc787d9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb8d590 0x5637ccf5f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc787d9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5637ccf66f40 con 0x5637ccb8d590 2024-04-25T13:44:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc787d9740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x5637ccf66870 con 0x5637ccb6ce40 2024-04-25T13:44:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc787d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5637ccf67610 con 0x5637ccb853b0 2024-04-25T13:44:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc787d9740 10 client.0 _ll_register_callbacks cb 0x7fcc5c0314d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:44:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc6b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb8d590 0x5637ccf5f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc6b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb8d590 0x5637ccf5f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38860/0 (socket says 172.21.15.43:38860) 2024-04-25T13:44:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc6b7fe640 1 -- 172.21.15.43:0/615910805 learned_addr learned my addr 172.21.15.43:0/615910805 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc6affd640 1 --2- 172.21.15.43:0/615910805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb6ce40 0x5637ccf5e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc6a7fc640 1 --2- 172.21.15.43:0/615910805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb853b0 0x5637ccf5e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc6b7fe640 1 -- 172.21.15.43:0/615910805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb853b0 msgr2=0x5637ccf5e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc6b7fe640 1 --2- 172.21.15.43:0/615910805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb853b0 0x5637ccf5e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc6b7fe640 1 -- 172.21.15.43:0/615910805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb6ce40 msgr2=0x5637ccf5e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc6b7fe640 1 --2- 172.21.15.43:0/615910805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb6ce40 0x5637ccf5e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc6b7fe640 1 -- 172.21.15.43:0/615910805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637ccf5fa60 con 0x5637ccb8d590 2024-04-25T13:44:26.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc6a7fc640 1 --2- 172.21.15.43:0/615910805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb853b0 0x5637ccf5e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:44:26.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc6b7fe640 1 --2- 172.21.15.43:0/615910805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb8d590 0x5637ccf5f4a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c030e10 tx=0x7fcc5c005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3de795ab687d19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc4affd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T13:44:26.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc4affd640 1 -- 172.21.15.43:0/615910805 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c053ae0 con 0x5637ccb8d590 2024-04-25T13:44:26.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc4affd640 1 -- 172.21.15.43:0/615910805 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7fcc5c053c80 con 0x5637ccb8d590 2024-04-25T13:44:26.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.609+0000 7fcc787d9740 1 -- 172.21.15.43:0/615910805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc54012270 con 0x5637ccb8d590 2024-04-25T13:44:26.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.610+0000 7fcc4affd640 1 -- 172.21.15.43:0/615910805 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcc5c06a050 con 0x5637ccb8d590 2024-04-25T13:44:26.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.610+0000 7fcc787d9740 10 client.15444 fetch_fsmap learned FSMap version 24 2024-04-25T13:44:26.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.610+0000 7fcc787d9740 1 -- 172.21.15.43:0/615910805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5637ccf60c60 con 0x5637ccb8d590 2024-04-25T13:44:26.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.610+0000 7fcc4affd640 1 -- 172.21.15.43:0/615910805 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc54012270 con 0x5637ccb8d590 2024-04-25T13:44:26.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.610+0000 7fcc4affd640 1 -- 172.21.15.43:0/615910805 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcc5c051050 con 0x5637ccb8d590 2024-04-25T13:44:26.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.610+0000 7fcc787d9740 10 client.15444 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T13:44:26.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.610+0000 7fcc787d9740 10 client.15444 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-25T13:44:26.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.610+0000 7fcc787d9740 20 client.15444 populate_metadata read hostname 'smithi043' 2024-04-25T13:44:26.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.610+0000 7fcc787d9740 1 --2- 172.21.15.43:0/615910805 >> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] conn(0x5637ccbae270 0x5637ccfd07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.610+0000 7fcc787d9740 4 client.15444 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:44:26.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.610+0000 7fcc787d9740 1 -- 172.21.15.43:0/615910805 --> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] -- command(tid 0: {"prefix": "status"}) -- 0x5637ccebc1c0 con 0x5637ccbae270 2024-04-25T13:44:26.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.610+0000 7fcc6affd640 1 --2- 172.21.15.43:0/615910805 >> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] conn(0x5637ccbae270 0x5637ccfd07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc4affd640 10 client.15444 ms_handle_connect on v2:172.21.15.161:6836/1464384320 2024-04-25T13:44:26.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc6affd640 1 --2- 172.21.15.43:0/615910805 >> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] conn(0x5637ccbae270 0x5637ccfd07b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e1b2a847a9c4f4d0 server_cookie=3a0a7deda579efa2 in_seq=0 out_seq=0 2024-04-25T13:44:26.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc4affd640 1 -- 172.21.15.43:0/615910805 <== mds.1 v2:172.21.15.161:6836/1464384320 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5637ccebc1c0 con 0x5637ccbae270 2024-04-25T13:44:26.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc4affd640 10 client.15444 handle_command_reply: tid=0 2024-04-25T13:44:26.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc787d9740 1 client.15444 shutdown 2024-04-25T13:44:26.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc787d9740 1 -- 172.21.15.43:0/615910805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb8d590 msgr2=0x5637ccf5f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc787d9740 1 --2- 172.21.15.43:0/615910805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb8d590 0x5637ccf5f4a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c030e10 tx=0x7fcc5c005c70 comp rx=0 tx=0).stop 2024-04-25T13:44:26.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc787d9740 1 -- 172.21.15.43:0/615910805 shutdown_connections 2024-04-25T13:44:26.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc787d9740 1 --2- 172.21.15.43:0/615910805 >> [v2:172.21.15.161:6836/1464384320,v1:172.21.15.161:6837/1464384320] conn(0x5637ccbae270 0x5637ccfd07b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc787d9740 1 --2- 172.21.15.43:0/615910805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5637ccb8d590 0x5637ccf5f4a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc787d9740 1 --2- 172.21.15.43:0/615910805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5637ccb853b0 0x5637ccf5e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc787d9740 1 --2- 172.21.15.43:0/615910805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5637ccb6ce40 0x5637ccf5e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc4affd640 0 client.15444 ms_handle_reset on v2:172.21.15.161:6836/1464384320 2024-04-25T13:44:26.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc787d9740 1 -- 172.21.15.43:0/615910805 >> 172.21.15.43:0/615910805 conn(0x5637ccba23c0 msgr2=0x5637ccf58e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc787d9740 1 -- 172.21.15.43:0/615910805 shutdown_connections 2024-04-25T13:44:26.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc787d9740 1 -- 172.21.15.43:0/615910805 wait complete. 2024-04-25T13:44:26.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.611+0000 7fcc787d9740 20 client.15444 trim_cache size 0 max 16384 2024-04-25T13:44:26.619 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T13:44:26.619 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "394efb6c-0308-11ef-bc93-c7b262605968", 2024-04-25T13:44:26.620 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 1, 2024-04-25T13:44:26.620 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24509, 2024-04-25T13:44:26.620 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T13:44:26.620 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T13:44:26.620 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T13:44:26.621 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 112.483962119, 2024-04-25T13:44:26.621 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 24, 2024-04-25T13:44:26.621 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 84, 2024-04-25T13:44:26.621 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 80, 2024-04-25T13:44:26.621 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 155.540924002 2024-04-25T13:44:26.621 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T13:44:26.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.612+0000 7fcc7192e640 1 -- 172.21.15.43:0/253845944 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcc580afb70 msgr2=0x7fcc580b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.612+0000 7fcc7192e640 1 --2- 172.21.15.43:0/253845944 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcc580afb70 0x7fcc580b2080 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5637ccf50540 tx=0x7fcc5c031000 comp rx=0 tx=0).stop 2024-04-25T13:44:26.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.612+0000 7fcc7192e640 1 -- 172.21.15.43:0/253845944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc6c103f00 msgr2=0x7fcc6c102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.612+0000 7fcc7192e640 1 --2- 172.21.15.43:0/253845944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc6c103f00 0x7fcc6c102140 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400d740 tx=0x7fcc6400dc00 comp rx=0 tx=0).stop 2024-04-25T13:44:26.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.612+0000 7fcc7192e640 1 -- 172.21.15.43:0/253845944 shutdown_connections 2024-04-25T13:44:26.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.612+0000 7fcc7192e640 1 --2- 172.21.15.43:0/253845944 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7fcc580afb70 0x7fcc580b2080 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.612+0000 7fcc7192e640 1 --2- 172.21.15.43:0/253845944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc6c19eff0 0x7fcc6c1a1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.612+0000 7fcc7192e640 1 --2- 172.21.15.43:0/253845944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc6c108a30 0x7fcc6c19eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.612+0000 7fcc7192e640 1 --2- 172.21.15.43:0/253845944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc6c103f00 0x7fcc6c102140 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.612+0000 7fcc7192e640 1 -- 172.21.15.43:0/253845944 >> 172.21.15.43:0/253845944 conn(0x7fcc6c0fd380 msgr2=0x7fcc6c0ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.612+0000 7fcc7192e640 1 -- 172.21.15.43:0/253845944 shutdown_connections 2024-04-25T13:44:26.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.612+0000 7fcc7192e640 1 -- 172.21.15.43:0/253845944 wait complete. 2024-04-25T13:44:26.624 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T13:44:26.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.737+0000 7f97fd8cd640 1 -- 172.21.15.43:0/3489021627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97f8109a30 msgr2=0x7f97f810be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.737+0000 7f97fd8cd640 1 --2- 172.21.15.43:0/3489021627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97f8109a30 0x7f97f810be50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009ca0 tx=0x7f97f002a8c0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.737+0000 7f97fd8cd640 1 -- 172.21.15.43:0/3489021627 shutdown_connections 2024-04-25T13:44:26.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.737+0000 7f97fd8cd640 1 --2- 172.21.15.43:0/3489021627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97f8109a30 0x7f97f810be50 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.737+0000 7f97fd8cd640 1 --2- 172.21.15.43:0/3489021627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f8104d30 0x7f97f8105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.737+0000 7f97fd8cd640 1 --2- 172.21.15.43:0/3489021627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97f8103af0 0x7f97f81047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.737+0000 7f97fd8cd640 1 -- 172.21.15.43:0/3489021627 >> 172.21.15.43:0/3489021627 conn(0x7f97f80fece0 msgr2=0x7f97f8101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.737+0000 7f97fd8cd640 1 -- 172.21.15.43:0/3489021627 shutdown_connections 2024-04-25T13:44:26.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.737+0000 7f97fd8cd640 1 -- 172.21.15.43:0/3489021627 wait complete. 2024-04-25T13:44:26.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.738+0000 7f97fd8cd640 1 Processor -- start 2024-04-25T13:44:26.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.738+0000 7f97fd8cd640 1 -- start start 2024-04-25T13:44:26.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.738+0000 7f97fd8cd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f8103af0 0x7f97f819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.738+0000 7f97fd8cd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97f8104d30 0x7f97f819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.738+0000 7f97fd8cd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97f8109a30 0x7f97f81a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.738+0000 7f97fd8cd640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f97f810f500 con 0x7f97f8109a30 2024-04-25T13:44:26.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.738+0000 7f97fd8cd640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f97f810f380 con 0x7f97f8104d30 2024-04-25T13:44:26.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.738+0000 7f97fd8cd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f97f810f680 con 0x7f97f8103af0 2024-04-25T13:44:26.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.738+0000 7f97f77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97f8109a30 0x7f97f81a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.738+0000 7f97f77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97f8109a30 0x7f97f81a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38876/0 (socket says 172.21.15.43:38876) 2024-04-25T13:44:26.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.738+0000 7f97f77fe640 1 -- 172.21.15.43:0/4217284500 learned_addr learned my addr 172.21.15.43:0/4217284500 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.739+0000 7f97f67fc640 1 --2- 172.21.15.43:0/4217284500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97f8104d30 0x7f97f819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.739+0000 7f97f6ffd640 1 --2- 172.21.15.43:0/4217284500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f8103af0 0x7f97f819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.739+0000 7f97f77fe640 1 -- 172.21.15.43:0/4217284500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f8103af0 msgr2=0x7f97f819a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.739+0000 7f97f77fe640 1 --2- 172.21.15.43:0/4217284500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f8103af0 0x7f97f819a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.739+0000 7f97f77fe640 1 -- 172.21.15.43:0/4217284500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97f8104d30 msgr2=0x7f97f819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.739+0000 7f97f77fe640 1 --2- 172.21.15.43:0/4217284500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97f8104d30 0x7f97f819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.739+0000 7f97f77fe640 1 -- 172.21.15.43:0/4217284500 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f81a1bf0 con 0x7f97f8109a30 2024-04-25T13:44:26.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.739+0000 7f97f77fe640 1 --2- 172.21.15.43:0/4217284500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97f8109a30 0x7f97f81a1580 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f97f0005e30 tx=0x7f97f0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.739+0000 7f97fc8cb640 1 -- 172.21.15.43:0/4217284500 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0032e90 con 0x7f97f8109a30 2024-04-25T13:44:26.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.739+0000 7f97fd8cd640 1 -- 172.21.15.43:0/4217284500 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f81a1e80 con 0x7f97f8109a30 2024-04-25T13:44:26.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.739+0000 7f97fc8cb640 1 -- 172.21.15.43:0/4217284500 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97f00044d0 con 0x7f97f8109a30 2024-04-25T13:44:26.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.739+0000 7f97fc8cb640 1 -- 172.21.15.43:0/4217284500 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0030ce0 con 0x7f97f8109a30 2024-04-25T13:44:26.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.739+0000 7f97fd8cd640 1 -- 172.21.15.43:0/4217284500 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f81a2340 con 0x7f97f8109a30 2024-04-25T13:44:26.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.742+0000 7f97fc8cb640 1 -- 172.21.15.43:0/4217284500 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f97f0004040 con 0x7f97f8109a30 2024-04-25T13:44:26.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.742+0000 7f9804778740 1 Processor -- start 2024-04-25T13:44:26.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.742+0000 7f9804778740 1 -- start start 2024-04-25T13:44:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.742+0000 7f9804778740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc35370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.742+0000 7f9804778740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c86b3b0 0x55929cc358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.742+0000 7f9804778740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c873590 0x55929cc3c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.742+0000 7f9804778740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55929cb9a740 con 0x55929c894270 2024-04-25T13:44:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.742+0000 7f9804778740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x55929cb363a0 con 0x55929c86b3b0 2024-04-25T13:44:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.742+0000 7f9804778740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55929cb96700 con 0x55929c873590 2024-04-25T13:44:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.742+0000 7f97f6ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c86b3b0 0x55929cc358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.742+0000 7f97f67fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc35370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.742+0000 7f97f67fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc35370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38888/0 (socket says 172.21.15.43:38888) 2024-04-25T13:44:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.742+0000 7f97f67fc640 1 -- 172.21.15.43:0/463608829 learned_addr learned my addr 172.21.15.43:0/463608829 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.742+0000 7f97f6ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c86b3b0 0x55929cc358f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.43:54128/0 (socket says 172.21.15.43:54128) 2024-04-25T13:44:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.742+0000 7f97fc8cb640 1 --2- 172.21.15.43:0/4217284500 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f97e00afaf0 0x7f97e00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.743+0000 7f97f77fe640 1 --2- 172.21.15.43:0/4217284500 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f97e00afaf0 0x7f97e00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.743+0000 7f97f6ffd640 1 -- 172.21.15.43:0/463608829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c873590 msgr2=0x55929cc3c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.743+0000 7f97f6ffd640 1 --2- 172.21.15.43:0/463608829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c873590 0x55929cc3c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.743+0000 7f97f6ffd640 1 -- 172.21.15.43:0/463608829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 msgr2=0x55929cc35370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.743+0000 7f97f6ffd640 1 --2- 172.21.15.43:0/463608829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc35370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.743+0000 7f97fc8cb640 1 -- 172.21.15.43:0/4217284500 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f97f0100600 con 0x7f97f8109a30 2024-04-25T13:44:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.743+0000 7f97f6ffd640 1 -- 172.21.15.43:0/463608829 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55929cb52750 con 0x55929c86b3b0 2024-04-25T13:44:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.743+0000 7f97f67fc640 1 --2- 172.21.15.43:0/463608829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc35370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:44:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.743+0000 7f97f6ffd640 1 --2- 172.21.15.43:0/463608829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c86b3b0 0x55929cc358f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f97f81033c0 tx=0x7f97e8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de72f845a24b0ae7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.743+0000 7f97f77fe640 1 --2- 172.21.15.43:0/4217284500 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f97e00afaf0 0x7f97e00b2000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f97f0031920 tx=0x7f97f00bd0a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.743+0000 7f97ddffb640 1 -- 172.21.15.43:0/463608829 <== mon.2 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8009d70 con 0x55929c86b3b0 2024-04-25T13:44:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.743+0000 7f97ddffb640 1 -- 172.21.15.43:0/463608829 <== mon.2 v2:172.21.15.161:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97e8005020 con 0x55929c86b3b0 2024-04-25T13:44:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.743+0000 7f97ddffb640 1 -- 172.21.15.43:0/463608829 <== mon.2 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8004a00 con 0x55929c86b3b0 2024-04-25T13:44:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.744+0000 7f9804778740 1 -- 172.21.15.43:0/463608829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c86b3b0 msgr2=0x55929cc358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.744+0000 7f9804778740 1 --2- 172.21.15.43:0/463608829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c86b3b0 0x55929cc358f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f97f81033c0 tx=0x7f97e8011810 comp rx=0 tx=0).stop 2024-04-25T13:44:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.744+0000 7f9804778740 1 -- 172.21.15.43:0/463608829 shutdown_connections 2024-04-25T13:44:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.744+0000 7f9804778740 1 --2- 172.21.15.43:0/463608829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c873590 0x55929cc3c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.744+0000 7f9804778740 1 --2- 172.21.15.43:0/463608829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c86b3b0 0x55929cc358f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.744+0000 7f9804778740 1 --2- 172.21.15.43:0/463608829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc35370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.744+0000 7f9804778740 1 -- 172.21.15.43:0/463608829 >> 172.21.15.43:0/463608829 conn(0x55929c8883c0 msgr2=0x55929cc30d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.744+0000 7f9804778740 1 -- 172.21.15.43:0/463608829 shutdown_connections 2024-04-25T13:44:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.744+0000 7f9804778740 1 -- 172.21.15.43:0/463608829 wait complete. 2024-04-25T13:44:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.744+0000 7f9804778740 1 -- start start 2024-04-25T13:44:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f9804778740 1 Processor -- start 2024-04-25T13:44:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f9804778740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c86b3b0 0x55929cc3f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f9804778740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c873590 0x55929cc3f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f9804778740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc46770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f9804778740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55929cc3d240 con 0x55929c894270 2024-04-25T13:44:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f9804778740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x55929cb21fe0 con 0x55929c873590 2024-04-25T13:44:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f9804778740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55929cc3d3c0 con 0x55929c86b3b0 2024-04-25T13:44:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f9804778740 10 client.0 _ll_register_callbacks cb 0x55929cb38150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:44:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f97f67fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc46770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f97f67fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc46770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38896/0 (socket says 172.21.15.43:38896) 2024-04-25T13:44:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f97f67fc640 1 -- 172.21.15.43:0/65568173 learned_addr learned my addr 172.21.15.43:0/65568173 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f97f67fc640 1 --2- 172.21.15.43:0/65568173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c86b3b0 0x55929cc3f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f97f6ffd640 1 --2- 172.21.15.43:0/65568173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c873590 0x55929cc3f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f97f67fc640 1 -- 172.21.15.43:0/65568173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c86b3b0 msgr2=0x55929cc3f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f97f67fc640 1 --2- 172.21.15.43:0/65568173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c86b3b0 0x55929cc3f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f97f67fc640 1 -- 172.21.15.43:0/65568173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c873590 msgr2=0x55929cc3f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f97f67fc640 1 --2- 172.21.15.43:0/65568173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c873590 0x55929cc3f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.745+0000 7f97f67fc640 1 -- 172.21.15.43:0/65568173 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55929c8ac2d0 con 0x55929c894270 2024-04-25T13:44:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.746+0000 7f97f67fc640 1 --2- 172.21.15.43:0/65568173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc46770 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f97ec012990 tx=0x7f97ec00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a1088b91ed8c57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.746+0000 7f97d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T13:44:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.746+0000 7f97d6ffd640 1 -- 172.21.15.43:0/65568173 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0120d0 con 0x55929c894270 2024-04-25T13:44:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.746+0000 7f97d6ffd640 1 -- 172.21.15.43:0/65568173 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f97ec004020 con 0x55929c894270 2024-04-25T13:44:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.746+0000 7f9804778740 1 -- 172.21.15.43:0/65568173 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97e8005020 con 0x55929c894270 2024-04-25T13:44:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.746+0000 7f97d6ffd640 1 -- 172.21.15.43:0/65568173 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f97ec012270 con 0x55929c894270 2024-04-25T13:44:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.746+0000 7f9804778740 10 client.15456 fetch_fsmap learned FSMap version 24 2024-04-25T13:44:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.746+0000 7f9804778740 1 -- 172.21.15.43:0/65568173 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55929c9766b0 con 0x55929c894270 2024-04-25T13:44:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.746+0000 7f97d6ffd640 1 -- 172.21.15.43:0/65568173 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97e8005020 con 0x55929c894270 2024-04-25T13:44:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.746+0000 7f97d6ffd640 1 -- 172.21.15.43:0/65568173 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f97ec0050b0 con 0x55929c894270 2024-04-25T13:44:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.746+0000 7f9804778740 10 client.15456 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T13:44:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.746+0000 7f9804778740 10 client.15456 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T13:44:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.746+0000 7f9804778740 20 client.15456 populate_metadata read hostname 'smithi043' 2024-04-25T13:44:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.746+0000 7f9804778740 1 --2- 172.21.15.43:0/65568173 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x55929c852e40 0x55929cc4d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.746+0000 7f9804778740 4 client.15456 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:44:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.746+0000 7f9804778740 1 -- 172.21.15.43:0/65568173 --> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55929cba8350 con 0x55929c852e40 2024-04-25T13:44:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.747+0000 7f97f6ffd640 1 --2- 172.21.15.43:0/65568173 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x55929c852e40 0x55929cc4d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.747+0000 7f97d6ffd640 10 client.15456 ms_handle_connect on v2:172.21.15.161:6838/1243414461 2024-04-25T13:44:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.747+0000 7f97f6ffd640 1 --2- 172.21.15.43:0/65568173 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x55929c852e40 0x55929cc4d080 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53f94a8c5736ced9 server_cookie=3d0e0dda57279296 in_seq=0 out_seq=0 2024-04-25T13:44:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.748+0000 7f97d6ffd640 1 -- 172.21.15.43:0/65568173 <== mds.0 v2:172.21.15.161:6838/1243414461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55929cba8350 con 0x55929c852e40 2024-04-25T13:44:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.748+0000 7f97d6ffd640 10 client.15456 handle_command_reply: tid=0 2024-04-25T13:44:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.748+0000 7f9804778740 1 client.15456 shutdown 2024-04-25T13:44:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.748+0000 7f9804778740 1 -- 172.21.15.43:0/65568173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 msgr2=0x55929cc46770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.748+0000 7f9804778740 1 --2- 172.21.15.43:0/65568173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc46770 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f97ec012990 tx=0x7f97ec00b410 comp rx=0 tx=0).stop 2024-04-25T13:44:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.748+0000 7f9804778740 1 -- 172.21.15.43:0/65568173 shutdown_connections 2024-04-25T13:44:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.748+0000 7f9804778740 1 --2- 172.21.15.43:0/65568173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc46770 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.748+0000 7f9804778740 1 --2- 172.21.15.43:0/65568173 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x55929c852e40 0x55929cc4d080 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.748+0000 7f9804778740 1 --2- 172.21.15.43:0/65568173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c873590 0x55929cc3f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.748+0000 7f9804778740 1 --2- 172.21.15.43:0/65568173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c86b3b0 0x55929cc3f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.748+0000 7f97d6ffd640 0 client.15456 ms_handle_reset on v2:172.21.15.161:6838/1243414461 2024-04-25T13:44:26.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.748+0000 7f9804778740 1 -- 172.21.15.43:0/65568173 >> 172.21.15.43:0/65568173 conn(0x55929c8883c0 msgr2=0x55929cc2fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.748+0000 7f9804778740 1 -- 172.21.15.43:0/65568173 shutdown_connections 2024-04-25T13:44:26.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.748+0000 7f9804778740 1 -- 172.21.15.43:0/65568173 wait complete. 2024-04-25T13:44:26.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.748+0000 7f9804778740 20 client.15456 trim_cache size 0 max 16384 2024-04-25T13:44:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.767+0000 7f9804778740 1 Processor -- start 2024-04-25T13:44:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.767+0000 7f9804778740 1 -- start start 2024-04-25T13:44:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.767+0000 7f9804778740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c86b3b0 0x55929cc2ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.767+0000 7f9804778740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c873590 0x55929cc46690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.767+0000 7f9804778740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c894270 0x55929cc46bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.767+0000 7f9804778740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55929cc4b3c0 con 0x55929c873590 2024-04-25T13:44:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.767+0000 7f9804778740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x55929cc4ba90 con 0x55929c894270 2024-04-25T13:44:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.767+0000 7f9804778740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55929cc4c160 con 0x55929c86b3b0 2024-04-25T13:44:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.767+0000 7f97f6ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c873590 0x55929cc46690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.767+0000 7f97f6ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c873590 0x55929cc46690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38898/0 (socket says 172.21.15.43:38898) 2024-04-25T13:44:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.767+0000 7f97f6ffd640 1 -- 172.21.15.43:0/2002811682 learned_addr learned my addr 172.21.15.43:0/2002811682 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.767+0000 7f97f6ffd640 1 -- 172.21.15.43:0/2002811682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c86b3b0 msgr2=0x55929cc2ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.767+0000 7f97f6ffd640 1 --2- 172.21.15.43:0/2002811682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c86b3b0 0x55929cc2ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.767+0000 7f97f6ffd640 1 -- 172.21.15.43:0/2002811682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c894270 msgr2=0x55929cc46bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.767+0000 7f97f6ffd640 1 --2- 172.21.15.43:0/2002811682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c894270 0x55929cc46bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.768+0000 7f97f6ffd640 1 -- 172.21.15.43:0/2002811682 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55929cc3a0f0 con 0x55929c873590 2024-04-25T13:44:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.768+0000 7f97f6ffd640 1 --2- 172.21.15.43:0/2002811682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c873590 0x55929cc46690 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f97e8005310 tx=0x7f97e8005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf99fd632f510fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.768+0000 7f97dd7fa640 1 -- 172.21.15.43:0/2002811682 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8009d70 con 0x55929c873590 2024-04-25T13:44:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.768+0000 7f97dd7fa640 1 -- 172.21.15.43:0/2002811682 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97e8005440 con 0x55929c873590 2024-04-25T13:44:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.768+0000 7f97dd7fa640 1 -- 172.21.15.43:0/2002811682 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8019450 con 0x55929c873590 2024-04-25T13:44:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.769+0000 7f9804778740 1 -- 172.21.15.43:0/2002811682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c873590 msgr2=0x55929cc46690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.769+0000 7f9804778740 1 --2- 172.21.15.43:0/2002811682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c873590 0x55929cc46690 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f97e8005310 tx=0x7f97e8005780 comp rx=0 tx=0).stop 2024-04-25T13:44:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.769+0000 7f9804778740 1 -- 172.21.15.43:0/2002811682 shutdown_connections 2024-04-25T13:44:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.769+0000 7f9804778740 1 --2- 172.21.15.43:0/2002811682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c894270 0x55929cc46bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.769+0000 7f9804778740 1 --2- 172.21.15.43:0/2002811682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c873590 0x55929cc46690 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.769+0000 7f9804778740 1 --2- 172.21.15.43:0/2002811682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c86b3b0 0x55929cc2ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.769+0000 7f9804778740 1 -- 172.21.15.43:0/2002811682 >> 172.21.15.43:0/2002811682 conn(0x55929c8883c0 msgr2=0x55929cc3d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.769+0000 7f9804778740 1 -- 172.21.15.43:0/2002811682 shutdown_connections 2024-04-25T13:44:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.769+0000 7f9804778740 1 -- 172.21.15.43:0/2002811682 wait complete. 2024-04-25T13:44:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.769+0000 7f9804778740 1 -- start start 2024-04-25T13:44:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.769+0000 7f9804778740 1 Processor -- start 2024-04-25T13:44:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.769+0000 7f9804778740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c86b3b0 0x55929cc42840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f9804778740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c873590 0x55929cc42d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f9804778740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc45c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f9804778740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55929cc4cf00 con 0x55929c894270 2024-04-25T13:44:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f9804778740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x55929cc4c830 con 0x55929c86b3b0 2024-04-25T13:44:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f9804778740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55929cc4d5d0 con 0x55929c873590 2024-04-25T13:44:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f9804778740 10 client.0 _ll_register_callbacks cb 0x7f97ec00ba70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:44:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f97f67fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc45c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f97f67fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc45c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38912/0 (socket says 172.21.15.43:38912) 2024-04-25T13:44:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f97f67fc640 1 -- 172.21.15.43:0/3640225129 learned_addr learned my addr 172.21.15.43:0/3640225129 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f97f6ffd640 1 --2- 172.21.15.43:0/3640225129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c873590 0x55929cc42d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f97f67fc640 1 --2- 172.21.15.43:0/3640225129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c86b3b0 0x55929cc42840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f97f67fc640 1 -- 172.21.15.43:0/3640225129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c873590 msgr2=0x55929cc42d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f97f67fc640 1 --2- 172.21.15.43:0/3640225129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c873590 0x55929cc42d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f97f67fc640 1 -- 172.21.15.43:0/3640225129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c86b3b0 msgr2=0x55929cc42840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f97f67fc640 1 --2- 172.21.15.43:0/3640225129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c86b3b0 0x55929cc42840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f97f67fc640 1 -- 172.21.15.43:0/3640225129 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55929cc461e0 con 0x55929c894270 2024-04-25T13:44:26.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f97f67fc640 1 --2- 172.21.15.43:0/3640225129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc45c20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f97ec005fd0 tx=0x7f97ec005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e453c558deaafb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f97d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T13:44:26.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f97d6ffd640 1 -- 172.21.15.43:0/3640225129 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00b410 con 0x55929c894270 2024-04-25T13:44:26.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f9804778740 1 -- 172.21.15.43:0/3640225129 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97e8005440 con 0x55929c894270 2024-04-25T13:44:26.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f97d6ffd640 1 -- 172.21.15.43:0/3640225129 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f97ec012410 con 0x55929c894270 2024-04-25T13:44:26.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f97d6ffd640 1 -- 172.21.15.43:0/3640225129 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f97ec004020 con 0x55929c894270 2024-04-25T13:44:26.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.770+0000 7f9804778740 10 client.15462 fetch_fsmap learned FSMap version 24 2024-04-25T13:44:26.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.771+0000 7f9804778740 1 -- 172.21.15.43:0/3640225129 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55929ccb5f00 con 0x55929c894270 2024-04-25T13:44:26.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.771+0000 7f97d6ffd640 1 -- 172.21.15.43:0/3640225129 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97e8005440 con 0x55929c894270 2024-04-25T13:44:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.771+0000 7f97d6ffd640 1 -- 172.21.15.43:0/3640225129 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f97ec003a80 con 0x55929c894270 2024-04-25T13:44:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.771+0000 7f9804778740 10 client.15462 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T13:44:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.771+0000 7f9804778740 10 client.15462 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T13:44:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.771+0000 7f9804778740 20 client.15462 populate_metadata read hostname 'smithi043' 2024-04-25T13:44:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.771+0000 7f9804778740 1 --2- 172.21.15.43:0/3640225129 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x55929c828280 0x55929ccb97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.771+0000 7f9804778740 4 client.15462 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:44:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.771+0000 7f9804778740 1 -- 172.21.15.43:0/3640225129 --> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] -- command(tid 0: {"prefix": "status"}) -- 0x55929cba21c0 con 0x55929c828280 2024-04-25T13:44:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.771+0000 7f97f6ffd640 1 --2- 172.21.15.43:0/3640225129 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x55929c828280 0x55929ccb97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f97f6ffd640 1 --2- 172.21.15.43:0/3640225129 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x55929c828280 0x55929ccb97a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4e332d04cb0cca1 server_cookie=6295a03a103fac22 in_seq=0 out_seq=0 2024-04-25T13:44:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f97d6ffd640 10 client.15462 ms_handle_connect on v2:172.21.15.161:6838/1243414461 2024-04-25T13:44:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f97d6ffd640 1 -- 172.21.15.43:0/3640225129 <== mds.0 v2:172.21.15.161:6838/1243414461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55929cba21c0 con 0x55929c828280 2024-04-25T13:44:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f97d6ffd640 10 client.15462 handle_command_reply: tid=0 2024-04-25T13:44:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f9804778740 1 client.15462 shutdown 2024-04-25T13:44:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f9804778740 1 -- 172.21.15.43:0/3640225129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 msgr2=0x55929cc45c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f9804778740 1 --2- 172.21.15.43:0/3640225129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc45c20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f97ec005fd0 tx=0x7f97ec005750 comp rx=0 tx=0).stop 2024-04-25T13:44:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f9804778740 1 -- 172.21.15.43:0/3640225129 shutdown_connections 2024-04-25T13:44:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f9804778740 1 --2- 172.21.15.43:0/3640225129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55929c894270 0x55929cc45c20 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f9804778740 1 --2- 172.21.15.43:0/3640225129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55929c873590 0x55929cc42d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f9804778740 1 --2- 172.21.15.43:0/3640225129 >> [v2:172.21.15.161:6838/1243414461,v1:172.21.15.161:6839/1243414461] conn(0x55929c828280 0x55929ccb97a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f9804778740 1 --2- 172.21.15.43:0/3640225129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55929c86b3b0 0x55929cc42840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f97d6ffd640 0 client.15462 ms_handle_reset on v2:172.21.15.161:6838/1243414461 2024-04-25T13:44:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f9804778740 1 -- 172.21.15.43:0/3640225129 >> 172.21.15.43:0/3640225129 conn(0x55929c8883c0 msgr2=0x55929cc306b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f9804778740 1 -- 172.21.15.43:0/3640225129 shutdown_connections 2024-04-25T13:44:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f9804778740 1 -- 172.21.15.43:0/3640225129 wait complete. 2024-04-25T13:44:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.772+0000 7f9804778740 20 client.15462 trim_cache size 0 max 16384 2024-04-25T13:44:26.780 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T13:44:26.780 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "394efb6c-0308-11ef-bc93-c7b262605968", 2024-04-25T13:44:26.780 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-04-25T13:44:26.780 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24542, 2024-04-25T13:44:26.780 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T13:44:26.780 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T13:44:26.780 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T13:44:26.780 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 137.75474295699999, 2024-04-25T13:44:26.780 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 24, 2024-04-25T13:44:26.780 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 84, 2024-04-25T13:44:26.780 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 80, 2024-04-25T13:44:26.780 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 144.04568200700001 2024-04-25T13:44:26.781 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T13:44:26.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.773+0000 7f97fd8cd640 1 -- 172.21.15.43:0/4217284500 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f97e00afaf0 msgr2=0x7f97e00b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.773+0000 7f97fd8cd640 1 --2- 172.21.15.43:0/4217284500 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f97e00afaf0 0x7f97e00b2000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f97f0031920 tx=0x7f97f00bd0a0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.773+0000 7f97fd8cd640 1 -- 172.21.15.43:0/4217284500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97f8109a30 msgr2=0x7f97f81a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.773+0000 7f97fd8cd640 1 --2- 172.21.15.43:0/4217284500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97f8109a30 0x7f97f81a1580 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f97f0005e30 tx=0x7f97f0003ba0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.773+0000 7f97fd8cd640 1 -- 172.21.15.43:0/4217284500 shutdown_connections 2024-04-25T13:44:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.773+0000 7f97fd8cd640 1 --2- 172.21.15.43:0/4217284500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97f8109a30 0x7f97f81a1580 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.773+0000 7f97fd8cd640 1 --2- 172.21.15.43:0/4217284500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97f8104d30 0x7f97f819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.773+0000 7f97fd8cd640 1 --2- 172.21.15.43:0/4217284500 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f97e00afaf0 0x7f97e00b2000 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.773+0000 7f97fd8cd640 1 --2- 172.21.15.43:0/4217284500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f8103af0 0x7f97f819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.773+0000 7f97fd8cd640 1 -- 172.21.15.43:0/4217284500 >> 172.21.15.43:0/4217284500 conn(0x7f97f80fece0 msgr2=0x7f97f8105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.773+0000 7f97fd8cd640 1 -- 172.21.15.43:0/4217284500 shutdown_connections 2024-04-25T13:44:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.773+0000 7f97fd8cd640 1 -- 172.21.15.43:0/4217284500 wait complete. 2024-04-25T13:44:26.784 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T13:44:26.795 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T13:44:26.795 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T13:44:26.796 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T13:44:26.796 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-04-25T13:44:26.796 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T13:44:26.796 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T13:44:26.797 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-04-25T13:44:26.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.909+0000 7f7608515640 1 -- 172.21.15.43:0/3148388594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7600109a80 msgr2=0x7f760010bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.909+0000 7f7608515640 1 --2- 172.21.15.43:0/3148388594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7600109a80 0x7f760010bea0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009900 tx=0x7f75fc02a410 comp rx=0 tx=0).stop 2024-04-25T13:44:26.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.909+0000 7f7608515640 1 -- 172.21.15.43:0/3148388594 shutdown_connections 2024-04-25T13:44:26.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.909+0000 7f7608515640 1 --2- 172.21.15.43:0/3148388594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7600109a80 0x7f760010bea0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.909+0000 7f7608515640 1 --2- 172.21.15.43:0/3148388594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7600104d80 0x7f7600105190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.909+0000 7f7608515640 1 --2- 172.21.15.43:0/3148388594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7600103b40 0x7f7600104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.909+0000 7f7608515640 1 -- 172.21.15.43:0/3148388594 >> 172.21.15.43:0/3148388594 conn(0x7f76000fed30 msgr2=0x7f76001011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:26.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.909+0000 7f7608515640 1 -- 172.21.15.43:0/3148388594 shutdown_connections 2024-04-25T13:44:26.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.909+0000 7f7608515640 1 -- 172.21.15.43:0/3148388594 wait complete. 2024-04-25T13:44:26.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.909+0000 7f7608515640 1 Processor -- start 2024-04-25T13:44:26.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7608515640 1 -- start start 2024-04-25T13:44:26.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7608515640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7600103b40 0x7f760019a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7608515640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7600104d80 0x7f760019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7608515640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7600109a80 0x7f76001a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7608515640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f760010f520 con 0x7f7600109a80 2024-04-25T13:44:26.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7608515640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f760010f3a0 con 0x7f7600104d80 2024-04-25T13:44:26.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7608515640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f760010f6a0 con 0x7f7600103b40 2024-04-25T13:44:26.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7606ab2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7600109a80 0x7f76001a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7606ab2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7600109a80 0x7f76001a1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38932/0 (socket says 172.21.15.43:38932) 2024-04-25T13:44:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7606ab2640 1 -- 172.21.15.43:0/3597680229 learned_addr learned my addr 172.21.15.43:0/3597680229 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f76062b1640 1 --2- 172.21.15.43:0/3597680229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7600103b40 0x7f760019a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7605ab0640 1 --2- 172.21.15.43:0/3597680229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7600104d80 0x7f760019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7606ab2640 1 -- 172.21.15.43:0/3597680229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7600103b40 msgr2=0x7f760019a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7606ab2640 1 --2- 172.21.15.43:0/3597680229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7600103b40 0x7f760019a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7606ab2640 1 -- 172.21.15.43:0/3597680229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7600104d80 msgr2=0x7f760019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7606ab2640 1 --2- 172.21.15.43:0/3597680229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7600104d80 0x7f760019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7606ab2640 1 -- 172.21.15.43:0/3597680229 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76001a1c00 con 0x7f7600109a80 2024-04-25T13:44:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7605ab0640 1 --2- 172.21.15.43:0/3597680229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7600104d80 0x7f760019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:44:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.910+0000 7f7606ab2640 1 --2- 172.21.15.43:0/3597680229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7600109a80 0x7f76001a1590 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f75fc005ab0 tx=0x7f75fc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.911+0000 7f75f77fe640 1 -- 172.21.15.43:0/3597680229 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc03f030 con 0x7f7600109a80 2024-04-25T13:44:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.911+0000 7f75f77fe640 1 -- 172.21.15.43:0/3597680229 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75fc003c90 con 0x7f7600109a80 2024-04-25T13:44:26.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.911+0000 7f7608515640 1 -- 172.21.15.43:0/3597680229 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76001a1e90 con 0x7f7600109a80 2024-04-25T13:44:26.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.911+0000 7f75f77fe640 1 -- 172.21.15.43:0/3597680229 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc035070 con 0x7f7600109a80 2024-04-25T13:44:26.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.911+0000 7f7608515640 1 -- 172.21.15.43:0/3597680229 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76001a22a0 con 0x7f7600109a80 2024-04-25T13:44:26.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.912+0000 7f7608515640 1 -- 172.21.15.43:0/3597680229 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7600108890 con 0x7f7600109a80 2024-04-25T13:44:26.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.913+0000 7f75f77fe640 1 -- 172.21.15.43:0/3597680229 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 147520+0+0 (secure 0 0 0) 0x7f75fc042030 con 0x7f7600109a80 2024-04-25T13:44:26.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.914+0000 7f75f77fe640 1 --2- 172.21.15.43:0/3597680229 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f75ec0afae0 0x7f75ec0b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:26.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.914+0000 7f76062b1640 1 --2- 172.21.15.43:0/3597680229 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f75ec0afae0 0x7f75ec0b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:26.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.914+0000 7f75f77fe640 1 -- 172.21.15.43:0/3597680229 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f75fc0ffa90 con 0x7f7600109a80 2024-04-25T13:44:26.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.915+0000 7f76062b1640 1 --2- 172.21.15.43:0/3597680229 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f75ec0afae0 0x7f75ec0b1ff0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7600104740 tx=0x7f75f8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:26.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:26.918+0000 7f75f77fe640 1 -- 172.21.15.43:0/3597680229 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f75fc0c8290 con 0x7f7600109a80 2024-04-25T13:44:27.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:27.157+0000 7f7608515640 1 -- 172.21.15.43:0/3597680229 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f760002dce0 con 0x7f7600109a80 2024-04-25T13:44:27.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:27 smithi175 ceph-mon[32649]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:44:27.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:27 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1985162450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:44:27.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:27 smithi043 ceph-mon[29195]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:44:27.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:27 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1985162450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:44:27.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:27 smithi161 ceph-mon[32696]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:44:27.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:27 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1985162450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:44:28.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:28.133+0000 7f75f77fe640 1 -- 172.21.15.43:0/3597680229 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f75fc0c7b90 con 0x7f7600109a80 2024-04-25T13:44:28.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:28.136+0000 7f7608515640 1 -- 172.21.15.43:0/3597680229 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f75ec0afae0 msgr2=0x7f75ec0b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:28.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:28.136+0000 7f7608515640 1 --2- 172.21.15.43:0/3597680229 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f75ec0afae0 0x7f75ec0b1ff0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7600104740 tx=0x7f75f8009680 comp rx=0 tx=0).stop 2024-04-25T13:44:28.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:28.136+0000 7f7608515640 1 -- 172.21.15.43:0/3597680229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7600109a80 msgr2=0x7f76001a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:28.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:28.136+0000 7f7608515640 1 --2- 172.21.15.43:0/3597680229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7600109a80 0x7f76001a1590 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f75fc005ab0 tx=0x7f75fc0042f0 comp rx=0 tx=0).stop 2024-04-25T13:44:28.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:28.136+0000 7f7608515640 1 -- 172.21.15.43:0/3597680229 shutdown_connections 2024-04-25T13:44:28.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:28.136+0000 7f7608515640 1 --2- 172.21.15.43:0/3597680229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7600109a80 0x7f76001a1590 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:28.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:28.136+0000 7f7608515640 1 --2- 172.21.15.43:0/3597680229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7600104d80 0x7f760019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:28.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:28.136+0000 7f7608515640 1 --2- 172.21.15.43:0/3597680229 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f75ec0afae0 0x7f75ec0b1ff0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:28.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:28.136+0000 7f7608515640 1 --2- 172.21.15.43:0/3597680229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7600103b40 0x7f760019a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:28.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:28.136+0000 7f7608515640 1 -- 172.21.15.43:0/3597680229 >> 172.21.15.43:0/3597680229 conn(0x7f76000fed30 msgr2=0x7f7600105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:28.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:28.136+0000 7f7608515640 1 -- 172.21.15.43:0/3597680229 shutdown_connections 2024-04-25T13:44:28.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:28.136+0000 7f7608515640 1 -- 172.21.15.43:0/3597680229 wait complete. 2024-04-25T13:44:28.156 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T13:44:28.172 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T13:44:28.172 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-25T13:44:28.173 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-04-25T13:44:28.173 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T13:44:28.173 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T13:44:28.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:44:28.173 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-25T13:44:28.192 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-25T13:44:28.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:44:28.193 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:44:28.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:44:28.260 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-04-25T13:44:28.364 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T13:44:28.364 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-25T13:44:28.377 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:28 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3597680229' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-25T13:44:28.377 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:28 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: ignoring --setuser ceph since I am not root 2024-04-25T13:44:28.377 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:28 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: ignoring --setgroup ceph since I am not root 2024-04-25T13:44:28.377 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:28 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:28.372+0000 7f27e9581200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:44:28.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:28 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3597680229' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-25T13:44:28.430 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:28 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: ignoring --setuser ceph since I am not root 2024-04-25T13:44:28.430 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:28 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: ignoring --setgroup ceph since I am not root 2024-04-25T13:44:28.430 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:28 smithi175 ceph-mgr[34508]: -- 172.21.15.175:0/3039862618 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5649907665a0 con 0x5649954f0900 2024-04-25T13:44:28.430 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:28 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:28.336+0000 7fba82ce1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:44:28.527 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:28 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3597680229' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-25T13:44:28.527 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:28 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: ignoring --setuser ceph since I am not root 2024-04-25T13:44:28.527 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:28 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: ignoring --setgroup ceph since I am not root 2024-04-25T13:44:28.527 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:28 smithi161 ceph-mgr[34091]: -- 172.21.15.161:0/3389759211 <== mon.2 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558f50a145a0 con 0x558f5579e480 2024-04-25T13:44:28.527 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:28 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:28.337+0000 7fb3e284e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:44:28.527 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:28 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:28.527+0000 7fb3e284e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:44:28.620 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:44:28.694 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:28 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:28.578+0000 7f27e9581200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:44:28.695 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:28 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:28.694+0000 7f27e9581200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:44:28.852 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:28 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:28.631+0000 7fb3e284e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:44:28.930 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:28 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:28.524+0000 7fba82ce1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:44:28.930 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:28 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:28.627+0000 7fba82ce1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:44:29.352 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:28 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:28.944+0000 7fb3e284e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:44:29.352 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:29 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:29.030+0000 7fb3e284e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:44:29.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:29 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3597680229' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-25T13:44:29.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:29 smithi161 ceph-mon[32696]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-04-25T13:44:29.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:29 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3597680229' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-25T13:44:29.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:29 smithi175 ceph-mon[32649]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-04-25T13:44:29.431 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:28 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:28.936+0000 7fba82ce1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:44:29.431 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:29 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:29.022+0000 7fba82ce1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:44:29.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:29 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3597680229' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-25T13:44:29.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:29 smithi043 ceph-mon[29195]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-04-25T13:44:29.463 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:29 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:29.025+0000 7f27e9581200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:44:29.463 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:29 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:29.122+0000 7f27e9581200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:44:30.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.427+0000 7f9a900e4700 1 -- 172.21.15.43:0/1489637799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a88107cc0 msgr2=0x7f9a881080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:30.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.427+0000 7f9a900e4700 1 --2- 172.21.15.43:0/1489637799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a88107cc0 0x7f9a881080d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9a780099c0 tx=0x7f9a78009cd0 comp rx=0 tx=0).stop 2024-04-25T13:44:30.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.427+0000 7f9a900e4700 1 -- 172.21.15.43:0/1489637799 shutdown_connections 2024-04-25T13:44:30.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.427+0000 7f9a900e4700 1 --2- 172.21.15.43:0/1489637799 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a88108610 0x7f9a8810ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:30.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.427+0000 7f9a900e4700 1 --2- 172.21.15.43:0/1489637799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a88103390 0x7f9a881037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:30.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.427+0000 7f9a900e4700 1 --2- 172.21.15.43:0/1489637799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a88107cc0 0x7f9a881080d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:30.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.427+0000 7f9a900e4700 1 -- 172.21.15.43:0/1489637799 >> 172.21.15.43:0/1489637799 conn(0x7f9a880fec90 msgr2=0x7f9a881010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:30.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.428+0000 7f9a900e4700 1 -- 172.21.15.43:0/1489637799 shutdown_connections 2024-04-25T13:44:30.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.428+0000 7f9a900e4700 1 -- 172.21.15.43:0/1489637799 wait complete. 2024-04-25T13:44:30.429 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:30 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:30.412+0000 7f27e9581200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:44:30.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.428+0000 7f9a900e4700 1 Processor -- start 2024-04-25T13:44:30.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.428+0000 7f9a900e4700 1 -- start start 2024-04-25T13:44:30.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a900e4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a88103390 0x7f9a8819f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:30.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a900e4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a88107cc0 0x7f9a8819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:30.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a900e4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a88108610 0x7f9a88199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:30.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a900e4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9a881130d0 con 0x7f9a88107cc0 2024-04-25T13:44:30.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a900e4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9a88112f50 con 0x7f9a88108610 2024-04-25T13:44:30.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a900e4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9a88113250 con 0x7f9a88103390 2024-04-25T13:44:30.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a8d67f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a88107cc0 0x7f9a8819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:30.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a8d67f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a88107cc0 0x7f9a8819fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36994/0 (socket says 172.21.15.43:36994) 2024-04-25T13:44:30.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a8d67f700 1 -- 172.21.15.43:0/3197217977 learned_addr learned my addr 172.21.15.43:0/3197217977 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:30.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a8de80700 1 --2- 172.21.15.43:0/3197217977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a88103390 0x7f9a8819f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:30.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a8e681700 1 --2- 172.21.15.43:0/3197217977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a88108610 0x7f9a88199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:30.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a8de80700 1 -- 172.21.15.43:0/3197217977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a88108610 msgr2=0x7f9a88199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:30.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a8de80700 1 --2- 172.21.15.43:0/3197217977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a88108610 0x7f9a88199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:30.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a8de80700 1 -- 172.21.15.43:0/3197217977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a88107cc0 msgr2=0x7f9a8819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:30.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a8de80700 1 --2- 172.21.15.43:0/3197217977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a88107cc0 0x7f9a8819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:30.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a8de80700 1 -- 172.21.15.43:0/3197217977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a88199fc0 con 0x7f9a88103390 2024-04-25T13:44:30.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.429+0000 7f9a8d67f700 1 --2- 172.21.15.43:0/3197217977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a88107cc0 0x7f9a8819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:44:30.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.430+0000 7f9a8de80700 1 --2- 172.21.15.43:0/3197217977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a88103390 0x7f9a8819f6f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400eb00 tx=0x7f9a8400ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:30.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.430+0000 7f9a7effd700 1 -- 172.21.15.43:0/3197217977 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8401c070 con 0x7f9a88103390 2024-04-25T13:44:30.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.430+0000 7f9a900e4700 1 -- 172.21.15.43:0/3197217977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8819a2b0 con 0x7f9a88103390 2024-04-25T13:44:30.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.430+0000 7f9a7effd700 1 -- 172.21.15.43:0/3197217977 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a8400be50 con 0x7f9a88103390 2024-04-25T13:44:30.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.430+0000 7f9a7effd700 1 -- 172.21.15.43:0/3197217977 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84017e50 con 0x7f9a88103390 2024-04-25T13:44:30.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.430+0000 7f9a900e4700 1 -- 172.21.15.43:0/3197217977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a8806b4e0 con 0x7f9a88103390 2024-04-25T13:44:30.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.431+0000 7f9a900e4700 1 -- 172.21.15.43:0/3197217977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a88104840 con 0x7f9a88103390 2024-04-25T13:44:30.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.434+0000 7f9a7effd700 1 -- 172.21.15.43:0/3197217977 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 19) ==== 147537+0+0 (secure 0 0 0) 0x7f9a8404c080 con 0x7f9a88103390 2024-04-25T13:44:30.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.434+0000 7f9a7effd700 1 --2- 172.21.15.43:0/3197217977 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9a740afd70 0x7f9a740b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:30.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.434+0000 7f9a8d67f700 1 -- 172.21.15.43:0/3197217977 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9a740afd70 msgr2=0x7f9a740b2280 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2478639579 2024-04-25T13:44:30.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.435+0000 7f9a7effd700 1 -- 172.21.15.43:0/3197217977 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f9a840e08d0 con 0x7f9a88103390 2024-04-25T13:44:30.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.435+0000 7f9a8d67f700 1 --2- 172.21.15.43:0/3197217977 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9a740afd70 0x7f9a740b2280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:44:30.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.440+0000 7f9a7effd700 1 -- 172.21.15.43:0/3197217977 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9a840a9130 con 0x7f9a88103390 2024-04-25T13:44:30.569 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:30 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:30.215+0000 7fba82ce1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:44:30.569 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:30 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:30.392+0000 7fba82ce1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:44:30.569 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:30 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:30.570+0000 7fba82ce1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:44:30.573 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:30 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:30.226+0000 7fb3e284e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:44:30.573 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:30 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:30.400+0000 7fb3e284e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:44:30.573 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:30 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:30.573+0000 7fb3e284e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:44:30.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.636+0000 7f9a8d67f700 1 -- 172.21.15.43:0/3197217977 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9a740afd70 msgr2=0x7f9a740b2280 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2478639579 2024-04-25T13:44:30.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.636+0000 7f9a8d67f700 1 --2- 172.21.15.43:0/3197217977 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9a740afd70 0x7f9a740b2280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:44:30.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.695+0000 7f9a900e4700 1 -- 172.21.15.43:0/3197217977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9a88051190 con 0x7f9a88103390 2024-04-25T13:44:30.695 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:30 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:30.601+0000 7f27e9581200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:44:30.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.695+0000 7f9a7effd700 1 -- 172.21.15.43:0/3197217977 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+88 (secure 0 0 0) 0x7f9a840a8a30 con 0x7f9a88103390 2024-04-25T13:44:30.696 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T13:44:30.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.698+0000 7f9a900e4700 1 -- 172.21.15.43:0/3197217977 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9a740afd70 msgr2=0x7f9a740b2280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T13:44:30.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.698+0000 7f9a900e4700 1 --2- 172.21.15.43:0/3197217977 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9a740afd70 0x7f9a740b2280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:30.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.698+0000 7f9a900e4700 1 -- 172.21.15.43:0/3197217977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a88103390 msgr2=0x7f9a8819f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:30.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.698+0000 7f9a900e4700 1 --2- 172.21.15.43:0/3197217977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a88103390 0x7f9a8819f6f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400eb00 tx=0x7f9a8400ee10 comp rx=0 tx=0).stop 2024-04-25T13:44:30.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.698+0000 7f9a900e4700 1 -- 172.21.15.43:0/3197217977 shutdown_connections 2024-04-25T13:44:30.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.698+0000 7f9a900e4700 1 --2- 172.21.15.43:0/3197217977 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9a740afd70 0x7f9a740b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:30.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.698+0000 7f9a900e4700 1 --2- 172.21.15.43:0/3197217977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a88108610 0x7f9a88199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:30.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.698+0000 7f9a900e4700 1 --2- 172.21.15.43:0/3197217977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a88103390 0x7f9a8819f6f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:30.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.698+0000 7f9a900e4700 1 --2- 172.21.15.43:0/3197217977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a88107cc0 0x7f9a8819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:30.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.698+0000 7f9a900e4700 1 -- 172.21.15.43:0/3197217977 >> 172.21.15.43:0/3197217977 conn(0x7f9a880fec90 msgr2=0x7f9a881010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:30.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.698+0000 7f9a900e4700 1 -- 172.21.15.43:0/3197217977 shutdown_connections 2024-04-25T13:44:30.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:30.698+0000 7f9a900e4700 1 -- 172.21.15.43:0/3197217977 wait complete. 2024-04-25T13:44:30.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:30 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3197217977' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T13:44:30.868 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:30 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3197217977' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T13:44:30.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:30 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3197217977' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T13:44:30.963 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:30 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:30.793+0000 7f27e9581200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:44:31.164 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:30 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:30.867+0000 7fb3e284e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:44:31.164 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:30 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:30.960+0000 7fb3e284e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:44:31.164 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:31.164+0000 7fb3e284e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:44:31.168 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:30 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:30.868+0000 7fba82ce1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:44:31.168 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:30 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:30.963+0000 7fba82ce1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:44:31.341 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:31 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:31.106+0000 7f27e9581200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:44:31.342 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:31 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:31.205+0000 7f27e9581200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:44:31.370 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T13:44:31.370 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:44:31.370 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-04-25T13:44:31.370 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T13:44:31.371 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T13:44:31.371 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T13:44:31.371 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T13:44:31.371 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:44:31.371 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:44:31.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:44:31.371 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-04-25T13:44:31.428 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:44:31.428 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:44:31.428 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:44:31.428 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:44:31.429 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-04-25T13:44:31.429 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:44:31.429 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:44:31.429 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-04-25T13:44:31.429 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-04-25T13:44:31.429 INFO:teuthology.orchestra.run.smithi043.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:44:31.429 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:44:31.429 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-04-25T13:44:31.429 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T13:44:31.429 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 41947sec preferred_lft 41947sec 2024-04-25T13:44:31.429 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link noprefixroute 2024-04-25T13:44:31.429 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:44:31.429 INFO:teuthology.orchestra.run.smithi043.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:44:31.429 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-04-25T13:44:31.430 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-04-25T13:44:31.430 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:44:31.430 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:44:31.430 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-04-25T13:44:31.430 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T13:44:31.430 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:44:31.430 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T13:44:31.430 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2024-04-25T13:44:31.430 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2024-04-25T13:44:31.430 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2024-04-25T13:44:31.431 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T13:44:31.431 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T13:44:31.431 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:31.168+0000 7fba82ce1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:44:31.431 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:31.367+0000 7fba82ce1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:44:31.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:44:31.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:44:31.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:44:31.573 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:44:31.595 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:31 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:31.423+0000 7f27e9581200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:44:31.598 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-04-25T13:44:31.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:44:31.600 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-04-25T13:44:31.602 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:31.361+0000 7fb3e284e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:44:31.656 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-04-25T13:44:31.657 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:44:31.657 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T13:44:31.657 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T13:44:31.657 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:44:31.657 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:44:31.657 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T13:44:31.657 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T13:44:31.657 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T13:44:31.657 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T13:44:31.658 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T13:44:31.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:44:31.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:44:31.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:44:31.786 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-25T13:44:31.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:44:31.802 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2024-04-25T13:44:31.858 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:44:31.858 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T13:44:31.859 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:44:31.859 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T13:44:31.859 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T13:44:31.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:44:31.956 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:31 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:31.642+0000 7f27e9581200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:44:31.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:44:31.979 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T13:44:31.979 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:44:31.979 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T13:44:31.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T13:44:31.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T13:44:31.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T13:44:31.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T13:44:31.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T13:44:31.979 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T13:44:32.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:44:32.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:44:32.096 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:44:32.097 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T13:44:32.097 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2024-04-25T13:44:32.097 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T13:44:32.097 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T13:44:32.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:44:32.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:44:32.179 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-04-25T13:44:32.180 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:44:32.180 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T13:44:32.195 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:44:32.196 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:44:32.196 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T13:44:32.252 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-04-25T13:44:32.318 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:44:32.352 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:31.965+0000 7fb3e284e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T13:44:32.374 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-04-25T13:44:32.374 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-04-25T13:44:32.374 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-04-25T13:44:32.374 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-04-25T13:44:32.374 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-04-25T13:44:32.375 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-04-25T13:44:32.375 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-04-25T13:44:32.375 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-04-25T13:44:32.375 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-04-25T13:44:32.375 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-04-25T13:44:32.375 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-04-25T13:44:32.375 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/selinux 2024-04-25T13:44:32.376 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:44:32.376 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-04-25T13:44:32.376 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-04-25T13:44:32.376 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-04-25T13:44:32.376 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-04-25T13:44:32.376 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-04-25T13:44:32.376 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:44:32.376 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:44:32.376 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-04-25T13:44:32.376 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:44:32.376 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:44:32.376 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:44:32.376 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-04-25T13:44:32.377 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-04-25T13:44:32.377 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay 2024-04-25T13:44:32.377 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/bf8dd62de97bef275234fec2db7fe6ae942124898b405f7a685627159de12dc2/merged 2024-04-25T13:44:32.377 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/0c14cefe4e593c231f9d943cbbbe656c6a1a59a428c7fdd266af7d5c057ebdd0/merged 2024-04-25T13:44:32.377 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/0 2024-04-25T13:44:32.377 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:44:32.377 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/02a5fa2057c5e4feda29fd23dce82c552605aef5d3e0839934c7e70979b5f5c1/merged 2024-04-25T13:44:32.377 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/943766bca05f83610ab7ddc5c1aad709aa59566af629c42ef97daf819887ba35/merged 2024-04-25T13:44:32.377 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/631bce35cf1985bea94cf8dbf4fb501421dceb5e37d0fab07c4fb861299a1151/merged 2024-04-25T13:44:32.377 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/3f8fe60384483ce1e0db5668bb6e199f40fb582d7fa78043ad01a0dbc94886f3/merged 2024-04-25T13:44:32.377 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/5739f0fa3396653c8fec270ad44c09325d968147793b054b3e19dc4f610bedce/merged 2024-04-25T13:44:32.377 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/767a931f62c9b2740515b6100aa30145d87f063030a179a09b3d7cf6f75b1942/merged 2024-04-25T13:44:32.377 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/b3621d1e8d57f2524eb441296b66a4233ea4ead732953d5f28b8c0b0c8f1a63a/merged 2024-04-25T13:44:32.378 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/36fb2aebddae48cc1029114b62947ac5cfad32bbceb64bbe2f23cf7968868b5f/merged 2024-04-25T13:44:32.378 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-04-25T13:44:32.378 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:44:32.378 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:44:32.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:44:32.378 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-04-25T13:44:32.402 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:31.972+0000 7fba82ce1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T13:44:32.430 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T13:44:32.430 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/371af08e-2f1d-4778-ac3f-dad01340feec --client_fs=cephfs) 2024-04-25T13:44:32.473 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-04-25T13:44:32.499 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:44:32.558 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-04-25T13:44:32.558 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-04-25T13:44:32.558 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-04-25T13:44:32.558 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-04-25T13:44:32.558 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-04-25T13:44:32.558 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-04-25T13:44:32.558 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-04-25T13:44:32.558 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-04-25T13:44:32.558 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-04-25T13:44:32.558 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-04-25T13:44:32.558 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-04-25T13:44:32.559 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/selinux 2024-04-25T13:44:32.559 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:44:32.559 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-04-25T13:44:32.559 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-04-25T13:44:32.559 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-04-25T13:44:32.559 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-04-25T13:44:32.559 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-04-25T13:44:32.559 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:44:32.559 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:44:32.559 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-04-25T13:44:32.559 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:44:32.559 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:44:32.559 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:44:32.559 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-04-25T13:44:32.559 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-04-25T13:44:32.560 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay 2024-04-25T13:44:32.560 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/bf8dd62de97bef275234fec2db7fe6ae942124898b405f7a685627159de12dc2/merged 2024-04-25T13:44:32.560 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/0c14cefe4e593c231f9d943cbbbe656c6a1a59a428c7fdd266af7d5c057ebdd0/merged 2024-04-25T13:44:32.560 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/0 2024-04-25T13:44:32.560 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:44:32.560 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/02a5fa2057c5e4feda29fd23dce82c552605aef5d3e0839934c7e70979b5f5c1/merged 2024-04-25T13:44:32.560 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/943766bca05f83610ab7ddc5c1aad709aa59566af629c42ef97daf819887ba35/merged 2024-04-25T13:44:32.560 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/631bce35cf1985bea94cf8dbf4fb501421dceb5e37d0fab07c4fb861299a1151/merged 2024-04-25T13:44:32.560 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/3f8fe60384483ce1e0db5668bb6e199f40fb582d7fa78043ad01a0dbc94886f3/merged 2024-04-25T13:44:32.560 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/5739f0fa3396653c8fec270ad44c09325d968147793b054b3e19dc4f610bedce/merged 2024-04-25T13:44:32.560 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/767a931f62c9b2740515b6100aa30145d87f063030a179a09b3d7cf6f75b1942/merged 2024-04-25T13:44:32.560 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/b3621d1e8d57f2524eb441296b66a4233ea4ead732953d5f28b8c0b0c8f1a63a/merged 2024-04-25T13:44:32.560 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/36fb2aebddae48cc1029114b62947ac5cfad32bbceb64bbe2f23cf7968868b5f/merged 2024-04-25T13:44:32.560 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-04-25T13:44:32.561 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:44:32.561 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:44:32.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:44:32.561 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-04-25T13:44:32.568 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi043.stderr:2024-04-25T13:44:32.569+0000 7fab995ff480 -1 init, newargv = 0x7fab88004720 newargc=15 2024-04-25T13:44:32.569 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi043.stderr:ceph-fuse[82945]: starting ceph client 2024-04-25T13:44:32.584 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi043.stderr:ceph-fuse[82945]: starting fuse 2024-04-25T13:44:32.680 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:32 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:32.403+0000 7fba82ce1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:44:32.680 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:32 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:32.502+0000 7fba82ce1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:44:32.699 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:32 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:32.394+0000 7fb3e284e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:44:32.699 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:32 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:32.492+0000 7fb3e284e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:44:32.712 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:32 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:32.311+0000 7f27e9581200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T13:44:33.104 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:32 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:32.779+0000 7f27e9581200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:44:33.104 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:32 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:32.883+0000 7f27e9581200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:44:33.104 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:33 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:33.105+0000 7f27e9581200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T13:44:33.180 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:32 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:32.709+0000 7fba82ce1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T13:44:33.573 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:32 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:32.699+0000 7fb3e284e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T13:44:33.573 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:33 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:33.232+0000 7fb3e284e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:44:33.573 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:33 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:33.327+0000 7fb3e284e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:44:33.587 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:33 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:33.243+0000 7fba82ce1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:44:33.587 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:33 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:33.338+0000 7fba82ce1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:44:33.685 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-04-25T13:44:33.711 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:44:33.768 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-04-25T13:44:33.768 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-04-25T13:44:33.768 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-04-25T13:44:33.768 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-04-25T13:44:33.768 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-04-25T13:44:33.768 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-04-25T13:44:33.768 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-04-25T13:44:33.768 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-04-25T13:44:33.768 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-04-25T13:44:33.768 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-04-25T13:44:33.769 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-04-25T13:44:33.769 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/selinux 2024-04-25T13:44:33.769 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:44:33.769 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-04-25T13:44:33.769 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-04-25T13:44:33.769 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-04-25T13:44:33.769 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-04-25T13:44:33.769 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-04-25T13:44:33.769 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:44:33.769 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:44:33.769 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-04-25T13:44:33.769 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:44:33.769 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:44:33.769 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:44:33.770 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-04-25T13:44:33.770 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-04-25T13:44:33.770 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay 2024-04-25T13:44:33.770 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/bf8dd62de97bef275234fec2db7fe6ae942124898b405f7a685627159de12dc2/merged 2024-04-25T13:44:33.770 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/0c14cefe4e593c231f9d943cbbbe656c6a1a59a428c7fdd266af7d5c057ebdd0/merged 2024-04-25T13:44:33.770 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/0 2024-04-25T13:44:33.770 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:44:33.770 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/02a5fa2057c5e4feda29fd23dce82c552605aef5d3e0839934c7e70979b5f5c1/merged 2024-04-25T13:44:33.770 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/943766bca05f83610ab7ddc5c1aad709aa59566af629c42ef97daf819887ba35/merged 2024-04-25T13:44:33.770 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/631bce35cf1985bea94cf8dbf4fb501421dceb5e37d0fab07c4fb861299a1151/merged 2024-04-25T13:44:33.770 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/3f8fe60384483ce1e0db5668bb6e199f40fb582d7fa78043ad01a0dbc94886f3/merged 2024-04-25T13:44:33.770 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/5739f0fa3396653c8fec270ad44c09325d968147793b054b3e19dc4f610bedce/merged 2024-04-25T13:44:33.770 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/767a931f62c9b2740515b6100aa30145d87f063030a179a09b3d7cf6f75b1942/merged 2024-04-25T13:44:33.770 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/b3621d1e8d57f2524eb441296b66a4233ea4ead732953d5f28b8c0b0c8f1a63a/merged 2024-04-25T13:44:33.771 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/containers/storage/overlay/36fb2aebddae48cc1029114b62947ac5cfad32bbceb64bbe2f23cf7968868b5f/merged 2024-04-25T13:44:33.771 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-04-25T13:44:33.771 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:44:33.771 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:44:33.771 INFO:teuthology.orchestra.run.smithi043.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-25T13:44:33.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:44:33.771 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-04-25T13:44:33.824 INFO:teuthology.orchestra.run.smithi043.stdout:115 2024-04-25T13:44:33.824 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [115] 2024-04-25T13:44:33.825 DEBUG:teuthology.orchestra.run.smithi043:> sudo stdin-killer -- python3 -c ' 2024-04-25T13:44:33.825 DEBUG:teuthology.orchestra.run.smithi043:> import glob 2024-04-25T13:44:33.825 DEBUG:teuthology.orchestra.run.smithi043:> import re 2024-04-25T13:44:33.825 DEBUG:teuthology.orchestra.run.smithi043:> import os 2024-04-25T13:44:33.825 DEBUG:teuthology.orchestra.run.smithi043:> import subprocess 2024-04-25T13:44:33.825 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-25T13:44:33.825 DEBUG:teuthology.orchestra.run.smithi043:> def _find_admin_socket(client_name): 2024-04-25T13:44:33.825 DEBUG:teuthology.orchestra.run.smithi043:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T13:44:33.825 DEBUG:teuthology.orchestra.run.smithi043:> files = glob.glob(asok_path) 2024-04-25T13:44:33.825 DEBUG:teuthology.orchestra.run.smithi043:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T13:44:33.825 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-25T13:44:33.825 DEBUG:teuthology.orchestra.run.smithi043:> # Given a non-glob path, it better be there 2024-04-25T13:44:33.825 DEBUG:teuthology.orchestra.run.smithi043:> if "*" not in asok_path: 2024-04-25T13:44:33.825 DEBUG:teuthology.orchestra.run.smithi043:> assert(len(files) == 1) 2024-04-25T13:44:33.825 DEBUG:teuthology.orchestra.run.smithi043:> return files[0] 2024-04-25T13:44:33.825 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-25T13:44:33.826 DEBUG:teuthology.orchestra.run.smithi043:> for f in files: 2024-04-25T13:44:33.826 DEBUG:teuthology.orchestra.run.smithi043:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T13:44:33.826 DEBUG:teuthology.orchestra.run.smithi043:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T13:44:33.826 DEBUG:teuthology.orchestra.run.smithi043:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T13:44:33.826 DEBUG:teuthology.orchestra.run.smithi043:> contents = proc_f.read() 2024-04-25T13:44:33.826 DEBUG:teuthology.orchestra.run.smithi043:> if mountpoint in contents: 2024-04-25T13:44:33.826 DEBUG:teuthology.orchestra.run.smithi043:> return f 2024-04-25T13:44:33.826 DEBUG:teuthology.orchestra.run.smithi043:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T13:44:33.826 DEBUG:teuthology.orchestra.run.smithi043:> 2024-04-25T13:44:33.826 DEBUG:teuthology.orchestra.run.smithi043:> print(_find_admin_socket("client.0")) 2024-04-25T13:44:33.826 DEBUG:teuthology.orchestra.run.smithi043:> ' 2024-04-25T13:44:33.852 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:33 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:33.573+0000 7fb3e284e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:44:33.852 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:33 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:33.707+0000 7fb3e284e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:44:33.852 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:33 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:33.803+0000 7fb3e284e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:44:33.930 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:33 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:33.587+0000 7fba82ce1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:44:33.930 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:33 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:33.723+0000 7fba82ce1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:44:33.930 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:33 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:33.820+0000 7fba82ce1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:44:33.947 INFO:teuthology.orchestra.run.smithi043.stdout:/var/run/ceph/ceph-client.0.82945.asok 2024-04-25T13:44:33.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:44:33.957 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:33 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:33.661+0000 7f27e9581200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:44:33.957 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:33 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:33.762+0000 7f27e9581200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:44:33.958 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.82945.asok 2024-04-25T13:44:33.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:44:33.959 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.82945.asok status 2024-04-25T13:44:34.105 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T13:44:34.105 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": { 2024-04-25T13:44:34.105 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_sha1": "994e2f20102a20fa9a27966c14b625cc01884df8", 2024-04-25T13:44:34.105 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T13:44:34.105 INFO:teuthology.orchestra.run.smithi043.stdout: "entity_id": "0", 2024-04-25T13:44:34.105 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": "smithi043", 2024-04-25T13:44:34.105 INFO:teuthology.orchestra.run.smithi043.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T13:44:34.105 INFO:teuthology.orchestra.run.smithi043.stdout: "pid": "82945", 2024-04-25T13:44:34.105 INFO:teuthology.orchestra.run.smithi043.stdout: "root": "/volumes/qa/sv_0/371af08e-2f1d-4778-ac3f-dad01340feec" 2024-04-25T13:44:34.105 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:44:34.106 INFO:teuthology.orchestra.run.smithi043.stdout: "dentry_count": 0, 2024-04-25T13:44:34.106 INFO:teuthology.orchestra.run.smithi043.stdout: "dentry_pinned_count": 0, 2024-04-25T13:44:34.106 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 15498, 2024-04-25T13:44:34.106 INFO:teuthology.orchestra.run.smithi043.stdout: "inst": { 2024-04-25T13:44:34.106 INFO:teuthology.orchestra.run.smithi043.stdout: "name": { 2024-04-25T13:44:34.106 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "client", 2024-04-25T13:44:34.106 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 15498 2024-04-25T13:44:34.106 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:44:34.106 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": { 2024-04-25T13:44:34.106 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T13:44:34.106 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "192.168.0.1:0", 2024-04-25T13:44:34.106 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 449944437 2024-04-25T13:44:34.107 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:44:34.107 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:44:34.107 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": { 2024-04-25T13:44:34.107 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T13:44:34.107 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "192.168.0.1:0", 2024-04-25T13:44:34.107 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 449944437 2024-04-25T13:44:34.107 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:44:34.107 INFO:teuthology.orchestra.run.smithi043.stdout: "inst_str": "client.15498 192.168.0.1:0/449944437", 2024-04-25T13:44:34.107 INFO:teuthology.orchestra.run.smithi043.stdout: "addr_str": "192.168.0.1:0/449944437", 2024-04-25T13:44:34.107 INFO:teuthology.orchestra.run.smithi043.stdout: "inode_count": 5, 2024-04-25T13:44:34.107 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_epoch": 24, 2024-04-25T13:44:34.107 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_epoch": 84, 2024-04-25T13:44:34.107 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_epoch_barrier": 0, 2024-04-25T13:44:34.107 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklisted": false, 2024-04-25T13:44:34.108 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs" 2024-04-25T13:44:34.108 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T13:44:34.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:44:34.115 DEBUG:teuthology.orchestra.run.smithi043:> stat --file-system '--printf=%T 2024-04-25T13:44:34.115 DEBUG:teuthology.orchestra.run.smithi043:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T13:44:34.130 INFO:teuthology.orchestra.run.smithi043.stdout:fuseblk 2024-04-25T13:44:34.131 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T13:44:34.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:44:34.131 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T13:44:34.198 INFO:teuthology.run_tasks:Running task exec... 2024-04-25T13:44:34.208 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T13:44:34.208 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T13:44:34.208 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-04-25T13:44:34.212 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:34 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:34.032+0000 7f27e9581200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:44:34.212 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:34 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:34.180+0000 7f27e9581200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:44:34.229 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:33 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:33.918+0000 7fb3e284e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:44:34.229 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:34 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:34.229+0000 7fb3e284e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:44:34.243 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:33 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:33.937+0000 7fba82ce1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:44:34.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.326+0000 7f0681ed1640 1 -- 172.21.15.43:0/3180419904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f067c104610 msgr2=0x7f067c106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.326+0000 7f0681ed1640 1 --2- 172.21.15.43:0/3180419904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f067c104610 0x7f067c106a30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f066c009900 tx=0x7f066c02a410 comp rx=0 tx=0).stop 2024-04-25T13:44:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.326+0000 7f0681ed1640 1 -- 172.21.15.43:0/3180419904 shutdown_connections 2024-04-25T13:44:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.326+0000 7f0681ed1640 1 --2- 172.21.15.43:0/3180419904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f067c1098d0 0x7f067c10bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.326+0000 7f0681ed1640 1 --2- 172.21.15.43:0/3180419904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c106f70 0x7f067c109390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.326+0000 7f0681ed1640 1 --2- 172.21.15.43:0/3180419904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f067c104610 0x7f067c106a30 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.326+0000 7f0681ed1640 1 -- 172.21.15.43:0/3180419904 >> 172.21.15.43:0/3180419904 conn(0x7f067c0fdc10 msgr2=0x7f067c1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.326+0000 7f0681ed1640 1 -- 172.21.15.43:0/3180419904 shutdown_connections 2024-04-25T13:44:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.326+0000 7f0681ed1640 1 -- 172.21.15.43:0/3180419904 wait complete. 2024-04-25T13:44:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.327+0000 7f0681ed1640 1 Processor -- start 2024-04-25T13:44:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.327+0000 7f0681ed1640 1 -- start start 2024-04-25T13:44:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.327+0000 7f0681ed1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f067c104610 0x7f067c103a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.327+0000 7f0681ed1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f067c106f70 0x7f067c102100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.327+0000 7f0681ed1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c1098d0 0x7f067c102640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.327+0000 7f0681ed1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f067c10f4b0 con 0x7f067c106f70 2024-04-25T13:44:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.327+0000 7f0681ed1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f067c10f330 con 0x7f067c1098d0 2024-04-25T13:44:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.327+0000 7f0681ed1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f067c10f630 con 0x7f067c104610 2024-04-25T13:44:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.327+0000 7f067affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f067c106f70 0x7f067c102100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.327+0000 7f067affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f067c106f70 0x7f067c102100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37012/0 (socket says 172.21.15.43:37012) 2024-04-25T13:44:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.327+0000 7f067bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c1098d0 0x7f067c102640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.327+0000 7f067affd640 1 -- 172.21.15.43:0/22764791 learned_addr learned my addr 172.21.15.43:0/22764791 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.327+0000 7f067b7fe640 1 --2- 172.21.15.43:0/22764791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f067c104610 0x7f067c103a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.328+0000 7f067affd640 1 -- 172.21.15.43:0/22764791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f067c104610 msgr2=0x7f067c103a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.328+0000 7f067affd640 1 --2- 172.21.15.43:0/22764791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f067c104610 0x7f067c103a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.328+0000 7f067affd640 1 -- 172.21.15.43:0/22764791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c1098d0 msgr2=0x7f067c102640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.328+0000 7f067affd640 1 --2- 172.21.15.43:0/22764791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c1098d0 0x7f067c102640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.328+0000 7f067affd640 1 -- 172.21.15.43:0/22764791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067c102d70 con 0x7f067c106f70 2024-04-25T13:44:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.328+0000 7f067affd640 1 --2- 172.21.15.43:0/22764791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f067c106f70 0x7f067c102100 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f067000e9f0 tx=0x7f067000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.328+0000 7f0678ff9640 1 -- 172.21.15.43:0/22764791 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067000cd80 con 0x7f067c106f70 2024-04-25T13:44:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.328+0000 7f0681ed1640 1 -- 172.21.15.43:0/22764791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f067c1a4230 con 0x7f067c106f70 2024-04-25T13:44:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.328+0000 7f0678ff9640 1 -- 172.21.15.43:0/22764791 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06700108c0 con 0x7f067c106f70 2024-04-25T13:44:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.328+0000 7f0678ff9640 1 -- 172.21.15.43:0/22764791 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06700187c0 con 0x7f067c106f70 2024-04-25T13:44:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.328+0000 7f0681ed1640 1 -- 172.21.15.43:0/22764791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f067c1a46d0 con 0x7f067c106f70 2024-04-25T13:44:34.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.329+0000 7f0681ed1640 1 -- 172.21.15.43:0/22764791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f067c0ff730 con 0x7f067c106f70 2024-04-25T13:44:34.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.331+0000 7f0678ff9640 1 -- 172.21.15.43:0/22764791 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) ==== 147537+0+0 (secure 0 0 0) 0x7f0670010430 con 0x7f067c106f70 2024-04-25T13:44:34.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.332+0000 7f0678ff9640 1 --2- 172.21.15.43:0/22764791 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f06640afb30 0x7f06640b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:34.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.332+0000 7f067b7fe640 1 -- 172.21.15.43:0/22764791 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f06640afb30 msgr2=0x7f06640b2040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2478639579 2024-04-25T13:44:34.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.332+0000 7f0678ff9640 1 -- 172.21.15.43:0/22764791 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f06700df830 con 0x7f067c106f70 2024-04-25T13:44:34.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.332+0000 7f067b7fe640 1 --2- 172.21.15.43:0/22764791 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f06640afb30 0x7f06640b2040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:44:34.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.336+0000 7f0678ff9640 1 -- 172.21.15.43:0/22764791 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f06700a7a40 con 0x7f067c106f70 2024-04-25T13:44:34.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.533+0000 7f067b7fe640 1 -- 172.21.15.43:0/22764791 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f06640afb30 msgr2=0x7f06640b2040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2478639579 2024-04-25T13:44:34.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.533+0000 7f067b7fe640 1 --2- 172.21.15.43:0/22764791 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f06640afb30 0x7f06640b2040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:44:34.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.566+0000 7f0681ed1640 1 -- 172.21.15.43:0/22764791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f067c02db50 con 0x7f067c106f70 2024-04-25T13:44:34.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.618+0000 7f0678ff9640 1 -- 172.21.15.43:0/22764791 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7f06700b0110 con 0x7f067c106f70 2024-04-25T13:44:34.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.620+0000 7f0681ed1640 1 -- 172.21.15.43:0/22764791 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f06640afb30 msgr2=0x7f06640b2040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T13:44:34.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.620+0000 7f0681ed1640 1 --2- 172.21.15.43:0/22764791 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f06640afb30 0x7f06640b2040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.620+0000 7f0681ed1640 1 -- 172.21.15.43:0/22764791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f067c106f70 msgr2=0x7f067c102100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:34.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.620+0000 7f0681ed1640 1 --2- 172.21.15.43:0/22764791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f067c106f70 0x7f067c102100 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f067000e9f0 tx=0x7f067000eeb0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.620+0000 7f0681ed1640 1 -- 172.21.15.43:0/22764791 shutdown_connections 2024-04-25T13:44:34.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.620+0000 7f0681ed1640 1 --2- 172.21.15.43:0/22764791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c1098d0 0x7f067c102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.620+0000 7f0681ed1640 1 --2- 172.21.15.43:0/22764791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f067c106f70 0x7f067c102100 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.620+0000 7f0681ed1640 1 --2- 172.21.15.43:0/22764791 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f06640afb30 0x7f06640b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.620+0000 7f0681ed1640 1 --2- 172.21.15.43:0/22764791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f067c104610 0x7f067c103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.620+0000 7f0681ed1640 1 -- 172.21.15.43:0/22764791 >> 172.21.15.43:0/22764791 conn(0x7f067c0fdc10 msgr2=0x7f067c106670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:34.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.620+0000 7f0681ed1640 1 -- 172.21.15.43:0/22764791 shutdown_connections 2024-04-25T13:44:34.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.620+0000 7f0681ed1640 1 -- 172.21.15.43:0/22764791 wait complete. 2024-04-25T13:44:34.621 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:34 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:34.243+0000 7fba82ce1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:44:34.621 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:34 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:34.288+0000 7f27e9581200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:44:34.621 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:34 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:34.418+0000 7f27e9581200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:44:34.633 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-04-25T13:44:34.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.751+0000 7f9be869f640 1 -- 172.21.15.43:0/2788214533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9be0108960 msgr2=0x7f9be010ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:34.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.751+0000 7f9be869f640 1 --2- 172.21.15.43:0/2788214533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9be0108960 0x7f9be010ad80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009ca0 tx=0x7f9bd802a8c0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.751+0000 7f9be869f640 1 -- 172.21.15.43:0/2788214533 shutdown_connections 2024-04-25T13:44:34.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.751+0000 7f9be869f640 1 --2- 172.21.15.43:0/2788214533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9be0108960 0x7f9be010ad80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.751+0000 7f9be869f640 1 --2- 172.21.15.43:0/2788214533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9be0103c60 0x7f9be0104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.751+0000 7f9be869f640 1 --2- 172.21.15.43:0/2788214533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9be0102a20 0x7f9be0103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.751+0000 7f9be869f640 1 -- 172.21.15.43:0/2788214533 >> 172.21.15.43:0/2788214533 conn(0x7f9be00fdc10 msgr2=0x7f9be01000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:34.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.751+0000 7f9be869f640 1 -- 172.21.15.43:0/2788214533 shutdown_connections 2024-04-25T13:44:34.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.751+0000 7f9be869f640 1 -- 172.21.15.43:0/2788214533 wait complete. 2024-04-25T13:44:34.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.752+0000 7f9be869f640 1 Processor -- start 2024-04-25T13:44:34.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.752+0000 7f9be869f640 1 -- start start 2024-04-25T13:44:34.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.752+0000 7f9be869f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9be0102a20 0x7f9be0199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:34.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.752+0000 7f9be869f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9be0103c60 0x7f9be0199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:34.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.752+0000 7f9be869f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9be0108960 0x7f9be01a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:34.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.752+0000 7f9be869f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9be010e470 con 0x7f9be0108960 2024-04-25T13:44:34.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.752+0000 7f9be869f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9be010e2f0 con 0x7f9be0102a20 2024-04-25T13:44:34.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.752+0000 7f9be869f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9be010e5f0 con 0x7f9be0103c60 2024-04-25T13:44:34.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.752+0000 7f9be6c3c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9be0108960 0x7f9be01a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:34.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.752+0000 7f9be6c3c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9be0108960 0x7f9be01a04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37018/0 (socket says 172.21.15.43:37018) 2024-04-25T13:44:34.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.752+0000 7f9be6c3c640 1 -- 172.21.15.43:0/2624781809 learned_addr learned my addr 172.21.15.43:0/2624781809 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:34.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.752+0000 7f9be643b640 1 --2- 172.21.15.43:0/2624781809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9be0102a20 0x7f9be0199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:34.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.752+0000 7f9be5c3a640 1 --2- 172.21.15.43:0/2624781809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9be0103c60 0x7f9be0199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:34.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.753+0000 7f9be643b640 1 -- 172.21.15.43:0/2624781809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9be0103c60 msgr2=0x7f9be0199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:34.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.753+0000 7f9be643b640 1 --2- 172.21.15.43:0/2624781809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9be0103c60 0x7f9be0199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.753+0000 7f9be643b640 1 -- 172.21.15.43:0/2624781809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9be0108960 msgr2=0x7f9be01a04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:34.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.753+0000 7f9be643b640 1 --2- 172.21.15.43:0/2624781809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9be0108960 0x7f9be01a04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:34.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.753+0000 7f9be643b640 1 -- 172.21.15.43:0/2624781809 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be01a0b50 con 0x7f9be0102a20 2024-04-25T13:44:34.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.753+0000 7f9be643b640 1 --2- 172.21.15.43:0/2624781809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9be0102a20 0x7f9be0199010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9be01022f0 tx=0x7f9bd000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:34.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.753+0000 7f9bd77fe640 1 -- 172.21.15.43:0/2624781809 <== mon.2 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd000cc40 con 0x7f9be0102a20 2024-04-25T13:44:34.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.753+0000 7f9bd77fe640 1 -- 172.21.15.43:0/2624781809 <== mon.2 v2:172.21.15.161:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bd000cde0 con 0x7f9be0102a20 2024-04-25T13:44:34.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.753+0000 7f9be869f640 1 -- 172.21.15.43:0/2624781809 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be01a0e40 con 0x7f9be0102a20 2024-04-25T13:44:34.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.753+0000 7f9bd77fe640 1 -- 172.21.15.43:0/2624781809 <== mon.2 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0010430 con 0x7f9be0102a20 2024-04-25T13:44:34.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.753+0000 7f9be869f640 1 -- 172.21.15.43:0/2624781809 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be01a1250 con 0x7f9be0102a20 2024-04-25T13:44:34.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.754+0000 7f9be869f640 1 -- 172.21.15.43:0/2624781809 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9be006a110 con 0x7f9be0102a20 2024-04-25T13:44:34.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.756+0000 7f9bd77fe640 1 -- 172.21.15.43:0/2624781809 <== mon.2 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 19) ==== 147537+0+0 (secure 0 0 0) 0x7f9bd0003ec0 con 0x7f9be0102a20 2024-04-25T13:44:34.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.756+0000 7f9bd77fe640 1 --2- 172.21.15.43:0/2624781809 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9bcc0afb30 0x7f9bcc0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:34.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.756+0000 7f9be5c3a640 1 -- 172.21.15.43:0/2624781809 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9bcc0afb30 msgr2=0x7f9bcc0b2040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2478639579 2024-04-25T13:44:34.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.756+0000 7f9bd77fe640 1 -- 172.21.15.43:0/2624781809 <== mon.2 v2:172.21.15.161:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9121+0+0 (secure 0 0 0) 0x7f9bd00df4a0 con 0x7f9be0102a20 2024-04-25T13:44:34.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.756+0000 7f9be5c3a640 1 --2- 172.21.15.43:0/2624781809 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9bcc0afb30 0x7f9bcc0b2040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:44:34.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.760+0000 7f9bd77fe640 1 -- 172.21.15.43:0/2624781809 <== mon.2 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9bd00a7d00 con 0x7f9be0102a20 2024-04-25T13:44:34.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:34 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/22764791' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-25T13:44:34.930 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:34 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:34.850+0000 7fba82ce1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:44:34.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.957+0000 7f9be5c3a640 1 -- 172.21.15.43:0/2624781809 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9bcc0afb30 msgr2=0x7f9bcc0b2040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2478639579 2024-04-25T13:44:34.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.957+0000 7f9be5c3a640 1 --2- 172.21.15.43:0/2624781809 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9bcc0afb30 0x7f9bcc0b2040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:44:34.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:34 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/22764791' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-25T13:44:34.962 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:34 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:34.741+0000 7f27e9581200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:44:34.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:34.977+0000 7f9be869f640 1 -- 172.21.15.43:0/2624781809 --> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f9be0062fe0 con 0x7f9bcc0afb30 2024-04-25T13:44:35.054 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:34 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/22764791' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-25T13:44:35.055 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:34 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:34.838+0000 7fb3e284e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:44:35.352 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:44:35 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y[34083]: 2024-04-25T13:44:35.054+0000 7fb3e284e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:44:35.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:35.358+0000 7f9be5c3a640 1 -- 172.21.15.43:0/2624781809 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9bcc0afb30 msgr2=0x7f9bcc0b2040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2478639579 2024-04-25T13:44:35.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:35.358+0000 7f9be5c3a640 1 --2- 172.21.15.43:0/2624781809 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9bcc0afb30 0x7f9bcc0b2040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T13:44:35.430 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:44:35 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z[34504]: 2024-04-25T13:44:35.070+0000 7fba82ce1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:44:35.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:35.637+0000 7f9bd77fe640 1 -- 172.21.15.43:0/2624781809 <== mon.2 v2:172.21.15.161:3300/0 7 ==== mgrmap(e 20) ==== 147537+0+0 (secure 0 0 0) 0x7f9bd00a3890 con 0x7f9be0102a20 2024-04-25T13:44:35.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:35.652+0000 7f9bd77fe640 1 -- 172.21.15.43:0/2624781809 <== mon.2 v2:172.21.15.161:3300/0 8 ==== mgrmap(e 21) ==== 147205+0+0 (secure 0 0 0) 0x7f9bd000e050 con 0x7f9be0102a20 2024-04-25T13:44:35.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:35.652+0000 7f9bd77fe640 1 -- 172.21.15.43:0/2624781809 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9bcc0afb30 msgr2=0x7f9bcc0b2040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T13:44:35.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:35.652+0000 7f9bd77fe640 1 --2- 172.21.15.43:0/2624781809 >> [v2:172.21.15.43:6800/2478639579,v1:172.21.15.43:6801/2478639579] conn(0x7f9bcc0afb30 0x7f9bcc0b2040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:35.712 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:35.389+0000 7f27e9581200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:44:35.712 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:35.625+0000 7f27e9581200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:44:35.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/22764791' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-25T13:44:35.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-mon[29195]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:44:35.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-mon[29195]: Standby manager daemon y restarted 2024-04-25T13:44:35.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-mon[29195]: Standby manager daemon y started 2024-04-25T13:44:35.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-mon[29195]: from='mgr.? 172.21.15.161:0/981736726' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T13:44:35.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-mon[29195]: from='mgr.? 172.21.15.161:0/981736726' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T13:44:35.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-mon[29195]: from='mgr.? 172.21.15.161:0/981736726' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T13:44:35.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-mon[29195]: from='mgr.? 172.21.15.161:0/981736726' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T13:44:35.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-mon[29195]: Standby manager daemon z restarted 2024-04-25T13:44:35.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-mon[29195]: Standby manager daemon z started 2024-04-25T13:44:35.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-mon[29195]: from='mgr.? 172.21.15.175:0/3368215107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T13:44:35.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-mon[29195]: from='mgr.? 172.21.15.175:0/3368215107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T13:44:35.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-mon[29195]: from='mgr.? 172.21.15.175:0/3368215107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T13:44:35.714 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-mon[29195]: from='mgr.? 172.21.15.175:0/3368215107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T13:44:35.897 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:35 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/22764791' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-25T13:44:35.897 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:35 smithi161 ceph-mon[32696]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:44:35.897 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:35 smithi161 ceph-mon[32696]: Standby manager daemon y restarted 2024-04-25T13:44:35.897 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:35 smithi161 ceph-mon[32696]: Standby manager daemon y started 2024-04-25T13:44:35.897 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:35 smithi161 ceph-mon[32696]: from='mgr.? 172.21.15.161:0/981736726' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T13:44:35.897 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:35 smithi161 ceph-mon[32696]: from='mgr.? 172.21.15.161:0/981736726' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T13:44:35.897 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:35 smithi161 ceph-mon[32696]: from='mgr.? 172.21.15.161:0/981736726' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T13:44:35.897 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:35 smithi161 ceph-mon[32696]: from='mgr.? 172.21.15.161:0/981736726' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T13:44:35.897 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:35 smithi161 ceph-mon[32696]: Standby manager daemon z restarted 2024-04-25T13:44:35.898 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:35 smithi161 ceph-mon[32696]: Standby manager daemon z started 2024-04-25T13:44:35.898 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:35 smithi161 ceph-mon[32696]: from='mgr.? 172.21.15.175:0/3368215107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T13:44:35.898 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:35 smithi161 ceph-mon[32696]: from='mgr.? 172.21.15.175:0/3368215107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T13:44:35.898 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:35 smithi161 ceph-mon[32696]: from='mgr.? 172.21.15.175:0/3368215107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T13:44:35.898 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:35 smithi161 ceph-mon[32696]: from='mgr.? 172.21.15.175:0/3368215107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T13:44:35.913 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:35 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/22764791' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-25T13:44:35.913 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:35 smithi175 ceph-mon[32649]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:44:35.913 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:35 smithi175 ceph-mon[32649]: Standby manager daemon y restarted 2024-04-25T13:44:35.913 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:35 smithi175 ceph-mon[32649]: Standby manager daemon y started 2024-04-25T13:44:35.914 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:35 smithi175 ceph-mon[32649]: from='mgr.? 172.21.15.161:0/981736726' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T13:44:35.914 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:35 smithi175 ceph-mon[32649]: from='mgr.? 172.21.15.161:0/981736726' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T13:44:35.914 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:35 smithi175 ceph-mon[32649]: from='mgr.? 172.21.15.161:0/981736726' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T13:44:35.914 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:35 smithi175 ceph-mon[32649]: from='mgr.? 172.21.15.161:0/981736726' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T13:44:35.914 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:35 smithi175 ceph-mon[32649]: Standby manager daemon z restarted 2024-04-25T13:44:35.914 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:35 smithi175 ceph-mon[32649]: Standby manager daemon z started 2024-04-25T13:44:35.914 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:35 smithi175 ceph-mon[32649]: from='mgr.? 172.21.15.175:0/3368215107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T13:44:35.914 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:35 smithi175 ceph-mon[32649]: from='mgr.? 172.21.15.175:0/3368215107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T13:44:35.914 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:35 smithi175 ceph-mon[32649]: from='mgr.? 172.21.15.175:0/3368215107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T13:44:35.914 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:35 smithi175 ceph-mon[32649]: from='mgr.? 172.21.15.175:0/3368215107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T13:44:36.215 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:35.920+0000 7f274ac8d700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:44:36.215 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:35.920+0000 7f274ac8d700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:44:36.215 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:35.920+0000 7f274ac8d700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:44:36.215 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:35.920+0000 7f274ac8d700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:44:36.215 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:35.920+0000 7f274ac8d700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:44:36.215 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:35.920+0000 7f2747446700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:44:36.215 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:35.920+0000 7f2747446700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:44:36.215 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:35.920+0000 7f2747446700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:44:36.215 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:35.920+0000 7f2747446700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:44:36.216 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:35.920+0000 7f2747446700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:44:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.659+0000 7f9bd77fe640 1 -- 172.21.15.43:0/2624781809 <== mon.2 v2:172.21.15.161:3300/0 9 ==== mgrmap(e 22) ==== 147332+0+0 (secure 0 0 0) 0x7f9bd008e6c0 con 0x7f9be0102a20 2024-04-25T13:44:36.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.660+0000 7f9bd77fe640 1 --2- 172.21.15.43:0/2624781809 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9bcc039e40 0x7f9bcc03a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:36.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.660+0000 7f9bd77fe640 1 -- 172.21.15.43:0/2624781809 --> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f9bcc0411f0 con 0x7f9bcc039e40 2024-04-25T13:44:36.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.663+0000 7f9be5c3a640 1 --2- 172.21.15.43:0/2624781809 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9bcc039e40 0x7f9bcc03a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:36.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.665+0000 7f9be5c3a640 1 --2- 172.21.15.43:0/2624781809 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9bcc039e40 0x7f9bcc03a250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9be019a0b0 tx=0x7f9bdc005f90 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:36.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.684+0000 7f9bd77fe640 1 -- 172.21.15.43:0/2624781809 <== mgr.15486 v2:172.21.15.43:6800/1964865924 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f9bcc0411f0 con 0x7f9bcc039e40 2024-04-25T13:44:36.683 INFO:teuthology.orchestra.run.smithi043.stdout:{} 2024-04-25T13:44:36.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.686+0000 7f9be869f640 1 -- 172.21.15.43:0/2624781809 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9bcc039e40 msgr2=0x7f9bcc03a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:36.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.686+0000 7f9be869f640 1 --2- 172.21.15.43:0/2624781809 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9bcc039e40 0x7f9bcc03a250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9be019a0b0 tx=0x7f9bdc005f90 comp rx=0 tx=0).stop 2024-04-25T13:44:36.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.686+0000 7f9be869f640 1 -- 172.21.15.43:0/2624781809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9be0102a20 msgr2=0x7f9be0199010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:36.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.686+0000 7f9be869f640 1 --2- 172.21.15.43:0/2624781809 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9be0102a20 0x7f9be0199010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9be01022f0 tx=0x7f9bd000ee50 comp rx=0 tx=0).stop 2024-04-25T13:44:36.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.686+0000 7f9be6c3c640 1 -- 172.21.15.43:0/2624781809 reap_dead start 2024-04-25T13:44:36.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.686+0000 7f9be869f640 1 -- 172.21.15.43:0/2624781809 shutdown_connections 2024-04-25T13:44:36.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.686+0000 7f9be869f640 1 -- 172.21.15.43:0/2624781809 >> 172.21.15.43:0/2624781809 conn(0x7f9be00fdc10 msgr2=0x7f9be0104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:36.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.686+0000 7f9be869f640 1 -- 172.21.15.43:0/2624781809 shutdown_connections 2024-04-25T13:44:36.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.686+0000 7f9be869f640 1 -- 172.21.15.43:0/2624781809 wait complete. 2024-04-25T13:44:36.697 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-25T13:44:36.708 INFO:teuthology.run_tasks:Running task exec... 2024-04-25T13:44:36.726 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T13:44:36.727 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T13:44:36.727 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-04-25T13:44:36.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.844+0000 7ff5c199d640 1 -- 172.21.15.43:0/3571653696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5bc101fe0 msgr2=0x7ff5bc102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:36.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.844+0000 7ff5c199d640 1 --2- 172.21.15.43:0/3571653696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5bc101fe0 0x7ff5bc102ce0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0009900 tx=0x7ff5b002a410 comp rx=0 tx=0).stop 2024-04-25T13:44:36.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.844+0000 7ff5c199d640 1 -- 172.21.15.43:0/3571653696 shutdown_connections 2024-04-25T13:44:36.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.844+0000 7ff5c199d640 1 --2- 172.21.15.43:0/3571653696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5bc107f20 0x7ff5bc10a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:36.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.844+0000 7ff5c199d640 1 --2- 172.21.15.43:0/3571653696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5bc103220 0x7ff5bc103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:36.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.844+0000 7ff5c199d640 1 --2- 172.21.15.43:0/3571653696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5bc101fe0 0x7ff5bc102ce0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:36.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.844+0000 7ff5c199d640 1 -- 172.21.15.43:0/3571653696 >> 172.21.15.43:0/3571653696 conn(0x7ff5bc0fd1d0 msgr2=0x7ff5bc0ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:36.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.844+0000 7ff5c199d640 1 -- 172.21.15.43:0/3571653696 shutdown_connections 2024-04-25T13:44:36.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.844+0000 7ff5c199d640 1 -- 172.21.15.43:0/3571653696 wait complete. 2024-04-25T13:44:36.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.845+0000 7ff5c199d640 1 Processor -- start 2024-04-25T13:44:36.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.845+0000 7ff5c199d640 1 -- start start 2024-04-25T13:44:36.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.845+0000 7ff5c199d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5bc101fe0 0x7ff5bc199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:36.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.845+0000 7ff5c199d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5bc103220 0x7ff5bc19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:36.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.845+0000 7ff5c199d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5bc107f20 0x7ff5bc1a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:36.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.845+0000 7ff5c199d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc10e200 con 0x7ff5bc101fe0 2024-04-25T13:44:36.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.845+0000 7ff5c199d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc10e080 con 0x7ff5bc103220 2024-04-25T13:44:36.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.845+0000 7ff5c199d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc10e380 con 0x7ff5bc107f20 2024-04-25T13:44:36.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.845+0000 7ff5c099b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5bc101fe0 0x7ff5bc199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:36.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.845+0000 7ff5bbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5bc103220 0x7ff5bc19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:36.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.845+0000 7ff5c099b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5bc101fe0 0x7ff5bc199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37180/0 (socket says 172.21.15.43:37180) 2024-04-25T13:44:36.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.845+0000 7ff5c099b640 1 -- 172.21.15.43:0/384631593 learned_addr learned my addr 172.21.15.43:0/384631593 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:36.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.845+0000 7ff5c119c640 1 --2- 172.21.15.43:0/384631593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5bc107f20 0x7ff5bc1a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:36.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.846+0000 7ff5c099b640 1 -- 172.21.15.43:0/384631593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5bc107f20 msgr2=0x7ff5bc1a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:36.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.846+0000 7ff5c099b640 1 --2- 172.21.15.43:0/384631593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5bc107f20 0x7ff5bc1a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:36.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.846+0000 7ff5c099b640 1 -- 172.21.15.43:0/384631593 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5bc103220 msgr2=0x7ff5bc19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:36.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.846+0000 7ff5c099b640 1 --2- 172.21.15.43:0/384631593 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5bc103220 0x7ff5bc19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:36.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.846+0000 7ff5c099b640 1 -- 172.21.15.43:0/384631593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5bc1a1b20 con 0x7ff5bc101fe0 2024-04-25T13:44:36.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.846+0000 7ff5c099b640 1 --2- 172.21.15.43:0/384631593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5bc101fe0 0x7ff5bc199fe0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0005760 tx=0x7ff5b0005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:36.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.846+0000 7ff5b9ffb640 1 -- 172.21.15.43:0/384631593 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b003f030 con 0x7ff5bc101fe0 2024-04-25T13:44:36.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.846+0000 7ff5b9ffb640 1 -- 172.21.15.43:0/384631593 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5b00043d0 con 0x7ff5bc101fe0 2024-04-25T13:44:36.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.846+0000 7ff5c199d640 1 -- 172.21.15.43:0/384631593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5bc1a1db0 con 0x7ff5bc101fe0 2024-04-25T13:44:36.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.846+0000 7ff5b9ffb640 1 -- 172.21.15.43:0/384631593 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b0035070 con 0x7ff5bc101fe0 2024-04-25T13:44:36.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.846+0000 7ff5c199d640 1 -- 172.21.15.43:0/384631593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5bc1a2200 con 0x7ff5bc101fe0 2024-04-25T13:44:36.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.847+0000 7ff5c199d640 1 -- 172.21.15.43:0/384631593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5bc1a2430 con 0x7ff5bc101fe0 2024-04-25T13:44:36.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.849+0000 7ff5b9ffb640 1 -- 172.21.15.43:0/384631593 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 22) ==== 147332+0+0 (secure 0 0 0) 0x7ff5b0042030 con 0x7ff5bc101fe0 2024-04-25T13:44:36.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.850+0000 7ff5b9ffb640 1 --2- 172.21.15.43:0/384631593 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7ff5ac0af960 0x7ff5ac0b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:36.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.850+0000 7ff5bbfff640 1 --2- 172.21.15.43:0/384631593 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7ff5ac0af960 0x7ff5ac0b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:36.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.850+0000 7ff5b9ffb640 1 -- 172.21.15.43:0/384631593 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9379+0+0 (secure 0 0 0) 0x7ff5b00ff2a0 con 0x7ff5bc101fe0 2024-04-25T13:44:36.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.850+0000 7ff5bbfff640 1 --2- 172.21.15.43:0/384631593 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7ff5ac0af960 0x7ff5ac0b1e70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc19b080 tx=0x7ff5a8005f90 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:36.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:36.854+0000 7ff5b9ffb640 1 -- 172.21.15.43:0/384631593 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff5b00c76a0 con 0x7ff5bc101fe0 2024-04-25T13:44:36.924 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: Active manager daemon x restarted 2024-04-25T13:44:36.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: Activating manager daemon x 2024-04-25T13:44:36.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: mgrmap e20: x(active, since 9m), standbys: z, y 2024-04-25T13:44:36.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: osdmap e85: 12 total, 12 up, 12 in 2024-04-25T13:44:36.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: mgrmap e21: x(active, starting, since 0.0127653s), standbys: z, y 2024-04-25T13:44:36.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:44:36.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:44:36.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:44:36.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T13:44:36.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T13:44:36.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T13:44:36.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T13:44:36.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T13:44:36.926 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T13:44:36.926 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T13:44:36.926 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T13:44:36.926 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T13:44:36.926 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T13:44:36.926 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T13:44:36.926 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T13:44:36.926 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T13:44:36.926 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T13:44:36.926 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T13:44:36.926 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:44:36.926 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:44:36.927 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:44:36.927 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:44:36.927 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:44:36.927 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:44:36.927 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:44:36.927 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:44:36.927 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:44:36.927 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:44:36.927 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:44:36.927 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:44:36.927 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T13:44:36.927 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T13:44:36.927 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T13:44:36.927 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: Manager daemon x is now available 2024-04-25T13:44:36.928 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:44:36.928 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T13:44:36.928 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T13:44:36.928 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:36 smithi161 ceph-mon[32696]: [25/Apr/2024:13:44:36] ENGINE Bus STARTING 2024-04-25T13:44:36.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: Active manager daemon x restarted 2024-04-25T13:44:36.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: Activating manager daemon x 2024-04-25T13:44:36.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: mgrmap e20: x(active, since 9m), standbys: z, y 2024-04-25T13:44:36.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: osdmap e85: 12 total, 12 up, 12 in 2024-04-25T13:44:36.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: mgrmap e21: x(active, starting, since 0.0127653s), standbys: z, y 2024-04-25T13:44:36.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:44:36.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:44:36.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:44:36.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T13:44:36.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T13:44:36.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T13:44:36.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T13:44:36.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T13:44:36.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T13:44:36.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T13:44:36.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T13:44:36.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T13:44:36.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T13:44:36.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T13:44:36.932 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T13:44:36.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T13:44:36.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T13:44:36.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T13:44:36.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:44:36.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:44:36.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:44:36.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:44:36.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:44:36.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:44:36.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:44:36.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:44:36.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:44:36.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:44:36.933 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:44:36.934 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:44:36.934 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T13:44:36.934 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T13:44:36.934 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T13:44:36.934 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: Manager daemon x is now available 2024-04-25T13:44:36.934 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:44:36.934 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T13:44:36.934 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T13:44:36.934 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:36 smithi175 ceph-mon[32649]: [25/Apr/2024:13:44:36] ENGINE Bus STARTING 2024-04-25T13:44:36.951 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:36.672+0000 7f2745442700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:44:36.951 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:36.672+0000 7f2745442700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:44:36.951 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:36.672+0000 7f2745442700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:44:36.951 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:36.672+0000 7f2745442700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:44:36.951 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:44:36.672+0000 7f2745442700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:44:36.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: Active manager daemon x restarted 2024-04-25T13:44:36.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: Activating manager daemon x 2024-04-25T13:44:36.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: mgrmap e20: x(active, since 9m), standbys: z, y 2024-04-25T13:44:36.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: osdmap e85: 12 total, 12 up, 12 in 2024-04-25T13:44:36.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: mgrmap e21: x(active, starting, since 0.0127653s), standbys: z, y 2024-04-25T13:44:36.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T13:44:36.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T13:44:36.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T13:44:36.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T13:44:36.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T13:44:36.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T13:44:36.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T13:44:36.953 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T13:44:36.953 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T13:44:36.953 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T13:44:36.953 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T13:44:36.953 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T13:44:36.953 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T13:44:36.953 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T13:44:36.953 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T13:44:36.953 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T13:44:36.953 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T13:44:36.953 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T13:44:36.953 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T13:44:36.954 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T13:44:36.954 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T13:44:36.954 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T13:44:36.954 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T13:44:36.954 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T13:44:36.954 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T13:44:36.954 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T13:44:36.954 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T13:44:36.954 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T13:44:36.954 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T13:44:36.954 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T13:44:36.955 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T13:44:36.955 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T13:44:36.955 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T13:44:36.955 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: Manager daemon x is now available 2024-04-25T13:44:36.955 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:44:36.955 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T13:44:36.955 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T13:44:36.955 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:36 smithi043 ceph-mon[29195]: [25/Apr/2024:13:44:36] ENGINE Bus STARTING 2024-04-25T13:44:37.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.043+0000 7ff5c199d640 1 -- 172.21.15.43:0/384631593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7ff5bc1a2600 con 0x7ff5bc101fe0 2024-04-25T13:44:37.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.049+0000 7ff5b9ffb640 1 -- 172.21.15.43:0/384631593 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v30)=0 v30) ==== 129+0+0 (secure 0 0 0) 0x7ff5b00cb9a0 con 0x7ff5bc101fe0 2024-04-25T13:44:37.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.052+0000 7ff5c199d640 1 -- 172.21.15.43:0/384631593 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7ff5ac0af960 msgr2=0x7ff5ac0b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:37.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.052+0000 7ff5c199d640 1 --2- 172.21.15.43:0/384631593 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7ff5ac0af960 0x7ff5ac0b1e70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc19b080 tx=0x7ff5a8005f90 comp rx=0 tx=0).stop 2024-04-25T13:44:37.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.052+0000 7ff5c199d640 1 -- 172.21.15.43:0/384631593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5bc101fe0 msgr2=0x7ff5bc199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:37.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.052+0000 7ff5c199d640 1 --2- 172.21.15.43:0/384631593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5bc101fe0 0x7ff5bc199fe0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0005760 tx=0x7ff5b0005e20 comp rx=0 tx=0).stop 2024-04-25T13:44:37.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.052+0000 7ff5c199d640 1 -- 172.21.15.43:0/384631593 shutdown_connections 2024-04-25T13:44:37.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.052+0000 7ff5c199d640 1 --2- 172.21.15.43:0/384631593 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7ff5ac0af960 0x7ff5ac0b1e70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.052+0000 7ff5c199d640 1 --2- 172.21.15.43:0/384631593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5bc107f20 0x7ff5bc1a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.052+0000 7ff5c199d640 1 --2- 172.21.15.43:0/384631593 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5bc103220 0x7ff5bc19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.052+0000 7ff5c199d640 1 --2- 172.21.15.43:0/384631593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5bc101fe0 0x7ff5bc199fe0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.052+0000 7ff5c199d640 1 -- 172.21.15.43:0/384631593 >> 172.21.15.43:0/384631593 conn(0x7ff5bc0fd1d0 msgr2=0x7ff5bc10aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:37.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.052+0000 7ff5c199d640 1 -- 172.21.15.43:0/384631593 shutdown_connections 2024-04-25T13:44:37.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.052+0000 7ff5c199d640 1 -- 172.21.15.43:0/384631593 wait complete. 2024-04-25T13:44:37.065 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-04-25T13:44:37.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.184+0000 7efe17c42640 1 -- 172.21.15.43:0/766761875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe10102a10 msgr2=0x7efe10103710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:37.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.184+0000 7efe17c42640 1 --2- 172.21.15.43:0/766761875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe10102a10 0x7efe10103710 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009900 tx=0x7efe0c02a410 comp rx=0 tx=0).stop 2024-04-25T13:44:37.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.184+0000 7efe17c42640 1 -- 172.21.15.43:0/766761875 shutdown_connections 2024-04-25T13:44:37.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.184+0000 7efe17c42640 1 --2- 172.21.15.43:0/766761875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe10108950 0x7efe1010ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.184+0000 7efe17c42640 1 --2- 172.21.15.43:0/766761875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe10103c50 0x7efe10104060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.184+0000 7efe17c42640 1 --2- 172.21.15.43:0/766761875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe10102a10 0x7efe10103710 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.184+0000 7efe17c42640 1 -- 172.21.15.43:0/766761875 >> 172.21.15.43:0/766761875 conn(0x7efe100fdc00 msgr2=0x7efe101000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.184+0000 7efe17c42640 1 -- 172.21.15.43:0/766761875 shutdown_connections 2024-04-25T13:44:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.184+0000 7efe17c42640 1 -- 172.21.15.43:0/766761875 wait complete. 2024-04-25T13:44:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe17c42640 1 Processor -- start 2024-04-25T13:44:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe17c42640 1 -- start start 2024-04-25T13:44:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe17c42640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe10102a10 0x7efe10199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe17c42640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe10103c50 0x7efe10199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe17c42640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe10108950 0x7efe101a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe17c42640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efe1010e410 con 0x7efe10108950 2024-04-25T13:44:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe17c42640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7efe1010e290 con 0x7efe10102a10 2024-04-25T13:44:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe17c42640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efe1010e590 con 0x7efe10103c50 2024-04-25T13:44:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe161df640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe10108950 0x7efe101a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe161df640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe10108950 0x7efe101a0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37206/0 (socket says 172.21.15.43:37206) 2024-04-25T13:44:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe151dd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe10103c50 0x7efe10199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe161df640 1 -- 172.21.15.43:0/2876397210 learned_addr learned my addr 172.21.15.43:0/2876397210 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe159de640 1 --2- 172.21.15.43:0/2876397210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe10102a10 0x7efe10199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe161df640 1 -- 172.21.15.43:0/2876397210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe10103c50 msgr2=0x7efe10199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe161df640 1 --2- 172.21.15.43:0/2876397210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe10103c50 0x7efe10199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe161df640 1 -- 172.21.15.43:0/2876397210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe10102a10 msgr2=0x7efe10199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe161df640 1 --2- 172.21.15.43:0/2876397210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe10102a10 0x7efe10199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.185+0000 7efe161df640 1 -- 172.21.15.43:0/2876397210 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe10074ed0 con 0x7efe10108950 2024-04-25T13:44:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.186+0000 7efe161df640 1 --2- 172.21.15.43:0/2876397210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe10108950 0x7efe101a0590 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efe0800eb10 tx=0x7efe0800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.186+0000 7efe06ffd640 1 -- 172.21.15.43:0/2876397210 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe08004b20 con 0x7efe10108950 2024-04-25T13:44:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.186+0000 7efe06ffd640 1 -- 172.21.15.43:0/2876397210 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe08004cc0 con 0x7efe10108950 2024-04-25T13:44:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.186+0000 7efe17c42640 1 -- 172.21.15.43:0/2876397210 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe100751c0 con 0x7efe10108950 2024-04-25T13:44:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.186+0000 7efe06ffd640 1 -- 172.21.15.43:0/2876397210 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe08010690 con 0x7efe10108950 2024-04-25T13:44:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.186+0000 7efe17c42640 1 -- 172.21.15.43:0/2876397210 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe100756c0 con 0x7efe10108950 2024-04-25T13:44:37.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.187+0000 7efe17c42640 1 -- 172.21.15.43:0/2876397210 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe10107760 con 0x7efe10108950 2024-04-25T13:44:37.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.188+0000 7efe06ffd640 1 -- 172.21.15.43:0/2876397210 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 22) ==== 147332+0+0 (secure 0 0 0) 0x7efe08005000 con 0x7efe10108950 2024-04-25T13:44:37.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.189+0000 7efe06ffd640 1 --2- 172.21.15.43:0/2876397210 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7efdfc0af8e0 0x7efdfc0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:37.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.189+0000 7efe06ffd640 1 -- 172.21.15.43:0/2876397210 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9379+0+0 (secure 0 0 0) 0x7efe080df480 con 0x7efe10108950 2024-04-25T13:44:37.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.189+0000 7efe159de640 1 --2- 172.21.15.43:0/2876397210 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7efdfc0af8e0 0x7efdfc0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:37.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.189+0000 7efe159de640 1 --2- 172.21.15.43:0/2876397210 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7efdfc0af8e0 0x7efdfc0b1df0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe0c02a930 tx=0x7efe0c031400 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.193+0000 7efe06ffd640 1 -- 172.21.15.43:0/2876397210 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efe08053ff0 con 0x7efe10108950 2024-04-25T13:44:37.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.385+0000 7efe17c42640 1 -- 172.21.15.43:0/2876397210 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7efe10075980 con 0x7efe10108950 2024-04-25T13:44:37.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.389+0000 7efe06ffd640 1 -- 172.21.15.43:0/2876397210 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) ==== 138+0+0 (secure 0 0 0) 0x7efe080a7ed0 con 0x7efe10108950 2024-04-25T13:44:37.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.392+0000 7efe17c42640 1 -- 172.21.15.43:0/2876397210 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7efdfc0af8e0 msgr2=0x7efdfc0b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:37.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.392+0000 7efe17c42640 1 --2- 172.21.15.43:0/2876397210 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7efdfc0af8e0 0x7efdfc0b1df0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe0c02a930 tx=0x7efe0c031400 comp rx=0 tx=0).stop 2024-04-25T13:44:37.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.392+0000 7efe17c42640 1 -- 172.21.15.43:0/2876397210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe10108950 msgr2=0x7efe101a0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:37.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.392+0000 7efe17c42640 1 --2- 172.21.15.43:0/2876397210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe10108950 0x7efe101a0590 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efe0800eb10 tx=0x7efe0800c2d0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.392+0000 7efe17c42640 1 -- 172.21.15.43:0/2876397210 shutdown_connections 2024-04-25T13:44:37.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.392+0000 7efe17c42640 1 --2- 172.21.15.43:0/2876397210 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7efdfc0af8e0 0x7efdfc0b1df0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.392+0000 7efe17c42640 1 --2- 172.21.15.43:0/2876397210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe10108950 0x7efe101a0590 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.392+0000 7efe17c42640 1 --2- 172.21.15.43:0/2876397210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe10103c50 0x7efe10199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.392+0000 7efe17c42640 1 --2- 172.21.15.43:0/2876397210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe10102a10 0x7efe10199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.392+0000 7efe17c42640 1 -- 172.21.15.43:0/2876397210 >> 172.21.15.43:0/2876397210 conn(0x7efe100fdc00 msgr2=0x7efe10104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:37.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.392+0000 7efe17c42640 1 -- 172.21.15.43:0/2876397210 shutdown_connections 2024-04-25T13:44:37.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.392+0000 7efe17c42640 1 -- 172.21.15.43:0/2876397210 wait complete. 2024-04-25T13:44:37.403 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-04-25T13:44:37.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.531+0000 7f75d5f00640 1 -- 172.21.15.43:0/566774746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75d0103b40 msgr2=0x7f75d0104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:37.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.531+0000 7f75d5f00640 1 --2- 172.21.15.43:0/566774746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75d0103b40 0x7f75d0104840 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f75c0009900 tx=0x7f75c002a410 comp rx=0 tx=0).stop 2024-04-25T13:44:37.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.531+0000 7f75d5f00640 1 -- 172.21.15.43:0/566774746 shutdown_connections 2024-04-25T13:44:37.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.531+0000 7f75d5f00640 1 --2- 172.21.15.43:0/566774746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d0109a80 0x7f75d010bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.531+0000 7f75d5f00640 1 --2- 172.21.15.43:0/566774746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d0104d80 0x7f75d0105190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.531+0000 7f75d5f00640 1 --2- 172.21.15.43:0/566774746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75d0103b40 0x7f75d0104840 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.531+0000 7f75d5f00640 1 -- 172.21.15.43:0/566774746 >> 172.21.15.43:0/566774746 conn(0x7f75d00fed30 msgr2=0x7f75d01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:37.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.531+0000 7f75d5f00640 1 -- 172.21.15.43:0/566774746 shutdown_connections 2024-04-25T13:44:37.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.531+0000 7f75d5f00640 1 -- 172.21.15.43:0/566774746 wait complete. 2024-04-25T13:44:37.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.532+0000 7f75d5f00640 1 Processor -- start 2024-04-25T13:44:37.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.532+0000 7f75d5f00640 1 -- start start 2024-04-25T13:44:37.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.532+0000 7f75d5f00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d0103b40 0x7f75d019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:37.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.532+0000 7f75d5f00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d0104d80 0x7f75d019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:37.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.532+0000 7f75d5f00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75d0109a80 0x7f75d01a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:37.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.532+0000 7f75d5f00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75d010f4d0 con 0x7f75d0109a80 2024-04-25T13:44:37.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.532+0000 7f75d5f00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f75d010f350 con 0x7f75d0104d80 2024-04-25T13:44:37.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.532+0000 7f75d5f00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75d010f650 con 0x7f75d0103b40 2024-04-25T13:44:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.533+0000 7f75cffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75d0109a80 0x7f75d01a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.533+0000 7f75ceffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d0104d80 0x7f75d019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.533+0000 7f75ceffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d0104d80 0x7f75d019a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.43:43476/0 (socket says 172.21.15.43:43476) 2024-04-25T13:44:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.533+0000 7f75ceffd640 1 -- 172.21.15.43:0/111942910 learned_addr learned my addr 172.21.15.43:0/111942910 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.533+0000 7f75cffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75d0109a80 0x7f75d01a1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37212/0 (socket says 172.21.15.43:37212) 2024-04-25T13:44:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.533+0000 7f75cf7fe640 1 --2- 172.21.15.43:0/111942910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d0103b40 0x7f75d019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.533+0000 7f75ceffd640 1 -- 172.21.15.43:0/111942910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d0103b40 msgr2=0x7f75d019a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.533+0000 7f75ceffd640 1 --2- 172.21.15.43:0/111942910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d0103b40 0x7f75d019a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.533+0000 7f75ceffd640 1 -- 172.21.15.43:0/111942910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75d0109a80 msgr2=0x7f75d01a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.533+0000 7f75ceffd640 1 --2- 172.21.15.43:0/111942910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75d0109a80 0x7f75d01a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.533+0000 7f75ceffd640 1 -- 172.21.15.43:0/111942910 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d01a1cd0 con 0x7f75d0104d80 2024-04-25T13:44:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.533+0000 7f75ceffd640 1 --2- 172.21.15.43:0/111942910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d0104d80 0x7f75d019a6d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f75c400e9f0 tx=0x7f75c400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.533+0000 7f75ccff9640 1 -- 172.21.15.43:0/111942910 <== mon.2 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c400cd80 con 0x7f75d0104d80 2024-04-25T13:44:37.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.533+0000 7f75d5f00640 1 -- 172.21.15.43:0/111942910 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d01a1fc0 con 0x7f75d0104d80 2024-04-25T13:44:37.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.533+0000 7f75ccff9640 1 -- 172.21.15.43:0/111942910 <== mon.2 v2:172.21.15.161:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75c40108c0 con 0x7f75d0104d80 2024-04-25T13:44:37.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.533+0000 7f75ccff9640 1 -- 172.21.15.43:0/111942910 <== mon.2 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c40187c0 con 0x7f75d0104d80 2024-04-25T13:44:37.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.534+0000 7f75d5f00640 1 -- 172.21.15.43:0/111942910 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d01a2430 con 0x7f75d0104d80 2024-04-25T13:44:37.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.534+0000 7f75d5f00640 1 -- 172.21.15.43:0/111942910 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d0108890 con 0x7f75d0104d80 2024-04-25T13:44:37.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.536+0000 7f75ccff9640 1 -- 172.21.15.43:0/111942910 <== mon.2 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 22) ==== 147332+0+0 (secure 0 0 0) 0x7f75c4010430 con 0x7f75d0104d80 2024-04-25T13:44:37.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.537+0000 7f75ccff9640 1 --2- 172.21.15.43:0/111942910 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f75b80af960 0x7f75b80b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:37.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.537+0000 7f75ccff9640 1 -- 172.21.15.43:0/111942910 <== mon.2 v2:172.21.15.161:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9379+0+0 (secure 0 0 0) 0x7f75c40df4a0 con 0x7f75d0104d80 2024-04-25T13:44:37.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.537+0000 7f75cf7fe640 1 --2- 172.21.15.43:0/111942910 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f75b80af960 0x7f75b80b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:37.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.538+0000 7f75cf7fe640 1 --2- 172.21.15.43:0/111942910 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f75b80af960 0x7f75b80b1e70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f75c0005760 tx=0x7f75c0000bc0 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:37.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.541+0000 7f75ccff9640 1 -- 172.21.15.43:0/111942910 <== mon.2 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f75c40a7860 con 0x7f75d0104d80 2024-04-25T13:44:37.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:37 smithi043 ceph-mon[29195]: [25/Apr/2024:13:44:36] ENGINE Serving on https://172.21.15.43:7150 2024-04-25T13:44:37.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:37 smithi043 ceph-mon[29195]: [25/Apr/2024:13:44:36] ENGINE Serving on http://172.21.15.43:8765 2024-04-25T13:44:37.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:37 smithi043 ceph-mon[29195]: [25/Apr/2024:13:44:36] ENGINE Bus STARTED 2024-04-25T13:44:37.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:37 smithi043 ceph-mon[29195]: mgrmap e22: x(active, since 1.02313s), standbys: z, y 2024-04-25T13:44:37.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:37 smithi043 ceph-mon[29195]: from='client.25205 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:37.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:37 smithi043 ceph-mon[29195]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:44:37.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:37 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/384631593' entity='client.admin' 2024-04-25T13:44:37.713 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:37 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2876397210' entity='client.admin' 2024-04-25T13:44:37.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.792+0000 7f75d5f00640 1 -- 172.21.15.43:0/111942910 --> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f75d0062fe0 con 0x7f75b80af960 2024-04-25T13:44:37.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.825+0000 7f75ccff9640 1 -- 172.21.15.43:0/111942910 <== mgr.15486 v2:172.21.15.43:6800/1964865924 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f75d0062fe0 con 0x7f75b80af960 2024-04-25T13:44:37.824 INFO:teuthology.orchestra.run.smithi043.stdout:Schedule set for path / 2024-04-25T13:44:37.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.827+0000 7f75d5f00640 1 -- 172.21.15.43:0/111942910 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f75b80af960 msgr2=0x7f75b80b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:37.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.827+0000 7f75d5f00640 1 --2- 172.21.15.43:0/111942910 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f75b80af960 0x7f75b80b1e70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f75c0005760 tx=0x7f75c0000bc0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.828+0000 7f75d5f00640 1 -- 172.21.15.43:0/111942910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d0104d80 msgr2=0x7f75d019a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:37.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.828+0000 7f75d5f00640 1 --2- 172.21.15.43:0/111942910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d0104d80 0x7f75d019a6d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f75c400e9f0 tx=0x7f75c400eeb0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.828+0000 7f75d5f00640 1 -- 172.21.15.43:0/111942910 shutdown_connections 2024-04-25T13:44:37.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.828+0000 7f75d5f00640 1 --2- 172.21.15.43:0/111942910 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f75b80af960 0x7f75b80b1e70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.828+0000 7f75d5f00640 1 --2- 172.21.15.43:0/111942910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75d0109a80 0x7f75d01a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.828+0000 7f75d5f00640 1 --2- 172.21.15.43:0/111942910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d0104d80 0x7f75d019a6d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.828+0000 7f75d5f00640 1 --2- 172.21.15.43:0/111942910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d0103b40 0x7f75d019a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.828+0000 7f75d5f00640 1 -- 172.21.15.43:0/111942910 >> 172.21.15.43:0/111942910 conn(0x7f75d00fed30 msgr2=0x7f75d0105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:37.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.828+0000 7f75d5f00640 1 -- 172.21.15.43:0/111942910 shutdown_connections 2024-04-25T13:44:37.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.828+0000 7f75d5f00640 1 -- 172.21.15.43:0/111942910 wait complete. 2024-04-25T13:44:37.839 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-04-25T13:44:37.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:37 smithi175 ceph-mon[32649]: [25/Apr/2024:13:44:36] ENGINE Serving on https://172.21.15.43:7150 2024-04-25T13:44:37.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:37 smithi175 ceph-mon[32649]: [25/Apr/2024:13:44:36] ENGINE Serving on http://172.21.15.43:8765 2024-04-25T13:44:37.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:37 smithi175 ceph-mon[32649]: [25/Apr/2024:13:44:36] ENGINE Bus STARTED 2024-04-25T13:44:37.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:37 smithi175 ceph-mon[32649]: mgrmap e22: x(active, since 1.02313s), standbys: z, y 2024-04-25T13:44:37.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:37 smithi175 ceph-mon[32649]: from='client.25205 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:37.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:37 smithi175 ceph-mon[32649]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:44:37.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:37 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/384631593' entity='client.admin' 2024-04-25T13:44:37.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:37 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2876397210' entity='client.admin' 2024-04-25T13:44:37.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.958+0000 7f069957d640 1 -- 172.21.15.43:0/1389251013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0694108950 msgr2=0x7f069410ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:37.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.958+0000 7f069957d640 1 --2- 172.21.15.43:0/1389251013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0694108950 0x7f069410ad70 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f068c009ca0 tx=0x7f068c02a8c0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.958+0000 7f069957d640 1 -- 172.21.15.43:0/1389251013 shutdown_connections 2024-04-25T13:44:37.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.958+0000 7f069957d640 1 --2- 172.21.15.43:0/1389251013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0694108950 0x7f069410ad70 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.958+0000 7f069957d640 1 --2- 172.21.15.43:0/1389251013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0694103c50 0x7f0694104060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.958+0000 7f069957d640 1 --2- 172.21.15.43:0/1389251013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0694102a10 0x7f0694103710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.959+0000 7f069957d640 1 -- 172.21.15.43:0/1389251013 >> 172.21.15.43:0/1389251013 conn(0x7f06940fdc00 msgr2=0x7f06941000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:37.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.959+0000 7f069957d640 1 -- 172.21.15.43:0/1389251013 shutdown_connections 2024-04-25T13:44:37.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.959+0000 7f069957d640 1 -- 172.21.15.43:0/1389251013 wait complete. 2024-04-25T13:44:37.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.959+0000 7f069957d640 1 Processor -- start 2024-04-25T13:44:37.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.959+0000 7f069957d640 1 -- start start 2024-04-25T13:44:37.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.959+0000 7f069957d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0694102a10 0x7f069410d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:37.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.959+0000 7f069957d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0694103c50 0x7f069410b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:37.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.959+0000 7f069957d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0694108950 0x7f069410bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:37.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.959+0000 7f069957d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f069410f550 con 0x7f0694108950 2024-04-25T13:44:37.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.959+0000 7f069957d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f069410f3d0 con 0x7f0694103c50 2024-04-25T13:44:37.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.959+0000 7f069957d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f069410f6d0 con 0x7f0694102a10 2024-04-25T13:44:37.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.960+0000 7f06937fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0694108950 0x7f069410bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:37.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.960+0000 7f06937fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0694108950 0x7f069410bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37244/0 (socket says 172.21.15.43:37244) 2024-04-25T13:44:37.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.960+0000 7f06937fe640 1 -- 172.21.15.43:0/44722065 learned_addr learned my addr 172.21.15.43:0/44722065 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:37.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.960+0000 7f0692ffd640 1 --2- 172.21.15.43:0/44722065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0694102a10 0x7f069410d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:37.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.960+0000 7f068bfff640 1 --2- 172.21.15.43:0/44722065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0694103c50 0x7f069410b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:37.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.960+0000 7f06937fe640 1 -- 172.21.15.43:0/44722065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0694102a10 msgr2=0x7f069410d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:37.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.960+0000 7f06937fe640 1 --2- 172.21.15.43:0/44722065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0694102a10 0x7f069410d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.960+0000 7f06937fe640 1 -- 172.21.15.43:0/44722065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0694103c50 msgr2=0x7f069410b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:37.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.960+0000 7f06937fe640 1 --2- 172.21.15.43:0/44722065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0694103c50 0x7f069410b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:37.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.960+0000 7f06937fe640 1 -- 172.21.15.43:0/44722065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069410c5f0 con 0x7f0694108950 2024-04-25T13:44:37.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.960+0000 7f0692ffd640 1 --2- 172.21.15.43:0/44722065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0694102a10 0x7f069410d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:44:37.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.960+0000 7f06937fe640 1 --2- 172.21.15.43:0/44722065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0694108950 0x7f069410bec0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f068c031040 tx=0x7f068c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:37.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.960+0000 7f0690ff9640 1 -- 172.21.15.43:0/44722065 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c003d60 con 0x7f0694108950 2024-04-25T13:44:37.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.960+0000 7f069957d640 1 -- 172.21.15.43:0/44722065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06941a41d0 con 0x7f0694108950 2024-04-25T13:44:37.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.961+0000 7f0690ff9640 1 -- 172.21.15.43:0/44722065 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f068c0044d0 con 0x7f0694108950 2024-04-25T13:44:37.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.961+0000 7f0690ff9640 1 -- 172.21.15.43:0/44722065 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c030c50 con 0x7f0694108950 2024-04-25T13:44:37.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.961+0000 7f069957d640 1 -- 172.21.15.43:0/44722065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06941a4690 con 0x7f0694108950 2024-04-25T13:44:37.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.962+0000 7f069957d640 1 -- 172.21.15.43:0/44722065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0694050740 con 0x7f0694108950 2024-04-25T13:44:37.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.964+0000 7f0690ff9640 1 -- 172.21.15.43:0/44722065 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 22) ==== 147332+0+0 (secure 0 0 0) 0x7f068c004040 con 0x7f0694108950 2024-04-25T13:44:37.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.965+0000 7f0690ff9640 1 --2- 172.21.15.43:0/44722065 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f06800af8e0 0x7f06800b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:37.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.965+0000 7f0692ffd640 1 --2- 172.21.15.43:0/44722065 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f06800af8e0 0x7f06800b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:37.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.965+0000 7f0690ff9640 1 -- 172.21.15.43:0/44722065 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9379+0+0 (secure 0 0 0) 0x7f068c100270 con 0x7f0694108950 2024-04-25T13:44:37.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.965+0000 7f0692ffd640 1 --2- 172.21.15.43:0/44722065 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f06800af8e0 0x7f06800b1df0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0694103610 tx=0x7f0684005f90 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:37.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:37.968+0000 7f0690ff9640 1 -- 172.21.15.43:0/44722065 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f068c0c8c80 con 0x7f0694108950 2024-04-25T13:44:38.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:37 smithi161 ceph-mon[32696]: [25/Apr/2024:13:44:36] ENGINE Serving on https://172.21.15.43:7150 2024-04-25T13:44:38.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:37 smithi161 ceph-mon[32696]: [25/Apr/2024:13:44:36] ENGINE Serving on http://172.21.15.43:8765 2024-04-25T13:44:38.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:37 smithi161 ceph-mon[32696]: [25/Apr/2024:13:44:36] ENGINE Bus STARTED 2024-04-25T13:44:38.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:37 smithi161 ceph-mon[32696]: mgrmap e22: x(active, since 1.02313s), standbys: z, y 2024-04-25T13:44:38.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:37 smithi161 ceph-mon[32696]: from='client.25205 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:38.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:37 smithi161 ceph-mon[32696]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:44:38.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:37 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/384631593' entity='client.admin' 2024-04-25T13:44:38.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:37 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2876397210' entity='client.admin' 2024-04-25T13:44:38.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.180+0000 7f069957d640 1 -- 172.21.15.43:0/44722065 --> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f0694062fe0 con 0x7f06800af8e0 2024-04-25T13:44:38.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.207+0000 7f0690ff9640 1 -- 172.21.15.43:0/44722065 <== mgr.15486 v2:172.21.15.43:6800/1964865924 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f0694062fe0 con 0x7f06800af8e0 2024-04-25T13:44:38.208 INFO:teuthology.orchestra.run.smithi043.stdout:Retention added to path / 2024-04-25T13:44:38.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.209+0000 7f069957d640 1 -- 172.21.15.43:0/44722065 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f06800af8e0 msgr2=0x7f06800b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:38.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.209+0000 7f069957d640 1 --2- 172.21.15.43:0/44722065 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f06800af8e0 0x7f06800b1df0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0694103610 tx=0x7f0684005f90 comp rx=0 tx=0).stop 2024-04-25T13:44:38.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.209+0000 7f069957d640 1 -- 172.21.15.43:0/44722065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0694108950 msgr2=0x7f069410bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:38.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.209+0000 7f069957d640 1 --2- 172.21.15.43:0/44722065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0694108950 0x7f069410bec0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f068c031040 tx=0x7f068c003970 comp rx=0 tx=0).stop 2024-04-25T13:44:38.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.209+0000 7f069957d640 1 -- 172.21.15.43:0/44722065 shutdown_connections 2024-04-25T13:44:38.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.209+0000 7f069957d640 1 --2- 172.21.15.43:0/44722065 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f06800af8e0 0x7f06800b1df0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.209+0000 7f069957d640 1 --2- 172.21.15.43:0/44722065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0694108950 0x7f069410bec0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.209+0000 7f069957d640 1 --2- 172.21.15.43:0/44722065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0694103c50 0x7f069410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.209+0000 7f069957d640 1 --2- 172.21.15.43:0/44722065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0694102a10 0x7f069410d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.209+0000 7f069957d640 1 -- 172.21.15.43:0/44722065 >> 172.21.15.43:0/44722065 conn(0x7f06940fdc00 msgr2=0x7f0694104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:38.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.209+0000 7f069957d640 1 -- 172.21.15.43:0/44722065 shutdown_connections 2024-04-25T13:44:38.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.209+0000 7f069957d640 1 -- 172.21.15.43:0/44722065 wait complete. 2024-04-25T13:44:38.220 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-25T13:44:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.336+0000 7f8a30bc5640 1 -- 172.21.15.43:0/725381282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a2c103400 msgr2=0x7f8a2c103810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.336+0000 7f8a30bc5640 1 --2- 172.21.15.43:0/725381282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a2c103400 0x7f8a2c103810 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009900 tx=0x7f8a1c02a410 comp rx=0 tx=0).stop 2024-04-25T13:44:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.336+0000 7f8a30bc5640 1 -- 172.21.15.43:0/725381282 shutdown_connections 2024-04-25T13:44:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.336+0000 7f8a30bc5640 1 --2- 172.21.15.43:0/725381282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a2c108100 0x7f8a2c10a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.336+0000 7f8a30bc5640 1 --2- 172.21.15.43:0/725381282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a2c103400 0x7f8a2c103810 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.336+0000 7f8a30bc5640 1 --2- 172.21.15.43:0/725381282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a2c1021c0 0x7f8a2c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.336+0000 7f8a30bc5640 1 -- 172.21.15.43:0/725381282 >> 172.21.15.43:0/725381282 conn(0x7f8a2c0fd390 msgr2=0x7f8a2c0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.336+0000 7f8a30bc5640 1 -- 172.21.15.43:0/725381282 shutdown_connections 2024-04-25T13:44:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.336+0000 7f8a30bc5640 1 -- 172.21.15.43:0/725381282 wait complete. 2024-04-25T13:44:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.337+0000 7f8a30bc5640 1 Processor -- start 2024-04-25T13:44:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.337+0000 7f8a30bc5640 1 -- start start 2024-04-25T13:44:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.337+0000 7f8a30bc5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a2c1021c0 0x7f8a2c0ff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.337+0000 7f8a30bc5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a2c103400 0x7f8a2c0fdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.337+0000 7f8a30bc5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a2c108100 0x7f8a2c0fe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.337+0000 7f8a30bc5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c10d300 con 0x7f8a2c1021c0 2024-04-25T13:44:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.337+0000 7f8a30bc5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c10d180 con 0x7f8a2c103400 2024-04-25T13:44:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.337+0000 7f8a30bc5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c10d480 con 0x7f8a2c108100 2024-04-25T13:44:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.337+0000 7f8a2a59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a2c1021c0 0x7f8a2c0ff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.337+0000 7f8a2a59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a2c1021c0 0x7f8a2c0ff4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37266/0 (socket says 172.21.15.43:37266) 2024-04-25T13:44:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.337+0000 7f8a2a59c640 1 -- 172.21.15.43:0/478666264 learned_addr learned my addr 172.21.15.43:0/478666264 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.337+0000 7f8a29d9b640 1 --2- 172.21.15.43:0/478666264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a2c103400 0x7f8a2c0fdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.337+0000 7f8a2ad9d640 1 --2- 172.21.15.43:0/478666264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a2c108100 0x7f8a2c0fe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.338+0000 7f8a2a59c640 1 -- 172.21.15.43:0/478666264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a2c108100 msgr2=0x7f8a2c0fe0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.338+0000 7f8a2a59c640 1 --2- 172.21.15.43:0/478666264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a2c108100 0x7f8a2c0fe0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.338+0000 7f8a2a59c640 1 -- 172.21.15.43:0/478666264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a2c103400 msgr2=0x7f8a2c0fdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.338+0000 7f8a2a59c640 1 --2- 172.21.15.43:0/478666264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a2c103400 0x7f8a2c0fdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.338+0000 7f8a2a59c640 1 -- 172.21.15.43:0/478666264 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2c0fe7e0 con 0x7f8a2c1021c0 2024-04-25T13:44:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.338+0000 7f8a2a59c640 1 --2- 172.21.15.43:0/478666264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a2c1021c0 0x7f8a2c0ff4d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000e9f0 tx=0x7f8a2000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.338+0000 7f8a1b7fe640 1 -- 172.21.15.43:0/478666264 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2000ccc0 con 0x7f8a2c1021c0 2024-04-25T13:44:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.338+0000 7f8a30bc5640 1 -- 172.21.15.43:0/478666264 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2c1a4260 con 0x7f8a2c1021c0 2024-04-25T13:44:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.338+0000 7f8a1b7fe640 1 -- 172.21.15.43:0/478666264 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a200035f0 con 0x7f8a2c1021c0 2024-04-25T13:44:38.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.338+0000 7f8a1b7fe640 1 -- 172.21.15.43:0/478666264 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2000ce60 con 0x7f8a2c1021c0 2024-04-25T13:44:38.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.338+0000 7f8a30bc5640 1 -- 172.21.15.43:0/478666264 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a2c1a4720 con 0x7f8a2c1021c0 2024-04-25T13:44:38.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.339+0000 7f8a30bc5640 1 -- 172.21.15.43:0/478666264 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a2c1a49e0 con 0x7f8a2c1021c0 2024-04-25T13:44:38.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.341+0000 7f8a1b7fe640 1 -- 172.21.15.43:0/478666264 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 22) ==== 147332+0+0 (secure 0 0 0) 0x7f8a20004000 con 0x7f8a2c1021c0 2024-04-25T13:44:38.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.341+0000 7f8a1b7fe640 1 --2- 172.21.15.43:0/478666264 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f8a140af8e0 0x7f8a140b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:38.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.341+0000 7f8a1b7fe640 1 -- 172.21.15.43:0/478666264 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9379+0+0 (secure 0 0 0) 0x7f8a200df0f0 con 0x7f8a2c1021c0 2024-04-25T13:44:38.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.341+0000 7f8a29d9b640 1 --2- 172.21.15.43:0/478666264 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f8a140af8e0 0x7f8a140b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:38.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.342+0000 7f8a29d9b640 1 --2- 172.21.15.43:0/478666264 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f8a140af8e0 0x7f8a140b1df0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0fee70 tx=0x7f8a1c000bc0 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:38.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.345+0000 7f8a1b7fe640 1 -- 172.21.15.43:0/478666264 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8a200a7b40 con 0x7f8a2c1021c0 2024-04-25T13:44:38.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.409+0000 7f8a1b7fe640 1 -- 172.21.15.43:0/478666264 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 23) ==== 147691+0+0 (secure 0 0 0) 0x7f8a200a36d0 con 0x7f8a2c1021c0 2024-04-25T13:44:38.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.567+0000 7f8a30bc5640 1 -- 172.21.15.43:0/478666264 --> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f8a2c107810 con 0x7f8a140af8e0 2024-04-25T13:44:38.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.587+0000 7f8a1b7fe640 1 -- 172.21.15.43:0/478666264 <== mgr.15486 v2:172.21.15.43:6800/1964865924 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f8a2c107810 con 0x7f8a140af8e0 2024-04-25T13:44:38.586 INFO:teuthology.orchestra.run.smithi043.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-25T00:00:00", "created": "2024-04-25T13:44:37", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-04-25T13:44:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.589+0000 7f8a30bc5640 1 -- 172.21.15.43:0/478666264 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f8a140af8e0 msgr2=0x7f8a140b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.589+0000 7f8a30bc5640 1 --2- 172.21.15.43:0/478666264 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f8a140af8e0 0x7f8a140b1df0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0fee70 tx=0x7f8a1c000bc0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.589+0000 7f8a30bc5640 1 -- 172.21.15.43:0/478666264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a2c1021c0 msgr2=0x7f8a2c0ff4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.589+0000 7f8a30bc5640 1 --2- 172.21.15.43:0/478666264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a2c1021c0 0x7f8a2c0ff4d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000e9f0 tx=0x7f8a2000eeb0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.589+0000 7f8a30bc5640 1 -- 172.21.15.43:0/478666264 shutdown_connections 2024-04-25T13:44:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.589+0000 7f8a30bc5640 1 --2- 172.21.15.43:0/478666264 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f8a140af8e0 0x7f8a140b1df0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.589+0000 7f8a30bc5640 1 --2- 172.21.15.43:0/478666264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a2c108100 0x7f8a2c0fe0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.589+0000 7f8a30bc5640 1 --2- 172.21.15.43:0/478666264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a2c103400 0x7f8a2c0fdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.589+0000 7f8a30bc5640 1 --2- 172.21.15.43:0/478666264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a2c1021c0 0x7f8a2c0ff4d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.589+0000 7f8a30bc5640 1 -- 172.21.15.43:0/478666264 >> 172.21.15.43:0/478666264 conn(0x7f8a2c0fd390 msgr2=0x7f8a2c1060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.589+0000 7f8a30bc5640 1 -- 172.21.15.43:0/478666264 shutdown_connections 2024-04-25T13:44:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.589+0000 7f8a30bc5640 1 -- 172.21.15.43:0/478666264 wait complete. 2024-04-25T13:44:38.599 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-25T13:44:38.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.717+0000 7f88a138f640 1 -- 172.21.15.43:0/3904997561 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f889c103c60 msgr2=0x7f889c104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.717+0000 7f88a138f640 1 --2- 172.21.15.43:0/3904997561 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f889c103c60 0x7f889c104070 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8890009900 tx=0x7f889002a410 comp rx=0 tx=0).stop 2024-04-25T13:44:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.717+0000 7f88a138f640 1 -- 172.21.15.43:0/3904997561 shutdown_connections 2024-04-25T13:44:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.717+0000 7f88a138f640 1 --2- 172.21.15.43:0/3904997561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f889c108960 0x7f889c10ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.717+0000 7f88a138f640 1 --2- 172.21.15.43:0/3904997561 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f889c103c60 0x7f889c104070 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.717+0000 7f88a138f640 1 --2- 172.21.15.43:0/3904997561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889c102a20 0x7f889c103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.717+0000 7f88a138f640 1 -- 172.21.15.43:0/3904997561 >> 172.21.15.43:0/3904997561 conn(0x7f889c0fdc10 msgr2=0x7f889c1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.717+0000 7f88a138f640 1 -- 172.21.15.43:0/3904997561 shutdown_connections 2024-04-25T13:44:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.717+0000 7f88a138f640 1 -- 172.21.15.43:0/3904997561 wait complete. 2024-04-25T13:44:38.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.718+0000 7f88a138f640 1 Processor -- start 2024-04-25T13:44:38.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f88a138f640 1 -- start start 2024-04-25T13:44:38.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f88a138f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f889c102a20 0x7f889c199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:38.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f88a138f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f889c103c60 0x7f889c1995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:38.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f88a138f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889c108960 0x7f889c1a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:38.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f88a138f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f889c10e3f0 con 0x7f889c102a20 2024-04-25T13:44:38.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f88a138f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f889c10e270 con 0x7f889c103c60 2024-04-25T13:44:38.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f88a138f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f889c10e570 con 0x7f889c108960 2024-04-25T13:44:38.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f889affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f889c102a20 0x7f889c199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:38.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f889affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f889c102a20 0x7f889c199080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37288/0 (socket says 172.21.15.43:37288) 2024-04-25T13:44:38.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f889affd640 1 -- 172.21.15.43:0/4211186801 learned_addr learned my addr 172.21.15.43:0/4211186801 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:44:38.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f889b7fe640 1 --2- 172.21.15.43:0/4211186801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889c108960 0x7f889c1a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:38.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f889a7fc640 1 --2- 172.21.15.43:0/4211186801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f889c103c60 0x7f889c1995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:38.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f889affd640 1 -- 172.21.15.43:0/4211186801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889c108960 msgr2=0x7f889c1a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:38.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f889affd640 1 --2- 172.21.15.43:0/4211186801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889c108960 0x7f889c1a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f889affd640 1 -- 172.21.15.43:0/4211186801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f889c103c60 msgr2=0x7f889c1995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:38.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f889affd640 1 --2- 172.21.15.43:0/4211186801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f889c103c60 0x7f889c1995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.719+0000 7f889affd640 1 -- 172.21.15.43:0/4211186801 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c1a0bc0 con 0x7f889c102a20 2024-04-25T13:44:38.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.720+0000 7f889affd640 1 --2- 172.21.15.43:0/4211186801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f889c102a20 0x7f889c199080 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f889400e9f0 tx=0x7f889400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:38.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.720+0000 7f8883fff640 1 -- 172.21.15.43:0/4211186801 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889400ccc0 con 0x7f889c102a20 2024-04-25T13:44:38.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.720+0000 7f88a138f640 1 -- 172.21.15.43:0/4211186801 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889c1a0eb0 con 0x7f889c102a20 2024-04-25T13:44:38.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.720+0000 7f8883fff640 1 -- 172.21.15.43:0/4211186801 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88940035f0 con 0x7f889c102a20 2024-04-25T13:44:38.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.720+0000 7f8883fff640 1 -- 172.21.15.43:0/4211186801 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889400ce60 con 0x7f889c102a20 2024-04-25T13:44:38.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.720+0000 7f88a138f640 1 -- 172.21.15.43:0/4211186801 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f889c1a1310 con 0x7f889c102a20 2024-04-25T13:44:38.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.721+0000 7f88a138f640 1 -- 172.21.15.43:0/4211186801 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889c107770 con 0x7f889c102a20 2024-04-25T13:44:38.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.722+0000 7f8883fff640 1 -- 172.21.15.43:0/4211186801 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 23) ==== 147691+0+0 (secure 0 0 0) 0x7f8894004000 con 0x7f889c102a20 2024-04-25T13:44:38.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.723+0000 7f8883fff640 1 --2- 172.21.15.43:0/4211186801 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f88840afce0 0x7f88840b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:38.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.723+0000 7f8883fff640 1 -- 172.21.15.43:0/4211186801 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9379+0+0 (secure 0 0 0) 0x7f88940df860 con 0x7f889c102a20 2024-04-25T13:44:38.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.723+0000 7f889a7fc640 1 --2- 172.21.15.43:0/4211186801 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f88840afce0 0x7f88840b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:38.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.724+0000 7f889a7fc640 1 --2- 172.21.15.43:0/4211186801 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f88840afce0 0x7f88840b21f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f889c19a120 tx=0x7f8890000bc0 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:38.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.728+0000 7f8883fff640 1 -- 172.21.15.43:0/4211186801 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f88940a7c30 con 0x7f889c102a20 2024-04-25T13:44:38.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:38 smithi043 ceph-mon[29195]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:44:38.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:38 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:38.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:38 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:38.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:38 smithi043 ceph-mon[29195]: from='client.25265 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:38.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:38 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:38.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:38 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:38.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:38 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:38.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:38 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:38.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:38 smithi043 ceph-mon[29195]: from='client.15582 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:38.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:38 smithi043 ceph-mon[29195]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-04-25T13:44:38.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.973+0000 7f88a138f640 1 -- 172.21.15.43:0/4211186801 --> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f889c062fe0 con 0x7f88840afce0 2024-04-25T13:44:38.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.981+0000 7f8883fff640 1 -- 172.21.15.43:0/4211186801 <== mgr.15486 v2:172.21.15.43:6800/1964865924 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f889c062fe0 con 0x7f88840afce0 2024-04-25T13:44:38.980 INFO:teuthology.orchestra.run.smithi043.stdout:/ 1m 6m3h 2024-04-25T13:44:38.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.983+0000 7f88a138f640 1 -- 172.21.15.43:0/4211186801 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f88840afce0 msgr2=0x7f88840b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.983+0000 7f88a138f640 1 --2- 172.21.15.43:0/4211186801 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f88840afce0 0x7f88840b21f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f889c19a120 tx=0x7f8890000bc0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.984+0000 7f88a138f640 1 -- 172.21.15.43:0/4211186801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f889c102a20 msgr2=0x7f889c199080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.984+0000 7f88a138f640 1 --2- 172.21.15.43:0/4211186801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f889c102a20 0x7f889c199080 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f889400e9f0 tx=0x7f889400eeb0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.984+0000 7f88a138f640 1 -- 172.21.15.43:0/4211186801 shutdown_connections 2024-04-25T13:44:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.984+0000 7f88a138f640 1 --2- 172.21.15.43:0/4211186801 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f88840afce0 0x7f88840b21f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.984+0000 7f88a138f640 1 --2- 172.21.15.43:0/4211186801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f889c108960 0x7f889c1a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.984+0000 7f88a138f640 1 --2- 172.21.15.43:0/4211186801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f889c103c60 0x7f889c1995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.984+0000 7f88a138f640 1 --2- 172.21.15.43:0/4211186801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f889c102a20 0x7f889c199080 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.984+0000 7f88a138f640 1 -- 172.21.15.43:0/4211186801 >> 172.21.15.43:0/4211186801 conn(0x7f889c0fdc10 msgr2=0x7f889c104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.984+0000 7f88a138f640 1 -- 172.21.15.43:0/4211186801 shutdown_connections 2024-04-25T13:44:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:44:38.984+0000 7f88a138f640 1 -- 172.21.15.43:0/4211186801 wait complete. 2024-04-25T13:44:38.998 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-04-25T13:44:39.024 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-04-25T13:44:39.035 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T13:44:39.051 INFO:tasks.workunit:Pulling workunits from ref 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:44:39.051 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T13:44:39.051 INFO:tasks.workunit:timeout=6h 2024-04-25T13:44:39.051 INFO:tasks.workunit:cleanup=True 2024-04-25T13:44:39.052 DEBUG:teuthology.orchestra.run.smithi043:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T13:44:39.082 INFO:teuthology.orchestra.run.smithi043.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T13:44:39.082 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-25T13:44:39.082 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 73h/115d Inode: 1 Links: 2 2024-04-25T13:44:39.082 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:44:39.082 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-25T13:44:39.082 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-25 13:42:36.883291881 +0000 2024-04-25T13:44:39.082 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-25 13:42:36.883291881 +0000 2024-04-25T13:44:39.082 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-25 13:44:34.195928151 +0000 2024-04-25T13:44:39.083 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2024-04-25T13:44:39.083 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T13:44:39.083 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T13:44:39.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:38 smithi161 ceph-mon[32696]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:44:39.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:38 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:39.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:38 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:39.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:38 smithi161 ceph-mon[32696]: from='client.25265 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:39.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:38 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:39.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:38 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:39.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:38 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:39.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:38 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:39.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:38 smithi161 ceph-mon[32696]: from='client.15582 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:39.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:38 smithi161 ceph-mon[32696]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-04-25T13:44:39.154 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:44:39.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:38 smithi175 ceph-mon[32649]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:44:39.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:38 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:39.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:38 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:39.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:38 smithi175 ceph-mon[32649]: from='client.25265 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:39.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:38 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:39.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:38 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:39.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:38 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:39.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:38 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:39.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:38 smithi175 ceph-mon[32649]: from='client.15582 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:39.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:38 smithi175 ceph-mon[32649]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-04-25T13:44:39.210 INFO:tasks.workunit.client.0.smithi043.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T13:44:40.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='client.15588 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:40.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi161 to 176.2M 2024-04-25T13:44:40.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: Unable to set osd_memory_target on smithi161 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-04-25T13:44:40.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi175 to 176.2M 2024-04-25T13:44:40.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: Unable to set osd_memory_target on smithi175 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-25T13:44:40.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='client.15594 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:40.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi043 to 177.2M 2024-04-25T13:44:40.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: Unable to set osd_memory_target on smithi043 to 185894912: error parsing value: Value '185894912' is below minimum 939524096 2024-04-25T13:44:40.185 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:44:40.185 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:44:40.185 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: Updating smithi043:/etc/ceph/ceph.conf 2024-04-25T13:44:40.185 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: Updating smithi161:/etc/ceph/ceph.conf 2024-04-25T13:44:40.185 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:39 smithi175 ceph-mon[32649]: Updating smithi175:/etc/ceph/ceph.conf 2024-04-25T13:44:40.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='client.15588 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:40.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi161 to 176.2M 2024-04-25T13:44:40.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: Unable to set osd_memory_target on smithi161 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-04-25T13:44:40.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi175 to 176.2M 2024-04-25T13:44:40.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: Unable to set osd_memory_target on smithi175 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-25T13:44:40.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='client.15594 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:40.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi043 to 177.2M 2024-04-25T13:44:40.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: Unable to set osd_memory_target on smithi043 to 185894912: error parsing value: Value '185894912' is below minimum 939524096 2024-04-25T13:44:40.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:44:40.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:44:40.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: Updating smithi043:/etc/ceph/ceph.conf 2024-04-25T13:44:40.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: Updating smithi161:/etc/ceph/ceph.conf 2024-04-25T13:44:40.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:39 smithi043 ceph-mon[29195]: Updating smithi175:/etc/ceph/ceph.conf 2024-04-25T13:44:40.238 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='client.15588 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:40.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi161 to 176.2M 2024-04-25T13:44:40.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: Unable to set osd_memory_target on smithi161 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-04-25T13:44:40.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi175 to 176.2M 2024-04-25T13:44:40.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: Unable to set osd_memory_target on smithi175 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-25T13:44:40.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='client.15594 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:44:40.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:40.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:44:40.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi043 to 177.2M 2024-04-25T13:44:40.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: Unable to set osd_memory_target on smithi043 to 185894912: error parsing value: Value '185894912' is below minimum 939524096 2024-04-25T13:44:40.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:44:40.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:44:40.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: Updating smithi043:/etc/ceph/ceph.conf 2024-04-25T13:44:40.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: Updating smithi161:/etc/ceph/ceph.conf 2024-04-25T13:44:40.241 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:39 smithi161 ceph-mon[32696]: Updating smithi175:/etc/ceph/ceph.conf 2024-04-25T13:44:41.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: Updating smithi043:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:44:41.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: Updating smithi161:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:44:41.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: Updating smithi175:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:44:41.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:44:41.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:44:41.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:44:41.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:44:41.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: Updating smithi161:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T13:44:41.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: Updating smithi043:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T13:44:41.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: Updating smithi175:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T13:44:41.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-04-25T13:44:41.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:44:41.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:44:41.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:44:41.464 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:41 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: Updating smithi043:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:44:41.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: Updating smithi161:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:44:41.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: Updating smithi175:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:44:41.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:44:41.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:44:41.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:44:41.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:44:41.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: Updating smithi161:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T13:44:41.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: Updating smithi043:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T13:44:41.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: Updating smithi175:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T13:44:41.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-04-25T13:44:41.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:44:41.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:44:41.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:44:41.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:41 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: Updating smithi043:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:44:41.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: Updating smithi161:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:44:41.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: Updating smithi175:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T13:44:41.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:44:41.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:44:41.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:44:41.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-04-25T13:44:41.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: Updating smithi161:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T13:44:41.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: Updating smithi043:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T13:44:41.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: Updating smithi175:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T13:44:41.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-04-25T13:44:41.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:41.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:44:41.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:44:41.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:44:41.682 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:41 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:44:43.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:43 smithi043 ceph-mon[29195]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 90 KiB/s wr, 21 op/s 2024-04-25T13:44:43.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:43 smithi161 ceph-mon[32696]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 90 KiB/s wr, 21 op/s 2024-04-25T13:44:43.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:43 smithi175 ceph-mon[32649]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 90 KiB/s wr, 21 op/s 2024-04-25T13:44:45.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:45 smithi043 ceph-mon[29195]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 133 KiB/s wr, 36 op/s 2024-04-25T13:44:45.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:45 smithi161 ceph-mon[32696]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 133 KiB/s wr, 36 op/s 2024-04-25T13:44:45.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:45 smithi175 ceph-mon[32649]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 133 KiB/s wr, 36 op/s 2024-04-25T13:44:47.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:47 smithi043 ceph-mon[29195]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 103 KiB/s wr, 28 op/s 2024-04-25T13:44:47.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:47 smithi161 ceph-mon[32696]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 103 KiB/s wr, 28 op/s 2024-04-25T13:44:47.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:47 smithi175 ceph-mon[32649]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 103 KiB/s wr, 28 op/s 2024-04-25T13:44:49.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:49 smithi043 ceph-mon[29195]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 84 KiB/s wr, 26 op/s 2024-04-25T13:44:49.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:49 smithi161 ceph-mon[32696]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 84 KiB/s wr, 26 op/s 2024-04-25T13:44:49.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:49 smithi175 ceph-mon[32649]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 84 KiB/s wr, 26 op/s 2024-04-25T13:44:51.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:51 smithi043 ceph-mon[29195]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 23 op/s 2024-04-25T13:44:51.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:51 smithi161 ceph-mon[32696]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 23 op/s 2024-04-25T13:44:51.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:51 smithi175 ceph-mon[32649]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 23 op/s 2024-04-25T13:44:53.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:53 smithi043 ceph-mon[29195]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 77 KiB/s wr, 24 op/s 2024-04-25T13:44:53.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:53 smithi161 ceph-mon[32696]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 77 KiB/s wr, 24 op/s 2024-04-25T13:44:53.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:53 smithi175 ceph-mon[32649]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 77 KiB/s wr, 24 op/s 2024-04-25T13:44:55.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:55 smithi043 ceph-mon[29195]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-25T13:44:55.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:55 smithi161 ceph-mon[32696]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-25T13:44:55.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:55 smithi175 ceph-mon[32649]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-04-25T13:44:57.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:57 smithi161 ceph-mon[32696]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-25T13:44:57.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:57 smithi175 ceph-mon[32649]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-25T13:44:57.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:57 smithi043 ceph-mon[29195]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-25T13:44:59.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:44:59 smithi161 ceph-mon[32696]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-04-25T13:44:59.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:44:59 smithi175 ceph-mon[32649]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-04-25T13:44:59.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:44:59 smithi043 ceph-mon[29195]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-04-25T13:45:00.712 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:45:00 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:45:00.220+0000 7f27207b9700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:45:00.712 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:45:00 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:45:00.220+0000 7f27207b9700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:45:00.712 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:45:00 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:45:00.220+0000 7f27207b9700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:45:00.713 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:45:00 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:45:00.220+0000 7f27207b9700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:45:00.713 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:45:00 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:45:00.220+0000 7f27207b9700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T13:45:01.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:01 smithi043 ceph-mon[29195]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-25T13:45:01.604 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:01 smithi161 ceph-mon[32696]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-25T13:45:01.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:01 smithi175 ceph-mon[32649]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-25T13:45:03.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:03 smithi161 ceph-mon[32696]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-04-25T13:45:03.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:03 smithi161 ceph-mon[32696]: mgrmap e25: x(active, since 26s), standbys: z, y 2024-04-25T13:45:03.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:03 smithi175 ceph-mon[32649]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-04-25T13:45:03.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:03 smithi175 ceph-mon[32649]: mgrmap e25: x(active, since 26s), standbys: z, y 2024-04-25T13:45:03.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:03 smithi043 ceph-mon[29195]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-04-25T13:45:03.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:03 smithi043 ceph-mon[29195]: mgrmap e25: x(active, since 26s), standbys: z, y 2024-04-25T13:45:05.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:05 smithi161 ceph-mon[32696]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-04-25T13:45:05.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:05 smithi175 ceph-mon[32649]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-04-25T13:45:05.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:05 smithi043 ceph-mon[29195]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-04-25T13:45:07.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:07 smithi161 ceph-mon[32696]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T13:45:07.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:07 smithi175 ceph-mon[32649]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T13:45:07.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:07 smithi043 ceph-mon[29195]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T13:45:09.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:09 smithi161 ceph-mon[32696]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:45:09.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:09 smithi175 ceph-mon[32649]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:45:09.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:09 smithi043 ceph-mon[29195]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:45:11.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:11 smithi161 ceph-mon[32696]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T13:45:11.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:11 smithi175 ceph-mon[32649]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T13:45:11.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:11 smithi043 ceph-mon[29195]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T13:45:12.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:12 smithi161 ceph-mon[32696]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:45:12.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:12 smithi175 ceph-mon[32649]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:45:12.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:12 smithi043 ceph-mon[29195]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:45:15.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:14 smithi161 ceph-mon[32696]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-25T13:45:15.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:14 smithi175 ceph-mon[32649]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-25T13:45:15.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:14 smithi043 ceph-mon[29195]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-25T13:45:17.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:16 smithi161 ceph-mon[32696]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T13:45:17.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:16 smithi175 ceph-mon[32649]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T13:45:17.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:16 smithi043 ceph-mon[29195]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T13:45:19.015 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:18 smithi043 ceph-mon[29195]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T13:45:19.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:18 smithi161 ceph-mon[32696]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T13:45:19.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:18 smithi175 ceph-mon[32649]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T13:45:21.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:20 smithi161 ceph-mon[32696]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T13:45:21.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:20 smithi175 ceph-mon[32649]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T13:45:21.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:20 smithi043 ceph-mon[29195]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T13:45:23.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:22 smithi161 ceph-mon[32696]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-25T13:45:23.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:22 smithi175 ceph-mon[32649]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-25T13:45:23.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:22 smithi043 ceph-mon[29195]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 6 op/s 2024-04-25T13:45:25.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:24 smithi161 ceph-mon[32696]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:45:25.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:24 smithi175 ceph-mon[32649]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:45:25.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:24 smithi043 ceph-mon[29195]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:45:27.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:26 smithi161 ceph-mon[32696]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:27.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:26 smithi175 ceph-mon[32649]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:27.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:26 smithi043 ceph-mon[29195]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:29.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:28 smithi161 ceph-mon[32696]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:29.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:28 smithi175 ceph-mon[32649]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:29.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:28 smithi043 ceph-mon[29195]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:31.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:30 smithi161 ceph-mon[32696]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:31.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:30 smithi175 ceph-mon[32649]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:31.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:30 smithi043 ceph-mon[29195]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:33.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:32 smithi161 ceph-mon[32696]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:33.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:32 smithi175 ceph-mon[32649]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:33.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:32 smithi043 ceph-mon[29195]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:35.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:34 smithi161 ceph-mon[32696]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:45:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:34 smithi175 ceph-mon[32649]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:45:35.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:34 smithi043 ceph-mon[29195]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:45:37.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:36 smithi161 ceph-mon[32696]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:37.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:36 smithi175 ceph-mon[32649]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:37.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:36 smithi043 ceph-mon[29195]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:39.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:38 smithi161 ceph-mon[32696]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:39.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:38 smithi175 ceph-mon[32649]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:39.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:38 smithi043 ceph-mon[29195]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:41.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:40 smithi161 ceph-mon[32696]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:41.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:40 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:45:41.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:40 smithi175 ceph-mon[32649]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:41.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:40 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:45:41.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:40 smithi043 ceph-mon[29195]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:41.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:40 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:45:42.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:42 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:42 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:42 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:42 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:42 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:42 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:42 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:42 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:42 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:42 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:42 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:42 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:42 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:42 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:42 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:42 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:42 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:42.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:42 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:43.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:43 smithi161 ceph-mon[32696]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:43.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:43 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:45:43.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:43 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:45:43.603 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:43 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:43.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:43 smithi175 ceph-mon[32649]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:43.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:43 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:45:43.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:43 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:45:43.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:43 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:43.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:43 smithi043 ceph-mon[29195]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:43.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:43 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:45:43.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:43 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:45:43.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:43 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:45:45.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:45 smithi161 ceph-mon[32696]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:45.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:45 smithi175 ceph-mon[32649]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:45.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:45 smithi043 ceph-mon[29195]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:47.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:47 smithi161 ceph-mon[32696]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:47.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:47 smithi175 ceph-mon[32649]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:47.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:47 smithi043 ceph-mon[29195]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:49.514 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:49 smithi043 ceph-mon[29195]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:49.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:49 smithi161 ceph-mon[32696]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:49.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:49 smithi175 ceph-mon[32649]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:51.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:51 smithi161 ceph-mon[32696]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:51.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:51 smithi175 ceph-mon[32649]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:51.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:51 smithi043 ceph-mon[29195]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:53.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:53 smithi161 ceph-mon[32696]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:53.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:53 smithi175 ceph-mon[32649]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:53.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:53 smithi043 ceph-mon[29195]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:55.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:55 smithi161 ceph-mon[32696]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:55.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:55 smithi175 ceph-mon[32649]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:55.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:55 smithi043 ceph-mon[29195]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:57.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:57 smithi161 ceph-mon[32696]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:57.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:57 smithi175 ceph-mon[32649]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:57.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:57 smithi043 ceph-mon[29195]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:45:59.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:45:59 smithi161 ceph-mon[32696]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:59.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:45:59 smithi175 ceph-mon[32649]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:45:59.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:45:59 smithi043 ceph-mon[29195]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:46:01.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:01 smithi161 ceph-mon[32696]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:46:01.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:01 smithi175 ceph-mon[32649]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:46:01.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:01 smithi043 ceph-mon[29195]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:46:03.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:02 smithi161 ceph-mon[32696]: pgmap v46: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:46:03.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:02 smithi175 ceph-mon[32649]: pgmap v46: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:46:03.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:02 smithi043 ceph-mon[29195]: pgmap v46: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:46:04.438 INFO:tasks.workunit.client.0.smithi043.stderr:Updating files: 93% (11451/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-25T13:46:05.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:04 smithi161 ceph-mon[32696]: pgmap v47: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T13:46:05.122 INFO:tasks.workunit.client.0.smithi043.stderr:Note: switching to '994e2f20102a20fa9a27966c14b625cc01884df8'. 2024-04-25T13:46:05.122 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T13:46:05.122 INFO:tasks.workunit.client.0.smithi043.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T13:46:05.122 INFO:tasks.workunit.client.0.smithi043.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T13:46:05.123 INFO:tasks.workunit.client.0.smithi043.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T13:46:05.123 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T13:46:05.123 INFO:tasks.workunit.client.0.smithi043.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T13:46:05.123 INFO:tasks.workunit.client.0.smithi043.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T13:46:05.123 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T13:46:05.123 INFO:tasks.workunit.client.0.smithi043.stderr: git switch -c 2024-04-25T13:46:05.123 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T13:46:05.123 INFO:tasks.workunit.client.0.smithi043.stderr:Or undo this operation with: 2024-04-25T13:46:05.123 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T13:46:05.123 INFO:tasks.workunit.client.0.smithi043.stderr: git switch - 2024-04-25T13:46:05.123 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T13:46:05.123 INFO:tasks.workunit.client.0.smithi043.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T13:46:05.123 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T13:46:05.123 INFO:tasks.workunit.client.0.smithi043.stderr:HEAD is now at 994e2f20102 Merge PR #56810 into wip-pdonnell-testing-20240425.015853-debug 2024-04-25T13:46:05.129 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T13:46:05.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:04 smithi175 ceph-mon[32649]: pgmap v47: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T13:46:05.191 INFO:tasks.workunit.client.0.smithi043.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T13:46:05.193 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T13:46:05.193 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T13:46:05.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:04 smithi043 ceph-mon[29195]: pgmap v47: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T13:46:05.807 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T13:46:05.862 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T13:46:05.904 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T13:46:05.905 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T13:46:05.905 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T13:46:05.945 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T13:46:05.949 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:46:05.949 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T13:46:06.006 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-25T13:46:06.008 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-25T13:46:06.008 DEBUG:teuthology.orchestra.run.smithi043:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=994e2f20102a20fa9a27966c14b625cc01884df8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-25T13:46:06.071 INFO:tasks.workunit.client.0.smithi043.stderr:+ mkdir -p fsstress 2024-04-25T13:46:06.073 INFO:tasks.workunit.client.0.smithi043.stderr:+ pushd fsstress 2024-04-25T13:46:06.074 INFO:tasks.workunit.client.0.smithi043.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T13:46:06.075 INFO:tasks.workunit.client.0.smithi043.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-25T13:46:06.609 INFO:tasks.workunit.client.0.smithi043.stderr:+ tar xzf ltp-full.tgz 2024-04-25T13:46:07.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:06 smithi161 ceph-mon[32696]: pgmap v48: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T13:46:07.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:06 smithi175 ceph-mon[32649]: pgmap v48: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T13:46:07.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:06 smithi043 ceph-mon[29195]: pgmap v48: 129 pgs: 129 active+clean; 1.3 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T13:46:09.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:08 smithi161 ceph-mon[32696]: pgmap v49: 129 pgs: 129 active+clean; 12 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 904 KiB/s wr, 15 op/s 2024-04-25T13:46:09.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:08 smithi161 ceph-mon[32696]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-04-25T13:46:09.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:08 smithi175 ceph-mon[32649]: pgmap v49: 129 pgs: 129 active+clean; 12 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 904 KiB/s wr, 15 op/s 2024-04-25T13:46:09.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:08 smithi175 ceph-mon[32649]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-04-25T13:46:09.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:08 smithi043 ceph-mon[29195]: pgmap v49: 129 pgs: 129 active+clean; 12 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 904 KiB/s wr, 15 op/s 2024-04-25T13:46:09.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:08 smithi043 ceph-mon[29195]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-04-25T13:46:11.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:10 smithi161 ceph-mon[32696]: pgmap v50: 129 pgs: 129 active+clean; 12 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 904 KiB/s wr, 12 op/s 2024-04-25T13:46:11.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:10 smithi175 ceph-mon[32649]: pgmap v50: 129 pgs: 129 active+clean; 12 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 904 KiB/s wr, 12 op/s 2024-04-25T13:46:11.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:10 smithi043 ceph-mon[29195]: pgmap v50: 129 pgs: 129 active+clean; 12 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 904 KiB/s wr, 12 op/s 2024-04-25T13:46:13.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:12 smithi161 ceph-mon[32696]: pgmap v51: 129 pgs: 129 active+clean; 19 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 1.6 MiB/s wr, 129 op/s 2024-04-25T13:46:13.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:12 smithi175 ceph-mon[32649]: pgmap v51: 129 pgs: 129 active+clean; 19 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 1.6 MiB/s wr, 129 op/s 2024-04-25T13:46:13.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:12 smithi043 ceph-mon[29195]: pgmap v51: 129 pgs: 129 active+clean; 19 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 1.6 MiB/s wr, 129 op/s 2024-04-25T13:46:14.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:13 smithi161 ceph-mon[32696]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:46:14.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:13 smithi175 ceph-mon[32649]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:46:14.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:13 smithi043 ceph-mon[29195]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:46:15.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:14 smithi161 ceph-mon[32696]: pgmap v52: 129 pgs: 129 active+clean; 19 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 1.6 MiB/s wr, 121 op/s 2024-04-25T13:46:15.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:14 smithi175 ceph-mon[32649]: pgmap v52: 129 pgs: 129 active+clean; 19 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 1.6 MiB/s wr, 121 op/s 2024-04-25T13:46:15.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:14 smithi043 ceph-mon[29195]: pgmap v52: 129 pgs: 129 active+clean; 19 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 1.6 MiB/s wr, 121 op/s 2024-04-25T13:46:17.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:16 smithi161 ceph-mon[32696]: pgmap v53: 129 pgs: 129 active+clean; 19 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 1.6 MiB/s wr, 121 op/s 2024-04-25T13:46:17.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:16 smithi175 ceph-mon[32649]: pgmap v53: 129 pgs: 129 active+clean; 19 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 1.6 MiB/s wr, 121 op/s 2024-04-25T13:46:17.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:16 smithi043 ceph-mon[29195]: pgmap v53: 129 pgs: 129 active+clean; 19 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 1.6 MiB/s wr, 121 op/s 2024-04-25T13:46:19.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:18 smithi161 ceph-mon[32696]: pgmap v54: 129 pgs: 129 active+clean; 30 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 2.6 MiB/s wr, 245 op/s 2024-04-25T13:46:19.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:18 smithi175 ceph-mon[32649]: pgmap v54: 129 pgs: 129 active+clean; 30 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 2.6 MiB/s wr, 245 op/s 2024-04-25T13:46:19.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:18 smithi043 ceph-mon[29195]: pgmap v54: 129 pgs: 129 active+clean; 30 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 2.6 MiB/s wr, 245 op/s 2024-04-25T13:46:21.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:20 smithi161 ceph-mon[32696]: pgmap v55: 129 pgs: 129 active+clean; 30 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 1.7 MiB/s wr, 240 op/s 2024-04-25T13:46:21.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:20 smithi175 ceph-mon[32649]: pgmap v55: 129 pgs: 129 active+clean; 30 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 1.7 MiB/s wr, 240 op/s 2024-04-25T13:46:21.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:20 smithi043 ceph-mon[29195]: pgmap v55: 129 pgs: 129 active+clean; 30 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 1.7 MiB/s wr, 240 op/s 2024-04-25T13:46:23.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:22 smithi161 ceph-mon[32696]: pgmap v56: 129 pgs: 129 active+clean; 43 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 332 op/s 2024-04-25T13:46:23.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:22 smithi175 ceph-mon[32649]: pgmap v56: 129 pgs: 129 active+clean; 43 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 332 op/s 2024-04-25T13:46:23.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:22 smithi043 ceph-mon[29195]: pgmap v56: 129 pgs: 129 active+clean; 43 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 332 op/s 2024-04-25T13:46:25.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:24 smithi161 ceph-mon[32696]: pgmap v57: 129 pgs: 129 active+clean; 43 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 2.2 MiB/s wr, 216 op/s 2024-04-25T13:46:25.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:24 smithi175 ceph-mon[32649]: pgmap v57: 129 pgs: 129 active+clean; 43 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 2.2 MiB/s wr, 216 op/s 2024-04-25T13:46:25.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:24 smithi043 ceph-mon[29195]: pgmap v57: 129 pgs: 129 active+clean; 43 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 2.2 MiB/s wr, 216 op/s 2024-04-25T13:46:27.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:26 smithi161 ceph-mon[32696]: pgmap v58: 129 pgs: 129 active+clean; 43 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 2.2 MiB/s wr, 216 op/s 2024-04-25T13:46:27.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:26 smithi175 ceph-mon[32649]: pgmap v58: 129 pgs: 129 active+clean; 43 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 2.2 MiB/s wr, 216 op/s 2024-04-25T13:46:27.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:26 smithi043 ceph-mon[29195]: pgmap v58: 129 pgs: 129 active+clean; 43 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 2.2 MiB/s wr, 216 op/s 2024-04-25T13:46:29.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:28 smithi161 ceph-mon[32696]: pgmap v59: 129 pgs: 129 active+clean; 54 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 344 op/s 2024-04-25T13:46:29.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:28 smithi175 ceph-mon[32649]: pgmap v59: 129 pgs: 129 active+clean; 54 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 344 op/s 2024-04-25T13:46:29.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:28 smithi043 ceph-mon[29195]: pgmap v59: 129 pgs: 129 active+clean; 54 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 344 op/s 2024-04-25T13:46:31.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:30 smithi161 ceph-mon[32696]: pgmap v60: 129 pgs: 129 active+clean; 54 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 2.1 MiB/s wr, 220 op/s 2024-04-25T13:46:31.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:30 smithi175 ceph-mon[32649]: pgmap v60: 129 pgs: 129 active+clean; 54 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 2.1 MiB/s wr, 220 op/s 2024-04-25T13:46:31.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:30 smithi043 ceph-mon[29195]: pgmap v60: 129 pgs: 129 active+clean; 54 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 2.1 MiB/s wr, 220 op/s 2024-04-25T13:46:33.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:32 smithi161 ceph-mon[32696]: pgmap v61: 129 pgs: 129 active+clean; 61 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 327 op/s 2024-04-25T13:46:33.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:32 smithi175 ceph-mon[32649]: pgmap v61: 129 pgs: 129 active+clean; 61 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 327 op/s 2024-04-25T13:46:33.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:32 smithi043 ceph-mon[29195]: pgmap v61: 129 pgs: 129 active+clean; 61 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 327 op/s 2024-04-25T13:46:35.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:34 smithi161 ceph-mon[32696]: pgmap v62: 129 pgs: 129 active+clean; 61 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 1.7 MiB/s wr, 235 op/s 2024-04-25T13:46:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:34 smithi175 ceph-mon[32649]: pgmap v62: 129 pgs: 129 active+clean; 61 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 1.7 MiB/s wr, 235 op/s 2024-04-25T13:46:35.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:34 smithi043 ceph-mon[29195]: pgmap v62: 129 pgs: 129 active+clean; 61 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 1.7 MiB/s wr, 235 op/s 2024-04-25T13:46:37.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:36 smithi161 ceph-mon[32696]: pgmap v63: 129 pgs: 129 active+clean; 61 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 1.7 MiB/s wr, 235 op/s 2024-04-25T13:46:37.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:36 smithi175 ceph-mon[32649]: pgmap v63: 129 pgs: 129 active+clean; 61 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 1.7 MiB/s wr, 235 op/s 2024-04-25T13:46:37.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:36 smithi043 ceph-mon[29195]: pgmap v63: 129 pgs: 129 active+clean; 61 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 1.7 MiB/s wr, 235 op/s 2024-04-25T13:46:39.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:38 smithi161 ceph-mon[32696]: pgmap v64: 129 pgs: 129 active+clean; 73 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 343 op/s 2024-04-25T13:46:39.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:38 smithi175 ceph-mon[32649]: pgmap v64: 129 pgs: 129 active+clean; 73 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 343 op/s 2024-04-25T13:46:39.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:38 smithi043 ceph-mon[29195]: pgmap v64: 129 pgs: 129 active+clean; 73 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 343 op/s 2024-04-25T13:46:41.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:40 smithi161 ceph-mon[32696]: pgmap v65: 129 pgs: 129 active+clean; 73 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 1.7 MiB/s wr, 216 op/s 2024-04-25T13:46:41.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:40 smithi175 ceph-mon[32649]: pgmap v65: 129 pgs: 129 active+clean; 73 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 1.7 MiB/s wr, 216 op/s 2024-04-25T13:46:41.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:40 smithi043 ceph-mon[29195]: pgmap v65: 129 pgs: 129 active+clean; 73 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 1.7 MiB/s wr, 216 op/s 2024-04-25T13:46:43.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:42 smithi161 ceph-mon[32696]: pgmap v66: 129 pgs: 129 active+clean; 85 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 328 op/s 2024-04-25T13:46:43.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:42 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:46:43.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:42 smithi175 ceph-mon[32649]: pgmap v66: 129 pgs: 129 active+clean; 85 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 328 op/s 2024-04-25T13:46:43.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:42 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:46:43.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:42 smithi043 ceph-mon[29195]: pgmap v66: 129 pgs: 129 active+clean; 85 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 328 op/s 2024-04-25T13:46:43.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:42 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:46:44.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:43 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:46:44.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:43 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:46:44.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:43 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:46:44.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:43 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:46:44.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:43 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:46:44.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:43 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:46:44.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:43 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:46:44.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:43 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:46:44.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:43 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:46:45.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:45 smithi161 ceph-mon[32696]: pgmap v67: 129 pgs: 129 active+clean; 85 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.1 MiB/s wr, 221 op/s 2024-04-25T13:46:45.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:45 smithi175 ceph-mon[32649]: pgmap v67: 129 pgs: 129 active+clean; 85 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.1 MiB/s wr, 221 op/s 2024-04-25T13:46:45.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:45 smithi043 ceph-mon[29195]: pgmap v67: 129 pgs: 129 active+clean; 85 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.1 MiB/s wr, 221 op/s 2024-04-25T13:46:47.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:47 smithi161 ceph-mon[32696]: pgmap v68: 129 pgs: 129 active+clean; 85 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 2.1 MiB/s wr, 221 op/s 2024-04-25T13:46:47.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:47 smithi175 ceph-mon[32649]: pgmap v68: 129 pgs: 129 active+clean; 85 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 2.1 MiB/s wr, 221 op/s 2024-04-25T13:46:47.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:47 smithi043 ceph-mon[29195]: pgmap v68: 129 pgs: 129 active+clean; 85 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 2.1 MiB/s wr, 221 op/s 2024-04-25T13:46:49.513 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:49 smithi043 ceph-mon[29195]: pgmap v69: 129 pgs: 129 active+clean; 97 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 328 op/s 2024-04-25T13:46:49.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:49 smithi161 ceph-mon[32696]: pgmap v69: 129 pgs: 129 active+clean; 97 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 328 op/s 2024-04-25T13:46:49.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:49 smithi175 ceph-mon[32649]: pgmap v69: 129 pgs: 129 active+clean; 97 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 328 op/s 2024-04-25T13:46:50.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:50 smithi161 ceph-mon[32696]: pgmap v70: 129 pgs: 129 active+clean; 97 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 219 op/s 2024-04-25T13:46:50.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:50 smithi175 ceph-mon[32649]: pgmap v70: 129 pgs: 129 active+clean; 97 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 219 op/s 2024-04-25T13:46:50.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:50 smithi043 ceph-mon[29195]: pgmap v70: 129 pgs: 129 active+clean; 97 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 219 op/s 2024-04-25T13:46:50.970 INFO:tasks.workunit.client.0.smithi043.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-25T13:46:50.974 INFO:tasks.workunit.client.0.smithi043.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T13:46:50.974 INFO:tasks.workunit.client.0.smithi043.stderr:+ make 2024-04-25T13:46:51.529 INFO:tasks.workunit.client.0.smithi043.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-25T13:46:52.571 INFO:tasks.workunit.client.0.smithi043.stderr:++ readlink -f fsstress 2024-04-25T13:46:52.572 INFO:tasks.workunit.client.0.smithi043.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-25T13:46:52.572 INFO:tasks.workunit.client.0.smithi043.stderr:+ popd 2024-04-25T13:46:52.573 INFO:tasks.workunit.client.0.smithi043.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T13:46:52.574 INFO:tasks.workunit.client.0.smithi043.stderr:+ popd 2024-04-25T13:46:52.574 INFO:tasks.workunit.client.0.smithi043.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-25T13:46:52.574 INFO:tasks.workunit.client.0.smithi043.stderr:++ mktemp -d -p . 2024-04-25T13:46:52.577 INFO:tasks.workunit.client.0.smithi043.stderr:+ T=./tmp.lay3LAZZ2F 2024-04-25T13:46:52.577 INFO:tasks.workunit.client.0.smithi043.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.lay3LAZZ2F -l 1 -n 1000 -p 10 -v 2024-04-25T13:46:52.580 INFO:tasks.workunit.client.0.smithi043.stdout:seed = 1713553376 2024-04-25T13:46:52.585 INFO:tasks.workunit.client.0.smithi043.stdout:0/0: getdents . 0 2024-04-25T13:46:52.586 INFO:tasks.workunit.client.0.smithi043.stdout:1/0: getdents . 0 2024-04-25T13:46:52.586 INFO:tasks.workunit.client.0.smithi043.stdout:1/1: dwrite - no filename 2024-04-25T13:46:52.586 INFO:tasks.workunit.client.0.smithi043.stdout:1/2: unlink - no file 2024-04-25T13:46:52.586 INFO:tasks.workunit.client.0.smithi043.stdout:1/3: rename - no filename 2024-04-25T13:46:52.587 INFO:tasks.workunit.client.0.smithi043.stdout:0/1: mknod c0 0 2024-04-25T13:46:52.587 INFO:tasks.workunit.client.0.smithi043.stdout:0/2: dread - no filename 2024-04-25T13:46:52.587 INFO:tasks.workunit.client.0.smithi043.stdout:0/3: chown c0 1040984 1 2024-04-25T13:46:52.587 INFO:tasks.workunit.client.0.smithi043.stdout:0/4: write - no filename 2024-04-25T13:46:52.588 INFO:tasks.workunit.client.0.smithi043.stdout:3/0: readlink - no filename 2024-04-25T13:46:52.588 INFO:tasks.workunit.client.0.smithi043.stdout:3/1: read - no filename 2024-04-25T13:46:52.588 INFO:tasks.workunit.client.0.smithi043.stdout:3/2: dread - no filename 2024-04-25T13:46:52.588 INFO:tasks.workunit.client.0.smithi043.stdout:3/3: dwrite - no filename 2024-04-25T13:46:52.588 INFO:tasks.workunit.client.0.smithi043.stdout:3/4: rename - no filename 2024-04-25T13:46:52.588 INFO:tasks.workunit.client.0.smithi043.stdout:3/5: stat - no entries 2024-04-25T13:46:52.590 INFO:tasks.workunit.client.0.smithi043.stdout:4/0: write - no filename 2024-04-25T13:46:52.590 INFO:tasks.workunit.client.0.smithi043.stdout:4/1: unlink - no file 2024-04-25T13:46:52.590 INFO:tasks.workunit.client.0.smithi043.stdout:4/2: dwrite - no filename 2024-04-25T13:46:52.590 INFO:tasks.workunit.client.0.smithi043.stdout:4/3: write - no filename 2024-04-25T13:46:52.590 INFO:tasks.workunit.client.0.smithi043.stdout:4/4: write - no filename 2024-04-25T13:46:52.591 INFO:tasks.workunit.client.0.smithi043.stdout:3/6: mkdir d0 0 2024-04-25T13:46:52.591 INFO:tasks.workunit.client.0.smithi043.stdout:3/7: dwrite - no filename 2024-04-25T13:46:52.591 INFO:tasks.workunit.client.0.smithi043.stdout:3/8: write - no filename 2024-04-25T13:46:52.591 INFO:tasks.workunit.client.0.smithi043.stdout:3/9: dread - no filename 2024-04-25T13:46:52.591 INFO:tasks.workunit.client.0.smithi043.stdout:3/10: rename d0 to d0/d1 22 2024-04-25T13:46:52.592 INFO:tasks.workunit.client.0.smithi043.stdout:3/11: read - no filename 2024-04-25T13:46:52.592 INFO:tasks.workunit.client.0.smithi043.stdout:3/12: chown d0 530 1 2024-04-25T13:46:52.592 INFO:tasks.workunit.client.0.smithi043.stdout:3/13: link - no file 2024-04-25T13:46:52.592 INFO:tasks.workunit.client.0.smithi043.stdout:3/14: dread - no filename 2024-04-25T13:46:52.592 INFO:tasks.workunit.client.0.smithi043.stdout:4/5: mknod c0 0 2024-04-25T13:46:52.593 INFO:tasks.workunit.client.0.smithi043.stdout:6/0: stat - no entries 2024-04-25T13:46:52.593 INFO:tasks.workunit.client.0.smithi043.stdout:6/1: truncate - no filename 2024-04-25T13:46:52.593 INFO:tasks.workunit.client.0.smithi043.stdout:6/2: chown . 263 1 2024-04-25T13:46:52.593 INFO:tasks.workunit.client.0.smithi043.stdout:6/3: truncate - no filename 2024-04-25T13:46:52.593 INFO:tasks.workunit.client.0.smithi043.stdout:6/4: read - no filename 2024-04-25T13:46:52.593 INFO:tasks.workunit.client.0.smithi043.stdout:3/15: creat d0/f2 x:0 0 0 2024-04-25T13:46:52.594 INFO:tasks.workunit.client.0.smithi043.stdout:4/6: mkdir d1 0 2024-04-25T13:46:52.594 INFO:tasks.workunit.client.0.smithi043.stdout:4/7: write - no filename 2024-04-25T13:46:52.594 INFO:tasks.workunit.client.0.smithi043.stdout:4/8: dread - no filename 2024-04-25T13:46:52.594 INFO:tasks.workunit.client.0.smithi043.stdout:5/0: symlink l0 0 2024-04-25T13:46:52.596 INFO:tasks.workunit.client.0.smithi043.stdout:5/1: mkdir d1 0 2024-04-25T13:46:52.596 INFO:tasks.workunit.client.0.smithi043.stdout:5/2: dread - no filename 2024-04-25T13:46:52.597 INFO:tasks.workunit.client.0.smithi043.stdout:8/0: dread - no filename 2024-04-25T13:46:52.597 INFO:tasks.workunit.client.0.smithi043.stdout:8/1: dwrite - no filename 2024-04-25T13:46:52.597 INFO:tasks.workunit.client.0.smithi043.stdout:8/2: write - no filename 2024-04-25T13:46:52.597 INFO:tasks.workunit.client.0.smithi043.stdout:8/3: fsync - no filename 2024-04-25T13:46:52.598 INFO:tasks.workunit.client.0.smithi043.stdout:3/16: link d0/f2 d0/f3 0 2024-04-25T13:46:52.598 INFO:tasks.workunit.client.0.smithi043.stdout:4/9: mknod d1/c2 0 2024-04-25T13:46:52.598 INFO:tasks.workunit.client.0.smithi043.stdout:4/10: write - no filename 2024-04-25T13:46:52.601 INFO:tasks.workunit.client.0.smithi043.stdout:7/0: mknod c0 0 2024-04-25T13:46:52.601 INFO:tasks.workunit.client.0.smithi043.stdout:7/1: read - no filename 2024-04-25T13:46:52.601 INFO:tasks.workunit.client.0.smithi043.stdout:7/2: dread - no filename 2024-04-25T13:46:52.601 INFO:tasks.workunit.client.0.smithi043.stdout:7/3: dread - no filename 2024-04-25T13:46:52.601 INFO:tasks.workunit.client.0.smithi043.stdout:7/4: write - no filename 2024-04-25T13:46:52.601 INFO:tasks.workunit.client.0.smithi043.stdout:7/5: stat c0 0 2024-04-25T13:46:52.602 INFO:tasks.workunit.client.0.smithi043.stdout:7/6: stat c0 0 2024-04-25T13:46:52.602 INFO:tasks.workunit.client.0.smithi043.stdout:4/11: mkdir d1/d3 0 2024-04-25T13:46:52.602 INFO:tasks.workunit.client.0.smithi043.stdout:4/12: fsync - no filename 2024-04-25T13:46:52.602 INFO:tasks.workunit.client.0.smithi043.stdout:4/13: dread - no filename 2024-04-25T13:46:52.602 INFO:tasks.workunit.client.0.smithi043.stdout:8/4: getdents . 0 2024-04-25T13:46:52.603 INFO:tasks.workunit.client.0.smithi043.stdout:4/14: chown d1/d3 20439226 1 2024-04-25T13:46:52.603 INFO:tasks.workunit.client.0.smithi043.stdout:9/0: mkdir d0 0 2024-04-25T13:46:52.605 INFO:tasks.workunit.client.0.smithi043.stdout:8/5: mknod c0 0 2024-04-25T13:46:52.606 INFO:tasks.workunit.client.0.smithi043.stdout:4/15: rename c0 to d1/c4 0 2024-04-25T13:46:52.609 INFO:tasks.workunit.client.0.smithi043.stdout:3/17: dwrite d0/f3 [0,4194304] 0 2024-04-25T13:46:52.610 INFO:tasks.workunit.client.0.smithi043.stdout:8/6: mknod c1 0 2024-04-25T13:46:52.610 INFO:tasks.workunit.client.0.smithi043.stdout:8/7: fdatasync - no filename 2024-04-25T13:46:52.611 INFO:tasks.workunit.client.0.smithi043.stdout:9/1: symlink d0/l1 0 2024-04-25T13:46:52.611 INFO:tasks.workunit.client.0.smithi043.stdout:9/2: write - no filename 2024-04-25T13:46:52.611 INFO:tasks.workunit.client.0.smithi043.stdout:9/3: dwrite - no filename 2024-04-25T13:46:52.611 INFO:tasks.workunit.client.0.smithi043.stdout:9/4: dwrite - no filename 2024-04-25T13:46:52.612 INFO:tasks.workunit.client.0.smithi043.stdout:4/16: symlink d1/l5 0 2024-04-25T13:46:52.614 INFO:tasks.workunit.client.0.smithi043.stdout:8/8: creat f2 x:0 0 0 2024-04-25T13:46:52.615 INFO:tasks.workunit.client.0.smithi043.stdout:8/9: write f2 [91467,20457] 0 2024-04-25T13:46:52.615 INFO:tasks.workunit.client.0.smithi043.stdout:9/5: rename d0/l1 to d0/l2 0 2024-04-25T13:46:52.615 INFO:tasks.workunit.client.0.smithi043.stdout:9/6: truncate - no filename 2024-04-25T13:46:52.617 INFO:tasks.workunit.client.0.smithi043.stdout:4/17: rename d1/l5 to d1/d3/l6 0 2024-04-25T13:46:52.617 INFO:tasks.workunit.client.0.smithi043.stdout:4/18: dread - no filename 2024-04-25T13:46:52.617 INFO:tasks.workunit.client.0.smithi043.stdout:4/19: write - no filename 2024-04-25T13:46:52.620 INFO:tasks.workunit.client.0.smithi043.stdout:9/7: creat d0/f3 x:0 0 0 2024-04-25T13:46:52.622 INFO:tasks.workunit.client.0.smithi043.stdout:4/20: symlink d1/d3/l7 0 2024-04-25T13:46:52.628 INFO:tasks.workunit.client.0.smithi043.stdout:9/8: dwrite d0/f3 [0,4194304] 0 2024-04-25T13:46:52.633 INFO:tasks.workunit.client.0.smithi043.stdout:9/9: dread d0/f3 [0,4194304] 0 2024-04-25T13:46:52.759 INFO:tasks.workunit.client.0.smithi043.stdout:7/7: getdents . 0 2024-04-25T13:46:52.770 INFO:tasks.workunit.client.0.smithi043.stdout:8/10: fsync f2 0 2024-04-25T13:46:52.771 INFO:tasks.workunit.client.0.smithi043.stdout:3/18: dwrite d0/f3 [4194304,4194304] 0 2024-04-25T13:46:52.772 INFO:tasks.workunit.client.0.smithi043.stdout:8/11: truncate f2 585881 0 2024-04-25T13:46:52.772 INFO:tasks.workunit.client.0.smithi043.stdout:8/12: truncate f2 815288 0 2024-04-25T13:46:52.778 INFO:tasks.workunit.client.0.smithi043.stdout:9/10: truncate d0/f3 1954701 0 2024-04-25T13:46:52.784 INFO:tasks.workunit.client.0.smithi043.stdout:8/13: dread f2 [0,4194304] 0 2024-04-25T13:46:52.806 INFO:tasks.workunit.client.0.smithi043.stdout:7/8: creat f1 x:0 0 0 2024-04-25T13:46:52.807 INFO:tasks.workunit.client.0.smithi043.stdout:7/9: write f1 [576238,108070] 0 2024-04-25T13:46:52.817 INFO:tasks.workunit.client.0.smithi043.stdout:8/14: rename c1 to c3 0 2024-04-25T13:46:52.820 INFO:tasks.workunit.client.0.smithi043.stdout:7/10: creat f2 x:0 0 0 2024-04-25T13:46:52.820 INFO:tasks.workunit.client.0.smithi043.stdout:7/11: readlink - no filename 2024-04-25T13:46:52.823 INFO:tasks.workunit.client.0.smithi043.stdout:9/11: unlink d0/f3 0 2024-04-25T13:46:52.827 INFO:tasks.workunit.client.0.smithi043.stdout:8/15: dread f2 [0,4194304] 0 2024-04-25T13:46:52.832 INFO:tasks.workunit.client.0.smithi043.stdout:7/12: creat f3 x:0 0 0 2024-04-25T13:46:52.839 INFO:tasks.workunit.client.0.smithi043.stdout:8/16: unlink c0 0 2024-04-25T13:46:52.852 INFO:tasks.workunit.client.0.smithi043.stdout:7/13: unlink f1 0 2024-04-25T13:46:52.863 INFO:tasks.workunit.client.0.smithi043.stdout:8/17: link f2 f4 0 2024-04-25T13:46:52.864 INFO:tasks.workunit.client.0.smithi043.stdout:8/18: rmdir - no directory 2024-04-25T13:46:52.866 INFO:tasks.workunit.client.0.smithi043.stdout:7/14: link f3 f4 0 2024-04-25T13:46:52.869 INFO:tasks.workunit.client.0.smithi043.stdout:9/12: getdents d0 0 2024-04-25T13:46:52.873 INFO:tasks.workunit.client.0.smithi043.stdout:3/19: creat d0/f4 x:0 0 0 2024-04-25T13:46:52.875 INFO:tasks.workunit.client.0.smithi043.stdout:7/15: mkdir d5 0 2024-04-25T13:46:52.876 INFO:tasks.workunit.client.0.smithi043.stdout:7/16: truncate f4 968043 0 2024-04-25T13:46:52.878 INFO:tasks.workunit.client.0.smithi043.stdout:8/19: link c3 c5 0 2024-04-25T13:46:52.880 INFO:tasks.workunit.client.0.smithi043.stdout:7/17: creat d5/f6 x:0 0 0 2024-04-25T13:46:52.884 INFO:tasks.workunit.client.0.smithi043.stdout:7/18: creat d5/f7 x:0 0 0 2024-04-25T13:46:52.885 INFO:tasks.workunit.client.0.smithi043.stdout:7/19: write d5/f7 [688341,121167] 0 2024-04-25T13:46:52.898 INFO:tasks.workunit.client.0.smithi043.stdout:8/20: dwrite f4 [0,4194304] 0 2024-04-25T13:46:52.899 INFO:tasks.workunit.client.0.smithi043.stdout:7/20: getdents d5 0 2024-04-25T13:46:52.900 INFO:tasks.workunit.client.0.smithi043.stdout:3/20: symlink d0/l5 0 2024-04-25T13:46:52.902 INFO:tasks.workunit.client.0.smithi043.stdout:7/21: mknod d5/c8 0 2024-04-25T13:46:52.903 INFO:tasks.workunit.client.0.smithi043.stdout:7/22: chown d5 851332 1 2024-04-25T13:46:52.906 INFO:tasks.workunit.client.0.smithi043.stdout:8/21: dread f2 [0,4194304] 0 2024-04-25T13:46:52.907 INFO:tasks.workunit.client.0.smithi043.stdout:7/23: mknod d5/c9 0 2024-04-25T13:46:52.910 INFO:tasks.workunit.client.0.smithi043.stdout:3/21: dwrite d0/f4 [0,4194304] 0 2024-04-25T13:46:52.917 INFO:tasks.workunit.client.0.smithi043.stdout:3/22: rename d0/l5 to d0/l6 0 2024-04-25T13:46:52.921 INFO:tasks.workunit.client.0.smithi043.stdout:7/24: dwrite d5/f6 [0,4194304] 0 2024-04-25T13:46:52.922 INFO:tasks.workunit.client.0.smithi043.stdout:8/22: dwrite f4 [4194304,4194304] 0 2024-04-25T13:46:52.926 INFO:tasks.workunit.client.0.smithi043.stdout:7/25: unlink c0 0 2024-04-25T13:46:52.926 INFO:tasks.workunit.client.0.smithi043.stdout:3/23: dread d0/f4 [0,4194304] 0 2024-04-25T13:46:52.929 INFO:tasks.workunit.client.0.smithi043.stdout:3/24: readlink d0/l6 0 2024-04-25T13:46:52.936 INFO:tasks.workunit.client.0.smithi043.stdout:8/23: link c5 c6 0 2024-04-25T13:46:52.940 INFO:tasks.workunit.client.0.smithi043.stdout:7/26: dwrite f3 [0,4194304] 0 2024-04-25T13:46:52.946 INFO:tasks.workunit.client.0.smithi043.stdout:3/25: dwrite d0/f2 [0,4194304] 0 2024-04-25T13:46:52.948 INFO:tasks.workunit.client.0.smithi043.stdout:8/24: dwrite f4 [0,4194304] 0 2024-04-25T13:46:52.949 INFO:tasks.workunit.client.0.smithi043.stdout:3/26: mknod d0/c7 0 2024-04-25T13:46:52.951 INFO:tasks.workunit.client.0.smithi043.stdout:3/27: fsync d0/f4 0 2024-04-25T13:46:52.952 INFO:tasks.workunit.client.0.smithi043.stdout:7/27: dwrite d5/f6 [0,4194304] 0 2024-04-25T13:46:52.955 INFO:tasks.workunit.client.0.smithi043.stdout:8/25: dwrite f4 [4194304,4194304] 0 2024-04-25T13:46:52.958 INFO:tasks.workunit.client.0.smithi043.stdout:7/28: dread f4 [0,4194304] 0 2024-04-25T13:46:52.959 INFO:tasks.workunit.client.0.smithi043.stdout:7/29: truncate f3 5199291 0 2024-04-25T13:46:52.960 INFO:tasks.workunit.client.0.smithi043.stdout:3/28: rename d0/l6 to d0/l8 0 2024-04-25T13:46:52.961 INFO:tasks.workunit.client.0.smithi043.stdout:3/29: chown d0/f2 1412660301 1 2024-04-25T13:46:52.962 INFO:tasks.workunit.client.0.smithi043.stdout:7/30: mknod d5/ca 0 2024-04-25T13:46:52.963 INFO:tasks.workunit.client.0.smithi043.stdout:7/31: chown f3 1026 1 2024-04-25T13:46:52.964 INFO:tasks.workunit.client.0.smithi043.stdout:8/26: dwrite f4 [0,4194304] 0 2024-04-25T13:46:52.967 INFO:tasks.workunit.client.0.smithi043.stdout:3/30: mkdir d0/d9 0 2024-04-25T13:46:52.968 INFO:tasks.workunit.client.0.smithi043.stdout:8/27: stat c3 0 2024-04-25T13:46:52.970 INFO:tasks.workunit.client.0.smithi043.stdout:3/31: truncate d0/f2 8931601 0 2024-04-25T13:46:52.972 INFO:tasks.workunit.client.0.smithi043.stdout:8/28: creat f7 x:0 0 0 2024-04-25T13:46:52.973 INFO:tasks.workunit.client.0.smithi043.stdout:7/32: dwrite f2 [0,4194304] 0 2024-04-25T13:46:52.976 INFO:tasks.workunit.client.0.smithi043.stdout:3/32: mkdir d0/da 0 2024-04-25T13:46:52.976 INFO:tasks.workunit.client.0.smithi043.stdout:3/33: stat d0 0 2024-04-25T13:46:52.977 INFO:tasks.workunit.client.0.smithi043.stdout:7/33: mknod d5/cb 0 2024-04-25T13:46:52.977 INFO:tasks.workunit.client.0.smithi043.stdout:7/34: read f2 [3374275,8924] 0 2024-04-25T13:46:52.981 INFO:tasks.workunit.client.0.smithi043.stdout:3/34: mknod d0/da/cb 0 2024-04-25T13:46:52.983 INFO:tasks.workunit.client.0.smithi043.stdout:7/35: mkdir d5/dc 0 2024-04-25T13:46:52.987 INFO:tasks.workunit.client.0.smithi043.stdout:7/36: rename f2 to d5/fd 0 2024-04-25T13:46:52.989 INFO:tasks.workunit.client.0.smithi043.stdout:7/37: creat d5/fe x:0 0 0 2024-04-25T13:46:52.991 INFO:tasks.workunit.client.0.smithi043.stdout:8/29: getdents . 0 2024-04-25T13:46:52.991 INFO:tasks.workunit.client.0.smithi043.stdout:8/30: dread - f7 zero size 2024-04-25T13:46:52.996 INFO:tasks.workunit.client.0.smithi043.stdout:8/31: creat f8 x:0 0 0 2024-04-25T13:46:52.997 INFO:tasks.workunit.client.0.smithi043.stdout:3/35: getdents d0/da 0 2024-04-25T13:46:53.001 INFO:tasks.workunit.client.0.smithi043.stdout:3/36: creat d0/da/fc x:0 0 0 2024-04-25T13:46:53.002 INFO:tasks.workunit.client.0.smithi043.stdout:7/38: rmdir d5/dc 0 2024-04-25T13:46:53.002 INFO:tasks.workunit.client.0.smithi043.stdout:7/39: readlink - no filename 2024-04-25T13:46:53.003 INFO:tasks.workunit.client.0.smithi043.stdout:3/37: read d0/f4 [2833533,67531] 0 2024-04-25T13:46:53.003 INFO:tasks.workunit.client.0.smithi043.stdout:8/32: mkdir d9 0 2024-04-25T13:46:53.003 INFO:tasks.workunit.client.0.smithi043.stdout:8/33: dread - f8 zero size 2024-04-25T13:46:53.006 INFO:tasks.workunit.client.0.smithi043.stdout:3/38: link d0/da/cb d0/cd 0 2024-04-25T13:46:53.007 INFO:tasks.workunit.client.0.smithi043.stdout:8/34: rmdir d9 0 2024-04-25T13:46:53.008 INFO:tasks.workunit.client.0.smithi043.stdout:8/35: chown c6 2010472 1 2024-04-25T13:46:53.008 INFO:tasks.workunit.client.0.smithi043.stdout:7/40: dwrite f3 [0,4194304] 0 2024-04-25T13:46:53.009 INFO:tasks.workunit.client.0.smithi043.stdout:3/39: creat d0/fe x:0 0 0 2024-04-25T13:46:53.012 INFO:tasks.workunit.client.0.smithi043.stdout:8/36: symlink la 0 2024-04-25T13:46:53.015 INFO:tasks.workunit.client.0.smithi043.stdout:3/40: link d0/l8 d0/lf 0 2024-04-25T13:46:53.018 INFO:tasks.workunit.client.0.smithi043.stdout:8/37: dwrite f2 [4194304,4194304] 0 2024-04-25T13:46:53.021 INFO:tasks.workunit.client.0.smithi043.stdout:8/38: write f7 [53459,2337] 0 2024-04-25T13:46:53.021 INFO:tasks.workunit.client.0.smithi043.stdout:7/41: dread d5/f7 [0,4194304] 0 2024-04-25T13:46:53.021 INFO:tasks.workunit.client.0.smithi043.stdout:3/41: dread d0/f4 [0,4194304] 0 2024-04-25T13:46:53.022 INFO:tasks.workunit.client.0.smithi043.stdout:7/42: read - d5/fe zero size 2024-04-25T13:46:53.025 INFO:tasks.workunit.client.0.smithi043.stdout:8/39: mkdir db 0 2024-04-25T13:46:53.029 INFO:tasks.workunit.client.0.smithi043.stdout:8/40: write f7 [806514,99108] 0 2024-04-25T13:46:53.034 INFO:tasks.workunit.client.0.smithi043.stdout:3/42: dwrite d0/f2 [8388608,4194304] 0 2024-04-25T13:46:53.035 INFO:tasks.workunit.client.0.smithi043.stdout:7/43: dwrite d5/f6 [0,4194304] 0 2024-04-25T13:46:53.037 INFO:tasks.workunit.client.0.smithi043.stdout:3/43: symlink d0/da/l10 0 2024-04-25T13:46:53.041 INFO:tasks.workunit.client.0.smithi043.stdout:8/41: dwrite f8 [0,4194304] 0 2024-04-25T13:46:53.047 INFO:tasks.workunit.client.0.smithi043.stdout:3/44: dwrite d0/da/fc [0,4194304] 0 2024-04-25T13:46:53.048 INFO:tasks.workunit.client.0.smithi043.stdout:8/42: dread f8 [0,4194304] 0 2024-04-25T13:46:53.050 INFO:tasks.workunit.client.0.smithi043.stdout:3/45: creat d0/da/f11 x:0 0 0 2024-04-25T13:46:53.053 INFO:tasks.workunit.client.0.smithi043.stdout:8/43: dread f8 [0,4194304] 0 2024-04-25T13:46:53.053 INFO:tasks.workunit.client.0.smithi043.stdout:3/46: mknod d0/c12 0 2024-04-25T13:46:53.057 INFO:tasks.workunit.client.0.smithi043.stdout:8/44: mkdir db/dc 0 2024-04-25T13:46:53.060 INFO:tasks.workunit.client.0.smithi043.stdout:3/47: mkdir d0/d13 0 2024-04-25T13:46:53.064 INFO:tasks.workunit.client.0.smithi043.stdout:3/48: mkdir d0/d14 0 2024-04-25T13:46:53.065 INFO:tasks.workunit.client.0.smithi043.stdout:3/49: write d0/f4 [4347871,26577] 0 2024-04-25T13:46:53.067 INFO:tasks.workunit.client.0.smithi043.stdout:8/45: dwrite f7 [0,4194304] 0 2024-04-25T13:46:53.070 INFO:tasks.workunit.client.0.smithi043.stdout:3/50: mkdir d0/d9/d15 0 2024-04-25T13:46:53.072 INFO:tasks.workunit.client.0.smithi043.stdout:8/46: rename f8 to db/fd 0 2024-04-25T13:46:53.080 INFO:tasks.workunit.client.0.smithi043.stdout:3/51: dread d0/f2 [4194304,4194304] 0 2024-04-25T13:46:53.083 INFO:tasks.workunit.client.0.smithi043.stdout:8/47: dwrite f7 [0,4194304] 0 2024-04-25T13:46:53.086 INFO:tasks.workunit.client.0.smithi043.stdout:8/48: symlink db/le 0 2024-04-25T13:46:53.088 INFO:tasks.workunit.client.0.smithi043.stdout:8/49: read db/fd [3208235,6320] 0 2024-04-25T13:46:53.091 INFO:tasks.workunit.client.0.smithi043.stdout:3/52: dwrite d0/da/f11 [0,4194304] 0 2024-04-25T13:46:53.093 INFO:tasks.workunit.client.0.smithi043.stdout:8/50: rename f7 to db/ff 0 2024-04-25T13:46:53.093 INFO:tasks.workunit.client.0.smithi043.stdout:3/53: write d0/da/f11 [4164391,52036] 0 2024-04-25T13:46:53.094 INFO:tasks.workunit.client.0.smithi043.stdout:8/51: readlink db/le 0 2024-04-25T13:46:53.097 INFO:tasks.workunit.client.0.smithi043.stdout:3/54: symlink d0/d9/d15/l16 0 2024-04-25T13:46:53.098 INFO:tasks.workunit.client.0.smithi043.stdout:3/55: chown d0/d9/d15 52119 1 2024-04-25T13:46:53.099 INFO:tasks.workunit.client.0.smithi043.stdout:8/52: dread db/ff [0,4194304] 0 2024-04-25T13:46:53.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:52 smithi161 ceph-mon[32696]: pgmap v71: 129 pgs: 129 active+clean; 114 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.6 MiB/s wr, 328 op/s 2024-04-25T13:46:53.102 INFO:tasks.workunit.client.0.smithi043.stdout:8/53: write f4 [2492720,28017] 0 2024-04-25T13:46:53.104 INFO:tasks.workunit.client.0.smithi043.stdout:3/56: getdents d0/d9 0 2024-04-25T13:46:53.108 INFO:tasks.workunit.client.0.smithi043.stdout:3/57: getdents d0/d9 0 2024-04-25T13:46:53.108 INFO:tasks.workunit.client.0.smithi043.stdout:8/54: dwrite f4 [0,4194304] 0 2024-04-25T13:46:53.111 INFO:tasks.workunit.client.0.smithi043.stdout:3/58: mknod d0/d14/c17 0 2024-04-25T13:46:53.116 INFO:tasks.workunit.client.0.smithi043.stdout:3/59: dread d0/f3 [8388608,4194304] 0 2024-04-25T13:46:53.120 INFO:tasks.workunit.client.0.smithi043.stdout:3/60: symlink d0/l18 0 2024-04-25T13:46:53.122 INFO:tasks.workunit.client.0.smithi043.stdout:3/61: creat d0/d9/d15/f19 x:0 0 0 2024-04-25T13:46:53.124 INFO:tasks.workunit.client.0.smithi043.stdout:8/55: fdatasync f4 0 2024-04-25T13:46:53.126 INFO:tasks.workunit.client.0.smithi043.stdout:3/62: dread d0/da/fc [0,4194304] 0 2024-04-25T13:46:53.126 INFO:tasks.workunit.client.0.smithi043.stdout:8/56: write db/fd [5198250,84903] 0 2024-04-25T13:46:53.127 INFO:tasks.workunit.client.0.smithi043.stdout:3/63: dread - d0/fe zero size 2024-04-25T13:46:53.129 INFO:tasks.workunit.client.0.smithi043.stdout:8/57: symlink db/l10 0 2024-04-25T13:46:53.130 INFO:tasks.workunit.client.0.smithi043.stdout:3/64: symlink d0/d9/l1a 0 2024-04-25T13:46:53.130 INFO:tasks.workunit.client.0.smithi043.stdout:3/65: readlink d0/d9/d15/l16 0 2024-04-25T13:46:53.131 INFO:tasks.workunit.client.0.smithi043.stdout:8/58: mkdir db/d11 0 2024-04-25T13:46:53.133 INFO:tasks.workunit.client.0.smithi043.stdout:3/66: unlink d0/lf 0 2024-04-25T13:46:53.137 INFO:tasks.workunit.client.0.smithi043.stdout:8/59: dwrite f2 [0,4194304] 0 2024-04-25T13:46:53.139 INFO:tasks.workunit.client.0.smithi043.stdout:8/60: fsync db/ff 0 2024-04-25T13:46:53.140 INFO:tasks.workunit.client.0.smithi043.stdout:8/61: chown db/fd 3 1 2024-04-25T13:46:53.141 INFO:tasks.workunit.client.0.smithi043.stdout:3/67: dwrite d0/f2 [8388608,4194304] 0 2024-04-25T13:46:53.144 INFO:tasks.workunit.client.0.smithi043.stdout:3/68: symlink d0/da/l1b 0 2024-04-25T13:46:53.144 INFO:tasks.workunit.client.0.smithi043.stdout:3/69: dread - d0/fe zero size 2024-04-25T13:46:53.145 INFO:tasks.workunit.client.0.smithi043.stdout:8/62: link db/le db/d11/l12 0 2024-04-25T13:46:53.148 INFO:tasks.workunit.client.0.smithi043.stdout:8/63: symlink db/l13 0 2024-04-25T13:46:53.148 INFO:tasks.workunit.client.0.smithi043.stdout:8/64: chown db 235142 1 2024-04-25T13:46:53.148 INFO:tasks.workunit.client.0.smithi043.stdout:3/70: getdents d0/d13 0 2024-04-25T13:46:53.150 INFO:tasks.workunit.client.0.smithi043.stdout:8/65: unlink la 0 2024-04-25T13:46:53.153 INFO:tasks.workunit.client.0.smithi043.stdout:3/71: dread d0/f2 [0,4194304] 0 2024-04-25T13:46:53.162 INFO:tasks.workunit.client.0.smithi043.stdout:8/66: truncate db/fd 1228722 0 2024-04-25T13:46:53.163 INFO:tasks.workunit.client.0.smithi043.stdout:3/72: truncate d0/da/f11 580924 0 2024-04-25T13:46:53.165 INFO:tasks.workunit.client.0.smithi043.stdout:8/67: unlink c3 0 2024-04-25T13:46:53.167 INFO:tasks.workunit.client.0.smithi043.stdout:3/73: dread d0/da/fc [0,4194304] 0 2024-04-25T13:46:53.167 INFO:tasks.workunit.client.0.smithi043.stdout:3/74: write d0/f4 [2841116,23926] 0 2024-04-25T13:46:53.168 INFO:tasks.workunit.client.0.smithi043.stdout:8/68: creat db/d11/f14 x:0 0 0 2024-04-25T13:46:53.170 INFO:tasks.workunit.client.0.smithi043.stdout:8/69: unlink db/d11/l12 0 2024-04-25T13:46:53.173 INFO:tasks.workunit.client.0.smithi043.stdout:8/70: creat db/d11/f15 x:0 0 0 2024-04-25T13:46:53.174 INFO:tasks.workunit.client.0.smithi043.stdout:8/71: chown db/ff 120394 1 2024-04-25T13:46:53.174 INFO:tasks.workunit.client.0.smithi043.stdout:3/75: dwrite d0/f3 [4194304,4194304] 0 2024-04-25T13:46:53.176 INFO:tasks.workunit.client.0.smithi043.stdout:8/72: creat db/f16 x:0 0 0 2024-04-25T13:46:53.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:52 smithi175 ceph-mon[32649]: pgmap v71: 129 pgs: 129 active+clean; 114 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.6 MiB/s wr, 328 op/s 2024-04-25T13:46:53.180 INFO:tasks.workunit.client.0.smithi043.stdout:3/76: getdents d0/da 0 2024-04-25T13:46:53.181 INFO:tasks.workunit.client.0.smithi043.stdout:3/77: chown d0/f3 196 1 2024-04-25T13:46:53.182 INFO:tasks.workunit.client.0.smithi043.stdout:8/73: dread db/fd [0,4194304] 0 2024-04-25T13:46:53.189 INFO:tasks.workunit.client.0.smithi043.stdout:8/74: creat db/d11/f17 x:0 0 0 2024-04-25T13:46:53.196 INFO:tasks.workunit.client.0.smithi043.stdout:8/75: creat db/dc/f18 x:0 0 0 2024-04-25T13:46:53.197 INFO:tasks.workunit.client.0.smithi043.stdout:3/78: getdents d0/d9 0 2024-04-25T13:46:53.198 INFO:tasks.workunit.client.0.smithi043.stdout:3/79: chown d0/d14/c17 90998576 1 2024-04-25T13:46:53.198 INFO:tasks.workunit.client.0.smithi043.stdout:8/76: symlink db/dc/l19 0 2024-04-25T13:46:53.204 INFO:tasks.workunit.client.0.smithi043.stdout:3/80: write d0/da/f11 [924265,107236] 0 2024-04-25T13:46:53.204 INFO:tasks.workunit.client.0.smithi043.stdout:8/77: dwrite f2 [4194304,4194304] 0 2024-04-25T13:46:53.205 INFO:tasks.workunit.client.0.smithi043.stdout:3/81: write d0/f3 [7493393,45319] 0 2024-04-25T13:46:53.206 INFO:tasks.workunit.client.0.smithi043.stdout:8/78: chown db/fd 20101 1 2024-04-25T13:46:53.207 INFO:tasks.workunit.client.0.smithi043.stdout:3/82: write d0/f2 [5205389,56285] 0 2024-04-25T13:46:53.208 INFO:tasks.workunit.client.0.smithi043.stdout:8/79: write db/dc/f18 [173496,49120] 0 2024-04-25T13:46:53.208 INFO:tasks.workunit.client.0.smithi043.stdout:3/83: dread - d0/d9/d15/f19 zero size 2024-04-25T13:46:53.210 INFO:tasks.workunit.client.0.smithi043.stdout:8/80: dread - db/d11/f17 zero size 2024-04-25T13:46:53.211 INFO:tasks.workunit.client.0.smithi043.stdout:3/84: write d0/fe [384335,87220] 0 2024-04-25T13:46:53.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:52 smithi043 ceph-mon[29195]: pgmap v71: 129 pgs: 129 active+clean; 114 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.6 MiB/s wr, 328 op/s 2024-04-25T13:46:53.217 INFO:tasks.workunit.client.0.smithi043.stdout:8/81: getdents db/d11 0 2024-04-25T13:46:53.218 INFO:tasks.workunit.client.0.smithi043.stdout:8/82: rename db to db/dc/d1a 22 2024-04-25T13:46:53.219 INFO:tasks.workunit.client.0.smithi043.stdout:8/83: read - db/d11/f17 zero size 2024-04-25T13:46:53.219 INFO:tasks.workunit.client.0.smithi043.stdout:3/85: dwrite d0/f4 [0,4194304] 0 2024-04-25T13:46:53.221 INFO:tasks.workunit.client.0.smithi043.stdout:8/84: rmdir db 39 2024-04-25T13:46:53.223 INFO:tasks.workunit.client.0.smithi043.stdout:3/86: rename d0/d9/l1a to d0/d9/d15/l1c 0 2024-04-25T13:46:53.224 INFO:tasks.workunit.client.0.smithi043.stdout:8/85: write db/d11/f17 [892217,91770] 0 2024-04-25T13:46:53.225 INFO:tasks.workunit.client.0.smithi043.stdout:8/86: truncate db/f16 406965 0 2024-04-25T13:46:53.241 INFO:tasks.workunit.client.0.smithi043.stdout:3/87: dread d0/da/fc [0,4194304] 0 2024-04-25T13:46:53.322 INFO:tasks.workunit.client.0.smithi043.stdout:8/87: mkdir db/d11/d1b 0 2024-04-25T13:46:53.322 INFO:tasks.workunit.client.0.smithi043.stdout:8/88: chown db/l10 15231901 1 2024-04-25T13:46:53.323 INFO:tasks.workunit.client.0.smithi043.stdout:3/88: creat d0/f1d x:0 0 0 2024-04-25T13:46:53.324 INFO:tasks.workunit.client.0.smithi043.stdout:8/89: truncate db/fd 1947531 0 2024-04-25T13:46:53.326 INFO:tasks.workunit.client.0.smithi043.stdout:8/90: rename db/dc/l19 to db/l1c 0 2024-04-25T13:46:53.410 INFO:tasks.workunit.client.0.smithi043.stdout:8/91: creat db/d11/f1d x:0 0 0 2024-04-25T13:46:53.411 INFO:tasks.workunit.client.0.smithi043.stdout:8/92: stat c5 0 2024-04-25T13:46:53.411 INFO:tasks.workunit.client.0.smithi043.stdout:3/89: dwrite d0/da/fc [4194304,4194304] 0 2024-04-25T13:46:53.413 INFO:tasks.workunit.client.0.smithi043.stdout:8/93: truncate db/f16 1007881 0 2024-04-25T13:46:53.414 INFO:tasks.workunit.client.0.smithi043.stdout:3/90: creat d0/d9/f1e x:0 0 0 2024-04-25T13:46:53.415 INFO:tasks.workunit.client.0.smithi043.stdout:3/91: stat d0/f4 0 2024-04-25T13:46:53.415 INFO:tasks.workunit.client.0.smithi043.stdout:8/94: mkdir db/d11/d1b/d1e 0 2024-04-25T13:46:53.416 INFO:tasks.workunit.client.0.smithi043.stdout:3/92: write d0/f2 [4010581,64325] 0 2024-04-25T13:46:53.417 INFO:tasks.workunit.client.0.smithi043.stdout:8/95: symlink db/d11/d1b/l1f 0 2024-04-25T13:46:53.420 INFO:tasks.workunit.client.0.smithi043.stdout:3/93: rename d0/d9/d15/f19 to d0/d9/d15/f1f 0 2024-04-25T13:46:53.420 INFO:tasks.workunit.client.0.smithi043.stdout:3/94: stat d0/da/cb 0 2024-04-25T13:46:53.421 INFO:tasks.workunit.client.0.smithi043.stdout:8/96: dread f2 [0,4194304] 0 2024-04-25T13:46:53.425 INFO:tasks.workunit.client.0.smithi043.stdout:8/97: rename f2 to db/d11/f20 0 2024-04-25T13:46:53.427 INFO:tasks.workunit.client.0.smithi043.stdout:8/98: mkdir db/dc/d21 0 2024-04-25T13:46:53.429 INFO:tasks.workunit.client.0.smithi043.stdout:8/99: mknod db/c22 0 2024-04-25T13:46:53.433 INFO:tasks.workunit.client.0.smithi043.stdout:8/100: link db/f16 db/dc/f23 0 2024-04-25T13:46:53.471 INFO:tasks.workunit.client.0.smithi043.stdout:8/101: truncate db/d11/f20 7040221 0 2024-04-25T13:46:53.472 INFO:tasks.workunit.client.0.smithi043.stdout:8/102: stat db/le 0 2024-04-25T13:46:53.475 INFO:tasks.workunit.client.0.smithi043.stdout:8/103: getdents db/d11 0 2024-04-25T13:46:53.476 INFO:tasks.workunit.client.0.smithi043.stdout:8/104: truncate db/d11/f1d 756551 0 2024-04-25T13:46:53.478 INFO:tasks.workunit.client.0.smithi043.stdout:8/105: creat db/f24 x:0 0 0 2024-04-25T13:46:53.479 INFO:tasks.workunit.client.0.smithi043.stdout:8/106: truncate db/d11/f15 484474 0 2024-04-25T13:46:53.480 INFO:tasks.workunit.client.0.smithi043.stdout:8/107: write db/ff [2330293,57910] 0 2024-04-25T13:46:53.486 INFO:tasks.workunit.client.0.smithi043.stdout:8/108: write db/f16 [705512,43997] 0 2024-04-25T13:46:53.486 INFO:tasks.workunit.client.0.smithi043.stdout:8/109: chown db/d11/f14 29335099 1 2024-04-25T13:46:53.492 INFO:tasks.workunit.client.0.smithi043.stdout:8/110: truncate db/dc/f23 954750 0 2024-04-25T13:46:53.494 INFO:tasks.workunit.client.0.smithi043.stdout:8/111: creat db/dc/d21/f25 x:0 0 0 2024-04-25T13:46:53.495 INFO:tasks.workunit.client.0.smithi043.stdout:8/112: mknod db/d11/d1b/c26 0 2024-04-25T13:46:53.496 INFO:tasks.workunit.client.0.smithi043.stdout:8/113: truncate db/d11/f17 1977816 0 2024-04-25T13:46:53.496 INFO:tasks.workunit.client.0.smithi043.stdout:8/114: readlink db/l13 0 2024-04-25T13:46:53.498 INFO:tasks.workunit.client.0.smithi043.stdout:8/115: mkdir db/d11/d1b/d1e/d27 0 2024-04-25T13:46:53.500 INFO:tasks.workunit.client.0.smithi043.stdout:8/116: mkdir db/dc/d28 0 2024-04-25T13:46:53.501 INFO:tasks.workunit.client.0.smithi043.stdout:8/117: read db/fd [1552705,24591] 0 2024-04-25T13:46:53.503 INFO:tasks.workunit.client.0.smithi043.stdout:8/118: symlink db/dc/l29 0 2024-04-25T13:46:53.505 INFO:tasks.workunit.client.0.smithi043.stdout:8/119: creat db/d11/f2a x:0 0 0 2024-04-25T13:46:53.507 INFO:tasks.workunit.client.0.smithi043.stdout:8/120: dread db/d11/f15 [0,4194304] 0 2024-04-25T13:46:53.509 INFO:tasks.workunit.client.0.smithi043.stdout:8/121: symlink db/dc/l2b 0 2024-04-25T13:46:53.510 INFO:tasks.workunit.client.0.smithi043.stdout:8/122: symlink db/l2c 0 2024-04-25T13:46:53.516 INFO:tasks.workunit.client.0.smithi043.stdout:8/123: dwrite db/d11/f14 [0,4194304] 0 2024-04-25T13:46:53.519 INFO:tasks.workunit.client.0.smithi043.stdout:8/124: creat db/f2d x:0 0 0 2024-04-25T13:46:53.523 INFO:tasks.workunit.client.0.smithi043.stdout:8/125: unlink db/d11/f14 0 2024-04-25T13:46:53.526 INFO:tasks.workunit.client.0.smithi043.stdout:8/126: creat db/dc/d21/f2e x:0 0 0 2024-04-25T13:46:53.529 INFO:tasks.workunit.client.0.smithi043.stdout:8/127: creat db/dc/f2f x:0 0 0 2024-04-25T13:46:53.532 INFO:tasks.workunit.client.0.smithi043.stdout:8/128: creat db/d11/d1b/d1e/d27/f30 x:0 0 0 2024-04-25T13:46:53.533 INFO:tasks.workunit.client.0.smithi043.stdout:8/129: symlink db/d11/d1b/l31 0 2024-04-25T13:46:53.535 INFO:tasks.workunit.client.0.smithi043.stdout:8/130: unlink db/dc/l2b 0 2024-04-25T13:46:53.536 INFO:tasks.workunit.client.0.smithi043.stdout:8/131: chown db/d11/f1d 97818 1 2024-04-25T13:46:53.536 INFO:tasks.workunit.client.0.smithi043.stdout:8/132: chown db/f2d 191798939 1 2024-04-25T13:46:53.538 INFO:tasks.workunit.client.0.smithi043.stdout:8/133: symlink db/d11/d1b/l32 0 2024-04-25T13:46:53.538 INFO:tasks.workunit.client.0.smithi043.stdout:8/134: chown db/dc/d21/f2e 2 1 2024-04-25T13:46:53.540 INFO:tasks.workunit.client.0.smithi043.stdout:8/135: symlink db/dc/d28/l33 0 2024-04-25T13:46:53.546 INFO:tasks.workunit.client.0.smithi043.stdout:8/136: dwrite db/f16 [0,4194304] 0 2024-04-25T13:46:53.547 INFO:tasks.workunit.client.0.smithi043.stdout:8/137: chown db/dc/f18 230525 1 2024-04-25T13:46:53.547 INFO:tasks.workunit.client.0.smithi043.stdout:8/138: truncate db/f2d 556974 0 2024-04-25T13:46:53.550 INFO:tasks.workunit.client.0.smithi043.stdout:8/139: mknod db/dc/d21/c34 0 2024-04-25T13:46:53.553 INFO:tasks.workunit.client.0.smithi043.stdout:8/140: dread db/f16 [0,4194304] 0 2024-04-25T13:46:53.555 INFO:tasks.workunit.client.0.smithi043.stdout:8/141: chown c6 46 1 2024-04-25T13:46:53.559 INFO:tasks.workunit.client.0.smithi043.stdout:8/142: link db/d11/d1b/d1e/d27/f30 db/f35 0 2024-04-25T13:46:53.563 INFO:tasks.workunit.client.0.smithi043.stdout:8/143: dread db/dc/f23 [0,4194304] 0 2024-04-25T13:46:53.573 INFO:tasks.workunit.client.0.smithi043.stdout:8/144: dwrite db/d11/f20 [0,4194304] 0 2024-04-25T13:46:53.575 INFO:tasks.workunit.client.0.smithi043.stdout:8/145: mknod db/d11/d1b/d1e/c36 0 2024-04-25T13:46:53.575 INFO:tasks.workunit.client.0.smithi043.stdout:8/146: fdatasync db/f2d 0 2024-04-25T13:46:53.578 INFO:tasks.workunit.client.0.smithi043.stdout:8/147: getdents db/dc/d28 0 2024-04-25T13:46:53.579 INFO:tasks.workunit.client.0.smithi043.stdout:8/148: chown db/f24 395278540 1 2024-04-25T13:46:53.585 INFO:tasks.workunit.client.0.smithi043.stdout:8/149: truncate db/dc/f23 2877623 0 2024-04-25T13:46:53.585 INFO:tasks.workunit.client.0.smithi043.stdout:8/150: rename db/dc to db/dc/d21/d37 22 2024-04-25T13:46:53.586 INFO:tasks.workunit.client.0.smithi043.stdout:8/151: fdatasync db/d11/f17 0 2024-04-25T13:46:53.588 INFO:tasks.workunit.client.0.smithi043.stdout:8/152: mkdir db/d38 0 2024-04-25T13:46:53.593 INFO:tasks.workunit.client.0.smithi043.stdout:8/153: write db/fd [2876492,57851] 0 2024-04-25T13:46:53.605 INFO:tasks.workunit.client.0.smithi043.stdout:8/154: dwrite db/dc/f23 [0,4194304] 0 2024-04-25T13:46:53.605 INFO:tasks.workunit.client.0.smithi043.stdout:8/155: chown db/d11/d1b/d1e 66950796 1 2024-04-25T13:46:53.608 INFO:tasks.workunit.client.0.smithi043.stdout:8/156: rename db/f24 to db/dc/d21/f39 0 2024-04-25T13:46:53.613 INFO:tasks.workunit.client.0.smithi043.stdout:8/157: fsync db/dc/d21/f39 0 2024-04-25T13:46:53.617 INFO:tasks.workunit.client.0.smithi043.stdout:8/158: link db/dc/d28/l33 db/dc/l3a 0 2024-04-25T13:46:53.625 INFO:tasks.workunit.client.0.smithi043.stdout:8/159: dwrite db/dc/d21/f25 [0,4194304] 0 2024-04-25T13:46:53.627 INFO:tasks.workunit.client.0.smithi043.stdout:8/160: creat db/d11/d1b/d1e/f3b x:0 0 0 2024-04-25T13:46:53.627 INFO:tasks.workunit.client.0.smithi043.stdout:8/161: chown db/d11/d1b/l32 6130 1 2024-04-25T13:46:53.629 INFO:tasks.workunit.client.0.smithi043.stdout:8/162: mkdir db/d38/d3c 0 2024-04-25T13:46:53.631 INFO:tasks.workunit.client.0.smithi043.stdout:8/163: creat db/d11/f3d x:0 0 0 2024-04-25T13:46:53.632 INFO:tasks.workunit.client.0.smithi043.stdout:8/164: fdatasync db/d11/f1d 0 2024-04-25T13:46:53.635 INFO:tasks.workunit.client.0.smithi043.stdout:8/165: creat db/d11/d1b/f3e x:0 0 0 2024-04-25T13:46:53.639 INFO:tasks.workunit.client.0.smithi043.stdout:8/166: rename db/c22 to db/dc/d28/c3f 0 2024-04-25T13:46:53.647 INFO:tasks.workunit.client.0.smithi043.stdout:8/167: truncate db/dc/d21/f25 3430274 0 2024-04-25T13:46:53.649 INFO:tasks.workunit.client.0.smithi043.stdout:8/168: mkdir db/d38/d40 0 2024-04-25T13:46:53.650 INFO:tasks.workunit.client.0.smithi043.stdout:8/169: dread - db/f35 zero size 2024-04-25T13:46:53.652 INFO:tasks.workunit.client.0.smithi043.stdout:8/170: symlink db/dc/l41 0 2024-04-25T13:46:55.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:54 smithi161 ceph-mon[32696]: pgmap v72: 129 pgs: 129 active+clean; 114 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 2.6 MiB/s wr, 216 op/s 2024-04-25T13:46:55.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:54 smithi175 ceph-mon[32649]: pgmap v72: 129 pgs: 129 active+clean; 114 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 2.6 MiB/s wr, 216 op/s 2024-04-25T13:46:55.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:54 smithi043 ceph-mon[29195]: pgmap v72: 129 pgs: 129 active+clean; 114 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 2.6 MiB/s wr, 216 op/s 2024-04-25T13:46:56.563 INFO:tasks.workunit.client.0.smithi043.stdout:2/0: sync 2024-04-25T13:46:56.563 INFO:tasks.workunit.client.0.smithi043.stdout:2/1: chown . 50420 1 2024-04-25T13:46:56.650 INFO:tasks.workunit.client.0.smithi043.stdout:7/44: sync 2024-04-25T13:46:56.650 INFO:tasks.workunit.client.0.smithi043.stdout:8/171: sync 2024-04-25T13:46:56.651 INFO:tasks.workunit.client.0.smithi043.stdout:1/4: sync 2024-04-25T13:46:56.651 INFO:tasks.workunit.client.0.smithi043.stdout:9/13: sync 2024-04-25T13:46:56.651 INFO:tasks.workunit.client.0.smithi043.stdout:0/5: sync 2024-04-25T13:46:56.651 INFO:tasks.workunit.client.0.smithi043.stdout:4/21: sync 2024-04-25T13:46:56.651 INFO:tasks.workunit.client.0.smithi043.stdout:6/5: sync 2024-04-25T13:46:56.651 INFO:tasks.workunit.client.0.smithi043.stdout:6/6: readlink - no filename 2024-04-25T13:46:56.651 INFO:tasks.workunit.client.0.smithi043.stdout:6/7: link - no file 2024-04-25T13:46:56.651 INFO:tasks.workunit.client.0.smithi043.stdout:6/8: write - no filename 2024-04-25T13:46:56.651 INFO:tasks.workunit.client.0.smithi043.stdout:5/3: sync 2024-04-25T13:46:56.651 INFO:tasks.workunit.client.0.smithi043.stdout:5/4: dread - no filename 2024-04-25T13:46:56.651 INFO:tasks.workunit.client.0.smithi043.stdout:5/5: dwrite - no filename 2024-04-25T13:46:56.651 INFO:tasks.workunit.client.0.smithi043.stdout:3/95: sync 2024-04-25T13:46:56.652 INFO:tasks.workunit.client.0.smithi043.stdout:9/14: chown d0 3428 1 2024-04-25T13:46:56.652 INFO:tasks.workunit.client.0.smithi043.stdout:7/45: write f3 [6023730,39546] 0 2024-04-25T13:46:56.654 INFO:tasks.workunit.client.0.smithi043.stdout:1/5: mknod c0 0 2024-04-25T13:46:56.656 INFO:tasks.workunit.client.0.smithi043.stdout:1/6: unlink c0 0 2024-04-25T13:46:56.658 INFO:tasks.workunit.client.0.smithi043.stdout:7/46: link d5/f7 d5/ff 0 2024-04-25T13:46:56.658 INFO:tasks.workunit.client.0.smithi043.stdout:1/7: mknod c1 0 2024-04-25T13:46:56.660 INFO:tasks.workunit.client.0.smithi043.stdout:7/47: unlink d5/f7 0 2024-04-25T13:46:56.662 INFO:tasks.workunit.client.0.smithi043.stdout:8/172: write db/f16 [4620014,88349] 0 2024-04-25T13:46:56.663 INFO:tasks.workunit.client.0.smithi043.stdout:1/8: creat f2 x:0 0 0 2024-04-25T13:46:56.664 INFO:tasks.workunit.client.0.smithi043.stdout:3/96: write d0/d9/f1e [494382,78135] 0 2024-04-25T13:46:56.665 INFO:tasks.workunit.client.0.smithi043.stdout:0/6: mknod c1 0 2024-04-25T13:46:56.669 INFO:tasks.workunit.client.0.smithi043.stdout:4/22: symlink d1/d3/l8 0 2024-04-25T13:46:56.669 INFO:tasks.workunit.client.0.smithi043.stdout:4/23: dread - no filename 2024-04-25T13:46:56.670 INFO:tasks.workunit.client.0.smithi043.stdout:9/15: creat d0/f4 x:0 0 0 2024-04-25T13:46:56.673 INFO:tasks.workunit.client.0.smithi043.stdout:1/9: creat f3 x:0 0 0 2024-04-25T13:46:56.674 INFO:tasks.workunit.client.0.smithi043.stdout:8/173: creat db/d11/d1b/d1e/f42 x:0 0 0 2024-04-25T13:46:56.676 INFO:tasks.workunit.client.0.smithi043.stdout:3/97: dwrite d0/da/f11 [0,4194304] 0 2024-04-25T13:46:56.676 INFO:tasks.workunit.client.0.smithi043.stdout:6/9: mkdir d0 0 2024-04-25T13:46:56.677 INFO:tasks.workunit.client.0.smithi043.stdout:0/7: rename c1 to c2 0 2024-04-25T13:46:56.677 INFO:tasks.workunit.client.0.smithi043.stdout:0/8: rmdir - no directory 2024-04-25T13:46:56.679 INFO:tasks.workunit.client.0.smithi043.stdout:5/6: creat d1/f2 x:0 0 0 2024-04-25T13:46:56.680 INFO:tasks.workunit.client.0.smithi043.stdout:4/24: unlink d1/d3/l7 0 2024-04-25T13:46:56.680 INFO:tasks.workunit.client.0.smithi043.stdout:4/25: dread - no filename 2024-04-25T13:46:56.680 INFO:tasks.workunit.client.0.smithi043.stdout:4/26: truncate - no filename 2024-04-25T13:46:56.680 INFO:tasks.workunit.client.0.smithi043.stdout:4/27: read - no filename 2024-04-25T13:46:56.680 INFO:tasks.workunit.client.0.smithi043.stdout:4/28: dread - no filename 2024-04-25T13:46:56.680 INFO:tasks.workunit.client.0.smithi043.stdout:4/29: dwrite - no filename 2024-04-25T13:46:56.684 INFO:tasks.workunit.client.0.smithi043.stdout:3/98: creat d0/d9/f20 x:0 0 0 2024-04-25T13:46:56.686 INFO:tasks.workunit.client.0.smithi043.stdout:6/10: symlink d0/l1 0 2024-04-25T13:46:56.688 INFO:tasks.workunit.client.0.smithi043.stdout:6/11: chown d0 164952688 1 2024-04-25T13:46:56.688 INFO:tasks.workunit.client.0.smithi043.stdout:4/30: creat d1/d3/f9 x:0 0 0 2024-04-25T13:46:56.688 INFO:tasks.workunit.client.0.smithi043.stdout:1/10: dwrite f3 [0,4194304] 0 2024-04-25T13:46:56.691 INFO:tasks.workunit.client.0.smithi043.stdout:3/99: write d0/d9/f20 [200059,39112] 0 2024-04-25T13:46:56.693 INFO:tasks.workunit.client.0.smithi043.stdout:1/11: write f2 [698546,69354] 0 2024-04-25T13:46:56.694 INFO:tasks.workunit.client.0.smithi043.stdout:6/12: mknod d0/c2 0 2024-04-25T13:46:56.696 INFO:tasks.workunit.client.0.smithi043.stdout:4/31: creat d1/d3/fa x:0 0 0 2024-04-25T13:46:56.697 INFO:tasks.workunit.client.0.smithi043.stdout:1/12: write f2 [1416957,39681] 0 2024-04-25T13:46:56.698 INFO:tasks.workunit.client.0.smithi043.stdout:8/174: dwrite f4 [4194304,4194304] 0 2024-04-25T13:46:56.699 INFO:tasks.workunit.client.0.smithi043.stdout:3/100: rename d0/c7 to d0/d13/c21 0 2024-04-25T13:46:56.699 INFO:tasks.workunit.client.0.smithi043.stdout:4/32: dread - d1/d3/fa zero size 2024-04-25T13:46:56.701 INFO:tasks.workunit.client.0.smithi043.stdout:6/13: creat d0/f3 x:0 0 0 2024-04-25T13:46:56.702 INFO:tasks.workunit.client.0.smithi043.stdout:6/14: chown d0/f3 261131942 1 2024-04-25T13:46:56.702 INFO:tasks.workunit.client.0.smithi043.stdout:1/13: creat f4 x:0 0 0 2024-04-25T13:46:56.703 INFO:tasks.workunit.client.0.smithi043.stdout:8/175: chown db/l1c 8497502 1 2024-04-25T13:46:56.704 INFO:tasks.workunit.client.0.smithi043.stdout:4/33: symlink d1/d3/lb 0 2024-04-25T13:46:56.704 INFO:tasks.workunit.client.0.smithi043.stdout:6/15: write d0/f3 [153982,44552] 0 2024-04-25T13:46:56.705 INFO:tasks.workunit.client.0.smithi043.stdout:1/14: mknod c5 0 2024-04-25T13:46:56.706 INFO:tasks.workunit.client.0.smithi043.stdout:4/34: dread - d1/d3/f9 zero size 2024-04-25T13:46:56.708 INFO:tasks.workunit.client.0.smithi043.stdout:6/16: truncate d0/f3 1012582 0 2024-04-25T13:46:56.708 INFO:tasks.workunit.client.0.smithi043.stdout:8/176: creat db/dc/d28/f43 x:0 0 0 2024-04-25T13:46:56.712 INFO:tasks.workunit.client.0.smithi043.stdout:8/177: write db/d11/f1d [848307,89995] 0 2024-04-25T13:46:56.713 INFO:tasks.workunit.client.0.smithi043.stdout:4/35: write d1/d3/f9 [134383,68536] 0 2024-04-25T13:46:56.717 INFO:tasks.workunit.client.0.smithi043.stdout:8/178: mkdir db/d44 0 2024-04-25T13:46:56.718 INFO:tasks.workunit.client.0.smithi043.stdout:4/36: mknod d1/cc 0 2024-04-25T13:46:56.718 INFO:tasks.workunit.client.0.smithi043.stdout:8/179: read db/dc/f23 [388294,92952] 0 2024-04-25T13:46:56.718 INFO:tasks.workunit.client.0.smithi043.stdout:6/17: dread d0/f3 [0,4194304] 0 2024-04-25T13:46:56.721 INFO:tasks.workunit.client.0.smithi043.stdout:4/37: creat d1/fd x:0 0 0 2024-04-25T13:46:56.724 INFO:tasks.workunit.client.0.smithi043.stdout:6/18: write d0/f3 [759029,61924] 0 2024-04-25T13:46:56.725 INFO:tasks.workunit.client.0.smithi043.stdout:4/38: mkdir d1/de 0 2024-04-25T13:46:56.726 INFO:tasks.workunit.client.0.smithi043.stdout:4/39: write d1/d3/fa [536328,26967] 0 2024-04-25T13:46:56.730 INFO:tasks.workunit.client.0.smithi043.stdout:8/180: dread db/fd [0,4194304] 0 2024-04-25T13:46:56.730 INFO:tasks.workunit.client.0.smithi043.stdout:4/40: read d1/d3/f9 [164172,79961] 0 2024-04-25T13:46:56.737 INFO:tasks.workunit.client.0.smithi043.stdout:6/19: dwrite d0/f3 [0,4194304] 0 2024-04-25T13:46:56.741 INFO:tasks.workunit.client.0.smithi043.stdout:6/20: creat d0/f4 x:0 0 0 2024-04-25T13:46:56.742 INFO:tasks.workunit.client.0.smithi043.stdout:6/21: fdatasync d0/f4 0 2024-04-25T13:46:56.742 INFO:tasks.workunit.client.0.smithi043.stdout:8/181: dwrite db/d11/d1b/f3e [0,4194304] 0 2024-04-25T13:46:56.744 INFO:tasks.workunit.client.0.smithi043.stdout:8/182: write db/d11/f3d [30601,45932] 0 2024-04-25T13:46:56.744 INFO:tasks.workunit.client.0.smithi043.stdout:2/2: sync 2024-04-25T13:46:56.749 INFO:tasks.workunit.client.0.smithi043.stdout:8/183: creat db/dc/f45 x:0 0 0 2024-04-25T13:46:56.749 INFO:tasks.workunit.client.0.smithi043.stdout:6/22: dread d0/f3 [0,4194304] 0 2024-04-25T13:46:56.749 INFO:tasks.workunit.client.0.smithi043.stdout:8/184: readlink db/dc/l29 0 2024-04-25T13:46:56.750 INFO:tasks.workunit.client.0.smithi043.stdout:2/3: mkdir d0 0 2024-04-25T13:46:56.750 INFO:tasks.workunit.client.0.smithi043.stdout:2/4: dread - no filename 2024-04-25T13:46:56.750 INFO:tasks.workunit.client.0.smithi043.stdout:2/5: dwrite - no filename 2024-04-25T13:46:56.752 INFO:tasks.workunit.client.0.smithi043.stdout:2/6: rename d0 to d0/d1 22 2024-04-25T13:46:56.752 INFO:tasks.workunit.client.0.smithi043.stdout:2/7: stat d0 0 2024-04-25T13:46:56.753 INFO:tasks.workunit.client.0.smithi043.stdout:2/8: stat d0 0 2024-04-25T13:46:56.753 INFO:tasks.workunit.client.0.smithi043.stdout:2/9: dwrite - no filename 2024-04-25T13:46:56.753 INFO:tasks.workunit.client.0.smithi043.stdout:2/10: truncate - no filename 2024-04-25T13:46:56.753 INFO:tasks.workunit.client.0.smithi043.stdout:8/185: truncate db/d11/f2a 342840 0 2024-04-25T13:46:56.754 INFO:tasks.workunit.client.0.smithi043.stdout:8/186: chown db/d11/d1b/d1e 54 1 2024-04-25T13:46:56.754 INFO:tasks.workunit.client.0.smithi043.stdout:6/23: rename d0/f3 to d0/f5 0 2024-04-25T13:46:56.756 INFO:tasks.workunit.client.0.smithi043.stdout:8/187: mkdir db/d46 0 2024-04-25T13:46:56.757 INFO:tasks.workunit.client.0.smithi043.stdout:2/11: symlink d0/l2 0 2024-04-25T13:46:56.758 INFO:tasks.workunit.client.0.smithi043.stdout:2/12: chown d0 3209 1 2024-04-25T13:46:56.758 INFO:tasks.workunit.client.0.smithi043.stdout:2/13: dread - no filename 2024-04-25T13:46:56.758 INFO:tasks.workunit.client.0.smithi043.stdout:2/14: read - no filename 2024-04-25T13:46:56.759 INFO:tasks.workunit.client.0.smithi043.stdout:6/24: dread d0/f5 [0,4194304] 0 2024-04-25T13:46:56.759 INFO:tasks.workunit.client.0.smithi043.stdout:8/188: creat db/d11/d1b/f47 x:0 0 0 2024-04-25T13:46:56.760 INFO:tasks.workunit.client.0.smithi043.stdout:6/25: chown d0/f4 0 1 2024-04-25T13:46:56.760 INFO:tasks.workunit.client.0.smithi043.stdout:2/15: symlink d0/l3 0 2024-04-25T13:46:56.761 INFO:tasks.workunit.client.0.smithi043.stdout:2/16: dread - no filename 2024-04-25T13:46:56.761 INFO:tasks.workunit.client.0.smithi043.stdout:2/17: chown d0 34144923 1 2024-04-25T13:46:56.761 INFO:tasks.workunit.client.0.smithi043.stdout:8/189: truncate db/dc/d21/f2e 1006742 0 2024-04-25T13:46:56.783 INFO:tasks.workunit.client.0.smithi043.stdout:7/48: truncate f4 82409 0 2024-04-25T13:46:56.788 INFO:tasks.workunit.client.0.smithi043.stdout:0/9: chown c2 244763557 1 2024-04-25T13:46:56.788 INFO:tasks.workunit.client.0.smithi043.stdout:0/10: truncate - no filename 2024-04-25T13:46:56.788 INFO:tasks.workunit.client.0.smithi043.stdout:0/11: fdatasync - no filename 2024-04-25T13:46:56.788 INFO:tasks.workunit.client.0.smithi043.stdout:0/12: write - no filename 2024-04-25T13:46:56.791 INFO:tasks.workunit.client.0.smithi043.stdout:0/13: link c0 c3 0 2024-04-25T13:46:56.791 INFO:tasks.workunit.client.0.smithi043.stdout:0/14: truncate - no filename 2024-04-25T13:46:56.791 INFO:tasks.workunit.client.0.smithi043.stdout:0/15: read - no filename 2024-04-25T13:46:56.791 INFO:tasks.workunit.client.0.smithi043.stdout:0/16: write - no filename 2024-04-25T13:46:56.794 INFO:tasks.workunit.client.0.smithi043.stdout:1/15: getdents . 0 2024-04-25T13:46:56.798 INFO:tasks.workunit.client.0.smithi043.stdout:1/16: dread f3 [0,4194304] 0 2024-04-25T13:46:56.799 INFO:tasks.workunit.client.0.smithi043.stdout:1/17: write f3 [3004701,126159] 0 2024-04-25T13:46:56.800 INFO:tasks.workunit.client.0.smithi043.stdout:4/41: getdents d1 0 2024-04-25T13:46:56.800 INFO:tasks.workunit.client.0.smithi043.stdout:4/42: chown d1/d3/fa 143492946 1 2024-04-25T13:46:56.802 INFO:tasks.workunit.client.0.smithi043.stdout:1/18: mknod c6 0 2024-04-25T13:46:56.805 INFO:tasks.workunit.client.0.smithi043.stdout:4/43: mkdir d1/de/df 0 2024-04-25T13:46:56.807 INFO:tasks.workunit.client.0.smithi043.stdout:6/26: unlink d0/f5 0 2024-04-25T13:46:56.808 INFO:tasks.workunit.client.0.smithi043.stdout:6/27: dread - d0/f4 zero size 2024-04-25T13:46:56.809 INFO:tasks.workunit.client.0.smithi043.stdout:6/28: chown d0 112 1 2024-04-25T13:46:56.809 INFO:tasks.workunit.client.0.smithi043.stdout:1/19: dwrite f3 [4194304,4194304] 0 2024-04-25T13:46:56.809 INFO:tasks.workunit.client.0.smithi043.stdout:1/20: readlink - no filename 2024-04-25T13:46:56.809 INFO:tasks.workunit.client.0.smithi043.stdout:1/21: truncate f2 1936614 0 2024-04-25T13:46:56.858 INFO:tasks.workunit.client.0.smithi043.stdout:8/190: truncate db/d11/f3d 33874 0 2024-04-25T13:46:56.858 INFO:tasks.workunit.client.0.smithi043.stdout:6/29: symlink d0/l6 0 2024-04-25T13:46:56.859 INFO:tasks.workunit.client.0.smithi043.stdout:4/44: link d1/d3/l8 d1/de/df/l10 0 2024-04-25T13:46:56.863 INFO:tasks.workunit.client.0.smithi043.stdout:4/45: mkdir d1/d11 0 2024-04-25T13:46:56.867 INFO:tasks.workunit.client.0.smithi043.stdout:7/49: creat d5/f10 x:0 0 0 2024-04-25T13:46:56.870 INFO:tasks.workunit.client.0.smithi043.stdout:1/22: dwrite f4 [0,4194304] 0 2024-04-25T13:46:56.873 INFO:tasks.workunit.client.0.smithi043.stdout:7/50: mkdir d5/d11 0 2024-04-25T13:46:56.873 INFO:tasks.workunit.client.0.smithi043.stdout:8/191: dwrite f4 [0,4194304] 0 2024-04-25T13:46:56.874 INFO:tasks.workunit.client.0.smithi043.stdout:4/46: dread d1/d3/f9 [0,4194304] 0 2024-04-25T13:46:56.874 INFO:tasks.workunit.client.0.smithi043.stdout:1/23: creat f7 x:0 0 0 2024-04-25T13:46:56.875 INFO:tasks.workunit.client.0.smithi043.stdout:6/30: dwrite d0/f4 [0,4194304] 0 2024-04-25T13:46:56.877 INFO:tasks.workunit.client.0.smithi043.stdout:7/51: fdatasync d5/fd 0 2024-04-25T13:46:56.879 INFO:tasks.workunit.client.0.smithi043.stdout:1/24: mknod c8 0 2024-04-25T13:46:56.879 INFO:tasks.workunit.client.0.smithi043.stdout:6/31: rmdir d0 39 2024-04-25T13:46:56.883 INFO:tasks.workunit.client.0.smithi043.stdout:1/25: rename f7 to f9 0 2024-04-25T13:46:56.886 INFO:tasks.workunit.client.0.smithi043.stdout:4/47: dread d1/d3/fa [0,4194304] 0 2024-04-25T13:46:56.892 INFO:tasks.workunit.client.0.smithi043.stdout:7/52: rename d5/f6 to d5/f12 0 2024-04-25T13:46:56.895 INFO:tasks.workunit.client.0.smithi043.stdout:7/53: read - d5/fe zero size 2024-04-25T13:46:56.897 INFO:tasks.workunit.client.0.smithi043.stdout:1/26: dread f2 [0,4194304] 0 2024-04-25T13:46:56.898 INFO:tasks.workunit.client.0.smithi043.stdout:6/32: fdatasync d0/f4 0 2024-04-25T13:46:56.899 INFO:tasks.workunit.client.0.smithi043.stdout:4/48: dwrite d1/fd [0,4194304] 0 2024-04-25T13:46:56.900 INFO:tasks.workunit.client.0.smithi043.stdout:1/27: unlink c1 0 2024-04-25T13:46:56.901 INFO:tasks.workunit.client.0.smithi043.stdout:6/33: mknod d0/c7 0 2024-04-25T13:46:56.902 INFO:tasks.workunit.client.0.smithi043.stdout:4/49: symlink d1/d3/l12 0 2024-04-25T13:46:56.903 INFO:tasks.workunit.client.0.smithi043.stdout:4/50: write d1/fd [193707,43812] 0 2024-04-25T13:46:56.903 INFO:tasks.workunit.client.0.smithi043.stdout:1/28: creat fa x:0 0 0 2024-04-25T13:46:56.904 INFO:tasks.workunit.client.0.smithi043.stdout:1/29: chown c5 318 1 2024-04-25T13:46:56.904 INFO:tasks.workunit.client.0.smithi043.stdout:6/34: mknod d0/c8 0 2024-04-25T13:46:56.904 INFO:tasks.workunit.client.0.smithi043.stdout:1/30: chown f4 6229 1 2024-04-25T13:46:56.905 INFO:tasks.workunit.client.0.smithi043.stdout:6/35: stat d0/c7 0 2024-04-25T13:46:56.906 INFO:tasks.workunit.client.0.smithi043.stdout:7/54: rename d5/c8 to d5/c13 0 2024-04-25T13:46:56.906 INFO:tasks.workunit.client.0.smithi043.stdout:4/51: stat d1/d3/l6 0 2024-04-25T13:46:56.906 INFO:tasks.workunit.client.0.smithi043.stdout:4/52: stat d1/d3/f9 0 2024-04-25T13:46:56.907 INFO:tasks.workunit.client.0.smithi043.stdout:1/31: mknod cb 0 2024-04-25T13:46:56.909 INFO:tasks.workunit.client.0.smithi043.stdout:6/36: unlink d0/c7 0 2024-04-25T13:46:56.911 INFO:tasks.workunit.client.0.smithi043.stdout:6/37: read d0/f4 [1960986,73649] 0 2024-04-25T13:46:56.911 INFO:tasks.workunit.client.0.smithi043.stdout:4/53: mknod d1/c13 0 2024-04-25T13:46:56.914 INFO:tasks.workunit.client.0.smithi043.stdout:7/55: rename d5/ff to d5/d11/f14 0 2024-04-25T13:46:56.915 INFO:tasks.workunit.client.0.smithi043.stdout:6/38: symlink d0/l9 0 2024-04-25T13:46:56.916 INFO:tasks.workunit.client.0.smithi043.stdout:6/39: stat d0/l1 0 2024-04-25T13:46:56.917 INFO:tasks.workunit.client.0.smithi043.stdout:1/32: dwrite f3 [0,4194304] 0 2024-04-25T13:46:56.922 INFO:tasks.workunit.client.0.smithi043.stdout:1/33: creat fc x:0 0 0 2024-04-25T13:46:56.922 INFO:tasks.workunit.client.0.smithi043.stdout:4/54: getdents d1/de 0 2024-04-25T13:46:56.923 INFO:tasks.workunit.client.0.smithi043.stdout:1/34: chown f2 113 1 2024-04-25T13:46:56.924 INFO:tasks.workunit.client.0.smithi043.stdout:6/40: truncate d0/f4 1412992 0 2024-04-25T13:46:56.926 INFO:tasks.workunit.client.0.smithi043.stdout:7/56: rename f3 to d5/f15 0 2024-04-25T13:46:56.926 INFO:tasks.workunit.client.0.smithi043.stdout:7/57: chown d5/fe 11 1 2024-04-25T13:46:56.927 INFO:tasks.workunit.client.0.smithi043.stdout:7/58: fsync d5/f10 0 2024-04-25T13:46:56.929 INFO:tasks.workunit.client.0.smithi043.stdout:1/35: mknod cd 0 2024-04-25T13:46:56.930 INFO:tasks.workunit.client.0.smithi043.stdout:1/36: write fc [249293,81861] 0 2024-04-25T13:46:56.930 INFO:tasks.workunit.client.0.smithi043.stdout:1/37: chown c8 6921 1 2024-04-25T13:46:56.931 INFO:tasks.workunit.client.0.smithi043.stdout:6/41: mknod d0/ca 0 2024-04-25T13:46:56.932 INFO:tasks.workunit.client.0.smithi043.stdout:6/42: chown d0/l6 11 1 2024-04-25T13:46:56.933 INFO:tasks.workunit.client.0.smithi043.stdout:7/59: symlink d5/d11/l16 0 2024-04-25T13:46:56.936 INFO:tasks.workunit.client.0.smithi043.stdout:1/38: dread f4 [0,4194304] 0 2024-04-25T13:46:56.940 INFO:tasks.workunit.client.0.smithi043.stdout:1/39: rename f4 to fe 0 2024-04-25T13:46:56.941 INFO:tasks.workunit.client.0.smithi043.stdout:3/101: sync 2024-04-25T13:46:56.941 INFO:tasks.workunit.client.0.smithi043.stdout:9/16: sync 2024-04-25T13:46:56.941 INFO:tasks.workunit.client.0.smithi043.stdout:5/7: sync 2024-04-25T13:46:56.942 INFO:tasks.workunit.client.0.smithi043.stdout:4/55: truncate d1/fd 530689 0 2024-04-25T13:46:56.942 INFO:tasks.workunit.client.0.smithi043.stdout:1/40: mkdir df 0 2024-04-25T13:46:56.943 INFO:tasks.workunit.client.0.smithi043.stdout:5/8: chown d1/f2 900693 1 2024-04-25T13:46:56.943 INFO:tasks.workunit.client.0.smithi043.stdout:9/17: write d0/f4 [379714,6345] 0 2024-04-25T13:46:56.943 INFO:tasks.workunit.client.0.smithi043.stdout:3/102: truncate d0/f1d 432030 0 2024-04-25T13:46:56.944 INFO:tasks.workunit.client.0.smithi043.stdout:1/41: chown c6 8273009 1 2024-04-25T13:46:56.945 INFO:tasks.workunit.client.0.smithi043.stdout:4/56: unlink d1/d3/fa 0 2024-04-25T13:46:56.945 INFO:tasks.workunit.client.0.smithi043.stdout:1/42: stat cb 0 2024-04-25T13:46:56.946 INFO:tasks.workunit.client.0.smithi043.stdout:5/9: mkdir d1/d3 0 2024-04-25T13:46:56.948 INFO:tasks.workunit.client.0.smithi043.stdout:9/18: fsync d0/f4 0 2024-04-25T13:46:56.948 INFO:tasks.workunit.client.0.smithi043.stdout:3/103: read - d0/d9/d15/f1f zero size 2024-04-25T13:46:56.951 INFO:tasks.workunit.client.0.smithi043.stdout:5/10: unlink l0 0 2024-04-25T13:46:56.953 INFO:tasks.workunit.client.0.smithi043.stdout:4/57: dread d1/d3/f9 [0,4194304] 0 2024-04-25T13:46:56.954 INFO:tasks.workunit.client.0.smithi043.stdout:3/104: creat d0/d14/f22 x:0 0 0 2024-04-25T13:46:56.955 INFO:tasks.workunit.client.0.smithi043.stdout:1/43: mkdir df/d10 0 2024-04-25T13:46:56.956 INFO:tasks.workunit.client.0.smithi043.stdout:5/11: mkdir d1/d4 0 2024-04-25T13:46:56.958 INFO:tasks.workunit.client.0.smithi043.stdout:6/43: dwrite d0/f4 [0,4194304] 0 2024-04-25T13:46:56.960 INFO:tasks.workunit.client.0.smithi043.stdout:7/60: dwrite d5/d11/f14 [0,4194304] 0 2024-04-25T13:46:56.960 INFO:tasks.workunit.client.0.smithi043.stdout:1/44: creat df/f11 x:0 0 0 2024-04-25T13:46:56.960 INFO:tasks.workunit.client.0.smithi043.stdout:5/12: chown d1/f2 40764581 1 2024-04-25T13:46:56.960 INFO:tasks.workunit.client.0.smithi043.stdout:4/58: truncate d1/d3/f9 1224554 0 2024-04-25T13:46:56.963 INFO:tasks.workunit.client.0.smithi043.stdout:7/61: chown d5/fd 180942287 1 2024-04-25T13:46:56.964 INFO:tasks.workunit.client.0.smithi043.stdout:5/13: write d1/f2 [52316,16503] 0 2024-04-25T13:46:56.967 INFO:tasks.workunit.client.0.smithi043.stdout:1/45: dread fc [0,4194304] 0 2024-04-25T13:46:56.967 INFO:tasks.workunit.client.0.smithi043.stdout:9/19: dwrite d0/f4 [0,4194304] 0 2024-04-25T13:46:56.968 INFO:tasks.workunit.client.0.smithi043.stdout:3/105: truncate d0/fe 158175 0 2024-04-25T13:46:56.969 INFO:tasks.workunit.client.0.smithi043.stdout:4/59: write d1/fd [734020,16493] 0 2024-04-25T13:46:56.970 INFO:tasks.workunit.client.0.smithi043.stdout:5/14: dread d1/f2 [0,4194304] 0 2024-04-25T13:46:56.975 INFO:tasks.workunit.client.0.smithi043.stdout:7/62: creat d5/f17 x:0 0 0 2024-04-25T13:46:56.978 INFO:tasks.workunit.client.0.smithi043.stdout:1/46: creat df/d10/f12 x:0 0 0 2024-04-25T13:46:56.981 INFO:tasks.workunit.client.0.smithi043.stdout:4/60: dread d1/fd [0,4194304] 0 2024-04-25T13:46:56.983 INFO:tasks.workunit.client.0.smithi043.stdout:7/63: chown d5/f15 4326665 1 2024-04-25T13:46:56.983 INFO:tasks.workunit.client.0.smithi043.stdout:7/64: readlink d5/d11/l16 0 2024-04-25T13:46:56.984 INFO:tasks.workunit.client.0.smithi043.stdout:3/106: read d0/fe [153974,71274] 0 2024-04-25T13:46:56.984 INFO:tasks.workunit.client.0.smithi043.stdout:5/15: mkdir d1/d4/d5 0 2024-04-25T13:46:56.984 INFO:tasks.workunit.client.0.smithi043.stdout:5/16: stat d1 0 2024-04-25T13:46:56.985 INFO:tasks.workunit.client.0.smithi043.stdout:9/20: truncate d0/f4 2900859 0 2024-04-25T13:46:56.986 INFO:tasks.workunit.client.0.smithi043.stdout:6/44: fsync d0/f4 0 2024-04-25T13:46:56.988 INFO:tasks.workunit.client.0.smithi043.stdout:3/107: creat d0/d9/f23 x:0 0 0 2024-04-25T13:46:56.988 INFO:tasks.workunit.client.0.smithi043.stdout:6/45: write d0/f4 [1810611,51929] 0 2024-04-25T13:46:56.989 INFO:tasks.workunit.client.0.smithi043.stdout:9/21: creat d0/f5 x:0 0 0 2024-04-25T13:46:56.991 INFO:tasks.workunit.client.0.smithi043.stdout:7/65: creat d5/f18 x:0 0 0 2024-04-25T13:46:56.995 INFO:tasks.workunit.client.0.smithi043.stdout:1/47: getdents df 0 2024-04-25T13:46:56.995 INFO:tasks.workunit.client.0.smithi043.stdout:7/66: stat f4 0 2024-04-25T13:46:56.995 INFO:tasks.workunit.client.0.smithi043.stdout:9/22: mkdir d0/d6 0 2024-04-25T13:46:56.997 INFO:tasks.workunit.client.0.smithi043.stdout:6/46: write d0/f4 [4354684,113443] 0 2024-04-25T13:46:57.000 INFO:tasks.workunit.client.0.smithi043.stdout:6/47: chown d0 0 1 2024-04-25T13:46:57.003 INFO:tasks.workunit.client.0.smithi043.stdout:9/23: fsync d0/f4 0 2024-04-25T13:46:57.006 INFO:tasks.workunit.client.0.smithi043.stdout:4/61: dwrite d1/fd [0,4194304] 0 2024-04-25T13:46:57.008 INFO:tasks.workunit.client.0.smithi043.stdout:9/24: fdatasync d0/f4 0 2024-04-25T13:46:57.011 INFO:tasks.workunit.client.0.smithi043.stdout:3/108: dwrite d0/f3 [0,4194304] 0 2024-04-25T13:46:57.011 INFO:tasks.workunit.client.0.smithi043.stdout:5/17: dwrite d1/f2 [0,4194304] 0 2024-04-25T13:46:57.016 INFO:tasks.workunit.client.0.smithi043.stdout:9/25: mkdir d0/d6/d7 0 2024-04-25T13:46:57.017 INFO:tasks.workunit.client.0.smithi043.stdout:3/109: fdatasync d0/d9/f23 0 2024-04-25T13:46:57.018 INFO:tasks.workunit.client.0.smithi043.stdout:5/18: unlink d1/f2 0 2024-04-25T13:46:57.018 INFO:tasks.workunit.client.0.smithi043.stdout:5/19: dwrite - no filename 2024-04-25T13:46:57.019 INFO:tasks.workunit.client.0.smithi043.stdout:4/62: dread d1/d3/f9 [0,4194304] 0 2024-04-25T13:46:57.020 INFO:tasks.workunit.client.0.smithi043.stdout:7/67: dwrite d5/f12 [0,4194304] 0 2024-04-25T13:46:57.020 INFO:tasks.workunit.client.0.smithi043.stdout:9/26: write d0/f4 [1306604,111479] 0 2024-04-25T13:46:57.020 INFO:tasks.workunit.client.0.smithi043.stdout:6/48: dread d0/f4 [0,4194304] 0 2024-04-25T13:46:57.024 INFO:tasks.workunit.client.0.smithi043.stdout:5/20: creat d1/d4/f6 x:0 0 0 2024-04-25T13:46:57.024 INFO:tasks.workunit.client.0.smithi043.stdout:3/110: truncate d0/d9/f23 76217 0 2024-04-25T13:46:57.025 INFO:tasks.workunit.client.0.smithi043.stdout:4/63: creat d1/f14 x:0 0 0 2024-04-25T13:46:57.027 INFO:tasks.workunit.client.0.smithi043.stdout:6/49: creat d0/fb x:0 0 0 2024-04-25T13:46:57.028 INFO:tasks.workunit.client.0.smithi043.stdout:7/68: creat d5/d11/f19 x:0 0 0 2024-04-25T13:46:57.029 INFO:tasks.workunit.client.0.smithi043.stdout:3/111: readlink d0/l8 0 2024-04-25T13:46:57.030 INFO:tasks.workunit.client.0.smithi043.stdout:2/18: sync 2024-04-25T13:46:57.030 INFO:tasks.workunit.client.0.smithi043.stdout:0/17: sync 2024-04-25T13:46:57.033 INFO:tasks.workunit.client.0.smithi043.stdout:4/64: creat d1/d3/f15 x:0 0 0 2024-04-25T13:46:57.035 INFO:tasks.workunit.client.0.smithi043.stdout:6/50: creat d0/fc x:0 0 0 2024-04-25T13:46:57.035 INFO:tasks.workunit.client.0.smithi043.stdout:5/21: mkdir d1/d3/d7 0 2024-04-25T13:46:57.037 INFO:tasks.workunit.client.0.smithi043.stdout:0/18: symlink l4 0 2024-04-25T13:46:57.038 INFO:tasks.workunit.client.0.smithi043.stdout:2/19: creat d0/f4 x:0 0 0 2024-04-25T13:46:57.038 INFO:tasks.workunit.client.0.smithi043.stdout:9/27: link d0/l2 d0/l8 0 2024-04-25T13:46:57.039 INFO:tasks.workunit.client.0.smithi043.stdout:6/51: symlink d0/ld 0 2024-04-25T13:46:57.040 INFO:tasks.workunit.client.0.smithi043.stdout:9/28: stat d0/f5 0 2024-04-25T13:46:57.041 INFO:tasks.workunit.client.0.smithi043.stdout:3/112: unlink d0/d13/c21 0 2024-04-25T13:46:57.043 INFO:tasks.workunit.client.0.smithi043.stdout:2/20: write d0/f4 [162830,75907] 0 2024-04-25T13:46:57.043 INFO:tasks.workunit.client.0.smithi043.stdout:6/52: read - d0/fb zero size 2024-04-25T13:46:57.045 INFO:tasks.workunit.client.0.smithi043.stdout:0/19: chown c0 540 1 2024-04-25T13:46:57.045 INFO:tasks.workunit.client.0.smithi043.stdout:0/20: dread - no filename 2024-04-25T13:46:57.046 INFO:tasks.workunit.client.0.smithi043.stdout:9/29: write d0/f4 [179125,77706] 0 2024-04-25T13:46:57.049 INFO:tasks.workunit.client.0.smithi043.stdout:4/65: dwrite d1/d3/f15 [0,4194304] 0 2024-04-25T13:46:57.049 INFO:tasks.workunit.client.0.smithi043.stdout:7/69: getdents d5/d11 0 2024-04-25T13:46:57.051 INFO:tasks.workunit.client.0.smithi043.stdout:3/113: symlink d0/d14/l24 0 2024-04-25T13:46:57.053 INFO:tasks.workunit.client.0.smithi043.stdout:9/30: write d0/f5 [4192,53564] 0 2024-04-25T13:46:57.055 INFO:tasks.workunit.client.0.smithi043.stdout:7/70: write d5/f10 [958071,50292] 0 2024-04-25T13:46:57.058 INFO:tasks.workunit.client.0.smithi043.stdout:0/21: rename l4 to l5 0 2024-04-25T13:46:57.058 INFO:tasks.workunit.client.0.smithi043.stdout:0/22: dwrite - no filename 2024-04-25T13:46:57.058 INFO:tasks.workunit.client.0.smithi043.stdout:0/23: write - no filename 2024-04-25T13:46:57.058 INFO:tasks.workunit.client.0.smithi043.stdout:5/22: dwrite d1/d4/f6 [0,4194304] 0 2024-04-25T13:46:57.061 INFO:tasks.workunit.client.0.smithi043.stdout:0/24: chown c3 6609598 1 2024-04-25T13:46:57.062 INFO:tasks.workunit.client.0.smithi043.stdout:3/114: mknod d0/da/c25 0 2024-04-25T13:46:57.065 INFO:tasks.workunit.client.0.smithi043.stdout:6/53: link d0/f4 d0/fe 0 2024-04-25T13:46:57.066 INFO:tasks.workunit.client.0.smithi043.stdout:3/115: stat d0/da/l1b 0 2024-04-25T13:46:57.067 INFO:tasks.workunit.client.0.smithi043.stdout:0/25: creat f6 x:0 0 0 2024-04-25T13:46:57.070 INFO:tasks.workunit.client.0.smithi043.stdout:3/116: stat d0/da/c25 0 2024-04-25T13:46:57.070 INFO:tasks.workunit.client.0.smithi043.stdout:2/21: dwrite d0/f4 [0,4194304] 0 2024-04-25T13:46:57.070 INFO:tasks.workunit.client.0.smithi043.stdout:7/71: symlink d5/l1a 0 2024-04-25T13:46:57.071 INFO:tasks.workunit.client.0.smithi043.stdout:9/31: dread d0/f4 [0,4194304] 0 2024-04-25T13:46:57.071 INFO:tasks.workunit.client.0.smithi043.stdout:0/26: write f6 [158406,36821] 0 2024-04-25T13:46:57.073 INFO:tasks.workunit.client.0.smithi043.stdout:5/23: mkdir d1/d3/d7/d8 0 2024-04-25T13:46:57.073 INFO:tasks.workunit.client.0.smithi043.stdout:4/66: dwrite d1/f14 [0,4194304] 0 2024-04-25T13:46:57.075 INFO:tasks.workunit.client.0.smithi043.stdout:7/72: write d5/d11/f19 [265268,124200] 0 2024-04-25T13:46:57.077 INFO:tasks.workunit.client.0.smithi043.stdout:2/22: write d0/f4 [2674342,76962] 0 2024-04-25T13:46:57.080 INFO:tasks.workunit.client.0.smithi043.stdout:9/32: creat d0/d6/f9 x:0 0 0 2024-04-25T13:46:57.080 INFO:tasks.workunit.client.0.smithi043.stdout:0/27: read f6 [71385,127615] 0 2024-04-25T13:46:57.080 INFO:tasks.workunit.client.0.smithi043.stdout:5/24: unlink d1/d4/f6 0 2024-04-25T13:46:57.081 INFO:tasks.workunit.client.0.smithi043.stdout:5/25: truncate - no filename 2024-04-25T13:46:57.081 INFO:tasks.workunit.client.0.smithi043.stdout:9/33: chown d0/f4 25523299 1 2024-04-25T13:46:57.083 INFO:tasks.workunit.client.0.smithi043.stdout:7/73: creat d5/d11/f1b x:0 0 0 2024-04-25T13:46:57.085 INFO:tasks.workunit.client.0.smithi043.stdout:3/117: rename d0/da/l10 to d0/d9/d15/l26 0 2024-04-25T13:46:57.087 INFO:tasks.workunit.client.0.smithi043.stdout:0/28: creat f7 x:0 0 0 2024-04-25T13:46:57.088 INFO:tasks.workunit.client.0.smithi043.stdout:5/26: mkdir d1/d3/d7/d9 0 2024-04-25T13:46:57.091 INFO:tasks.workunit.client.0.smithi043.stdout:6/54: getdents d0 0 2024-04-25T13:46:57.091 INFO:tasks.workunit.client.0.smithi043.stdout:9/34: dread d0/f5 [0,4194304] 0 2024-04-25T13:46:57.092 INFO:tasks.workunit.client.0.smithi043.stdout:4/67: creat d1/de/df/f16 x:0 0 0 2024-04-25T13:46:57.093 INFO:tasks.workunit.client.0.smithi043.stdout:3/118: creat d0/d13/f27 x:0 0 0 2024-04-25T13:46:57.094 INFO:tasks.workunit.client.0.smithi043.stdout:2/23: dwrite d0/f4 [4194304,4194304] 0 2024-04-25T13:46:57.095 INFO:tasks.workunit.client.0.smithi043.stdout:0/29: chown l5 10655 1 2024-04-25T13:46:57.096 INFO:tasks.workunit.client.0.smithi043.stdout:0/30: rmdir - no directory 2024-04-25T13:46:57.097 INFO:tasks.workunit.client.0.smithi043.stdout:6/55: creat d0/ff x:0 0 0 2024-04-25T13:46:57.099 INFO:tasks.workunit.client.0.smithi043.stdout:6/56: chown d0/fc 59 1 2024-04-25T13:46:57.100 INFO:tasks.workunit.client.0.smithi043.stdout:3/119: creat d0/da/f28 x:0 0 0 2024-04-25T13:46:57.102 INFO:tasks.workunit.client.0.smithi043.stdout:2/24: mkdir d0/d5 0 2024-04-25T13:46:57.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:56 smithi161 ceph-mon[32696]: pgmap v73: 129 pgs: 129 active+clean; 114 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 2.6 MiB/s wr, 216 op/s 2024-04-25T13:46:57.102 INFO:tasks.workunit.client.0.smithi043.stdout:7/74: dwrite d5/d11/f1b [0,4194304] 0 2024-04-25T13:46:57.105 INFO:tasks.workunit.client.0.smithi043.stdout:7/75: dread - d5/fe zero size 2024-04-25T13:46:57.105 INFO:tasks.workunit.client.0.smithi043.stdout:2/25: read d0/f4 [2597099,107763] 0 2024-04-25T13:46:57.105 INFO:tasks.workunit.client.0.smithi043.stdout:6/57: unlink d0/c2 0 2024-04-25T13:46:57.108 INFO:tasks.workunit.client.0.smithi043.stdout:4/68: rmdir d1/d11 0 2024-04-25T13:46:57.110 INFO:tasks.workunit.client.0.smithi043.stdout:9/35: dwrite d0/f5 [0,4194304] 0 2024-04-25T13:46:57.113 INFO:tasks.workunit.client.0.smithi043.stdout:7/76: dread d5/f12 [0,4194304] 0 2024-04-25T13:46:57.114 INFO:tasks.workunit.client.0.smithi043.stdout:4/69: dread d1/d3/f15 [0,4194304] 0 2024-04-25T13:46:57.115 INFO:tasks.workunit.client.0.smithi043.stdout:4/70: write d1/f14 [4919898,47022] 0 2024-04-25T13:46:57.116 INFO:tasks.workunit.client.0.smithi043.stdout:2/26: symlink d0/l6 0 2024-04-25T13:46:57.121 INFO:tasks.workunit.client.0.smithi043.stdout:4/71: fdatasync d1/f14 0 2024-04-25T13:46:57.123 INFO:tasks.workunit.client.0.smithi043.stdout:0/31: getdents . 0 2024-04-25T13:46:57.124 INFO:tasks.workunit.client.0.smithi043.stdout:0/32: chown f6 395 1 2024-04-25T13:46:57.126 INFO:tasks.workunit.client.0.smithi043.stdout:9/36: creat d0/d6/fa x:0 0 0 2024-04-25T13:46:57.126 INFO:tasks.workunit.client.0.smithi043.stdout:4/72: dread d1/f14 [0,4194304] 0 2024-04-25T13:46:57.133 INFO:tasks.workunit.client.0.smithi043.stdout:2/27: write d0/f4 [401296,23730] 0 2024-04-25T13:46:57.134 INFO:tasks.workunit.client.0.smithi043.stdout:3/120: truncate d0/d9/f1e 383683 0 2024-04-25T13:46:57.135 INFO:tasks.workunit.client.0.smithi043.stdout:0/33: creat f8 x:0 0 0 2024-04-25T13:46:57.137 INFO:tasks.workunit.client.0.smithi043.stdout:9/37: rename d0/f5 to d0/d6/fb 0 2024-04-25T13:46:57.138 INFO:tasks.workunit.client.0.smithi043.stdout:4/73: fsync d1/d3/f9 0 2024-04-25T13:46:57.138 INFO:tasks.workunit.client.0.smithi043.stdout:2/28: rmdir d0 39 2024-04-25T13:46:57.138 INFO:tasks.workunit.client.0.smithi043.stdout:3/121: dread d0/da/f11 [0,4194304] 0 2024-04-25T13:46:57.141 INFO:tasks.workunit.client.0.smithi043.stdout:9/38: readlink d0/l8 0 2024-04-25T13:46:57.143 INFO:tasks.workunit.client.0.smithi043.stdout:7/77: creat d5/f1c x:0 0 0 2024-04-25T13:46:57.144 INFO:tasks.workunit.client.0.smithi043.stdout:3/122: dread d0/f2 [0,4194304] 0 2024-04-25T13:46:57.145 INFO:tasks.workunit.client.0.smithi043.stdout:4/74: mknod d1/c17 0 2024-04-25T13:46:57.147 INFO:tasks.workunit.client.0.smithi043.stdout:6/58: getdents d0 0 2024-04-25T13:46:57.148 INFO:tasks.workunit.client.0.smithi043.stdout:6/59: read - d0/fc zero size 2024-04-25T13:46:57.149 INFO:tasks.workunit.client.0.smithi043.stdout:6/60: stat d0/l1 0 2024-04-25T13:46:57.150 INFO:tasks.workunit.client.0.smithi043.stdout:0/34: dwrite f7 [0,4194304] 0 2024-04-25T13:46:57.151 INFO:tasks.workunit.client.0.smithi043.stdout:6/61: dread - d0/fc zero size 2024-04-25T13:46:57.151 INFO:tasks.workunit.client.0.smithi043.stdout:9/39: write d0/f4 [1263060,19898] 0 2024-04-25T13:46:57.152 INFO:tasks.workunit.client.0.smithi043.stdout:6/62: dread - d0/fb zero size 2024-04-25T13:46:57.152 INFO:tasks.workunit.client.0.smithi043.stdout:3/123: creat d0/d14/f29 x:0 0 0 2024-04-25T13:46:57.153 INFO:tasks.workunit.client.0.smithi043.stdout:6/63: readlink d0/l9 0 2024-04-25T13:46:57.153 INFO:tasks.workunit.client.0.smithi043.stdout:4/75: creat d1/de/df/f18 x:0 0 0 2024-04-25T13:46:57.154 INFO:tasks.workunit.client.0.smithi043.stdout:2/29: creat d0/f7 x:0 0 0 2024-04-25T13:46:57.157 INFO:tasks.workunit.client.0.smithi043.stdout:7/78: symlink d5/l1d 0 2024-04-25T13:46:57.157 INFO:tasks.workunit.client.0.smithi043.stdout:0/35: read f6 [72102,92275] 0 2024-04-25T13:46:57.158 INFO:tasks.workunit.client.0.smithi043.stdout:9/40: mkdir d0/d6/dc 0 2024-04-25T13:46:57.159 INFO:tasks.workunit.client.0.smithi043.stdout:4/76: creat d1/f19 x:0 0 0 2024-04-25T13:46:57.161 INFO:tasks.workunit.client.0.smithi043.stdout:2/30: mkdir d0/d8 0 2024-04-25T13:46:57.162 INFO:tasks.workunit.client.0.smithi043.stdout:0/36: write f8 [321454,70079] 0 2024-04-25T13:46:57.164 INFO:tasks.workunit.client.0.smithi043.stdout:3/124: creat d0/f2a x:0 0 0 2024-04-25T13:46:57.166 INFO:tasks.workunit.client.0.smithi043.stdout:9/41: fdatasync d0/d6/fb 0 2024-04-25T13:46:57.167 INFO:tasks.workunit.client.0.smithi043.stdout:6/64: dwrite d0/fc [0,4194304] 0 2024-04-25T13:46:57.168 INFO:tasks.workunit.client.0.smithi043.stdout:4/77: mkdir d1/de/df/d1a 0 2024-04-25T13:46:57.170 INFO:tasks.workunit.client.0.smithi043.stdout:2/31: symlink d0/d5/l9 0 2024-04-25T13:46:57.170 INFO:tasks.workunit.client.0.smithi043.stdout:7/79: dread d5/fd [0,4194304] 0 2024-04-25T13:46:57.171 INFO:tasks.workunit.client.0.smithi043.stdout:2/32: write d0/f7 [991717,58542] 0 2024-04-25T13:46:57.173 INFO:tasks.workunit.client.0.smithi043.stdout:0/37: creat f9 x:0 0 0 2024-04-25T13:46:57.174 INFO:tasks.workunit.client.0.smithi043.stdout:6/65: rmdir d0 39 2024-04-25T13:46:57.175 INFO:tasks.workunit.client.0.smithi043.stdout:3/125: rmdir d0 39 2024-04-25T13:46:57.177 INFO:tasks.workunit.client.0.smithi043.stdout:6/66: fdatasync d0/fb 0 2024-04-25T13:46:57.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:56 smithi175 ceph-mon[32649]: pgmap v73: 129 pgs: 129 active+clean; 114 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 2.6 MiB/s wr, 216 op/s 2024-04-25T13:46:57.180 INFO:tasks.workunit.client.0.smithi043.stdout:7/80: dwrite d5/f1c [0,4194304] 0 2024-04-25T13:46:57.182 INFO:tasks.workunit.client.0.smithi043.stdout:7/81: write d5/f10 [611059,95257] 0 2024-04-25T13:46:57.182 INFO:tasks.workunit.client.0.smithi043.stdout:9/42: link d0/f4 d0/d6/d7/fd 0 2024-04-25T13:46:57.182 INFO:tasks.workunit.client.0.smithi043.stdout:0/38: dread f8 [0,4194304] 0 2024-04-25T13:46:57.183 INFO:tasks.workunit.client.0.smithi043.stdout:6/67: mknod d0/c10 0 2024-04-25T13:46:57.183 INFO:tasks.workunit.client.0.smithi043.stdout:7/82: chown d5/f10 5 1 2024-04-25T13:46:57.184 INFO:tasks.workunit.client.0.smithi043.stdout:4/78: getdents d1/de 0 2024-04-25T13:46:57.184 INFO:tasks.workunit.client.0.smithi043.stdout:6/68: chown d0/fe 36496 1 2024-04-25T13:46:57.185 INFO:tasks.workunit.client.0.smithi043.stdout:4/79: fdatasync d1/de/df/f16 0 2024-04-25T13:46:57.187 INFO:tasks.workunit.client.0.smithi043.stdout:4/80: chown d1/d3/l6 3948 1 2024-04-25T13:46:57.190 INFO:tasks.workunit.client.0.smithi043.stdout:4/81: chown d1/c2 2 1 2024-04-25T13:46:57.191 INFO:tasks.workunit.client.0.smithi043.stdout:9/43: symlink d0/le 0 2024-04-25T13:46:57.192 INFO:tasks.workunit.client.0.smithi043.stdout:2/33: truncate d0/f7 663622 0 2024-04-25T13:46:57.194 INFO:tasks.workunit.client.0.smithi043.stdout:6/69: dwrite d0/fc [0,4194304] 0 2024-04-25T13:46:57.194 INFO:tasks.workunit.client.0.smithi043.stdout:3/126: rmdir d0/d9/d15 39 2024-04-25T13:46:57.195 INFO:tasks.workunit.client.0.smithi043.stdout:6/70: dread - d0/fb zero size 2024-04-25T13:46:57.196 INFO:tasks.workunit.client.0.smithi043.stdout:0/39: symlink la 0 2024-04-25T13:46:57.196 INFO:tasks.workunit.client.0.smithi043.stdout:3/127: read d0/da/f11 [1633405,13523] 0 2024-04-25T13:46:57.197 INFO:tasks.workunit.client.0.smithi043.stdout:8/192: sync 2024-04-25T13:46:57.204 INFO:tasks.workunit.client.0.smithi043.stdout:6/71: rename d0/c10 to d0/c11 0 2024-04-25T13:46:57.205 INFO:tasks.workunit.client.0.smithi043.stdout:7/83: creat d5/f1e x:0 0 0 2024-04-25T13:46:57.206 INFO:tasks.workunit.client.0.smithi043.stdout:7/84: truncate d5/fd 4702178 0 2024-04-25T13:46:57.208 INFO:tasks.workunit.client.0.smithi043.stdout:8/193: creat db/dc/f48 x:0 0 0 2024-04-25T13:46:57.209 INFO:tasks.workunit.client.0.smithi043.stdout:8/194: chown db/le 103129 1 2024-04-25T13:46:57.210 INFO:tasks.workunit.client.0.smithi043.stdout:0/40: mkdir db 0 2024-04-25T13:46:57.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:56 smithi043 ceph-mon[29195]: pgmap v73: 129 pgs: 129 active+clean; 114 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 2.6 MiB/s wr, 216 op/s 2024-04-25T13:46:57.213 INFO:tasks.workunit.client.0.smithi043.stdout:6/72: unlink d0/l6 0 2024-04-25T13:46:57.214 INFO:tasks.workunit.client.0.smithi043.stdout:7/85: creat d5/d11/f1f x:0 0 0 2024-04-25T13:46:57.215 INFO:tasks.workunit.client.0.smithi043.stdout:6/73: chown d0/l9 18368 1 2024-04-25T13:46:57.215 INFO:tasks.workunit.client.0.smithi043.stdout:7/86: chown d5/f18 1008571 1 2024-04-25T13:46:57.216 INFO:tasks.workunit.client.0.smithi043.stdout:8/195: mkdir db/d38/d49 0 2024-04-25T13:46:57.216 INFO:tasks.workunit.client.0.smithi043.stdout:6/74: dread - d0/ff zero size 2024-04-25T13:46:57.216 INFO:tasks.workunit.client.0.smithi043.stdout:4/82: link d1/d3/l8 d1/de/l1b 0 2024-04-25T13:46:57.219 INFO:tasks.workunit.client.0.smithi043.stdout:9/44: getdents d0/d6/d7 0 2024-04-25T13:46:57.219 INFO:tasks.workunit.client.0.smithi043.stdout:7/87: truncate d5/f17 453907 0 2024-04-25T13:46:57.219 INFO:tasks.workunit.client.0.smithi043.stdout:8/196: rename db/d11/d1b to db/d11/d1b/d4a 22 2024-04-25T13:46:57.222 INFO:tasks.workunit.client.0.smithi043.stdout:8/197: chown db/f2d 12 1 2024-04-25T13:46:57.222 INFO:tasks.workunit.client.0.smithi043.stdout:0/41: dwrite f9 [0,4194304] 0 2024-04-25T13:46:57.222 INFO:tasks.workunit.client.0.smithi043.stdout:3/128: link d0/l18 d0/d9/d15/l2b 0 2024-04-25T13:46:57.222 INFO:tasks.workunit.client.0.smithi043.stdout:8/198: stat db/le 0 2024-04-25T13:46:57.224 INFO:tasks.workunit.client.0.smithi043.stdout:6/75: creat d0/f12 x:0 0 0 2024-04-25T13:46:57.227 INFO:tasks.workunit.client.0.smithi043.stdout:9/45: symlink d0/lf 0 2024-04-25T13:46:57.228 INFO:tasks.workunit.client.0.smithi043.stdout:7/88: creat d5/d11/f20 x:0 0 0 2024-04-25T13:46:57.231 INFO:tasks.workunit.client.0.smithi043.stdout:6/76: creat d0/f13 x:0 0 0 2024-04-25T13:46:57.232 INFO:tasks.workunit.client.0.smithi043.stdout:4/83: truncate d1/f14 3797985 0 2024-04-25T13:46:57.232 INFO:tasks.workunit.client.0.smithi043.stdout:2/34: dread d0/f7 [0,4194304] 0 2024-04-25T13:46:57.233 INFO:tasks.workunit.client.0.smithi043.stdout:9/46: unlink d0/d6/fb 0 2024-04-25T13:46:57.234 INFO:tasks.workunit.client.0.smithi043.stdout:0/42: creat db/fc x:0 0 0 2024-04-25T13:46:57.236 INFO:tasks.workunit.client.0.smithi043.stdout:3/129: mknod d0/d9/c2c 0 2024-04-25T13:46:57.237 INFO:tasks.workunit.client.0.smithi043.stdout:8/199: getdents db/d46 0 2024-04-25T13:46:57.237 INFO:tasks.workunit.client.0.smithi043.stdout:7/89: mknod d5/d11/c21 0 2024-04-25T13:46:57.238 INFO:tasks.workunit.client.0.smithi043.stdout:6/77: mknod d0/c14 0 2024-04-25T13:46:57.240 INFO:tasks.workunit.client.0.smithi043.stdout:4/84: creat d1/de/f1c x:0 0 0 2024-04-25T13:46:57.240 INFO:tasks.workunit.client.0.smithi043.stdout:4/85: chown d1/d3/lb 1268811 1 2024-04-25T13:46:57.241 INFO:tasks.workunit.client.0.smithi043.stdout:2/35: rename d0/f4 to d0/d8/fa 0 2024-04-25T13:46:57.241 INFO:tasks.workunit.client.0.smithi043.stdout:2/36: readlink d0/d5/l9 0 2024-04-25T13:46:57.243 INFO:tasks.workunit.client.0.smithi043.stdout:9/47: creat d0/d6/d7/f10 x:0 0 0 2024-04-25T13:46:57.244 INFO:tasks.workunit.client.0.smithi043.stdout:8/200: rmdir db/dc 39 2024-04-25T13:46:57.245 INFO:tasks.workunit.client.0.smithi043.stdout:8/201: readlink db/l13 0 2024-04-25T13:46:57.245 INFO:tasks.workunit.client.0.smithi043.stdout:6/78: rmdir d0 39 2024-04-25T13:46:57.247 INFO:tasks.workunit.client.0.smithi043.stdout:3/130: link d0/f1d d0/da/f2d 0 2024-04-25T13:46:57.247 INFO:tasks.workunit.client.0.smithi043.stdout:2/37: truncate d0/f7 1119617 0 2024-04-25T13:46:57.248 INFO:tasks.workunit.client.0.smithi043.stdout:1/48: sync 2024-04-25T13:46:57.249 INFO:tasks.workunit.client.0.smithi043.stdout:3/131: stat d0/d14 0 2024-04-25T13:46:57.251 INFO:tasks.workunit.client.0.smithi043.stdout:7/90: rename d5/f17 to d5/f22 0 2024-04-25T13:46:57.254 INFO:tasks.workunit.client.0.smithi043.stdout:6/79: write d0/f12 [619346,91688] 0 2024-04-25T13:46:57.257 INFO:tasks.workunit.client.0.smithi043.stdout:1/49: write df/d10/f12 [157562,107482] 0 2024-04-25T13:46:57.259 INFO:tasks.workunit.client.0.smithi043.stdout:4/86: dwrite d1/f19 [0,4194304] 0 2024-04-25T13:46:57.261 INFO:tasks.workunit.client.0.smithi043.stdout:2/38: mkdir d0/d8/db 0 2024-04-25T13:46:57.264 INFO:tasks.workunit.client.0.smithi043.stdout:0/43: dwrite f8 [0,4194304] 0 2024-04-25T13:46:57.267 INFO:tasks.workunit.client.0.smithi043.stdout:4/87: dread - d1/de/df/f18 zero size 2024-04-25T13:46:57.267 INFO:tasks.workunit.client.0.smithi043.stdout:7/91: chown d5/c13 409 1 2024-04-25T13:46:57.268 INFO:tasks.workunit.client.0.smithi043.stdout:9/48: fsync d0/d6/d7/f10 0 2024-04-25T13:46:57.274 INFO:tasks.workunit.client.0.smithi043.stdout:6/80: rename d0/ca to d0/c15 0 2024-04-25T13:46:57.276 INFO:tasks.workunit.client.0.smithi043.stdout:8/202: dwrite db/d11/f1d [0,4194304] 0 2024-04-25T13:46:57.276 INFO:tasks.workunit.client.0.smithi043.stdout:1/50: creat df/d10/f13 x:0 0 0 2024-04-25T13:46:57.278 INFO:tasks.workunit.client.0.smithi043.stdout:2/39: creat d0/d8/fc x:0 0 0 2024-04-25T13:46:57.282 INFO:tasks.workunit.client.0.smithi043.stdout:0/44: symlink db/ld 0 2024-04-25T13:46:57.284 INFO:tasks.workunit.client.0.smithi043.stdout:3/132: dwrite d0/da/f28 [0,4194304] 0 2024-04-25T13:46:57.284 INFO:tasks.workunit.client.0.smithi043.stdout:9/49: fsync d0/f4 0 2024-04-25T13:46:57.285 INFO:tasks.workunit.client.0.smithi043.stdout:8/203: chown db/d11/d1b 361 1 2024-04-25T13:46:57.285 INFO:tasks.workunit.client.0.smithi043.stdout:4/88: dread d1/d3/f9 [0,4194304] 0 2024-04-25T13:46:57.286 INFO:tasks.workunit.client.0.smithi043.stdout:1/51: write df/d10/f13 [460243,31759] 0 2024-04-25T13:46:57.286 INFO:tasks.workunit.client.0.smithi043.stdout:1/52: readlink - no filename 2024-04-25T13:46:57.288 INFO:tasks.workunit.client.0.smithi043.stdout:0/45: write db/fc [839368,76678] 0 2024-04-25T13:46:57.291 INFO:tasks.workunit.client.0.smithi043.stdout:0/46: write f7 [1397923,37993] 0 2024-04-25T13:46:57.291 INFO:tasks.workunit.client.0.smithi043.stdout:6/81: creat d0/f16 x:0 0 0 2024-04-25T13:46:57.292 INFO:tasks.workunit.client.0.smithi043.stdout:1/53: write df/d10/f13 [936574,26461] 0 2024-04-25T13:46:57.293 INFO:tasks.workunit.client.0.smithi043.stdout:7/92: dread d5/d11/f14 [0,4194304] 0 2024-04-25T13:46:57.297 INFO:tasks.workunit.client.0.smithi043.stdout:3/133: truncate d0/f2 1783856 0 2024-04-25T13:46:57.299 INFO:tasks.workunit.client.0.smithi043.stdout:3/134: fdatasync d0/f4 0 2024-04-25T13:46:57.299 INFO:tasks.workunit.client.0.smithi043.stdout:0/47: chown c3 13572 1 2024-04-25T13:46:57.300 INFO:tasks.workunit.client.0.smithi043.stdout:2/40: rename d0/f7 to d0/d8/fd 0 2024-04-25T13:46:57.300 INFO:tasks.workunit.client.0.smithi043.stdout:6/82: mknod d0/c17 0 2024-04-25T13:46:57.302 INFO:tasks.workunit.client.0.smithi043.stdout:4/89: truncate d1/f14 3733144 0 2024-04-25T13:46:57.303 INFO:tasks.workunit.client.0.smithi043.stdout:9/50: dread d0/d6/d7/fd [0,4194304] 0 2024-04-25T13:46:57.304 INFO:tasks.workunit.client.0.smithi043.stdout:6/83: fdatasync d0/ff 0 2024-04-25T13:46:57.305 INFO:tasks.workunit.client.0.smithi043.stdout:0/48: rmdir db 39 2024-04-25T13:46:57.305 INFO:tasks.workunit.client.0.smithi043.stdout:5/27: sync 2024-04-25T13:46:57.306 INFO:tasks.workunit.client.0.smithi043.stdout:3/135: unlink d0/d14/c17 0 2024-04-25T13:46:57.306 INFO:tasks.workunit.client.0.smithi043.stdout:2/41: read - d0/d8/fc zero size 2024-04-25T13:46:57.306 INFO:tasks.workunit.client.0.smithi043.stdout:9/51: chown d0/le 237 1 2024-04-25T13:46:57.307 INFO:tasks.workunit.client.0.smithi043.stdout:0/49: chown f6 28773 1 2024-04-25T13:46:57.307 INFO:tasks.workunit.client.0.smithi043.stdout:8/204: rename db/d11/d1b/l32 to db/dc/d28/l4b 0 2024-04-25T13:46:57.309 INFO:tasks.workunit.client.0.smithi043.stdout:6/84: write d0/fc [744222,127691] 0 2024-04-25T13:46:57.309 INFO:tasks.workunit.client.0.smithi043.stdout:4/90: mkdir d1/de/d1d 0 2024-04-25T13:46:57.310 INFO:tasks.workunit.client.0.smithi043.stdout:9/52: write d0/d6/d7/f10 [36730,70021] 0 2024-04-25T13:46:57.310 INFO:tasks.workunit.client.0.smithi043.stdout:1/54: dwrite f3 [4194304,4194304] 0 2024-04-25T13:46:57.313 INFO:tasks.workunit.client.0.smithi043.stdout:6/85: write d0/f12 [1577874,89091] 0 2024-04-25T13:46:57.314 INFO:tasks.workunit.client.0.smithi043.stdout:0/50: stat db/fc 0 2024-04-25T13:46:57.318 INFO:tasks.workunit.client.0.smithi043.stdout:0/51: truncate f9 5100780 0 2024-04-25T13:46:57.320 INFO:tasks.workunit.client.0.smithi043.stdout:7/93: truncate d5/d11/f14 3327172 0 2024-04-25T13:46:57.322 INFO:tasks.workunit.client.0.smithi043.stdout:1/55: dread df/d10/f12 [0,4194304] 0 2024-04-25T13:46:57.322 INFO:tasks.workunit.client.0.smithi043.stdout:4/91: unlink d1/d3/lb 0 2024-04-25T13:46:57.322 INFO:tasks.workunit.client.0.smithi043.stdout:3/136: dwrite d0/da/fc [0,4194304] 0 2024-04-25T13:46:57.325 INFO:tasks.workunit.client.0.smithi043.stdout:9/53: symlink d0/d6/l11 0 2024-04-25T13:46:57.325 INFO:tasks.workunit.client.0.smithi043.stdout:4/92: chown d1/de/d1d 226 1 2024-04-25T13:46:57.326 INFO:tasks.workunit.client.0.smithi043.stdout:8/205: write db/f16 [3336140,52075] 0 2024-04-25T13:46:57.327 INFO:tasks.workunit.client.0.smithi043.stdout:5/28: mkdir d1/d3/d7/d8/da 0 2024-04-25T13:46:57.328 INFO:tasks.workunit.client.0.smithi043.stdout:6/86: dwrite d0/fc [0,4194304] 0 2024-04-25T13:46:57.329 INFO:tasks.workunit.client.0.smithi043.stdout:5/29: chown d1/d3 34490917 1 2024-04-25T13:46:57.333 INFO:tasks.workunit.client.0.smithi043.stdout:1/56: mkdir df/d14 0 2024-04-25T13:46:57.333 INFO:tasks.workunit.client.0.smithi043.stdout:0/52: dread f7 [0,4194304] 0 2024-04-25T13:46:57.337 INFO:tasks.workunit.client.0.smithi043.stdout:0/53: rename db to db/de 22 2024-04-25T13:46:57.337 INFO:tasks.workunit.client.0.smithi043.stdout:9/54: mknod d0/d6/d7/c12 0 2024-04-25T13:46:57.339 INFO:tasks.workunit.client.0.smithi043.stdout:1/57: write df/f11 [965083,5742] 0 2024-04-25T13:46:57.340 INFO:tasks.workunit.client.0.smithi043.stdout:9/55: stat d0/d6/dc 0 2024-04-25T13:46:57.340 INFO:tasks.workunit.client.0.smithi043.stdout:8/206: creat db/dc/d21/f4c x:0 0 0 2024-04-25T13:46:57.341 INFO:tasks.workunit.client.0.smithi043.stdout:7/94: mknod d5/c23 0 2024-04-25T13:46:57.345 INFO:tasks.workunit.client.0.smithi043.stdout:4/93: dwrite d1/de/f1c [0,4194304] 0 2024-04-25T13:46:57.345 INFO:tasks.workunit.client.0.smithi043.stdout:5/30: mkdir d1/d3/d7/d8/db 0 2024-04-25T13:46:57.345 INFO:tasks.workunit.client.0.smithi043.stdout:8/207: dread - db/dc/f2f zero size 2024-04-25T13:46:57.347 INFO:tasks.workunit.client.0.smithi043.stdout:0/54: rmdir db 39 2024-04-25T13:46:57.349 INFO:tasks.workunit.client.0.smithi043.stdout:1/58: fsync f9 0 2024-04-25T13:46:57.350 INFO:tasks.workunit.client.0.smithi043.stdout:2/42: dwrite d0/d8/fd [0,4194304] 0 2024-04-25T13:46:57.350 INFO:tasks.workunit.client.0.smithi043.stdout:6/87: dread d0/fc [0,4194304] 0 2024-04-25T13:46:57.351 INFO:tasks.workunit.client.0.smithi043.stdout:7/95: unlink d5/d11/f1b 0 2024-04-25T13:46:57.351 INFO:tasks.workunit.client.0.smithi043.stdout:4/94: dread - d1/de/df/f16 zero size 2024-04-25T13:46:57.352 INFO:tasks.workunit.client.0.smithi043.stdout:9/56: dread d0/d6/d7/f10 [0,4194304] 0 2024-04-25T13:46:57.352 INFO:tasks.workunit.client.0.smithi043.stdout:5/31: mknod d1/d3/d7/cc 0 2024-04-25T13:46:57.353 INFO:tasks.workunit.client.0.smithi043.stdout:5/32: dwrite - no filename 2024-04-25T13:46:57.358 INFO:tasks.workunit.client.0.smithi043.stdout:8/208: mknod db/d46/c4d 0 2024-04-25T13:46:57.361 INFO:tasks.workunit.client.0.smithi043.stdout:3/137: write d0/f2 [2007695,90521] 0 2024-04-25T13:46:57.361 INFO:tasks.workunit.client.0.smithi043.stdout:2/43: rename d0/l2 to d0/d8/db/le 0 2024-04-25T13:46:57.365 INFO:tasks.workunit.client.0.smithi043.stdout:6/88: dwrite d0/ff [0,4194304] 0 2024-04-25T13:46:57.366 INFO:tasks.workunit.client.0.smithi043.stdout:4/95: dread d1/fd [0,4194304] 0 2024-04-25T13:46:57.366 INFO:tasks.workunit.client.0.smithi043.stdout:6/89: dread - d0/fb zero size 2024-04-25T13:46:57.368 INFO:tasks.workunit.client.0.smithi043.stdout:8/209: mkdir db/dc/d21/d4e 0 2024-04-25T13:46:57.369 INFO:tasks.workunit.client.0.smithi043.stdout:9/57: rename d0/d6/d7/c12 to d0/d6/c13 0 2024-04-25T13:46:57.370 INFO:tasks.workunit.client.0.smithi043.stdout:7/96: write f4 [1101841,50076] 0 2024-04-25T13:46:57.370 INFO:tasks.workunit.client.0.smithi043.stdout:3/138: mkdir d0/d13/d2e 0 2024-04-25T13:46:57.371 INFO:tasks.workunit.client.0.smithi043.stdout:3/139: chown d0/d9/f23 4053 1 2024-04-25T13:46:57.374 INFO:tasks.workunit.client.0.smithi043.stdout:0/55: truncate f7 686130 0 2024-04-25T13:46:57.376 INFO:tasks.workunit.client.0.smithi043.stdout:7/97: creat d5/d11/f24 x:0 0 0 2024-04-25T13:46:57.377 INFO:tasks.workunit.client.0.smithi043.stdout:8/210: dread db/d11/f17 [0,4194304] 0 2024-04-25T13:46:57.377 INFO:tasks.workunit.client.0.smithi043.stdout:7/98: chown d5/fe 818321 1 2024-04-25T13:46:57.378 INFO:tasks.workunit.client.0.smithi043.stdout:3/140: creat d0/d9/d15/f2f x:0 0 0 2024-04-25T13:46:57.381 INFO:tasks.workunit.client.0.smithi043.stdout:6/90: link d0/c17 d0/c18 0 2024-04-25T13:46:57.382 INFO:tasks.workunit.client.0.smithi043.stdout:2/44: truncate d0/d8/fa 5166827 0 2024-04-25T13:46:57.383 INFO:tasks.workunit.client.0.smithi043.stdout:8/211: chown db/dc/d28/l33 25534 1 2024-04-25T13:46:57.384 INFO:tasks.workunit.client.0.smithi043.stdout:2/45: truncate d0/d8/fc 552057 0 2024-04-25T13:46:57.384 INFO:tasks.workunit.client.0.smithi043.stdout:8/212: fsync db/d11/f2a 0 2024-04-25T13:46:57.385 INFO:tasks.workunit.client.0.smithi043.stdout:2/46: chown d0/d8/db 1766386 1 2024-04-25T13:46:57.385 INFO:tasks.workunit.client.0.smithi043.stdout:6/91: creat d0/f19 x:0 0 0 2024-04-25T13:46:57.386 INFO:tasks.workunit.client.0.smithi043.stdout:7/99: mknod d5/c25 0 2024-04-25T13:46:57.386 INFO:tasks.workunit.client.0.smithi043.stdout:6/92: dread - d0/f16 zero size 2024-04-25T13:46:57.386 INFO:tasks.workunit.client.0.smithi043.stdout:7/100: stat d5/f22 0 2024-04-25T13:46:57.386 INFO:tasks.workunit.client.0.smithi043.stdout:3/141: symlink d0/d9/l30 0 2024-04-25T13:46:57.388 INFO:tasks.workunit.client.0.smithi043.stdout:3/142: write d0/d14/f29 [423938,82867] 0 2024-04-25T13:46:57.390 INFO:tasks.workunit.client.0.smithi043.stdout:7/101: creat d5/d11/f26 x:0 0 0 2024-04-25T13:46:57.391 INFO:tasks.workunit.client.0.smithi043.stdout:8/213: symlink db/d44/l4f 0 2024-04-25T13:46:57.391 INFO:tasks.workunit.client.0.smithi043.stdout:8/214: readlink db/l10 0 2024-04-25T13:46:57.392 INFO:tasks.workunit.client.0.smithi043.stdout:3/143: fsync d0/da/f2d 0 2024-04-25T13:46:57.393 INFO:tasks.workunit.client.0.smithi043.stdout:0/56: truncate f7 1263475 0 2024-04-25T13:46:57.403 INFO:tasks.workunit.client.0.smithi043.stdout:8/215: creat db/d38/d49/f50 x:0 0 0 2024-04-25T13:46:57.404 INFO:tasks.workunit.client.0.smithi043.stdout:0/57: mknod db/cf 0 2024-04-25T13:46:57.404 INFO:tasks.workunit.client.0.smithi043.stdout:6/93: write d0/f4 [1839769,18090] 0 2024-04-25T13:46:57.407 INFO:tasks.workunit.client.0.smithi043.stdout:0/58: write f6 [1243380,108406] 0 2024-04-25T13:46:57.408 INFO:tasks.workunit.client.0.smithi043.stdout:6/94: creat d0/f1a x:0 0 0 2024-04-25T13:46:57.409 INFO:tasks.workunit.client.0.smithi043.stdout:0/59: write f6 [624944,90376] 0 2024-04-25T13:46:57.411 INFO:tasks.workunit.client.0.smithi043.stdout:6/95: truncate d0/ff 4703098 0 2024-04-25T13:46:57.413 INFO:tasks.workunit.client.0.smithi043.stdout:7/102: truncate d5/f10 516626 0 2024-04-25T13:46:57.413 INFO:tasks.workunit.client.0.smithi043.stdout:8/216: dwrite db/d11/d1b/f47 [0,4194304] 0 2024-04-25T13:46:57.414 INFO:tasks.workunit.client.0.smithi043.stdout:7/103: read - d5/f1e zero size 2024-04-25T13:46:57.414 INFO:tasks.workunit.client.0.smithi043.stdout:6/96: mkdir d0/d1b 0 2024-04-25T13:46:57.415 INFO:tasks.workunit.client.0.smithi043.stdout:6/97: read - d0/f16 zero size 2024-04-25T13:46:57.418 INFO:tasks.workunit.client.0.smithi043.stdout:8/217: dread db/dc/f18 [0,4194304] 0 2024-04-25T13:46:57.418 INFO:tasks.workunit.client.0.smithi043.stdout:8/218: dread - db/dc/f48 zero size 2024-04-25T13:46:57.419 INFO:tasks.workunit.client.0.smithi043.stdout:6/98: mkdir d0/d1c 0 2024-04-25T13:46:57.420 INFO:tasks.workunit.client.0.smithi043.stdout:6/99: write d0/f12 [2365525,128795] 0 2024-04-25T13:46:57.421 INFO:tasks.workunit.client.0.smithi043.stdout:6/100: chown d0/l9 3 1 2024-04-25T13:46:57.421 INFO:tasks.workunit.client.0.smithi043.stdout:6/101: write d0/f1a [915392,134] 0 2024-04-25T13:46:57.422 INFO:tasks.workunit.client.0.smithi043.stdout:8/219: creat db/d11/f51 x:0 0 0 2024-04-25T13:46:57.423 INFO:tasks.workunit.client.0.smithi043.stdout:8/220: fsync db/dc/f48 0 2024-04-25T13:46:57.426 INFO:tasks.workunit.client.0.smithi043.stdout:7/104: creat d5/f27 x:0 0 0 2024-04-25T13:46:57.426 INFO:tasks.workunit.client.0.smithi043.stdout:0/60: truncate db/fc 219136 0 2024-04-25T13:46:57.426 INFO:tasks.workunit.client.0.smithi043.stdout:6/102: fdatasync d0/f1a 0 2024-04-25T13:46:57.434 INFO:tasks.workunit.client.0.smithi043.stdout:8/221: dwrite db/f16 [0,4194304] 0 2024-04-25T13:46:57.435 INFO:tasks.workunit.client.0.smithi043.stdout:7/105: rename d5/d11/f1f to d5/d11/f28 0 2024-04-25T13:46:57.435 INFO:tasks.workunit.client.0.smithi043.stdout:6/103: creat d0/d1b/f1d x:0 0 0 2024-04-25T13:46:57.439 INFO:tasks.workunit.client.0.smithi043.stdout:6/104: symlink d0/l1e 0 2024-04-25T13:46:57.443 INFO:tasks.workunit.client.0.smithi043.stdout:7/106: rename d5/f1c to d5/f29 0 2024-04-25T13:46:57.443 INFO:tasks.workunit.client.0.smithi043.stdout:8/222: dwrite db/d11/d1b/d1e/f42 [0,4194304] 0 2024-04-25T13:46:57.444 INFO:tasks.workunit.client.0.smithi043.stdout:7/107: readlink d5/l1a 0 2024-04-25T13:46:57.449 INFO:tasks.workunit.client.0.smithi043.stdout:7/108: rmdir d5/d11 39 2024-04-25T13:46:57.476 INFO:tasks.workunit.client.0.smithi043.stdout:8/223: link db/d11/d1b/l31 db/d38/l52 0 2024-04-25T13:46:57.477 INFO:tasks.workunit.client.0.smithi043.stdout:0/61: dwrite f7 [0,4194304] 0 2024-04-25T13:46:57.478 INFO:tasks.workunit.client.0.smithi043.stdout:7/109: mknod d5/d11/c2a 0 2024-04-25T13:46:57.480 INFO:tasks.workunit.client.0.smithi043.stdout:6/105: dwrite d0/d1b/f1d [0,4194304] 0 2024-04-25T13:46:57.481 INFO:tasks.workunit.client.0.smithi043.stdout:0/62: fdatasync db/fc 0 2024-04-25T13:46:57.486 INFO:tasks.workunit.client.0.smithi043.stdout:0/63: read f6 [1130703,98065] 0 2024-04-25T13:46:57.491 INFO:tasks.workunit.client.0.smithi043.stdout:0/64: write f6 [699223,49840] 0 2024-04-25T13:46:57.492 INFO:tasks.workunit.client.0.smithi043.stdout:8/224: dwrite db/d11/f20 [4194304,4194304] 0 2024-04-25T13:46:57.494 INFO:tasks.workunit.client.0.smithi043.stdout:6/106: dwrite d0/fb [0,4194304] 0 2024-04-25T13:46:57.495 INFO:tasks.workunit.client.0.smithi043.stdout:8/225: dread - db/d38/d49/f50 zero size 2024-04-25T13:46:57.496 INFO:tasks.workunit.client.0.smithi043.stdout:6/107: fsync d0/fe 0 2024-04-25T13:46:57.497 INFO:tasks.workunit.client.0.smithi043.stdout:6/108: fdatasync d0/fe 0 2024-04-25T13:46:57.498 INFO:tasks.workunit.client.0.smithi043.stdout:0/65: rename c0 to db/c10 0 2024-04-25T13:46:57.500 INFO:tasks.workunit.client.0.smithi043.stdout:8/226: unlink db/d44/l4f 0 2024-04-25T13:46:57.502 INFO:tasks.workunit.client.0.smithi043.stdout:6/109: symlink d0/d1c/l1f 0 2024-04-25T13:46:57.504 INFO:tasks.workunit.client.0.smithi043.stdout:6/110: fdatasync d0/fe 0 2024-04-25T13:46:57.506 INFO:tasks.workunit.client.0.smithi043.stdout:8/227: rename db/dc/f18 to db/d11/d1b/d1e/f53 0 2024-04-25T13:46:57.506 INFO:tasks.workunit.client.0.smithi043.stdout:0/66: dread db/fc [0,4194304] 0 2024-04-25T13:46:57.508 INFO:tasks.workunit.client.0.smithi043.stdout:6/111: link d0/fe d0/f20 0 2024-04-25T13:46:57.509 INFO:tasks.workunit.client.0.smithi043.stdout:0/67: symlink db/l11 0 2024-04-25T13:46:57.512 INFO:tasks.workunit.client.0.smithi043.stdout:8/228: mknod db/dc/d21/c54 0 2024-04-25T13:46:57.516 INFO:tasks.workunit.client.0.smithi043.stdout:0/68: link f6 db/f12 0 2024-04-25T13:46:57.517 INFO:tasks.workunit.client.0.smithi043.stdout:6/112: dwrite d0/fb [0,4194304] 0 2024-04-25T13:46:57.519 INFO:tasks.workunit.client.0.smithi043.stdout:0/69: symlink db/l13 0 2024-04-25T13:46:57.522 INFO:tasks.workunit.client.0.smithi043.stdout:6/113: rename d0/l1 to d0/l21 0 2024-04-25T13:46:57.524 INFO:tasks.workunit.client.0.smithi043.stdout:0/70: write f6 [284085,110580] 0 2024-04-25T13:46:57.525 INFO:tasks.workunit.client.0.smithi043.stdout:0/71: fdatasync f8 0 2024-04-25T13:46:57.526 INFO:tasks.workunit.client.0.smithi043.stdout:0/72: fsync f9 0 2024-04-25T13:46:57.528 INFO:tasks.workunit.client.0.smithi043.stdout:8/229: write db/d11/d1b/d1e/d27/f30 [639095,119002] 0 2024-04-25T13:46:57.530 INFO:tasks.workunit.client.0.smithi043.stdout:6/114: dwrite d0/f1a [0,4194304] 0 2024-04-25T13:46:57.530 INFO:tasks.workunit.client.0.smithi043.stdout:8/230: write db/dc/f2f [227927,129091] 0 2024-04-25T13:46:57.532 INFO:tasks.workunit.client.0.smithi043.stdout:0/73: truncate db/fc 573279 0 2024-04-25T13:46:57.536 INFO:tasks.workunit.client.0.smithi043.stdout:0/74: creat db/f14 x:0 0 0 2024-04-25T13:46:57.536 INFO:tasks.workunit.client.0.smithi043.stdout:8/231: dread db/d11/d1b/f47 [0,4194304] 0 2024-04-25T13:46:57.539 INFO:tasks.workunit.client.0.smithi043.stdout:0/75: rename db/f14 to db/f15 0 2024-04-25T13:46:57.543 INFO:tasks.workunit.client.0.smithi043.stdout:6/115: truncate d0/fc 1518131 0 2024-04-25T13:46:57.543 INFO:tasks.workunit.client.0.smithi043.stdout:6/116: stat d0/d1c 0 2024-04-25T13:46:57.545 INFO:tasks.workunit.client.0.smithi043.stdout:6/117: symlink d0/d1c/l22 0 2024-04-25T13:46:57.549 INFO:tasks.workunit.client.0.smithi043.stdout:8/232: link db/dc/d28/l4b db/d44/l55 0 2024-04-25T13:46:57.555 INFO:tasks.workunit.client.0.smithi043.stdout:6/118: dwrite d0/f19 [0,4194304] 0 2024-04-25T13:46:57.557 INFO:tasks.workunit.client.0.smithi043.stdout:6/119: dread - d0/f13 zero size 2024-04-25T13:46:57.561 INFO:tasks.workunit.client.0.smithi043.stdout:6/120: symlink d0/l23 0 2024-04-25T13:46:57.561 INFO:tasks.workunit.client.0.smithi043.stdout:0/76: dwrite db/fc [0,4194304] 0 2024-04-25T13:46:57.561 INFO:tasks.workunit.client.0.smithi043.stdout:6/121: chown d0 30 1 2024-04-25T13:46:57.562 INFO:tasks.workunit.client.0.smithi043.stdout:8/233: dwrite db/fd [0,4194304] 0 2024-04-25T13:46:57.564 INFO:tasks.workunit.client.0.smithi043.stdout:8/234: truncate db/dc/d21/f39 569684 0 2024-04-25T13:46:57.566 INFO:tasks.workunit.client.0.smithi043.stdout:6/122: mkdir d0/d24 0 2024-04-25T13:46:57.574 INFO:tasks.workunit.client.0.smithi043.stdout:6/123: write d0/fe [233013,109613] 0 2024-04-25T13:46:57.578 INFO:tasks.workunit.client.0.smithi043.stdout:0/77: dwrite db/f15 [0,4194304] 0 2024-04-25T13:46:57.579 INFO:tasks.workunit.client.0.smithi043.stdout:6/124: mknod d0/d1c/c25 0 2024-04-25T13:46:57.580 INFO:tasks.workunit.client.0.smithi043.stdout:0/78: symlink db/l16 0 2024-04-25T13:46:57.582 INFO:tasks.workunit.client.0.smithi043.stdout:6/125: fdatasync d0/fc 0 2024-04-25T13:46:57.583 INFO:tasks.workunit.client.0.smithi043.stdout:8/235: dread db/f35 [0,4194304] 0 2024-04-25T13:46:57.585 INFO:tasks.workunit.client.0.smithi043.stdout:8/236: creat db/d11/d1b/d1e/f56 x:0 0 0 2024-04-25T13:46:57.586 INFO:tasks.workunit.client.0.smithi043.stdout:8/237: fdatasync db/f16 0 2024-04-25T13:46:57.589 INFO:tasks.workunit.client.0.smithi043.stdout:8/238: rename db/dc/d21/c34 to db/d38/c57 0 2024-04-25T13:46:57.591 INFO:tasks.workunit.client.0.smithi043.stdout:0/79: getdents db 0 2024-04-25T13:46:57.594 INFO:tasks.workunit.client.0.smithi043.stdout:8/239: dread db/d11/f2a [0,4194304] 0 2024-04-25T13:46:57.594 INFO:tasks.workunit.client.0.smithi043.stdout:0/80: creat db/f17 x:0 0 0 2024-04-25T13:46:57.597 INFO:tasks.workunit.client.0.smithi043.stdout:0/81: creat db/f18 x:0 0 0 2024-04-25T13:46:57.598 INFO:tasks.workunit.client.0.smithi043.stdout:8/240: dread db/d11/d1b/d1e/d27/f30 [0,4194304] 0 2024-04-25T13:46:57.599 INFO:tasks.workunit.client.0.smithi043.stdout:1/59: sync 2024-04-25T13:46:57.599 INFO:tasks.workunit.client.0.smithi043.stdout:8/241: write db/dc/d28/f43 [217693,121919] 0 2024-04-25T13:46:57.601 INFO:tasks.workunit.client.0.smithi043.stdout:1/60: mknod df/d14/c15 0 2024-04-25T13:46:57.602 INFO:tasks.workunit.client.0.smithi043.stdout:8/242: creat db/dc/d21/d4e/f58 x:0 0 0 2024-04-25T13:46:57.603 INFO:tasks.workunit.client.0.smithi043.stdout:1/61: write df/f11 [665197,118882] 0 2024-04-25T13:46:57.605 INFO:tasks.workunit.client.0.smithi043.stdout:1/62: write f3 [4562332,85170] 0 2024-04-25T13:46:57.608 INFO:tasks.workunit.client.0.smithi043.stdout:1/63: creat df/f16 x:0 0 0 2024-04-25T13:46:57.609 INFO:tasks.workunit.client.0.smithi043.stdout:0/82: dwrite db/f12 [0,4194304] 0 2024-04-25T13:46:57.610 INFO:tasks.workunit.client.0.smithi043.stdout:1/64: fdatasync df/f16 0 2024-04-25T13:46:57.611 INFO:tasks.workunit.client.0.smithi043.stdout:0/83: symlink db/l19 0 2024-04-25T13:46:57.612 INFO:tasks.workunit.client.0.smithi043.stdout:1/65: dread f2 [0,4194304] 0 2024-04-25T13:46:57.618 INFO:tasks.workunit.client.0.smithi043.stdout:0/84: dwrite db/f12 [0,4194304] 0 2024-04-25T13:46:57.622 INFO:tasks.workunit.client.0.smithi043.stdout:0/85: rename c3 to db/c1a 0 2024-04-25T13:46:57.628 INFO:tasks.workunit.client.0.smithi043.stdout:0/86: dread f7 [0,4194304] 0 2024-04-25T13:46:57.629 INFO:tasks.workunit.client.0.smithi043.stdout:0/87: write f9 [5513572,58110] 0 2024-04-25T13:46:57.632 INFO:tasks.workunit.client.0.smithi043.stdout:0/88: stat c2 0 2024-04-25T13:46:57.632 INFO:tasks.workunit.client.0.smithi043.stdout:1/66: dwrite df/d10/f12 [0,4194304] 0 2024-04-25T13:46:57.634 INFO:tasks.workunit.client.0.smithi043.stdout:1/67: write df/f11 [1950861,74028] 0 2024-04-25T13:46:57.634 INFO:tasks.workunit.client.0.smithi043.stdout:0/89: mkdir db/d1b 0 2024-04-25T13:46:57.637 INFO:tasks.workunit.client.0.smithi043.stdout:1/68: creat df/f17 x:0 0 0 2024-04-25T13:46:57.638 INFO:tasks.workunit.client.0.smithi043.stdout:0/90: read db/fc [2042391,52387] 0 2024-04-25T13:46:57.638 INFO:tasks.workunit.client.0.smithi043.stdout:1/69: stat df/f16 0 2024-04-25T13:46:57.639 INFO:tasks.workunit.client.0.smithi043.stdout:0/91: mknod db/d1b/c1c 0 2024-04-25T13:46:57.640 INFO:tasks.workunit.client.0.smithi043.stdout:1/70: symlink df/d10/l18 0 2024-04-25T13:46:57.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/71: rmdir df/d14 39 2024-04-25T13:46:57.647 INFO:tasks.workunit.client.0.smithi043.stdout:1/72: creat df/d14/f19 x:0 0 0 2024-04-25T13:46:57.648 INFO:tasks.workunit.client.0.smithi043.stdout:0/92: dwrite db/f17 [0,4194304] 0 2024-04-25T13:46:57.648 INFO:tasks.workunit.client.0.smithi043.stdout:1/73: chown f3 29 1 2024-04-25T13:46:57.648 INFO:tasks.workunit.client.0.smithi043.stdout:0/93: chown db 6588186 1 2024-04-25T13:46:57.650 INFO:tasks.workunit.client.0.smithi043.stdout:1/74: write df/f11 [789429,119526] 0 2024-04-25T13:46:57.650 INFO:tasks.workunit.client.0.smithi043.stdout:0/94: creat db/f1d x:0 0 0 2024-04-25T13:46:57.660 INFO:tasks.workunit.client.0.smithi043.stdout:0/95: dread db/f12 [0,4194304] 0 2024-04-25T13:46:57.660 INFO:tasks.workunit.client.0.smithi043.stdout:1/75: dwrite f3 [8388608,4194304] 0 2024-04-25T13:46:57.664 INFO:tasks.workunit.client.0.smithi043.stdout:1/76: getdents df/d10 0 2024-04-25T13:46:57.666 INFO:tasks.workunit.client.0.smithi043.stdout:0/96: fdatasync db/f17 0 2024-04-25T13:46:57.667 INFO:tasks.workunit.client.0.smithi043.stdout:1/77: read df/f11 [1382922,82821] 0 2024-04-25T13:46:57.667 INFO:tasks.workunit.client.0.smithi043.stdout:0/97: write db/f1d [106944,71741] 0 2024-04-25T13:46:57.669 INFO:tasks.workunit.client.0.smithi043.stdout:1/78: write f2 [831776,126218] 0 2024-04-25T13:46:57.673 INFO:tasks.workunit.client.0.smithi043.stdout:0/98: dread db/f12 [0,4194304] 0 2024-04-25T13:46:57.678 INFO:tasks.workunit.client.0.smithi043.stdout:0/99: dread f8 [0,4194304] 0 2024-04-25T13:46:57.679 INFO:tasks.workunit.client.0.smithi043.stdout:0/100: write db/f15 [752745,128257] 0 2024-04-25T13:46:57.683 INFO:tasks.workunit.client.0.smithi043.stdout:0/101: rename db/f15 to db/d1b/f1e 0 2024-04-25T13:46:57.685 INFO:tasks.workunit.client.0.smithi043.stdout:1/79: dread df/f11 [0,4194304] 0 2024-04-25T13:46:57.685 INFO:tasks.workunit.client.0.smithi043.stdout:1/80: chown cb 199226 1 2024-04-25T13:46:57.687 INFO:tasks.workunit.client.0.smithi043.stdout:1/81: write fe [4921282,47723] 0 2024-04-25T13:46:57.688 INFO:tasks.workunit.client.0.smithi043.stdout:0/102: dread db/f12 [0,4194304] 0 2024-04-25T13:46:57.688 INFO:tasks.workunit.client.0.smithi043.stdout:1/82: dread - fa zero size 2024-04-25T13:46:57.688 INFO:tasks.workunit.client.0.smithi043.stdout:0/103: read f6 [73111,73289] 0 2024-04-25T13:46:57.691 INFO:tasks.workunit.client.0.smithi043.stdout:1/83: dread df/f11 [0,4194304] 0 2024-04-25T13:46:57.693 INFO:tasks.workunit.client.0.smithi043.stdout:0/104: dread db/f17 [0,4194304] 0 2024-04-25T13:46:57.693 INFO:tasks.workunit.client.0.smithi043.stdout:1/84: read fe [4690828,64930] 0 2024-04-25T13:46:57.699 INFO:tasks.workunit.client.0.smithi043.stdout:0/105: rename db/c10 to db/c1f 0 2024-04-25T13:46:57.701 INFO:tasks.workunit.client.0.smithi043.stdout:0/106: truncate db/f1d 497741 0 2024-04-25T13:46:57.701 INFO:tasks.workunit.client.0.smithi043.stdout:1/85: getdents df/d14 0 2024-04-25T13:46:57.702 INFO:tasks.workunit.client.0.smithi043.stdout:1/86: truncate df/f11 2205916 0 2024-04-25T13:46:57.702 INFO:tasks.workunit.client.0.smithi043.stdout:0/107: rmdir db/d1b 39 2024-04-25T13:46:57.706 INFO:tasks.workunit.client.0.smithi043.stdout:0/108: symlink db/d1b/l20 0 2024-04-25T13:46:57.706 INFO:tasks.workunit.client.0.smithi043.stdout:0/109: dread - db/f18 zero size 2024-04-25T13:46:57.707 INFO:tasks.workunit.client.0.smithi043.stdout:0/110: truncate db/f18 294724 0 2024-04-25T13:46:57.707 INFO:tasks.workunit.client.0.smithi043.stdout:5/33: sync 2024-04-25T13:46:57.707 INFO:tasks.workunit.client.0.smithi043.stdout:0/111: write f9 [5942448,47379] 0 2024-04-25T13:46:57.710 INFO:tasks.workunit.client.0.smithi043.stdout:0/112: mknod db/d1b/c21 0 2024-04-25T13:46:57.711 INFO:tasks.workunit.client.0.smithi043.stdout:5/34: creat d1/d4/d5/fd x:0 0 0 2024-04-25T13:46:57.714 INFO:tasks.workunit.client.0.smithi043.stdout:5/35: mknod d1/d4/d5/ce 0 2024-04-25T13:46:57.719 INFO:tasks.workunit.client.0.smithi043.stdout:0/113: dwrite f7 [4194304,4194304] 0 2024-04-25T13:46:57.719 INFO:tasks.workunit.client.0.smithi043.stdout:0/114: chown c2 3870567 1 2024-04-25T13:46:57.725 INFO:tasks.workunit.client.0.smithi043.stdout:5/36: rename d1/d4/d5 to d1/d3/d7/d8/df 0 2024-04-25T13:46:57.725 INFO:tasks.workunit.client.0.smithi043.stdout:0/115: dwrite f9 [0,4194304] 0 2024-04-25T13:46:57.727 INFO:tasks.workunit.client.0.smithi043.stdout:5/37: write d1/d3/d7/d8/df/fd [620984,43589] 0 2024-04-25T13:46:57.728 INFO:tasks.workunit.client.0.smithi043.stdout:0/116: creat db/d1b/f22 x:0 0 0 2024-04-25T13:46:57.730 INFO:tasks.workunit.client.0.smithi043.stdout:5/38: mknod d1/d3/d7/d8/df/c10 0 2024-04-25T13:46:57.732 INFO:tasks.workunit.client.0.smithi043.stdout:5/39: stat d1/d3/d7/d8/db 0 2024-04-25T13:46:57.733 INFO:tasks.workunit.client.0.smithi043.stdout:0/117: write db/d1b/f1e [1694872,77272] 0 2024-04-25T13:46:57.734 INFO:tasks.workunit.client.0.smithi043.stdout:0/118: readlink db/l16 0 2024-04-25T13:46:57.735 INFO:tasks.workunit.client.0.smithi043.stdout:0/119: chown c2 76733 1 2024-04-25T13:46:57.743 INFO:tasks.workunit.client.0.smithi043.stdout:5/40: dwrite d1/d3/d7/d8/df/fd [0,4194304] 0 2024-04-25T13:46:57.753 INFO:tasks.workunit.client.0.smithi043.stdout:0/120: mkdir db/d1b/d23 0 2024-04-25T13:46:57.753 INFO:tasks.workunit.client.0.smithi043.stdout:0/121: stat db/d1b/f1e 0 2024-04-25T13:46:57.775 INFO:tasks.workunit.client.0.smithi043.stdout:0/122: rename db/l19 to db/l24 0 2024-04-25T13:46:57.780 INFO:tasks.workunit.client.0.smithi043.stdout:0/123: truncate db/fc 184366 0 2024-04-25T13:46:57.784 INFO:tasks.workunit.client.0.smithi043.stdout:0/124: mkdir db/d25 0 2024-04-25T13:46:57.792 INFO:tasks.workunit.client.0.smithi043.stdout:0/125: link db/d1b/f22 db/d1b/f26 0 2024-04-25T13:46:57.795 INFO:tasks.workunit.client.0.smithi043.stdout:0/126: readlink db/l24 0 2024-04-25T13:46:57.844 INFO:tasks.workunit.client.0.smithi043.stdout:4/96: sync 2024-04-25T13:46:57.844 INFO:tasks.workunit.client.0.smithi043.stdout:3/144: sync 2024-04-25T13:46:57.844 INFO:tasks.workunit.client.0.smithi043.stdout:9/58: sync 2024-04-25T13:46:57.844 INFO:tasks.workunit.client.0.smithi043.stdout:4/97: chown d1/d3/l6 27683 1 2024-04-25T13:46:57.853 INFO:tasks.workunit.client.0.smithi043.stdout:3/145: getdents d0/d13 0 2024-04-25T13:46:57.853 INFO:tasks.workunit.client.0.smithi043.stdout:4/98: dwrite d1/f19 [0,4194304] 0 2024-04-25T13:46:57.854 INFO:tasks.workunit.client.0.smithi043.stdout:9/59: dwrite d0/f4 [0,4194304] 0 2024-04-25T13:46:57.856 INFO:tasks.workunit.client.0.smithi043.stdout:3/146: chown d0 61913 1 2024-04-25T13:46:57.858 INFO:tasks.workunit.client.0.smithi043.stdout:9/60: dread d0/f4 [0,4194304] 0 2024-04-25T13:46:57.859 INFO:tasks.workunit.client.0.smithi043.stdout:9/61: stat d0/le 0 2024-04-25T13:46:57.863 INFO:tasks.workunit.client.0.smithi043.stdout:3/147: rename d0/f1d to d0/d13/d2e/f31 0 2024-04-25T13:46:57.869 INFO:tasks.workunit.client.0.smithi043.stdout:4/99: dwrite d1/f14 [0,4194304] 0 2024-04-25T13:46:57.870 INFO:tasks.workunit.client.0.smithi043.stdout:9/62: dwrite d0/d6/d7/f10 [0,4194304] 0 2024-04-25T13:46:57.874 INFO:tasks.workunit.client.0.smithi043.stdout:9/63: chown d0/d6/d7/fd 12539012 1 2024-04-25T13:46:57.874 INFO:tasks.workunit.client.0.smithi043.stdout:4/100: mkdir d1/de/df/d1e 0 2024-04-25T13:46:57.877 INFO:tasks.workunit.client.0.smithi043.stdout:9/64: mknod d0/d6/dc/c14 0 2024-04-25T13:46:57.879 INFO:tasks.workunit.client.0.smithi043.stdout:4/101: rename d1/d3/l8 to d1/de/d1d/l1f 0 2024-04-25T13:46:57.880 INFO:tasks.workunit.client.0.smithi043.stdout:3/148: symlink d0/d14/l32 0 2024-04-25T13:46:57.880 INFO:tasks.workunit.client.0.smithi043.stdout:4/102: readlink d1/de/l1b 0 2024-04-25T13:46:57.880 INFO:tasks.workunit.client.0.smithi043.stdout:9/65: rmdir d0/d6/d7 39 2024-04-25T13:46:57.881 INFO:tasks.workunit.client.0.smithi043.stdout:3/149: dread - d0/f2a zero size 2024-04-25T13:46:57.882 INFO:tasks.workunit.client.0.smithi043.stdout:4/103: mkdir d1/de/d1d/d20 0 2024-04-25T13:46:57.883 INFO:tasks.workunit.client.0.smithi043.stdout:4/104: write d1/de/df/f16 [598682,112340] 0 2024-04-25T13:46:57.888 INFO:tasks.workunit.client.0.smithi043.stdout:9/66: dread d0/d6/d7/fd [0,4194304] 0 2024-04-25T13:46:57.890 INFO:tasks.workunit.client.0.smithi043.stdout:9/67: stat d0/d6/d7/f10 0 2024-04-25T13:46:57.895 INFO:tasks.workunit.client.0.smithi043.stdout:4/105: dwrite d1/d3/f9 [0,4194304] 0 2024-04-25T13:46:57.896 INFO:tasks.workunit.client.0.smithi043.stdout:9/68: creat d0/d6/f15 x:0 0 0 2024-04-25T13:46:57.897 INFO:tasks.workunit.client.0.smithi043.stdout:9/69: stat d0/d6/d7/fd 0 2024-04-25T13:46:57.898 INFO:tasks.workunit.client.0.smithi043.stdout:4/106: write d1/d3/f15 [3144361,99607] 0 2024-04-25T13:46:57.906 INFO:tasks.workunit.client.0.smithi043.stdout:4/107: link d1/d3/l6 d1/de/df/d1e/l21 0 2024-04-25T13:46:57.907 INFO:tasks.workunit.client.0.smithi043.stdout:9/70: truncate d0/d6/d7/fd 3931803 0 2024-04-25T13:46:57.907 INFO:tasks.workunit.client.0.smithi043.stdout:5/41: sync 2024-04-25T13:46:57.908 INFO:tasks.workunit.client.0.smithi043.stdout:8/243: sync 2024-04-25T13:46:57.908 INFO:tasks.workunit.client.0.smithi043.stdout:7/110: sync 2024-04-25T13:46:57.908 INFO:tasks.workunit.client.0.smithi043.stdout:1/87: sync 2024-04-25T13:46:57.908 INFO:tasks.workunit.client.0.smithi043.stdout:6/126: sync 2024-04-25T13:46:57.908 INFO:tasks.workunit.client.0.smithi043.stdout:2/47: sync 2024-04-25T13:46:57.909 INFO:tasks.workunit.client.0.smithi043.stdout:2/48: chown d0/l6 129427690 1 2024-04-25T13:46:57.909 INFO:tasks.workunit.client.0.smithi043.stdout:4/108: symlink d1/de/df/d1e/l22 0 2024-04-25T13:46:57.911 INFO:tasks.workunit.client.0.smithi043.stdout:9/71: creat d0/d6/d7/f16 x:0 0 0 2024-04-25T13:46:57.913 INFO:tasks.workunit.client.0.smithi043.stdout:5/42: dread d1/d3/d7/d8/df/fd [0,4194304] 0 2024-04-25T13:46:57.917 INFO:tasks.workunit.client.0.smithi043.stdout:5/43: write d1/d3/d7/d8/df/fd [3766416,10658] 0 2024-04-25T13:46:57.918 INFO:tasks.workunit.client.0.smithi043.stdout:5/44: chown d1/d3/d7/d8/df 75 1 2024-04-25T13:46:57.919 INFO:tasks.workunit.client.0.smithi043.stdout:9/72: dwrite d0/d6/d7/f10 [0,4194304] 0 2024-04-25T13:46:57.920 INFO:tasks.workunit.client.0.smithi043.stdout:2/49: creat d0/d8/ff x:0 0 0 2024-04-25T13:46:57.921 INFO:tasks.workunit.client.0.smithi043.stdout:9/73: fdatasync d0/d6/d7/f16 0 2024-04-25T13:46:57.921 INFO:tasks.workunit.client.0.smithi043.stdout:4/109: mkdir d1/d23 0 2024-04-25T13:46:57.923 INFO:tasks.workunit.client.0.smithi043.stdout:9/74: stat d0/le 0 2024-04-25T13:46:57.923 INFO:tasks.workunit.client.0.smithi043.stdout:7/111: symlink d5/l2b 0 2024-04-25T13:46:57.925 INFO:tasks.workunit.client.0.smithi043.stdout:6/127: creat d0/d24/f26 x:0 0 0 2024-04-25T13:46:57.926 INFO:tasks.workunit.client.0.smithi043.stdout:8/244: dwrite db/d11/f15 [0,4194304] 0 2024-04-25T13:46:57.927 INFO:tasks.workunit.client.0.smithi043.stdout:3/150: link d0/d9/d15/f2f d0/f33 0 2024-04-25T13:46:57.927 INFO:tasks.workunit.client.0.smithi043.stdout:1/88: chown df/d10/f13 0 1 2024-04-25T13:46:57.929 INFO:tasks.workunit.client.0.smithi043.stdout:5/45: rmdir d1/d3 39 2024-04-25T13:46:57.936 INFO:tasks.workunit.client.0.smithi043.stdout:6/128: mknod d0/d1b/c27 0 2024-04-25T13:46:57.938 INFO:tasks.workunit.client.0.smithi043.stdout:8/245: chown db/dc 4264 1 2024-04-25T13:46:57.939 INFO:tasks.workunit.client.0.smithi043.stdout:7/112: dwrite d5/d11/f28 [0,4194304] 0 2024-04-25T13:46:57.947 INFO:tasks.workunit.client.0.smithi043.stdout:3/151: dwrite d0/da/f28 [0,4194304] 0 2024-04-25T13:46:57.949 INFO:tasks.workunit.client.0.smithi043.stdout:6/129: rename d0/f1a to d0/d1c/f28 0 2024-04-25T13:46:57.952 INFO:tasks.workunit.client.0.smithi043.stdout:2/50: truncate d0/d8/fc 278523 0 2024-04-25T13:46:57.980 INFO:tasks.workunit.client.0.smithi043.stdout:3/152: truncate d0/da/f11 2425877 0 2024-04-25T13:46:57.980 INFO:tasks.workunit.client.0.smithi043.stdout:5/46: unlink d1/d3/d7/d8/df/ce 0 2024-04-25T13:46:57.980 INFO:tasks.workunit.client.0.smithi043.stdout:4/110: link d1/c13 d1/d3/c24 0 2024-04-25T13:46:57.980 INFO:tasks.workunit.client.0.smithi043.stdout:3/153: chown d0/cd 1 1 2024-04-25T13:46:57.980 INFO:tasks.workunit.client.0.smithi043.stdout:9/75: link d0/le d0/d6/d7/l17 0 2024-04-25T13:46:57.980 INFO:tasks.workunit.client.0.smithi043.stdout:4/111: stat d1/de/d1d/d20 0 2024-04-25T13:46:57.980 INFO:tasks.workunit.client.0.smithi043.stdout:3/154: dread - d0/d9/d15/f1f zero size 2024-04-25T13:46:57.980 INFO:tasks.workunit.client.0.smithi043.stdout:6/130: dread d0/f12 [0,4194304] 0 2024-04-25T13:46:57.980 INFO:tasks.workunit.client.0.smithi043.stdout:7/113: mknod d5/c2c 0 2024-04-25T13:46:57.980 INFO:tasks.workunit.client.0.smithi043.stdout:5/47: rename d1/d3/d7/d8/db to d1/d3/d7/d8/da/d11 0 2024-04-25T13:46:57.980 INFO:tasks.workunit.client.0.smithi043.stdout:9/76: creat d0/d6/dc/f18 x:0 0 0 2024-04-25T13:46:57.980 INFO:tasks.workunit.client.0.smithi043.stdout:3/155: fdatasync d0/d13/d2e/f31 0 2024-04-25T13:46:57.981 INFO:tasks.workunit.client.0.smithi043.stdout:4/112: dwrite d1/de/df/f16 [0,4194304] 0 2024-04-25T13:46:57.981 INFO:tasks.workunit.client.0.smithi043.stdout:1/89: symlink df/d14/l1a 0 2024-04-25T13:46:57.981 INFO:tasks.workunit.client.0.smithi043.stdout:4/113: read d1/de/df/f16 [4162464,58478] 0 2024-04-25T13:46:57.981 INFO:tasks.workunit.client.0.smithi043.stdout:1/90: readlink df/d14/l1a 0 2024-04-25T13:46:57.981 INFO:tasks.workunit.client.0.smithi043.stdout:1/91: write df/d10/f12 [992816,110196] 0 2024-04-25T13:46:57.981 INFO:tasks.workunit.client.0.smithi043.stdout:5/48: dread d1/d3/d7/d8/df/fd [0,4194304] 0 2024-04-25T13:46:57.981 INFO:tasks.workunit.client.0.smithi043.stdout:6/131: creat d0/f29 x:0 0 0 2024-04-25T13:46:57.981 INFO:tasks.workunit.client.0.smithi043.stdout:6/132: dread - d0/f13 zero size 2024-04-25T13:46:57.981 INFO:tasks.workunit.client.0.smithi043.stdout:9/77: creat d0/d6/d7/f19 x:0 0 0 2024-04-25T13:46:57.981 INFO:tasks.workunit.client.0.smithi043.stdout:9/78: stat d0/d6/dc/f18 0 2024-04-25T13:46:57.981 INFO:tasks.workunit.client.0.smithi043.stdout:4/114: symlink d1/l25 0 2024-04-25T13:46:57.982 INFO:tasks.workunit.client.0.smithi043.stdout:2/51: write d0/d8/fc [64490,69347] 0 2024-04-25T13:46:57.983 INFO:tasks.workunit.client.0.smithi043.stdout:9/79: truncate d0/d6/fa 135191 0 2024-04-25T13:46:57.984 INFO:tasks.workunit.client.0.smithi043.stdout:7/114: dwrite d5/f29 [0,4194304] 0 2024-04-25T13:46:57.986 INFO:tasks.workunit.client.0.smithi043.stdout:7/115: readlink d5/l1d 0 2024-04-25T13:46:57.987 INFO:tasks.workunit.client.0.smithi043.stdout:4/115: symlink d1/de/df/l26 0 2024-04-25T13:46:57.989 INFO:tasks.workunit.client.0.smithi043.stdout:5/49: creat d1/f12 x:0 0 0 2024-04-25T13:46:57.990 INFO:tasks.workunit.client.0.smithi043.stdout:3/156: write d0/d9/d15/f2f [286283,72331] 0 2024-04-25T13:46:57.990 INFO:tasks.workunit.client.0.smithi043.stdout:6/133: link d0/d1b/c27 d0/d1c/c2a 0 2024-04-25T13:46:57.995 INFO:tasks.workunit.client.0.smithi043.stdout:4/116: mkdir d1/de/df/d1a/d27 0 2024-04-25T13:46:57.995 INFO:tasks.workunit.client.0.smithi043.stdout:1/92: creat df/f1b x:0 0 0 2024-04-25T13:46:57.996 INFO:tasks.workunit.client.0.smithi043.stdout:3/157: write d0/d14/f22 [890204,91612] 0 2024-04-25T13:46:57.997 INFO:tasks.workunit.client.0.smithi043.stdout:9/80: creat d0/d6/f1a x:0 0 0 2024-04-25T13:46:57.998 INFO:tasks.workunit.client.0.smithi043.stdout:2/52: dwrite d0/d8/fc [0,4194304] 0 2024-04-25T13:46:58.001 INFO:tasks.workunit.client.0.smithi043.stdout:9/81: readlink d0/le 0 2024-04-25T13:46:58.002 INFO:tasks.workunit.client.0.smithi043.stdout:4/117: fsync d1/fd 0 2024-04-25T13:46:58.004 INFO:tasks.workunit.client.0.smithi043.stdout:6/134: write d0/fc [1152719,66771] 0 2024-04-25T13:46:58.007 INFO:tasks.workunit.client.0.smithi043.stdout:3/158: mkdir d0/d9/d15/d34 0 2024-04-25T13:46:58.011 INFO:tasks.workunit.client.0.smithi043.stdout:9/82: creat d0/d6/dc/f1b x:0 0 0 2024-04-25T13:46:58.012 INFO:tasks.workunit.client.0.smithi043.stdout:6/135: dread d0/f20 [4194304,4194304] 0 2024-04-25T13:46:58.014 INFO:tasks.workunit.client.0.smithi043.stdout:3/159: fsync d0/f2 0 2024-04-25T13:46:58.016 INFO:tasks.workunit.client.0.smithi043.stdout:5/50: dwrite d1/d3/d7/d8/df/fd [4194304,4194304] 0 2024-04-25T13:46:58.019 INFO:tasks.workunit.client.0.smithi043.stdout:7/116: dwrite d5/d11/f14 [0,4194304] 0 2024-04-25T13:46:58.020 INFO:tasks.workunit.client.0.smithi043.stdout:9/83: write d0/d6/dc/f18 [467518,27152] 0 2024-04-25T13:46:58.021 INFO:tasks.workunit.client.0.smithi043.stdout:2/53: link d0/d8/fa d0/d5/f10 0 2024-04-25T13:46:58.023 INFO:tasks.workunit.client.0.smithi043.stdout:1/93: dread df/d10/f13 [0,4194304] 0 2024-04-25T13:46:58.025 INFO:tasks.workunit.client.0.smithi043.stdout:2/54: fsync d0/d8/fd 0 2024-04-25T13:46:58.026 INFO:tasks.workunit.client.0.smithi043.stdout:1/94: dread - f9 zero size 2024-04-25T13:46:58.026 INFO:tasks.workunit.client.0.smithi043.stdout:5/51: write d1/d3/d7/d8/df/fd [4201294,18421] 0 2024-04-25T13:46:58.026 INFO:tasks.workunit.client.0.smithi043.stdout:4/118: dwrite d1/f14 [4194304,4194304] 0 2024-04-25T13:46:58.029 INFO:tasks.workunit.client.0.smithi043.stdout:7/117: creat d5/f2d x:0 0 0 2024-04-25T13:46:58.030 INFO:tasks.workunit.client.0.smithi043.stdout:1/95: chown c8 26 1 2024-04-25T13:46:58.032 INFO:tasks.workunit.client.0.smithi043.stdout:2/55: creat d0/d8/f11 x:0 0 0 2024-04-25T13:46:58.033 INFO:tasks.workunit.client.0.smithi043.stdout:4/119: write d1/d3/f9 [1888207,83291] 0 2024-04-25T13:46:58.036 INFO:tasks.workunit.client.0.smithi043.stdout:6/136: dwrite d0/d1b/f1d [0,4194304] 0 2024-04-25T13:46:58.038 INFO:tasks.workunit.client.0.smithi043.stdout:3/160: unlink d0/l18 0 2024-04-25T13:46:58.039 INFO:tasks.workunit.client.0.smithi043.stdout:1/96: rename df/d14/f19 to df/d14/f1c 0 2024-04-25T13:46:58.042 INFO:tasks.workunit.client.0.smithi043.stdout:4/120: mkdir d1/de/df/d1e/d28 0 2024-04-25T13:46:58.045 INFO:tasks.workunit.client.0.smithi043.stdout:1/97: symlink df/d10/l1d 0 2024-04-25T13:46:58.046 INFO:tasks.workunit.client.0.smithi043.stdout:6/137: dread d0/fb [0,4194304] 0 2024-04-25T13:46:58.046 INFO:tasks.workunit.client.0.smithi043.stdout:2/56: truncate d0/d8/fd 2987417 0 2024-04-25T13:46:58.046 INFO:tasks.workunit.client.0.smithi043.stdout:6/138: chown d0/f19 605 1 2024-04-25T13:46:58.046 INFO:tasks.workunit.client.0.smithi043.stdout:5/52: getdents d1/d4 0 2024-04-25T13:46:58.046 INFO:tasks.workunit.client.0.smithi043.stdout:7/118: link d5/f12 d5/f2e 0 2024-04-25T13:46:58.049 INFO:tasks.workunit.client.0.smithi043.stdout:7/119: chown d5/d11/f20 24635049 1 2024-04-25T13:46:58.052 INFO:tasks.workunit.client.0.smithi043.stdout:2/57: rmdir d0 39 2024-04-25T13:46:58.052 INFO:tasks.workunit.client.0.smithi043.stdout:0/127: sync 2024-04-25T13:46:58.053 INFO:tasks.workunit.client.0.smithi043.stdout:7/120: mknod d5/d11/c2f 0 2024-04-25T13:46:58.053 INFO:tasks.workunit.client.0.smithi043.stdout:6/139: link d0/d1c/l22 d0/l2b 0 2024-04-25T13:46:58.066 INFO:tasks.workunit.client.0.smithi043.stdout:4/121: dwrite d1/de/df/f18 [0,4194304] 0 2024-04-25T13:46:58.067 INFO:tasks.workunit.client.0.smithi043.stdout:7/121: chown d5/d11 103400256 1 2024-04-25T13:46:58.069 INFO:tasks.workunit.client.0.smithi043.stdout:2/58: read - d0/d8/f11 zero size 2024-04-25T13:46:58.072 INFO:tasks.workunit.client.0.smithi043.stdout:5/53: dwrite d1/f12 [0,4194304] 0 2024-04-25T13:46:58.073 INFO:tasks.workunit.client.0.smithi043.stdout:0/128: mkdir db/d1b/d23/d27 0 2024-04-25T13:46:58.077 INFO:tasks.workunit.client.0.smithi043.stdout:3/161: creat d0/f35 x:0 0 0 2024-04-25T13:46:58.077 INFO:tasks.workunit.client.0.smithi043.stdout:5/54: chown d1/d3/d7/cc 2 1 2024-04-25T13:46:58.080 INFO:tasks.workunit.client.0.smithi043.stdout:5/55: chown d1/d3/d7 2087618 1 2024-04-25T13:46:58.083 INFO:tasks.workunit.client.0.smithi043.stdout:4/122: dwrite d1/f14 [4194304,4194304] 0 2024-04-25T13:46:58.084 INFO:tasks.workunit.client.0.smithi043.stdout:6/140: getdents d0 0 2024-04-25T13:46:58.084 INFO:tasks.workunit.client.0.smithi043.stdout:7/122: dwrite d5/fd [0,4194304] 0 2024-04-25T13:46:58.086 INFO:tasks.workunit.client.0.smithi043.stdout:2/59: dread d0/d8/fc [0,4194304] 0 2024-04-25T13:46:58.087 INFO:tasks.workunit.client.0.smithi043.stdout:4/123: chown d1/de/df 2957868 1 2024-04-25T13:46:58.087 INFO:tasks.workunit.client.0.smithi043.stdout:7/123: chown d5/fd 9704 1 2024-04-25T13:46:58.087 INFO:tasks.workunit.client.0.smithi043.stdout:1/98: rename cb to df/d14/c1e 0 2024-04-25T13:46:58.088 INFO:tasks.workunit.client.0.smithi043.stdout:7/124: readlink d5/l1d 0 2024-04-25T13:46:58.088 INFO:tasks.workunit.client.0.smithi043.stdout:1/99: stat f9 0 2024-04-25T13:46:58.089 INFO:tasks.workunit.client.0.smithi043.stdout:5/56: fdatasync d1/f12 0 2024-04-25T13:46:58.090 INFO:tasks.workunit.client.0.smithi043.stdout:6/141: rename d0/l21 to d0/l2c 0 2024-04-25T13:46:58.094 INFO:tasks.workunit.client.0.smithi043.stdout:1/100: write fc [614744,115925] 0 2024-04-25T13:46:58.096 INFO:tasks.workunit.client.0.smithi043.stdout:4/124: dread d1/d3/f15 [0,4194304] 0 2024-04-25T13:46:58.097 INFO:tasks.workunit.client.0.smithi043.stdout:6/142: symlink d0/d24/l2d 0 2024-04-25T13:46:58.099 INFO:tasks.workunit.client.0.smithi043.stdout:1/101: symlink df/d10/l1f 0 2024-04-25T13:46:58.100 INFO:tasks.workunit.client.0.smithi043.stdout:6/143: truncate d0/f4 4635715 0 2024-04-25T13:46:58.101 INFO:tasks.workunit.client.0.smithi043.stdout:5/57: dread d1/d3/d7/d8/df/fd [0,4194304] 0 2024-04-25T13:46:58.101 INFO:tasks.workunit.client.0.smithi043.stdout:2/60: chown d0/d8/db/le 608026 1 2024-04-25T13:46:58.103 INFO:tasks.workunit.client.0.smithi043.stdout:3/162: dread - d0/d9/d15/f1f zero size 2024-04-25T13:46:58.104 INFO:tasks.workunit.client.0.smithi043.stdout:6/144: write d0/d1b/f1d [4250014,128946] 0 2024-04-25T13:46:58.107 INFO:tasks.workunit.client.0.smithi043.stdout:5/58: write d1/d3/d7/d8/df/fd [4897291,130861] 0 2024-04-25T13:46:58.108 INFO:tasks.workunit.client.0.smithi043.stdout:2/61: getdents d0/d5 0 2024-04-25T13:46:58.108 INFO:tasks.workunit.client.0.smithi043.stdout:3/163: chown d0/d9/d15/l16 239636029 1 2024-04-25T13:46:58.109 INFO:tasks.workunit.client.0.smithi043.stdout:4/125: dread d1/f14 [4194304,4194304] 0 2024-04-25T13:46:58.110 INFO:tasks.workunit.client.0.smithi043.stdout:2/62: stat d0/d8/fd 0 2024-04-25T13:46:58.111 INFO:tasks.workunit.client.0.smithi043.stdout:4/126: fdatasync d1/de/df/f16 0 2024-04-25T13:46:58.115 INFO:tasks.workunit.client.0.smithi043.stdout:3/164: unlink d0/d14/f29 0 2024-04-25T13:46:58.115 INFO:tasks.workunit.client.0.smithi043.stdout:4/127: symlink d1/de/df/l29 0 2024-04-25T13:46:58.119 INFO:tasks.workunit.client.0.smithi043.stdout:3/165: write d0/f33 [553938,7224] 0 2024-04-25T13:46:58.119 INFO:tasks.workunit.client.0.smithi043.stdout:2/63: rmdir d0/d8/db 39 2024-04-25T13:46:58.120 INFO:tasks.workunit.client.0.smithi043.stdout:6/145: dwrite d0/fe [0,4194304] 0 2024-04-25T13:46:58.122 INFO:tasks.workunit.client.0.smithi043.stdout:5/59: dwrite d1/f12 [4194304,4194304] 0 2024-04-25T13:46:58.125 INFO:tasks.workunit.client.0.smithi043.stdout:3/166: read d0/f33 [67112,65865] 0 2024-04-25T13:46:58.126 INFO:tasks.workunit.client.0.smithi043.stdout:2/64: creat d0/f12 x:0 0 0 2024-04-25T13:46:58.127 INFO:tasks.workunit.client.0.smithi043.stdout:5/60: mkdir d1/d3/d7/d8/da/d11/d13 0 2024-04-25T13:46:58.129 INFO:tasks.workunit.client.0.smithi043.stdout:4/128: dwrite d1/de/df/f18 [0,4194304] 0 2024-04-25T13:46:58.132 INFO:tasks.workunit.client.0.smithi043.stdout:3/167: mkdir d0/d9/d15/d34/d36 0 2024-04-25T13:46:58.139 INFO:tasks.workunit.client.0.smithi043.stdout:2/65: creat d0/d8/f13 x:0 0 0 2024-04-25T13:46:58.141 INFO:tasks.workunit.client.0.smithi043.stdout:4/129: getdents d1/de/df/d1a/d27 0 2024-04-25T13:46:58.141 INFO:tasks.workunit.client.0.smithi043.stdout:1/102: rename fa to df/f20 0 2024-04-25T13:46:58.143 INFO:tasks.workunit.client.0.smithi043.stdout:5/61: link d1/d3/d7/cc d1/d3/d7/d8/da/d11/d13/c14 0 2024-04-25T13:46:58.145 INFO:tasks.workunit.client.0.smithi043.stdout:3/168: symlink d0/l37 0 2024-04-25T13:46:58.149 INFO:tasks.workunit.client.0.smithi043.stdout:5/62: dread d1/d3/d7/d8/df/fd [0,4194304] 0 2024-04-25T13:46:58.152 INFO:tasks.workunit.client.0.smithi043.stdout:2/66: mknod d0/d8/db/c14 0 2024-04-25T13:46:58.153 INFO:tasks.workunit.client.0.smithi043.stdout:2/67: fdatasync d0/d8/f11 0 2024-04-25T13:46:58.154 INFO:tasks.workunit.client.0.smithi043.stdout:5/63: dread d1/d3/d7/d8/df/fd [0,4194304] 0 2024-04-25T13:46:58.155 INFO:tasks.workunit.client.0.smithi043.stdout:2/68: mknod d0/d5/c15 0 2024-04-25T13:46:58.156 INFO:tasks.workunit.client.0.smithi043.stdout:1/103: creat df/d14/f21 x:0 0 0 2024-04-25T13:46:58.157 INFO:tasks.workunit.client.0.smithi043.stdout:5/64: symlink d1/l15 0 2024-04-25T13:46:58.159 INFO:tasks.workunit.client.0.smithi043.stdout:5/65: stat d1/d3/d7/d8/da 0 2024-04-25T13:46:58.161 INFO:tasks.workunit.client.0.smithi043.stdout:2/69: getdents d0/d5 0 2024-04-25T13:46:58.163 INFO:tasks.workunit.client.0.smithi043.stdout:1/104: dwrite f2 [0,4194304] 0 2024-04-25T13:46:58.163 INFO:tasks.workunit.client.0.smithi043.stdout:2/70: dread - d0/d8/ff zero size 2024-04-25T13:46:58.164 INFO:tasks.workunit.client.0.smithi043.stdout:2/71: dread - d0/f12 zero size 2024-04-25T13:46:58.164 INFO:tasks.workunit.client.0.smithi043.stdout:1/105: chown df/d14/c1e 8553 1 2024-04-25T13:46:58.165 INFO:tasks.workunit.client.0.smithi043.stdout:1/106: chown f2 3165865 1 2024-04-25T13:46:58.165 INFO:tasks.workunit.client.0.smithi043.stdout:2/72: chown d0/f12 52146 1 2024-04-25T13:46:58.166 INFO:tasks.workunit.client.0.smithi043.stdout:1/107: fsync fe 0 2024-04-25T13:46:58.166 INFO:tasks.workunit.client.0.smithi043.stdout:1/108: chown df/f20 390 1 2024-04-25T13:46:58.168 INFO:tasks.workunit.client.0.smithi043.stdout:2/73: rename d0/d5/c15 to d0/c16 0 2024-04-25T13:46:58.170 INFO:tasks.workunit.client.0.smithi043.stdout:1/109: dread df/d10/f13 [0,4194304] 0 2024-04-25T13:46:58.170 INFO:tasks.workunit.client.0.smithi043.stdout:2/74: read d0/d8/fc [3354512,1001] 0 2024-04-25T13:46:58.170 INFO:tasks.workunit.client.0.smithi043.stdout:5/66: truncate d1/d3/d7/d8/df/fd 7668387 0 2024-04-25T13:46:58.172 INFO:tasks.workunit.client.0.smithi043.stdout:2/75: dread - d0/d8/f11 zero size 2024-04-25T13:46:58.176 INFO:tasks.workunit.client.0.smithi043.stdout:2/76: read d0/d8/fa [790856,130421] 0 2024-04-25T13:46:58.177 INFO:tasks.workunit.client.0.smithi043.stdout:1/110: getdents df/d14 0 2024-04-25T13:46:58.183 INFO:tasks.workunit.client.0.smithi043.stdout:3/169: dread d0/da/fc [4194304,4194304] 0 2024-04-25T13:46:58.187 INFO:tasks.workunit.client.0.smithi043.stdout:3/170: rmdir d0/d14 39 2024-04-25T13:46:58.189 INFO:tasks.workunit.client.0.smithi043.stdout:5/67: truncate d1/d3/d7/d8/df/fd 1958089 0 2024-04-25T13:46:58.191 INFO:tasks.workunit.client.0.smithi043.stdout:2/77: mkdir d0/d8/db/d17 0 2024-04-25T13:46:58.192 INFO:tasks.workunit.client.0.smithi043.stdout:5/68: mknod d1/d3/d7/d8/c16 0 2024-04-25T13:46:58.192 INFO:tasks.workunit.client.0.smithi043.stdout:3/171: read d0/fe [4673,28920] 0 2024-04-25T13:46:58.194 INFO:tasks.workunit.client.0.smithi043.stdout:2/78: rename d0/d8/f11 to d0/f18 0 2024-04-25T13:46:58.202 INFO:tasks.workunit.client.0.smithi043.stdout:5/69: dread d1/d3/d7/d8/df/fd [0,4194304] 0 2024-04-25T13:46:58.204 INFO:tasks.workunit.client.0.smithi043.stdout:5/70: read d1/f12 [199623,57536] 0 2024-04-25T13:46:58.207 INFO:tasks.workunit.client.0.smithi043.stdout:2/79: getdents d0/d8/db 0 2024-04-25T13:46:58.208 INFO:tasks.workunit.client.0.smithi043.stdout:3/172: dwrite d0/da/f2d [0,4194304] 0 2024-04-25T13:46:58.208 INFO:tasks.workunit.client.0.smithi043.stdout:2/80: chown d0/d8/fc 35850 1 2024-04-25T13:46:58.208 INFO:tasks.workunit.client.0.smithi043.stdout:5/71: unlink d1/d3/d7/d8/df/c10 0 2024-04-25T13:46:58.212 INFO:tasks.workunit.client.0.smithi043.stdout:5/72: creat d1/d3/d7/d8/f17 x:0 0 0 2024-04-25T13:46:58.213 INFO:tasks.workunit.client.0.smithi043.stdout:5/73: write d1/d3/d7/d8/f17 [323961,91031] 0 2024-04-25T13:46:58.214 INFO:tasks.workunit.client.0.smithi043.stdout:2/81: getdents d0 0 2024-04-25T13:46:58.215 INFO:tasks.workunit.client.0.smithi043.stdout:3/173: getdents d0/d9/d15 0 2024-04-25T13:46:58.217 INFO:tasks.workunit.client.0.smithi043.stdout:2/82: rmdir d0 39 2024-04-25T13:46:58.217 INFO:tasks.workunit.client.0.smithi043.stdout:2/83: chown d0/d8 45577 1 2024-04-25T13:46:58.220 INFO:tasks.workunit.client.0.smithi043.stdout:5/74: link d1/d3/d7/d8/c16 d1/d3/d7/d8/da/c18 0 2024-04-25T13:46:58.221 INFO:tasks.workunit.client.0.smithi043.stdout:2/84: rmdir d0 39 2024-04-25T13:46:58.222 INFO:tasks.workunit.client.0.smithi043.stdout:3/174: dwrite d0/da/f28 [0,4194304] 0 2024-04-25T13:46:58.225 INFO:tasks.workunit.client.0.smithi043.stdout:5/75: creat d1/f19 x:0 0 0 2024-04-25T13:46:58.229 INFO:tasks.workunit.client.0.smithi043.stdout:2/85: link d0/l3 d0/l19 0 2024-04-25T13:46:58.230 INFO:tasks.workunit.client.0.smithi043.stdout:5/76: dread d1/f12 [4194304,4194304] 0 2024-04-25T13:46:58.230 INFO:tasks.workunit.client.0.smithi043.stdout:3/175: mkdir d0/d9/d15/d38 0 2024-04-25T13:46:58.234 INFO:tasks.workunit.client.0.smithi043.stdout:5/77: link d1/d3/d7/d8/df/fd d1/d3/f1a 0 2024-04-25T13:46:58.237 INFO:tasks.workunit.client.0.smithi043.stdout:5/78: mknod d1/d3/d7/d8/da/c1b 0 2024-04-25T13:46:58.245 INFO:tasks.workunit.client.0.smithi043.stdout:8/246: sync 2024-04-25T13:46:58.247 INFO:tasks.workunit.client.0.smithi043.stdout:8/247: mkdir db/d11/d1b/d59 0 2024-04-25T13:46:58.253 INFO:tasks.workunit.client.0.smithi043.stdout:8/248: truncate f4 5279871 0 2024-04-25T13:46:58.255 INFO:tasks.workunit.client.0.smithi043.stdout:8/249: mknod db/d11/c5a 0 2024-04-25T13:46:58.255 INFO:tasks.workunit.client.0.smithi043.stdout:8/250: chown db/d11/d1b/d1e/c36 4 1 2024-04-25T13:46:58.256 INFO:tasks.workunit.client.0.smithi043.stdout:2/86: rename d0/d8/fc to d0/d8/db/f1a 0 2024-04-25T13:46:58.257 INFO:tasks.workunit.client.0.smithi043.stdout:8/251: fsync db/d11/d1b/d1e/f53 0 2024-04-25T13:46:58.263 INFO:tasks.workunit.client.0.smithi043.stdout:5/79: rename d1/d3/d7/d8/da/d11/d13/c14 to d1/d3/d7/d8/da/d11/c1c 0 2024-04-25T13:46:58.263 INFO:tasks.workunit.client.0.smithi043.stdout:2/87: rmdir d0/d5 39 2024-04-25T13:46:58.264 INFO:tasks.workunit.client.0.smithi043.stdout:2/88: dread - d0/f18 zero size 2024-04-25T13:46:58.354 INFO:tasks.workunit.client.0.smithi043.stdout:9/84: sync 2024-04-25T13:46:58.358 INFO:tasks.workunit.client.0.smithi043.stdout:3/176: rename d0/da/cb to d0/d9/d15/d34/d36/c39 0 2024-04-25T13:46:58.359 INFO:tasks.workunit.client.0.smithi043.stdout:8/252: rmdir db/dc/d21 39 2024-04-25T13:46:58.359 INFO:tasks.workunit.client.0.smithi043.stdout:5/80: dwrite d1/f19 [0,4194304] 0 2024-04-25T13:46:58.361 INFO:tasks.workunit.client.0.smithi043.stdout:9/85: symlink d0/d6/d7/l1c 0 2024-04-25T13:46:58.362 INFO:tasks.workunit.client.0.smithi043.stdout:8/253: truncate db/d11/f51 57190 0 2024-04-25T13:46:58.362 INFO:tasks.workunit.client.0.smithi043.stdout:3/177: mknod d0/d14/c3a 0 2024-04-25T13:46:58.363 INFO:tasks.workunit.client.0.smithi043.stdout:8/254: fdatasync db/ff 0 2024-04-25T13:46:58.365 INFO:tasks.workunit.client.0.smithi043.stdout:8/255: chown db/l2c 5992082 1 2024-04-25T13:46:58.370 INFO:tasks.workunit.client.0.smithi043.stdout:3/178: creat d0/f3b x:0 0 0 2024-04-25T13:46:58.371 INFO:tasks.workunit.client.0.smithi043.stdout:5/81: dwrite d1/d3/d7/d8/f17 [0,4194304] 0 2024-04-25T13:46:58.372 INFO:tasks.workunit.client.0.smithi043.stdout:9/86: dread d0/d6/d7/fd [0,4194304] 0 2024-04-25T13:46:58.374 INFO:tasks.workunit.client.0.smithi043.stdout:5/82: mknod d1/d3/d7/c1d 0 2024-04-25T13:46:58.377 INFO:tasks.workunit.client.0.smithi043.stdout:5/83: rmdir d1/d3/d7 39 2024-04-25T13:46:58.380 INFO:tasks.workunit.client.0.smithi043.stdout:2/89: dread d0/d5/f10 [0,4194304] 0 2024-04-25T13:46:58.381 INFO:tasks.workunit.client.0.smithi043.stdout:9/87: rename d0/d6 to d0/d1d 0 2024-04-25T13:46:58.382 INFO:tasks.workunit.client.0.smithi043.stdout:8/256: dwrite db/d11/f3d [0,4194304] 0 2024-04-25T13:46:58.386 INFO:tasks.workunit.client.0.smithi043.stdout:5/84: mknod d1/d3/d7/d8/da/c1e 0 2024-04-25T13:46:58.387 INFO:tasks.workunit.client.0.smithi043.stdout:5/85: truncate d1/d3/d7/d8/df/fd 2459382 0 2024-04-25T13:46:58.387 INFO:tasks.workunit.client.0.smithi043.stdout:9/88: rename d0/d1d/f15 to d0/f1e 0 2024-04-25T13:46:58.392 INFO:tasks.workunit.client.0.smithi043.stdout:5/86: unlink d1/d3/d7/cc 0 2024-04-25T13:46:58.395 INFO:tasks.workunit.client.0.smithi043.stdout:9/89: link d0/le d0/l1f 0 2024-04-25T13:46:58.397 INFO:tasks.workunit.client.0.smithi043.stdout:8/257: dwrite db/d11/d1b/d1e/d27/f30 [0,4194304] 0 2024-04-25T13:46:58.398 INFO:tasks.workunit.client.0.smithi043.stdout:9/90: unlink d0/lf 0 2024-04-25T13:46:58.401 INFO:tasks.workunit.client.0.smithi043.stdout:9/91: creat d0/f20 x:0 0 0 2024-04-25T13:46:58.402 INFO:tasks.workunit.client.0.smithi043.stdout:5/87: dread d1/d3/d7/d8/df/fd [0,4194304] 0 2024-04-25T13:46:58.407 INFO:tasks.workunit.client.0.smithi043.stdout:8/258: symlink db/d38/d40/l5b 0 2024-04-25T13:46:58.410 INFO:tasks.workunit.client.0.smithi043.stdout:9/92: getdents d0 0 2024-04-25T13:46:58.411 INFO:tasks.workunit.client.0.smithi043.stdout:9/93: truncate d0/d1d/f9 443537 0 2024-04-25T13:46:58.413 INFO:tasks.workunit.client.0.smithi043.stdout:9/94: creat d0/f21 x:0 0 0 2024-04-25T13:46:58.416 INFO:tasks.workunit.client.0.smithi043.stdout:9/95: getdents d0/d1d/d7 0 2024-04-25T13:46:58.418 INFO:tasks.workunit.client.0.smithi043.stdout:9/96: mkdir d0/d1d/d22 0 2024-04-25T13:46:58.420 INFO:tasks.workunit.client.0.smithi043.stdout:9/97: creat d0/d1d/dc/f23 x:0 0 0 2024-04-25T13:46:58.421 INFO:tasks.workunit.client.0.smithi043.stdout:3/179: rename d0/cd to d0/d9/d15/c3c 0 2024-04-25T13:46:58.424 INFO:tasks.workunit.client.0.smithi043.stdout:9/98: link d0/f4 d0/d1d/d22/f24 0 2024-04-25T13:46:58.428 INFO:tasks.workunit.client.0.smithi043.stdout:9/99: creat d0/d1d/f25 x:0 0 0 2024-04-25T13:46:58.429 INFO:tasks.workunit.client.0.smithi043.stdout:9/100: stat d0/d1d/dc/f1b 0 2024-04-25T13:46:58.430 INFO:tasks.workunit.client.0.smithi043.stdout:9/101: write d0/d1d/dc/f18 [507698,99521] 0 2024-04-25T13:46:58.430 INFO:tasks.workunit.client.0.smithi043.stdout:3/180: creat d0/d13/f3d x:0 0 0 2024-04-25T13:46:58.431 INFO:tasks.workunit.client.0.smithi043.stdout:3/181: truncate d0/f35 302929 0 2024-04-25T13:46:58.432 INFO:tasks.workunit.client.0.smithi043.stdout:9/102: mkdir d0/d1d/dc/d26 0 2024-04-25T13:46:58.433 INFO:tasks.workunit.client.0.smithi043.stdout:9/103: write d0/d1d/f9 [503864,120684] 0 2024-04-25T13:46:58.434 INFO:tasks.workunit.client.0.smithi043.stdout:9/104: chown d0/d1d/f1a 122684 1 2024-04-25T13:46:58.434 INFO:tasks.workunit.client.0.smithi043.stdout:9/105: readlink d0/d1d/l11 0 2024-04-25T13:46:58.435 INFO:tasks.workunit.client.0.smithi043.stdout:9/106: truncate d0/d1d/dc/f18 876342 0 2024-04-25T13:46:58.437 INFO:tasks.workunit.client.0.smithi043.stdout:9/107: creat d0/d1d/d22/f27 x:0 0 0 2024-04-25T13:46:58.441 INFO:tasks.workunit.client.0.smithi043.stdout:7/125: sync 2024-04-25T13:46:58.441 INFO:tasks.workunit.client.0.smithi043.stdout:6/146: sync 2024-04-25T13:46:58.441 INFO:tasks.workunit.client.0.smithi043.stdout:0/129: sync 2024-04-25T13:46:58.443 INFO:tasks.workunit.client.0.smithi043.stdout:0/130: write db/f17 [2194124,4457] 0 2024-04-25T13:46:58.443 INFO:tasks.workunit.client.0.smithi043.stdout:7/126: write d5/f1e [409073,124215] 0 2024-04-25T13:46:58.446 INFO:tasks.workunit.client.0.smithi043.stdout:0/131: mknod db/d1b/c28 0 2024-04-25T13:46:58.447 INFO:tasks.workunit.client.0.smithi043.stdout:9/108: dwrite d0/d1d/dc/f1b [0,4194304] 0 2024-04-25T13:46:58.447 INFO:tasks.workunit.client.0.smithi043.stdout:7/127: symlink d5/l30 0 2024-04-25T13:46:58.451 INFO:tasks.workunit.client.0.smithi043.stdout:0/132: unlink db/c1f 0 2024-04-25T13:46:58.452 INFO:tasks.workunit.client.0.smithi043.stdout:6/147: dwrite d0/f19 [4194304,4194304] 0 2024-04-25T13:46:58.453 INFO:tasks.workunit.client.0.smithi043.stdout:0/133: write db/d1b/f1e [1983446,11856] 0 2024-04-25T13:46:58.454 INFO:tasks.workunit.client.0.smithi043.stdout:9/109: creat d0/d1d/f28 x:0 0 0 2024-04-25T13:46:58.457 INFO:tasks.workunit.client.0.smithi043.stdout:7/128: link d5/f27 d5/d11/f31 0 2024-04-25T13:46:58.458 INFO:tasks.workunit.client.0.smithi043.stdout:7/129: chown d5/f1e 5571 1 2024-04-25T13:46:58.460 INFO:tasks.workunit.client.0.smithi043.stdout:0/134: creat db/d1b/f29 x:0 0 0 2024-04-25T13:46:58.467 INFO:tasks.workunit.client.0.smithi043.stdout:3/182: link d0/d9/d15/f1f d0/d14/f3e 0 2024-04-25T13:46:58.469 INFO:tasks.workunit.client.0.smithi043.stdout:6/148: dwrite d0/f19 [4194304,4194304] 0 2024-04-25T13:46:58.469 INFO:tasks.workunit.client.0.smithi043.stdout:9/110: dwrite d0/d1d/dc/f23 [0,4194304] 0 2024-04-25T13:46:58.471 INFO:tasks.workunit.client.0.smithi043.stdout:0/135: dread db/d1b/f1e [0,4194304] 0 2024-04-25T13:46:58.472 INFO:tasks.workunit.client.0.smithi043.stdout:6/149: fsync d0/fb 0 2024-04-25T13:46:58.475 INFO:tasks.workunit.client.0.smithi043.stdout:6/150: chown d0/c14 4092 1 2024-04-25T13:46:58.479 INFO:tasks.workunit.client.0.smithi043.stdout:3/183: chown d0/da/f11 89451 1 2024-04-25T13:46:58.480 INFO:tasks.workunit.client.0.smithi043.stdout:9/111: rename d0/d1d/d22/f24 to d0/d1d/f29 0 2024-04-25T13:46:58.481 INFO:tasks.workunit.client.0.smithi043.stdout:7/130: dwrite d5/d11/f31 [0,4194304] 0 2024-04-25T13:46:58.482 INFO:tasks.workunit.client.0.smithi043.stdout:6/151: write d0/f12 [2959168,204] 0 2024-04-25T13:46:58.484 INFO:tasks.workunit.client.0.smithi043.stdout:9/112: chown d0/d1d/l11 1 1 2024-04-25T13:46:58.484 INFO:tasks.workunit.client.0.smithi043.stdout:7/131: stat d5/l30 0 2024-04-25T13:46:58.485 INFO:tasks.workunit.client.0.smithi043.stdout:7/132: dread - d5/f18 zero size 2024-04-25T13:46:58.486 INFO:tasks.workunit.client.0.smithi043.stdout:3/184: mkdir d0/d9/d15/d38/d3f 0 2024-04-25T13:46:58.487 INFO:tasks.workunit.client.0.smithi043.stdout:9/113: creat d0/d1d/dc/f2a x:0 0 0 2024-04-25T13:46:58.492 INFO:tasks.workunit.client.0.smithi043.stdout:0/136: dread db/f12 [0,4194304] 0 2024-04-25T13:46:58.492 INFO:tasks.workunit.client.0.smithi043.stdout:7/133: truncate d5/d11/f26 303963 0 2024-04-25T13:46:58.493 INFO:tasks.workunit.client.0.smithi043.stdout:0/137: chown db/d1b 1 1 2024-04-25T13:46:58.493 INFO:tasks.workunit.client.0.smithi043.stdout:3/185: truncate d0/f2 2519897 0 2024-04-25T13:46:58.493 INFO:tasks.workunit.client.0.smithi043.stdout:9/114: mknod d0/d1d/dc/c2b 0 2024-04-25T13:46:58.495 INFO:tasks.workunit.client.0.smithi043.stdout:9/115: dread - d0/d1d/f28 zero size 2024-04-25T13:46:58.495 INFO:tasks.workunit.client.0.smithi043.stdout:7/134: mkdir d5/d32 0 2024-04-25T13:46:58.497 INFO:tasks.workunit.client.0.smithi043.stdout:9/116: dread - d0/f20 zero size 2024-04-25T13:46:58.497 INFO:tasks.workunit.client.0.smithi043.stdout:6/152: dwrite d0/d1c/f28 [4194304,4194304] 0 2024-04-25T13:46:58.497 INFO:tasks.workunit.client.0.smithi043.stdout:0/138: mkdir db/d25/d2a 0 2024-04-25T13:46:58.497 INFO:tasks.workunit.client.0.smithi043.stdout:7/135: rename d5 to d5/d32/d33 22 2024-04-25T13:46:58.499 INFO:tasks.workunit.client.0.smithi043.stdout:9/117: stat d0/l2 0 2024-04-25T13:46:58.500 INFO:tasks.workunit.client.0.smithi043.stdout:6/153: read - d0/f29 zero size 2024-04-25T13:46:58.502 INFO:tasks.workunit.client.0.smithi043.stdout:0/139: write db/f17 [4416276,4563] 0 2024-04-25T13:46:58.503 INFO:tasks.workunit.client.0.smithi043.stdout:7/136: rename d5/f22 to d5/d11/f34 0 2024-04-25T13:46:58.506 INFO:tasks.workunit.client.0.smithi043.stdout:6/154: mkdir d0/d24/d2e 0 2024-04-25T13:46:58.506 INFO:tasks.workunit.client.0.smithi043.stdout:3/186: dwrite d0/d13/f3d [0,4194304] 0 2024-04-25T13:46:58.508 INFO:tasks.workunit.client.0.smithi043.stdout:0/140: creat db/d25/f2b x:0 0 0 2024-04-25T13:46:58.508 INFO:tasks.workunit.client.0.smithi043.stdout:6/155: dread - d0/f29 zero size 2024-04-25T13:46:58.509 INFO:tasks.workunit.client.0.smithi043.stdout:3/187: write d0/f4 [3645491,43969] 0 2024-04-25T13:46:58.511 INFO:tasks.workunit.client.0.smithi043.stdout:7/137: fsync d5/f12 0 2024-04-25T13:46:58.513 INFO:tasks.workunit.client.0.smithi043.stdout:3/188: truncate d0/f2a 329954 0 2024-04-25T13:46:58.513 INFO:tasks.workunit.client.0.smithi043.stdout:9/118: link d0/d1d/dc/c2b d0/d1d/d22/c2c 0 2024-04-25T13:46:58.517 INFO:tasks.workunit.client.0.smithi043.stdout:6/156: mkdir d0/d24/d2e/d2f 0 2024-04-25T13:46:58.519 INFO:tasks.workunit.client.0.smithi043.stdout:9/119: write d0/f1e [834403,19437] 0 2024-04-25T13:46:58.521 INFO:tasks.workunit.client.0.smithi043.stdout:3/189: creat d0/d9/d15/d34/d36/f40 x:0 0 0 2024-04-25T13:46:58.523 INFO:tasks.workunit.client.0.smithi043.stdout:6/157: unlink d0/f19 0 2024-04-25T13:46:58.524 INFO:tasks.workunit.client.0.smithi043.stdout:9/120: mknod d0/c2d 0 2024-04-25T13:46:58.526 INFO:tasks.workunit.client.0.smithi043.stdout:9/121: creat d0/d1d/d7/f2e x:0 0 0 2024-04-25T13:46:58.530 INFO:tasks.workunit.client.0.smithi043.stdout:3/190: symlink d0/d9/d15/l41 0 2024-04-25T13:46:58.531 INFO:tasks.workunit.client.0.smithi043.stdout:9/122: dread d0/f4 [0,4194304] 0 2024-04-25T13:46:58.538 INFO:tasks.workunit.client.0.smithi043.stdout:9/123: dwrite d0/f1e [0,4194304] 0 2024-04-25T13:46:58.544 INFO:tasks.workunit.client.0.smithi043.stdout:3/191: creat d0/d9/d15/d38/d3f/f42 x:0 0 0 2024-04-25T13:46:58.544 INFO:tasks.workunit.client.0.smithi043.stdout:9/124: link d0/d1d/d7/l1c d0/d1d/dc/d26/l2f 0 2024-04-25T13:46:58.544 INFO:tasks.workunit.client.0.smithi043.stdout:3/192: chown d0/d13/d2e/f31 129 1 2024-04-25T13:46:58.547 INFO:tasks.workunit.client.0.smithi043.stdout:9/125: fsync d0/d1d/f29 0 2024-04-25T13:46:58.547 INFO:tasks.workunit.client.0.smithi043.stdout:4/130: sync 2024-04-25T13:46:58.547 INFO:tasks.workunit.client.0.smithi043.stdout:1/111: sync 2024-04-25T13:46:58.548 INFO:tasks.workunit.client.0.smithi043.stdout:4/131: stat d1/de/df/d1e/l22 0 2024-04-25T13:46:58.549 INFO:tasks.workunit.client.0.smithi043.stdout:1/112: truncate df/f20 251222 0 2024-04-25T13:46:58.550 INFO:tasks.workunit.client.0.smithi043.stdout:4/132: chown d1/de/df/l29 5416274 1 2024-04-25T13:46:58.551 INFO:tasks.workunit.client.0.smithi043.stdout:9/126: mknod d0/d1d/d22/c30 0 2024-04-25T13:46:58.551 INFO:tasks.workunit.client.0.smithi043.stdout:9/127: readlink d0/l1f 0 2024-04-25T13:46:58.552 INFO:tasks.workunit.client.0.smithi043.stdout:9/128: write d0/d1d/fa [913235,17438] 0 2024-04-25T13:46:58.554 INFO:tasks.workunit.client.0.smithi043.stdout:4/133: creat d1/de/d1d/f2a x:0 0 0 2024-04-25T13:46:58.559 INFO:tasks.workunit.client.0.smithi043.stdout:4/134: unlink d1/f19 0 2024-04-25T13:46:58.559 INFO:tasks.workunit.client.0.smithi043.stdout:4/135: fsync d1/de/d1d/f2a 0 2024-04-25T13:46:58.562 INFO:tasks.workunit.client.0.smithi043.stdout:9/129: link d0/l2 d0/d1d/dc/l31 0 2024-04-25T13:46:58.562 INFO:tasks.workunit.client.0.smithi043.stdout:1/113: rmdir df/d14 39 2024-04-25T13:46:58.564 INFO:tasks.workunit.client.0.smithi043.stdout:3/193: dwrite d0/d9/d15/f1f [0,4194304] 0 2024-04-25T13:46:58.631 INFO:tasks.workunit.client.0.smithi043.stdout:9/130: symlink d0/d1d/dc/d26/l32 0 2024-04-25T13:46:58.633 INFO:tasks.workunit.client.0.smithi043.stdout:9/131: creat d0/d1d/dc/f33 x:0 0 0 2024-04-25T13:46:58.635 INFO:tasks.workunit.client.0.smithi043.stdout:3/194: creat d0/da/f43 x:0 0 0 2024-04-25T13:46:58.638 INFO:tasks.workunit.client.0.smithi043.stdout:1/114: dwrite df/f16 [0,4194304] 0 2024-04-25T13:46:58.639 INFO:tasks.workunit.client.0.smithi043.stdout:9/132: getdents d0/d1d 0 2024-04-25T13:46:58.642 INFO:tasks.workunit.client.0.smithi043.stdout:9/133: creat d0/d1d/d7/f34 x:0 0 0 2024-04-25T13:46:58.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/115: write df/d14/f1c [712984,55189] 0 2024-04-25T13:46:58.646 INFO:tasks.workunit.client.0.smithi043.stdout:1/116: mkdir df/d10/d22 0 2024-04-25T13:46:58.647 INFO:tasks.workunit.client.0.smithi043.stdout:9/134: mknod d0/d1d/c35 0 2024-04-25T13:46:58.648 INFO:tasks.workunit.client.0.smithi043.stdout:3/195: rmdir d0 39 2024-04-25T13:46:58.648 INFO:tasks.workunit.client.0.smithi043.stdout:1/117: mknod df/d10/d22/c23 0 2024-04-25T13:46:58.649 INFO:tasks.workunit.client.0.smithi043.stdout:3/196: readlink d0/d9/l30 0 2024-04-25T13:46:58.652 INFO:tasks.workunit.client.0.smithi043.stdout:1/118: creat df/d10/f24 x:0 0 0 2024-04-25T13:46:58.653 INFO:tasks.workunit.client.0.smithi043.stdout:1/119: chown f2 2422171 1 2024-04-25T13:46:58.653 INFO:tasks.workunit.client.0.smithi043.stdout:1/120: readlink df/d14/l1a 0 2024-04-25T13:46:58.653 INFO:tasks.workunit.client.0.smithi043.stdout:1/121: dread - df/f1b zero size 2024-04-25T13:46:58.654 INFO:tasks.workunit.client.0.smithi043.stdout:1/122: stat f3 0 2024-04-25T13:46:58.654 INFO:tasks.workunit.client.0.smithi043.stdout:9/135: rename d0/d1d/d7/fd to d0/d1d/dc/f36 0 2024-04-25T13:46:58.656 INFO:tasks.workunit.client.0.smithi043.stdout:1/123: mkdir df/d14/d25 0 2024-04-25T13:46:58.656 INFO:tasks.workunit.client.0.smithi043.stdout:3/197: link d0/f2a d0/d9/f44 0 2024-04-25T13:46:58.657 INFO:tasks.workunit.client.0.smithi043.stdout:9/136: unlink d0/l2 0 2024-04-25T13:46:58.658 INFO:tasks.workunit.client.0.smithi043.stdout:1/124: dread df/d10/f13 [0,4194304] 0 2024-04-25T13:46:58.659 INFO:tasks.workunit.client.0.smithi043.stdout:1/125: dread - df/d14/f21 zero size 2024-04-25T13:46:58.668 INFO:tasks.workunit.client.0.smithi043.stdout:5/88: sync 2024-04-25T13:46:58.668 INFO:tasks.workunit.client.0.smithi043.stdout:2/90: sync 2024-04-25T13:46:58.668 INFO:tasks.workunit.client.0.smithi043.stdout:8/259: sync 2024-04-25T13:46:58.668 INFO:tasks.workunit.client.0.smithi043.stdout:5/89: chown d1/l15 61020 1 2024-04-25T13:46:58.669 INFO:tasks.workunit.client.0.smithi043.stdout:8/260: mkdir db/d44/d5c 0 2024-04-25T13:46:58.672 INFO:tasks.workunit.client.0.smithi043.stdout:5/90: link d1/d3/d7/d8/f17 d1/d3/f1f 0 2024-04-25T13:46:58.675 INFO:tasks.workunit.client.0.smithi043.stdout:5/91: mknod d1/d3/d7/d8/df/c20 0 2024-04-25T13:46:58.676 INFO:tasks.workunit.client.0.smithi043.stdout:8/261: dwrite db/d11/d1b/d1e/f56 [0,4194304] 0 2024-04-25T13:46:58.679 INFO:tasks.workunit.client.0.smithi043.stdout:5/92: dread d1/d3/f1a [0,4194304] 0 2024-04-25T13:46:58.686 INFO:tasks.workunit.client.0.smithi043.stdout:5/93: rename d1/d3/d7/d8/da/c1b to d1/d3/d7/d8/df/c21 0 2024-04-25T13:46:58.687 INFO:tasks.workunit.client.0.smithi043.stdout:8/262: stat db/dc/d28/f43 0 2024-04-25T13:46:58.690 INFO:tasks.workunit.client.0.smithi043.stdout:2/91: rmdir d0/d8/db 39 2024-04-25T13:46:58.692 INFO:tasks.workunit.client.0.smithi043.stdout:8/263: dwrite db/f16 [4194304,4194304] 0 2024-04-25T13:46:58.694 INFO:tasks.workunit.client.0.smithi043.stdout:2/92: read d0/d8/fd [833364,43561] 0 2024-04-25T13:46:58.698 INFO:tasks.workunit.client.0.smithi043.stdout:2/93: dread d0/d8/fa [0,4194304] 0 2024-04-25T13:46:58.699 INFO:tasks.workunit.client.0.smithi043.stdout:5/94: rename d1/d3/d7/d8/df/c21 to d1/c22 0 2024-04-25T13:46:58.699 INFO:tasks.workunit.client.0.smithi043.stdout:8/264: mkdir db/d38/d49/d5d 0 2024-04-25T13:46:58.702 INFO:tasks.workunit.client.0.smithi043.stdout:5/95: unlink d1/d3/f1a 0 2024-04-25T13:46:58.705 INFO:tasks.workunit.client.0.smithi043.stdout:2/94: creat d0/d8/f1b x:0 0 0 2024-04-25T13:46:58.707 INFO:tasks.workunit.client.0.smithi043.stdout:5/96: link d1/d3/d7/d8/f17 d1/d3/d7/f23 0 2024-04-25T13:46:58.711 INFO:tasks.workunit.client.0.smithi043.stdout:8/265: dwrite db/d11/d1b/f47 [0,4194304] 0 2024-04-25T13:46:58.712 INFO:tasks.workunit.client.0.smithi043.stdout:5/97: truncate d1/f12 6660399 0 2024-04-25T13:46:58.713 INFO:tasks.workunit.client.0.smithi043.stdout:2/95: dread d0/d8/db/f1a [0,4194304] 0 2024-04-25T13:46:58.714 INFO:tasks.workunit.client.0.smithi043.stdout:2/96: write d0/d8/f13 [1044205,100956] 0 2024-04-25T13:46:58.717 INFO:tasks.workunit.client.0.smithi043.stdout:2/97: write d0/d8/db/f1a [718774,56592] 0 2024-04-25T13:46:58.718 INFO:tasks.workunit.client.0.smithi043.stdout:5/98: truncate d1/d3/f1f 1326574 0 2024-04-25T13:46:58.719 INFO:tasks.workunit.client.0.smithi043.stdout:5/99: stat d1/d3/d7/d8/df 0 2024-04-25T13:46:58.722 INFO:tasks.workunit.client.0.smithi043.stdout:5/100: unlink d1/d3/d7/d8/df/c20 0 2024-04-25T13:46:58.722 INFO:tasks.workunit.client.0.smithi043.stdout:2/98: fsync d0/d8/f1b 0 2024-04-25T13:46:58.736 INFO:tasks.workunit.client.0.smithi043.stdout:2/99: dwrite d0/d8/ff [0,4194304] 0 2024-04-25T13:46:58.740 INFO:tasks.workunit.client.0.smithi043.stdout:5/101: dwrite d1/d3/d7/d8/f17 [0,4194304] 0 2024-04-25T13:46:58.742 INFO:tasks.workunit.client.0.smithi043.stdout:2/100: symlink d0/d8/db/l1c 0 2024-04-25T13:46:58.747 INFO:tasks.workunit.client.0.smithi043.stdout:2/101: truncate d0/d8/fa 2174156 0 2024-04-25T13:46:58.750 INFO:tasks.workunit.client.0.smithi043.stdout:2/102: chown d0/l19 1232 1 2024-04-25T13:46:58.752 INFO:tasks.workunit.client.0.smithi043.stdout:5/102: dwrite d1/d3/d7/f23 [0,4194304] 0 2024-04-25T13:46:58.756 INFO:tasks.workunit.client.0.smithi043.stdout:2/103: dread d0/d8/ff [0,4194304] 0 2024-04-25T13:46:58.757 INFO:tasks.workunit.client.0.smithi043.stdout:8/266: dread db/dc/f23 [0,4194304] 0 2024-04-25T13:46:58.758 INFO:tasks.workunit.client.0.smithi043.stdout:8/267: chown db/d46 91510772 1 2024-04-25T13:46:58.758 INFO:tasks.workunit.client.0.smithi043.stdout:2/104: chown d0/d8/ff 22374877 1 2024-04-25T13:46:58.758 INFO:tasks.workunit.client.0.smithi043.stdout:8/268: chown db/dc/f23 197832 1 2024-04-25T13:46:58.761 INFO:tasks.workunit.client.0.smithi043.stdout:7/138: sync 2024-04-25T13:46:58.761 INFO:tasks.workunit.client.0.smithi043.stdout:0/141: sync 2024-04-25T13:46:58.762 INFO:tasks.workunit.client.0.smithi043.stdout:0/142: dread - db/d1b/f29 zero size 2024-04-25T13:46:58.766 INFO:tasks.workunit.client.0.smithi043.stdout:5/103: rename d1/d3/d7/d8/da/d11/d13 to d1/d3/d24 0 2024-04-25T13:46:58.767 INFO:tasks.workunit.client.0.smithi043.stdout:8/269: getdents db/d38/d49 0 2024-04-25T13:46:58.768 INFO:tasks.workunit.client.0.smithi043.stdout:7/139: creat d5/f35 x:0 0 0 2024-04-25T13:46:58.770 INFO:tasks.workunit.client.0.smithi043.stdout:0/143: mknod db/d25/d2a/c2c 0 2024-04-25T13:46:58.770 INFO:tasks.workunit.client.0.smithi043.stdout:7/140: fdatasync f4 0 2024-04-25T13:46:58.774 INFO:tasks.workunit.client.0.smithi043.stdout:7/141: fsync d5/f35 0 2024-04-25T13:46:58.775 INFO:tasks.workunit.client.0.smithi043.stdout:5/104: dread d1/f19 [0,4194304] 0 2024-04-25T13:46:58.776 INFO:tasks.workunit.client.0.smithi043.stdout:7/142: chown d5/d32 25626 1 2024-04-25T13:46:58.777 INFO:tasks.workunit.client.0.smithi043.stdout:2/105: creat d0/d8/db/f1d x:0 0 0 2024-04-25T13:46:58.780 INFO:tasks.workunit.client.0.smithi043.stdout:0/144: dwrite db/d1b/f29 [0,4194304] 0 2024-04-25T13:46:58.783 INFO:tasks.workunit.client.0.smithi043.stdout:2/106: truncate d0/d8/fd 1581208 0 2024-04-25T13:46:58.784 INFO:tasks.workunit.client.0.smithi043.stdout:8/270: dwrite db/dc/d21/f4c [0,4194304] 0 2024-04-25T13:46:58.786 INFO:tasks.workunit.client.0.smithi043.stdout:5/105: creat d1/d3/d7/d8/da/d11/f25 x:0 0 0 2024-04-25T13:46:58.788 INFO:tasks.workunit.client.0.smithi043.stdout:8/271: chown db/d11/d1b/d1e/f42 8 1 2024-04-25T13:46:58.789 INFO:tasks.workunit.client.0.smithi043.stdout:7/143: dwrite d5/d11/f20 [0,4194304] 0 2024-04-25T13:46:58.790 INFO:tasks.workunit.client.0.smithi043.stdout:8/272: write db/dc/d21/f39 [792211,47741] 0 2024-04-25T13:46:58.790 INFO:tasks.workunit.client.0.smithi043.stdout:0/145: creat db/f2d x:0 0 0 2024-04-25T13:46:58.790 INFO:tasks.workunit.client.0.smithi043.stdout:7/144: chown d5/f12 92570 1 2024-04-25T13:46:58.795 INFO:tasks.workunit.client.0.smithi043.stdout:6/158: sync 2024-04-25T13:46:58.801 INFO:tasks.workunit.client.0.smithi043.stdout:5/106: mkdir d1/d3/d26 0 2024-04-25T13:46:58.802 INFO:tasks.workunit.client.0.smithi043.stdout:6/159: unlink d0/d24/f26 0 2024-04-25T13:46:58.803 INFO:tasks.workunit.client.0.smithi043.stdout:6/160: chown d0/c8 151099 1 2024-04-25T13:46:58.804 INFO:tasks.workunit.client.0.smithi043.stdout:0/146: creat db/d25/d2a/f2e x:0 0 0 2024-04-25T13:46:58.806 INFO:tasks.workunit.client.0.smithi043.stdout:5/107: rename d1/d3/f1f to d1/d3/d26/f27 0 2024-04-25T13:46:58.808 INFO:tasks.workunit.client.0.smithi043.stdout:0/147: chown db/d25/d2a/f2e 562 1 2024-04-25T13:46:58.810 INFO:tasks.workunit.client.0.smithi043.stdout:7/145: dwrite d5/d11/f34 [0,4194304] 0 2024-04-25T13:46:58.810 INFO:tasks.workunit.client.0.smithi043.stdout:6/161: mknod d0/d1b/c30 0 2024-04-25T13:46:58.813 INFO:tasks.workunit.client.0.smithi043.stdout:5/108: unlink d1/l15 0 2024-04-25T13:46:58.817 INFO:tasks.workunit.client.0.smithi043.stdout:0/148: dwrite f9 [4194304,4194304] 0 2024-04-25T13:46:58.819 INFO:tasks.workunit.client.0.smithi043.stdout:5/109: chown d1/d3/d7/d8/c16 7332 1 2024-04-25T13:46:58.821 INFO:tasks.workunit.client.0.smithi043.stdout:6/162: link d0/f29 d0/f31 0 2024-04-25T13:46:58.822 INFO:tasks.workunit.client.0.smithi043.stdout:0/149: mkdir db/d2f 0 2024-04-25T13:46:58.823 INFO:tasks.workunit.client.0.smithi043.stdout:8/273: dwrite db/dc/f23 [0,4194304] 0 2024-04-25T13:46:58.825 INFO:tasks.workunit.client.0.smithi043.stdout:5/110: truncate d1/d3/d7/d8/da/d11/f25 587846 0 2024-04-25T13:46:58.826 INFO:tasks.workunit.client.0.smithi043.stdout:6/163: creat d0/d24/d2e/d2f/f32 x:0 0 0 2024-04-25T13:46:58.829 INFO:tasks.workunit.client.0.smithi043.stdout:7/146: dread d5/f10 [0,4194304] 0 2024-04-25T13:46:58.833 INFO:tasks.workunit.client.0.smithi043.stdout:7/147: mkdir d5/d36 0 2024-04-25T13:46:58.833 INFO:tasks.workunit.client.0.smithi043.stdout:0/150: dread f6 [0,4194304] 0 2024-04-25T13:46:58.836 INFO:tasks.workunit.client.0.smithi043.stdout:5/111: dread d1/d3/d7/d8/df/fd [0,4194304] 0 2024-04-25T13:46:58.838 INFO:tasks.workunit.client.0.smithi043.stdout:7/148: getdents d5/d32 0 2024-04-25T13:46:58.839 INFO:tasks.workunit.client.0.smithi043.stdout:0/151: chown db/d1b/f26 93325191 1 2024-04-25T13:46:58.840 INFO:tasks.workunit.client.0.smithi043.stdout:6/164: dread d0/d1c/f28 [4194304,4194304] 0 2024-04-25T13:46:58.841 INFO:tasks.workunit.client.0.smithi043.stdout:8/274: dwrite db/dc/d21/d4e/f58 [0,4194304] 0 2024-04-25T13:46:58.844 INFO:tasks.workunit.client.0.smithi043.stdout:4/136: sync 2024-04-25T13:46:58.844 INFO:tasks.workunit.client.0.smithi043.stdout:9/137: sync 2024-04-25T13:46:58.844 INFO:tasks.workunit.client.0.smithi043.stdout:3/198: sync 2024-04-25T13:46:58.845 INFO:tasks.workunit.client.0.smithi043.stdout:1/126: sync 2024-04-25T13:46:58.846 INFO:tasks.workunit.client.0.smithi043.stdout:5/112: rmdir d1/d3/d7 39 2024-04-25T13:46:58.847 INFO:tasks.workunit.client.0.smithi043.stdout:1/127: chown fe 1595 1 2024-04-25T13:46:58.847 INFO:tasks.workunit.client.0.smithi043.stdout:6/165: read d0/d1c/f28 [3448455,83167] 0 2024-04-25T13:46:58.850 INFO:tasks.workunit.client.0.smithi043.stdout:4/137: write d1/de/d1d/f2a [723668,17403] 0 2024-04-25T13:46:58.854 INFO:tasks.workunit.client.0.smithi043.stdout:6/166: truncate d0/f29 290483 0 2024-04-25T13:46:58.854 INFO:tasks.workunit.client.0.smithi043.stdout:2/107: dread d0/d8/fd [0,4194304] 0 2024-04-25T13:46:58.854 INFO:tasks.workunit.client.0.smithi043.stdout:3/199: truncate d0/fe 1171459 0 2024-04-25T13:46:58.854 INFO:tasks.workunit.client.0.smithi043.stdout:7/149: dwrite d5/d11/f28 [0,4194304] 0 2024-04-25T13:46:58.855 INFO:tasks.workunit.client.0.smithi043.stdout:1/128: creat df/d10/d22/f26 x:0 0 0 2024-04-25T13:46:58.855 INFO:tasks.workunit.client.0.smithi043.stdout:4/138: write d1/de/f1c [35166,58557] 0 2024-04-25T13:46:58.856 INFO:tasks.workunit.client.0.smithi043.stdout:8/275: rmdir db/d38/d49 39 2024-04-25T13:46:58.858 INFO:tasks.workunit.client.0.smithi043.stdout:7/150: chown d5/c2c 1974967723 1 2024-04-25T13:46:58.858 INFO:tasks.workunit.client.0.smithi043.stdout:5/113: write d1/d3/d7/d8/da/d11/f25 [1113465,124967] 0 2024-04-25T13:46:58.859 INFO:tasks.workunit.client.0.smithi043.stdout:1/129: truncate df/f1b 578978 0 2024-04-25T13:46:58.861 INFO:tasks.workunit.client.0.smithi043.stdout:9/138: getdents d0 0 2024-04-25T13:46:58.864 INFO:tasks.workunit.client.0.smithi043.stdout:1/130: write f2 [1794766,48591] 0 2024-04-25T13:46:58.870 INFO:tasks.workunit.client.0.smithi043.stdout:8/276: symlink db/d46/l5e 0 2024-04-25T13:46:58.876 INFO:tasks.workunit.client.0.smithi043.stdout:1/131: unlink df/d10/d22/c23 0 2024-04-25T13:46:58.876 INFO:tasks.workunit.client.0.smithi043.stdout:4/139: dread d1/de/d1d/f2a [0,4194304] 0 2024-04-25T13:46:58.877 INFO:tasks.workunit.client.0.smithi043.stdout:0/152: dwrite db/fc [0,4194304] 0 2024-04-25T13:46:58.878 INFO:tasks.workunit.client.0.smithi043.stdout:6/167: dwrite d0/d1c/f28 [0,4194304] 0 2024-04-25T13:46:58.883 INFO:tasks.workunit.client.0.smithi043.stdout:4/140: fsync d1/de/df/f16 0 2024-04-25T13:46:58.885 INFO:tasks.workunit.client.0.smithi043.stdout:1/132: chown df/d10/f12 1 1 2024-04-25T13:46:58.886 INFO:tasks.workunit.client.0.smithi043.stdout:7/151: dwrite d5/f15 [0,4194304] 0 2024-04-25T13:46:58.886 INFO:tasks.workunit.client.0.smithi043.stdout:2/108: write d0/d8/db/f1a [2263364,21892] 0 2024-04-25T13:46:58.889 INFO:tasks.workunit.client.0.smithi043.stdout:6/168: write d0/d1c/f28 [6487103,50176] 0 2024-04-25T13:46:58.892 INFO:tasks.workunit.client.0.smithi043.stdout:9/139: chown d0/d1d/d22/c2c 106237527 1 2024-04-25T13:46:58.895 INFO:tasks.workunit.client.0.smithi043.stdout:6/169: chown d0/d1b 306357021 1 2024-04-25T13:46:58.895 INFO:tasks.workunit.client.0.smithi043.stdout:0/153: chown db/c1a 3070593 1 2024-04-25T13:46:58.898 INFO:tasks.workunit.client.0.smithi043.stdout:2/109: write d0/d8/fd [1624415,16809] 0 2024-04-25T13:46:58.902 INFO:tasks.workunit.client.0.smithi043.stdout:5/114: dwrite d1/d3/d7/f23 [0,4194304] 0 2024-04-25T13:46:58.903 INFO:tasks.workunit.client.0.smithi043.stdout:2/110: readlink d0/d5/l9 0 2024-04-25T13:46:58.904 INFO:tasks.workunit.client.0.smithi043.stdout:7/152: link d5/l1d d5/d32/l37 0 2024-04-25T13:46:58.905 INFO:tasks.workunit.client.0.smithi043.stdout:0/154: mknod db/d2f/c30 0 2024-04-25T13:46:58.905 INFO:tasks.workunit.client.0.smithi043.stdout:9/140: read d0/d1d/dc/f18 [673772,31737] 0 2024-04-25T13:46:58.906 INFO:tasks.workunit.client.0.smithi043.stdout:2/111: stat d0/d5 0 2024-04-25T13:46:58.912 INFO:tasks.workunit.client.0.smithi043.stdout:4/141: dwrite d1/d3/f9 [0,4194304] 0 2024-04-25T13:46:58.912 INFO:tasks.workunit.client.0.smithi043.stdout:3/200: dread d0/da/fc [0,4194304] 0 2024-04-25T13:46:58.912 INFO:tasks.workunit.client.0.smithi043.stdout:5/115: mkdir d1/d3/d7/d8/df/d28 0 2024-04-25T13:46:58.913 INFO:tasks.workunit.client.0.smithi043.stdout:2/112: mkdir d0/d5/d1e 0 2024-04-25T13:46:58.915 INFO:tasks.workunit.client.0.smithi043.stdout:4/142: chown d1/de/d1d 17612 1 2024-04-25T13:46:58.915 INFO:tasks.workunit.client.0.smithi043.stdout:0/155: write db/f12 [3360518,68134] 0 2024-04-25T13:46:58.915 INFO:tasks.workunit.client.0.smithi043.stdout:7/153: symlink d5/l38 0 2024-04-25T13:46:58.922 INFO:tasks.workunit.client.0.smithi043.stdout:6/170: dwrite d0/f29 [0,4194304] 0 2024-04-25T13:46:58.926 INFO:tasks.workunit.client.0.smithi043.stdout:9/141: link d0/d1d/d22/f27 d0/d1d/d7/f37 0 2024-04-25T13:46:58.929 INFO:tasks.workunit.client.0.smithi043.stdout:4/143: mknod d1/d3/c2b 0 2024-04-25T13:46:58.929 INFO:tasks.workunit.client.0.smithi043.stdout:8/277: dread db/d11/f20 [0,4194304] 0 2024-04-25T13:46:58.931 INFO:tasks.workunit.client.0.smithi043.stdout:3/201: read d0/f3 [2272355,112521] 0 2024-04-25T13:46:58.935 INFO:tasks.workunit.client.0.smithi043.stdout:7/154: dread d5/d11/f19 [0,4194304] 0 2024-04-25T13:46:58.935 INFO:tasks.workunit.client.0.smithi043.stdout:6/171: truncate d0/d24/d2e/d2f/f32 711545 0 2024-04-25T13:46:58.935 INFO:tasks.workunit.client.0.smithi043.stdout:5/116: rename d1/d3/d7/d8/da/c1e to d1/d3/d7/d9/c29 0 2024-04-25T13:46:58.935 INFO:tasks.workunit.client.0.smithi043.stdout:9/142: dread - d0/d1d/d7/f37 zero size 2024-04-25T13:46:58.937 INFO:tasks.workunit.client.0.smithi043.stdout:3/202: write d0/d14/f22 [1944660,127419] 0 2024-04-25T13:46:58.940 INFO:tasks.workunit.client.0.smithi043.stdout:4/144: creat d1/de/d1d/f2c x:0 0 0 2024-04-25T13:46:58.945 INFO:tasks.workunit.client.0.smithi043.stdout:6/172: symlink d0/d1b/l33 0 2024-04-25T13:46:58.946 INFO:tasks.workunit.client.0.smithi043.stdout:7/155: unlink d5/f29 0 2024-04-25T13:46:58.946 INFO:tasks.workunit.client.0.smithi043.stdout:2/113: dwrite d0/d8/f13 [0,4194304] 0 2024-04-25T13:46:58.946 INFO:tasks.workunit.client.0.smithi043.stdout:0/156: dwrite db/f1d [0,4194304] 0 2024-04-25T13:46:58.947 INFO:tasks.workunit.client.0.smithi043.stdout:1/133: dread f3 [4194304,4194304] 0 2024-04-25T13:46:58.949 INFO:tasks.workunit.client.0.smithi043.stdout:5/117: creat d1/d3/d26/f2a x:0 0 0 2024-04-25T13:46:58.949 INFO:tasks.workunit.client.0.smithi043.stdout:2/114: fsync d0/f12 0 2024-04-25T13:46:58.952 INFO:tasks.workunit.client.0.smithi043.stdout:1/134: write f2 [1590581,46148] 0 2024-04-25T13:46:58.957 INFO:tasks.workunit.client.0.smithi043.stdout:8/278: dread db/d11/f20 [0,4194304] 0 2024-04-25T13:46:58.958 INFO:tasks.workunit.client.0.smithi043.stdout:9/143: mknod d0/d1d/dc/c38 0 2024-04-25T13:46:58.960 INFO:tasks.workunit.client.0.smithi043.stdout:3/203: link d0/d14/f22 d0/d9/f45 0 2024-04-25T13:46:58.960 INFO:tasks.workunit.client.0.smithi043.stdout:1/135: mknod df/d10/d22/c27 0 2024-04-25T13:46:58.961 INFO:tasks.workunit.client.0.smithi043.stdout:2/115: dread d0/d8/fd [0,4194304] 0 2024-04-25T13:46:58.965 INFO:tasks.workunit.client.0.smithi043.stdout:6/173: dread d0/f31 [0,4194304] 0 2024-04-25T13:46:58.965 INFO:tasks.workunit.client.0.smithi043.stdout:4/145: link d1/fd d1/de/df/d1a/f2d 0 2024-04-25T13:46:58.967 INFO:tasks.workunit.client.0.smithi043.stdout:7/156: link d5/l1a d5/d32/l39 0 2024-04-25T13:46:58.968 INFO:tasks.workunit.client.0.smithi043.stdout:8/279: read db/ff [3761630,15268] 0 2024-04-25T13:46:58.970 INFO:tasks.workunit.client.0.smithi043.stdout:5/118: dwrite d1/d3/d26/f2a [0,4194304] 0 2024-04-25T13:46:58.971 INFO:tasks.workunit.client.0.smithi043.stdout:6/174: rmdir d0/d1c 39 2024-04-25T13:46:58.971 INFO:tasks.workunit.client.0.smithi043.stdout:4/146: read d1/d3/f9 [259581,78036] 0 2024-04-25T13:46:58.972 INFO:tasks.workunit.client.0.smithi043.stdout:2/116: getdents d0/d8/db/d17 0 2024-04-25T13:46:58.973 INFO:tasks.workunit.client.0.smithi043.stdout:9/144: mkdir d0/d1d/dc/d26/d39 0 2024-04-25T13:46:58.974 INFO:tasks.workunit.client.0.smithi043.stdout:3/204: unlink d0/d9/d15/d34/d36/f40 0 2024-04-25T13:46:58.979 INFO:tasks.workunit.client.0.smithi043.stdout:6/175: creat d0/d24/d2e/f34 x:0 0 0 2024-04-25T13:46:58.980 INFO:tasks.workunit.client.0.smithi043.stdout:0/157: dwrite db/d1b/f26 [0,4194304] 0 2024-04-25T13:46:58.983 INFO:tasks.workunit.client.0.smithi043.stdout:1/136: dwrite df/d10/f13 [0,4194304] 0 2024-04-25T13:46:58.983 INFO:tasks.workunit.client.0.smithi043.stdout:7/157: creat d5/d32/f3a x:0 0 0 2024-04-25T13:46:58.984 INFO:tasks.workunit.client.0.smithi043.stdout:5/119: truncate d1/d3/d7/d8/f17 5018641 0 2024-04-25T13:46:58.987 INFO:tasks.workunit.client.0.smithi043.stdout:0/158: creat db/d1b/d23/f31 x:0 0 0 2024-04-25T13:46:58.987 INFO:tasks.workunit.client.0.smithi043.stdout:7/158: mkdir d5/d11/d3b 0 2024-04-25T13:46:58.989 INFO:tasks.workunit.client.0.smithi043.stdout:6/176: symlink d0/l35 0 2024-04-25T13:46:58.990 INFO:tasks.workunit.client.0.smithi043.stdout:4/147: dwrite d1/de/f1c [0,4194304] 0 2024-04-25T13:46:58.991 INFO:tasks.workunit.client.0.smithi043.stdout:3/205: mknod d0/c46 0 2024-04-25T13:46:58.994 INFO:tasks.workunit.client.0.smithi043.stdout:9/145: getdents d0/d1d/d7 0 2024-04-25T13:46:58.996 INFO:tasks.workunit.client.0.smithi043.stdout:5/120: dread d1/d3/d7/d8/df/fd [0,4194304] 0 2024-04-25T13:46:58.998 INFO:tasks.workunit.client.0.smithi043.stdout:4/148: write d1/de/f1c [2367724,91540] 0 2024-04-25T13:46:58.998 INFO:tasks.workunit.client.0.smithi043.stdout:9/146: chown d0/f1e 288 1 2024-04-25T13:46:59.000 INFO:tasks.workunit.client.0.smithi043.stdout:7/159: creat d5/f3c x:0 0 0 2024-04-25T13:46:59.002 INFO:tasks.workunit.client.0.smithi043.stdout:1/137: dwrite df/d10/f12 [0,4194304] 0 2024-04-25T13:46:59.003 INFO:tasks.workunit.client.0.smithi043.stdout:9/147: read d0/f1e [2016917,4033] 0 2024-04-25T13:46:59.003 INFO:tasks.workunit.client.0.smithi043.stdout:4/149: chown d1/c17 1602812458 1 2024-04-25T13:46:59.004 INFO:tasks.workunit.client.0.smithi043.stdout:5/121: fsync d1/d3/d7/d8/da/d11/f25 0 2024-04-25T13:46:59.005 INFO:tasks.workunit.client.0.smithi043.stdout:0/159: dread db/d1b/f1e [0,4194304] 0 2024-04-25T13:46:59.005 INFO:tasks.workunit.client.0.smithi043.stdout:7/160: unlink d5/l1d 0 2024-04-25T13:46:59.007 INFO:tasks.workunit.client.0.smithi043.stdout:6/177: dread d0/f31 [0,4194304] 0 2024-04-25T13:46:59.009 INFO:tasks.workunit.client.0.smithi043.stdout:7/161: write d5/d32/f3a [730059,112938] 0 2024-04-25T13:46:59.011 INFO:tasks.workunit.client.0.smithi043.stdout:1/138: getdents df/d10/d22 0 2024-04-25T13:46:59.012 INFO:tasks.workunit.client.0.smithi043.stdout:9/148: mkdir d0/d1d/d7/d3a 0 2024-04-25T13:46:59.013 INFO:tasks.workunit.client.0.smithi043.stdout:5/122: dread d1/f12 [4194304,4194304] 0 2024-04-25T13:46:59.015 INFO:tasks.workunit.client.0.smithi043.stdout:4/150: symlink d1/de/df/d1e/d28/l2e 0 2024-04-25T13:46:59.021 INFO:tasks.workunit.client.0.smithi043.stdout:6/178: dwrite d0/f12 [0,4194304] 0 2024-04-25T13:46:59.023 INFO:tasks.workunit.client.0.smithi043.stdout:7/162: dread d5/f1e [0,4194304] 0 2024-04-25T13:46:59.030 INFO:tasks.workunit.client.0.smithi043.stdout:6/179: rmdir d0/d24 39 2024-04-25T13:46:59.031 INFO:tasks.workunit.client.0.smithi043.stdout:3/206: stat d0/da/f11 0 2024-04-25T13:46:59.033 INFO:tasks.workunit.client.0.smithi043.stdout:9/149: creat d0/d1d/dc/d26/d39/f3b x:0 0 0 2024-04-25T13:46:59.033 INFO:tasks.workunit.client.0.smithi043.stdout:1/139: dwrite f3 [8388608,4194304] 0 2024-04-25T13:46:59.034 INFO:tasks.workunit.client.0.smithi043.stdout:7/163: dwrite d5/f27 [4194304,4194304] 0 2024-04-25T13:46:59.035 INFO:tasks.workunit.client.0.smithi043.stdout:5/123: creat d1/d3/d7/d8/df/d28/f2b x:0 0 0 2024-04-25T13:46:59.036 INFO:tasks.workunit.client.0.smithi043.stdout:7/164: fdatasync d5/d11/f20 0 2024-04-25T13:46:59.037 INFO:tasks.workunit.client.0.smithi043.stdout:7/165: dread d5/f10 [0,4194304] 0 2024-04-25T13:46:59.038 INFO:tasks.workunit.client.0.smithi043.stdout:4/151: symlink d1/de/df/d1a/d27/l2f 0 2024-04-25T13:46:59.042 INFO:tasks.workunit.client.0.smithi043.stdout:7/166: write d5/fd [2851319,73013] 0 2024-04-25T13:46:59.042 INFO:tasks.workunit.client.0.smithi043.stdout:4/152: write d1/de/df/f16 [1472891,64823] 0 2024-04-25T13:46:59.042 INFO:tasks.workunit.client.0.smithi043.stdout:6/180: write d0/d1c/f28 [2205093,77929] 0 2024-04-25T13:46:59.044 INFO:tasks.workunit.client.0.smithi043.stdout:1/140: mkdir df/d14/d28 0 2024-04-25T13:46:59.044 INFO:tasks.workunit.client.0.smithi043.stdout:7/167: dread - d5/f3c zero size 2024-04-25T13:46:59.044 INFO:tasks.workunit.client.0.smithi043.stdout:1/141: readlink df/d10/l1f 0 2024-04-25T13:46:59.046 INFO:tasks.workunit.client.0.smithi043.stdout:1/142: chown df/d10/l1f 21 1 2024-04-25T13:46:59.053 INFO:tasks.workunit.client.0.smithi043.stdout:4/153: creat d1/de/df/d1e/f30 x:0 0 0 2024-04-25T13:46:59.055 INFO:tasks.workunit.client.0.smithi043.stdout:1/143: write df/f20 [557323,51931] 0 2024-04-25T13:46:59.055 INFO:tasks.workunit.client.0.smithi043.stdout:7/168: getdents d5/d36 0 2024-04-25T13:46:59.056 INFO:tasks.workunit.client.0.smithi043.stdout:8/280: rename db/dc/d21/c54 to db/d44/c5f 0 2024-04-25T13:46:59.057 INFO:tasks.workunit.client.0.smithi043.stdout:9/150: write d0/d1d/f29 [1430891,85825] 0 2024-04-25T13:46:59.058 INFO:tasks.workunit.client.0.smithi043.stdout:4/154: unlink d1/c17 0 2024-04-25T13:46:59.059 INFO:tasks.workunit.client.0.smithi043.stdout:5/124: truncate d1/d3/d26/f2a 212648 0 2024-04-25T13:46:59.059 INFO:tasks.workunit.client.0.smithi043.stdout:8/281: chown db/dc/d21 9850 1 2024-04-25T13:46:59.060 INFO:tasks.workunit.client.0.smithi043.stdout:1/144: write df/d10/d22/f26 [711679,127139] 0 2024-04-25T13:46:59.060 INFO:tasks.workunit.client.0.smithi043.stdout:7/169: chown d5/d11/f14 10456255 1 2024-04-25T13:46:59.061 INFO:tasks.workunit.client.0.smithi043.stdout:2/117: rename d0/d8/f1b to d0/d5/d1e/f1f 0 2024-04-25T13:46:59.062 INFO:tasks.workunit.client.0.smithi043.stdout:5/125: fdatasync d1/d3/d7/f23 0 2024-04-25T13:46:59.064 INFO:tasks.workunit.client.0.smithi043.stdout:4/155: unlink d1/fd 0 2024-04-25T13:46:59.065 INFO:tasks.workunit.client.0.smithi043.stdout:9/151: write d0/d1d/dc/f23 [269426,117502] 0 2024-04-25T13:46:59.066 INFO:tasks.workunit.client.0.smithi043.stdout:1/145: fdatasync fe 0 2024-04-25T13:46:59.073 INFO:tasks.workunit.client.0.smithi043.stdout:5/126: dwrite d1/d3/d7/d8/da/d11/f25 [0,4194304] 0 2024-04-25T13:46:59.074 INFO:tasks.workunit.client.0.smithi043.stdout:5/127: chown d1/d3/d7 59403 1 2024-04-25T13:46:59.085 INFO:tasks.workunit.client.0.smithi043.stdout:1/146: unlink df/f17 0 2024-04-25T13:46:59.089 INFO:tasks.workunit.client.0.smithi043.stdout:9/152: rename d0/d1d/dc/c14 to d0/d1d/dc/d26/d39/c3c 0 2024-04-25T13:46:59.094 INFO:tasks.workunit.client.0.smithi043.stdout:7/170: link d5/d11/f20 d5/d32/f3d 0 2024-04-25T13:46:59.094 INFO:tasks.workunit.client.0.smithi043.stdout:4/156: dwrite d1/de/df/d1a/f2d [0,4194304] 0 2024-04-25T13:46:59.095 INFO:tasks.workunit.client.0.smithi043.stdout:7/171: chown d5/d11/c2a 3969707 1 2024-04-25T13:46:59.096 INFO:tasks.workunit.client.0.smithi043.stdout:1/147: truncate fe 3434281 0 2024-04-25T13:46:59.098 INFO:tasks.workunit.client.0.smithi043.stdout:9/153: write d0/f1e [2589311,122675] 0 2024-04-25T13:46:59.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:46:58 smithi161 ceph-mon[32696]: pgmap v74: 129 pgs: 129 active+clean; 181 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 15 MiB/s wr, 246 op/s 2024-04-25T13:46:59.105 INFO:tasks.workunit.client.0.smithi043.stdout:5/128: getdents d1/d3/d7 0 2024-04-25T13:46:59.106 INFO:tasks.workunit.client.0.smithi043.stdout:4/157: dwrite d1/d3/f15 [0,4194304] 0 2024-04-25T13:46:59.109 INFO:tasks.workunit.client.0.smithi043.stdout:4/158: write d1/de/df/f16 [3107837,81978] 0 2024-04-25T13:46:59.109 INFO:tasks.workunit.client.0.smithi043.stdout:8/282: link db/d38/l52 db/l60 0 2024-04-25T13:46:59.111 INFO:tasks.workunit.client.0.smithi043.stdout:5/129: write d1/d3/d7/d8/df/fd [3359087,104156] 0 2024-04-25T13:46:59.111 INFO:tasks.workunit.client.0.smithi043.stdout:9/154: creat d0/d1d/f3d x:0 0 0 2024-04-25T13:46:59.117 INFO:tasks.workunit.client.0.smithi043.stdout:9/155: write d0/d1d/fa [1840817,52205] 0 2024-04-25T13:46:59.118 INFO:tasks.workunit.client.0.smithi043.stdout:4/159: mknod d1/de/df/d1e/c31 0 2024-04-25T13:46:59.118 INFO:tasks.workunit.client.0.smithi043.stdout:9/156: read - d0/d1d/dc/d26/d39/f3b zero size 2024-04-25T13:46:59.120 INFO:tasks.workunit.client.0.smithi043.stdout:7/172: truncate d5/d11/f28 4105070 0 2024-04-25T13:46:59.125 INFO:tasks.workunit.client.0.smithi043.stdout:8/283: dread db/dc/d21/f39 [0,4194304] 0 2024-04-25T13:46:59.126 INFO:tasks.workunit.client.0.smithi043.stdout:8/284: chown db/d11/f3d 16188 1 2024-04-25T13:46:59.129 INFO:tasks.workunit.client.0.smithi043.stdout:5/130: unlink d1/d3/d7/d9/c29 0 2024-04-25T13:46:59.131 INFO:tasks.workunit.client.0.smithi043.stdout:9/157: dread d0/d1d/dc/f36 [0,4194304] 0 2024-04-25T13:46:59.131 INFO:tasks.workunit.client.0.smithi043.stdout:4/160: mknod d1/d23/c32 0 2024-04-25T13:46:59.132 INFO:tasks.workunit.client.0.smithi043.stdout:5/131: write d1/d3/d7/d8/df/d28/f2b [568471,1549] 0 2024-04-25T13:46:59.139 INFO:tasks.workunit.client.0.smithi043.stdout:5/132: dwrite d1/d3/d7/f23 [4194304,4194304] 0 2024-04-25T13:46:59.140 INFO:tasks.workunit.client.0.smithi043.stdout:8/285: creat db/d46/f61 x:0 0 0 2024-04-25T13:46:59.140 INFO:tasks.workunit.client.0.smithi043.stdout:2/118: link d0/f12 d0/d8/db/f20 0 2024-04-25T13:46:59.142 INFO:tasks.workunit.client.0.smithi043.stdout:1/148: chown df/d14/d28 20 1 2024-04-25T13:46:59.143 INFO:tasks.workunit.client.0.smithi043.stdout:7/173: creat d5/d36/f3e x:0 0 0 2024-04-25T13:46:59.143 INFO:tasks.workunit.client.0.smithi043.stdout:1/149: write df/d10/f24 [600621,2818] 0 2024-04-25T13:46:59.143 INFO:tasks.workunit.client.0.smithi043.stdout:8/286: mkdir db/dc/d21/d4e/d62 0 2024-04-25T13:46:59.144 INFO:tasks.workunit.client.0.smithi043.stdout:1/150: fsync f3 0 2024-04-25T13:46:59.144 INFO:tasks.workunit.client.0.smithi043.stdout:7/174: chown d5/d11/f14 323838 1 2024-04-25T13:46:59.145 INFO:tasks.workunit.client.0.smithi043.stdout:4/161: mkdir d1/de/df/d1e/d28/d33 0 2024-04-25T13:46:59.146 INFO:tasks.workunit.client.0.smithi043.stdout:4/162: write d1/d3/f15 [157173,20230] 0 2024-04-25T13:46:59.150 INFO:tasks.workunit.client.0.smithi043.stdout:5/133: rename d1/f12 to d1/d3/d7/d8/da/f2c 0 2024-04-25T13:46:59.154 INFO:tasks.workunit.client.0.smithi043.stdout:7/175: dwrite d5/fe [0,4194304] 0 2024-04-25T13:46:59.155 INFO:tasks.workunit.client.0.smithi043.stdout:9/158: mknod d0/d1d/c3e 0 2024-04-25T13:46:59.155 INFO:tasks.workunit.client.0.smithi043.stdout:7/176: stat d5/d11/c2f 0 2024-04-25T13:46:59.156 INFO:tasks.workunit.client.0.smithi043.stdout:8/287: rmdir db 39 2024-04-25T13:46:59.164 INFO:tasks.workunit.client.0.smithi043.stdout:9/159: rmdir d0/d1d/dc/d26/d39 39 2024-04-25T13:46:59.166 INFO:tasks.workunit.client.0.smithi043.stdout:5/134: rmdir d1/d3/d7/d8/da/d11 39 2024-04-25T13:46:59.168 INFO:tasks.workunit.client.0.smithi043.stdout:2/119: fdatasync d0/d8/db/f1d 0 2024-04-25T13:46:59.170 INFO:tasks.workunit.client.0.smithi043.stdout:8/288: write db/d11/f51 [575278,112839] 0 2024-04-25T13:46:59.171 INFO:tasks.workunit.client.0.smithi043.stdout:4/163: write d1/de/df/d1a/f2d [3036009,123693] 0 2024-04-25T13:46:59.173 INFO:tasks.workunit.client.0.smithi043.stdout:9/160: truncate d0/f4 922982 0 2024-04-25T13:46:59.175 INFO:tasks.workunit.client.0.smithi043.stdout:5/135: mkdir d1/d3/d7/d9/d2d 0 2024-04-25T13:46:59.175 INFO:tasks.workunit.client.0.smithi043.stdout:9/161: write d0/d1d/d7/f19 [1002686,24175] 0 2024-04-25T13:46:59.176 INFO:tasks.workunit.client.0.smithi043.stdout:3/207: dwrite d0/d9/d15/f2f [0,4194304] 0 2024-04-25T13:46:59.177 INFO:tasks.workunit.client.0.smithi043.stdout:7/177: mkdir d5/d11/d3b/d3f 0 2024-04-25T13:46:59.178 INFO:tasks.workunit.client.0.smithi043.stdout:7/178: fdatasync d5/f2d 0 2024-04-25T13:46:59.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:46:58 smithi175 ceph-mon[32649]: pgmap v74: 129 pgs: 129 active+clean; 181 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 15 MiB/s wr, 246 op/s 2024-04-25T13:46:59.181 INFO:tasks.workunit.client.0.smithi043.stdout:2/120: unlink d0/d5/f10 0 2024-04-25T13:46:59.183 INFO:tasks.workunit.client.0.smithi043.stdout:9/162: creat d0/d1d/d7/f3f x:0 0 0 2024-04-25T13:46:59.190 INFO:tasks.workunit.client.0.smithi043.stdout:5/136: mkdir d1/d3/d7/d8/da/d2e 0 2024-04-25T13:46:59.191 INFO:tasks.workunit.client.0.smithi043.stdout:3/208: symlink d0/l47 0 2024-04-25T13:46:59.192 INFO:tasks.workunit.client.0.smithi043.stdout:5/137: chown d1/d3/d7/d8/c16 9 1 2024-04-25T13:46:59.193 INFO:tasks.workunit.client.0.smithi043.stdout:7/179: dwrite d5/d11/f19 [0,4194304] 0 2024-04-25T13:46:59.197 INFO:tasks.workunit.client.0.smithi043.stdout:2/121: truncate d0/d8/ff 453402 0 2024-04-25T13:46:59.198 INFO:tasks.workunit.client.0.smithi043.stdout:5/138: getdents d1/d4 0 2024-04-25T13:46:59.199 INFO:tasks.workunit.client.0.smithi043.stdout:5/139: write d1/d3/d7/f23 [7709900,100863] 0 2024-04-25T13:46:59.202 INFO:tasks.workunit.client.0.smithi043.stdout:2/122: dread d0/d8/f13 [0,4194304] 0 2024-04-25T13:46:59.206 INFO:tasks.workunit.client.0.smithi043.stdout:2/123: mknod d0/d8/db/d17/c21 0 2024-04-25T13:46:59.208 INFO:tasks.workunit.client.0.smithi043.stdout:5/140: dread d1/d3/d7/d8/da/f2c [4194304,4194304] 0 2024-04-25T13:46:59.208 INFO:tasks.workunit.client.0.smithi043.stdout:2/124: chown d0/d8/db/f1a 17662 1 2024-04-25T13:46:59.209 INFO:tasks.workunit.client.0.smithi043.stdout:2/125: dread - d0/d5/d1e/f1f zero size 2024-04-25T13:46:59.210 INFO:tasks.workunit.client.0.smithi043.stdout:5/141: fdatasync d1/d3/d7/d8/f17 0 2024-04-25T13:46:59.211 INFO:tasks.workunit.client.0.smithi043.stdout:2/126: stat d0/d8/db 0 2024-04-25T13:46:59.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:46:58 smithi043 ceph-mon[29195]: pgmap v74: 129 pgs: 129 active+clean; 181 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 15 MiB/s wr, 246 op/s 2024-04-25T13:46:59.212 INFO:tasks.workunit.client.0.smithi043.stdout:1/151: rename c8 to df/d14/c29 0 2024-04-25T13:46:59.212 INFO:tasks.workunit.client.0.smithi043.stdout:5/142: stat d1/c22 0 2024-04-25T13:46:59.214 INFO:tasks.workunit.client.0.smithi043.stdout:8/289: dread db/dc/f23 [0,4194304] 0 2024-04-25T13:46:59.214 INFO:tasks.workunit.client.0.smithi043.stdout:2/127: write d0/d8/f13 [4798537,61226] 0 2024-04-25T13:46:59.216 INFO:tasks.workunit.client.0.smithi043.stdout:9/163: rename d0/d1d to d0/d1d/d40 22 2024-04-25T13:46:59.218 INFO:tasks.workunit.client.0.smithi043.stdout:5/143: unlink d1/d3/d7/d8/df/d28/f2b 0 2024-04-25T13:46:59.222 INFO:tasks.workunit.client.0.smithi043.stdout:7/180: rename d5/c2c to d5/d11/d3b/d3f/c40 0 2024-04-25T13:46:59.224 INFO:tasks.workunit.client.0.smithi043.stdout:9/164: read - d0/d1d/f25 zero size 2024-04-25T13:46:59.225 INFO:tasks.workunit.client.0.smithi043.stdout:5/144: mkdir d1/d3/d7/d2f 0 2024-04-25T13:46:59.227 INFO:tasks.workunit.client.0.smithi043.stdout:7/181: dread d5/d11/f19 [0,4194304] 0 2024-04-25T13:46:59.228 INFO:tasks.workunit.client.0.smithi043.stdout:9/165: mkdir d0/d1d/d7/d41 0 2024-04-25T13:46:59.231 INFO:tasks.workunit.client.0.smithi043.stdout:5/145: rmdir d1/d3/d7/d9 39 2024-04-25T13:46:59.231 INFO:tasks.workunit.client.0.smithi043.stdout:3/209: dread d0/f3 [0,4194304] 0 2024-04-25T13:46:59.234 INFO:tasks.workunit.client.0.smithi043.stdout:9/166: unlink d0/d1d/dc/l31 0 2024-04-25T13:46:59.235 INFO:tasks.workunit.client.0.smithi043.stdout:9/167: fsync d0/d1d/d7/f2e 0 2024-04-25T13:46:59.237 INFO:tasks.workunit.client.0.smithi043.stdout:1/152: dread fe [0,4194304] 0 2024-04-25T13:46:59.237 INFO:tasks.workunit.client.0.smithi043.stdout:7/182: getdents d5/d11/d3b 0 2024-04-25T13:46:59.238 INFO:tasks.workunit.client.0.smithi043.stdout:1/153: write f9 [377325,53837] 0 2024-04-25T13:46:59.239 INFO:tasks.workunit.client.0.smithi043.stdout:8/290: dread db/d11/d1b/d1e/d27/f30 [0,4194304] 0 2024-04-25T13:46:59.245 INFO:tasks.workunit.client.0.smithi043.stdout:3/210: creat d0/da/f48 x:0 0 0 2024-04-25T13:46:59.247 INFO:tasks.workunit.client.0.smithi043.stdout:7/183: truncate d5/f15 2050804 0 2024-04-25T13:46:59.248 INFO:tasks.workunit.client.0.smithi043.stdout:1/154: dwrite df/d10/f24 [0,4194304] 0 2024-04-25T13:46:59.248 INFO:tasks.workunit.client.0.smithi043.stdout:9/168: getdents d0/d1d/d7 0 2024-04-25T13:46:59.249 INFO:tasks.workunit.client.0.smithi043.stdout:5/146: dwrite d1/d3/d7/d8/da/f2c [0,4194304] 0 2024-04-25T13:46:59.252 INFO:tasks.workunit.client.0.smithi043.stdout:5/147: mknod d1/d3/d24/c30 0 2024-04-25T13:46:59.254 INFO:tasks.workunit.client.0.smithi043.stdout:9/169: readlink d0/l1f 0 2024-04-25T13:46:59.254 INFO:tasks.workunit.client.0.smithi043.stdout:7/184: read d5/d11/f14 [3273374,72254] 0 2024-04-25T13:46:59.259 INFO:tasks.workunit.client.0.smithi043.stdout:9/170: fdatasync d0/d1d/d7/f16 0 2024-04-25T13:46:59.268 INFO:tasks.workunit.client.0.smithi043.stdout:3/211: rename d0/d9/d15/d34/d36/c39 to d0/d9/d15/d34/d36/c49 0 2024-04-25T13:46:59.268 INFO:tasks.workunit.client.0.smithi043.stdout:9/171: dwrite d0/d1d/d7/f16 [0,4194304] 0 2024-04-25T13:46:59.269 INFO:tasks.workunit.client.0.smithi043.stdout:5/148: getdents d1 0 2024-04-25T13:46:59.269 INFO:tasks.workunit.client.0.smithi043.stdout:1/155: rename df/d14/d25 to df/d14/d2a 0 2024-04-25T13:46:59.274 INFO:tasks.workunit.client.0.smithi043.stdout:9/172: readlink d0/le 0 2024-04-25T13:46:59.275 INFO:tasks.workunit.client.0.smithi043.stdout:7/185: dwrite d5/d32/f3a [0,4194304] 0 2024-04-25T13:46:59.276 INFO:tasks.workunit.client.0.smithi043.stdout:5/149: symlink d1/d3/d7/d8/da/d2e/l31 0 2024-04-25T13:46:59.280 INFO:tasks.workunit.client.0.smithi043.stdout:1/156: dread df/d10/f13 [0,4194304] 0 2024-04-25T13:46:59.280 INFO:tasks.workunit.client.0.smithi043.stdout:7/186: creat d5/d11/f41 x:0 0 0 2024-04-25T13:46:59.281 INFO:tasks.workunit.client.0.smithi043.stdout:3/212: dwrite d0/f4 [0,4194304] 0 2024-04-25T13:46:59.282 INFO:tasks.workunit.client.0.smithi043.stdout:5/150: rmdir d1/d3 39 2024-04-25T13:46:59.284 INFO:tasks.workunit.client.0.smithi043.stdout:9/173: creat d0/f42 x:0 0 0 2024-04-25T13:46:59.285 INFO:tasks.workunit.client.0.smithi043.stdout:3/213: mknod d0/d13/d2e/c4a 0 2024-04-25T13:46:59.286 INFO:tasks.workunit.client.0.smithi043.stdout:7/187: fdatasync d5/d32/f3d 0 2024-04-25T13:46:59.289 INFO:tasks.workunit.client.0.smithi043.stdout:7/188: write d5/f35 [145547,111030] 0 2024-04-25T13:46:59.291 INFO:tasks.workunit.client.0.smithi043.stdout:9/174: dread - d0/d1d/dc/f33 zero size 2024-04-25T13:46:59.292 INFO:tasks.workunit.client.0.smithi043.stdout:7/189: write d5/f35 [181291,39487] 0 2024-04-25T13:46:59.293 INFO:tasks.workunit.client.0.smithi043.stdout:1/157: dwrite fc [0,4194304] 0 2024-04-25T13:46:59.294 INFO:tasks.workunit.client.0.smithi043.stdout:1/158: fdatasync f2 0 2024-04-25T13:46:59.297 INFO:tasks.workunit.client.0.smithi043.stdout:7/190: write d5/d11/f26 [1008651,106300] 0 2024-04-25T13:46:59.298 INFO:tasks.workunit.client.0.smithi043.stdout:3/214: unlink d0/d9/f1e 0 2024-04-25T13:46:59.300 INFO:tasks.workunit.client.0.smithi043.stdout:3/215: dread - d0/d9/d15/d38/d3f/f42 zero size 2024-04-25T13:46:59.302 INFO:tasks.workunit.client.0.smithi043.stdout:7/191: creat d5/d11/f42 x:0 0 0 2024-04-25T13:46:59.306 INFO:tasks.workunit.client.0.smithi043.stdout:7/192: symlink d5/d11/d3b/l43 0 2024-04-25T13:46:59.307 INFO:tasks.workunit.client.0.smithi043.stdout:1/159: dwrite df/d10/f13 [0,4194304] 0 2024-04-25T13:46:59.308 INFO:tasks.workunit.client.0.smithi043.stdout:9/175: truncate d0/d1d/d7/f10 288195 0 2024-04-25T13:46:59.314 INFO:tasks.workunit.client.0.smithi043.stdout:9/176: creat d0/d1d/d22/f43 x:0 0 0 2024-04-25T13:46:59.320 INFO:tasks.workunit.client.0.smithi043.stdout:5/151: dwrite d1/d3/d26/f2a [0,4194304] 0 2024-04-25T13:46:59.324 INFO:tasks.workunit.client.0.smithi043.stdout:1/160: dwrite df/d10/f12 [0,4194304] 0 2024-04-25T13:46:59.327 INFO:tasks.workunit.client.0.smithi043.stdout:1/161: fsync f3 0 2024-04-25T13:46:59.329 INFO:tasks.workunit.client.0.smithi043.stdout:5/152: creat d1/f32 x:0 0 0 2024-04-25T13:46:59.329 INFO:tasks.workunit.client.0.smithi043.stdout:9/177: truncate d0/d1d/f29 1038878 0 2024-04-25T13:46:59.333 INFO:tasks.workunit.client.0.smithi043.stdout:7/193: dread d5/fd [0,4194304] 0 2024-04-25T13:46:59.333 INFO:tasks.workunit.client.0.smithi043.stdout:5/153: creat d1/d3/d7/d8/df/d28/f33 x:0 0 0 2024-04-25T13:46:59.334 INFO:tasks.workunit.client.0.smithi043.stdout:7/194: read - d5/d36/f3e zero size 2024-04-25T13:46:59.335 INFO:tasks.workunit.client.0.smithi043.stdout:7/195: write d5/f35 [1235153,128065] 0 2024-04-25T13:46:59.335 INFO:tasks.workunit.client.0.smithi043.stdout:1/162: symlink df/d14/d28/l2b 0 2024-04-25T13:46:59.336 INFO:tasks.workunit.client.0.smithi043.stdout:7/196: write d5/d11/f24 [316388,20960] 0 2024-04-25T13:46:59.337 INFO:tasks.workunit.client.0.smithi043.stdout:7/197: dread - d5/f2d zero size 2024-04-25T13:46:59.340 INFO:tasks.workunit.client.0.smithi043.stdout:7/198: truncate d5/f2e 859344 0 2024-04-25T13:46:59.341 INFO:tasks.workunit.client.0.smithi043.stdout:9/178: link d0/d1d/dc/d26/d39/c3c d0/d1d/d7/d3a/c44 0 2024-04-25T13:46:59.341 INFO:tasks.workunit.client.0.smithi043.stdout:1/163: write df/f11 [2111050,68577] 0 2024-04-25T13:46:59.341 INFO:tasks.workunit.client.0.smithi043.stdout:7/199: readlink d5/l2b 0 2024-04-25T13:46:59.342 INFO:tasks.workunit.client.0.smithi043.stdout:7/200: chown d5/f2d 98446906 1 2024-04-25T13:46:59.345 INFO:tasks.workunit.client.0.smithi043.stdout:9/179: chown d0/d1d/dc/f2a 176 1 2024-04-25T13:46:59.350 INFO:tasks.workunit.client.0.smithi043.stdout:9/180: mknod d0/d1d/dc/d26/c45 0 2024-04-25T13:46:59.350 INFO:tasks.workunit.client.0.smithi043.stdout:1/164: dwrite df/f1b [0,4194304] 0 2024-04-25T13:46:59.352 INFO:tasks.workunit.client.0.smithi043.stdout:9/181: mkdir d0/d1d/dc/d26/d39/d46 0 2024-04-25T13:46:59.353 INFO:tasks.workunit.client.0.smithi043.stdout:1/165: creat df/d10/f2c x:0 0 0 2024-04-25T13:46:59.353 INFO:tasks.workunit.client.0.smithi043.stdout:1/166: stat df/d10/d22/f26 0 2024-04-25T13:46:59.354 INFO:tasks.workunit.client.0.smithi043.stdout:7/201: fsync d5/f12 0 2024-04-25T13:46:59.359 INFO:tasks.workunit.client.0.smithi043.stdout:1/167: dwrite fc [0,4194304] 0 2024-04-25T13:46:59.360 INFO:tasks.workunit.client.0.smithi043.stdout:7/202: symlink d5/d36/l44 0 2024-04-25T13:46:59.361 INFO:tasks.workunit.client.0.smithi043.stdout:7/203: write d5/f35 [1060053,10548] 0 2024-04-25T13:46:59.362 INFO:tasks.workunit.client.0.smithi043.stdout:9/182: unlink d0/d1d/dc/f36 0 2024-04-25T13:46:59.369 INFO:tasks.workunit.client.0.smithi043.stdout:9/183: mkdir d0/d1d/dc/d26/d47 0 2024-04-25T13:46:59.371 INFO:tasks.workunit.client.0.smithi043.stdout:7/204: creat d5/f45 x:0 0 0 2024-04-25T13:46:59.372 INFO:tasks.workunit.client.0.smithi043.stdout:7/205: chown d5/d11/f42 16011455 1 2024-04-25T13:46:59.372 INFO:tasks.workunit.client.0.smithi043.stdout:1/168: truncate fc 3758385 0 2024-04-25T13:46:59.374 INFO:tasks.workunit.client.0.smithi043.stdout:7/206: creat d5/d11/d3b/f46 x:0 0 0 2024-04-25T13:46:59.374 INFO:tasks.workunit.client.0.smithi043.stdout:9/184: truncate d0/d1d/d7/f10 394547 0 2024-04-25T13:46:59.375 INFO:tasks.workunit.client.0.smithi043.stdout:7/207: fsync d5/f10 0 2024-04-25T13:46:59.377 INFO:tasks.workunit.client.0.smithi043.stdout:9/185: symlink d0/d1d/dc/d26/l48 0 2024-04-25T13:46:59.378 INFO:tasks.workunit.client.0.smithi043.stdout:7/208: symlink d5/d11/l47 0 2024-04-25T13:46:59.384 INFO:tasks.workunit.client.0.smithi043.stdout:7/209: dwrite d5/fd [0,4194304] 0 2024-04-25T13:46:59.387 INFO:tasks.workunit.client.0.smithi043.stdout:7/210: unlink d5/fe 0 2024-04-25T13:46:59.388 INFO:tasks.workunit.client.0.smithi043.stdout:7/211: chown d5/c25 1000 0 2024-04-25T13:46:59.393 INFO:tasks.workunit.client.0.smithi043.stdout:7/212: dread d5/d11/f28 [0,4194304] 0 2024-04-25T13:46:59.403 INFO:tasks.workunit.client.0.smithi043.stdout:7/213: dwrite d5/f10 [0,4194304] 0 2024-04-25T13:46:59.405 INFO:tasks.workunit.client.0.smithi043.stdout:7/214: unlink d5/c25 0 2024-04-25T13:46:59.411 INFO:tasks.workunit.client.0.smithi043.stdout:7/215: dwrite d5/d11/f14 [0,4194304] 0 2024-04-25T13:46:59.414 INFO:tasks.workunit.client.0.smithi043.stdout:7/216: unlink d5/d11/f20 0 2024-04-25T13:46:59.419 INFO:tasks.workunit.client.0.smithi043.stdout:7/217: dwrite d5/d32/f3a [0,4194304] 0 2024-04-25T13:46:59.422 INFO:tasks.workunit.client.0.smithi043.stdout:7/218: creat d5/d11/d3b/d3f/f48 x:0 0 0 2024-04-25T13:46:59.425 INFO:tasks.workunit.client.0.smithi043.stdout:7/219: mkdir d5/d11/d3b/d3f/d49 0 2024-04-25T13:46:59.426 INFO:tasks.workunit.client.0.smithi043.stdout:7/220: fdatasync d5/d11/d3b/d3f/f48 0 2024-04-25T13:46:59.428 INFO:tasks.workunit.client.0.smithi043.stdout:7/221: fdatasync d5/f12 0 2024-04-25T13:46:59.433 INFO:tasks.workunit.client.0.smithi043.stdout:7/222: getdents d5/d11/d3b/d3f 0 2024-04-25T13:46:59.435 INFO:tasks.workunit.client.0.smithi043.stdout:7/223: chown d5/l1a 252260969 1 2024-04-25T13:46:59.437 INFO:tasks.workunit.client.0.smithi043.stdout:7/224: creat d5/d11/d3b/d3f/f4a x:0 0 0 2024-04-25T13:46:59.439 INFO:tasks.workunit.client.0.smithi043.stdout:7/225: creat d5/d11/d3b/f4b x:0 0 0 2024-04-25T13:46:59.440 INFO:tasks.workunit.client.0.smithi043.stdout:7/226: symlink d5/l4c 0 2024-04-25T13:46:59.448 INFO:tasks.workunit.client.0.smithi043.stdout:7/227: truncate d5/d32/f3a 2882933 0 2024-04-25T13:46:59.450 INFO:tasks.workunit.client.0.smithi043.stdout:7/228: write d5/d11/d3b/f46 [558817,130948] 0 2024-04-25T13:46:59.452 INFO:tasks.workunit.client.0.smithi043.stdout:7/229: creat d5/d11/f4d x:0 0 0 2024-04-25T13:46:59.452 INFO:tasks.workunit.client.0.smithi043.stdout:7/230: fdatasync d5/f10 0 2024-04-25T13:46:59.456 INFO:tasks.workunit.client.0.smithi043.stdout:7/231: creat d5/d32/f4e x:0 0 0 2024-04-25T13:46:59.458 INFO:tasks.workunit.client.0.smithi043.stdout:7/232: chown d5/c9 104582961 1 2024-04-25T13:46:59.460 INFO:tasks.workunit.client.0.smithi043.stdout:7/233: symlink d5/d11/d3b/d3f/l4f 0 2024-04-25T13:46:59.462 INFO:tasks.workunit.client.0.smithi043.stdout:7/234: mknod d5/d32/c50 0 2024-04-25T13:46:59.464 INFO:tasks.workunit.client.0.smithi043.stdout:7/235: rmdir d5/d11/d3b/d3f/d49 0 2024-04-25T13:46:59.471 INFO:tasks.workunit.client.0.smithi043.stdout:7/236: truncate d5/d11/f34 1499433 0 2024-04-25T13:46:59.487 INFO:tasks.workunit.client.0.smithi043.stdout:7/237: dread d5/f27 [0,4194304] 0 2024-04-25T13:46:59.490 INFO:tasks.workunit.client.0.smithi043.stdout:7/238: dread d5/d11/f14 [0,4194304] 0 2024-04-25T13:46:59.496 INFO:tasks.workunit.client.0.smithi043.stdout:7/239: dwrite d5/d11/f14 [0,4194304] 0 2024-04-25T13:46:59.502 INFO:tasks.workunit.client.0.smithi043.stdout:7/240: dwrite d5/d11/f4d [0,4194304] 0 2024-04-25T13:46:59.504 INFO:tasks.workunit.client.0.smithi043.stdout:7/241: write d5/f3c [1019631,35315] 0 2024-04-25T13:46:59.506 INFO:tasks.workunit.client.0.smithi043.stdout:7/242: unlink f4 0 2024-04-25T13:46:59.517 INFO:tasks.workunit.client.0.smithi043.stdout:7/243: dread d5/d11/f26 [0,4194304] 0 2024-04-25T13:46:59.519 INFO:tasks.workunit.client.0.smithi043.stdout:7/244: symlink d5/l51 0 2024-04-25T13:46:59.519 INFO:tasks.workunit.client.0.smithi043.stdout:7/245: truncate d5/f45 745445 0 2024-04-25T13:46:59.521 INFO:tasks.workunit.client.0.smithi043.stdout:7/246: write d5/d11/f26 [405778,32177] 0 2024-04-25T13:46:59.523 INFO:tasks.workunit.client.0.smithi043.stdout:7/247: mknod d5/d36/c52 0 2024-04-25T13:46:59.525 INFO:tasks.workunit.client.0.smithi043.stdout:7/248: rmdir d5/d11/d3b/d3f 39 2024-04-25T13:46:59.527 INFO:tasks.workunit.client.0.smithi043.stdout:7/249: symlink d5/d11/l53 0 2024-04-25T13:46:59.529 INFO:tasks.workunit.client.0.smithi043.stdout:7/250: fdatasync d5/d11/d3b/d3f/f4a 0 2024-04-25T13:46:59.529 INFO:tasks.workunit.client.0.smithi043.stdout:7/251: chown d5/d11/f4d 22566 1 2024-04-25T13:46:59.535 INFO:tasks.workunit.client.0.smithi043.stdout:7/252: dwrite d5/f35 [0,4194304] 0 2024-04-25T13:46:59.536 INFO:tasks.workunit.client.0.smithi043.stdout:7/253: write d5/d11/f42 [562661,111474] 0 2024-04-25T13:46:59.539 INFO:tasks.workunit.client.0.smithi043.stdout:7/254: mkdir d5/d36/d54 0 2024-04-25T13:46:59.540 INFO:tasks.workunit.client.0.smithi043.stdout:0/160: sync 2024-04-25T13:46:59.546 INFO:tasks.workunit.client.0.smithi043.stdout:7/255: dread d5/f35 [0,4194304] 0 2024-04-25T13:46:59.549 INFO:tasks.workunit.client.0.smithi043.stdout:7/256: truncate d5/d11/f31 9374449 0 2024-04-25T13:46:59.549 INFO:tasks.workunit.client.0.smithi043.stdout:0/161: dwrite f7 [4194304,4194304] 0 2024-04-25T13:46:59.551 INFO:tasks.workunit.client.0.smithi043.stdout:0/162: dread - db/d25/f2b zero size 2024-04-25T13:46:59.552 INFO:tasks.workunit.client.0.smithi043.stdout:0/163: fsync db/d25/f2b 0 2024-04-25T13:46:59.694 INFO:tasks.workunit.client.0.smithi043.stdout:6/181: sync 2024-04-25T13:46:59.698 INFO:tasks.workunit.client.0.smithi043.stdout:6/182: link d0/c17 d0/c36 0 2024-04-25T13:46:59.698 INFO:tasks.workunit.client.0.smithi043.stdout:6/183: fsync d0/f12 0 2024-04-25T13:46:59.704 INFO:tasks.workunit.client.0.smithi043.stdout:6/184: truncate d0/d24/d2e/d2f/f32 548649 0 2024-04-25T13:46:59.709 INFO:tasks.workunit.client.0.smithi043.stdout:6/185: dread d0/d24/d2e/d2f/f32 [0,4194304] 0 2024-04-25T13:46:59.711 INFO:tasks.workunit.client.0.smithi043.stdout:6/186: read d0/ff [363696,55807] 0 2024-04-25T13:46:59.715 INFO:tasks.workunit.client.0.smithi043.stdout:6/187: link d0/f20 d0/d24/d2e/f37 0 2024-04-25T13:46:59.715 INFO:tasks.workunit.client.0.smithi043.stdout:6/188: dread - d0/d24/d2e/f34 zero size 2024-04-25T13:46:59.717 INFO:tasks.workunit.client.0.smithi043.stdout:6/189: chown d0/c36 29829 1 2024-04-25T13:46:59.717 INFO:tasks.workunit.client.0.smithi043.stdout:6/190: write d0/fb [2292910,69189] 0 2024-04-25T13:46:59.721 INFO:tasks.workunit.client.0.smithi043.stdout:9/186: sync 2024-04-25T13:46:59.721 INFO:tasks.workunit.client.0.smithi043.stdout:3/216: sync 2024-04-25T13:46:59.722 INFO:tasks.workunit.client.0.smithi043.stdout:7/257: sync 2024-04-25T13:46:59.722 INFO:tasks.workunit.client.0.smithi043.stdout:4/164: sync 2024-04-25T13:46:59.722 INFO:tasks.workunit.client.0.smithi043.stdout:2/128: sync 2024-04-25T13:46:59.722 INFO:tasks.workunit.client.0.smithi043.stdout:6/191: link d0/fc d0/d24/d2e/d2f/f38 0 2024-04-25T13:46:59.722 INFO:tasks.workunit.client.0.smithi043.stdout:2/129: stat d0/l19 0 2024-04-25T13:46:59.723 INFO:tasks.workunit.client.0.smithi043.stdout:4/165: chown d1/de/d1d/f2c 61061 1 2024-04-25T13:46:59.724 INFO:tasks.workunit.client.0.smithi043.stdout:9/187: creat d0/d1d/d7/f49 x:0 0 0 2024-04-25T13:46:59.724 INFO:tasks.workunit.client.0.smithi043.stdout:3/217: chown d0/d9/c2c 29 1 2024-04-25T13:46:59.725 INFO:tasks.workunit.client.0.smithi043.stdout:7/258: fsync d5/f15 0 2024-04-25T13:46:59.727 INFO:tasks.workunit.client.0.smithi043.stdout:4/166: mkdir d1/d34 0 2024-04-25T13:46:59.728 INFO:tasks.workunit.client.0.smithi043.stdout:9/188: readlink d0/l8 0 2024-04-25T13:46:59.728 INFO:tasks.workunit.client.0.smithi043.stdout:3/218: fdatasync d0/d9/d15/f1f 0 2024-04-25T13:46:59.732 INFO:tasks.workunit.client.0.smithi043.stdout:6/192: dwrite d0/d24/d2e/d2f/f32 [0,4194304] 0 2024-04-25T13:46:59.734 INFO:tasks.workunit.client.0.smithi043.stdout:4/167: mkdir d1/d34/d35 0 2024-04-25T13:46:59.735 INFO:tasks.workunit.client.0.smithi043.stdout:9/189: mkdir d0/d1d/d4a 0 2024-04-25T13:46:59.737 INFO:tasks.workunit.client.0.smithi043.stdout:7/259: truncate d5/d32/f3a 622588 0 2024-04-25T13:46:59.738 INFO:tasks.workunit.client.0.smithi043.stdout:9/190: read d0/d1d/dc/f23 [220983,14161] 0 2024-04-25T13:46:59.738 INFO:tasks.workunit.client.0.smithi043.stdout:2/130: dread d0/d8/fa [0,4194304] 0 2024-04-25T13:46:59.739 INFO:tasks.workunit.client.0.smithi043.stdout:2/131: dread - d0/f12 zero size 2024-04-25T13:46:59.741 INFO:tasks.workunit.client.0.smithi043.stdout:4/168: mkdir d1/de/df/d1a/d27/d36 0 2024-04-25T13:46:59.742 INFO:tasks.workunit.client.0.smithi043.stdout:2/132: stat d0/d8/ff 0 2024-04-25T13:46:59.743 INFO:tasks.workunit.client.0.smithi043.stdout:2/133: truncate d0/d8/db/f1d 525092 0 2024-04-25T13:46:59.744 INFO:tasks.workunit.client.0.smithi043.stdout:4/169: creat d1/d23/f37 x:0 0 0 2024-04-25T13:46:59.746 INFO:tasks.workunit.client.0.smithi043.stdout:3/219: truncate d0/da/fc 6923616 0 2024-04-25T13:46:59.746 INFO:tasks.workunit.client.0.smithi043.stdout:7/260: rename d5/f35 to d5/f55 0 2024-04-25T13:46:59.747 INFO:tasks.workunit.client.0.smithi043.stdout:7/261: readlink d5/l2b 0 2024-04-25T13:46:59.749 INFO:tasks.workunit.client.0.smithi043.stdout:7/262: mknod d5/c56 0 2024-04-25T13:46:59.750 INFO:tasks.workunit.client.0.smithi043.stdout:3/220: creat d0/d14/f4b x:0 0 0 2024-04-25T13:46:59.750 INFO:tasks.workunit.client.0.smithi043.stdout:7/263: chown d5/f55 16393988 1 2024-04-25T13:46:59.752 INFO:tasks.workunit.client.0.smithi043.stdout:3/221: dread - d0/d9/d15/d38/d3f/f42 zero size 2024-04-25T13:46:59.752 INFO:tasks.workunit.client.0.smithi043.stdout:7/264: read - d5/d11/d3b/d3f/f48 zero size 2024-04-25T13:46:59.754 INFO:tasks.workunit.client.0.smithi043.stdout:2/134: write d0/d8/fd [357296,100076] 0 2024-04-25T13:46:59.756 INFO:tasks.workunit.client.0.smithi043.stdout:8/291: rename db/dc/d28/f43 to db/d11/d1b/f63 0 2024-04-25T13:46:59.756 INFO:tasks.workunit.client.0.smithi043.stdout:3/222: chown d0/da/f11 487457660 1 2024-04-25T13:46:59.758 INFO:tasks.workunit.client.0.smithi043.stdout:6/193: dread d0/d1c/f28 [4194304,4194304] 0 2024-04-25T13:46:59.760 INFO:tasks.workunit.client.0.smithi043.stdout:5/154: rename d1/d3/d7/d8/f17 to d1/d3/d7/d9/d2d/f34 0 2024-04-25T13:46:59.762 INFO:tasks.workunit.client.0.smithi043.stdout:8/292: creat db/dc/d21/d4e/d62/f64 x:0 0 0 2024-04-25T13:46:59.763 INFO:tasks.workunit.client.0.smithi043.stdout:3/223: unlink d0/da/f11 0 2024-04-25T13:46:59.765 INFO:tasks.workunit.client.0.smithi043.stdout:1/169: rename df/d10/l1d to df/d14/d28/l2d 0 2024-04-25T13:46:59.766 INFO:tasks.workunit.client.0.smithi043.stdout:8/293: write db/d11/d1b/f47 [2681601,40918] 0 2024-04-25T13:46:59.768 INFO:tasks.workunit.client.0.smithi043.stdout:5/155: rmdir d1/d3/d26 39 2024-04-25T13:46:59.768 INFO:tasks.workunit.client.0.smithi043.stdout:6/194: write d0/d24/d2e/d2f/f38 [358767,70954] 0 2024-04-25T13:46:59.769 INFO:tasks.workunit.client.0.smithi043.stdout:2/135: dwrite d0/f18 [0,4194304] 0 2024-04-25T13:46:59.769 INFO:tasks.workunit.client.0.smithi043.stdout:3/224: chown d0/f2a 17935497 1 2024-04-25T13:46:59.771 INFO:tasks.workunit.client.0.smithi043.stdout:1/170: creat df/d10/d22/f2e x:0 0 0 2024-04-25T13:46:59.771 INFO:tasks.workunit.client.0.smithi043.stdout:0/164: rename db/d1b/l20 to db/d1b/d23/l32 0 2024-04-25T13:46:59.774 INFO:tasks.workunit.client.0.smithi043.stdout:2/136: chown d0/d5 109648220 1 2024-04-25T13:46:59.775 INFO:tasks.workunit.client.0.smithi043.stdout:7/265: dwrite d5/d11/f34 [0,4194304] 0 2024-04-25T13:46:59.775 INFO:tasks.workunit.client.0.smithi043.stdout:1/171: write df/f20 [1174592,15311] 0 2024-04-25T13:46:59.776 INFO:tasks.workunit.client.0.smithi043.stdout:8/294: unlink db/d11/d1b/d1e/d27/f30 0 2024-04-25T13:46:59.777 INFO:tasks.workunit.client.0.smithi043.stdout:8/295: fsync db/fd 0 2024-04-25T13:46:59.777 INFO:tasks.workunit.client.0.smithi043.stdout:4/170: rename d1/d23 to d1/de/d1d/d20/d38 0 2024-04-25T13:46:59.780 INFO:tasks.workunit.client.0.smithi043.stdout:5/156: truncate d1/d3/d7/d9/d2d/f34 9170969 0 2024-04-25T13:46:59.782 INFO:tasks.workunit.client.0.smithi043.stdout:4/171: write d1/f14 [8184622,108285] 0 2024-04-25T13:46:59.783 INFO:tasks.workunit.client.0.smithi043.stdout:5/157: chown d1/d3/d7/d8/df/d28 163 1 2024-04-25T13:46:59.785 INFO:tasks.workunit.client.0.smithi043.stdout:7/266: creat d5/f57 x:0 0 0 2024-04-25T13:46:59.787 INFO:tasks.workunit.client.0.smithi043.stdout:3/225: truncate d0/d13/f3d 4189376 0 2024-04-25T13:46:59.787 INFO:tasks.workunit.client.0.smithi043.stdout:0/165: rename db/d1b/c28 to db/c33 0 2024-04-25T13:46:59.788 INFO:tasks.workunit.client.0.smithi043.stdout:8/296: read db/d11/d1b/f63 [126127,97716] 0 2024-04-25T13:46:59.790 INFO:tasks.workunit.client.0.smithi043.stdout:6/195: dwrite d0/fe [4194304,4194304] 0 2024-04-25T13:46:59.790 INFO:tasks.workunit.client.0.smithi043.stdout:5/158: write d1/d3/d7/f23 [3507422,28214] 0 2024-04-25T13:46:59.797 INFO:tasks.workunit.client.0.smithi043.stdout:1/172: rename df/d14/d28 to df/d10/d22/d2f 0 2024-04-25T13:46:59.799 INFO:tasks.workunit.client.0.smithi043.stdout:3/226: symlink d0/d9/l4c 0 2024-04-25T13:46:59.801 INFO:tasks.workunit.client.0.smithi043.stdout:8/297: symlink db/d11/d1b/d1e/l65 0 2024-04-25T13:46:59.801 INFO:tasks.workunit.client.0.smithi043.stdout:1/173: chown df/d10 26 1 2024-04-25T13:46:59.802 INFO:tasks.workunit.client.0.smithi043.stdout:7/267: dwrite d5/d11/f4d [0,4194304] 0 2024-04-25T13:46:59.804 INFO:tasks.workunit.client.0.smithi043.stdout:5/159: creat d1/d3/d7/d9/f35 x:0 0 0 2024-04-25T13:46:59.806 INFO:tasks.workunit.client.0.smithi043.stdout:4/172: truncate d1/de/d1d/f2a 106633 0 2024-04-25T13:46:59.806 INFO:tasks.workunit.client.0.smithi043.stdout:1/174: fsync df/f16 0 2024-04-25T13:46:59.807 INFO:tasks.workunit.client.0.smithi043.stdout:6/196: dwrite d0/fc [0,4194304] 0 2024-04-25T13:46:59.808 INFO:tasks.workunit.client.0.smithi043.stdout:6/197: readlink d0/l1e 0 2024-04-25T13:46:59.811 INFO:tasks.workunit.client.0.smithi043.stdout:3/227: symlink d0/da/l4d 0 2024-04-25T13:46:59.812 INFO:tasks.workunit.client.0.smithi043.stdout:7/268: symlink d5/d32/l58 0 2024-04-25T13:46:59.812 INFO:tasks.workunit.client.0.smithi043.stdout:3/228: fdatasync d0/f4 0 2024-04-25T13:46:59.813 INFO:tasks.workunit.client.0.smithi043.stdout:7/269: stat d5/f3c 0 2024-04-25T13:46:59.814 INFO:tasks.workunit.client.0.smithi043.stdout:7/270: read - d5/d36/f3e zero size 2024-04-25T13:46:59.814 INFO:tasks.workunit.client.0.smithi043.stdout:3/229: chown d0/d13/d2e/c4a 23 1 2024-04-25T13:46:59.815 INFO:tasks.workunit.client.0.smithi043.stdout:1/175: dread f3 [8388608,4194304] 0 2024-04-25T13:46:59.816 INFO:tasks.workunit.client.0.smithi043.stdout:5/160: unlink d1/d3/d7/d9/f35 0 2024-04-25T13:46:59.818 INFO:tasks.workunit.client.0.smithi043.stdout:4/173: creat d1/de/df/d1e/d28/f39 x:0 0 0 2024-04-25T13:46:59.820 INFO:tasks.workunit.client.0.smithi043.stdout:8/298: creat db/d11/d1b/f66 x:0 0 0 2024-04-25T13:46:59.820 INFO:tasks.workunit.client.0.smithi043.stdout:6/198: symlink d0/l39 0 2024-04-25T13:46:59.821 INFO:tasks.workunit.client.0.smithi043.stdout:7/271: mknod d5/d11/c59 0 2024-04-25T13:46:59.823 INFO:tasks.workunit.client.0.smithi043.stdout:3/230: creat d0/d9/d15/d34/d36/f4e x:0 0 0 2024-04-25T13:46:59.825 INFO:tasks.workunit.client.0.smithi043.stdout:5/161: mkdir d1/d3/d7/d9/d2d/d36 0 2024-04-25T13:46:59.825 INFO:tasks.workunit.client.0.smithi043.stdout:1/176: dwrite f2 [4194304,4194304] 0 2024-04-25T13:46:59.826 INFO:tasks.workunit.client.0.smithi043.stdout:7/272: stat d5/ca 0 2024-04-25T13:46:59.830 INFO:tasks.workunit.client.0.smithi043.stdout:7/273: read - d5/d32/f4e zero size 2024-04-25T13:46:59.831 INFO:tasks.workunit.client.0.smithi043.stdout:8/299: mkdir db/d38/d49/d5d/d67 0 2024-04-25T13:46:59.831 INFO:tasks.workunit.client.0.smithi043.stdout:5/162: mkdir d1/d3/d37 0 2024-04-25T13:46:59.835 INFO:tasks.workunit.client.0.smithi043.stdout:4/174: dwrite d1/de/df/d1e/f30 [0,4194304] 0 2024-04-25T13:46:59.837 INFO:tasks.workunit.client.0.smithi043.stdout:6/199: dwrite d0/d24/d2e/d2f/f32 [0,4194304] 0 2024-04-25T13:46:59.837 INFO:tasks.workunit.client.0.smithi043.stdout:7/274: mkdir d5/d11/d3b/d3f/d5a 0 2024-04-25T13:46:59.838 INFO:tasks.workunit.client.0.smithi043.stdout:4/175: read - d1/de/d1d/d20/d38/f37 zero size 2024-04-25T13:46:59.838 INFO:tasks.workunit.client.0.smithi043.stdout:6/200: write d0/f16 [125287,62585] 0 2024-04-25T13:46:59.839 INFO:tasks.workunit.client.0.smithi043.stdout:5/163: symlink d1/d3/d7/d8/df/d28/l38 0 2024-04-25T13:46:59.843 INFO:tasks.workunit.client.0.smithi043.stdout:8/300: dread - db/dc/f45 zero size 2024-04-25T13:46:59.846 INFO:tasks.workunit.client.0.smithi043.stdout:4/176: mkdir d1/de/d1d/d20/d38/d3a 0 2024-04-25T13:46:59.848 INFO:tasks.workunit.client.0.smithi043.stdout:8/301: write db/d11/f3d [3672920,10514] 0 2024-04-25T13:46:59.852 INFO:tasks.workunit.client.0.smithi043.stdout:7/275: dwrite d5/f1e [0,4194304] 0 2024-04-25T13:46:59.856 INFO:tasks.workunit.client.0.smithi043.stdout:7/276: mknod d5/d11/d3b/d3f/c5b 0 2024-04-25T13:46:59.857 INFO:tasks.workunit.client.0.smithi043.stdout:4/177: dread d1/de/df/d1e/f30 [0,4194304] 0 2024-04-25T13:46:59.862 INFO:tasks.workunit.client.0.smithi043.stdout:5/164: truncate d1/d3/d7/d8/da/f2c 4140876 0 2024-04-25T13:46:59.863 INFO:tasks.workunit.client.0.smithi043.stdout:4/178: symlink d1/de/d1d/d20/l3b 0 2024-04-25T13:46:59.863 INFO:tasks.workunit.client.0.smithi043.stdout:5/165: fdatasync d1/d3/d7/d8/df/d28/f33 0 2024-04-25T13:46:59.866 INFO:tasks.workunit.client.0.smithi043.stdout:8/302: write db/f2d [1394724,90836] 0 2024-04-25T13:46:59.866 INFO:tasks.workunit.client.0.smithi043.stdout:6/201: dread d0/f20 [0,4194304] 0 2024-04-25T13:46:59.866 INFO:tasks.workunit.client.0.smithi043.stdout:1/177: dread df/f16 [0,4194304] 0 2024-04-25T13:46:59.869 INFO:tasks.workunit.client.0.smithi043.stdout:9/191: sync 2024-04-25T13:46:59.871 INFO:tasks.workunit.client.0.smithi043.stdout:4/179: creat d1/de/df/d1a/f3c x:0 0 0 2024-04-25T13:46:59.873 INFO:tasks.workunit.client.0.smithi043.stdout:6/202: mkdir d0/d24/d3a 0 2024-04-25T13:46:59.875 INFO:tasks.workunit.client.0.smithi043.stdout:9/192: creat d0/d1d/d22/f4b x:0 0 0 2024-04-25T13:46:59.878 INFO:tasks.workunit.client.0.smithi043.stdout:1/178: dread f9 [0,4194304] 0 2024-04-25T13:46:59.878 INFO:tasks.workunit.client.0.smithi043.stdout:7/277: dwrite d5/f12 [0,4194304] 0 2024-04-25T13:46:59.879 INFO:tasks.workunit.client.0.smithi043.stdout:6/203: creat d0/d1c/f3b x:0 0 0 2024-04-25T13:46:59.880 INFO:tasks.workunit.client.0.smithi043.stdout:1/179: fsync df/f1b 0 2024-04-25T13:46:59.882 INFO:tasks.workunit.client.0.smithi043.stdout:3/231: rename d0/d9/c2c to d0/d9/d15/d38/c4f 0 2024-04-25T13:46:59.883 INFO:tasks.workunit.client.0.smithi043.stdout:5/166: getdents d1/d3/d7/d8/df 0 2024-04-25T13:46:59.884 INFO:tasks.workunit.client.0.smithi043.stdout:6/204: write d0/d24/d2e/d2f/f32 [3143172,120669] 0 2024-04-25T13:46:59.889 INFO:tasks.workunit.client.0.smithi043.stdout:7/278: creat d5/d11/f5c x:0 0 0 2024-04-25T13:46:59.890 INFO:tasks.workunit.client.0.smithi043.stdout:4/180: dwrite d1/d3/f15 [0,4194304] 0 2024-04-25T13:46:59.890 INFO:tasks.workunit.client.0.smithi043.stdout:9/193: creat d0/d1d/d7/d41/f4c x:0 0 0 2024-04-25T13:46:59.891 INFO:tasks.workunit.client.0.smithi043.stdout:1/180: rename df/d10/d22/d2f/l2d to df/d10/d22/d2f/l30 0 2024-04-25T13:46:59.891 INFO:tasks.workunit.client.0.smithi043.stdout:6/205: read d0/d1b/f1d [1776566,88056] 0 2024-04-25T13:46:59.891 INFO:tasks.workunit.client.0.smithi043.stdout:5/167: unlink d1/f32 0 2024-04-25T13:46:59.892 INFO:tasks.workunit.client.0.smithi043.stdout:6/206: chown d0/l9 1613426 1 2024-04-25T13:46:59.895 INFO:tasks.workunit.client.0.smithi043.stdout:9/194: stat d0/f1e 0 2024-04-25T13:46:59.896 INFO:tasks.workunit.client.0.smithi043.stdout:1/181: fdatasync df/d14/f1c 0 2024-04-25T13:46:59.900 INFO:tasks.workunit.client.0.smithi043.stdout:8/303: rename db/d11/d1b/l1f to db/l68 0 2024-04-25T13:46:59.902 INFO:tasks.workunit.client.0.smithi043.stdout:5/168: creat d1/d3/d37/f39 x:0 0 0 2024-04-25T13:46:59.903 INFO:tasks.workunit.client.0.smithi043.stdout:5/169: write d1/d3/d7/d8/df/fd [1469695,45479] 0 2024-04-25T13:46:59.904 INFO:tasks.workunit.client.0.smithi043.stdout:7/279: creat d5/f5d x:0 0 0 2024-04-25T13:46:59.905 INFO:tasks.workunit.client.0.smithi043.stdout:8/304: dread - db/d11/d1b/f66 zero size 2024-04-25T13:46:59.906 INFO:tasks.workunit.client.0.smithi043.stdout:8/305: stat c5 0 2024-04-25T13:46:59.906 INFO:tasks.workunit.client.0.smithi043.stdout:9/195: mkdir d0/d1d/dc/d26/d47/d4d 0 2024-04-25T13:46:59.906 INFO:tasks.workunit.client.0.smithi043.stdout:9/196: stat d0/d1d/d22 0 2024-04-25T13:46:59.907 INFO:tasks.workunit.client.0.smithi043.stdout:1/182: unlink df/f11 0 2024-04-25T13:46:59.910 INFO:tasks.workunit.client.0.smithi043.stdout:4/181: getdents d1/de 0 2024-04-25T13:46:59.913 INFO:tasks.workunit.client.0.smithi043.stdout:8/306: creat db/dc/d21/d4e/d62/f69 x:0 0 0 2024-04-25T13:46:59.916 INFO:tasks.workunit.client.0.smithi043.stdout:7/280: creat d5/d11/d3b/d3f/d5a/f5e x:0 0 0 2024-04-25T13:46:59.916 INFO:tasks.workunit.client.0.smithi043.stdout:4/182: readlink d1/d3/l6 0 2024-04-25T13:46:59.917 INFO:tasks.workunit.client.0.smithi043.stdout:4/183: stat d1/de/df/d1e 0 2024-04-25T13:46:59.920 INFO:tasks.workunit.client.0.smithi043.stdout:8/307: symlink db/dc/d28/l6a 0 2024-04-25T13:46:59.922 INFO:tasks.workunit.client.0.smithi043.stdout:9/197: link d0/l8 d0/d1d/d22/l4e 0 2024-04-25T13:46:59.923 INFO:tasks.workunit.client.0.smithi043.stdout:4/184: mkdir d1/d34/d35/d3d 0 2024-04-25T13:46:59.926 INFO:tasks.workunit.client.0.smithi043.stdout:9/198: dread - d0/f21 zero size 2024-04-25T13:46:59.927 INFO:tasks.workunit.client.0.smithi043.stdout:4/185: creat d1/d3/f3e x:0 0 0 2024-04-25T13:46:59.929 INFO:tasks.workunit.client.0.smithi043.stdout:5/170: truncate d1/d3/d7/f23 6867841 0 2024-04-25T13:46:59.930 INFO:tasks.workunit.client.0.smithi043.stdout:9/199: symlink d0/d1d/d22/l4f 0 2024-04-25T13:46:59.932 INFO:tasks.workunit.client.0.smithi043.stdout:4/186: fsync d1/de/df/d1e/f30 0 2024-04-25T13:46:59.935 INFO:tasks.workunit.client.0.smithi043.stdout:9/200: unlink d0/d1d/d7/d41/f4c 0 2024-04-25T13:46:59.935 INFO:tasks.workunit.client.0.smithi043.stdout:5/171: symlink d1/d3/d26/l3a 0 2024-04-25T13:46:59.936 INFO:tasks.workunit.client.0.smithi043.stdout:8/308: dread db/d11/d1b/f47 [0,4194304] 0 2024-04-25T13:46:59.939 INFO:tasks.workunit.client.0.smithi043.stdout:1/183: mkdir df/d31 0 2024-04-25T13:46:59.939 INFO:tasks.workunit.client.0.smithi043.stdout:2/137: sync 2024-04-25T13:46:59.940 INFO:tasks.workunit.client.0.smithi043.stdout:9/201: creat d0/d1d/dc/d26/d39/d46/f50 x:0 0 0 2024-04-25T13:46:59.944 INFO:tasks.workunit.client.0.smithi043.stdout:2/138: dwrite d0/d8/db/f1a [0,4194304] 0 2024-04-25T13:46:59.946 INFO:tasks.workunit.client.0.smithi043.stdout:2/139: chown d0/d5/d1e/f1f 1180746 1 2024-04-25T13:46:59.952 INFO:tasks.workunit.client.0.smithi043.stdout:8/309: truncate db/f35 3852754 0 2024-04-25T13:46:59.954 INFO:tasks.workunit.client.0.smithi043.stdout:8/310: fsync f4 0 2024-04-25T13:46:59.958 INFO:tasks.workunit.client.0.smithi043.stdout:5/172: dwrite d1/d3/d26/f27 [4194304,4194304] 0 2024-04-25T13:46:59.959 INFO:tasks.workunit.client.0.smithi043.stdout:1/184: mkdir df/d10/d22/d2f/d32 0 2024-04-25T13:46:59.961 INFO:tasks.workunit.client.0.smithi043.stdout:8/311: write db/d11/d1b/f47 [1299649,100985] 0 2024-04-25T13:46:59.961 INFO:tasks.workunit.client.0.smithi043.stdout:3/232: rename d0/d14/c3a to d0/d9/d15/c50 0 2024-04-25T13:46:59.965 INFO:tasks.workunit.client.0.smithi043.stdout:8/312: creat db/dc/d21/f6b x:0 0 0 2024-04-25T13:46:59.966 INFO:tasks.workunit.client.0.smithi043.stdout:6/207: rename d0/f12 to d0/d24/d2e/d2f/f3c 0 2024-04-25T13:46:59.967 INFO:tasks.workunit.client.0.smithi043.stdout:1/185: mknod df/d10/d22/d2f/c33 0 2024-04-25T13:46:59.970 INFO:tasks.workunit.client.0.smithi043.stdout:2/140: dwrite d0/d8/ff [0,4194304] 0 2024-04-25T13:46:59.975 INFO:tasks.workunit.client.0.smithi043.stdout:7/281: rename d5/d11/f34 to d5/d32/f5f 0 2024-04-25T13:46:59.979 INFO:tasks.workunit.client.0.smithi043.stdout:4/187: rename d1/de/d1d/d20/l3b to d1/l3f 0 2024-04-25T13:46:59.980 INFO:tasks.workunit.client.0.smithi043.stdout:7/282: dread - d5/d11/d3b/d3f/f48 zero size 2024-04-25T13:46:59.980 INFO:tasks.workunit.client.0.smithi043.stdout:6/208: dread d0/d24/d2e/d2f/f32 [0,4194304] 0 2024-04-25T13:46:59.984 INFO:tasks.workunit.client.0.smithi043.stdout:1/186: dwrite f9 [0,4194304] 0 2024-04-25T13:46:59.987 INFO:tasks.workunit.client.0.smithi043.stdout:9/202: rename d0/d1d/dc/d26/l2f to d0/d1d/d7/d41/l51 0 2024-04-25T13:46:59.987 INFO:tasks.workunit.client.0.smithi043.stdout:7/283: chown d5/d11/d3b/d3f/d5a/f5e 478 1 2024-04-25T13:46:59.988 INFO:tasks.workunit.client.0.smithi043.stdout:2/141: dwrite d0/d8/fd [0,4194304] 0 2024-04-25T13:46:59.992 INFO:tasks.workunit.client.0.smithi043.stdout:1/187: mkdir df/d31/d34 0 2024-04-25T13:46:59.992 INFO:tasks.workunit.client.0.smithi043.stdout:3/233: dread d0/d9/f45 [0,4194304] 0 2024-04-25T13:46:59.996 INFO:tasks.workunit.client.0.smithi043.stdout:6/209: getdents d0/d24/d3a 0 2024-04-25T13:46:59.996 INFO:tasks.workunit.client.0.smithi043.stdout:8/313: rename db/f2d to db/d11/d1b/f6c 0 2024-04-25T13:46:59.997 INFO:tasks.workunit.client.0.smithi043.stdout:7/284: mknod d5/d32/c60 0 2024-04-25T13:46:59.999 INFO:tasks.workunit.client.0.smithi043.stdout:2/142: mkdir d0/d8/d22 0 2024-04-25T13:47:00.005 INFO:tasks.workunit.client.0.smithi043.stdout:7/285: write d5/f45 [1007374,83167] 0 2024-04-25T13:47:00.012 INFO:tasks.workunit.client.0.smithi043.stdout:4/188: dwrite d1/de/df/d1a/f2d [4194304,4194304] 0 2024-04-25T13:47:00.012 INFO:tasks.workunit.client.0.smithi043.stdout:9/203: dwrite d0/d1d/dc/f33 [0,4194304] 0 2024-04-25T13:47:00.014 INFO:tasks.workunit.client.0.smithi043.stdout:2/143: truncate d0/f12 504447 0 2024-04-25T13:47:00.018 INFO:tasks.workunit.client.0.smithi043.stdout:9/204: dread - d0/d1d/d22/f27 zero size 2024-04-25T13:47:00.019 INFO:tasks.workunit.client.0.smithi043.stdout:1/188: dwrite fc [0,4194304] 0 2024-04-25T13:47:00.019 INFO:tasks.workunit.client.0.smithi043.stdout:4/189: creat d1/de/df/f40 x:0 0 0 2024-04-25T13:47:00.020 INFO:tasks.workunit.client.0.smithi043.stdout:7/286: truncate d5/d11/d3b/d3f/d5a/f5e 69168 0 2024-04-25T13:47:00.022 INFO:tasks.workunit.client.0.smithi043.stdout:4/190: chown d1/d3/f9 1983304 1 2024-04-25T13:47:00.025 INFO:tasks.workunit.client.0.smithi043.stdout:1/189: chown df/d14/c1e 7 1 2024-04-25T13:47:00.027 INFO:tasks.workunit.client.0.smithi043.stdout:8/314: write db/dc/f23 [5131862,104568] 0 2024-04-25T13:47:00.027 INFO:tasks.workunit.client.0.smithi043.stdout:7/287: mkdir d5/d11/d3b/d61 0 2024-04-25T13:47:00.029 INFO:tasks.workunit.client.0.smithi043.stdout:2/144: dread d0/d8/f13 [0,4194304] 0 2024-04-25T13:47:00.029 INFO:tasks.workunit.client.0.smithi043.stdout:7/288: chown d5/d32/c50 22356 1 2024-04-25T13:47:00.030 INFO:tasks.workunit.client.0.smithi043.stdout:4/191: creat d1/de/df/f41 x:0 0 0 2024-04-25T13:47:00.031 INFO:tasks.workunit.client.0.smithi043.stdout:2/145: readlink d0/l19 0 2024-04-25T13:47:00.035 INFO:tasks.workunit.client.0.smithi043.stdout:2/146: truncate d0/d8/fd 4741600 0 2024-04-25T13:47:00.036 INFO:tasks.workunit.client.0.smithi043.stdout:7/289: symlink d5/l62 0 2024-04-25T13:47:00.037 INFO:tasks.workunit.client.0.smithi043.stdout:1/190: getdents df/d31 0 2024-04-25T13:47:00.039 INFO:tasks.workunit.client.0.smithi043.stdout:2/147: chown d0/c16 5922346 1 2024-04-25T13:47:00.041 INFO:tasks.workunit.client.0.smithi043.stdout:8/315: dread db/d11/d1b/f47 [0,4194304] 0 2024-04-25T13:47:00.041 INFO:tasks.workunit.client.0.smithi043.stdout:6/210: dread d0/d1c/f28 [0,4194304] 0 2024-04-25T13:47:00.041 INFO:tasks.workunit.client.0.smithi043.stdout:2/148: read d0/d8/ff [538166,3551] 0 2024-04-25T13:47:00.043 INFO:tasks.workunit.client.0.smithi043.stdout:7/290: rename d5/d11/f5c to d5/d11/f63 0 2024-04-25T13:47:00.044 INFO:tasks.workunit.client.0.smithi043.stdout:2/149: stat d0/d8/d22 0 2024-04-25T13:47:00.044 INFO:tasks.workunit.client.0.smithi043.stdout:4/192: dwrite d1/de/d1d/f2c [0,4194304] 0 2024-04-25T13:47:00.045 INFO:tasks.workunit.client.0.smithi043.stdout:3/234: link d0/d9/d15/c50 d0/c51 0 2024-04-25T13:47:00.045 INFO:tasks.workunit.client.0.smithi043.stdout:7/291: dread - d5/d11/f41 zero size 2024-04-25T13:47:00.048 INFO:tasks.workunit.client.0.smithi043.stdout:2/150: creat d0/d8/db/d17/f23 x:0 0 0 2024-04-25T13:47:00.049 INFO:tasks.workunit.client.0.smithi043.stdout:6/211: dread d0/d24/d2e/d2f/f32 [0,4194304] 0 2024-04-25T13:47:00.050 INFO:tasks.workunit.client.0.smithi043.stdout:7/292: dread d5/d32/f3a [0,4194304] 0 2024-04-25T13:47:00.050 INFO:tasks.workunit.client.0.smithi043.stdout:1/191: creat df/f35 x:0 0 0 2024-04-25T13:47:00.050 INFO:tasks.workunit.client.0.smithi043.stdout:4/193: mknod d1/de/d1d/d20/d38/d3a/c42 0 2024-04-25T13:47:00.060 INFO:tasks.workunit.client.0.smithi043.stdout:4/194: dread d1/de/df/d1e/f30 [0,4194304] 0 2024-04-25T13:47:00.060 INFO:tasks.workunit.client.0.smithi043.stdout:2/151: dwrite d0/d5/d1e/f1f [0,4194304] 0 2024-04-25T13:47:00.062 INFO:tasks.workunit.client.0.smithi043.stdout:0/166: sync 2024-04-25T13:47:00.062 INFO:tasks.workunit.client.0.smithi043.stdout:7/293: truncate d5/f2e 4024924 0 2024-04-25T13:47:00.063 INFO:tasks.workunit.client.0.smithi043.stdout:4/195: truncate d1/de/d1d/f2c 4932545 0 2024-04-25T13:47:00.064 INFO:tasks.workunit.client.0.smithi043.stdout:1/192: creat df/d14/d2a/f36 x:0 0 0 2024-04-25T13:47:00.064 INFO:tasks.workunit.client.0.smithi043.stdout:2/152: truncate d0/d8/db/d17/f23 749890 0 2024-04-25T13:47:00.065 INFO:tasks.workunit.client.0.smithi043.stdout:7/294: mkdir d5/d36/d64 0 2024-04-25T13:47:00.065 INFO:tasks.workunit.client.0.smithi043.stdout:6/212: getdents d0/d24 0 2024-04-25T13:47:00.070 INFO:tasks.workunit.client.0.smithi043.stdout:6/213: mkdir d0/d3d 0 2024-04-25T13:47:00.078 INFO:tasks.workunit.client.0.smithi043.stdout:1/193: dread df/d10/f24 [0,4194304] 0 2024-04-25T13:47:00.081 INFO:tasks.workunit.client.0.smithi043.stdout:4/196: dwrite d1/de/d1d/d20/d38/f37 [0,4194304] 0 2024-04-25T13:47:00.081 INFO:tasks.workunit.client.0.smithi043.stdout:7/295: dread d5/d32/f5f [0,4194304] 0 2024-04-25T13:47:00.082 INFO:tasks.workunit.client.0.smithi043.stdout:2/153: dwrite d0/d8/db/d17/f23 [0,4194304] 0 2024-04-25T13:47:00.083 INFO:tasks.workunit.client.0.smithi043.stdout:7/296: chown d5/d36 12460 1 2024-04-25T13:47:00.086 INFO:tasks.workunit.client.0.smithi043.stdout:8/316: rename db/d11/d1b/f47 to db/dc/d28/f6d 0 2024-04-25T13:47:00.088 INFO:tasks.workunit.client.0.smithi043.stdout:3/235: dwrite d0/d9/f44 [0,4194304] 0 2024-04-25T13:47:00.088 INFO:tasks.workunit.client.0.smithi043.stdout:6/214: dread d0/fe [0,4194304] 0 2024-04-25T13:47:00.088 INFO:tasks.workunit.client.0.smithi043.stdout:7/297: chown d5/d36/f3e 16728095 1 2024-04-25T13:47:00.093 INFO:tasks.workunit.client.0.smithi043.stdout:0/167: rename db/d25/d2a/f2e to db/d2f/f34 0 2024-04-25T13:47:00.093 INFO:tasks.workunit.client.0.smithi043.stdout:0/168: stat db/d1b/f29 0 2024-04-25T13:47:00.093 INFO:tasks.workunit.client.0.smithi043.stdout:8/317: rmdir db/d44 39 2024-04-25T13:47:00.094 INFO:tasks.workunit.client.0.smithi043.stdout:6/215: fdatasync d0/fe 0 2024-04-25T13:47:00.094 INFO:tasks.workunit.client.0.smithi043.stdout:2/154: getdents d0/d5 0 2024-04-25T13:47:00.095 INFO:tasks.workunit.client.0.smithi043.stdout:1/194: dwrite f9 [0,4194304] 0 2024-04-25T13:47:00.100 INFO:tasks.workunit.client.0.smithi043.stdout:2/155: readlink d0/d8/db/le 0 2024-04-25T13:47:00.100 INFO:tasks.workunit.client.0.smithi043.stdout:7/298: rename d5/f57 to d5/d11/d3b/d3f/d5a/f65 0 2024-04-25T13:47:00.101 INFO:tasks.workunit.client.0.smithi043.stdout:1/195: dread - df/d10/f2c zero size 2024-04-25T13:47:00.101 INFO:tasks.workunit.client.0.smithi043.stdout:4/197: truncate d1/de/d1d/f2c 1563046 0 2024-04-25T13:47:00.102 INFO:tasks.workunit.client.0.smithi043.stdout:0/169: truncate db/f17 5156775 0 2024-04-25T13:47:00.102 INFO:tasks.workunit.client.0.smithi043.stdout:7/299: dread - d5/d36/f3e zero size 2024-04-25T13:47:00.104 INFO:tasks.workunit.client.0.smithi043.stdout:4/198: chown d1/f14 7 1 2024-04-25T13:47:00.105 INFO:tasks.workunit.client.0.smithi043.stdout:8/318: symlink db/d46/l6e 0 2024-04-25T13:47:00.107 INFO:tasks.workunit.client.0.smithi043.stdout:7/300: creat d5/d36/f66 x:0 0 0 2024-04-25T13:47:00.108 INFO:tasks.workunit.client.0.smithi043.stdout:3/236: dread - d0/da/f43 zero size 2024-04-25T13:47:00.108 INFO:tasks.workunit.client.0.smithi043.stdout:0/170: creat db/d1b/f35 x:0 0 0 2024-04-25T13:47:00.109 INFO:tasks.workunit.client.0.smithi043.stdout:7/301: chown d5/d36 0 1 2024-04-25T13:47:00.110 INFO:tasks.workunit.client.0.smithi043.stdout:1/196: mknod df/d31/d34/c37 0 2024-04-25T13:47:00.113 INFO:tasks.workunit.client.0.smithi043.stdout:4/199: unlink d1/de/d1d/f2a 0 2024-04-25T13:47:00.113 INFO:tasks.workunit.client.0.smithi043.stdout:0/171: write db/d25/f2b [91417,107645] 0 2024-04-25T13:47:00.116 INFO:tasks.workunit.client.0.smithi043.stdout:7/302: read d5/d32/f5f [2862553,65502] 0 2024-04-25T13:47:00.118 INFO:tasks.workunit.client.0.smithi043.stdout:1/197: write df/d10/f12 [485031,29982] 0 2024-04-25T13:47:00.120 INFO:tasks.workunit.client.0.smithi043.stdout:2/156: dwrite d0/d8/db/d17/f23 [0,4194304] 0 2024-04-25T13:47:00.124 INFO:tasks.workunit.client.0.smithi043.stdout:7/303: write d5/d11/f41 [553064,84729] 0 2024-04-25T13:47:00.125 INFO:tasks.workunit.client.0.smithi043.stdout:1/198: stat df/d14/d2a 0 2024-04-25T13:47:00.125 INFO:tasks.workunit.client.0.smithi043.stdout:8/319: dwrite db/d11/f1d [4194304,4194304] 0 2024-04-25T13:47:00.125 INFO:tasks.workunit.client.0.smithi043.stdout:3/237: read d0/da/f2d [1020717,74164] 0 2024-04-25T13:47:00.137 INFO:tasks.workunit.client.0.smithi043.stdout:8/320: truncate db/d11/f17 1645404 0 2024-04-25T13:47:00.137 INFO:tasks.workunit.client.0.smithi043.stdout:6/216: dread d0/d1b/f1d [0,4194304] 0 2024-04-25T13:47:00.138 INFO:tasks.workunit.client.0.smithi043.stdout:0/172: getdents db/d25 0 2024-04-25T13:47:00.138 INFO:tasks.workunit.client.0.smithi043.stdout:4/200: dwrite d1/d3/f15 [0,4194304] 0 2024-04-25T13:47:00.139 INFO:tasks.workunit.client.0.smithi043.stdout:7/304: mknod d5/d11/d3b/d61/c67 0 2024-04-25T13:47:00.139 INFO:tasks.workunit.client.0.smithi043.stdout:5/173: sync 2024-04-25T13:47:00.140 INFO:tasks.workunit.client.0.smithi043.stdout:1/199: dread fc [0,4194304] 0 2024-04-25T13:47:00.144 INFO:tasks.workunit.client.0.smithi043.stdout:2/157: dread d0/d5/d1e/f1f [0,4194304] 0 2024-04-25T13:47:00.144 INFO:tasks.workunit.client.0.smithi043.stdout:6/217: chown d0/d1c/l1f 3517953 1 2024-04-25T13:47:00.146 INFO:tasks.workunit.client.0.smithi043.stdout:0/173: rename db/d2f to db/d1b/d36 0 2024-04-25T13:47:00.148 INFO:tasks.workunit.client.0.smithi043.stdout:8/321: write db/dc/f48 [735615,96604] 0 2024-04-25T13:47:00.148 INFO:tasks.workunit.client.0.smithi043.stdout:5/174: creat d1/d3/d7/d9/d2d/f3b x:0 0 0 2024-04-25T13:47:00.148 INFO:tasks.workunit.client.0.smithi043.stdout:7/305: mkdir d5/d11/d3b/d61/d68 0 2024-04-25T13:47:00.149 INFO:tasks.workunit.client.0.smithi043.stdout:2/158: chown d0/d8/db/f1d 11 1 2024-04-25T13:47:00.149 INFO:tasks.workunit.client.0.smithi043.stdout:6/218: write d0/d24/d2e/f37 [7570113,127345] 0 2024-04-25T13:47:00.152 INFO:tasks.workunit.client.0.smithi043.stdout:0/174: chown db/d1b/f22 8413 1 2024-04-25T13:47:00.156 INFO:tasks.workunit.client.0.smithi043.stdout:0/175: fdatasync db/f17 0 2024-04-25T13:47:00.162 INFO:tasks.workunit.client.0.smithi043.stdout:8/322: truncate db/d38/d49/f50 268538 0 2024-04-25T13:47:00.164 INFO:tasks.workunit.client.0.smithi043.stdout:6/219: unlink d0/d24/d2e/d2f/f3c 0 2024-04-25T13:47:00.165 INFO:tasks.workunit.client.0.smithi043.stdout:1/200: dwrite df/d10/d22/f2e [0,4194304] 0 2024-04-25T13:47:00.165 INFO:tasks.workunit.client.0.smithi043.stdout:0/176: mkdir db/d37 0 2024-04-25T13:47:00.166 INFO:tasks.workunit.client.0.smithi043.stdout:4/201: dwrite d1/de/df/f41 [0,4194304] 0 2024-04-25T13:47:00.167 INFO:tasks.workunit.client.0.smithi043.stdout:3/238: rename d0/d9/d15/f2f to d0/d9/d15/f52 0 2024-04-25T13:47:00.212 INFO:tasks.workunit.client.0.smithi043.stdout:7/306: dwrite d5/f45 [0,4194304] 0 2024-04-25T13:47:00.213 INFO:tasks.workunit.client.0.smithi043.stdout:4/202: dread - d1/d3/f3e zero size 2024-04-25T13:47:00.214 INFO:tasks.workunit.client.0.smithi043.stdout:5/175: dread d1/d3/d7/d9/d2d/f34 [4194304,4194304] 0 2024-04-25T13:47:00.214 INFO:tasks.workunit.client.0.smithi043.stdout:0/177: creat db/d1b/f38 x:0 0 0 2024-04-25T13:47:00.214 INFO:tasks.workunit.client.0.smithi043.stdout:1/201: mkdir df/d31/d38 0 2024-04-25T13:47:00.280 INFO:tasks.workunit.client.0.smithi043.stdout:9/205: sync 2024-04-25T13:47:00.301 INFO:tasks.workunit.client.0.smithi043.stdout:6/220: link d0/fc d0/d1c/f3e 0 2024-04-25T13:47:00.303 INFO:tasks.workunit.client.0.smithi043.stdout:4/203: symlink d1/de/d1d/l43 0 2024-04-25T13:47:00.303 INFO:tasks.workunit.client.0.smithi043.stdout:5/176: read d1/d3/d7/d9/d2d/f34 [2828665,103344] 0 2024-04-25T13:47:00.303 INFO:tasks.workunit.client.0.smithi043.stdout:1/202: truncate fe 2928212 0 2024-04-25T13:47:00.304 INFO:tasks.workunit.client.0.smithi043.stdout:0/178: chown db/cf 32209 1 2024-04-25T13:47:00.304 INFO:tasks.workunit.client.0.smithi043.stdout:2/159: dwrite d0/d8/ff [0,4194304] 0 2024-04-25T13:47:00.306 INFO:tasks.workunit.client.0.smithi043.stdout:1/203: fdatasync df/d10/f13 0 2024-04-25T13:47:00.306 INFO:tasks.workunit.client.0.smithi043.stdout:3/239: mknod d0/d9/d15/d34/c53 0 2024-04-25T13:47:00.308 INFO:tasks.workunit.client.0.smithi043.stdout:4/204: chown d1/de/d1d/d20/d38/f37 60396 1 2024-04-25T13:47:00.308 INFO:tasks.workunit.client.0.smithi043.stdout:3/240: chown d0/d13/d2e/c4a 0 1 2024-04-25T13:47:00.309 INFO:tasks.workunit.client.0.smithi043.stdout:9/206: mkdir d0/d1d/dc/d26/d47/d52 0 2024-04-25T13:47:00.310 INFO:tasks.workunit.client.0.smithi043.stdout:4/205: fdatasync d1/de/df/f40 0 2024-04-25T13:47:00.312 INFO:tasks.workunit.client.0.smithi043.stdout:5/177: symlink d1/d3/d26/l3c 0 2024-04-25T13:47:00.314 INFO:tasks.workunit.client.0.smithi043.stdout:6/221: dwrite d0/f13 [0,4194304] 0 2024-04-25T13:47:00.314 INFO:tasks.workunit.client.0.smithi043.stdout:4/206: truncate d1/de/df/f40 118886 0 2024-04-25T13:47:00.317 INFO:tasks.workunit.client.0.smithi043.stdout:0/179: mkdir db/d1b/d23/d27/d39 0 2024-04-25T13:47:00.323 INFO:tasks.workunit.client.0.smithi043.stdout:1/204: rmdir df/d14 39 2024-04-25T13:47:00.323 INFO:tasks.workunit.client.0.smithi043.stdout:3/241: dwrite d0/f3b [0,4194304] 0 2024-04-25T13:47:00.323 INFO:tasks.workunit.client.0.smithi043.stdout:0/180: read - db/d1b/f38 zero size 2024-04-25T13:47:00.324 INFO:tasks.workunit.client.0.smithi043.stdout:4/207: write d1/de/df/d1e/d28/f39 [208222,27316] 0 2024-04-25T13:47:00.324 INFO:tasks.workunit.client.0.smithi043.stdout:4/208: fsync d1/de/df/d1e/f30 0 2024-04-25T13:47:00.325 INFO:tasks.workunit.client.0.smithi043.stdout:4/209: chown d1/de/d1d/d20 13025834 1 2024-04-25T13:47:00.326 INFO:tasks.workunit.client.0.smithi043.stdout:4/210: chown d1/de/l1b 1 1 2024-04-25T13:47:00.327 INFO:tasks.workunit.client.0.smithi043.stdout:4/211: chown d1/de/df 73981112 1 2024-04-25T13:47:00.329 INFO:tasks.workunit.client.0.smithi043.stdout:4/212: chown d1/d3/f9 1 1 2024-04-25T13:47:00.365 INFO:tasks.workunit.client.0.smithi043.stdout:8/323: sync 2024-04-25T13:47:00.459 INFO:tasks.workunit.client.0.smithi043.stdout:7/307: link d5/d11/d3b/d3f/c5b d5/d36/d54/c69 0 2024-04-25T13:47:00.461 INFO:tasks.workunit.client.0.smithi043.stdout:6/222: creat d0/d1c/f3f x:0 0 0 2024-04-25T13:47:00.461 INFO:tasks.workunit.client.0.smithi043.stdout:0/181: mknod db/d1b/c3a 0 2024-04-25T13:47:00.461 INFO:tasks.workunit.client.0.smithi043.stdout:7/308: readlink d5/d11/d3b/d3f/l4f 0 2024-04-25T13:47:00.461 INFO:tasks.workunit.client.0.smithi043.stdout:4/213: symlink d1/de/d1d/d20/d38/d3a/l44 0 2024-04-25T13:47:00.463 INFO:tasks.workunit.client.0.smithi043.stdout:8/324: write db/dc/f2f [1342068,60650] 0 2024-04-25T13:47:00.464 INFO:tasks.workunit.client.0.smithi043.stdout:3/242: fdatasync d0/d14/f4b 0 2024-04-25T13:47:00.464 INFO:tasks.workunit.client.0.smithi043.stdout:0/182: read db/fc [2485790,69726] 0 2024-04-25T13:47:00.468 INFO:tasks.workunit.client.0.smithi043.stdout:1/205: mkdir df/d14/d2a/d39 0 2024-04-25T13:47:00.470 INFO:tasks.workunit.client.0.smithi043.stdout:1/206: stat df/f35 0 2024-04-25T13:47:00.472 INFO:tasks.workunit.client.0.smithi043.stdout:2/160: dwrite d0/f12 [0,4194304] 0 2024-04-25T13:47:00.476 INFO:tasks.workunit.client.0.smithi043.stdout:1/207: creat df/d10/d22/f3a x:0 0 0 2024-04-25T13:47:00.480 INFO:tasks.workunit.client.0.smithi043.stdout:8/325: dwrite db/d46/f61 [0,4194304] 0 2024-04-25T13:47:00.482 INFO:tasks.workunit.client.0.smithi043.stdout:3/243: dwrite d0/d9/f44 [4194304,4194304] 0 2024-04-25T13:47:00.482 INFO:tasks.workunit.client.0.smithi043.stdout:0/183: dwrite f8 [0,4194304] 0 2024-04-25T13:47:00.484 INFO:tasks.workunit.client.0.smithi043.stdout:4/214: mkdir d1/de/df/d1e/d45 0 2024-04-25T13:47:00.484 INFO:tasks.workunit.client.0.smithi043.stdout:1/208: creat df/d31/d38/f3b x:0 0 0 2024-04-25T13:47:00.485 INFO:tasks.workunit.client.0.smithi043.stdout:7/309: rename d5/l62 to d5/d11/d3b/d3f/l6a 0 2024-04-25T13:47:00.485 INFO:tasks.workunit.client.0.smithi043.stdout:3/244: chown d0/f4 10 1 2024-04-25T13:47:00.486 INFO:tasks.workunit.client.0.smithi043.stdout:8/326: chown db/d11/d1b/f66 24965223 1 2024-04-25T13:47:00.487 INFO:tasks.workunit.client.0.smithi043.stdout:4/215: chown d1/d34/d35/d3d 47678 1 2024-04-25T13:47:00.489 INFO:tasks.workunit.client.0.smithi043.stdout:2/161: mkdir d0/d8/db/d24 0 2024-04-25T13:47:00.497 INFO:tasks.workunit.client.0.smithi043.stdout:5/178: dwrite d1/f19 [0,4194304] 0 2024-04-25T13:47:00.499 INFO:tasks.workunit.client.0.smithi043.stdout:0/184: link c2 db/d1b/d23/c3b 0 2024-04-25T13:47:00.500 INFO:tasks.workunit.client.0.smithi043.stdout:2/162: symlink d0/d8/l25 0 2024-04-25T13:47:00.502 INFO:tasks.workunit.client.0.smithi043.stdout:0/185: fdatasync db/d1b/f29 0 2024-04-25T13:47:00.503 INFO:tasks.workunit.client.0.smithi043.stdout:1/209: creat df/d14/f3c x:0 0 0 2024-04-25T13:47:00.505 INFO:tasks.workunit.client.0.smithi043.stdout:3/245: dread d0/d9/f44 [0,4194304] 0 2024-04-25T13:47:00.506 INFO:tasks.workunit.client.0.smithi043.stdout:5/179: creat d1/d3/d24/f3d x:0 0 0 2024-04-25T13:47:00.507 INFO:tasks.workunit.client.0.smithi043.stdout:0/186: symlink db/d25/d2a/l3c 0 2024-04-25T13:47:00.510 INFO:tasks.workunit.client.0.smithi043.stdout:7/310: getdents d5/d36 0 2024-04-25T13:47:00.510 INFO:tasks.workunit.client.0.smithi043.stdout:4/216: dread d1/de/df/d1a/f2d [4194304,4194304] 0 2024-04-25T13:47:00.510 INFO:tasks.workunit.client.0.smithi043.stdout:8/327: creat db/dc/d28/f6f x:0 0 0 2024-04-25T13:47:00.513 INFO:tasks.workunit.client.0.smithi043.stdout:7/311: fdatasync d5/d11/d3b/d3f/d5a/f5e 0 2024-04-25T13:47:00.513 INFO:tasks.workunit.client.0.smithi043.stdout:4/217: write d1/d3/f3e [788134,52009] 0 2024-04-25T13:47:00.513 INFO:tasks.workunit.client.0.smithi043.stdout:2/163: fdatasync d0/d5/d1e/f1f 0 2024-04-25T13:47:00.514 INFO:tasks.workunit.client.0.smithi043.stdout:8/328: write db/d11/f15 [3936678,90318] 0 2024-04-25T13:47:00.515 INFO:tasks.workunit.client.0.smithi043.stdout:1/210: mkdir df/d14/d3d 0 2024-04-25T13:47:00.517 INFO:tasks.workunit.client.0.smithi043.stdout:4/218: chown d1/de/l1b 8607462 1 2024-04-25T13:47:00.517 INFO:tasks.workunit.client.0.smithi043.stdout:5/180: symlink d1/d3/l3e 0 2024-04-25T13:47:00.520 INFO:tasks.workunit.client.0.smithi043.stdout:0/187: getdents db/d1b/d23/d27/d39 0 2024-04-25T13:47:00.521 INFO:tasks.workunit.client.0.smithi043.stdout:4/219: fdatasync d1/de/df/d1a/f3c 0 2024-04-25T13:47:00.523 INFO:tasks.workunit.client.0.smithi043.stdout:7/312: mkdir d5/d6b 0 2024-04-25T13:47:00.524 INFO:tasks.workunit.client.0.smithi043.stdout:8/329: read db/ff [1351915,30943] 0 2024-04-25T13:47:00.526 INFO:tasks.workunit.client.0.smithi043.stdout:4/220: chown d1/de/df/d1e/d28 1258 1 2024-04-25T13:47:00.528 INFO:tasks.workunit.client.0.smithi043.stdout:3/246: dwrite d0/f2 [0,4194304] 0 2024-04-25T13:47:00.530 INFO:tasks.workunit.client.0.smithi043.stdout:9/207: write d0/d1d/f29 [1501935,91956] 0 2024-04-25T13:47:00.531 INFO:tasks.workunit.client.0.smithi043.stdout:1/211: dwrite df/d14/f3c [0,4194304] 0 2024-04-25T13:47:00.531 INFO:tasks.workunit.client.0.smithi043.stdout:6/223: write d0/ff [2950486,31049] 0 2024-04-25T13:47:00.536 INFO:tasks.workunit.client.0.smithi043.stdout:5/181: dwrite d1/d3/d7/f23 [0,4194304] 0 2024-04-25T13:47:00.538 INFO:tasks.workunit.client.0.smithi043.stdout:6/224: truncate d0/d24/d2e/d2f/f32 4251124 0 2024-04-25T13:47:00.538 INFO:tasks.workunit.client.0.smithi043.stdout:4/221: creat d1/de/d1d/d20/d38/f46 x:0 0 0 2024-04-25T13:47:00.539 INFO:tasks.workunit.client.0.smithi043.stdout:0/188: creat db/d1b/d23/d27/d39/f3d x:0 0 0 2024-04-25T13:47:00.539 INFO:tasks.workunit.client.0.smithi043.stdout:2/164: chown d0/d8/db/le 283054887 1 2024-04-25T13:47:00.542 INFO:tasks.workunit.client.0.smithi043.stdout:7/313: creat d5/d36/d64/f6c x:0 0 0 2024-04-25T13:47:00.542 INFO:tasks.workunit.client.0.smithi043.stdout:0/189: chown db/f12 500 1 2024-04-25T13:47:00.543 INFO:tasks.workunit.client.0.smithi043.stdout:8/330: mknod db/dc/c70 0 2024-04-25T13:47:00.543 INFO:tasks.workunit.client.0.smithi043.stdout:4/222: fsync d1/de/d1d/d20/d38/f37 0 2024-04-25T13:47:00.547 INFO:tasks.workunit.client.0.smithi043.stdout:1/212: getdents df/d31/d34 0 2024-04-25T13:47:00.552 INFO:tasks.workunit.client.0.smithi043.stdout:1/213: mknod df/d14/d3d/c3e 0 2024-04-25T13:47:00.552 INFO:tasks.workunit.client.0.smithi043.stdout:9/208: rename d0/f42 to d0/d1d/f53 0 2024-04-25T13:47:00.555 INFO:tasks.workunit.client.0.smithi043.stdout:1/214: mkdir df/d31/d38/d3f 0 2024-04-25T13:47:00.557 INFO:tasks.workunit.client.0.smithi043.stdout:0/190: dwrite f9 [0,4194304] 0 2024-04-25T13:47:00.557 INFO:tasks.workunit.client.0.smithi043.stdout:6/225: creat d0/f40 x:0 0 0 2024-04-25T13:47:00.563 INFO:tasks.workunit.client.0.smithi043.stdout:7/314: link d5/fd d5/f6d 0 2024-04-25T13:47:00.566 INFO:tasks.workunit.client.0.smithi043.stdout:9/209: rename d0/d1d/d22/c2c to d0/d1d/dc/d26/d39/c54 0 2024-04-25T13:47:00.569 INFO:tasks.workunit.client.0.smithi043.stdout:8/331: chown db/dc/l3a 1105397640 1 2024-04-25T13:47:00.570 INFO:tasks.workunit.client.0.smithi043.stdout:4/223: creat d1/de/df/d1a/f47 x:0 0 0 2024-04-25T13:47:00.570 INFO:tasks.workunit.client.0.smithi043.stdout:1/215: dread df/d14/f3c [0,4194304] 0 2024-04-25T13:47:00.570 INFO:tasks.workunit.client.0.smithi043.stdout:5/182: dwrite d1/d3/d7/d8/da/f2c [4194304,4194304] 0 2024-04-25T13:47:00.571 INFO:tasks.workunit.client.0.smithi043.stdout:9/210: fsync d0/d1d/d7/f2e 0 2024-04-25T13:47:00.574 INFO:tasks.workunit.client.0.smithi043.stdout:7/315: mknod d5/d11/d3b/d3f/c6e 0 2024-04-25T13:47:00.575 INFO:tasks.workunit.client.0.smithi043.stdout:0/191: dwrite f6 [0,4194304] 0 2024-04-25T13:47:00.575 INFO:tasks.workunit.client.0.smithi043.stdout:5/183: dread - d1/d3/d7/d9/d2d/f3b zero size 2024-04-25T13:47:00.576 INFO:tasks.workunit.client.0.smithi043.stdout:9/211: write d0/d1d/d22/f43 [188185,116115] 0 2024-04-25T13:47:00.576 INFO:tasks.workunit.client.0.smithi043.stdout:7/316: fdatasync d5/d11/f42 0 2024-04-25T13:47:00.577 INFO:tasks.workunit.client.0.smithi043.stdout:1/216: unlink f9 0 2024-04-25T13:47:00.577 INFO:tasks.workunit.client.0.smithi043.stdout:4/224: creat d1/de/d1d/d20/d38/d3a/f48 x:0 0 0 2024-04-25T13:47:00.579 INFO:tasks.workunit.client.0.smithi043.stdout:0/192: chown db/d1b/d23/d27/d39/f3d 249980019 1 2024-04-25T13:47:00.579 INFO:tasks.workunit.client.0.smithi043.stdout:5/184: readlink d1/d3/d7/d8/da/d2e/l31 0 2024-04-25T13:47:00.581 INFO:tasks.workunit.client.0.smithi043.stdout:6/226: getdents d0/d24/d2e 0 2024-04-25T13:47:00.581 INFO:tasks.workunit.client.0.smithi043.stdout:6/227: chown d0/d1c 1 1 2024-04-25T13:47:00.582 INFO:tasks.workunit.client.0.smithi043.stdout:6/228: write d0/d1c/f3b [372417,96781] 0 2024-04-25T13:47:00.584 INFO:tasks.workunit.client.0.smithi043.stdout:6/229: fsync d0/fe 0 2024-04-25T13:47:00.586 INFO:tasks.workunit.client.0.smithi043.stdout:4/225: mkdir d1/de/df/d1a/d49 0 2024-04-25T13:47:00.588 INFO:tasks.workunit.client.0.smithi043.stdout:4/226: stat d1 0 2024-04-25T13:47:00.590 INFO:tasks.workunit.client.0.smithi043.stdout:5/185: symlink d1/l3f 0 2024-04-25T13:47:00.590 INFO:tasks.workunit.client.0.smithi043.stdout:1/217: getdents df/d10/d22 0 2024-04-25T13:47:00.591 INFO:tasks.workunit.client.0.smithi043.stdout:7/317: rename d5/d36/l44 to d5/d32/l6f 0 2024-04-25T13:47:00.592 INFO:tasks.workunit.client.0.smithi043.stdout:6/230: mkdir d0/d24/d2e/d2f/d41 0 2024-04-25T13:47:00.594 INFO:tasks.workunit.client.0.smithi043.stdout:1/218: stat df/d31 0 2024-04-25T13:47:00.598 INFO:tasks.workunit.client.0.smithi043.stdout:6/231: read d0/d24/d2e/f37 [5231079,21166] 0 2024-04-25T13:47:00.598 INFO:tasks.workunit.client.0.smithi043.stdout:9/212: rename d0/l8 to d0/d1d/dc/d26/d47/d52/l55 0 2024-04-25T13:47:00.600 INFO:tasks.workunit.client.0.smithi043.stdout:9/213: dread - d0/f21 zero size 2024-04-25T13:47:00.601 INFO:tasks.workunit.client.0.smithi043.stdout:6/232: readlink d0/l1e 0 2024-04-25T13:47:00.602 INFO:tasks.workunit.client.0.smithi043.stdout:4/227: dread d1/de/df/d1e/d28/f39 [0,4194304] 0 2024-04-25T13:47:00.602 INFO:tasks.workunit.client.0.smithi043.stdout:0/193: dwrite db/f18 [0,4194304] 0 2024-04-25T13:47:00.603 INFO:tasks.workunit.client.0.smithi043.stdout:5/186: rename d1/d3/d37 to d1/d3/d7/d2f/d40 0 2024-04-25T13:47:00.603 INFO:tasks.workunit.client.0.smithi043.stdout:1/219: symlink df/d10/d22/d2f/d32/l40 0 2024-04-25T13:47:00.605 INFO:tasks.workunit.client.0.smithi043.stdout:6/233: mknod d0/d1c/c42 0 2024-04-25T13:47:00.606 INFO:tasks.workunit.client.0.smithi043.stdout:1/220: readlink df/d10/d22/d2f/d32/l40 0 2024-04-25T13:47:00.607 INFO:tasks.workunit.client.0.smithi043.stdout:8/332: dread db/dc/d21/d4e/f58 [0,4194304] 0 2024-04-25T13:47:00.607 INFO:tasks.workunit.client.0.smithi043.stdout:6/234: readlink d0/ld 0 2024-04-25T13:47:00.608 INFO:tasks.workunit.client.0.smithi043.stdout:5/187: chown d1/d3/d26/l3c 91963121 1 2024-04-25T13:47:00.609 INFO:tasks.workunit.client.0.smithi043.stdout:1/221: write df/d10/f13 [4428007,82136] 0 2024-04-25T13:47:00.611 INFO:tasks.workunit.client.0.smithi043.stdout:9/214: creat d0/d1d/d7/d3a/f56 x:0 0 0 2024-04-25T13:47:00.612 INFO:tasks.workunit.client.0.smithi043.stdout:6/235: mknod d0/d24/d2e/c43 0 2024-04-25T13:47:00.612 INFO:tasks.workunit.client.0.smithi043.stdout:0/194: dread f8 [0,4194304] 0 2024-04-25T13:47:00.613 INFO:tasks.workunit.client.0.smithi043.stdout:1/222: mkdir df/d31/d38/d3f/d41 0 2024-04-25T13:47:00.613 INFO:tasks.workunit.client.0.smithi043.stdout:6/236: write d0/d1c/f3f [224731,48879] 0 2024-04-25T13:47:00.614 INFO:tasks.workunit.client.0.smithi043.stdout:7/318: rename d5/d11/f28 to d5/d11/d3b/f70 0 2024-04-25T13:47:00.617 INFO:tasks.workunit.client.0.smithi043.stdout:8/333: unlink db/d11/d1b/d1e/f53 0 2024-04-25T13:47:00.618 INFO:tasks.workunit.client.0.smithi043.stdout:5/188: creat d1/d3/d24/f41 x:0 0 0 2024-04-25T13:47:00.622 INFO:tasks.workunit.client.0.smithi043.stdout:2/165: dread d0/f12 [0,4194304] 0 2024-04-25T13:47:00.622 INFO:tasks.workunit.client.0.smithi043.stdout:0/195: fsync db/d1b/f1e 0 2024-04-25T13:47:00.622 INFO:tasks.workunit.client.0.smithi043.stdout:9/215: write d0/f4 [1041791,125573] 0 2024-04-25T13:47:00.622 INFO:tasks.workunit.client.0.smithi043.stdout:4/228: rename d1/d3/c2b to d1/de/df/d1a/d27/d36/c4a 0 2024-04-25T13:47:00.623 INFO:tasks.workunit.client.0.smithi043.stdout:6/237: mknod d0/d3d/c44 0 2024-04-25T13:47:00.625 INFO:tasks.workunit.client.0.smithi043.stdout:7/319: creat d5/d6b/f71 x:0 0 0 2024-04-25T13:47:00.628 INFO:tasks.workunit.client.0.smithi043.stdout:0/196: rename db/d1b/d23 to db/d1b/d23/d27/d39/d3e 22 2024-04-25T13:47:00.628 INFO:tasks.workunit.client.0.smithi043.stdout:2/166: mkdir d0/d26 0 2024-04-25T13:47:00.630 INFO:tasks.workunit.client.0.smithi043.stdout:7/320: write d5/d11/d3b/f46 [1661332,24847] 0 2024-04-25T13:47:00.631 INFO:tasks.workunit.client.0.smithi043.stdout:8/334: dwrite db/d38/d49/f50 [0,4194304] 0 2024-04-25T13:47:00.633 INFO:tasks.workunit.client.0.smithi043.stdout:5/189: getdents d1/d3/d7/d2f 0 2024-04-25T13:47:00.640 INFO:tasks.workunit.client.0.smithi043.stdout:6/238: truncate d0/f20 6518480 0 2024-04-25T13:47:00.640 INFO:tasks.workunit.client.0.smithi043.stdout:0/197: dwrite db/d1b/d23/d27/d39/f3d [0,4194304] 0 2024-04-25T13:47:00.641 INFO:tasks.workunit.client.0.smithi043.stdout:4/229: write d1/d3/f9 [212258,20052] 0 2024-04-25T13:47:00.645 INFO:tasks.workunit.client.0.smithi043.stdout:5/190: dwrite d1/d3/d7/d9/d2d/f34 [8388608,4194304] 0 2024-04-25T13:47:00.649 INFO:tasks.workunit.client.0.smithi043.stdout:9/216: link d0/d1d/d7/f49 d0/d1d/dc/d26/d47/d52/f57 0 2024-04-25T13:47:00.649 INFO:tasks.workunit.client.0.smithi043.stdout:0/198: mkdir db/d25/d2a/d3f 0 2024-04-25T13:47:00.650 INFO:tasks.workunit.client.0.smithi043.stdout:2/167: mknod d0/d8/db/c27 0 2024-04-25T13:47:00.656 INFO:tasks.workunit.client.0.smithi043.stdout:7/321: dwrite d5/d11/f19 [0,4194304] 0 2024-04-25T13:47:00.656 INFO:tasks.workunit.client.0.smithi043.stdout:5/191: rmdir d1/d3/d7/d8 39 2024-04-25T13:47:00.657 INFO:tasks.workunit.client.0.smithi043.stdout:5/192: chown d1/d3/d26/f27 171551811 1 2024-04-25T13:47:00.659 INFO:tasks.workunit.client.0.smithi043.stdout:5/193: dread - d1/d3/d7/d2f/d40/f39 zero size 2024-04-25T13:47:00.660 INFO:tasks.workunit.client.0.smithi043.stdout:4/230: link d1/de/df/f40 d1/d3/f4b 0 2024-04-25T13:47:00.662 INFO:tasks.workunit.client.0.smithi043.stdout:0/199: symlink db/d1b/d36/l40 0 2024-04-25T13:47:00.662 INFO:tasks.workunit.client.0.smithi043.stdout:8/335: rename db/d38/d49 to db/d38/d3c/d71 0 2024-04-25T13:47:00.663 INFO:tasks.workunit.client.0.smithi043.stdout:9/217: fdatasync d0/d1d/dc/d26/d47/d52/f57 0 2024-04-25T13:47:00.665 INFO:tasks.workunit.client.0.smithi043.stdout:1/223: dread df/f1b [0,4194304] 0 2024-04-25T13:47:00.666 INFO:tasks.workunit.client.0.smithi043.stdout:1/224: dread - df/d10/d22/f3a zero size 2024-04-25T13:47:00.668 INFO:tasks.workunit.client.0.smithi043.stdout:0/200: mkdir db/d1b/d36/d41 0 2024-04-25T13:47:00.670 INFO:tasks.workunit.client.0.smithi043.stdout:2/168: truncate d0/d8/fd 89568 0 2024-04-25T13:47:00.670 INFO:tasks.workunit.client.0.smithi043.stdout:0/201: write db/d1b/f22 [1598958,113867] 0 2024-04-25T13:47:00.672 INFO:tasks.workunit.client.0.smithi043.stdout:0/202: chown f6 1657 1 2024-04-25T13:47:00.673 INFO:tasks.workunit.client.0.smithi043.stdout:9/218: write d0/d1d/f28 [469778,65045] 0 2024-04-25T13:47:00.674 INFO:tasks.workunit.client.0.smithi043.stdout:6/239: rename d0/f20 to d0/d24/d2e/d2f/d41/f45 0 2024-04-25T13:47:00.677 INFO:tasks.workunit.client.0.smithi043.stdout:7/322: creat d5/f72 x:0 0 0 2024-04-25T13:47:00.679 INFO:tasks.workunit.client.0.smithi043.stdout:4/231: creat d1/de/df/d1a/f4c x:0 0 0 2024-04-25T13:47:00.680 INFO:tasks.workunit.client.0.smithi043.stdout:1/225: dwrite df/d10/f12 [0,4194304] 0 2024-04-25T13:47:00.680 INFO:tasks.workunit.client.0.smithi043.stdout:9/219: write d0/d1d/dc/f33 [1664270,103218] 0 2024-04-25T13:47:00.683 INFO:tasks.workunit.client.0.smithi043.stdout:0/203: creat db/d25/d2a/d3f/f42 x:0 0 0 2024-04-25T13:47:00.683 INFO:tasks.workunit.client.0.smithi043.stdout:1/226: dread - df/d31/d38/f3b zero size 2024-04-25T13:47:00.686 INFO:tasks.workunit.client.0.smithi043.stdout:7/323: creat d5/d36/f73 x:0 0 0 2024-04-25T13:47:00.689 INFO:tasks.workunit.client.0.smithi043.stdout:4/232: creat d1/de/d1d/d20/d38/d3a/f4d x:0 0 0 2024-04-25T13:47:00.691 INFO:tasks.workunit.client.0.smithi043.stdout:5/194: truncate d1/d3/d26/f27 2440117 0 2024-04-25T13:47:00.693 INFO:tasks.workunit.client.0.smithi043.stdout:2/169: dread d0/d8/fa [0,4194304] 0 2024-04-25T13:47:00.693 INFO:tasks.workunit.client.0.smithi043.stdout:7/324: chown d5/cb 0 1 2024-04-25T13:47:00.695 INFO:tasks.workunit.client.0.smithi043.stdout:6/240: symlink d0/d24/d3a/l46 0 2024-04-25T13:47:00.697 INFO:tasks.workunit.client.0.smithi043.stdout:9/220: creat d0/d1d/dc/d26/d47/d4d/f58 x:0 0 0 2024-04-25T13:47:00.698 INFO:tasks.workunit.client.0.smithi043.stdout:9/221: write d0/d1d/d7/f34 [141567,64271] 0 2024-04-25T13:47:00.700 INFO:tasks.workunit.client.0.smithi043.stdout:5/195: write d1/d3/d7/d8/da/f2c [4400736,130169] 0 2024-04-25T13:47:00.705 INFO:tasks.workunit.client.0.smithi043.stdout:0/204: mkdir db/d1b/d36/d41/d43 0 2024-04-25T13:47:00.708 INFO:tasks.workunit.client.0.smithi043.stdout:7/325: mknod d5/d6b/c74 0 2024-04-25T13:47:00.709 INFO:tasks.workunit.client.0.smithi043.stdout:7/326: read - d5/d36/f66 zero size 2024-04-25T13:47:00.714 INFO:tasks.workunit.client.0.smithi043.stdout:9/222: mknod d0/d1d/d7/d41/c59 0 2024-04-25T13:47:00.716 INFO:tasks.workunit.client.0.smithi043.stdout:5/196: unlink d1/d3/d7/d8/da/d2e/l31 0 2024-04-25T13:47:00.716 INFO:tasks.workunit.client.0.smithi043.stdout:5/197: chown d1/d3/d24 352446 1 2024-04-25T13:47:00.719 INFO:tasks.workunit.client.0.smithi043.stdout:0/205: read db/fc [3751215,95102] 0 2024-04-25T13:47:00.722 INFO:tasks.workunit.client.0.smithi043.stdout:9/223: creat d0/d1d/d7/f5a x:0 0 0 2024-04-25T13:47:00.724 INFO:tasks.workunit.client.0.smithi043.stdout:9/224: stat d0/d1d/dc/d26/d39/d46/f50 0 2024-04-25T13:47:00.725 INFO:tasks.workunit.client.0.smithi043.stdout:6/241: creat d0/f47 x:0 0 0 2024-04-25T13:47:00.725 INFO:tasks.workunit.client.0.smithi043.stdout:4/233: getdents d1/de/df/d1a/d27/d36 0 2024-04-25T13:47:00.727 INFO:tasks.workunit.client.0.smithi043.stdout:2/170: mknod d0/d8/db/c28 0 2024-04-25T13:47:00.729 INFO:tasks.workunit.client.0.smithi043.stdout:4/234: dread - d1/de/df/d1a/f3c zero size 2024-04-25T13:47:00.730 INFO:tasks.workunit.client.0.smithi043.stdout:9/225: link d0/d1d/dc/d26/d39/f3b d0/d1d/d7/f5b 0 2024-04-25T13:47:00.736 INFO:tasks.workunit.client.0.smithi043.stdout:6/242: dwrite d0/f47 [0,4194304] 0 2024-04-25T13:47:00.738 INFO:tasks.workunit.client.0.smithi043.stdout:8/336: dread db/f16 [4194304,4194304] 0 2024-04-25T13:47:00.738 INFO:tasks.workunit.client.0.smithi043.stdout:6/243: chown d0/ld 2561 1 2024-04-25T13:47:00.742 INFO:tasks.workunit.client.0.smithi043.stdout:5/198: dread d1/d3/d7/d8/da/d11/f25 [0,4194304] 0 2024-04-25T13:47:00.742 INFO:tasks.workunit.client.0.smithi043.stdout:6/244: mkdir d0/d24/d2e/d2f/d41/d48 0 2024-04-25T13:47:00.743 INFO:tasks.workunit.client.0.smithi043.stdout:2/171: fdatasync d0/d8/db/f20 0 2024-04-25T13:47:00.744 INFO:tasks.workunit.client.0.smithi043.stdout:5/199: fdatasync d1/d3/d24/f3d 0 2024-04-25T13:47:00.744 INFO:tasks.workunit.client.0.smithi043.stdout:1/227: rename fc to df/d31/d38/d3f/f42 0 2024-04-25T13:47:00.744 INFO:tasks.workunit.client.0.smithi043.stdout:6/245: stat d0/d24/d2e/d2f/f32 0 2024-04-25T13:47:00.746 INFO:tasks.workunit.client.0.smithi043.stdout:6/246: chown d0/d24/d3a/l46 74366 1 2024-04-25T13:47:00.747 INFO:tasks.workunit.client.0.smithi043.stdout:8/337: dread db/dc/d21/f39 [0,4194304] 0 2024-04-25T13:47:00.748 INFO:tasks.workunit.client.0.smithi043.stdout:9/226: rename d0/d1d/dc/f33 to d0/d1d/d7/f5c 0 2024-04-25T13:47:00.749 INFO:tasks.workunit.client.0.smithi043.stdout:9/227: chown d0/d1d/dc/d26/d39/d46 5050 1 2024-04-25T13:47:00.754 INFO:tasks.workunit.client.0.smithi043.stdout:6/247: creat d0/d3d/f49 x:0 0 0 2024-04-25T13:47:00.756 INFO:tasks.workunit.client.0.smithi043.stdout:8/338: mknod db/d44/d5c/c72 0 2024-04-25T13:47:00.756 INFO:tasks.workunit.client.0.smithi043.stdout:1/228: dwrite df/d31/d38/d3f/f42 [0,4194304] 0 2024-04-25T13:47:00.757 INFO:tasks.workunit.client.0.smithi043.stdout:4/235: dread d1/f14 [4194304,4194304] 0 2024-04-25T13:47:00.758 INFO:tasks.workunit.client.0.smithi043.stdout:2/172: fsync d0/d8/db/f20 0 2024-04-25T13:47:00.759 INFO:tasks.workunit.client.0.smithi043.stdout:5/200: getdents d1/d3/d26 0 2024-04-25T13:47:00.760 INFO:tasks.workunit.client.0.smithi043.stdout:2/173: chown d0/f18 32746 1 2024-04-25T13:47:00.763 INFO:tasks.workunit.client.0.smithi043.stdout:5/201: mkdir d1/d4/d42 0 2024-04-25T13:47:00.766 INFO:tasks.workunit.client.0.smithi043.stdout:6/248: link d0/d1c/l22 d0/d24/d2e/d2f/d41/l4a 0 2024-04-25T13:47:00.767 INFO:tasks.workunit.client.0.smithi043.stdout:6/249: stat d0/d1c/c42 0 2024-04-25T13:47:00.768 INFO:tasks.workunit.client.0.smithi043.stdout:4/236: symlink d1/de/df/d1a/l4e 0 2024-04-25T13:47:00.769 INFO:tasks.workunit.client.0.smithi043.stdout:1/229: dwrite df/d31/d38/d3f/f42 [0,4194304] 0 2024-04-25T13:47:00.770 INFO:tasks.workunit.client.0.smithi043.stdout:2/174: mknod d0/d8/d22/c29 0 2024-04-25T13:47:00.771 INFO:tasks.workunit.client.0.smithi043.stdout:5/202: mknod d1/d4/c43 0 2024-04-25T13:47:00.774 INFO:tasks.workunit.client.0.smithi043.stdout:2/175: symlink d0/d5/l2a 0 2024-04-25T13:47:00.775 INFO:tasks.workunit.client.0.smithi043.stdout:2/176: readlink d0/l6 0 2024-04-25T13:47:00.775 INFO:tasks.workunit.client.0.smithi043.stdout:5/203: creat d1/d3/d7/d8/f44 x:0 0 0 2024-04-25T13:47:00.777 INFO:tasks.workunit.client.0.smithi043.stdout:4/237: rename d1/l3f to d1/d34/d35/l4f 0 2024-04-25T13:47:00.777 INFO:tasks.workunit.client.0.smithi043.stdout:1/230: dread df/f1b [0,4194304] 0 2024-04-25T13:47:00.780 INFO:tasks.workunit.client.0.smithi043.stdout:8/339: truncate db/d11/d1b/d1e/f42 808795 0 2024-04-25T13:47:00.782 INFO:tasks.workunit.client.0.smithi043.stdout:5/204: truncate d1/d3/d26/f27 1216190 0 2024-04-25T13:47:00.784 INFO:tasks.workunit.client.0.smithi043.stdout:6/250: dwrite d0/f31 [4194304,4194304] 0 2024-04-25T13:47:00.784 INFO:tasks.workunit.client.0.smithi043.stdout:8/340: unlink db/d11/f51 0 2024-04-25T13:47:00.788 INFO:tasks.workunit.client.0.smithi043.stdout:1/231: rename df/d10/d22/d2f/d32 to df/d31/d38/d43 0 2024-04-25T13:47:00.788 INFO:tasks.workunit.client.0.smithi043.stdout:1/232: stat df 0 2024-04-25T13:47:00.788 INFO:tasks.workunit.client.0.smithi043.stdout:8/341: stat db/dc/d21/d4e/d62 0 2024-04-25T13:47:00.788 INFO:tasks.workunit.client.0.smithi043.stdout:2/177: dwrite d0/d8/db/d17/f23 [0,4194304] 0 2024-04-25T13:47:00.789 INFO:tasks.workunit.client.0.smithi043.stdout:6/251: symlink d0/d1b/l4b 0 2024-04-25T13:47:00.792 INFO:tasks.workunit.client.0.smithi043.stdout:8/342: write db/dc/d28/f6f [329339,107818] 0 2024-04-25T13:47:00.793 INFO:tasks.workunit.client.0.smithi043.stdout:1/233: creat df/d10/f44 x:0 0 0 2024-04-25T13:47:00.793 INFO:tasks.workunit.client.0.smithi043.stdout:2/178: unlink d0/d5/l2a 0 2024-04-25T13:47:00.797 INFO:tasks.workunit.client.0.smithi043.stdout:6/252: mkdir d0/d24/d2e/d2f/d41/d4c 0 2024-04-25T13:47:00.797 INFO:tasks.workunit.client.0.smithi043.stdout:8/343: fsync db/dc/f2f 0 2024-04-25T13:47:00.798 INFO:tasks.workunit.client.0.smithi043.stdout:8/344: stat c6 0 2024-04-25T13:47:00.803 INFO:tasks.workunit.client.0.smithi043.stdout:1/234: write df/d14/f21 [91100,113778] 0 2024-04-25T13:47:00.805 INFO:tasks.workunit.client.0.smithi043.stdout:6/253: mkdir d0/d24/d2e/d2f/d41/d48/d4d 0 2024-04-25T13:47:00.806 INFO:tasks.workunit.client.0.smithi043.stdout:8/345: truncate db/dc/d21/f2e 2039186 0 2024-04-25T13:47:00.808 INFO:tasks.workunit.client.0.smithi043.stdout:2/179: dwrite d0/d8/db/f1d [0,4194304] 0 2024-04-25T13:47:00.811 INFO:tasks.workunit.client.0.smithi043.stdout:8/346: symlink db/l73 0 2024-04-25T13:47:00.812 INFO:tasks.workunit.client.0.smithi043.stdout:2/180: write d0/d8/db/f1a [2403725,13116] 0 2024-04-25T13:47:00.813 INFO:tasks.workunit.client.0.smithi043.stdout:5/205: dwrite d1/d3/d26/f27 [0,4194304] 0 2024-04-25T13:47:00.813 INFO:tasks.workunit.client.0.smithi043.stdout:6/254: rmdir d0/d24/d2e/d2f 39 2024-04-25T13:47:00.815 INFO:tasks.workunit.client.0.smithi043.stdout:5/206: fdatasync d1/d3/d26/f2a 0 2024-04-25T13:47:00.815 INFO:tasks.workunit.client.0.smithi043.stdout:6/255: stat d0/d1c/f3f 0 2024-04-25T13:47:00.816 INFO:tasks.workunit.client.0.smithi043.stdout:1/235: link df/d14/d3d/c3e df/d31/d38/d3f/d41/c45 0 2024-04-25T13:47:00.820 INFO:tasks.workunit.client.0.smithi043.stdout:6/256: fdatasync d0/d1c/f3e 0 2024-04-25T13:47:00.822 INFO:tasks.workunit.client.0.smithi043.stdout:5/207: rmdir d1/d3/d7/d9/d2d 39 2024-04-25T13:47:00.824 INFO:tasks.workunit.client.0.smithi043.stdout:5/208: write d1/d3/d7/d8/df/d28/f33 [765314,85450] 0 2024-04-25T13:47:00.825 INFO:tasks.workunit.client.0.smithi043.stdout:1/236: getdents df 0 2024-04-25T13:47:00.826 INFO:tasks.workunit.client.0.smithi043.stdout:5/209: chown d1/d3/d7/d8 1395526 1 2024-04-25T13:47:00.826 INFO:tasks.workunit.client.0.smithi043.stdout:1/237: chown df/d14/c1e 43928 1 2024-04-25T13:47:00.829 INFO:tasks.workunit.client.0.smithi043.stdout:5/210: chown d1/d3/d7/d8/df/d28/l38 30394 1 2024-04-25T13:47:00.832 INFO:tasks.workunit.client.0.smithi043.stdout:5/211: symlink d1/d4/d42/l45 0 2024-04-25T13:47:00.832 INFO:tasks.workunit.client.0.smithi043.stdout:1/238: dread df/d31/d38/d3f/f42 [0,4194304] 0 2024-04-25T13:47:00.834 INFO:tasks.workunit.client.0.smithi043.stdout:5/212: mknod d1/d3/d7/d8/c46 0 2024-04-25T13:47:00.835 INFO:tasks.workunit.client.0.smithi043.stdout:1/239: rmdir df/d14/d2a 39 2024-04-25T13:47:00.836 INFO:tasks.workunit.client.0.smithi043.stdout:5/213: unlink d1/d3/d7/d8/c16 0 2024-04-25T13:47:00.839 INFO:tasks.workunit.client.0.smithi043.stdout:1/240: mkdir df/d14/d2a/d46 0 2024-04-25T13:47:00.839 INFO:tasks.workunit.client.0.smithi043.stdout:8/347: rename db/dc/c70 to db/d11/d1b/d1e/c74 0 2024-04-25T13:47:00.841 INFO:tasks.workunit.client.0.smithi043.stdout:1/241: mknod df/d31/d38/d3f/c47 0 2024-04-25T13:47:00.843 INFO:tasks.workunit.client.0.smithi043.stdout:1/242: creat df/d31/f48 x:0 0 0 2024-04-25T13:47:00.844 INFO:tasks.workunit.client.0.smithi043.stdout:2/181: rename d0/d8/f13 to d0/d8/d22/f2b 0 2024-04-25T13:47:00.844 INFO:tasks.workunit.client.0.smithi043.stdout:2/182: fdatasync d0/d8/ff 0 2024-04-25T13:47:00.848 INFO:tasks.workunit.client.0.smithi043.stdout:5/214: link d1/c22 d1/d3/d7/d9/c47 0 2024-04-25T13:47:00.848 INFO:tasks.workunit.client.0.smithi043.stdout:1/243: dwrite df/f1b [0,4194304] 0 2024-04-25T13:47:00.864 INFO:tasks.workunit.client.0.smithi043.stdout:8/348: dread - db/dc/d21/d4e/d62/f69 zero size 2024-04-25T13:47:00.864 INFO:tasks.workunit.client.0.smithi043.stdout:1/244: dwrite fe [0,4194304] 0 2024-04-25T13:47:00.866 INFO:tasks.workunit.client.0.smithi043.stdout:1/245: write df/d10/f13 [1676009,124869] 0 2024-04-25T13:47:00.866 INFO:tasks.workunit.client.0.smithi043.stdout:8/349: fdatasync f4 0 2024-04-25T13:47:00.869 INFO:tasks.workunit.client.0.smithi043.stdout:1/246: write df/d31/d38/d3f/f42 [4891942,112109] 0 2024-04-25T13:47:00.872 INFO:tasks.workunit.client.0.smithi043.stdout:8/350: dread db/d46/f61 [0,4194304] 0 2024-04-25T13:47:00.876 INFO:tasks.workunit.client.0.smithi043.stdout:1/247: link df/d31/f48 df/d31/d34/f49 0 2024-04-25T13:47:00.876 INFO:tasks.workunit.client.0.smithi043.stdout:8/351: creat db/d11/d1b/d1e/d27/f75 x:0 0 0 2024-04-25T13:47:00.878 INFO:tasks.workunit.client.0.smithi043.stdout:1/248: creat df/d31/d34/f4a x:0 0 0 2024-04-25T13:47:00.882 INFO:tasks.workunit.client.0.smithi043.stdout:8/352: mknod db/dc/d28/c76 0 2024-04-25T13:47:00.884 INFO:tasks.workunit.client.0.smithi043.stdout:8/353: stat db/dc/d21/f25 0 2024-04-25T13:47:00.885 INFO:tasks.workunit.client.0.smithi043.stdout:8/354: chown f4 5 1 2024-04-25T13:47:00.886 INFO:tasks.workunit.client.0.smithi043.stdout:1/249: dwrite df/d14/f1c [0,4194304] 0 2024-04-25T13:47:00.890 INFO:tasks.workunit.client.0.smithi043.stdout:1/250: unlink df/d10/d22/d2f/c33 0 2024-04-25T13:47:00.894 INFO:tasks.workunit.client.0.smithi043.stdout:8/355: mkdir db/d38/d77 0 2024-04-25T13:47:00.895 INFO:tasks.workunit.client.0.smithi043.stdout:8/356: fdatasync db/d11/f1d 0 2024-04-25T13:47:00.897 INFO:tasks.workunit.client.0.smithi043.stdout:8/357: read db/dc/d21/f25 [1016410,74091] 0 2024-04-25T13:47:00.900 INFO:tasks.workunit.client.0.smithi043.stdout:8/358: creat db/d44/f78 x:0 0 0 2024-04-25T13:47:00.901 INFO:tasks.workunit.client.0.smithi043.stdout:8/359: chown db/dc/d21/d4e/d62/f64 46653470 1 2024-04-25T13:47:00.934 INFO:tasks.workunit.client.0.smithi043.stdout:3/247: sync 2024-04-25T13:47:00.937 INFO:tasks.workunit.client.0.smithi043.stdout:3/248: write d0/d9/f20 [997275,104598] 0 2024-04-25T13:47:00.941 INFO:tasks.workunit.client.0.smithi043.stdout:3/249: mknod d0/d9/c54 0 2024-04-25T13:47:00.948 INFO:tasks.workunit.client.0.smithi043.stdout:3/250: dwrite d0/d13/d2e/f31 [0,4194304] 0 2024-04-25T13:47:00.951 INFO:tasks.workunit.client.0.smithi043.stdout:3/251: mkdir d0/d13/d55 0 2024-04-25T13:47:00.956 INFO:tasks.workunit.client.0.smithi043.stdout:3/252: creat d0/d9/d15/d38/d3f/f56 x:0 0 0 2024-04-25T13:47:00.958 INFO:tasks.workunit.client.0.smithi043.stdout:3/253: mkdir d0/d9/d15/d34/d36/d57 0 2024-04-25T13:47:00.966 INFO:tasks.workunit.client.0.smithi043.stdout:3/254: dwrite d0/d14/f3e [0,4194304] 0 2024-04-25T13:47:00.969 INFO:tasks.workunit.client.0.smithi043.stdout:3/255: write d0/d14/f3e [2263645,92422] 0 2024-04-25T13:47:00.970 INFO:tasks.workunit.client.0.smithi043.stdout:3/256: read d0/f3b [2360067,13784] 0 2024-04-25T13:47:00.974 INFO:tasks.workunit.client.0.smithi043.stdout:3/257: creat d0/d9/f58 x:0 0 0 2024-04-25T13:47:00.985 INFO:tasks.workunit.client.0.smithi043.stdout:3/258: link d0/d9/d15/c3c d0/d9/d15/c59 0 2024-04-25T13:47:00.988 INFO:tasks.workunit.client.0.smithi043.stdout:3/259: mkdir d0/d13/d5a 0 2024-04-25T13:47:00.988 INFO:tasks.workunit.client.0.smithi043.stdout:3/260: fdatasync d0/d14/f4b 0 2024-04-25T13:47:00.988 INFO:tasks.workunit.client.0.smithi043.stdout:8/360: dwrite db/f16 [4194304,4194304] 0 2024-04-25T13:47:00.990 INFO:tasks.workunit.client.0.smithi043.stdout:8/361: mkdir db/d11/d79 0 2024-04-25T13:47:00.991 INFO:tasks.workunit.client.0.smithi043.stdout:3/261: symlink d0/da/l5b 0 2024-04-25T13:47:00.992 INFO:tasks.workunit.client.0.smithi043.stdout:8/362: mknod db/c7a 0 2024-04-25T13:47:00.994 INFO:tasks.workunit.client.0.smithi043.stdout:8/363: truncate db/dc/f45 882614 0 2024-04-25T13:47:01.012 INFO:tasks.workunit.client.0.smithi043.stdout:3/262: rename d0/da/c25 to d0/d9/d15/d34/d36/c5c 0 2024-04-25T13:47:01.015 INFO:tasks.workunit.client.0.smithi043.stdout:3/263: rename d0/d9/f58 to d0/d9/f5d 0 2024-04-25T13:47:01.016 INFO:tasks.workunit.client.0.smithi043.stdout:3/264: chown d0/d9 0 1 2024-04-25T13:47:01.021 INFO:tasks.workunit.client.0.smithi043.stdout:3/265: dwrite d0/d9/d15/d34/d36/f4e [0,4194304] 0 2024-04-25T13:47:01.024 INFO:tasks.workunit.client.0.smithi043.stdout:3/266: dread d0/f35 [0,4194304] 0 2024-04-25T13:47:01.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:00 smithi161 ceph-mon[32696]: pgmap v75: 129 pgs: 129 active+clean; 181 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 14 MiB/s wr, 139 op/s 2024-04-25T13:47:01.110 INFO:tasks.workunit.client.0.smithi043.stdout:7/327: sync 2024-04-25T13:47:01.116 INFO:tasks.workunit.client.0.smithi043.stdout:7/328: dwrite d5/d36/f66 [0,4194304] 0 2024-04-25T13:47:01.119 INFO:tasks.workunit.client.0.smithi043.stdout:7/329: getdents d5/d11/d3b/d61/d68 0 2024-04-25T13:47:01.124 INFO:tasks.workunit.client.0.smithi043.stdout:7/330: rename d5/d36 to d5/d75 0 2024-04-25T13:47:01.125 INFO:tasks.workunit.client.0.smithi043.stdout:7/331: write d5/d11/f24 [1287062,117177] 0 2024-04-25T13:47:01.128 INFO:tasks.workunit.client.0.smithi043.stdout:7/332: link d5/f5d d5/d11/d3b/d3f/d5a/f76 0 2024-04-25T13:47:01.138 INFO:tasks.workunit.client.0.smithi043.stdout:7/333: dwrite d5/d11/d3b/d3f/d5a/f76 [0,4194304] 0 2024-04-25T13:47:01.144 INFO:tasks.workunit.client.0.smithi043.stdout:7/334: dwrite d5/f2d [0,4194304] 0 2024-04-25T13:47:01.145 INFO:tasks.workunit.client.0.smithi043.stdout:7/335: write d5/f1e [1508977,52784] 0 2024-04-25T13:47:01.146 INFO:tasks.workunit.client.0.smithi043.stdout:7/336: stat d5/d11/c2a 0 2024-04-25T13:47:01.149 INFO:tasks.workunit.client.0.smithi043.stdout:7/337: creat d5/d11/d3b/d61/d68/f77 x:0 0 0 2024-04-25T13:47:01.156 INFO:tasks.workunit.client.0.smithi043.stdout:7/338: write d5/f2e [325951,125644] 0 2024-04-25T13:47:01.159 INFO:tasks.workunit.client.0.smithi043.stdout:7/339: fdatasync d5/d11/d3b/f70 0 2024-04-25T13:47:01.160 INFO:tasks.workunit.client.0.smithi043.stdout:7/340: chown d5/d11/c2f 1758265 1 2024-04-25T13:47:01.161 INFO:tasks.workunit.client.0.smithi043.stdout:7/341: dread - d5/d11/d3b/d3f/f48 zero size 2024-04-25T13:47:01.165 INFO:tasks.workunit.client.0.smithi043.stdout:0/206: sync 2024-04-25T13:47:01.166 INFO:tasks.workunit.client.0.smithi043.stdout:0/207: readlink l5 0 2024-04-25T13:47:01.169 INFO:tasks.workunit.client.0.smithi043.stdout:7/342: dwrite d5/d75/d64/f6c [0,4194304] 0 2024-04-25T13:47:01.171 INFO:tasks.workunit.client.0.smithi043.stdout:7/343: symlink d5/d75/d64/l78 0 2024-04-25T13:47:01.173 INFO:tasks.workunit.client.0.smithi043.stdout:7/344: write d5/f45 [5205708,52967] 0 2024-04-25T13:47:01.174 INFO:tasks.workunit.client.0.smithi043.stdout:0/208: dwrite db/f17 [0,4194304] 0 2024-04-25T13:47:01.175 INFO:tasks.workunit.client.0.smithi043.stdout:7/345: readlink d5/d32/l39 0 2024-04-25T13:47:01.176 INFO:tasks.workunit.client.0.smithi043.stdout:7/346: fsync d5/f2d 0 2024-04-25T13:47:01.178 INFO:tasks.workunit.client.0.smithi043.stdout:0/209: creat db/d1b/d23/d27/f44 x:0 0 0 2024-04-25T13:47:01.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:00 smithi175 ceph-mon[32649]: pgmap v75: 129 pgs: 129 active+clean; 181 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 14 MiB/s wr, 139 op/s 2024-04-25T13:47:01.181 INFO:tasks.workunit.client.0.smithi043.stdout:0/210: truncate db/d1b/d23/d27/f44 403604 0 2024-04-25T13:47:01.183 INFO:tasks.workunit.client.0.smithi043.stdout:7/347: getdents d5/d11/d3b/d61/d68 0 2024-04-25T13:47:01.183 INFO:tasks.workunit.client.0.smithi043.stdout:0/211: dread db/d1b/d23/d27/f44 [0,4194304] 0 2024-04-25T13:47:01.184 INFO:tasks.workunit.client.0.smithi043.stdout:0/212: chown db/fc 134 1 2024-04-25T13:47:01.185 INFO:tasks.workunit.client.0.smithi043.stdout:7/348: mkdir d5/d75/d79 0 2024-04-25T13:47:01.187 INFO:tasks.workunit.client.0.smithi043.stdout:0/213: symlink db/l45 0 2024-04-25T13:47:01.190 INFO:tasks.workunit.client.0.smithi043.stdout:0/214: fsync db/d25/d2a/d3f/f42 0 2024-04-25T13:47:01.195 INFO:tasks.workunit.client.0.smithi043.stdout:7/349: dwrite d5/d32/f4e [0,4194304] 0 2024-04-25T13:47:01.196 INFO:tasks.workunit.client.0.smithi043.stdout:0/215: rmdir db/d1b/d36/d41/d43 0 2024-04-25T13:47:01.198 INFO:tasks.workunit.client.0.smithi043.stdout:0/216: write db/d1b/f1e [3158826,2307] 0 2024-04-25T13:47:01.199 INFO:tasks.workunit.client.0.smithi043.stdout:6/257: sync 2024-04-25T13:47:01.199 INFO:tasks.workunit.client.0.smithi043.stdout:3/267: sync 2024-04-25T13:47:01.199 INFO:tasks.workunit.client.0.smithi043.stdout:5/215: sync 2024-04-25T13:47:01.199 INFO:tasks.workunit.client.0.smithi043.stdout:4/238: sync 2024-04-25T13:47:01.199 INFO:tasks.workunit.client.0.smithi043.stdout:9/228: sync 2024-04-25T13:47:01.199 INFO:tasks.workunit.client.0.smithi043.stdout:1/251: sync 2024-04-25T13:47:01.199 INFO:tasks.workunit.client.0.smithi043.stdout:2/183: sync 2024-04-25T13:47:01.199 INFO:tasks.workunit.client.0.smithi043.stdout:8/364: sync 2024-04-25T13:47:01.201 INFO:tasks.workunit.client.0.smithi043.stdout:9/229: chown d0/d1d/d22 10378337 1 2024-04-25T13:47:01.201 INFO:tasks.workunit.client.0.smithi043.stdout:7/350: creat d5/d11/d3b/d3f/d5a/f7a x:0 0 0 2024-04-25T13:47:01.203 INFO:tasks.workunit.client.0.smithi043.stdout:0/217: creat db/d25/f46 x:0 0 0 2024-04-25T13:47:01.204 INFO:tasks.workunit.client.0.smithi043.stdout:6/258: truncate d0/f40 489634 0 2024-04-25T13:47:01.204 INFO:tasks.workunit.client.0.smithi043.stdout:2/184: creat d0/d5/d1e/f2c x:0 0 0 2024-04-25T13:47:01.206 INFO:tasks.workunit.client.0.smithi043.stdout:8/365: creat db/d11/d1b/d59/f7b x:0 0 0 2024-04-25T13:47:01.207 INFO:tasks.workunit.client.0.smithi043.stdout:6/259: write d0/f31 [6396725,58856] 0 2024-04-25T13:47:01.209 INFO:tasks.workunit.client.0.smithi043.stdout:4/239: rename d1/l25 to d1/de/df/d1e/d28/d33/l50 0 2024-04-25T13:47:01.209 INFO:tasks.workunit.client.0.smithi043.stdout:2/185: write d0/d8/ff [4678396,91998] 0 2024-04-25T13:47:01.209 INFO:tasks.workunit.client.0.smithi043.stdout:5/216: creat d1/d3/d7/d8/df/d28/f48 x:0 0 0 2024-04-25T13:47:01.211 INFO:tasks.workunit.client.0.smithi043.stdout:3/268: mknod d0/d9/d15/d34/d36/d57/c5e 0 2024-04-25T13:47:01.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:00 smithi043 ceph-mon[29195]: pgmap v75: 129 pgs: 129 active+clean; 181 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 14 MiB/s wr, 139 op/s 2024-04-25T13:47:01.214 INFO:tasks.workunit.client.0.smithi043.stdout:1/252: rename df/d14/f21 to df/d10/d22/d2f/f4b 0 2024-04-25T13:47:01.215 INFO:tasks.workunit.client.0.smithi043.stdout:0/218: truncate db/fc 3074514 0 2024-04-25T13:47:01.218 INFO:tasks.workunit.client.0.smithi043.stdout:9/230: write d0/d1d/d7/f10 [614684,25054] 0 2024-04-25T13:47:01.219 INFO:tasks.workunit.client.0.smithi043.stdout:1/253: symlink df/d14/d3d/l4c 0 2024-04-25T13:47:01.220 INFO:tasks.workunit.client.0.smithi043.stdout:8/366: mkdir db/d11/d1b/d59/d7c 0 2024-04-25T13:47:01.223 INFO:tasks.workunit.client.0.smithi043.stdout:6/260: dwrite d0/ff [4194304,4194304] 0 2024-04-25T13:47:01.224 INFO:tasks.workunit.client.0.smithi043.stdout:5/217: mknod d1/d3/d7/d9/d2d/c49 0 2024-04-25T13:47:01.226 INFO:tasks.workunit.client.0.smithi043.stdout:1/254: creat df/d31/d34/f4d x:0 0 0 2024-04-25T13:47:01.227 INFO:tasks.workunit.client.0.smithi043.stdout:8/367: stat db/d11/d1b/d1e/d27/f75 0 2024-04-25T13:47:01.228 INFO:tasks.workunit.client.0.smithi043.stdout:4/240: dwrite d1/de/f1c [0,4194304] 0 2024-04-25T13:47:01.231 INFO:tasks.workunit.client.0.smithi043.stdout:6/261: dread d0/f40 [0,4194304] 0 2024-04-25T13:47:01.235 INFO:tasks.workunit.client.0.smithi043.stdout:0/219: dread f6 [0,4194304] 0 2024-04-25T13:47:01.236 INFO:tasks.workunit.client.0.smithi043.stdout:5/218: truncate d1/d3/d7/d9/d2d/f34 4206843 0 2024-04-25T13:47:01.236 INFO:tasks.workunit.client.0.smithi043.stdout:4/241: chown d1/de/d1d/d20/d38/c32 29688 1 2024-04-25T13:47:01.237 INFO:tasks.workunit.client.0.smithi043.stdout:7/351: truncate d5/d11/f4d 564692 0 2024-04-25T13:47:01.237 INFO:tasks.workunit.client.0.smithi043.stdout:6/262: chown d0/d1b/f1d 2125293 1 2024-04-25T13:47:01.238 INFO:tasks.workunit.client.0.smithi043.stdout:2/186: truncate d0/f12 2380647 0 2024-04-25T13:47:01.239 INFO:tasks.workunit.client.0.smithi043.stdout:9/231: creat d0/d1d/dc/f5d x:0 0 0 2024-04-25T13:47:01.240 INFO:tasks.workunit.client.0.smithi043.stdout:1/255: link df/f16 df/d14/d2a/d39/f4e 0 2024-04-25T13:47:01.243 INFO:tasks.workunit.client.0.smithi043.stdout:6/263: dread - d0/d24/d2e/f34 zero size 2024-04-25T13:47:01.244 INFO:tasks.workunit.client.0.smithi043.stdout:5/219: mknod d1/d3/d7/c4a 0 2024-04-25T13:47:01.244 INFO:tasks.workunit.client.0.smithi043.stdout:7/352: write d5/d11/d3b/f4b [352108,89874] 0 2024-04-25T13:47:01.245 INFO:tasks.workunit.client.0.smithi043.stdout:4/242: dread - d1/de/d1d/d20/d38/d3a/f4d zero size 2024-04-25T13:47:01.251 INFO:tasks.workunit.client.0.smithi043.stdout:9/232: dread - d0/d1d/dc/d26/d39/d46/f50 zero size 2024-04-25T13:47:01.253 INFO:tasks.workunit.client.0.smithi043.stdout:7/353: chown d5/d11/d3b/d61/d68/f77 150 1 2024-04-25T13:47:01.254 INFO:tasks.workunit.client.0.smithi043.stdout:3/269: dread d0/f4 [0,4194304] 0 2024-04-25T13:47:01.258 INFO:tasks.workunit.client.0.smithi043.stdout:8/368: dwrite db/d46/f61 [0,4194304] 0 2024-04-25T13:47:01.259 INFO:tasks.workunit.client.0.smithi043.stdout:1/256: creat df/d10/d22/d2f/f4f x:0 0 0 2024-04-25T13:47:01.259 INFO:tasks.workunit.client.0.smithi043.stdout:0/220: dwrite db/d1b/f22 [0,4194304] 0 2024-04-25T13:47:01.262 INFO:tasks.workunit.client.0.smithi043.stdout:2/187: truncate d0/d8/ff 1520940 0 2024-04-25T13:47:01.262 INFO:tasks.workunit.client.0.smithi043.stdout:0/221: fdatasync db/d1b/f29 0 2024-04-25T13:47:01.264 INFO:tasks.workunit.client.0.smithi043.stdout:6/264: creat d0/d24/d2e/d2f/d41/f4e x:0 0 0 2024-04-25T13:47:01.266 INFO:tasks.workunit.client.0.smithi043.stdout:9/233: fdatasync d0/d1d/d7/f5b 0 2024-04-25T13:47:01.269 INFO:tasks.workunit.client.0.smithi043.stdout:7/354: creat d5/d11/d3b/d61/f7b x:0 0 0 2024-04-25T13:47:01.271 INFO:tasks.workunit.client.0.smithi043.stdout:4/243: link d1/de/df/d1e/f30 d1/de/df/d1a/d27/f51 0 2024-04-25T13:47:01.272 INFO:tasks.workunit.client.0.smithi043.stdout:9/234: dread - d0/d1d/f25 zero size 2024-04-25T13:47:01.277 INFO:tasks.workunit.client.0.smithi043.stdout:8/369: mkdir db/d7d 0 2024-04-25T13:47:01.277 INFO:tasks.workunit.client.0.smithi043.stdout:3/270: dwrite d0/d13/f27 [0,4194304] 0 2024-04-25T13:47:01.279 INFO:tasks.workunit.client.0.smithi043.stdout:1/257: dwrite df/d31/d34/f4d [0,4194304] 0 2024-04-25T13:47:01.281 INFO:tasks.workunit.client.0.smithi043.stdout:0/222: creat db/d1b/f47 x:0 0 0 2024-04-25T13:47:01.282 INFO:tasks.workunit.client.0.smithi043.stdout:8/370: write db/d11/d1b/d59/f7b [399862,35224] 0 2024-04-25T13:47:01.283 INFO:tasks.workunit.client.0.smithi043.stdout:0/223: fdatasync db/f17 0 2024-04-25T13:47:01.285 INFO:tasks.workunit.client.0.smithi043.stdout:0/224: chown f8 3940 1 2024-04-25T13:47:01.287 INFO:tasks.workunit.client.0.smithi043.stdout:4/244: rmdir d1/de/d1d/d20 39 2024-04-25T13:47:01.288 INFO:tasks.workunit.client.0.smithi043.stdout:4/245: write d1/de/df/d1a/f4c [931165,65673] 0 2024-04-25T13:47:01.289 INFO:tasks.workunit.client.0.smithi043.stdout:4/246: fsync d1/d3/f9 0 2024-04-25T13:47:01.290 INFO:tasks.workunit.client.0.smithi043.stdout:1/258: getdents df/d14/d3d 0 2024-04-25T13:47:01.291 INFO:tasks.workunit.client.0.smithi043.stdout:4/247: write d1/d3/f15 [548206,49381] 0 2024-04-25T13:47:01.295 INFO:tasks.workunit.client.0.smithi043.stdout:3/271: creat d0/d9/d15/d34/d36/d57/f5f x:0 0 0 2024-04-25T13:47:01.296 INFO:tasks.workunit.client.0.smithi043.stdout:1/259: dread df/d10/d22/d2f/f4b [0,4194304] 0 2024-04-25T13:47:01.298 INFO:tasks.workunit.client.0.smithi043.stdout:0/225: mknod db/d25/d2a/d3f/c48 0 2024-04-25T13:47:01.298 INFO:tasks.workunit.client.0.smithi043.stdout:3/272: truncate d0/d13/f27 3842374 0 2024-04-25T13:47:01.300 INFO:tasks.workunit.client.0.smithi043.stdout:6/265: rename d0/l2c to d0/d1c/l4f 0 2024-04-25T13:47:01.301 INFO:tasks.workunit.client.0.smithi043.stdout:3/273: read - d0/d9/d15/d38/d3f/f42 zero size 2024-04-25T13:47:01.304 INFO:tasks.workunit.client.0.smithi043.stdout:4/248: readlink d1/de/df/d1e/d28/d33/l50 0 2024-04-25T13:47:01.305 INFO:tasks.workunit.client.0.smithi043.stdout:1/260: dwrite df/d14/f1c [0,4194304] 0 2024-04-25T13:47:01.306 INFO:tasks.workunit.client.0.smithi043.stdout:5/220: rename d1/d3/d7/d9/d2d/f3b to d1/d3/d7/d8/da/d2e/f4b 0 2024-04-25T13:47:01.308 INFO:tasks.workunit.client.0.smithi043.stdout:6/266: creat d0/d24/f50 x:0 0 0 2024-04-25T13:47:01.313 INFO:tasks.workunit.client.0.smithi043.stdout:1/261: symlink df/d31/d38/d43/l50 0 2024-04-25T13:47:01.314 INFO:tasks.workunit.client.0.smithi043.stdout:7/355: dread d5/d11/f24 [0,4194304] 0 2024-04-25T13:47:01.318 INFO:tasks.workunit.client.0.smithi043.stdout:2/188: dwrite d0/d8/ff [0,4194304] 0 2024-04-25T13:47:01.321 INFO:tasks.workunit.client.0.smithi043.stdout:6/267: rmdir d0/d24/d2e 39 2024-04-25T13:47:01.325 INFO:tasks.workunit.client.0.smithi043.stdout:4/249: creat d1/de/d1d/d20/f52 x:0 0 0 2024-04-25T13:47:01.325 INFO:tasks.workunit.client.0.smithi043.stdout:7/356: write d5/f3c [1473594,93615] 0 2024-04-25T13:47:01.328 INFO:tasks.workunit.client.0.smithi043.stdout:6/268: write d0/f16 [300121,104821] 0 2024-04-25T13:47:01.329 INFO:tasks.workunit.client.0.smithi043.stdout:0/226: dwrite f8 [0,4194304] 0 2024-04-25T13:47:01.334 INFO:tasks.workunit.client.0.smithi043.stdout:9/235: dread d0/d1d/dc/f1b [0,4194304] 0 2024-04-25T13:47:01.336 INFO:tasks.workunit.client.0.smithi043.stdout:7/357: creat d5/d11/d3b/d61/f7c x:0 0 0 2024-04-25T13:47:01.339 INFO:tasks.workunit.client.0.smithi043.stdout:6/269: mkdir d0/d24/d51 0 2024-04-25T13:47:01.340 INFO:tasks.workunit.client.0.smithi043.stdout:7/358: chown d5/d11/d3b/f70 1 1 2024-04-25T13:47:01.342 INFO:tasks.workunit.client.0.smithi043.stdout:1/262: dwrite df/d10/f13 [0,4194304] 0 2024-04-25T13:47:01.351 INFO:tasks.workunit.client.0.smithi043.stdout:9/236: link d0/d1d/d7/f5c d0/d1d/dc/d26/d39/d46/f5e 0 2024-04-25T13:47:01.353 INFO:tasks.workunit.client.0.smithi043.stdout:4/250: dwrite d1/de/df/d1a/f2d [8388608,4194304] 0 2024-04-25T13:47:01.354 INFO:tasks.workunit.client.0.smithi043.stdout:1/263: mknod df/d14/d2a/d39/c51 0 2024-04-25T13:47:01.355 INFO:tasks.workunit.client.0.smithi043.stdout:0/227: getdents db/d1b/d36 0 2024-04-25T13:47:01.358 INFO:tasks.workunit.client.0.smithi043.stdout:7/359: mknod d5/d11/d3b/c7d 0 2024-04-25T13:47:01.359 INFO:tasks.workunit.client.0.smithi043.stdout:5/221: dread d1/d3/d26/f2a [0,4194304] 0 2024-04-25T13:47:01.359 INFO:tasks.workunit.client.0.smithi043.stdout:3/274: link d0/d9/d15/l1c d0/l60 0 2024-04-25T13:47:01.361 INFO:tasks.workunit.client.0.smithi043.stdout:2/189: dwrite d0/d8/fd [0,4194304] 0 2024-04-25T13:47:01.362 INFO:tasks.workunit.client.0.smithi043.stdout:0/228: chown db/d25/d2a/d3f/f42 1 1 2024-04-25T13:47:01.363 INFO:tasks.workunit.client.0.smithi043.stdout:1/264: symlink df/d14/d2a/d46/l52 0 2024-04-25T13:47:01.363 INFO:tasks.workunit.client.0.smithi043.stdout:9/237: dread d0/d1d/d7/f34 [0,4194304] 0 2024-04-25T13:47:01.364 INFO:tasks.workunit.client.0.smithi043.stdout:4/251: fdatasync d1/de/df/d1e/d28/f39 0 2024-04-25T13:47:01.365 INFO:tasks.workunit.client.0.smithi043.stdout:2/190: read d0/d8/ff [1237623,75797] 0 2024-04-25T13:47:01.368 INFO:tasks.workunit.client.0.smithi043.stdout:2/191: fsync d0/d5/d1e/f1f 0 2024-04-25T13:47:01.371 INFO:tasks.workunit.client.0.smithi043.stdout:4/252: dread - d1/de/d1d/d20/d38/d3a/f48 zero size 2024-04-25T13:47:01.372 INFO:tasks.workunit.client.0.smithi043.stdout:0/229: symlink db/l49 0 2024-04-25T13:47:01.373 INFO:tasks.workunit.client.0.smithi043.stdout:1/265: mkdir df/d31/d38/d43/d53 0 2024-04-25T13:47:01.376 INFO:tasks.workunit.client.0.smithi043.stdout:9/238: creat d0/d1d/dc/d26/d39/f5f x:0 0 0 2024-04-25T13:47:01.377 INFO:tasks.workunit.client.0.smithi043.stdout:7/360: dwrite d5/d11/f14 [0,4194304] 0 2024-04-25T13:47:01.377 INFO:tasks.workunit.client.0.smithi043.stdout:0/230: truncate f8 4987034 0 2024-04-25T13:47:01.380 INFO:tasks.workunit.client.0.smithi043.stdout:4/253: mkdir d1/de/df/d1a/d27/d36/d53 0 2024-04-25T13:47:01.381 INFO:tasks.workunit.client.0.smithi043.stdout:8/371: rename db/d11/d1b/c26 to db/d38/c7e 0 2024-04-25T13:47:01.382 INFO:tasks.workunit.client.0.smithi043.stdout:0/231: mkdir db/d25/d4a 0 2024-04-25T13:47:01.384 INFO:tasks.workunit.client.0.smithi043.stdout:7/361: truncate d5/d32/f3a 459717 0 2024-04-25T13:47:01.386 INFO:tasks.workunit.client.0.smithi043.stdout:3/275: read - d0/da/f43 zero size 2024-04-25T13:47:01.386 INFO:tasks.workunit.client.0.smithi043.stdout:5/222: rename d1/d3/d26/l3a to d1/d3/d7/d8/df/l4c 0 2024-04-25T13:47:01.387 INFO:tasks.workunit.client.0.smithi043.stdout:6/270: dread d0/d24/d2e/d2f/f38 [0,4194304] 0 2024-04-25T13:47:01.388 INFO:tasks.workunit.client.0.smithi043.stdout:0/232: mkdir db/d1b/d23/d27/d39/d4b 0 2024-04-25T13:47:01.388 INFO:tasks.workunit.client.0.smithi043.stdout:7/362: chown d5/f45 9 1 2024-04-25T13:47:01.391 INFO:tasks.workunit.client.0.smithi043.stdout:1/266: dwrite df/d10/f44 [0,4194304] 0 2024-04-25T13:47:01.391 INFO:tasks.workunit.client.0.smithi043.stdout:8/372: unlink db/l68 0 2024-04-25T13:47:01.392 INFO:tasks.workunit.client.0.smithi043.stdout:7/363: fsync d5/d75/f73 0 2024-04-25T13:47:01.394 INFO:tasks.workunit.client.0.smithi043.stdout:9/239: dread d0/d1d/dc/f18 [0,4194304] 0 2024-04-25T13:47:01.397 INFO:tasks.workunit.client.0.smithi043.stdout:5/223: rmdir d1/d3/d26 39 2024-04-25T13:47:01.397 INFO:tasks.workunit.client.0.smithi043.stdout:4/254: dwrite d1/de/df/f16 [0,4194304] 0 2024-04-25T13:47:01.400 INFO:tasks.workunit.client.0.smithi043.stdout:0/233: mkdir db/d1b/d23/d27/d39/d4c 0 2024-04-25T13:47:01.401 INFO:tasks.workunit.client.0.smithi043.stdout:9/240: dread d0/d1d/d7/f34 [0,4194304] 0 2024-04-25T13:47:01.406 INFO:tasks.workunit.client.0.smithi043.stdout:3/276: mkdir d0/d61 0 2024-04-25T13:47:01.407 INFO:tasks.workunit.client.0.smithi043.stdout:8/373: chown db/dc/l29 253564 1 2024-04-25T13:47:01.407 INFO:tasks.workunit.client.0.smithi043.stdout:1/267: mknod df/d31/c54 0 2024-04-25T13:47:01.408 INFO:tasks.workunit.client.0.smithi043.stdout:7/364: dwrite d5/d11/d3b/d61/f7c [0,4194304] 0 2024-04-25T13:47:01.409 INFO:tasks.workunit.client.0.smithi043.stdout:9/241: stat d0/d1d/dc/d26/d39/d46/f50 0 2024-04-25T13:47:01.409 INFO:tasks.workunit.client.0.smithi043.stdout:1/268: dread - df/d10/f2c zero size 2024-04-25T13:47:01.410 INFO:tasks.workunit.client.0.smithi043.stdout:0/234: mknod db/d1b/d23/c4d 0 2024-04-25T13:47:01.410 INFO:tasks.workunit.client.0.smithi043.stdout:6/271: write d0/d24/d2e/f37 [1698069,73039] 0 2024-04-25T13:47:01.414 INFO:tasks.workunit.client.0.smithi043.stdout:7/365: write d5/f55 [1778411,124764] 0 2024-04-25T13:47:01.416 INFO:tasks.workunit.client.0.smithi043.stdout:6/272: fsync d0/d24/d2e/d2f/d41/f45 0 2024-04-25T13:47:01.418 INFO:tasks.workunit.client.0.smithi043.stdout:0/235: symlink db/d25/d2a/l4e 0 2024-04-25T13:47:01.419 INFO:tasks.workunit.client.0.smithi043.stdout:1/269: dread df/d10/f44 [0,4194304] 0 2024-04-25T13:47:01.419 INFO:tasks.workunit.client.0.smithi043.stdout:6/273: write d0/f16 [1053569,104948] 0 2024-04-25T13:47:01.421 INFO:tasks.workunit.client.0.smithi043.stdout:6/274: dread - d0/d24/f50 zero size 2024-04-25T13:47:01.422 INFO:tasks.workunit.client.0.smithi043.stdout:6/275: chown d0/d1b/f1d 71498 1 2024-04-25T13:47:01.423 INFO:tasks.workunit.client.0.smithi043.stdout:1/270: creat df/d14/d3d/f55 x:0 0 0 2024-04-25T13:47:01.424 INFO:tasks.workunit.client.0.smithi043.stdout:4/255: truncate d1/de/df/d1a/f2d 11077369 0 2024-04-25T13:47:01.427 INFO:tasks.workunit.client.0.smithi043.stdout:7/366: truncate d5/fd 215816 0 2024-04-25T13:47:01.427 INFO:tasks.workunit.client.0.smithi043.stdout:5/224: link d1/d3/d24/c30 d1/d3/d7/d8/da/c4d 0 2024-04-25T13:47:01.428 INFO:tasks.workunit.client.0.smithi043.stdout:4/256: write d1/de/d1d/d20/d38/d3a/f48 [248083,108923] 0 2024-04-25T13:47:01.429 INFO:tasks.workunit.client.0.smithi043.stdout:6/276: unlink d0/f47 0 2024-04-25T13:47:01.431 INFO:tasks.workunit.client.0.smithi043.stdout:0/236: dwrite db/d25/f2b [0,4194304] 0 2024-04-25T13:47:01.432 INFO:tasks.workunit.client.0.smithi043.stdout:1/271: unlink c6 0 2024-04-25T13:47:01.435 INFO:tasks.workunit.client.0.smithi043.stdout:9/242: rename d0/d1d/f9 to d0/d1d/dc/f60 0 2024-04-25T13:47:01.437 INFO:tasks.workunit.client.0.smithi043.stdout:0/237: mkdir db/d1b/d4f 0 2024-04-25T13:47:01.440 INFO:tasks.workunit.client.0.smithi043.stdout:7/367: dwrite d5/d11/d3b/f46 [0,4194304] 0 2024-04-25T13:47:01.443 INFO:tasks.workunit.client.0.smithi043.stdout:5/225: rename d1/d3/d7/d8/da/c18 to d1/d3/d7/d9/d2d/c4e 0 2024-04-25T13:47:01.449 INFO:tasks.workunit.client.0.smithi043.stdout:7/368: read d5/d11/d3b/d3f/d5a/f76 [2921572,118773] 0 2024-04-25T13:47:01.450 INFO:tasks.workunit.client.0.smithi043.stdout:1/272: dwrite df/d31/d38/d3f/f42 [0,4194304] 0 2024-04-25T13:47:01.451 INFO:tasks.workunit.client.0.smithi043.stdout:3/277: creat d0/d9/f62 x:0 0 0 2024-04-25T13:47:01.458 INFO:tasks.workunit.client.0.smithi043.stdout:9/243: dwrite d0/d1d/d7/f19 [0,4194304] 0 2024-04-25T13:47:01.462 INFO:tasks.workunit.client.0.smithi043.stdout:0/238: dwrite db/f17 [0,4194304] 0 2024-04-25T13:47:01.463 INFO:tasks.workunit.client.0.smithi043.stdout:7/369: mknod d5/d11/d3b/d61/d68/c7e 0 2024-04-25T13:47:01.465 INFO:tasks.workunit.client.0.smithi043.stdout:3/278: truncate d0/d9/f20 2067913 0 2024-04-25T13:47:01.466 INFO:tasks.workunit.client.0.smithi043.stdout:6/277: truncate d0/f13 197158 0 2024-04-25T13:47:01.466 INFO:tasks.workunit.client.0.smithi043.stdout:9/244: rmdir d0/d1d/d7 39 2024-04-25T13:47:01.468 INFO:tasks.workunit.client.0.smithi043.stdout:5/226: getdents d1/d3/d7/d9 0 2024-04-25T13:47:01.470 INFO:tasks.workunit.client.0.smithi043.stdout:1/273: dwrite df/d10/d22/f3a [0,4194304] 0 2024-04-25T13:47:01.471 INFO:tasks.workunit.client.0.smithi043.stdout:7/370: mknod d5/d11/d3b/d61/c7f 0 2024-04-25T13:47:01.475 INFO:tasks.workunit.client.0.smithi043.stdout:0/239: rename db/d25/d2a/l4e to db/d1b/d23/d27/d39/l50 0 2024-04-25T13:47:01.478 INFO:tasks.workunit.client.0.smithi043.stdout:5/227: unlink d1/d3/d7/d8/df/fd 0 2024-04-25T13:47:01.480 INFO:tasks.workunit.client.0.smithi043.stdout:7/371: mkdir d5/d11/d80 0 2024-04-25T13:47:01.482 INFO:tasks.workunit.client.0.smithi043.stdout:9/245: creat d0/d1d/d4a/f61 x:0 0 0 2024-04-25T13:47:01.484 INFO:tasks.workunit.client.0.smithi043.stdout:6/278: link d0/c15 d0/d24/d2e/d2f/d41/d4c/c52 0 2024-04-25T13:47:01.487 INFO:tasks.workunit.client.0.smithi043.stdout:0/240: dwrite db/f2d [0,4194304] 0 2024-04-25T13:47:01.489 INFO:tasks.workunit.client.0.smithi043.stdout:7/372: rename d5/f12 to d5/f81 0 2024-04-25T13:47:01.490 INFO:tasks.workunit.client.0.smithi043.stdout:0/241: dread - db/d1b/d36/f34 zero size 2024-04-25T13:47:01.496 INFO:tasks.workunit.client.0.smithi043.stdout:5/228: dwrite d1/d3/d7/d8/da/d11/f25 [0,4194304] 0 2024-04-25T13:47:01.496 INFO:tasks.workunit.client.0.smithi043.stdout:9/246: dread d0/d1d/d7/f10 [0,4194304] 0 2024-04-25T13:47:01.497 INFO:tasks.workunit.client.0.smithi043.stdout:5/229: stat d1/d3/d7/d8 0 2024-04-25T13:47:01.498 INFO:tasks.workunit.client.0.smithi043.stdout:0/242: creat db/d1b/f51 x:0 0 0 2024-04-25T13:47:01.498 INFO:tasks.workunit.client.0.smithi043.stdout:9/247: write d0/f1e [4082769,111187] 0 2024-04-25T13:47:01.498 INFO:tasks.workunit.client.0.smithi043.stdout:6/279: creat d0/d24/d2e/d2f/d41/d48/d4d/f53 x:0 0 0 2024-04-25T13:47:01.500 INFO:tasks.workunit.client.0.smithi043.stdout:0/243: write db/f17 [264250,3983] 0 2024-04-25T13:47:01.501 INFO:tasks.workunit.client.0.smithi043.stdout:6/280: write d0/ff [1362481,127376] 0 2024-04-25T13:47:01.504 INFO:tasks.workunit.client.0.smithi043.stdout:5/230: rmdir d1/d4/d42 39 2024-04-25T13:47:01.506 INFO:tasks.workunit.client.0.smithi043.stdout:7/373: creat d5/f82 x:0 0 0 2024-04-25T13:47:01.508 INFO:tasks.workunit.client.0.smithi043.stdout:1/274: truncate f2 8375444 0 2024-04-25T13:47:01.510 INFO:tasks.workunit.client.0.smithi043.stdout:9/248: mkdir d0/d1d/dc/d26/d39/d46/d62 0 2024-04-25T13:47:01.512 INFO:tasks.workunit.client.0.smithi043.stdout:0/244: symlink db/d1b/d23/l52 0 2024-04-25T13:47:01.513 INFO:tasks.workunit.client.0.smithi043.stdout:9/249: dread - d0/d1d/d4a/f61 zero size 2024-04-25T13:47:01.514 INFO:tasks.workunit.client.0.smithi043.stdout:6/281: dwrite d0/f16 [0,4194304] 0 2024-04-25T13:47:01.515 INFO:tasks.workunit.client.0.smithi043.stdout:6/282: stat d0/f31 0 2024-04-25T13:47:01.517 INFO:tasks.workunit.client.0.smithi043.stdout:5/231: creat d1/d3/d7/f4f x:0 0 0 2024-04-25T13:47:01.518 INFO:tasks.workunit.client.0.smithi043.stdout:7/374: mknod d5/c83 0 2024-04-25T13:47:01.518 INFO:tasks.workunit.client.0.smithi043.stdout:1/275: dread df/f1b [0,4194304] 0 2024-04-25T13:47:01.520 INFO:tasks.workunit.client.0.smithi043.stdout:9/250: rename d0/f4 to d0/d1d/d22/f63 0 2024-04-25T13:47:01.521 INFO:tasks.workunit.client.0.smithi043.stdout:7/375: fdatasync d5/f82 0 2024-04-25T13:47:01.525 INFO:tasks.workunit.client.0.smithi043.stdout:1/276: unlink df/d10/d22/d2f/f4b 0 2024-04-25T13:47:01.527 INFO:tasks.workunit.client.0.smithi043.stdout:0/245: dwrite db/d1b/f38 [0,4194304] 0 2024-04-25T13:47:01.527 INFO:tasks.workunit.client.0.smithi043.stdout:7/376: chown d5/d11/d3b/d3f/c40 482480957 1 2024-04-25T13:47:01.529 INFO:tasks.workunit.client.0.smithi043.stdout:6/283: rename d0/d24/d51 to d0/d3d/d54 0 2024-04-25T13:47:01.531 INFO:tasks.workunit.client.0.smithi043.stdout:7/377: mkdir d5/d11/d84 0 2024-04-25T13:47:01.533 INFO:tasks.workunit.client.0.smithi043.stdout:0/246: creat db/d1b/d36/f53 x:0 0 0 2024-04-25T13:47:01.535 INFO:tasks.workunit.client.0.smithi043.stdout:5/232: dwrite d1/d3/d7/d8/da/d11/f25 [0,4194304] 0 2024-04-25T13:47:01.536 INFO:tasks.workunit.client.0.smithi043.stdout:1/277: creat df/d14/f56 x:0 0 0 2024-04-25T13:47:01.539 INFO:tasks.workunit.client.0.smithi043.stdout:0/247: mkdir db/d25/d54 0 2024-04-25T13:47:01.544 INFO:tasks.workunit.client.0.smithi043.stdout:9/251: dwrite d0/d1d/dc/d26/d39/d46/f50 [0,4194304] 0 2024-04-25T13:47:01.546 INFO:tasks.workunit.client.0.smithi043.stdout:5/233: stat d1/d3/d7/d8/df/l4c 0 2024-04-25T13:47:01.546 INFO:tasks.workunit.client.0.smithi043.stdout:0/248: chown db/d1b/f26 1716010 1 2024-04-25T13:47:01.546 INFO:tasks.workunit.client.0.smithi043.stdout:6/284: dwrite d0/f4 [0,4194304] 0 2024-04-25T13:47:01.549 INFO:tasks.workunit.client.0.smithi043.stdout:7/378: getdents d5/d11/d3b/d61 0 2024-04-25T13:47:01.552 INFO:tasks.workunit.client.0.smithi043.stdout:1/278: link df/d31/f48 df/d31/d38/d43/f57 0 2024-04-25T13:47:01.553 INFO:tasks.workunit.client.0.smithi043.stdout:0/249: rename f9 to db/d1b/d23/d27/d39/d4b/f55 0 2024-04-25T13:47:01.554 INFO:tasks.workunit.client.0.smithi043.stdout:1/279: readlink df/d14/d2a/d46/l52 0 2024-04-25T13:47:01.556 INFO:tasks.workunit.client.0.smithi043.stdout:5/234: dread d1/d3/d26/f2a [0,4194304] 0 2024-04-25T13:47:01.556 INFO:tasks.workunit.client.0.smithi043.stdout:6/285: link d0/d1c/f3f d0/d24/f55 0 2024-04-25T13:47:01.557 INFO:tasks.workunit.client.0.smithi043.stdout:1/280: creat df/d10/d22/f58 x:0 0 0 2024-04-25T13:47:01.560 INFO:tasks.workunit.client.0.smithi043.stdout:7/379: link d5/d32/f5f d5/d11/f85 0 2024-04-25T13:47:01.560 INFO:tasks.workunit.client.0.smithi043.stdout:0/250: fdatasync db/d1b/d36/f34 0 2024-04-25T13:47:01.562 INFO:tasks.workunit.client.0.smithi043.stdout:6/286: creat d0/d1c/f56 x:0 0 0 2024-04-25T13:47:01.564 INFO:tasks.workunit.client.0.smithi043.stdout:9/252: rename d0/d1d/dc/d26/d47/d52/f57 to d0/d1d/f64 0 2024-04-25T13:47:01.564 INFO:tasks.workunit.client.0.smithi043.stdout:5/235: rename d1/d3 to d1/d3/d7/d9/d2d/d50 22 2024-04-25T13:47:01.565 INFO:tasks.workunit.client.0.smithi043.stdout:7/380: symlink d5/l86 0 2024-04-25T13:47:01.566 INFO:tasks.workunit.client.0.smithi043.stdout:6/287: creat d0/d3d/d54/f57 x:0 0 0 2024-04-25T13:47:01.570 INFO:tasks.workunit.client.0.smithi043.stdout:0/251: dwrite f7 [0,4194304] 0 2024-04-25T13:47:01.571 INFO:tasks.workunit.client.0.smithi043.stdout:7/381: rename d5/d32/f5f to d5/d11/d3b/d61/f87 0 2024-04-25T13:47:01.572 INFO:tasks.workunit.client.0.smithi043.stdout:0/252: write db/d1b/f38 [3073378,6359] 0 2024-04-25T13:47:01.573 INFO:tasks.workunit.client.0.smithi043.stdout:9/253: link d0/d1d/d7/f34 d0/d1d/dc/d26/d47/f65 0 2024-04-25T13:47:01.576 INFO:tasks.workunit.client.0.smithi043.stdout:5/236: rename d1/d3/d7/d9/d2d/f34 to d1/d3/d7/d2f/d40/f51 0 2024-04-25T13:47:01.580 INFO:tasks.workunit.client.0.smithi043.stdout:0/253: rename db/l49 to db/d1b/d4f/l56 0 2024-04-25T13:47:01.582 INFO:tasks.workunit.client.0.smithi043.stdout:7/382: dwrite d5/d32/f4e [0,4194304] 0 2024-04-25T13:47:01.583 INFO:tasks.workunit.client.0.smithi043.stdout:7/383: readlink d5/l30 0 2024-04-25T13:47:01.584 INFO:tasks.workunit.client.0.smithi043.stdout:9/254: link d0/d1d/d7/f5c d0/d1d/d7/f66 0 2024-04-25T13:47:01.586 INFO:tasks.workunit.client.0.smithi043.stdout:5/237: dread d1/d3/d26/f27 [0,4194304] 0 2024-04-25T13:47:01.586 INFO:tasks.workunit.client.0.smithi043.stdout:9/255: fsync d0/d1d/dc/f5d 0 2024-04-25T13:47:01.587 INFO:tasks.workunit.client.0.smithi043.stdout:7/384: creat d5/d11/d3b/d3f/d5a/f88 x:0 0 0 2024-04-25T13:47:01.587 INFO:tasks.workunit.client.0.smithi043.stdout:5/238: chown d1/d3/d7/d8/da/d11 84 1 2024-04-25T13:47:01.588 INFO:tasks.workunit.client.0.smithi043.stdout:0/254: rmdir db/d37 0 2024-04-25T13:47:01.588 INFO:tasks.workunit.client.0.smithi043.stdout:0/255: fdatasync db/d1b/f1e 0 2024-04-25T13:47:01.590 INFO:tasks.workunit.client.0.smithi043.stdout:9/256: mkdir d0/d1d/d22/d67 0 2024-04-25T13:47:01.596 INFO:tasks.workunit.client.0.smithi043.stdout:9/257: write d0/d1d/f29 [1672531,89822] 0 2024-04-25T13:47:01.596 INFO:tasks.workunit.client.0.smithi043.stdout:0/256: dwrite db/f1d [4194304,4194304] 0 2024-04-25T13:47:01.598 INFO:tasks.workunit.client.0.smithi043.stdout:5/239: mkdir d1/d3/d7/d8/da/d11/d52 0 2024-04-25T13:47:01.600 INFO:tasks.workunit.client.0.smithi043.stdout:5/240: write d1/d3/d7/d2f/d40/f39 [327543,87502] 0 2024-04-25T13:47:01.602 INFO:tasks.workunit.client.0.smithi043.stdout:5/241: write d1/d3/d24/f3d [255726,114204] 0 2024-04-25T13:47:01.603 INFO:tasks.workunit.client.0.smithi043.stdout:0/257: dread db/f12 [0,4194304] 0 2024-04-25T13:47:01.604 INFO:tasks.workunit.client.0.smithi043.stdout:6/288: truncate d0/d24/d2e/d2f/f32 2925045 0 2024-04-25T13:47:01.606 INFO:tasks.workunit.client.0.smithi043.stdout:5/242: write d1/d3/d7/d8/f44 [846030,91322] 0 2024-04-25T13:47:01.607 INFO:tasks.workunit.client.0.smithi043.stdout:7/385: getdents d5/d11/d3b/d3f/d5a 0 2024-04-25T13:47:01.609 INFO:tasks.workunit.client.0.smithi043.stdout:5/243: write d1/d3/d24/f3d [641558,33660] 0 2024-04-25T13:47:01.609 INFO:tasks.workunit.client.0.smithi043.stdout:0/258: creat db/d1b/d36/d41/f57 x:0 0 0 2024-04-25T13:47:01.611 INFO:tasks.workunit.client.0.smithi043.stdout:6/289: symlink d0/d24/d2e/l58 0 2024-04-25T13:47:01.612 INFO:tasks.workunit.client.0.smithi043.stdout:0/259: write db/d1b/f1e [3426687,1470] 0 2024-04-25T13:47:01.619 INFO:tasks.workunit.client.0.smithi043.stdout:9/258: dread d0/d1d/fa [0,4194304] 0 2024-04-25T13:47:01.619 INFO:tasks.workunit.client.0.smithi043.stdout:7/386: getdents d5/d75/d64 0 2024-04-25T13:47:01.619 INFO:tasks.workunit.client.0.smithi043.stdout:6/290: creat d0/f59 x:0 0 0 2024-04-25T13:47:01.622 INFO:tasks.workunit.client.0.smithi043.stdout:7/387: chown d5/d11/d3b/d3f/d5a 38 1 2024-04-25T13:47:01.623 INFO:tasks.workunit.client.0.smithi043.stdout:6/291: creat d0/d3d/f5a x:0 0 0 2024-04-25T13:47:01.625 INFO:tasks.workunit.client.0.smithi043.stdout:0/260: dwrite db/d1b/f35 [0,4194304] 0 2024-04-25T13:47:01.626 INFO:tasks.workunit.client.0.smithi043.stdout:5/244: dwrite d1/d3/d7/d8/da/f2c [4194304,4194304] 0 2024-04-25T13:47:01.627 INFO:tasks.workunit.client.0.smithi043.stdout:0/261: stat db/d25/f2b 0 2024-04-25T13:47:01.627 INFO:tasks.workunit.client.0.smithi043.stdout:7/388: readlink d5/d32/l37 0 2024-04-25T13:47:01.628 INFO:tasks.workunit.client.0.smithi043.stdout:5/245: chown d1/d3/d24/f41 236278970 1 2024-04-25T13:47:01.629 INFO:tasks.workunit.client.0.smithi043.stdout:0/262: dread - db/d1b/d36/d41/f57 zero size 2024-04-25T13:47:01.630 INFO:tasks.workunit.client.0.smithi043.stdout:9/259: creat d0/d1d/dc/d26/d39/d46/d62/f68 x:0 0 0 2024-04-25T13:47:01.630 INFO:tasks.workunit.client.0.smithi043.stdout:0/263: read db/d1b/f22 [1319776,119095] 0 2024-04-25T13:47:01.630 INFO:tasks.workunit.client.0.smithi043.stdout:0/264: dread - db/d25/f46 zero size 2024-04-25T13:47:01.633 INFO:tasks.workunit.client.0.smithi043.stdout:7/389: fdatasync d5/d11/d3b/f70 0 2024-04-25T13:47:01.634 INFO:tasks.workunit.client.0.smithi043.stdout:7/390: write d5/d11/f41 [1154315,45367] 0 2024-04-25T13:47:01.639 INFO:tasks.workunit.client.0.smithi043.stdout:6/292: write d0/f13 [1202088,73320] 0 2024-04-25T13:47:01.641 INFO:tasks.workunit.client.0.smithi043.stdout:7/391: truncate d5/d11/d3b/d3f/d5a/f76 2133310 0 2024-04-25T13:47:01.645 INFO:tasks.workunit.client.0.smithi043.stdout:5/246: creat d1/d3/d7/d8/da/f53 x:0 0 0 2024-04-25T13:47:01.647 INFO:tasks.workunit.client.0.smithi043.stdout:7/392: mkdir d5/d11/d3b/d3f/d5a/d89 0 2024-04-25T13:47:01.649 INFO:tasks.workunit.client.0.smithi043.stdout:9/260: getdents d0/d1d/d7/d3a 0 2024-04-25T13:47:01.651 INFO:tasks.workunit.client.0.smithi043.stdout:6/293: creat d0/d24/f5b x:0 0 0 2024-04-25T13:47:01.651 INFO:tasks.workunit.client.0.smithi043.stdout:0/265: getdents db/d1b/d23/d27 0 2024-04-25T13:47:01.653 INFO:tasks.workunit.client.0.smithi043.stdout:9/261: symlink d0/d1d/dc/d26/l69 0 2024-04-25T13:47:01.655 INFO:tasks.workunit.client.0.smithi043.stdout:9/262: truncate d0/d1d/f28 1290521 0 2024-04-25T13:47:01.655 INFO:tasks.workunit.client.0.smithi043.stdout:7/393: link d5/d11/f26 d5/d75/d54/f8a 0 2024-04-25T13:47:01.657 INFO:tasks.workunit.client.0.smithi043.stdout:0/266: creat db/d1b/d4f/f58 x:0 0 0 2024-04-25T13:47:01.657 INFO:tasks.workunit.client.0.smithi043.stdout:9/263: dread - d0/d1d/d7/d3a/f56 zero size 2024-04-25T13:47:01.658 INFO:tasks.workunit.client.0.smithi043.stdout:0/267: write f8 [4784288,13071] 0 2024-04-25T13:47:01.660 INFO:tasks.workunit.client.0.smithi043.stdout:9/264: creat d0/d1d/d4a/f6a x:0 0 0 2024-04-25T13:47:01.663 INFO:tasks.workunit.client.0.smithi043.stdout:0/268: rename db/d1b/d36/l40 to db/d1b/l59 0 2024-04-25T13:47:01.666 INFO:tasks.workunit.client.0.smithi043.stdout:5/247: truncate d1/d3/d7/f23 3568968 0 2024-04-25T13:47:01.669 INFO:tasks.workunit.client.0.smithi043.stdout:5/248: getdents d1/d3/d7/d9/d2d/d36 0 2024-04-25T13:47:01.669 INFO:tasks.workunit.client.0.smithi043.stdout:5/249: stat d1/d3 0 2024-04-25T13:47:01.672 INFO:tasks.workunit.client.0.smithi043.stdout:5/250: symlink d1/d3/d7/d8/l54 0 2024-04-25T13:47:01.676 INFO:tasks.workunit.client.0.smithi043.stdout:5/251: creat d1/d3/d7/d8/da/d2e/f55 x:0 0 0 2024-04-25T13:47:01.680 INFO:tasks.workunit.client.0.smithi043.stdout:7/394: truncate d5/d11/d3b/d3f/d5a/f76 2479828 0 2024-04-25T13:47:01.681 INFO:tasks.workunit.client.0.smithi043.stdout:5/252: creat d1/f56 x:0 0 0 2024-04-25T13:47:01.684 INFO:tasks.workunit.client.0.smithi043.stdout:7/395: mkdir d5/d11/d3b/d8b 0 2024-04-25T13:47:01.698 INFO:tasks.workunit.client.0.smithi043.stdout:7/396: mknod d5/d11/d3b/d61/d68/c8c 0 2024-04-25T13:47:01.699 INFO:tasks.workunit.client.0.smithi043.stdout:5/253: dwrite d1/f19 [4194304,4194304] 0 2024-04-25T13:47:01.699 INFO:tasks.workunit.client.0.smithi043.stdout:7/397: chown d5/c9 44 1 2024-04-25T13:47:01.700 INFO:tasks.workunit.client.0.smithi043.stdout:7/398: chown d5/d11/d3b 152 1 2024-04-25T13:47:01.700 INFO:tasks.workunit.client.0.smithi043.stdout:5/254: write d1/d3/d24/f3d [1145062,120234] 0 2024-04-25T13:47:01.702 INFO:tasks.workunit.client.0.smithi043.stdout:7/399: write d5/d11/d3b/d3f/f4a [176770,129704] 0 2024-04-25T13:47:01.716 INFO:tasks.workunit.client.0.smithi043.stdout:7/400: dwrite d5/fd [0,4194304] 0 2024-04-25T13:47:01.717 INFO:tasks.workunit.client.0.smithi043.stdout:7/401: write d5/f3c [2340874,108392] 0 2024-04-25T13:47:01.725 INFO:tasks.workunit.client.0.smithi043.stdout:5/255: dread d1/d3/d7/d8/da/f2c [0,4194304] 0 2024-04-25T13:47:01.726 INFO:tasks.workunit.client.0.smithi043.stdout:7/402: dwrite d5/d11/f42 [0,4194304] 0 2024-04-25T13:47:01.731 INFO:tasks.workunit.client.0.smithi043.stdout:5/256: rename d1/d3/d7/d9/d2d/c49 to d1/d3/c57 0 2024-04-25T13:47:01.732 INFO:tasks.workunit.client.0.smithi043.stdout:5/257: chown d1/c22 14085 1 2024-04-25T13:47:01.733 INFO:tasks.workunit.client.0.smithi043.stdout:5/258: write d1/d3/d7/d8/f44 [1004230,130256] 0 2024-04-25T13:47:01.735 INFO:tasks.workunit.client.0.smithi043.stdout:5/259: symlink d1/d3/d7/d2f/d40/l58 0 2024-04-25T13:47:01.741 INFO:tasks.workunit.client.0.smithi043.stdout:5/260: dwrite d1/d3/d7/d8/f44 [0,4194304] 0 2024-04-25T13:47:01.755 INFO:tasks.workunit.client.0.smithi043.stdout:7/403: dread d5/f55 [0,4194304] 0 2024-04-25T13:47:01.756 INFO:tasks.workunit.client.0.smithi043.stdout:7/404: read - d5/d11/d3b/d61/f7b zero size 2024-04-25T13:47:01.761 INFO:tasks.workunit.client.0.smithi043.stdout:7/405: dwrite d5/d11/d3b/f46 [0,4194304] 0 2024-04-25T13:47:01.762 INFO:tasks.workunit.client.0.smithi043.stdout:7/406: chown d5/f45 11 1 2024-04-25T13:47:01.762 INFO:tasks.workunit.client.0.smithi043.stdout:7/407: chown d5/d32/c50 36 1 2024-04-25T13:47:01.765 INFO:tasks.workunit.client.0.smithi043.stdout:7/408: mkdir d5/d11/d3b/d3f/d5a/d8d 0 2024-04-25T13:47:01.788 INFO:tasks.workunit.client.0.smithi043.stdout:7/409: dread d5/d11/d3b/d61/f87 [0,4194304] 0 2024-04-25T13:47:01.789 INFO:tasks.workunit.client.0.smithi043.stdout:7/410: fsync d5/d6b/f71 0 2024-04-25T13:47:01.791 INFO:tasks.workunit.client.0.smithi043.stdout:7/411: rmdir d5/d11/d3b/d3f 39 2024-04-25T13:47:01.792 INFO:tasks.workunit.client.0.smithi043.stdout:7/412: dread - d5/d11/d3b/d3f/d5a/f7a zero size 2024-04-25T13:47:01.796 INFO:tasks.workunit.client.0.smithi043.stdout:7/413: dread d5/d11/d3b/d3f/d5a/f76 [0,4194304] 0 2024-04-25T13:47:01.798 INFO:tasks.workunit.client.0.smithi043.stdout:7/414: mknod d5/d11/c8e 0 2024-04-25T13:47:01.799 INFO:tasks.workunit.client.0.smithi043.stdout:7/415: mkdir d5/d11/d8f 0 2024-04-25T13:47:01.800 INFO:tasks.workunit.client.0.smithi043.stdout:7/416: read d5/d32/f4e [2690896,77950] 0 2024-04-25T13:47:01.802 INFO:tasks.workunit.client.0.smithi043.stdout:7/417: getdents d5/d11/d3b/d8b 0 2024-04-25T13:47:01.803 INFO:tasks.workunit.client.0.smithi043.stdout:7/418: dread - d5/d75/f3e zero size 2024-04-25T13:47:01.804 INFO:tasks.workunit.client.0.smithi043.stdout:7/419: fsync d5/d11/d3b/d61/f7c 0 2024-04-25T13:47:01.808 INFO:tasks.workunit.client.0.smithi043.stdout:7/420: link d5/d11/f26 d5/d11/f90 0 2024-04-25T13:47:01.811 INFO:tasks.workunit.client.0.smithi043.stdout:7/421: symlink d5/d11/d3b/d8b/l91 0 2024-04-25T13:47:01.833 INFO:tasks.workunit.client.0.smithi043.stdout:5/261: dwrite d1/d3/d7/d2f/d40/f51 [0,4194304] 0 2024-04-25T13:47:01.838 INFO:tasks.workunit.client.0.smithi043.stdout:5/262: rename d1/d3/d7/d8/df/d28/f33 to d1/d3/d7/d8/da/d11/d52/f59 0 2024-04-25T13:47:01.840 INFO:tasks.workunit.client.0.smithi043.stdout:5/263: dread - d1/d3/d7/d8/da/f53 zero size 2024-04-25T13:47:01.841 INFO:tasks.workunit.client.0.smithi043.stdout:5/264: readlink d1/d3/d7/d8/df/d28/l38 0 2024-04-25T13:47:01.895 INFO:tasks.workunit.client.0.smithi043.stdout:2/192: sync 2024-04-25T13:47:01.897 INFO:tasks.workunit.client.0.smithi043.stdout:2/193: symlink d0/d26/l2d 0 2024-04-25T13:47:01.900 INFO:tasks.workunit.client.0.smithi043.stdout:2/194: symlink d0/d8/db/l2e 0 2024-04-25T13:47:01.901 INFO:tasks.workunit.client.0.smithi043.stdout:2/195: mkdir d0/d5/d2f 0 2024-04-25T13:47:01.917 INFO:tasks.workunit.client.0.smithi043.stdout:2/196: read d0/d8/db/f1a [1644041,53825] 0 2024-04-25T13:47:01.920 INFO:tasks.workunit.client.0.smithi043.stdout:2/197: rename d0/d8/db/c14 to d0/d8/db/d24/c30 0 2024-04-25T13:47:01.922 INFO:tasks.workunit.client.0.smithi043.stdout:2/198: truncate d0/d8/fa 2978821 0 2024-04-25T13:47:01.929 INFO:tasks.workunit.client.0.smithi043.stdout:2/199: dwrite d0/d5/d1e/f1f [0,4194304] 0 2024-04-25T13:47:01.929 INFO:tasks.workunit.client.0.smithi043.stdout:2/200: creat d0/d26/f31 x:0 0 0 2024-04-25T13:47:01.930 INFO:tasks.workunit.client.0.smithi043.stdout:2/201: read d0/d5/d1e/f1f [2899517,77879] 0 2024-04-25T13:47:01.932 INFO:tasks.workunit.client.0.smithi043.stdout:2/202: mkdir d0/d5/d1e/d32 0 2024-04-25T13:47:01.938 INFO:tasks.workunit.client.0.smithi043.stdout:2/203: link d0/f12 d0/d26/f33 0 2024-04-25T13:47:01.959 INFO:tasks.workunit.client.0.smithi043.stdout:2/204: rename d0/d8/db to d0/d34 0 2024-04-25T13:47:01.961 INFO:tasks.workunit.client.0.smithi043.stdout:2/205: mkdir d0/d35 0 2024-04-25T13:47:01.963 INFO:tasks.workunit.client.0.smithi043.stdout:2/206: read d0/d34/f1d [2869509,7222] 0 2024-04-25T13:47:01.968 INFO:tasks.workunit.client.0.smithi043.stdout:2/207: unlink d0/f12 0 2024-04-25T13:47:01.984 INFO:tasks.workunit.client.0.smithi043.stdout:2/208: dread d0/d34/f1a [0,4194304] 0 2024-04-25T13:47:01.989 INFO:tasks.workunit.client.0.smithi043.stdout:2/209: dwrite d0/f18 [0,4194304] 0 2024-04-25T13:47:01.992 INFO:tasks.workunit.client.0.smithi043.stdout:2/210: unlink d0/d26/l2d 0 2024-04-25T13:47:01.994 INFO:tasks.workunit.client.0.smithi043.stdout:2/211: fdatasync d0/d8/d22/f2b 0 2024-04-25T13:47:02.014 INFO:tasks.workunit.client.0.smithi043.stdout:2/212: rename d0/d34/d24 to d0/d8/d22/d36 0 2024-04-25T13:47:02.021 INFO:tasks.workunit.client.0.smithi043.stdout:2/213: creat d0/d34/f37 x:0 0 0 2024-04-25T13:47:02.023 INFO:tasks.workunit.client.0.smithi043.stdout:2/214: getdents d0/d5/d1e/d32 0 2024-04-25T13:47:02.025 INFO:tasks.workunit.client.0.smithi043.stdout:2/215: mknod d0/d5/d1e/d32/c38 0 2024-04-25T13:47:02.031 INFO:tasks.workunit.client.0.smithi043.stdout:2/216: dwrite d0/d8/fd [4194304,4194304] 0 2024-04-25T13:47:02.039 INFO:tasks.workunit.client.0.smithi043.stdout:2/217: fsync d0/d34/f20 0 2024-04-25T13:47:02.039 INFO:tasks.workunit.client.0.smithi043.stdout:2/218: stat d0/d34/d17/c21 0 2024-04-25T13:47:02.042 INFO:tasks.workunit.client.0.smithi043.stdout:2/219: dread d0/f18 [0,4194304] 0 2024-04-25T13:47:02.045 INFO:tasks.workunit.client.0.smithi043.stdout:2/220: dread d0/f18 [0,4194304] 0 2024-04-25T13:47:02.047 INFO:tasks.workunit.client.0.smithi043.stdout:8/374: sync 2024-04-25T13:47:02.048 INFO:tasks.workunit.client.0.smithi043.stdout:2/221: write d0/d34/f1a [2582033,101320] 0 2024-04-25T13:47:02.048 INFO:tasks.workunit.client.0.smithi043.stdout:2/222: chown d0/d8/fd 301 1 2024-04-25T13:47:02.052 INFO:tasks.workunit.client.0.smithi043.stdout:2/223: dread d0/d8/fd [0,4194304] 0 2024-04-25T13:47:02.057 INFO:tasks.workunit.client.0.smithi043.stdout:2/224: dwrite d0/d8/d22/f2b [0,4194304] 0 2024-04-25T13:47:02.071 INFO:tasks.workunit.client.0.smithi043.stdout:2/225: link d0/d34/f1d d0/d5/d1e/f39 0 2024-04-25T13:47:02.075 INFO:tasks.workunit.client.0.smithi043.stdout:2/226: creat d0/d8/d22/d36/f3a x:0 0 0 2024-04-25T13:47:02.076 INFO:tasks.workunit.client.0.smithi043.stdout:2/227: write d0/d34/f37 [695806,80054] 0 2024-04-25T13:47:02.088 INFO:tasks.workunit.client.0.smithi043.stdout:2/228: dread d0/d34/f37 [0,4194304] 0 2024-04-25T13:47:02.094 INFO:tasks.workunit.client.0.smithi043.stdout:2/229: dwrite d0/f18 [0,4194304] 0 2024-04-25T13:47:02.096 INFO:tasks.workunit.client.0.smithi043.stdout:2/230: rmdir d0/d8 39 2024-04-25T13:47:02.098 INFO:tasks.workunit.client.0.smithi043.stdout:2/231: mknod d0/d5/c3b 0 2024-04-25T13:47:02.106 INFO:tasks.workunit.client.0.smithi043.stdout:2/232: dwrite d0/d26/f33 [0,4194304] 0 2024-04-25T13:47:02.109 INFO:tasks.workunit.client.0.smithi043.stdout:2/233: fdatasync d0/d34/d17/f23 0 2024-04-25T13:47:02.109 INFO:tasks.workunit.client.0.smithi043.stdout:2/234: readlink d0/l6 0 2024-04-25T13:47:02.110 INFO:tasks.workunit.client.0.smithi043.stdout:2/235: write d0/d5/d1e/f1f [589815,69704] 0 2024-04-25T13:47:02.113 INFO:tasks.workunit.client.0.smithi043.stdout:2/236: symlink d0/d34/l3c 0 2024-04-25T13:47:02.119 INFO:tasks.workunit.client.0.smithi043.stdout:2/237: write d0/d8/ff [280866,93272] 0 2024-04-25T13:47:02.119 INFO:tasks.workunit.client.0.smithi043.stdout:2/238: chown d0/d8/l25 16726430 1 2024-04-25T13:47:02.121 INFO:tasks.workunit.client.0.smithi043.stdout:2/239: symlink d0/d35/l3d 0 2024-04-25T13:47:02.129 INFO:tasks.workunit.client.0.smithi043.stdout:2/240: chown d0/d34/f1d 8 1 2024-04-25T13:47:02.130 INFO:tasks.workunit.client.0.smithi043.stdout:2/241: mknod d0/d5/c3e 0 2024-04-25T13:47:02.131 INFO:tasks.workunit.client.0.smithi043.stdout:2/242: readlink d0/d34/l2e 0 2024-04-25T13:47:02.131 INFO:tasks.workunit.client.0.smithi043.stdout:2/243: write d0/d34/d17/f23 [1034105,38848] 0 2024-04-25T13:47:02.134 INFO:tasks.workunit.client.0.smithi043.stdout:3/279: sync 2024-04-25T13:47:02.134 INFO:tasks.workunit.client.0.smithi043.stdout:4/257: sync 2024-04-25T13:47:02.134 INFO:tasks.workunit.client.0.smithi043.stdout:1/281: sync 2024-04-25T13:47:02.135 INFO:tasks.workunit.client.0.smithi043.stdout:3/280: readlink d0/d9/l4c 0 2024-04-25T13:47:02.135 INFO:tasks.workunit.client.0.smithi043.stdout:4/258: mkdir d1/d3/d54 0 2024-04-25T13:47:02.135 INFO:tasks.workunit.client.0.smithi043.stdout:3/281: chown d0/d9/l4c 87 1 2024-04-25T13:47:02.136 INFO:tasks.workunit.client.0.smithi043.stdout:4/259: write d1/de/f1c [2403268,14119] 0 2024-04-25T13:47:02.136 INFO:tasks.workunit.client.0.smithi043.stdout:1/282: getdents df/d14/d2a/d39 0 2024-04-25T13:47:02.138 INFO:tasks.workunit.client.0.smithi043.stdout:4/260: truncate d1/de/d1d/d20/f52 975500 0 2024-04-25T13:47:02.139 INFO:tasks.workunit.client.0.smithi043.stdout:2/244: write d0/d8/fa [1641764,25960] 0 2024-04-25T13:47:02.139 INFO:tasks.workunit.client.0.smithi043.stdout:1/283: rmdir df/d14/d3d 39 2024-04-25T13:47:02.141 INFO:tasks.workunit.client.0.smithi043.stdout:3/282: mknod d0/d9/d15/c63 0 2024-04-25T13:47:02.141 INFO:tasks.workunit.client.0.smithi043.stdout:3/283: stat d0/c46 0 2024-04-25T13:47:02.145 INFO:tasks.workunit.client.0.smithi043.stdout:4/261: dread d1/de/df/d1a/f4c [0,4194304] 0 2024-04-25T13:47:02.145 INFO:tasks.workunit.client.0.smithi043.stdout:2/245: mkdir d0/d34/d3f 0 2024-04-25T13:47:02.146 INFO:tasks.workunit.client.0.smithi043.stdout:4/262: stat d1/de/d1d/l43 0 2024-04-25T13:47:02.146 INFO:tasks.workunit.client.0.smithi043.stdout:4/263: read d1/de/df/f16 [1787328,117636] 0 2024-04-25T13:47:02.147 INFO:tasks.workunit.client.0.smithi043.stdout:4/264: stat d1/d3/f3e 0 2024-04-25T13:47:02.147 INFO:tasks.workunit.client.0.smithi043.stdout:1/284: link df/d14/c15 df/d31/d38/d3f/d41/c59 0 2024-04-25T13:47:02.148 INFO:tasks.workunit.client.0.smithi043.stdout:1/285: write df/d10/f12 [2183464,114157] 0 2024-04-25T13:47:02.150 INFO:tasks.workunit.client.0.smithi043.stdout:1/286: write df/f1b [996208,18641] 0 2024-04-25T13:47:02.150 INFO:tasks.workunit.client.0.smithi043.stdout:2/246: creat d0/d26/f40 x:0 0 0 2024-04-25T13:47:02.151 INFO:tasks.workunit.client.0.smithi043.stdout:2/247: chown d0/d8/l25 389758052 1 2024-04-25T13:47:02.153 INFO:tasks.workunit.client.0.smithi043.stdout:1/287: mknod df/d31/d38/d43/c5a 0 2024-04-25T13:47:02.153 INFO:tasks.workunit.client.0.smithi043.stdout:4/265: rename d1/de/d1d/d20/d38/d3a/l44 to d1/d34/l55 0 2024-04-25T13:47:02.155 INFO:tasks.workunit.client.0.smithi043.stdout:1/288: write df/f35 [34100,55249] 0 2024-04-25T13:47:02.157 INFO:tasks.workunit.client.0.smithi043.stdout:4/266: mknod d1/de/d1d/c56 0 2024-04-25T13:47:02.159 INFO:tasks.workunit.client.0.smithi043.stdout:5/265: sync 2024-04-25T13:47:02.160 INFO:tasks.workunit.client.0.smithi043.stdout:6/294: sync 2024-04-25T13:47:02.160 INFO:tasks.workunit.client.0.smithi043.stdout:9/265: sync 2024-04-25T13:47:02.160 INFO:tasks.workunit.client.0.smithi043.stdout:7/422: sync 2024-04-25T13:47:02.160 INFO:tasks.workunit.client.0.smithi043.stdout:8/375: sync 2024-04-25T13:47:02.160 INFO:tasks.workunit.client.0.smithi043.stdout:0/269: sync 2024-04-25T13:47:02.163 INFO:tasks.workunit.client.0.smithi043.stdout:1/289: dwrite df/d31/d34/f4d [0,4194304] 0 2024-04-25T13:47:02.163 INFO:tasks.workunit.client.0.smithi043.stdout:3/284: rmdir d0/d9/d15 39 2024-04-25T13:47:02.165 INFO:tasks.workunit.client.0.smithi043.stdout:8/376: chown db/d11/d1b/d1e/f56 28 1 2024-04-25T13:47:02.165 INFO:tasks.workunit.client.0.smithi043.stdout:6/295: mkdir d0/d24/d2e/d5c 0 2024-04-25T13:47:02.167 INFO:tasks.workunit.client.0.smithi043.stdout:9/266: mknod d0/d1d/d7/d41/c6b 0 2024-04-25T13:47:02.169 INFO:tasks.workunit.client.0.smithi043.stdout:1/290: creat df/d10/d22/f5b x:0 0 0 2024-04-25T13:47:02.169 INFO:tasks.workunit.client.0.smithi043.stdout:0/270: creat db/d1b/d23/d27/f5a x:0 0 0 2024-04-25T13:47:02.170 INFO:tasks.workunit.client.0.smithi043.stdout:5/266: rename d1/d3/d26/l3c to d1/d3/d7/d2f/l5a 0 2024-04-25T13:47:02.171 INFO:tasks.workunit.client.0.smithi043.stdout:4/267: dwrite d1/de/df/f41 [0,4194304] 0 2024-04-25T13:47:02.173 INFO:tasks.workunit.client.0.smithi043.stdout:9/267: stat d0/d1d/dc/d26/d39/d46 0 2024-04-25T13:47:02.175 INFO:tasks.workunit.client.0.smithi043.stdout:1/291: symlink df/d31/d34/l5c 0 2024-04-25T13:47:02.199 INFO:tasks.workunit.client.0.smithi043.stdout:0/271: mkdir db/d5b 0 2024-04-25T13:47:02.199 INFO:tasks.workunit.client.0.smithi043.stdout:9/268: fsync d0/d1d/dc/d26/d39/f5f 0 2024-04-25T13:47:02.200 INFO:tasks.workunit.client.0.smithi043.stdout:4/268: chown d1/de/df/d1a/d27/d36/c4a 788 1 2024-04-25T13:47:02.200 INFO:tasks.workunit.client.0.smithi043.stdout:7/423: dwrite d5/f2e [4194304,4194304] 0 2024-04-25T13:47:02.201 INFO:tasks.workunit.client.0.smithi043.stdout:6/296: creat d0/f5d x:0 0 0 2024-04-25T13:47:02.202 INFO:tasks.workunit.client.0.smithi043.stdout:0/272: dread - db/d25/f46 zero size 2024-04-25T13:47:02.204 INFO:tasks.workunit.client.0.smithi043.stdout:2/248: dread d0/d34/f1a [0,4194304] 0 2024-04-25T13:47:02.205 INFO:tasks.workunit.client.0.smithi043.stdout:3/285: dwrite d0/d9/f20 [0,4194304] 0 2024-04-25T13:47:02.205 INFO:tasks.workunit.client.0.smithi043.stdout:7/424: creat d5/d6b/f92 x:0 0 0 2024-04-25T13:47:02.206 INFO:tasks.workunit.client.0.smithi043.stdout:2/249: chown d0/d34/f1a 258720 1 2024-04-25T13:47:02.207 INFO:tasks.workunit.client.0.smithi043.stdout:4/269: creat d1/d34/d35/f57 x:0 0 0 2024-04-25T13:47:02.208 INFO:tasks.workunit.client.0.smithi043.stdout:1/292: truncate df/d31/d34/f49 126052 0 2024-04-25T13:47:02.211 INFO:tasks.workunit.client.0.smithi043.stdout:7/425: mkdir d5/d11/d3b/d8b/d93 0 2024-04-25T13:47:02.211 INFO:tasks.workunit.client.0.smithi043.stdout:1/293: fdatasync df/d31/d38/f3b 0 2024-04-25T13:47:02.212 INFO:tasks.workunit.client.0.smithi043.stdout:2/250: creat d0/d34/d17/f41 x:0 0 0 2024-04-25T13:47:02.213 INFO:tasks.workunit.client.0.smithi043.stdout:7/426: stat d5/f2d 0 2024-04-25T13:47:02.214 INFO:tasks.workunit.client.0.smithi043.stdout:1/294: dread - df/d14/f56 zero size 2024-04-25T13:47:02.215 INFO:tasks.workunit.client.0.smithi043.stdout:6/297: dwrite d0/f59 [0,4194304] 0 2024-04-25T13:47:02.219 INFO:tasks.workunit.client.0.smithi043.stdout:6/298: chown d0/c17 6 1 2024-04-25T13:47:02.220 INFO:tasks.workunit.client.0.smithi043.stdout:1/295: write df/d14/f56 [471343,34451] 0 2024-04-25T13:47:02.220 INFO:tasks.workunit.client.0.smithi043.stdout:7/427: fsync d5/d11/f90 0 2024-04-25T13:47:02.223 INFO:tasks.workunit.client.0.smithi043.stdout:4/270: rename d1/de/df/d1e/f30 to d1/de/df/d1a/f58 0 2024-04-25T13:47:02.227 INFO:tasks.workunit.client.0.smithi043.stdout:1/296: read df/d31/d34/f4d [1638451,21259] 0 2024-04-25T13:47:02.230 INFO:tasks.workunit.client.0.smithi043.stdout:6/299: creat d0/d3d/d54/f5e x:0 0 0 2024-04-25T13:47:02.230 INFO:tasks.workunit.client.0.smithi043.stdout:4/271: chown d1/d3/c24 1159 1 2024-04-25T13:47:02.233 INFO:tasks.workunit.client.0.smithi043.stdout:3/286: dwrite d0/d9/d15/d34/d36/d57/f5f [0,4194304] 0 2024-04-25T13:47:02.235 INFO:tasks.workunit.client.0.smithi043.stdout:6/300: read d0/f59 [2081467,105540] 0 2024-04-25T13:47:02.238 INFO:tasks.workunit.client.0.smithi043.stdout:0/273: dwrite db/d1b/f22 [0,4194304] 0 2024-04-25T13:47:02.240 INFO:tasks.workunit.client.0.smithi043.stdout:2/251: truncate d0/d8/fa 2522142 0 2024-04-25T13:47:02.243 INFO:tasks.workunit.client.0.smithi043.stdout:9/269: dwrite d0/d1d/f64 [0,4194304] 0 2024-04-25T13:47:02.247 INFO:tasks.workunit.client.0.smithi043.stdout:7/428: dwrite d5/d75/f66 [4194304,4194304] 0 2024-04-25T13:47:02.248 INFO:tasks.workunit.client.0.smithi043.stdout:2/252: dread d0/d34/f37 [0,4194304] 0 2024-04-25T13:47:02.250 INFO:tasks.workunit.client.0.smithi043.stdout:1/297: getdents df/d31/d38/d3f/d41 0 2024-04-25T13:47:02.253 INFO:tasks.workunit.client.0.smithi043.stdout:3/287: write d0/d14/f22 [2222162,129868] 0 2024-04-25T13:47:02.254 INFO:tasks.workunit.client.0.smithi043.stdout:4/272: creat d1/de/df/d1a/d49/f59 x:0 0 0 2024-04-25T13:47:02.254 INFO:tasks.workunit.client.0.smithi043.stdout:7/429: chown d5/f45 2 1 2024-04-25T13:47:02.260 INFO:tasks.workunit.client.0.smithi043.stdout:0/274: rename db/d1b/f1e to db/d1b/d23/d27/f5c 0 2024-04-25T13:47:02.266 INFO:tasks.workunit.client.0.smithi043.stdout:8/377: dread db/dc/f23 [4194304,4194304] 0 2024-04-25T13:47:02.272 INFO:tasks.workunit.client.0.smithi043.stdout:3/288: read - d0/d9/f5d zero size 2024-04-25T13:47:02.273 INFO:tasks.workunit.client.0.smithi043.stdout:7/430: chown d5/d75/f73 3 1 2024-04-25T13:47:02.275 INFO:tasks.workunit.client.0.smithi043.stdout:0/275: rename db/f12 to db/d1b/d4f/f5d 0 2024-04-25T13:47:02.276 INFO:tasks.workunit.client.0.smithi043.stdout:6/301: dwrite d0/d24/d2e/f37 [4194304,4194304] 0 2024-04-25T13:47:02.281 INFO:tasks.workunit.client.0.smithi043.stdout:3/289: mknod d0/d13/c64 0 2024-04-25T13:47:02.282 INFO:tasks.workunit.client.0.smithi043.stdout:2/253: dwrite d0/f18 [4194304,4194304] 0 2024-04-25T13:47:02.282 INFO:tasks.workunit.client.0.smithi043.stdout:4/273: write d1/de/df/d1a/f2d [6182426,125116] 0 2024-04-25T13:47:02.284 INFO:tasks.workunit.client.0.smithi043.stdout:5/267: sync 2024-04-25T13:47:02.284 INFO:tasks.workunit.client.0.smithi043.stdout:8/378: write db/d11/d1b/d1e/f3b [68403,43021] 0 2024-04-25T13:47:02.284 INFO:tasks.workunit.client.0.smithi043.stdout:9/270: dwrite d0/d1d/dc/f5d [0,4194304] 0 2024-04-25T13:47:02.286 INFO:tasks.workunit.client.0.smithi043.stdout:0/276: creat db/d1b/f5e x:0 0 0 2024-04-25T13:47:02.287 INFO:tasks.workunit.client.0.smithi043.stdout:7/431: creat d5/d11/d84/f94 x:0 0 0 2024-04-25T13:47:02.294 INFO:tasks.workunit.client.0.smithi043.stdout:4/274: mknod d1/de/d1d/c5a 0 2024-04-25T13:47:02.294 INFO:tasks.workunit.client.0.smithi043.stdout:8/379: chown db/d46/l5e 514 1 2024-04-25T13:47:02.295 INFO:tasks.workunit.client.0.smithi043.stdout:1/298: dwrite df/f16 [0,4194304] 0 2024-04-25T13:47:02.296 INFO:tasks.workunit.client.0.smithi043.stdout:5/268: unlink d1/d3/d24/c30 0 2024-04-25T13:47:02.297 INFO:tasks.workunit.client.0.smithi043.stdout:3/290: write d0/da/f28 [3190205,33116] 0 2024-04-25T13:47:02.297 INFO:tasks.workunit.client.0.smithi043.stdout:0/277: rmdir db/d1b/d23/d27/d39/d4b 39 2024-04-25T13:47:02.298 INFO:tasks.workunit.client.0.smithi043.stdout:4/275: write d1/de/df/d1a/f3c [49838,80320] 0 2024-04-25T13:47:02.300 INFO:tasks.workunit.client.0.smithi043.stdout:5/269: fdatasync d1/d3/d7/d8/da/f53 0 2024-04-25T13:47:02.300 INFO:tasks.workunit.client.0.smithi043.stdout:6/302: getdents d0/d24/d2e 0 2024-04-25T13:47:02.301 INFO:tasks.workunit.client.0.smithi043.stdout:3/291: dread - d0/d9/f62 zero size 2024-04-25T13:47:02.302 INFO:tasks.workunit.client.0.smithi043.stdout:6/303: write d0/f5d [257716,115887] 0 2024-04-25T13:47:02.303 INFO:tasks.workunit.client.0.smithi043.stdout:6/304: truncate d0/d3d/f5a 654598 0 2024-04-25T13:47:02.309 INFO:tasks.workunit.client.0.smithi043.stdout:1/299: truncate df/d10/d22/f2e 783029 0 2024-04-25T13:47:02.310 INFO:tasks.workunit.client.0.smithi043.stdout:1/300: write df/f16 [2174512,54392] 0 2024-04-25T13:47:02.312 INFO:tasks.workunit.client.0.smithi043.stdout:7/432: dread d5/d11/f90 [0,4194304] 0 2024-04-25T13:47:02.312 INFO:tasks.workunit.client.0.smithi043.stdout:4/276: rmdir d1/de/d1d/d20/d38 39 2024-04-25T13:47:02.315 INFO:tasks.workunit.client.0.smithi043.stdout:3/292: chown d0/d9/d15/f1f 37 1 2024-04-25T13:47:02.316 INFO:tasks.workunit.client.0.smithi043.stdout:5/270: mkdir d1/d3/d7/d9/d2d/d5b 0 2024-04-25T13:47:02.318 INFO:tasks.workunit.client.0.smithi043.stdout:9/271: creat d0/d1d/dc/d26/f6c x:0 0 0 2024-04-25T13:47:02.320 INFO:tasks.workunit.client.0.smithi043.stdout:1/301: dwrite df/d10/d22/f5b [0,4194304] 0 2024-04-25T13:47:02.323 INFO:tasks.workunit.client.0.smithi043.stdout:6/305: symlink d0/d24/d2e/d2f/d41/d4c/l5f 0 2024-04-25T13:47:02.325 INFO:tasks.workunit.client.0.smithi043.stdout:0/278: dread f7 [4194304,4194304] 0 2024-04-25T13:47:02.328 INFO:tasks.workunit.client.0.smithi043.stdout:5/271: symlink d1/d3/d26/l5c 0 2024-04-25T13:47:02.329 INFO:tasks.workunit.client.0.smithi043.stdout:3/293: rmdir d0/d9/d15/d34/d36 39 2024-04-25T13:47:02.330 INFO:tasks.workunit.client.0.smithi043.stdout:8/380: creat db/d38/f7f x:0 0 0 2024-04-25T13:47:02.330 INFO:tasks.workunit.client.0.smithi043.stdout:1/302: link df/d14/f1c df/d10/d22/d2f/f5d 0 2024-04-25T13:47:02.330 INFO:tasks.workunit.client.0.smithi043.stdout:9/272: dread d0/d1d/f28 [0,4194304] 0 2024-04-25T13:47:02.332 INFO:tasks.workunit.client.0.smithi043.stdout:0/279: fsync f7 0 2024-04-25T13:47:02.333 INFO:tasks.workunit.client.0.smithi043.stdout:5/272: mknod d1/d3/d7/d9/d2d/c5d 0 2024-04-25T13:47:02.334 INFO:tasks.workunit.client.0.smithi043.stdout:3/294: symlink d0/d13/d55/l65 0 2024-04-25T13:47:02.337 INFO:tasks.workunit.client.0.smithi043.stdout:9/273: write d0/d1d/d7/f5a [505662,34515] 0 2024-04-25T13:47:02.338 INFO:tasks.workunit.client.0.smithi043.stdout:7/433: getdents d5/d11/d3b/d61/d68 0 2024-04-25T13:47:02.338 INFO:tasks.workunit.client.0.smithi043.stdout:2/254: rename d0/d34/c28 to d0/d8/d22/d36/c42 0 2024-04-25T13:47:02.341 INFO:tasks.workunit.client.0.smithi043.stdout:3/295: chown d0/d9/d15/l41 0 1 2024-04-25T13:47:02.342 INFO:tasks.workunit.client.0.smithi043.stdout:5/273: write d1/d3/d7/d2f/d40/f51 [2287335,75508] 0 2024-04-25T13:47:02.343 INFO:tasks.workunit.client.0.smithi043.stdout:0/280: rmdir db/d25/d4a 0 2024-04-25T13:47:02.346 INFO:tasks.workunit.client.0.smithi043.stdout:2/255: fsync d0/d8/fd 0 2024-04-25T13:47:02.348 INFO:tasks.workunit.client.0.smithi043.stdout:6/306: dwrite d0/f59 [4194304,4194304] 0 2024-04-25T13:47:02.348 INFO:tasks.workunit.client.0.smithi043.stdout:7/434: getdents d5/d11/d80 0 2024-04-25T13:47:02.348 INFO:tasks.workunit.client.0.smithi043.stdout:9/274: rmdir d0/d1d/dc/d26/d39 39 2024-04-25T13:47:02.349 INFO:tasks.workunit.client.0.smithi043.stdout:1/303: dwrite df/d31/d38/d3f/f42 [0,4194304] 0 2024-04-25T13:47:02.351 INFO:tasks.workunit.client.0.smithi043.stdout:2/256: mknod d0/d5/c43 0 2024-04-25T13:47:02.351 INFO:tasks.workunit.client.0.smithi043.stdout:9/275: stat d0/d1d/d22/f63 0 2024-04-25T13:47:02.352 INFO:tasks.workunit.client.0.smithi043.stdout:2/257: fdatasync d0/d5/d1e/f1f 0 2024-04-25T13:47:02.352 INFO:tasks.workunit.client.0.smithi043.stdout:0/281: symlink db/l5f 0 2024-04-25T13:47:02.353 INFO:tasks.workunit.client.0.smithi043.stdout:1/304: unlink df/d10/f44 0 2024-04-25T13:47:02.354 INFO:tasks.workunit.client.0.smithi043.stdout:0/282: write db/d1b/f47 [835030,111444] 0 2024-04-25T13:47:02.359 INFO:tasks.workunit.client.0.smithi043.stdout:1/305: rename df/d10/l18 to df/d31/l5e 0 2024-04-25T13:47:02.361 INFO:tasks.workunit.client.0.smithi043.stdout:2/258: symlink d0/d5/l44 0 2024-04-25T13:47:02.362 INFO:tasks.workunit.client.0.smithi043.stdout:3/296: symlink d0/d9/d15/l66 0 2024-04-25T13:47:02.362 INFO:tasks.workunit.client.0.smithi043.stdout:1/306: creat df/d10/d22/f5f x:0 0 0 2024-04-25T13:47:02.363 INFO:tasks.workunit.client.0.smithi043.stdout:5/274: unlink d1/d3/d7/d8/da/d2e/f4b 0 2024-04-25T13:47:02.364 INFO:tasks.workunit.client.0.smithi043.stdout:0/283: fsync db/d1b/d23/d27/f44 0 2024-04-25T13:47:02.369 INFO:tasks.workunit.client.0.smithi043.stdout:5/275: dread - d1/d3/d7/d8/df/d28/f48 zero size 2024-04-25T13:47:02.371 INFO:tasks.workunit.client.0.smithi043.stdout:6/307: truncate d0/fe 1847417 0 2024-04-25T13:47:02.373 INFO:tasks.workunit.client.0.smithi043.stdout:0/284: creat db/d5b/f60 x:0 0 0 2024-04-25T13:47:02.373 INFO:tasks.workunit.client.0.smithi043.stdout:1/307: link df/d31/d34/f4d df/d31/f60 0 2024-04-25T13:47:02.373 INFO:tasks.workunit.client.0.smithi043.stdout:5/276: read d1/f19 [1728226,94610] 0 2024-04-25T13:47:02.374 INFO:tasks.workunit.client.0.smithi043.stdout:2/259: dwrite d0/d8/ff [0,4194304] 0 2024-04-25T13:47:02.376 INFO:tasks.workunit.client.0.smithi043.stdout:6/308: unlink d0/ld 0 2024-04-25T13:47:02.377 INFO:tasks.workunit.client.0.smithi043.stdout:1/308: creat df/d31/d38/f61 x:0 0 0 2024-04-25T13:47:02.378 INFO:tasks.workunit.client.0.smithi043.stdout:0/285: creat db/d1b/d36/f61 x:0 0 0 2024-04-25T13:47:02.380 INFO:tasks.workunit.client.0.smithi043.stdout:3/297: write d0/f33 [1848514,41341] 0 2024-04-25T13:47:02.381 INFO:tasks.workunit.client.0.smithi043.stdout:7/435: dread d5/f27 [4194304,4194304] 0 2024-04-25T13:47:02.383 INFO:tasks.workunit.client.0.smithi043.stdout:2/260: creat d0/d5/d2f/f45 x:0 0 0 2024-04-25T13:47:02.384 INFO:tasks.workunit.client.0.smithi043.stdout:5/277: symlink d1/d3/d7/d9/d2d/d36/l5e 0 2024-04-25T13:47:02.385 INFO:tasks.workunit.client.0.smithi043.stdout:9/276: dwrite d0/d1d/d7/f66 [0,4194304] 0 2024-04-25T13:47:02.387 INFO:tasks.workunit.client.0.smithi043.stdout:7/436: write d5/d11/d3b/d61/d68/f77 [14823,63821] 0 2024-04-25T13:47:02.388 INFO:tasks.workunit.client.0.smithi043.stdout:3/298: creat d0/d13/f67 x:0 0 0 2024-04-25T13:47:02.388 INFO:tasks.workunit.client.0.smithi043.stdout:0/286: truncate db/d1b/d36/f53 190711 0 2024-04-25T13:47:02.389 INFO:tasks.workunit.client.0.smithi043.stdout:6/309: mkdir d0/d24/d2e/d2f/d41/d48/d60 0 2024-04-25T13:47:02.391 INFO:tasks.workunit.client.0.smithi043.stdout:0/287: read - db/d25/f46 zero size 2024-04-25T13:47:02.391 INFO:tasks.workunit.client.0.smithi043.stdout:5/278: truncate d1/d3/d7/d2f/d40/f39 837205 0 2024-04-25T13:47:02.392 INFO:tasks.workunit.client.0.smithi043.stdout:3/299: creat d0/d13/d5a/f68 x:0 0 0 2024-04-25T13:47:02.394 INFO:tasks.workunit.client.0.smithi043.stdout:9/277: fsync d0/d1d/dc/d26/d39/d46/d62/f68 0 2024-04-25T13:47:02.394 INFO:tasks.workunit.client.0.smithi043.stdout:5/279: chown d1/d3/d26/f27 6 1 2024-04-25T13:47:02.395 INFO:tasks.workunit.client.0.smithi043.stdout:0/288: truncate db/d5b/f60 1019688 0 2024-04-25T13:47:02.397 INFO:tasks.workunit.client.0.smithi043.stdout:7/437: creat d5/d11/d3b/d3f/d5a/d89/f95 x:0 0 0 2024-04-25T13:47:02.398 INFO:tasks.workunit.client.0.smithi043.stdout:5/280: write d1/d3/d26/f27 [2103998,29703] 0 2024-04-25T13:47:02.399 INFO:tasks.workunit.client.0.smithi043.stdout:9/278: readlink d0/d1d/l11 0 2024-04-25T13:47:02.400 INFO:tasks.workunit.client.0.smithi043.stdout:0/289: mkdir db/d1b/d62 0 2024-04-25T13:47:02.400 INFO:tasks.workunit.client.0.smithi043.stdout:7/438: write d5/f18 [828531,96657] 0 2024-04-25T13:47:02.408 INFO:tasks.workunit.client.0.smithi043.stdout:9/279: read d0/d1d/f28 [505835,57648] 0 2024-04-25T13:47:02.408 INFO:tasks.workunit.client.0.smithi043.stdout:0/290: creat db/d1b/d4f/f63 x:0 0 0 2024-04-25T13:47:02.409 INFO:tasks.workunit.client.0.smithi043.stdout:7/439: unlink d5/d75/f73 0 2024-04-25T13:47:02.410 INFO:tasks.workunit.client.0.smithi043.stdout:2/261: mkdir d0/d34/d3f/d46 0 2024-04-25T13:47:02.410 INFO:tasks.workunit.client.0.smithi043.stdout:0/291: chown f6 281 1 2024-04-25T13:47:02.414 INFO:tasks.workunit.client.0.smithi043.stdout:1/309: dwrite df/d31/d34/f49 [0,4194304] 0 2024-04-25T13:47:02.414 INFO:tasks.workunit.client.0.smithi043.stdout:5/281: rename d1/d3/d7/d9/d2d/d36/l5e to d1/d4/d42/l5f 0 2024-04-25T13:47:02.415 INFO:tasks.workunit.client.0.smithi043.stdout:7/440: symlink d5/d32/l96 0 2024-04-25T13:47:02.417 INFO:tasks.workunit.client.0.smithi043.stdout:9/280: truncate d0/d1d/d7/d3a/f56 33510 0 2024-04-25T13:47:02.419 INFO:tasks.workunit.client.0.smithi043.stdout:6/310: dread d0/f31 [4194304,4194304] 0 2024-04-25T13:47:02.419 INFO:tasks.workunit.client.0.smithi043.stdout:1/310: mknod df/d10/d22/c62 0 2024-04-25T13:47:02.425 INFO:tasks.workunit.client.0.smithi043.stdout:7/441: write d5/d11/d3b/d3f/d5a/f88 [532673,70323] 0 2024-04-25T13:47:02.427 INFO:tasks.workunit.client.0.smithi043.stdout:9/281: dread d0/d1d/f28 [0,4194304] 0 2024-04-25T13:47:02.430 INFO:tasks.workunit.client.0.smithi043.stdout:6/311: creat d0/d24/d2e/d2f/d41/d4c/f61 x:0 0 0 2024-04-25T13:47:02.431 INFO:tasks.workunit.client.0.smithi043.stdout:5/282: getdents d1/d3/d7/d9/d2d/d36 0 2024-04-25T13:47:02.432 INFO:tasks.workunit.client.0.smithi043.stdout:3/300: dread d0/f2a [4194304,4194304] 0 2024-04-25T13:47:02.434 INFO:tasks.workunit.client.0.smithi043.stdout:2/262: dread d0/d8/fa [0,4194304] 0 2024-04-25T13:47:02.437 INFO:tasks.workunit.client.0.smithi043.stdout:0/292: dwrite db/d1b/d23/d27/d39/d4b/f55 [0,4194304] 0 2024-04-25T13:47:02.438 INFO:tasks.workunit.client.0.smithi043.stdout:2/263: write d0/d34/d17/f41 [502727,51593] 0 2024-04-25T13:47:02.440 INFO:tasks.workunit.client.0.smithi043.stdout:6/312: write d0/f4 [2694783,96163] 0 2024-04-25T13:47:02.442 INFO:tasks.workunit.client.0.smithi043.stdout:9/282: rename d0/d1d/dc/f2a to d0/d1d/dc/d26/f6d 0 2024-04-25T13:47:02.443 INFO:tasks.workunit.client.0.smithi043.stdout:7/442: dread d5/f45 [4194304,4194304] 0 2024-04-25T13:47:02.446 INFO:tasks.workunit.client.0.smithi043.stdout:0/293: dread f6 [0,4194304] 0 2024-04-25T13:47:02.448 INFO:tasks.workunit.client.0.smithi043.stdout:2/264: symlink d0/d35/l47 0 2024-04-25T13:47:02.448 INFO:tasks.workunit.client.0.smithi043.stdout:6/313: rmdir d0/d24/d2e/d2f 39 2024-04-25T13:47:02.449 INFO:tasks.workunit.client.0.smithi043.stdout:7/443: stat d5/d11/d3b/d3f/d5a/f88 0 2024-04-25T13:47:02.449 INFO:tasks.workunit.client.0.smithi043.stdout:5/283: truncate d1/d3/d26/f2a 1016057 0 2024-04-25T13:47:02.449 INFO:tasks.workunit.client.0.smithi043.stdout:0/294: write db/d1b/f22 [3213355,53623] 0 2024-04-25T13:47:02.451 INFO:tasks.workunit.client.0.smithi043.stdout:7/444: fsync d5/f2e 0 2024-04-25T13:47:02.452 INFO:tasks.workunit.client.0.smithi043.stdout:1/311: dread df/d10/f12 [0,4194304] 0 2024-04-25T13:47:02.453 INFO:tasks.workunit.client.0.smithi043.stdout:9/283: creat d0/d1d/dc/d26/d39/f6e x:0 0 0 2024-04-25T13:47:02.453 INFO:tasks.workunit.client.0.smithi043.stdout:2/265: dread - d0/d26/f31 zero size 2024-04-25T13:47:02.457 INFO:tasks.workunit.client.0.smithi043.stdout:2/266: stat d0/d34/f1d 0 2024-04-25T13:47:02.462 INFO:tasks.workunit.client.0.smithi043.stdout:0/295: dread f6 [0,4194304] 0 2024-04-25T13:47:02.463 INFO:tasks.workunit.client.0.smithi043.stdout:1/312: write df/d31/f60 [4981462,14204] 0 2024-04-25T13:47:02.465 INFO:tasks.workunit.client.0.smithi043.stdout:7/445: dwrite d5/f82 [0,4194304] 0 2024-04-25T13:47:02.472 INFO:tasks.workunit.client.0.smithi043.stdout:7/446: symlink d5/d11/d3b/d8b/l97 0 2024-04-25T13:47:02.474 INFO:tasks.workunit.client.0.smithi043.stdout:5/284: dread d1/d3/d26/f2a [0,4194304] 0 2024-04-25T13:47:02.474 INFO:tasks.workunit.client.0.smithi043.stdout:9/284: truncate d0/d1d/d7/f66 2083338 0 2024-04-25T13:47:02.480 INFO:tasks.workunit.client.0.smithi043.stdout:2/267: dwrite d0/d5/d1e/f2c [0,4194304] 0 2024-04-25T13:47:02.481 INFO:tasks.workunit.client.0.smithi043.stdout:9/285: chown d0/d1d/d7/f5a 545662 1 2024-04-25T13:47:02.484 INFO:tasks.workunit.client.0.smithi043.stdout:6/314: dwrite d0/d24/d2e/d2f/d41/d48/d4d/f53 [0,4194304] 0 2024-04-25T13:47:02.484 INFO:tasks.workunit.client.0.smithi043.stdout:5/285: dread - d1/d3/d7/d8/df/d28/f48 zero size 2024-04-25T13:47:02.486 INFO:tasks.workunit.client.0.smithi043.stdout:9/286: fdatasync d0/d1d/d7/f16 0 2024-04-25T13:47:02.488 INFO:tasks.workunit.client.0.smithi043.stdout:6/315: chown d0/fb 1 1 2024-04-25T13:47:02.490 INFO:tasks.workunit.client.0.smithi043.stdout:1/313: dwrite df/d31/d38/d43/f57 [0,4194304] 0 2024-04-25T13:47:02.494 INFO:tasks.workunit.client.0.smithi043.stdout:3/301: rename d0/d9/d15/c3c to d0/da/c69 0 2024-04-25T13:47:02.502 INFO:tasks.workunit.client.0.smithi043.stdout:0/296: dread db/f2d [0,4194304] 0 2024-04-25T13:47:02.502 INFO:tasks.workunit.client.0.smithi043.stdout:7/447: dwrite d5/d11/f31 [4194304,4194304] 0 2024-04-25T13:47:02.504 INFO:tasks.workunit.client.0.smithi043.stdout:9/287: link d0/d1d/d4a/f6a d0/d1d/dc/d26/d39/f6f 0 2024-04-25T13:47:02.504 INFO:tasks.workunit.client.0.smithi043.stdout:5/286: dread d1/d3/d7/d2f/d40/f39 [0,4194304] 0 2024-04-25T13:47:02.506 INFO:tasks.workunit.client.0.smithi043.stdout:0/297: stat db/d25/d2a/l3c 0 2024-04-25T13:47:02.508 INFO:tasks.workunit.client.0.smithi043.stdout:2/268: dwrite d0/d5/d1e/f2c [0,4194304] 0 2024-04-25T13:47:02.508 INFO:tasks.workunit.client.0.smithi043.stdout:9/288: fdatasync d0/d1d/dc/f18 0 2024-04-25T13:47:02.509 INFO:tasks.workunit.client.0.smithi043.stdout:7/448: fdatasync d5/d11/d3b/d3f/d5a/d89/f95 0 2024-04-25T13:47:02.509 INFO:tasks.workunit.client.0.smithi043.stdout:1/314: rename df/d14/d2a/d46 to df/d14/d63 0 2024-04-25T13:47:02.513 INFO:tasks.workunit.client.0.smithi043.stdout:5/287: write d1/d3/d24/f41 [119593,77991] 0 2024-04-25T13:47:02.513 INFO:tasks.workunit.client.0.smithi043.stdout:3/302: write d0/d9/f44 [566381,75651] 0 2024-04-25T13:47:02.514 INFO:tasks.workunit.client.0.smithi043.stdout:0/298: read db/d1b/f22 [2513320,104700] 0 2024-04-25T13:47:02.515 INFO:tasks.workunit.client.0.smithi043.stdout:9/289: readlink d0/d1d/d7/l1c 0 2024-04-25T13:47:02.520 INFO:tasks.workunit.client.0.smithi043.stdout:3/303: write d0/d14/f3e [3854867,126042] 0 2024-04-25T13:47:02.521 INFO:tasks.workunit.client.0.smithi043.stdout:1/315: mknod df/d14/c64 0 2024-04-25T13:47:02.521 INFO:tasks.workunit.client.0.smithi043.stdout:3/304: chown d0/d13/c64 5148 1 2024-04-25T13:47:02.525 INFO:tasks.workunit.client.0.smithi043.stdout:1/316: creat df/d31/d38/d43/f65 x:0 0 0 2024-04-25T13:47:02.525 INFO:tasks.workunit.client.0.smithi043.stdout:6/316: dread d0/fc [0,4194304] 0 2024-04-25T13:47:02.526 INFO:tasks.workunit.client.0.smithi043.stdout:5/288: mknod d1/d4/c60 0 2024-04-25T13:47:02.527 INFO:tasks.workunit.client.0.smithi043.stdout:7/449: link d5/l1a d5/d75/d79/l98 0 2024-04-25T13:47:02.529 INFO:tasks.workunit.client.0.smithi043.stdout:6/317: creat d0/d3d/f62 x:0 0 0 2024-04-25T13:47:02.529 INFO:tasks.workunit.client.0.smithi043.stdout:7/450: stat d5/d11/d3b/d3f/d5a/d89/f95 0 2024-04-25T13:47:02.532 INFO:tasks.workunit.client.0.smithi043.stdout:0/299: getdents db/d1b/d36/d41 0 2024-04-25T13:47:02.534 INFO:tasks.workunit.client.0.smithi043.stdout:2/269: dwrite d0/d5/d1e/f39 [0,4194304] 0 2024-04-25T13:47:02.534 INFO:tasks.workunit.client.0.smithi043.stdout:4/277: sync 2024-04-25T13:47:02.535 INFO:tasks.workunit.client.0.smithi043.stdout:9/290: getdents d0/d1d/dc/d26/d39 0 2024-04-25T13:47:02.537 INFO:tasks.workunit.client.0.smithi043.stdout:1/317: getdents df/d10/d22 0 2024-04-25T13:47:02.538 INFO:tasks.workunit.client.0.smithi043.stdout:6/318: dread d0/d1c/f3b [0,4194304] 0 2024-04-25T13:47:02.539 INFO:tasks.workunit.client.0.smithi043.stdout:5/289: creat d1/d3/d7/f61 x:0 0 0 2024-04-25T13:47:02.539 INFO:tasks.workunit.client.0.smithi043.stdout:3/305: truncate d0/f33 2069103 0 2024-04-25T13:47:02.539 INFO:tasks.workunit.client.0.smithi043.stdout:1/318: fdatasync df/d10/d22/f58 0 2024-04-25T13:47:02.540 INFO:tasks.workunit.client.0.smithi043.stdout:0/300: readlink db/ld 0 2024-04-25T13:47:02.541 INFO:tasks.workunit.client.0.smithi043.stdout:2/270: creat d0/d35/f48 x:0 0 0 2024-04-25T13:47:02.544 INFO:tasks.workunit.client.0.smithi043.stdout:5/290: write d1/d3/d7/f4f [293581,107616] 0 2024-04-25T13:47:02.545 INFO:tasks.workunit.client.0.smithi043.stdout:1/319: mknod df/d31/c66 0 2024-04-25T13:47:02.547 INFO:tasks.workunit.client.0.smithi043.stdout:7/451: dwrite d5/d11/d3b/d61/f7c [0,4194304] 0 2024-04-25T13:47:02.548 INFO:tasks.workunit.client.0.smithi043.stdout:6/319: unlink d0/d1b/l33 0 2024-04-25T13:47:02.552 INFO:tasks.workunit.client.0.smithi043.stdout:2/271: symlink d0/d34/d3f/l49 0 2024-04-25T13:47:02.556 INFO:tasks.workunit.client.0.smithi043.stdout:1/320: fsync df/d14/f1c 0 2024-04-25T13:47:02.557 INFO:tasks.workunit.client.0.smithi043.stdout:5/291: write d1/d3/d7/f4f [312630,83296] 0 2024-04-25T13:47:02.563 INFO:tasks.workunit.client.0.smithi043.stdout:2/272: write d0/d5/d2f/f45 [12398,50694] 0 2024-04-25T13:47:02.563 INFO:tasks.workunit.client.0.smithi043.stdout:6/320: creat d0/d1c/f63 x:0 0 0 2024-04-25T13:47:02.565 INFO:tasks.workunit.client.0.smithi043.stdout:4/278: dwrite d1/de/d1d/d20/f52 [0,4194304] 0 2024-04-25T13:47:02.573 INFO:tasks.workunit.client.0.smithi043.stdout:6/321: fdatasync d0/fc 0 2024-04-25T13:47:02.574 INFO:tasks.workunit.client.0.smithi043.stdout:0/301: dwrite db/d1b/f47 [0,4194304] 0 2024-04-25T13:47:02.574 INFO:tasks.workunit.client.0.smithi043.stdout:3/306: dwrite d0/d9/f20 [4194304,4194304] 0 2024-04-25T13:47:02.576 INFO:tasks.workunit.client.0.smithi043.stdout:8/381: sync 2024-04-25T13:47:02.576 INFO:tasks.workunit.client.0.smithi043.stdout:1/321: truncate df/d14/f1c 3903020 0 2024-04-25T13:47:02.577 INFO:tasks.workunit.client.0.smithi043.stdout:5/292: write d1/d3/d7/d8/df/d28/f48 [627373,118896] 0 2024-04-25T13:47:02.578 INFO:tasks.workunit.client.0.smithi043.stdout:9/291: dwrite d0/d1d/dc/d26/d39/f6f [0,4194304] 0 2024-04-25T13:47:02.581 INFO:tasks.workunit.client.0.smithi043.stdout:3/307: chown d0/d14/f22 7730 1 2024-04-25T13:47:02.581 INFO:tasks.workunit.client.0.smithi043.stdout:4/279: chown d1/de/df/d1e/d28/d33 228993 1 2024-04-25T13:47:02.582 INFO:tasks.workunit.client.0.smithi043.stdout:0/302: read db/d1b/f47 [2405743,36694] 0 2024-04-25T13:47:02.583 INFO:tasks.workunit.client.0.smithi043.stdout:1/322: mkdir df/d14/d63/d67 0 2024-04-25T13:47:02.583 INFO:tasks.workunit.client.0.smithi043.stdout:2/273: creat d0/d26/f4a x:0 0 0 2024-04-25T13:47:02.585 INFO:tasks.workunit.client.0.smithi043.stdout:5/293: write d1/f56 [330828,41895] 0 2024-04-25T13:47:02.586 INFO:tasks.workunit.client.0.smithi043.stdout:8/382: fdatasync db/dc/d21/f39 0 2024-04-25T13:47:02.586 INFO:tasks.workunit.client.0.smithi043.stdout:7/452: dwrite d5/d6b/f71 [0,4194304] 0 2024-04-25T13:47:02.587 INFO:tasks.workunit.client.0.smithi043.stdout:6/322: mkdir d0/d24/d2e/d2f/d64 0 2024-04-25T13:47:02.587 INFO:tasks.workunit.client.0.smithi043.stdout:3/308: fdatasync d0/f4 0 2024-04-25T13:47:02.588 INFO:tasks.workunit.client.0.smithi043.stdout:1/323: chown df/d31/d34 60 1 2024-04-25T13:47:02.588 INFO:tasks.workunit.client.0.smithi043.stdout:2/274: chown d0/c16 191 1 2024-04-25T13:47:02.589 INFO:tasks.workunit.client.0.smithi043.stdout:4/280: chown d1/de/df/d1e/l22 1177 1 2024-04-25T13:47:02.593 INFO:tasks.workunit.client.0.smithi043.stdout:7/453: stat d5/d11/d8f 0 2024-04-25T13:47:02.594 INFO:tasks.workunit.client.0.smithi043.stdout:9/292: creat d0/d1d/dc/d26/d47/d4d/f70 x:0 0 0 2024-04-25T13:47:02.594 INFO:tasks.workunit.client.0.smithi043.stdout:2/275: chown d0/d26/f40 55903 1 2024-04-25T13:47:02.595 INFO:tasks.workunit.client.0.smithi043.stdout:8/383: fdatasync db/d11/f20 0 2024-04-25T13:47:02.598 INFO:tasks.workunit.client.0.smithi043.stdout:7/454: write d5/f72 [878411,78014] 0 2024-04-25T13:47:02.599 INFO:tasks.workunit.client.0.smithi043.stdout:5/294: mkdir d1/d3/d62 0 2024-04-25T13:47:02.600 INFO:tasks.workunit.client.0.smithi043.stdout:1/324: symlink df/d31/d38/d43/d53/l68 0 2024-04-25T13:47:02.600 INFO:tasks.workunit.client.0.smithi043.stdout:3/309: chown d0/da/f2d 14191 1 2024-04-25T13:47:02.603 INFO:tasks.workunit.client.0.smithi043.stdout:3/310: write d0/f2a [8294915,81696] 0 2024-04-25T13:47:02.605 INFO:tasks.workunit.client.0.smithi043.stdout:1/325: symlink df/d31/d38/d43/d53/l69 0 2024-04-25T13:47:02.606 INFO:tasks.workunit.client.0.smithi043.stdout:2/276: dread d0/d34/f1d [0,4194304] 0 2024-04-25T13:47:02.609 INFO:tasks.workunit.client.0.smithi043.stdout:4/281: creat d1/de/d1d/d20/f5b x:0 0 0 2024-04-25T13:47:02.610 INFO:tasks.workunit.client.0.smithi043.stdout:6/323: dwrite d0/d24/d2e/d2f/d41/d48/d4d/f53 [0,4194304] 0 2024-04-25T13:47:02.610 INFO:tasks.workunit.client.0.smithi043.stdout:3/311: chown d0/fe 11129 1 2024-04-25T13:47:02.610 INFO:tasks.workunit.client.0.smithi043.stdout:9/293: creat d0/d1d/d22/d67/f71 x:0 0 0 2024-04-25T13:47:02.610 INFO:tasks.workunit.client.0.smithi043.stdout:1/326: fsync df/d10/d22/f2e 0 2024-04-25T13:47:02.611 INFO:tasks.workunit.client.0.smithi043.stdout:3/312: stat d0/d13/d2e 0 2024-04-25T13:47:02.611 INFO:tasks.workunit.client.0.smithi043.stdout:8/384: mkdir db/dc/d80 0 2024-04-25T13:47:02.613 INFO:tasks.workunit.client.0.smithi043.stdout:7/455: symlink d5/d11/d3b/l99 0 2024-04-25T13:47:02.615 INFO:tasks.workunit.client.0.smithi043.stdout:0/303: getdents db/d1b/d23 0 2024-04-25T13:47:02.618 INFO:tasks.workunit.client.0.smithi043.stdout:5/295: mknod d1/d3/d7/d8/da/d11/d52/c63 0 2024-04-25T13:47:02.618 INFO:tasks.workunit.client.0.smithi043.stdout:7/456: fdatasync d5/d11/f14 0 2024-04-25T13:47:02.620 INFO:tasks.workunit.client.0.smithi043.stdout:2/277: mkdir d0/d4b 0 2024-04-25T13:47:02.621 INFO:tasks.workunit.client.0.smithi043.stdout:7/457: fsync d5/d11/f31 0 2024-04-25T13:47:02.622 INFO:tasks.workunit.client.0.smithi043.stdout:5/296: fsync d1/d3/d24/f41 0 2024-04-25T13:47:02.622 INFO:tasks.workunit.client.0.smithi043.stdout:9/294: mknod d0/d1d/dc/d26/d47/d4d/c72 0 2024-04-25T13:47:02.624 INFO:tasks.workunit.client.0.smithi043.stdout:8/385: mkdir db/d11/d79/d81 0 2024-04-25T13:47:02.625 INFO:tasks.workunit.client.0.smithi043.stdout:6/324: dwrite d0/d24/f5b [0,4194304] 0 2024-04-25T13:47:02.625 INFO:tasks.workunit.client.0.smithi043.stdout:0/304: creat db/d1b/d36/f64 x:0 0 0 2024-04-25T13:47:02.626 INFO:tasks.workunit.client.0.smithi043.stdout:1/327: dwrite df/d31/f48 [0,4194304] 0 2024-04-25T13:47:02.631 INFO:tasks.workunit.client.0.smithi043.stdout:9/295: write d0/d1d/dc/d26/d39/f6f [4474479,43400] 0 2024-04-25T13:47:02.632 INFO:tasks.workunit.client.0.smithi043.stdout:4/282: creat d1/de/d1d/f5c x:0 0 0 2024-04-25T13:47:02.632 INFO:tasks.workunit.client.0.smithi043.stdout:0/305: dread - db/d1b/d23/d27/f5a zero size 2024-04-25T13:47:02.634 INFO:tasks.workunit.client.0.smithi043.stdout:5/297: dread d1/f56 [0,4194304] 0 2024-04-25T13:47:02.634 INFO:tasks.workunit.client.0.smithi043.stdout:1/328: symlink df/d31/d38/l6a 0 2024-04-25T13:47:02.635 INFO:tasks.workunit.client.0.smithi043.stdout:3/313: creat d0/d9/d15/d38/f6a x:0 0 0 2024-04-25T13:47:02.638 INFO:tasks.workunit.client.0.smithi043.stdout:6/325: fdatasync d0/d24/d2e/f34 0 2024-04-25T13:47:02.639 INFO:tasks.workunit.client.0.smithi043.stdout:6/326: readlink d0/d24/l2d 0 2024-04-25T13:47:02.641 INFO:tasks.workunit.client.0.smithi043.stdout:6/327: readlink d0/l39 0 2024-04-25T13:47:02.641 INFO:tasks.workunit.client.0.smithi043.stdout:4/283: truncate d1/d3/f4b 976104 0 2024-04-25T13:47:02.642 INFO:tasks.workunit.client.0.smithi043.stdout:1/329: rmdir df/d14/d2a 39 2024-04-25T13:47:02.643 INFO:tasks.workunit.client.0.smithi043.stdout:0/306: mknod db/d25/d2a/c65 0 2024-04-25T13:47:02.644 INFO:tasks.workunit.client.0.smithi043.stdout:6/328: chown d0/f59 109 1 2024-04-25T13:47:02.647 INFO:tasks.workunit.client.0.smithi043.stdout:1/330: rmdir df/d31/d38/d43 39 2024-04-25T13:47:02.648 INFO:tasks.workunit.client.0.smithi043.stdout:0/307: mknod db/d5b/c66 0 2024-04-25T13:47:02.651 INFO:tasks.workunit.client.0.smithi043.stdout:7/458: getdents d5/d11/d3b/d3f 0 2024-04-25T13:47:02.652 INFO:tasks.workunit.client.0.smithi043.stdout:3/314: dwrite d0/d13/d2e/f31 [0,4194304] 0 2024-04-25T13:47:02.660 INFO:tasks.workunit.client.0.smithi043.stdout:4/284: write d1/de/df/f40 [1835808,59255] 0 2024-04-25T13:47:02.662 INFO:tasks.workunit.client.0.smithi043.stdout:6/329: getdents d0/d3d 0 2024-04-25T13:47:02.662 INFO:tasks.workunit.client.0.smithi043.stdout:3/315: mknod d0/d9/c6b 0 2024-04-25T13:47:02.663 INFO:tasks.workunit.client.0.smithi043.stdout:9/296: dwrite d0/d1d/dc/f23 [4194304,4194304] 0 2024-04-25T13:47:02.665 INFO:tasks.workunit.client.0.smithi043.stdout:5/298: dwrite d1/d3/d7/d8/da/d11/d52/f59 [0,4194304] 0 2024-04-25T13:47:02.669 INFO:tasks.workunit.client.0.smithi043.stdout:7/459: creat d5/d11/d3b/d8b/d93/f9a x:0 0 0 2024-04-25T13:47:02.672 INFO:tasks.workunit.client.0.smithi043.stdout:9/297: chown d0/d1d/dc/d26/d39/d46/f5e 0 1 2024-04-25T13:47:02.675 INFO:tasks.workunit.client.0.smithi043.stdout:1/331: creat df/d14/d2a/f6b x:0 0 0 2024-04-25T13:47:02.677 INFO:tasks.workunit.client.0.smithi043.stdout:3/316: symlink d0/d9/d15/d38/d3f/l6c 0 2024-04-25T13:47:02.679 INFO:tasks.workunit.client.0.smithi043.stdout:7/460: mkdir d5/d11/d3b/d8b/d9b 0 2024-04-25T13:47:02.682 INFO:tasks.workunit.client.0.smithi043.stdout:8/386: rename db/dc/d21/d4e/d62/f69 to db/d38/f82 0 2024-04-25T13:47:02.682 INFO:tasks.workunit.client.0.smithi043.stdout:4/285: dwrite d1/de/f1c [0,4194304] 0 2024-04-25T13:47:02.685 INFO:tasks.workunit.client.0.smithi043.stdout:3/317: dread - d0/d9/d15/d38/d3f/f42 zero size 2024-04-25T13:47:02.689 INFO:tasks.workunit.client.0.smithi043.stdout:6/330: dwrite d0/d1c/f56 [0,4194304] 0 2024-04-25T13:47:02.689 INFO:tasks.workunit.client.0.smithi043.stdout:9/298: rename d0/d1d/dc/d26/l69 to d0/d1d/d7/d41/l73 0 2024-04-25T13:47:02.689 INFO:tasks.workunit.client.0.smithi043.stdout:0/308: dread f8 [0,4194304] 0 2024-04-25T13:47:02.689 INFO:tasks.workunit.client.0.smithi043.stdout:7/461: write d5/d11/d3b/d61/d68/f77 [97885,86953] 0 2024-04-25T13:47:02.689 INFO:tasks.workunit.client.0.smithi043.stdout:5/299: dread d1/d3/d7/f4f [0,4194304] 0 2024-04-25T13:47:02.690 INFO:tasks.workunit.client.0.smithi043.stdout:1/332: dread df/d14/f56 [0,4194304] 0 2024-04-25T13:47:02.694 INFO:tasks.workunit.client.0.smithi043.stdout:6/331: stat d0/d24 0 2024-04-25T13:47:02.698 INFO:tasks.workunit.client.0.smithi043.stdout:2/278: dread d0/d26/f33 [0,4194304] 0 2024-04-25T13:47:02.702 INFO:tasks.workunit.client.0.smithi043.stdout:9/299: mknod d0/d1d/d7/d41/c74 0 2024-04-25T13:47:02.702 INFO:tasks.workunit.client.0.smithi043.stdout:5/300: mknod d1/d3/c64 0 2024-04-25T13:47:02.704 INFO:tasks.workunit.client.0.smithi043.stdout:1/333: rmdir df/d31/d38/d43 39 2024-04-25T13:47:02.705 INFO:tasks.workunit.client.0.smithi043.stdout:4/286: rename d1/de/d1d/f2c to d1/de/df/d1e/d28/d33/f5d 0 2024-04-25T13:47:02.707 INFO:tasks.workunit.client.0.smithi043.stdout:7/462: symlink d5/d11/d3b/d3f/d5a/l9c 0 2024-04-25T13:47:02.710 INFO:tasks.workunit.client.0.smithi043.stdout:0/309: dwrite db/d1b/d36/f61 [0,4194304] 0 2024-04-25T13:47:02.712 INFO:tasks.workunit.client.0.smithi043.stdout:1/334: creat df/d31/d34/f6c x:0 0 0 2024-04-25T13:47:02.719 INFO:tasks.workunit.client.0.smithi043.stdout:6/332: truncate d0/f31 3435577 0 2024-04-25T13:47:02.722 INFO:tasks.workunit.client.0.smithi043.stdout:8/387: dwrite db/d11/f17 [0,4194304] 0 2024-04-25T13:47:02.723 INFO:tasks.workunit.client.0.smithi043.stdout:4/287: dread d1/d3/f3e [0,4194304] 0 2024-04-25T13:47:02.725 INFO:tasks.workunit.client.0.smithi043.stdout:8/388: chown db/d11/f17 47 1 2024-04-25T13:47:02.728 INFO:tasks.workunit.client.0.smithi043.stdout:3/318: dwrite d0/d9/d15/d34/d36/f4e [0,4194304] 0 2024-04-25T13:47:02.729 INFO:tasks.workunit.client.0.smithi043.stdout:0/310: symlink db/d1b/d4f/l67 0 2024-04-25T13:47:02.732 INFO:tasks.workunit.client.0.smithi043.stdout:1/335: mknod df/d31/d38/d43/d53/c6d 0 2024-04-25T13:47:02.733 INFO:tasks.workunit.client.0.smithi043.stdout:9/300: dwrite d0/d1d/d22/f63 [0,4194304] 0 2024-04-25T13:47:02.736 INFO:tasks.workunit.client.0.smithi043.stdout:3/319: chown d0/d9/d15/d34/d36/f4e 846219 1 2024-04-25T13:47:02.739 INFO:tasks.workunit.client.0.smithi043.stdout:6/333: chown d0/d24/d2e/d2f/d41/d4c/c52 5 1 2024-04-25T13:47:02.739 INFO:tasks.workunit.client.0.smithi043.stdout:7/463: dwrite d5/d75/f66 [0,4194304] 0 2024-04-25T13:47:02.740 INFO:tasks.workunit.client.0.smithi043.stdout:1/336: mkdir df/d31/d38/d43/d6e 0 2024-04-25T13:47:02.742 INFO:tasks.workunit.client.0.smithi043.stdout:6/334: write d0/ff [7077643,47774] 0 2024-04-25T13:47:02.747 INFO:tasks.workunit.client.0.smithi043.stdout:1/337: creat df/d10/d22/d2f/f6f x:0 0 0 2024-04-25T13:47:02.750 INFO:tasks.workunit.client.0.smithi043.stdout:4/288: dread d1/de/d1d/d20/d38/d3a/f48 [0,4194304] 0 2024-04-25T13:47:02.751 INFO:tasks.workunit.client.0.smithi043.stdout:0/311: fsync db/d1b/f22 0 2024-04-25T13:47:02.752 INFO:tasks.workunit.client.0.smithi043.stdout:1/338: creat df/d31/d38/d43/d53/f70 x:0 0 0 2024-04-25T13:47:02.755 INFO:tasks.workunit.client.0.smithi043.stdout:3/320: chown d0/da/l1b 103 1 2024-04-25T13:47:02.755 INFO:tasks.workunit.client.0.smithi043.stdout:1/339: mkdir df/d14/d63/d71 0 2024-04-25T13:47:02.756 INFO:tasks.workunit.client.0.smithi043.stdout:9/301: creat d0/d1d/dc/d26/d39/d46/f75 x:0 0 0 2024-04-25T13:47:02.756 INFO:tasks.workunit.client.0.smithi043.stdout:3/321: symlink d0/d13/l6d 0 2024-04-25T13:47:02.759 INFO:tasks.workunit.client.0.smithi043.stdout:1/340: symlink df/d31/d38/d3f/d41/l72 0 2024-04-25T13:47:02.763 INFO:tasks.workunit.client.0.smithi043.stdout:1/341: dread df/d31/d38/d3f/f42 [0,4194304] 0 2024-04-25T13:47:02.764 INFO:tasks.workunit.client.0.smithi043.stdout:6/335: mknod d0/d3d/d54/c65 0 2024-04-25T13:47:02.765 INFO:tasks.workunit.client.0.smithi043.stdout:8/389: dread db/d11/f15 [0,4194304] 0 2024-04-25T13:47:02.767 INFO:tasks.workunit.client.0.smithi043.stdout:1/342: creat df/d31/d38/d3f/f73 x:0 0 0 2024-04-25T13:47:02.773 INFO:tasks.workunit.client.0.smithi043.stdout:1/343: dwrite df/d31/d38/d3f/f73 [0,4194304] 0 2024-04-25T13:47:02.780 INFO:tasks.workunit.client.0.smithi043.stdout:1/344: dread df/d10/d22/f2e [0,4194304] 0 2024-04-25T13:47:02.783 INFO:tasks.workunit.client.0.smithi043.stdout:0/312: mkdir db/d5b/d68 0 2024-04-25T13:47:02.784 INFO:tasks.workunit.client.0.smithi043.stdout:0/313: write db/d25/f46 [896095,34392] 0 2024-04-25T13:47:02.786 INFO:tasks.workunit.client.0.smithi043.stdout:0/314: truncate db/d1b/d23/d27/f5a 23300 0 2024-04-25T13:47:02.787 INFO:tasks.workunit.client.0.smithi043.stdout:1/345: write df/d10/d22/f2e [888056,46511] 0 2024-04-25T13:47:02.792 INFO:tasks.workunit.client.0.smithi043.stdout:6/336: chown d0/f29 514 1 2024-04-25T13:47:02.793 INFO:tasks.workunit.client.0.smithi043.stdout:6/337: fsync d0/d3d/f5a 0 2024-04-25T13:47:02.794 INFO:tasks.workunit.client.0.smithi043.stdout:8/390: fdatasync f4 0 2024-04-25T13:47:02.794 INFO:tasks.workunit.client.0.smithi043.stdout:6/338: chown d0/l9 3222 1 2024-04-25T13:47:02.795 INFO:tasks.workunit.client.0.smithi043.stdout:2/279: rename d0/d34/d3f/l49 to d0/l4c 0 2024-04-25T13:47:02.795 INFO:tasks.workunit.client.0.smithi043.stdout:1/346: dwrite df/d10/d22/f5f [0,4194304] 0 2024-04-25T13:47:02.799 INFO:tasks.workunit.client.0.smithi043.stdout:1/347: creat df/d31/d38/d3f/d41/f74 x:0 0 0 2024-04-25T13:47:02.800 INFO:tasks.workunit.client.0.smithi043.stdout:1/348: read - df/d31/d38/f3b zero size 2024-04-25T13:47:02.800 INFO:tasks.workunit.client.0.smithi043.stdout:9/302: link d0/d1d/d22/d67/f71 d0/d1d/d7/d41/f76 0 2024-04-25T13:47:02.801 INFO:tasks.workunit.client.0.smithi043.stdout:9/303: stat d0/d1d/d22/f27 0 2024-04-25T13:47:02.802 INFO:tasks.workunit.client.0.smithi043.stdout:1/349: creat df/d14/d63/d67/f75 x:0 0 0 2024-04-25T13:47:02.803 INFO:tasks.workunit.client.0.smithi043.stdout:0/315: creat db/d25/f69 x:0 0 0 2024-04-25T13:47:02.804 INFO:tasks.workunit.client.0.smithi043.stdout:0/316: dread - db/d1b/d23/f31 zero size 2024-04-25T13:47:02.804 INFO:tasks.workunit.client.0.smithi043.stdout:1/350: creat df/d10/f76 x:0 0 0 2024-04-25T13:47:02.807 INFO:tasks.workunit.client.0.smithi043.stdout:7/464: creat d5/d32/f9d x:0 0 0 2024-04-25T13:47:02.813 INFO:tasks.workunit.client.0.smithi043.stdout:1/351: dwrite df/d10/f12 [0,4194304] 0 2024-04-25T13:47:02.816 INFO:tasks.workunit.client.0.smithi043.stdout:1/352: symlink df/d31/d34/l77 0 2024-04-25T13:47:02.818 INFO:tasks.workunit.client.0.smithi043.stdout:1/353: rmdir df/d14/d63 39 2024-04-25T13:47:02.818 INFO:tasks.workunit.client.0.smithi043.stdout:8/391: dwrite db/d11/f20 [0,4194304] 0 2024-04-25T13:47:02.820 INFO:tasks.workunit.client.0.smithi043.stdout:1/354: rename df to df/d31/d38/d3f/d78 22 2024-04-25T13:47:02.823 INFO:tasks.workunit.client.0.smithi043.stdout:6/339: dwrite d0/d1b/f1d [0,4194304] 0 2024-04-25T13:47:02.826 INFO:tasks.workunit.client.0.smithi043.stdout:1/355: rename df/d31/d34/f49 to df/d31/f79 0 2024-04-25T13:47:02.827 INFO:tasks.workunit.client.0.smithi043.stdout:9/304: mkdir d0/d77 0 2024-04-25T13:47:02.827 INFO:tasks.workunit.client.0.smithi043.stdout:9/305: dread - d0/d1d/d22/f27 zero size 2024-04-25T13:47:02.830 INFO:tasks.workunit.client.0.smithi043.stdout:1/356: unlink df/d10/d22/f2e 0 2024-04-25T13:47:02.834 INFO:tasks.workunit.client.0.smithi043.stdout:2/280: creat d0/d26/f4d x:0 0 0 2024-04-25T13:47:02.836 INFO:tasks.workunit.client.0.smithi043.stdout:6/340: symlink d0/d24/d2e/d2f/d41/d48/l66 0 2024-04-25T13:47:02.839 INFO:tasks.workunit.client.0.smithi043.stdout:4/289: rmdir d1/de/df/d1a 39 2024-04-25T13:47:02.841 INFO:tasks.workunit.client.0.smithi043.stdout:1/357: dwrite df/d14/d2a/d39/f4e [0,4194304] 0 2024-04-25T13:47:02.843 INFO:tasks.workunit.client.0.smithi043.stdout:2/281: truncate d0/d8/fa 2915853 0 2024-04-25T13:47:02.848 INFO:tasks.workunit.client.0.smithi043.stdout:8/392: fsync db/d38/f7f 0 2024-04-25T13:47:02.848 INFO:tasks.workunit.client.0.smithi043.stdout:0/317: rmdir db/d25 39 2024-04-25T13:47:02.849 INFO:tasks.workunit.client.0.smithi043.stdout:6/341: dwrite d0/f40 [0,4194304] 0 2024-04-25T13:47:02.857 INFO:tasks.workunit.client.0.smithi043.stdout:7/465: getdents d5/d11/d3b/d3f/d5a 0 2024-04-25T13:47:02.865 INFO:tasks.workunit.client.0.smithi043.stdout:6/342: readlink d0/d1c/l4f 0 2024-04-25T13:47:02.872 INFO:tasks.workunit.client.0.smithi043.stdout:7/466: rename d5/f1e to d5/d11/d3b/d8b/f9e 0 2024-04-25T13:47:02.874 INFO:tasks.workunit.client.0.smithi043.stdout:4/290: dread - d1/de/d1d/d20/d38/d3a/f4d zero size 2024-04-25T13:47:02.876 INFO:tasks.workunit.client.0.smithi043.stdout:8/393: creat db/d11/d79/d81/f83 x:0 0 0 2024-04-25T13:47:02.876 INFO:tasks.workunit.client.0.smithi043.stdout:1/358: dread df/d31/f60 [0,4194304] 0 2024-04-25T13:47:02.877 INFO:tasks.workunit.client.0.smithi043.stdout:2/282: write d0/d8/fa [1704884,69364] 0 2024-04-25T13:47:02.878 INFO:tasks.workunit.client.0.smithi043.stdout:6/343: mknod d0/d24/d2e/d2f/d41/d48/c67 0 2024-04-25T13:47:02.880 INFO:tasks.workunit.client.0.smithi043.stdout:3/322: rename d0/d9/d15 to d0/d9/d6e 0 2024-04-25T13:47:02.885 INFO:tasks.workunit.client.0.smithi043.stdout:3/323: write d0/d14/f4b [308756,30272] 0 2024-04-25T13:47:02.890 INFO:tasks.workunit.client.0.smithi043.stdout:8/394: dwrite db/dc/d21/f2e [0,4194304] 0 2024-04-25T13:47:02.892 INFO:tasks.workunit.client.0.smithi043.stdout:2/283: dwrite d0/d8/fa [0,4194304] 0 2024-04-25T13:47:02.895 INFO:tasks.workunit.client.0.smithi043.stdout:7/467: link d5/d11/d3b/l99 d5/d6b/l9f 0 2024-04-25T13:47:02.899 INFO:tasks.workunit.client.0.smithi043.stdout:6/344: dwrite d0/d24/d2e/d2f/d41/d4c/f61 [0,4194304] 0 2024-04-25T13:47:02.899 INFO:tasks.workunit.client.0.smithi043.stdout:2/284: truncate d0/d26/f4a 791276 0 2024-04-25T13:47:02.899 INFO:tasks.workunit.client.0.smithi043.stdout:0/318: dwrite db/d1b/d4f/f63 [0,4194304] 0 2024-04-25T13:47:02.899 INFO:tasks.workunit.client.0.smithi043.stdout:1/359: mknod df/d14/d3d/c7a 0 2024-04-25T13:47:02.900 INFO:tasks.workunit.client.0.smithi043.stdout:3/324: truncate d0/f2 1212571 0 2024-04-25T13:47:02.901 INFO:tasks.workunit.client.0.smithi043.stdout:4/291: truncate d1/de/df/d1a/d27/f51 2492180 0 2024-04-25T13:47:02.903 INFO:tasks.workunit.client.0.smithi043.stdout:3/325: readlink d0/d14/l24 0 2024-04-25T13:47:02.904 INFO:tasks.workunit.client.0.smithi043.stdout:7/468: read d5/f2d [591755,51666] 0 2024-04-25T13:47:02.905 INFO:tasks.workunit.client.0.smithi043.stdout:2/285: mkdir d0/d34/d3f/d4e 0 2024-04-25T13:47:02.910 INFO:tasks.workunit.client.0.smithi043.stdout:3/326: mknod d0/d13/d5a/c6f 0 2024-04-25T13:47:02.912 INFO:tasks.workunit.client.0.smithi043.stdout:8/395: dwrite db/dc/d21/f6b [0,4194304] 0 2024-04-25T13:47:02.915 INFO:tasks.workunit.client.0.smithi043.stdout:4/292: rename d1/de/df/d1e/d28/f39 to d1/d34/d35/d3d/f5e 0 2024-04-25T13:47:02.915 INFO:tasks.workunit.client.0.smithi043.stdout:2/286: write d0/d34/f37 [678070,81527] 0 2024-04-25T13:47:02.917 INFO:tasks.workunit.client.0.smithi043.stdout:3/327: creat d0/d61/f70 x:0 0 0 2024-04-25T13:47:02.919 INFO:tasks.workunit.client.0.smithi043.stdout:6/345: dwrite d0/d24/d2e/f34 [0,4194304] 0 2024-04-25T13:47:02.920 INFO:tasks.workunit.client.0.smithi043.stdout:6/346: chown d0/f40 14044 1 2024-04-25T13:47:02.920 INFO:tasks.workunit.client.0.smithi043.stdout:1/360: creat df/d14/d2a/f7b x:0 0 0 2024-04-25T13:47:02.921 INFO:tasks.workunit.client.0.smithi043.stdout:1/361: dread - df/d31/d38/f3b zero size 2024-04-25T13:47:02.921 INFO:tasks.workunit.client.0.smithi043.stdout:3/328: symlink d0/d9/d6e/d38/l71 0 2024-04-25T13:47:02.926 INFO:tasks.workunit.client.0.smithi043.stdout:8/396: getdents db/d38 0 2024-04-25T13:47:02.928 INFO:tasks.workunit.client.0.smithi043.stdout:6/347: creat d0/d3d/d54/f68 x:0 0 0 2024-04-25T13:47:02.929 INFO:tasks.workunit.client.0.smithi043.stdout:8/397: dread db/d11/d1b/d1e/f3b [0,4194304] 0 2024-04-25T13:47:02.930 INFO:tasks.workunit.client.0.smithi043.stdout:8/398: fdatasync db/d11/d1b/d1e/f3b 0 2024-04-25T13:47:02.935 INFO:tasks.workunit.client.0.smithi043.stdout:7/469: truncate d5/d11/d3b/f46 2286367 0 2024-04-25T13:47:02.935 INFO:tasks.workunit.client.0.smithi043.stdout:1/362: rmdir df/d14/d63/d67 39 2024-04-25T13:47:02.939 INFO:tasks.workunit.client.0.smithi043.stdout:6/348: creat d0/d24/d2e/d2f/d41/f69 x:0 0 0 2024-04-25T13:47:02.940 INFO:tasks.workunit.client.0.smithi043.stdout:8/399: write db/d11/d1b/f63 [99026,100465] 0 2024-04-25T13:47:02.942 INFO:tasks.workunit.client.0.smithi043.stdout:4/293: write d1/de/df/d1a/f58 [532505,117410] 0 2024-04-25T13:47:02.942 INFO:tasks.workunit.client.0.smithi043.stdout:3/329: creat d0/d9/f72 x:0 0 0 2024-04-25T13:47:02.944 INFO:tasks.workunit.client.0.smithi043.stdout:6/349: read d0/f4 [206192,24309] 0 2024-04-25T13:47:02.948 INFO:tasks.workunit.client.0.smithi043.stdout:2/287: symlink d0/d8/d22/d36/l4f 0 2024-04-25T13:47:02.951 INFO:tasks.workunit.client.0.smithi043.stdout:6/350: mknod d0/d24/d3a/c6a 0 2024-04-25T13:47:02.953 INFO:tasks.workunit.client.0.smithi043.stdout:4/294: getdents d1/d3/d54 0 2024-04-25T13:47:02.953 INFO:tasks.workunit.client.0.smithi043.stdout:0/319: dread db/d1b/f35 [0,4194304] 0 2024-04-25T13:47:02.954 INFO:tasks.workunit.client.0.smithi043.stdout:8/400: dread f4 [4194304,4194304] 0 2024-04-25T13:47:02.956 INFO:tasks.workunit.client.0.smithi043.stdout:7/470: creat d5/d75/d64/fa0 x:0 0 0 2024-04-25T13:47:02.958 INFO:tasks.workunit.client.0.smithi043.stdout:8/401: dread - db/d11/d79/d81/f83 zero size 2024-04-25T13:47:02.958 INFO:tasks.workunit.client.0.smithi043.stdout:0/320: write db/d1b/f38 [3923535,30167] 0 2024-04-25T13:47:02.958 INFO:tasks.workunit.client.0.smithi043.stdout:6/351: creat d0/d24/f6b x:0 0 0 2024-04-25T13:47:02.959 INFO:tasks.workunit.client.0.smithi043.stdout:1/363: dwrite df/d14/d3d/f55 [0,4194304] 0 2024-04-25T13:47:02.960 INFO:tasks.workunit.client.0.smithi043.stdout:4/295: getdents d1/de/df/d1e/d45 0 2024-04-25T13:47:02.961 INFO:tasks.workunit.client.0.smithi043.stdout:6/352: chown d0/fc 70 1 2024-04-25T13:47:02.963 INFO:tasks.workunit.client.0.smithi043.stdout:7/471: unlink d5/d11/d3b/d61/c67 0 2024-04-25T13:47:02.964 INFO:tasks.workunit.client.0.smithi043.stdout:0/321: stat db/d1b/d4f/l56 0 2024-04-25T13:47:02.965 INFO:tasks.workunit.client.0.smithi043.stdout:6/353: creat d0/d3d/f6c x:0 0 0 2024-04-25T13:47:02.967 INFO:tasks.workunit.client.0.smithi043.stdout:0/322: chown db/d1b/d36/f53 42936 1 2024-04-25T13:47:02.969 INFO:tasks.workunit.client.0.smithi043.stdout:6/354: write d0/d3d/f62 [735301,52385] 0 2024-04-25T13:47:02.969 INFO:tasks.workunit.client.0.smithi043.stdout:1/364: getdents df/d31/d38/d43/d53 0 2024-04-25T13:47:02.973 INFO:tasks.workunit.client.0.smithi043.stdout:1/365: fsync df/d10/d22/f3a 0 2024-04-25T13:47:02.973 INFO:tasks.workunit.client.0.smithi043.stdout:0/323: fdatasync db/d25/d2a/d3f/f42 0 2024-04-25T13:47:02.974 INFO:tasks.workunit.client.0.smithi043.stdout:3/330: dread d0/da/f28 [0,4194304] 0 2024-04-25T13:47:02.975 INFO:tasks.workunit.client.0.smithi043.stdout:4/296: dwrite d1/d34/d35/f57 [0,4194304] 0 2024-04-25T13:47:02.976 INFO:tasks.workunit.client.0.smithi043.stdout:2/288: dread d0/d34/f20 [0,4194304] 0 2024-04-25T13:47:02.976 INFO:tasks.workunit.client.0.smithi043.stdout:1/366: write f3 [12293962,125377] 0 2024-04-25T13:47:02.978 INFO:tasks.workunit.client.0.smithi043.stdout:6/355: creat d0/d24/d2e/d2f/d64/f6d x:0 0 0 2024-04-25T13:47:02.979 INFO:tasks.workunit.client.0.smithi043.stdout:7/472: dwrite d5/d11/d3b/d61/f7c [0,4194304] 0 2024-04-25T13:47:02.980 INFO:tasks.workunit.client.0.smithi043.stdout:0/324: mkdir db/d25/d2a/d3f/d6a 0 2024-04-25T13:47:02.981 INFO:tasks.workunit.client.0.smithi043.stdout:1/367: rmdir df/d14/d63 39 2024-04-25T13:47:02.982 INFO:tasks.workunit.client.0.smithi043.stdout:6/356: rmdir d0/d1c 39 2024-04-25T13:47:02.983 INFO:tasks.workunit.client.0.smithi043.stdout:3/331: truncate d0/d13/f27 2648197 0 2024-04-25T13:47:02.984 INFO:tasks.workunit.client.0.smithi043.stdout:3/332: readlink d0/d14/l32 0 2024-04-25T13:47:02.985 INFO:tasks.workunit.client.0.smithi043.stdout:0/325: creat db/d1b/d23/d27/f6b x:0 0 0 2024-04-25T13:47:02.986 INFO:tasks.workunit.client.0.smithi043.stdout:4/297: chown d1/de/d1d/d20/d38/f46 5465093 1 2024-04-25T13:47:02.987 INFO:tasks.workunit.client.0.smithi043.stdout:3/333: creat d0/d13/f73 x:0 0 0 2024-04-25T13:47:02.990 INFO:tasks.workunit.client.0.smithi043.stdout:6/357: write d0/d24/d2e/d2f/d41/f45 [51056,104144] 0 2024-04-25T13:47:02.995 INFO:tasks.workunit.client.0.smithi043.stdout:1/368: chown df/d14/d63/d67 3699685 1 2024-04-25T13:47:02.995 INFO:tasks.workunit.client.0.smithi043.stdout:0/326: dwrite db/d1b/d23/d27/f6b [0,4194304] 0 2024-04-25T13:47:03.000 INFO:tasks.workunit.client.0.smithi043.stdout:3/334: fdatasync d0/f33 0 2024-04-25T13:47:03.002 INFO:tasks.workunit.client.0.smithi043.stdout:7/473: truncate d5/f3c 1388850 0 2024-04-25T13:47:03.005 INFO:tasks.workunit.client.0.smithi043.stdout:1/369: dwrite fe [0,4194304] 0 2024-04-25T13:47:03.007 INFO:tasks.workunit.client.0.smithi043.stdout:1/370: chown df/d31/d34/l5c 4384 1 2024-04-25T13:47:03.010 INFO:tasks.workunit.client.0.smithi043.stdout:4/298: creat d1/de/d1d/d20/d38/f5f x:0 0 0 2024-04-25T13:47:03.011 INFO:tasks.workunit.client.0.smithi043.stdout:0/327: rename db/l16 to db/d1b/d36/d41/l6c 0 2024-04-25T13:47:03.014 INFO:tasks.workunit.client.0.smithi043.stdout:6/358: dread d0/f31 [0,4194304] 0 2024-04-25T13:47:03.015 INFO:tasks.workunit.client.0.smithi043.stdout:7/474: dwrite d5/d11/f63 [0,4194304] 0 2024-04-25T13:47:03.016 INFO:tasks.workunit.client.0.smithi043.stdout:4/299: creat d1/d34/d35/d3d/f60 x:0 0 0 2024-04-25T13:47:03.016 INFO:tasks.workunit.client.0.smithi043.stdout:1/371: rename df/d31/d38/f3b to df/d14/d63/d71/f7c 0 2024-04-25T13:47:03.017 INFO:tasks.workunit.client.0.smithi043.stdout:3/335: write d0/da/fc [6638532,99823] 0 2024-04-25T13:47:03.021 INFO:tasks.workunit.client.0.smithi043.stdout:1/372: write df/d14/d63/d67/f75 [838683,110858] 0 2024-04-25T13:47:03.023 INFO:tasks.workunit.client.0.smithi043.stdout:1/373: fdatasync df/d14/d2a/f6b 0 2024-04-25T13:47:03.026 INFO:tasks.workunit.client.0.smithi043.stdout:7/475: symlink d5/d75/d54/la1 0 2024-04-25T13:47:03.026 INFO:tasks.workunit.client.0.smithi043.stdout:6/359: dwrite d0/d3d/d54/f57 [0,4194304] 0 2024-04-25T13:47:03.029 INFO:tasks.workunit.client.0.smithi043.stdout:6/360: write d0/d3d/d54/f5e [267986,83754] 0 2024-04-25T13:47:03.030 INFO:tasks.workunit.client.0.smithi043.stdout:3/336: dread d0/d9/d6e/d34/d36/f4e [0,4194304] 0 2024-04-25T13:47:03.031 INFO:tasks.workunit.client.0.smithi043.stdout:6/361: fsync d0/fb 0 2024-04-25T13:47:03.031 INFO:tasks.workunit.client.0.smithi043.stdout:2/289: link d0/d34/f37 d0/d5/d1e/d32/f50 0 2024-04-25T13:47:03.034 INFO:tasks.workunit.client.0.smithi043.stdout:3/337: fdatasync d0/d9/f20 0 2024-04-25T13:47:03.035 INFO:tasks.workunit.client.0.smithi043.stdout:0/328: truncate db/d25/f2b 3054581 0 2024-04-25T13:47:03.035 INFO:tasks.workunit.client.0.smithi043.stdout:2/290: rename d0/d5 to d0/d5/d51 22 2024-04-25T13:47:03.035 INFO:tasks.workunit.client.0.smithi043.stdout:6/362: chown d0/d3d/f5a 2133185 1 2024-04-25T13:47:03.036 INFO:tasks.workunit.client.0.smithi043.stdout:1/374: truncate df/d10/d22/f5b 4103506 0 2024-04-25T13:47:03.040 INFO:tasks.workunit.client.0.smithi043.stdout:0/329: fsync db/f2d 0 2024-04-25T13:47:03.041 INFO:tasks.workunit.client.0.smithi043.stdout:6/363: chown d0/d1c/f28 136373 1 2024-04-25T13:47:03.041 INFO:tasks.workunit.client.0.smithi043.stdout:7/476: dwrite d5/d11/f31 [0,4194304] 0 2024-04-25T13:47:03.042 INFO:tasks.workunit.client.0.smithi043.stdout:2/291: creat d0/d5/d1e/f52 x:0 0 0 2024-04-25T13:47:03.042 INFO:tasks.workunit.client.0.smithi043.stdout:1/375: write df/d14/d2a/f7b [810682,99759] 0 2024-04-25T13:47:03.043 INFO:tasks.workunit.client.0.smithi043.stdout:3/338: dread d0/d9/f23 [0,4194304] 0 2024-04-25T13:47:03.044 INFO:tasks.workunit.client.0.smithi043.stdout:7/477: read - d5/d6b/f92 zero size 2024-04-25T13:47:03.046 INFO:tasks.workunit.client.0.smithi043.stdout:6/364: truncate d0/d24/f50 600937 0 2024-04-25T13:47:03.046 INFO:tasks.workunit.client.0.smithi043.stdout:3/339: read d0/d9/d6e/d34/d36/f4e [1263198,110568] 0 2024-04-25T13:47:03.047 INFO:tasks.workunit.client.0.smithi043.stdout:2/292: symlink d0/d26/l53 0 2024-04-25T13:47:03.049 INFO:tasks.workunit.client.0.smithi043.stdout:7/478: unlink d5/d32/l96 0 2024-04-25T13:47:03.050 INFO:tasks.workunit.client.0.smithi043.stdout:4/300: dread d1/de/df/d1a/f58 [0,4194304] 0 2024-04-25T13:47:03.051 INFO:tasks.workunit.client.0.smithi043.stdout:3/340: symlink d0/d9/d6e/d34/d36/d57/l74 0 2024-04-25T13:47:03.051 INFO:tasks.workunit.client.0.smithi043.stdout:6/365: rmdir d0/d24/d2e/d2f 39 2024-04-25T13:47:03.052 INFO:tasks.workunit.client.0.smithi043.stdout:0/330: rmdir db/d25/d54 0 2024-04-25T13:47:03.052 INFO:tasks.workunit.client.0.smithi043.stdout:7/479: fsync d5/d11/d3b/d61/f7c 0 2024-04-25T13:47:03.054 INFO:tasks.workunit.client.0.smithi043.stdout:4/301: unlink d1/d3/f4b 0 2024-04-25T13:47:03.056 INFO:tasks.workunit.client.0.smithi043.stdout:1/376: dwrite df/d31/d34/f4d [4194304,4194304] 0 2024-04-25T13:47:03.057 INFO:tasks.workunit.client.0.smithi043.stdout:0/331: write db/d1b/f35 [1410502,128195] 0 2024-04-25T13:47:03.058 INFO:tasks.workunit.client.0.smithi043.stdout:7/480: symlink d5/d75/la2 0 2024-04-25T13:47:03.059 INFO:tasks.workunit.client.0.smithi043.stdout:4/302: symlink d1/l61 0 2024-04-25T13:47:03.062 INFO:tasks.workunit.client.0.smithi043.stdout:3/341: dwrite d0/d14/f3e [0,4194304] 0 2024-04-25T13:47:03.063 INFO:tasks.workunit.client.0.smithi043.stdout:4/303: mkdir d1/d3/d54/d62 0 2024-04-25T13:47:03.065 INFO:tasks.workunit.client.0.smithi043.stdout:4/304: write d1/de/f1c [1692730,118367] 0 2024-04-25T13:47:03.065 INFO:tasks.workunit.client.0.smithi043.stdout:3/342: write d0/fe [1172937,69595] 0 2024-04-25T13:47:03.065 INFO:tasks.workunit.client.0.smithi043.stdout:0/332: rename db/l24 to db/d1b/d36/d41/l6d 0 2024-04-25T13:47:03.067 INFO:tasks.workunit.client.0.smithi043.stdout:1/377: link df/d14/l1a df/d31/d38/l7d 0 2024-04-25T13:47:03.067 INFO:tasks.workunit.client.0.smithi043.stdout:3/343: stat d0/da/l1b 0 2024-04-25T13:47:03.069 INFO:tasks.workunit.client.0.smithi043.stdout:0/333: mknod db/d1b/c6e 0 2024-04-25T13:47:03.070 INFO:tasks.workunit.client.0.smithi043.stdout:4/305: symlink d1/de/df/d1a/d49/l63 0 2024-04-25T13:47:03.071 INFO:tasks.workunit.client.0.smithi043.stdout:3/344: mknod d0/d13/d55/c75 0 2024-04-25T13:47:03.073 INFO:tasks.workunit.client.0.smithi043.stdout:1/378: link df/d14/d2a/f6b df/d14/d63/d67/f7e 0 2024-04-25T13:47:03.076 INFO:tasks.workunit.client.0.smithi043.stdout:4/306: dread d1/d34/d35/d3d/f5e [0,4194304] 0 2024-04-25T13:47:03.078 INFO:tasks.workunit.client.0.smithi043.stdout:3/345: write d0/f2 [1600382,72488] 0 2024-04-25T13:47:03.078 INFO:tasks.workunit.client.0.smithi043.stdout:1/379: chown df/d14/d3d/l4c 453483748 1 2024-04-25T13:47:03.080 INFO:tasks.workunit.client.0.smithi043.stdout:3/346: creat d0/d13/d2e/f76 x:0 0 0 2024-04-25T13:47:03.081 INFO:tasks.workunit.client.0.smithi043.stdout:4/307: creat d1/de/df/d1a/f64 x:0 0 0 2024-04-25T13:47:03.081 INFO:tasks.workunit.client.0.smithi043.stdout:3/347: chown d0/da/f28 109583736 1 2024-04-25T13:47:03.082 INFO:tasks.workunit.client.0.smithi043.stdout:1/380: creat df/d14/d2a/d39/f7f x:0 0 0 2024-04-25T13:47:03.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:02 smithi161 ceph-mon[32696]: pgmap v76: 129 pgs: 129 active+clean; 841 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 103 MiB/s wr, 301 op/s 2024-04-25T13:47:03.133 INFO:tasks.workunit.client.0.smithi043.stdout:3/348: truncate d0/f2a 9302703 0 2024-04-25T13:47:03.133 INFO:tasks.workunit.client.0.smithi043.stdout:4/308: write d1/de/df/d1a/f64 [4916,88187] 0 2024-04-25T13:47:03.133 INFO:tasks.workunit.client.0.smithi043.stdout:0/334: write db/d1b/d23/d27/f44 [39401,19190] 0 2024-04-25T13:47:03.135 INFO:tasks.workunit.client.0.smithi043.stdout:4/309: fdatasync d1/de/d1d/d20/d38/d3a/f4d 0 2024-04-25T13:47:03.137 INFO:tasks.workunit.client.0.smithi043.stdout:4/310: chown d1/de/df/d1e/l22 132254 1 2024-04-25T13:47:03.176 INFO:tasks.workunit.client.0.smithi043.stdout:9/306: sync 2024-04-25T13:47:03.176 INFO:tasks.workunit.client.0.smithi043.stdout:5/301: sync 2024-04-25T13:47:03.177 INFO:tasks.workunit.client.0.smithi043.stdout:1/381: truncate f3 3545297 0 2024-04-25T13:47:03.178 INFO:tasks.workunit.client.0.smithi043.stdout:4/311: write d1/de/df/f16 [4380120,3619] 0 2024-04-25T13:47:03.178 INFO:tasks.workunit.client.0.smithi043.stdout:3/349: dwrite d0/da/f28 [0,4194304] 0 2024-04-25T13:47:03.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:02 smithi175 ceph-mon[32649]: pgmap v76: 129 pgs: 129 active+clean; 841 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 103 MiB/s wr, 301 op/s 2024-04-25T13:47:03.180 INFO:tasks.workunit.client.0.smithi043.stdout:5/302: chown d1/d3/d7/f23 98934854 1 2024-04-25T13:47:03.181 INFO:tasks.workunit.client.0.smithi043.stdout:9/307: creat d0/d1d/d22/f78 x:0 0 0 2024-04-25T13:47:03.181 INFO:tasks.workunit.client.0.smithi043.stdout:3/350: chown d0/d13/d2e 1212 1 2024-04-25T13:47:03.183 INFO:tasks.workunit.client.0.smithi043.stdout:1/382: creat df/d31/d38/d43/d53/f80 x:0 0 0 2024-04-25T13:47:03.185 INFO:tasks.workunit.client.0.smithi043.stdout:4/312: creat d1/de/df/d1a/f65 x:0 0 0 2024-04-25T13:47:03.187 INFO:tasks.workunit.client.0.smithi043.stdout:3/351: symlink d0/d9/d6e/d34/d36/l77 0 2024-04-25T13:47:03.188 INFO:tasks.workunit.client.0.smithi043.stdout:1/383: chown df/d14/d3d/c3e 8136 1 2024-04-25T13:47:03.189 INFO:tasks.workunit.client.0.smithi043.stdout:1/384: write df/d31/d34/f4a [1485,77348] 0 2024-04-25T13:47:03.190 INFO:tasks.workunit.client.0.smithi043.stdout:5/303: rename d1/d3/d7/f4f to d1/d3/d24/f65 0 2024-04-25T13:47:03.192 INFO:tasks.workunit.client.0.smithi043.stdout:1/385: mkdir df/d31/d38/d43/d81 0 2024-04-25T13:47:03.193 INFO:tasks.workunit.client.0.smithi043.stdout:9/308: creat d0/f79 x:0 0 0 2024-04-25T13:47:03.193 INFO:tasks.workunit.client.0.smithi043.stdout:1/386: chown df/d31/d38/d43/d53/f70 406680 1 2024-04-25T13:47:03.194 INFO:tasks.workunit.client.0.smithi043.stdout:4/313: mkdir d1/de/df/d1a/d27/d36/d53/d66 0 2024-04-25T13:47:03.195 INFO:tasks.workunit.client.0.smithi043.stdout:3/352: mkdir d0/d9/d78 0 2024-04-25T13:47:03.195 INFO:tasks.workunit.client.0.smithi043.stdout:5/304: symlink d1/d3/d24/l66 0 2024-04-25T13:47:03.196 INFO:tasks.workunit.client.0.smithi043.stdout:5/305: write d1/d3/d7/d2f/d40/f51 [4157649,108357] 0 2024-04-25T13:47:03.197 INFO:tasks.workunit.client.0.smithi043.stdout:4/314: mknod d1/d3/c67 0 2024-04-25T13:47:03.201 INFO:tasks.workunit.client.0.smithi043.stdout:3/353: mknod d0/d9/c79 0 2024-04-25T13:47:03.203 INFO:tasks.workunit.client.0.smithi043.stdout:1/387: getdents df/d31 0 2024-04-25T13:47:03.210 INFO:tasks.workunit.client.0.smithi043.stdout:1/388: dwrite fe [0,4194304] 0 2024-04-25T13:47:03.210 INFO:tasks.workunit.client.0.smithi043.stdout:1/389: stat df/d14/d63/l52 0 2024-04-25T13:47:03.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:02 smithi043 ceph-mon[29195]: pgmap v76: 129 pgs: 129 active+clean; 841 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 103 MiB/s wr, 301 op/s 2024-04-25T13:47:03.215 INFO:tasks.workunit.client.0.smithi043.stdout:1/390: mkdir df/d14/d3d/d82 0 2024-04-25T13:47:03.217 INFO:tasks.workunit.client.0.smithi043.stdout:1/391: write df/d10/f2c [385945,117992] 0 2024-04-25T13:47:03.217 INFO:tasks.workunit.client.0.smithi043.stdout:4/315: dwrite d1/de/d1d/d20/d38/d3a/f48 [0,4194304] 0 2024-04-25T13:47:03.219 INFO:tasks.workunit.client.0.smithi043.stdout:4/316: dread - d1/de/df/d1a/f65 zero size 2024-04-25T13:47:03.219 INFO:tasks.workunit.client.0.smithi043.stdout:4/317: stat d1/f14 0 2024-04-25T13:47:03.220 INFO:tasks.workunit.client.0.smithi043.stdout:5/306: rename d1/d3/d7/d2f/d40 to d1/d3/d7/d2f/d67 0 2024-04-25T13:47:03.222 INFO:tasks.workunit.client.0.smithi043.stdout:4/318: fsync d1/d3/f15 0 2024-04-25T13:47:03.226 INFO:tasks.workunit.client.0.smithi043.stdout:4/319: fdatasync d1/de/df/f16 0 2024-04-25T13:47:03.229 INFO:tasks.workunit.client.0.smithi043.stdout:1/392: dwrite df/d14/d2a/d39/f4e [0,4194304] 0 2024-04-25T13:47:03.230 INFO:tasks.workunit.client.0.smithi043.stdout:5/307: write d1/d3/d7/d8/f44 [4551193,117906] 0 2024-04-25T13:47:03.231 INFO:tasks.workunit.client.0.smithi043.stdout:1/393: chown fe 19491 1 2024-04-25T13:47:03.233 INFO:tasks.workunit.client.0.smithi043.stdout:4/320: unlink d1/de/d1d/d20/f5b 0 2024-04-25T13:47:03.235 INFO:tasks.workunit.client.0.smithi043.stdout:3/354: link d0/d9/d6e/d38/c4f d0/d13/d55/c7a 0 2024-04-25T13:47:03.236 INFO:tasks.workunit.client.0.smithi043.stdout:1/394: rename df/d31/d38/d3f/d41/c59 to df/d31/c83 0 2024-04-25T13:47:03.236 INFO:tasks.workunit.client.0.smithi043.stdout:2/293: sync 2024-04-25T13:47:03.236 INFO:tasks.workunit.client.0.smithi043.stdout:8/402: sync 2024-04-25T13:47:03.239 INFO:tasks.workunit.client.0.smithi043.stdout:0/335: dread db/d1b/d4f/f5d [0,4194304] 0 2024-04-25T13:47:03.241 INFO:tasks.workunit.client.0.smithi043.stdout:2/294: symlink d0/d8/d22/l54 0 2024-04-25T13:47:03.243 INFO:tasks.workunit.client.0.smithi043.stdout:5/308: dwrite d1/d3/d24/f3d [0,4194304] 0 2024-04-25T13:47:03.243 INFO:tasks.workunit.client.0.smithi043.stdout:8/403: creat db/d11/d79/f84 x:0 0 0 2024-04-25T13:47:03.244 INFO:tasks.workunit.client.0.smithi043.stdout:4/321: dread d1/de/f1c [0,4194304] 0 2024-04-25T13:47:03.245 INFO:tasks.workunit.client.0.smithi043.stdout:3/355: getdents d0/d9/d6e/d34 0 2024-04-25T13:47:03.247 INFO:tasks.workunit.client.0.smithi043.stdout:8/404: write db/dc/d21/d4e/d62/f64 [115609,91086] 0 2024-04-25T13:47:03.247 INFO:tasks.workunit.client.0.smithi043.stdout:3/356: write d0/d9/f44 [818848,113401] 0 2024-04-25T13:47:03.251 INFO:tasks.workunit.client.0.smithi043.stdout:1/395: rename df/d14/d63/d67/f7e to df/d14/d3d/f84 0 2024-04-25T13:47:03.256 INFO:tasks.workunit.client.0.smithi043.stdout:4/322: rename d1/d34/d35/f57 to d1/d3/f68 0 2024-04-25T13:47:03.258 INFO:tasks.workunit.client.0.smithi043.stdout:3/357: mknod d0/d9/c7b 0 2024-04-25T13:47:03.259 INFO:tasks.workunit.client.0.smithi043.stdout:5/309: dwrite d1/f56 [0,4194304] 0 2024-04-25T13:47:03.270 INFO:tasks.workunit.client.0.smithi043.stdout:5/310: creat d1/d4/f68 x:0 0 0 2024-04-25T13:47:03.271 INFO:tasks.workunit.client.0.smithi043.stdout:3/358: rmdir d0/d9/d6e 39 2024-04-25T13:47:03.272 INFO:tasks.workunit.client.0.smithi043.stdout:2/295: dwrite d0/d8/d22/d36/f3a [0,4194304] 0 2024-04-25T13:47:03.274 INFO:tasks.workunit.client.0.smithi043.stdout:1/396: truncate df/d14/d2a/f7b 636470 0 2024-04-25T13:47:03.275 INFO:tasks.workunit.client.0.smithi043.stdout:8/405: dwrite db/d11/d1b/d1e/f42 [0,4194304] 0 2024-04-25T13:47:03.276 INFO:tasks.workunit.client.0.smithi043.stdout:4/323: truncate d1/de/df/f41 185598 0 2024-04-25T13:47:03.277 INFO:tasks.workunit.client.0.smithi043.stdout:3/359: creat d0/d13/f7c x:0 0 0 2024-04-25T13:47:03.278 INFO:tasks.workunit.client.0.smithi043.stdout:0/336: dread db/d1b/f29 [0,4194304] 0 2024-04-25T13:47:03.278 INFO:tasks.workunit.client.0.smithi043.stdout:6/366: sync 2024-04-25T13:47:03.278 INFO:tasks.workunit.client.0.smithi043.stdout:7/481: sync 2024-04-25T13:47:03.279 INFO:tasks.workunit.client.0.smithi043.stdout:1/397: creat df/d31/d38/d3f/f85 x:0 0 0 2024-04-25T13:47:03.280 INFO:tasks.workunit.client.0.smithi043.stdout:2/296: mkdir d0/d34/d3f/d46/d55 0 2024-04-25T13:47:03.282 INFO:tasks.workunit.client.0.smithi043.stdout:0/337: dread - db/d1b/f51 zero size 2024-04-25T13:47:03.283 INFO:tasks.workunit.client.0.smithi043.stdout:8/406: write db/d11/d1b/d1e/f42 [4581303,91849] 0 2024-04-25T13:47:03.284 INFO:tasks.workunit.client.0.smithi043.stdout:5/311: creat d1/f69 x:0 0 0 2024-04-25T13:47:03.286 INFO:tasks.workunit.client.0.smithi043.stdout:6/367: read d0/d24/f55 [61192,56011] 0 2024-04-25T13:47:03.286 INFO:tasks.workunit.client.0.smithi043.stdout:0/338: stat f8 0 2024-04-25T13:47:03.291 INFO:tasks.workunit.client.0.smithi043.stdout:4/324: dread d1/de/df/d1a/f64 [0,4194304] 0 2024-04-25T13:47:03.293 INFO:tasks.workunit.client.0.smithi043.stdout:2/297: creat d0/d34/d3f/d46/f56 x:0 0 0 2024-04-25T13:47:03.294 INFO:tasks.workunit.client.0.smithi043.stdout:6/368: mkdir d0/d3d/d6e 0 2024-04-25T13:47:03.294 INFO:tasks.workunit.client.0.smithi043.stdout:0/339: dread - db/d1b/f51 zero size 2024-04-25T13:47:03.294 INFO:tasks.workunit.client.0.smithi043.stdout:1/398: truncate df/d14/d2a/d39/f7f 311525 0 2024-04-25T13:47:03.295 INFO:tasks.workunit.client.0.smithi043.stdout:5/312: truncate d1/d3/d7/d8/df/d28/f48 893430 0 2024-04-25T13:47:03.295 INFO:tasks.workunit.client.0.smithi043.stdout:4/325: readlink d1/de/df/d1e/d28/d33/l50 0 2024-04-25T13:47:03.296 INFO:tasks.workunit.client.0.smithi043.stdout:8/407: symlink db/d11/d1b/d1e/d27/l85 0 2024-04-25T13:47:03.297 INFO:tasks.workunit.client.0.smithi043.stdout:8/408: stat db/d11/f20 0 2024-04-25T13:47:03.298 INFO:tasks.workunit.client.0.smithi043.stdout:0/340: stat db/d1b/d36/d41/l6c 0 2024-04-25T13:47:03.316 INFO:tasks.workunit.client.0.smithi043.stdout:5/313: mkdir d1/d3/d7/d9/d6a 0 2024-04-25T13:47:03.316 INFO:tasks.workunit.client.0.smithi043.stdout:7/482: write d5/d11/f4d [72021,70975] 0 2024-04-25T13:47:03.317 INFO:tasks.workunit.client.0.smithi043.stdout:8/409: fsync db/d11/f2a 0 2024-04-25T13:47:03.317 INFO:tasks.workunit.client.0.smithi043.stdout:4/326: mknod d1/de/df/d1a/d49/c69 0 2024-04-25T13:47:03.317 INFO:tasks.workunit.client.0.smithi043.stdout:6/369: dread d0/d1c/f3b [0,4194304] 0 2024-04-25T13:47:03.319 INFO:tasks.workunit.client.0.smithi043.stdout:1/399: truncate df/d10/d22/d2f/f5d 4741557 0 2024-04-25T13:47:03.320 INFO:tasks.workunit.client.0.smithi043.stdout:6/370: write d0/d24/f5b [3885824,44962] 0 2024-04-25T13:47:03.321 INFO:tasks.workunit.client.0.smithi043.stdout:5/314: dread - d1/d3/d7/d8/da/f53 zero size 2024-04-25T13:47:03.323 INFO:tasks.workunit.client.0.smithi043.stdout:6/371: stat d0/d1b/c30 0 2024-04-25T13:47:03.325 INFO:tasks.workunit.client.0.smithi043.stdout:5/315: fdatasync d1/d3/d7/f61 0 2024-04-25T13:47:03.333 INFO:tasks.workunit.client.0.smithi043.stdout:5/316: chown d1/d3/d7/d8/da 2026033 1 2024-04-25T13:47:03.335 INFO:tasks.workunit.client.0.smithi043.stdout:3/360: link d0/d9/d6e/l16 d0/l7d 0 2024-04-25T13:47:03.337 INFO:tasks.workunit.client.0.smithi043.stdout:0/341: dwrite db/d1b/d36/f64 [0,4194304] 0 2024-04-25T13:47:03.338 INFO:tasks.workunit.client.0.smithi043.stdout:7/483: dwrite d5/f2e [4194304,4194304] 0 2024-04-25T13:47:03.338 INFO:tasks.workunit.client.0.smithi043.stdout:6/372: rmdir d0/d24/d2e/d2f/d41 39 2024-04-25T13:47:03.341 INFO:tasks.workunit.client.0.smithi043.stdout:6/373: fsync d0/f16 0 2024-04-25T13:47:03.341 INFO:tasks.workunit.client.0.smithi043.stdout:4/327: dwrite d1/de/df/d1a/f65 [0,4194304] 0 2024-04-25T13:47:03.342 INFO:tasks.workunit.client.0.smithi043.stdout:7/484: dread - d5/d6b/f92 zero size 2024-04-25T13:47:03.342 INFO:tasks.workunit.client.0.smithi043.stdout:1/400: dwrite df/d31/d38/d3f/f85 [0,4194304] 0 2024-04-25T13:47:03.344 INFO:tasks.workunit.client.0.smithi043.stdout:5/317: creat d1/d3/d7/d8/df/f6b x:0 0 0 2024-04-25T13:47:03.346 INFO:tasks.workunit.client.0.smithi043.stdout:1/401: truncate df/d14/d2a/f36 193287 0 2024-04-25T13:47:03.347 INFO:tasks.workunit.client.0.smithi043.stdout:4/328: mkdir d1/d6a 0 2024-04-25T13:47:03.349 INFO:tasks.workunit.client.0.smithi043.stdout:4/329: write d1/d34/d35/d3d/f60 [913665,81390] 0 2024-04-25T13:47:03.353 INFO:tasks.workunit.client.0.smithi043.stdout:0/342: rename db/d1b/d36/d41/l6c to db/d5b/l6f 0 2024-04-25T13:47:03.355 INFO:tasks.workunit.client.0.smithi043.stdout:7/485: dwrite d5/d11/f14 [0,4194304] 0 2024-04-25T13:47:03.361 INFO:tasks.workunit.client.0.smithi043.stdout:3/361: symlink d0/d9/d6e/d34/d36/d57/l7e 0 2024-04-25T13:47:03.361 INFO:tasks.workunit.client.0.smithi043.stdout:3/362: chown d0/d13/c64 23528196 1 2024-04-25T13:47:03.364 INFO:tasks.workunit.client.0.smithi043.stdout:5/318: rename d1/d3/d24/f41 to d1/d3/d7/d9/d2d/f6c 0 2024-04-25T13:47:03.370 INFO:tasks.workunit.client.0.smithi043.stdout:0/343: rename db/d1b/d36/f53 to db/d1b/d23/d27/d39/d4c/f70 0 2024-04-25T13:47:03.372 INFO:tasks.workunit.client.0.smithi043.stdout:1/402: rmdir df 39 2024-04-25T13:47:03.376 INFO:tasks.workunit.client.0.smithi043.stdout:4/330: write d1/de/df/d1e/d28/d33/f5d [1041104,33593] 0 2024-04-25T13:47:03.378 INFO:tasks.workunit.client.0.smithi043.stdout:6/374: creat d0/d24/d2e/d2f/d41/d4c/f6f x:0 0 0 2024-04-25T13:47:03.380 INFO:tasks.workunit.client.0.smithi043.stdout:0/344: mkdir db/d1b/d36/d41/d71 0 2024-04-25T13:47:03.384 INFO:tasks.workunit.client.0.smithi043.stdout:1/403: chown df/d14/f56 1326 1 2024-04-25T13:47:03.384 INFO:tasks.workunit.client.0.smithi043.stdout:7/486: dwrite d5/d75/d64/fa0 [0,4194304] 0 2024-04-25T13:47:03.385 INFO:tasks.workunit.client.0.smithi043.stdout:5/319: write d1/d3/d7/d8/da/f2c [37594,88169] 0 2024-04-25T13:47:03.386 INFO:tasks.workunit.client.0.smithi043.stdout:4/331: symlink d1/de/df/d1a/d49/l6b 0 2024-04-25T13:47:03.389 INFO:tasks.workunit.client.0.smithi043.stdout:7/487: unlink d5/f2d 0 2024-04-25T13:47:03.390 INFO:tasks.workunit.client.0.smithi043.stdout:6/375: symlink d0/d3d/d6e/l70 0 2024-04-25T13:47:03.391 INFO:tasks.workunit.client.0.smithi043.stdout:0/345: mkdir db/d1b/d62/d72 0 2024-04-25T13:47:03.392 INFO:tasks.workunit.client.0.smithi043.stdout:5/320: creat d1/d3/d7/d2f/d67/f6d x:0 0 0 2024-04-25T13:47:03.392 INFO:tasks.workunit.client.0.smithi043.stdout:1/404: dread df/d31/d34/f4d [0,4194304] 0 2024-04-25T13:47:03.394 INFO:tasks.workunit.client.0.smithi043.stdout:4/332: creat d1/de/df/d1a/d27/d36/f6c x:0 0 0 2024-04-25T13:47:03.395 INFO:tasks.workunit.client.0.smithi043.stdout:1/405: write df/f1b [17874,103676] 0 2024-04-25T13:47:03.395 INFO:tasks.workunit.client.0.smithi043.stdout:5/321: write d1/d3/d7/d8/da/f53 [655439,127844] 0 2024-04-25T13:47:03.396 INFO:tasks.workunit.client.0.smithi043.stdout:7/488: rename d5/d11/d3b/l43 to d5/d11/d3b/d8b/la3 0 2024-04-25T13:47:03.397 INFO:tasks.workunit.client.0.smithi043.stdout:6/376: read d0/fc [1072761,87179] 0 2024-04-25T13:47:03.397 INFO:tasks.workunit.client.0.smithi043.stdout:0/346: rmdir db/d1b 39 2024-04-25T13:47:03.399 INFO:tasks.workunit.client.0.smithi043.stdout:1/406: symlink df/d10/l86 0 2024-04-25T13:47:03.399 INFO:tasks.workunit.client.0.smithi043.stdout:4/333: write d1/de/df/d1a/f65 [557491,80181] 0 2024-04-25T13:47:03.400 INFO:tasks.workunit.client.0.smithi043.stdout:0/347: readlink db/d5b/l6f 0 2024-04-25T13:47:03.404 INFO:tasks.workunit.client.0.smithi043.stdout:6/377: mkdir d0/d3d/d6e/d71 0 2024-04-25T13:47:03.408 INFO:tasks.workunit.client.0.smithi043.stdout:1/407: fdatasync df/d14/f1c 0 2024-04-25T13:47:03.409 INFO:tasks.workunit.client.0.smithi043.stdout:5/322: mkdir d1/d3/d7/d9/d2d/d5b/d6e 0 2024-04-25T13:47:03.411 INFO:tasks.workunit.client.0.smithi043.stdout:4/334: mknod d1/de/df/c6d 0 2024-04-25T13:47:03.413 INFO:tasks.workunit.client.0.smithi043.stdout:6/378: mknod d0/d24/d2e/d2f/d41/d48/d60/c72 0 2024-04-25T13:47:03.414 INFO:tasks.workunit.client.0.smithi043.stdout:0/348: symlink db/d1b/d23/d27/l73 0 2024-04-25T13:47:03.414 INFO:tasks.workunit.client.0.smithi043.stdout:4/335: mknod d1/d3/d54/c6e 0 2024-04-25T13:47:03.415 INFO:tasks.workunit.client.0.smithi043.stdout:0/349: chown db/l5f 1545330 1 2024-04-25T13:47:03.416 INFO:tasks.workunit.client.0.smithi043.stdout:5/323: dwrite d1/d3/d7/d8/f44 [0,4194304] 0 2024-04-25T13:47:03.416 INFO:tasks.workunit.client.0.smithi043.stdout:6/379: mkdir d0/d24/d2e/d2f/d41/d48/d73 0 2024-04-25T13:47:03.419 INFO:tasks.workunit.client.0.smithi043.stdout:0/350: unlink l5 0 2024-04-25T13:47:03.420 INFO:tasks.workunit.client.0.smithi043.stdout:4/336: creat d1/de/d1d/d20/d38/d3a/f6f x:0 0 0 2024-04-25T13:47:03.421 INFO:tasks.workunit.client.0.smithi043.stdout:0/351: mkdir db/d1b/d23/d27/d39/d4c/d74 0 2024-04-25T13:47:03.422 INFO:tasks.workunit.client.0.smithi043.stdout:4/337: fsync d1/de/d1d/d20/d38/f46 0 2024-04-25T13:47:03.430 INFO:tasks.workunit.client.0.smithi043.stdout:0/352: dwrite db/d1b/f26 [0,4194304] 0 2024-04-25T13:47:03.432 INFO:tasks.workunit.client.0.smithi043.stdout:4/338: dwrite d1/de/df/f16 [0,4194304] 0 2024-04-25T13:47:03.438 INFO:tasks.workunit.client.0.smithi043.stdout:4/339: unlink d1/d3/f15 0 2024-04-25T13:47:03.438 INFO:tasks.workunit.client.0.smithi043.stdout:6/380: dread d0/d24/d2e/d2f/d41/f45 [0,4194304] 0 2024-04-25T13:47:03.439 INFO:tasks.workunit.client.0.smithi043.stdout:0/353: getdents db/d25/d2a/d3f/d6a 0 2024-04-25T13:47:03.439 INFO:tasks.workunit.client.0.smithi043.stdout:0/354: stat db/d5b 0 2024-04-25T13:47:03.443 INFO:tasks.workunit.client.0.smithi043.stdout:0/355: creat db/d1b/d23/d27/f75 x:0 0 0 2024-04-25T13:47:03.443 INFO:tasks.workunit.client.0.smithi043.stdout:5/324: dread d1/d3/d7/d8/da/d11/d52/f59 [0,4194304] 0 2024-04-25T13:47:03.444 INFO:tasks.workunit.client.0.smithi043.stdout:5/325: fdatasync d1/f56 0 2024-04-25T13:47:03.445 INFO:tasks.workunit.client.0.smithi043.stdout:7/489: rename d5/d32/l6f to d5/d75/d79/la4 0 2024-04-25T13:47:03.446 INFO:tasks.workunit.client.0.smithi043.stdout:7/490: write d5/d11/f19 [724222,102485] 0 2024-04-25T13:47:03.451 INFO:tasks.workunit.client.0.smithi043.stdout:4/340: getdents d1/de/df/d1e 0 2024-04-25T13:47:03.452 INFO:tasks.workunit.client.0.smithi043.stdout:7/491: stat d5/d32/f3a 0 2024-04-25T13:47:03.455 INFO:tasks.workunit.client.0.smithi043.stdout:0/356: getdents db 0 2024-04-25T13:47:03.457 INFO:tasks.workunit.client.0.smithi043.stdout:5/326: dwrite d1/d3/d26/f2a [0,4194304] 0 2024-04-25T13:47:03.457 INFO:tasks.workunit.client.0.smithi043.stdout:7/492: creat d5/d11/d3b/d61/d68/fa5 x:0 0 0 2024-04-25T13:47:03.457 INFO:tasks.workunit.client.0.smithi043.stdout:4/341: mkdir d1/de/df/d1a/d27/d36/d53/d66/d70 0 2024-04-25T13:47:03.459 INFO:tasks.workunit.client.0.smithi043.stdout:7/493: truncate d5/d11/f4d 937860 0 2024-04-25T13:47:03.460 INFO:tasks.workunit.client.0.smithi043.stdout:0/357: mknod db/d1b/d62/c76 0 2024-04-25T13:47:03.460 INFO:tasks.workunit.client.0.smithi043.stdout:1/408: rename df/d14/d2a to df/d14/d63/d87 0 2024-04-25T13:47:03.462 INFO:tasks.workunit.client.0.smithi043.stdout:4/342: write d1/d3/f3e [1104390,45541] 0 2024-04-25T13:47:03.463 INFO:tasks.workunit.client.0.smithi043.stdout:5/327: mknod d1/d3/c6f 0 2024-04-25T13:47:03.464 INFO:tasks.workunit.client.0.smithi043.stdout:7/494: read d5/d11/d3b/d3f/d5a/f76 [1496005,71805] 0 2024-04-25T13:47:03.466 INFO:tasks.workunit.client.0.smithi043.stdout:7/495: truncate d5/d75/f3e 399535 0 2024-04-25T13:47:03.467 INFO:tasks.workunit.client.0.smithi043.stdout:0/358: creat db/d1b/d23/d27/d39/d4c/f77 x:0 0 0 2024-04-25T13:47:03.467 INFO:tasks.workunit.client.0.smithi043.stdout:0/359: read f6 [345188,117979] 0 2024-04-25T13:47:03.468 INFO:tasks.workunit.client.0.smithi043.stdout:0/360: chown db/d25/d2a 488 1 2024-04-25T13:47:03.470 INFO:tasks.workunit.client.0.smithi043.stdout:6/381: rename d0/d24/d2e/d2f/f38 to d0/d3d/d6e/f74 0 2024-04-25T13:47:03.470 INFO:tasks.workunit.client.0.smithi043.stdout:1/409: link df/d14/d63/d87/d39/f7f df/d10/d22/f88 0 2024-04-25T13:47:03.470 INFO:tasks.workunit.client.0.smithi043.stdout:0/361: rename db/d1b/d23 to db/d1b/d23/d27/d39/d4c/d78 22 2024-04-25T13:47:03.471 INFO:tasks.workunit.client.0.smithi043.stdout:7/496: mknod d5/d11/ca6 0 2024-04-25T13:47:03.471 INFO:tasks.workunit.client.0.smithi043.stdout:1/410: chown df/d10/d22/f58 27512759 1 2024-04-25T13:47:03.474 INFO:tasks.workunit.client.0.smithi043.stdout:5/328: creat d1/d3/d7/f70 x:0 0 0 2024-04-25T13:47:03.474 INFO:tasks.workunit.client.0.smithi043.stdout:1/411: symlink df/d14/d63/d87/d39/l89 0 2024-04-25T13:47:03.475 INFO:tasks.workunit.client.0.smithi043.stdout:0/362: creat db/d5b/f79 x:0 0 0 2024-04-25T13:47:03.475 INFO:tasks.workunit.client.0.smithi043.stdout:5/329: read - d1/d3/d7/d8/da/d2e/f55 zero size 2024-04-25T13:47:03.476 INFO:tasks.workunit.client.0.smithi043.stdout:1/412: creat df/d31/d38/d3f/f8a x:0 0 0 2024-04-25T13:47:03.477 INFO:tasks.workunit.client.0.smithi043.stdout:5/330: fsync d1/d3/d26/f2a 0 2024-04-25T13:47:03.478 INFO:tasks.workunit.client.0.smithi043.stdout:0/363: creat db/d25/d2a/f7a x:0 0 0 2024-04-25T13:47:03.479 INFO:tasks.workunit.client.0.smithi043.stdout:1/413: truncate df/d14/d63/d71/f7c 40734 0 2024-04-25T13:47:03.479 INFO:tasks.workunit.client.0.smithi043.stdout:0/364: chown db/d25/d2a/l3c 1781 1 2024-04-25T13:47:03.480 INFO:tasks.workunit.client.0.smithi043.stdout:0/365: readlink db/d1b/d4f/l56 0 2024-04-25T13:47:03.481 INFO:tasks.workunit.client.0.smithi043.stdout:0/366: fdatasync db/d1b/f26 0 2024-04-25T13:47:03.486 INFO:tasks.workunit.client.0.smithi043.stdout:5/331: dread d1/d3/d7/d8/df/d28/f48 [0,4194304] 0 2024-04-25T13:47:03.488 INFO:tasks.workunit.client.0.smithi043.stdout:0/367: creat db/d1b/d23/d27/d39/f7b x:0 0 0 2024-04-25T13:47:03.490 INFO:tasks.workunit.client.0.smithi043.stdout:0/368: chown db/d1b/d4f/l56 2039 1 2024-04-25T13:47:03.490 INFO:tasks.workunit.client.0.smithi043.stdout:6/382: dwrite d0/f29 [4194304,4194304] 0 2024-04-25T13:47:03.491 INFO:tasks.workunit.client.0.smithi043.stdout:5/332: symlink d1/l71 0 2024-04-25T13:47:03.493 INFO:tasks.workunit.client.0.smithi043.stdout:5/333: write d1/d3/d7/f23 [1313802,3046] 0 2024-04-25T13:47:03.495 INFO:tasks.workunit.client.0.smithi043.stdout:7/497: dread d5/d32/f3d [0,4194304] 0 2024-04-25T13:47:03.495 INFO:tasks.workunit.client.0.smithi043.stdout:5/334: write d1/d3/d7/d8/df/f6b [38161,14598] 0 2024-04-25T13:47:03.496 INFO:tasks.workunit.client.0.smithi043.stdout:1/414: rename df/d14/d63/d87 to df/d31/d34/d8b 0 2024-04-25T13:47:03.498 INFO:tasks.workunit.client.0.smithi043.stdout:7/498: fdatasync d5/d11/f90 0 2024-04-25T13:47:03.499 INFO:tasks.workunit.client.0.smithi043.stdout:1/415: chown df/d31/d34/d8b/f6b 13739 1 2024-04-25T13:47:03.500 INFO:tasks.workunit.client.0.smithi043.stdout:5/335: creat d1/d3/d7/d9/d2d/f72 x:0 0 0 2024-04-25T13:47:03.501 INFO:tasks.workunit.client.0.smithi043.stdout:1/416: mkdir df/d14/d3d/d82/d8c 0 2024-04-25T13:47:03.504 INFO:tasks.workunit.client.0.smithi043.stdout:6/383: creat d0/d24/d2e/d5c/f75 x:0 0 0 2024-04-25T13:47:03.504 INFO:tasks.workunit.client.0.smithi043.stdout:1/417: mknod df/d14/d63/d67/c8d 0 2024-04-25T13:47:03.505 INFO:tasks.workunit.client.0.smithi043.stdout:1/418: chown df/d14/c64 742642460 1 2024-04-25T13:47:03.506 INFO:tasks.workunit.client.0.smithi043.stdout:1/419: fdatasync df/f20 0 2024-04-25T13:47:03.507 INFO:tasks.workunit.client.0.smithi043.stdout:7/499: dread d5/f45 [4194304,4194304] 0 2024-04-25T13:47:03.508 INFO:tasks.workunit.client.0.smithi043.stdout:1/420: creat df/d31/d38/d43/f8e x:0 0 0 2024-04-25T13:47:03.509 INFO:tasks.workunit.client.0.smithi043.stdout:6/384: unlink d0/d24/d2e/d2f/d41/d48/l66 0 2024-04-25T13:47:03.520 INFO:tasks.workunit.client.0.smithi043.stdout:0/369: rename db/d1b/d62/c76 to db/d1b/d4f/c7c 0 2024-04-25T13:47:03.522 INFO:tasks.workunit.client.0.smithi043.stdout:7/500: rename d5/d11/f90 to d5/d11/d8f/fa7 0 2024-04-25T13:47:03.526 INFO:tasks.workunit.client.0.smithi043.stdout:1/421: rename df/d10/d22/d2f/f6f to df/d14/d3d/d82/d8c/f8f 0 2024-04-25T13:47:03.528 INFO:tasks.workunit.client.0.smithi043.stdout:1/422: fdatasync df/d10/d22/f88 0 2024-04-25T13:47:03.531 INFO:tasks.workunit.client.0.smithi043.stdout:1/423: dread df/f16 [0,4194304] 0 2024-04-25T13:47:03.535 INFO:tasks.workunit.client.0.smithi043.stdout:8/410: sync 2024-04-25T13:47:03.536 INFO:tasks.workunit.client.0.smithi043.stdout:2/298: sync 2024-04-25T13:47:03.536 INFO:tasks.workunit.client.0.smithi043.stdout:6/385: rename d0/d24/d2e to d0/d76 0 2024-04-25T13:47:03.537 INFO:tasks.workunit.client.0.smithi043.stdout:2/299: dread - d0/d34/d3f/d46/f56 zero size 2024-04-25T13:47:03.537 INFO:tasks.workunit.client.0.smithi043.stdout:8/411: write db/d46/f61 [2753547,64388] 0 2024-04-25T13:47:03.538 INFO:tasks.workunit.client.0.smithi043.stdout:6/386: write d0/f29 [620946,51033] 0 2024-04-25T13:47:03.540 INFO:tasks.workunit.client.0.smithi043.stdout:6/387: readlink d0/l2b 0 2024-04-25T13:47:03.541 INFO:tasks.workunit.client.0.smithi043.stdout:6/388: chown d0/d24 1 1 2024-04-25T13:47:03.541 INFO:tasks.workunit.client.0.smithi043.stdout:2/300: mknod d0/d5/d1e/c57 0 2024-04-25T13:47:03.543 INFO:tasks.workunit.client.0.smithi043.stdout:0/370: dread db/d1b/d36/f61 [0,4194304] 0 2024-04-25T13:47:03.543 INFO:tasks.workunit.client.0.smithi043.stdout:8/412: mknod db/d46/c86 0 2024-04-25T13:47:03.544 INFO:tasks.workunit.client.0.smithi043.stdout:8/413: chown db/d38/f7f 107660 1 2024-04-25T13:47:03.544 INFO:tasks.workunit.client.0.smithi043.stdout:6/389: mkdir d0/d1b/d77 0 2024-04-25T13:47:03.546 INFO:tasks.workunit.client.0.smithi043.stdout:2/301: mknod d0/d8/c58 0 2024-04-25T13:47:03.550 INFO:tasks.workunit.client.0.smithi043.stdout:6/390: dread d0/d3d/d54/f5e [0,4194304] 0 2024-04-25T13:47:03.552 INFO:tasks.workunit.client.0.smithi043.stdout:2/302: dread d0/d34/f37 [0,4194304] 0 2024-04-25T13:47:03.553 INFO:tasks.workunit.client.0.smithi043.stdout:2/303: fdatasync d0/d8/ff 0 2024-04-25T13:47:03.554 INFO:tasks.workunit.client.0.smithi043.stdout:6/391: symlink d0/d76/l78 0 2024-04-25T13:47:03.555 INFO:tasks.workunit.client.0.smithi043.stdout:6/392: dread - d0/d3d/f6c zero size 2024-04-25T13:47:03.557 INFO:tasks.workunit.client.0.smithi043.stdout:2/304: unlink d0/d5/d1e/c57 0 2024-04-25T13:47:03.558 INFO:tasks.workunit.client.0.smithi043.stdout:6/393: readlink d0/d76/l58 0 2024-04-25T13:47:03.560 INFO:tasks.workunit.client.0.smithi043.stdout:2/305: unlink d0/d8/l25 0 2024-04-25T13:47:03.561 INFO:tasks.workunit.client.0.smithi043.stdout:6/394: unlink d0/d1c/l22 0 2024-04-25T13:47:03.566 INFO:tasks.workunit.client.0.smithi043.stdout:2/306: dwrite d0/d8/fd [4194304,4194304] 0 2024-04-25T13:47:03.566 INFO:tasks.workunit.client.0.smithi043.stdout:6/395: mknod d0/d76/d2f/d41/c79 0 2024-04-25T13:47:03.570 INFO:tasks.workunit.client.0.smithi043.stdout:0/371: dwrite db/d1b/d4f/f5d [0,4194304] 0 2024-04-25T13:47:03.572 INFO:tasks.workunit.client.0.smithi043.stdout:7/501: rename d5/d11/f42 to d5/d75/d79/fa8 0 2024-04-25T13:47:03.573 INFO:tasks.workunit.client.0.smithi043.stdout:6/396: mknod d0/d3d/d6e/d71/c7a 0 2024-04-25T13:47:03.573 INFO:tasks.workunit.client.0.smithi043.stdout:0/372: write db/d1b/f5e [438512,71964] 0 2024-04-25T13:47:03.574 INFO:tasks.workunit.client.0.smithi043.stdout:7/502: read d5/d11/f24 [1085074,32071] 0 2024-04-25T13:47:03.576 INFO:tasks.workunit.client.0.smithi043.stdout:0/373: getdents db/d1b/d23 0 2024-04-25T13:47:03.577 INFO:tasks.workunit.client.0.smithi043.stdout:0/374: write f7 [6210662,9129] 0 2024-04-25T13:47:03.579 INFO:tasks.workunit.client.0.smithi043.stdout:1/424: rename df/d31/d38/d43/c5a to df/d14/c90 0 2024-04-25T13:47:03.579 INFO:tasks.workunit.client.0.smithi043.stdout:8/414: rename db/d11/d1b/d1e/d27 to db/d11/d1b/d1e/d27/d87 22 2024-04-25T13:47:03.581 INFO:tasks.workunit.client.0.smithi043.stdout:1/425: fdatasync df/d31/d38/d3f/f8a 0 2024-04-25T13:47:03.588 INFO:tasks.workunit.client.0.smithi043.stdout:7/503: fdatasync d5/d75/d79/fa8 0 2024-04-25T13:47:03.589 INFO:tasks.workunit.client.0.smithi043.stdout:0/375: rename db/d1b/l59 to db/l7d 0 2024-04-25T13:47:03.589 INFO:tasks.workunit.client.0.smithi043.stdout:7/504: stat d5/d11/c59 0 2024-04-25T13:47:03.591 INFO:tasks.workunit.client.0.smithi043.stdout:6/397: dread d0/d24/f55 [0,4194304] 0 2024-04-25T13:47:03.592 INFO:tasks.workunit.client.0.smithi043.stdout:0/376: chown db/d1b/d36/f64 589 1 2024-04-25T13:47:03.597 INFO:tasks.workunit.client.0.smithi043.stdout:0/377: mknod db/d25/d2a/d3f/d6a/c7e 0 2024-04-25T13:47:03.598 INFO:tasks.workunit.client.0.smithi043.stdout:7/505: dwrite d5/f55 [0,4194304] 0 2024-04-25T13:47:03.600 INFO:tasks.workunit.client.0.smithi043.stdout:7/506: write d5/d11/f31 [8629828,86221] 0 2024-04-25T13:47:03.601 INFO:tasks.workunit.client.0.smithi043.stdout:7/507: readlink d5/l38 0 2024-04-25T13:47:03.606 INFO:tasks.workunit.client.0.smithi043.stdout:7/508: truncate d5/d11/d3b/d3f/d5a/f65 591442 0 2024-04-25T13:47:03.606 INFO:tasks.workunit.client.0.smithi043.stdout:8/415: dread db/d11/f20 [0,4194304] 0 2024-04-25T13:47:03.607 INFO:tasks.workunit.client.0.smithi043.stdout:0/378: dwrite f8 [4194304,4194304] 0 2024-04-25T13:47:03.614 INFO:tasks.workunit.client.0.smithi043.stdout:0/379: mknod db/d5b/d68/c7f 0 2024-04-25T13:47:03.615 INFO:tasks.workunit.client.0.smithi043.stdout:8/416: dwrite db/d11/f17 [0,4194304] 0 2024-04-25T13:47:03.619 INFO:tasks.workunit.client.0.smithi043.stdout:7/509: write d5/d75/d54/f8a [817462,22199] 0 2024-04-25T13:47:03.621 INFO:tasks.workunit.client.0.smithi043.stdout:6/398: dread d0/d1c/f3e [0,4194304] 0 2024-04-25T13:47:03.625 INFO:tasks.workunit.client.0.smithi043.stdout:0/380: rmdir db/d1b/d4f 39 2024-04-25T13:47:03.625 INFO:tasks.workunit.client.0.smithi043.stdout:7/510: symlink d5/d11/d3b/d8b/d9b/la9 0 2024-04-25T13:47:03.628 INFO:tasks.workunit.client.0.smithi043.stdout:6/399: mknod d0/d1b/d77/c7b 0 2024-04-25T13:47:03.636 INFO:tasks.workunit.client.0.smithi043.stdout:0/381: dwrite db/d1b/d23/d27/f44 [0,4194304] 0 2024-04-25T13:47:03.637 INFO:tasks.workunit.client.0.smithi043.stdout:8/417: dwrite db/dc/d28/f6d [0,4194304] 0 2024-04-25T13:47:03.638 INFO:tasks.workunit.client.0.smithi043.stdout:7/511: dread d5/d11/f26 [0,4194304] 0 2024-04-25T13:47:03.640 INFO:tasks.workunit.client.0.smithi043.stdout:6/400: truncate d0/ff 5734125 0 2024-04-25T13:47:03.642 INFO:tasks.workunit.client.0.smithi043.stdout:8/418: mknod db/d11/d1b/d59/d7c/c88 0 2024-04-25T13:47:03.646 INFO:tasks.workunit.client.0.smithi043.stdout:6/401: fsync d0/d76/d2f/d41/d4c/f61 0 2024-04-25T13:47:03.647 INFO:tasks.workunit.client.0.smithi043.stdout:8/419: read - db/d11/d1b/f66 zero size 2024-04-25T13:47:03.648 INFO:tasks.workunit.client.0.smithi043.stdout:0/382: dwrite db/d1b/d23/d27/f44 [0,4194304] 0 2024-04-25T13:47:03.651 INFO:tasks.workunit.client.0.smithi043.stdout:7/512: dwrite d5/d32/f9d [0,4194304] 0 2024-04-25T13:47:03.653 INFO:tasks.workunit.client.0.smithi043.stdout:7/513: stat d5/f6d 0 2024-04-25T13:47:03.656 INFO:tasks.workunit.client.0.smithi043.stdout:8/420: rename db/ff to db/d11/d1b/f89 0 2024-04-25T13:47:03.659 INFO:tasks.workunit.client.0.smithi043.stdout:7/514: read d5/d11/d3b/d3f/d5a/f5e [8292,85606] 0 2024-04-25T13:47:03.662 INFO:tasks.workunit.client.0.smithi043.stdout:8/421: write db/d38/d3c/d71/f50 [2161308,4001] 0 2024-04-25T13:47:03.664 INFO:tasks.workunit.client.0.smithi043.stdout:0/383: dwrite db/d25/d2a/d3f/f42 [0,4194304] 0 2024-04-25T13:47:03.668 INFO:tasks.workunit.client.0.smithi043.stdout:6/402: truncate d0/f13 1173171 0 2024-04-25T13:47:03.670 INFO:tasks.workunit.client.0.smithi043.stdout:8/422: truncate db/fd 5096626 0 2024-04-25T13:47:03.672 INFO:tasks.workunit.client.0.smithi043.stdout:0/384: mknod db/c80 0 2024-04-25T13:47:03.673 INFO:tasks.workunit.client.0.smithi043.stdout:6/403: creat d0/d76/f7c x:0 0 0 2024-04-25T13:47:03.674 INFO:tasks.workunit.client.0.smithi043.stdout:0/385: fsync db/f1d 0 2024-04-25T13:47:03.675 INFO:tasks.workunit.client.0.smithi043.stdout:6/404: write d0/d1c/f56 [1209676,63406] 0 2024-04-25T13:47:03.678 INFO:tasks.workunit.client.0.smithi043.stdout:0/386: unlink db/d1b/d36/f61 0 2024-04-25T13:47:03.680 INFO:tasks.workunit.client.0.smithi043.stdout:7/515: dread d5/fd [0,4194304] 0 2024-04-25T13:47:03.682 INFO:tasks.workunit.client.0.smithi043.stdout:6/405: creat d0/d76/d5c/f7d x:0 0 0 2024-04-25T13:47:03.685 INFO:tasks.workunit.client.0.smithi043.stdout:0/387: rmdir db/d1b/d36 39 2024-04-25T13:47:03.687 INFO:tasks.workunit.client.0.smithi043.stdout:6/406: truncate d0/d3d/f6c 715225 0 2024-04-25T13:47:03.688 INFO:tasks.workunit.client.0.smithi043.stdout:7/516: mknod d5/caa 0 2024-04-25T13:47:03.688 INFO:tasks.workunit.client.0.smithi043.stdout:8/423: dread db/dc/d21/d4e/f58 [0,4194304] 0 2024-04-25T13:47:03.689 INFO:tasks.workunit.client.0.smithi043.stdout:6/407: read - d0/d76/d2f/d41/d4c/f6f zero size 2024-04-25T13:47:03.689 INFO:tasks.workunit.client.0.smithi043.stdout:0/388: mknod db/d25/d2a/d3f/c81 0 2024-04-25T13:47:03.691 INFO:tasks.workunit.client.0.smithi043.stdout:6/408: write d0/d1c/f56 [1279100,110467] 0 2024-04-25T13:47:03.691 INFO:tasks.workunit.client.0.smithi043.stdout:3/363: sync 2024-04-25T13:47:03.692 INFO:tasks.workunit.client.0.smithi043.stdout:0/389: read db/d1b/d23/d27/f6b [2407738,91634] 0 2024-04-25T13:47:03.693 INFO:tasks.workunit.client.0.smithi043.stdout:6/409: chown d0/d76/d5c/f7d 624 1 2024-04-25T13:47:03.693 INFO:tasks.workunit.client.0.smithi043.stdout:7/517: rename d5/f55 to d5/d11/d3b/d61/fab 0 2024-04-25T13:47:03.693 INFO:tasks.workunit.client.0.smithi043.stdout:0/390: chown db/d1b/f5e 1 1 2024-04-25T13:47:03.695 INFO:tasks.workunit.client.0.smithi043.stdout:7/518: chown d5/d11/d3b/l99 7524462 1 2024-04-25T13:47:03.700 INFO:tasks.workunit.client.0.smithi043.stdout:6/410: creat d0/d24/f7e x:0 0 0 2024-04-25T13:47:03.701 INFO:tasks.workunit.client.0.smithi043.stdout:3/364: dwrite d0/f4 [4194304,4194304] 0 2024-04-25T13:47:03.706 INFO:tasks.workunit.client.0.smithi043.stdout:8/424: dwrite db/d11/d1b/f6c [0,4194304] 0 2024-04-25T13:47:03.707 INFO:tasks.workunit.client.0.smithi043.stdout:0/391: dread db/d1b/f22 [0,4194304] 0 2024-04-25T13:47:03.707 INFO:tasks.workunit.client.0.smithi043.stdout:7/519: creat d5/d75/d64/fac x:0 0 0 2024-04-25T13:47:03.710 INFO:tasks.workunit.client.0.smithi043.stdout:8/425: rename db/d11/d1b/d59/d7c/c88 to db/d11/d79/c8a 0 2024-04-25T13:47:03.711 INFO:tasks.workunit.client.0.smithi043.stdout:6/411: dread d0/f5d [0,4194304] 0 2024-04-25T13:47:03.712 INFO:tasks.workunit.client.0.smithi043.stdout:6/412: chown d0/d1b/l4b 171158 1 2024-04-25T13:47:03.712 INFO:tasks.workunit.client.0.smithi043.stdout:7/520: creat d5/d11/d3b/d3f/d5a/d89/fad x:0 0 0 2024-04-25T13:47:03.713 INFO:tasks.workunit.client.0.smithi043.stdout:8/426: creat db/dc/d80/f8b x:0 0 0 2024-04-25T13:47:03.714 INFO:tasks.workunit.client.0.smithi043.stdout:6/413: dread d0/d24/f55 [0,4194304] 0 2024-04-25T13:47:03.714 INFO:tasks.workunit.client.0.smithi043.stdout:3/365: link d0/d9/d6e/d38/d3f/f42 d0/d9/d6e/d34/f7f 0 2024-04-25T13:47:03.717 INFO:tasks.workunit.client.0.smithi043.stdout:8/427: mkdir db/d11/d1b/d8c 0 2024-04-25T13:47:03.721 INFO:tasks.workunit.client.0.smithi043.stdout:3/366: creat d0/d9/d6e/d34/f80 x:0 0 0 2024-04-25T13:47:03.727 INFO:tasks.workunit.client.0.smithi043.stdout:8/428: dwrite db/dc/f45 [0,4194304] 0 2024-04-25T13:47:03.732 INFO:tasks.workunit.client.0.smithi043.stdout:8/429: symlink db/dc/d28/l8d 0 2024-04-25T13:47:03.733 INFO:tasks.workunit.client.0.smithi043.stdout:3/367: dwrite d0/d13/f67 [0,4194304] 0 2024-04-25T13:47:03.735 INFO:tasks.workunit.client.0.smithi043.stdout:8/430: fdatasync db/d11/f20 0 2024-04-25T13:47:03.741 INFO:tasks.workunit.client.0.smithi043.stdout:7/521: dwrite d5/d75/d64/fac [0,4194304] 0 2024-04-25T13:47:03.741 INFO:tasks.workunit.client.0.smithi043.stdout:6/414: dread d0/ff [0,4194304] 0 2024-04-25T13:47:03.743 INFO:tasks.workunit.client.0.smithi043.stdout:7/522: write d5/d11/d3b/d8b/d93/f9a [140558,35642] 0 2024-04-25T13:47:03.744 INFO:tasks.workunit.client.0.smithi043.stdout:6/415: write d0/d24/f55 [1275326,35294] 0 2024-04-25T13:47:03.745 INFO:tasks.workunit.client.0.smithi043.stdout:6/416: chown d0/d3d/c44 3532856 1 2024-04-25T13:47:03.747 INFO:tasks.workunit.client.0.smithi043.stdout:8/431: rename db/d11/d1b/d1e to db/d44/d8e 0 2024-04-25T13:47:03.750 INFO:tasks.workunit.client.0.smithi043.stdout:6/417: write d0/d76/d2f/d41/f45 [2912921,3429] 0 2024-04-25T13:47:03.751 INFO:tasks.workunit.client.0.smithi043.stdout:6/418: readlink d0/d76/l58 0 2024-04-25T13:47:03.751 INFO:tasks.workunit.client.0.smithi043.stdout:8/432: creat db/d46/f8f x:0 0 0 2024-04-25T13:47:03.752 INFO:tasks.workunit.client.0.smithi043.stdout:7/523: link d5/l2b d5/d11/d3b/d3f/d5a/lae 0 2024-04-25T13:47:03.753 INFO:tasks.workunit.client.0.smithi043.stdout:7/524: stat d5/ca 0 2024-04-25T13:47:03.753 INFO:tasks.workunit.client.0.smithi043.stdout:7/525: stat d5/d11/d3b/l99 0 2024-04-25T13:47:03.844 INFO:tasks.workunit.client.0.smithi043.stdout:6/419: rename d0/d76/f37 to d0/d76/d2f/d41/f7f 0 2024-04-25T13:47:03.844 INFO:tasks.workunit.client.0.smithi043.stdout:7/526: creat d5/d11/d3b/d8b/d9b/faf x:0 0 0 2024-04-25T13:47:03.847 INFO:tasks.workunit.client.0.smithi043.stdout:8/433: dwrite db/d11/f3d [0,4194304] 0 2024-04-25T13:47:03.847 INFO:tasks.workunit.client.0.smithi043.stdout:6/420: creat d0/d76/d2f/d41/d48/d73/f80 x:0 0 0 2024-04-25T13:47:03.849 INFO:tasks.workunit.client.0.smithi043.stdout:8/434: rename db/d38/d3c to db/d38/d3c/d71/d5d/d67/d90 22 2024-04-25T13:47:03.850 INFO:tasks.workunit.client.0.smithi043.stdout:7/527: getdents d5/d75/d79 0 2024-04-25T13:47:03.850 INFO:tasks.workunit.client.0.smithi043.stdout:6/421: mkdir d0/d3d/d6e/d81 0 2024-04-25T13:47:03.851 INFO:tasks.workunit.client.0.smithi043.stdout:8/435: creat db/d44/d8e/d27/f91 x:0 0 0 2024-04-25T13:47:03.853 INFO:tasks.workunit.client.0.smithi043.stdout:3/368: dread d0/d9/f20 [0,4194304] 0 2024-04-25T13:47:03.853 INFO:tasks.workunit.client.0.smithi043.stdout:8/436: rmdir db/d46 39 2024-04-25T13:47:03.855 INFO:tasks.workunit.client.0.smithi043.stdout:8/437: readlink db/dc/l3a 0 2024-04-25T13:47:03.856 INFO:tasks.workunit.client.0.smithi043.stdout:6/422: creat d0/d76/f82 x:0 0 0 2024-04-25T13:47:03.857 INFO:tasks.workunit.client.0.smithi043.stdout:7/528: link d5/d11/c2f d5/d75/d54/cb0 0 2024-04-25T13:47:03.859 INFO:tasks.workunit.client.0.smithi043.stdout:3/369: getdents d0/da 0 2024-04-25T13:47:03.860 INFO:tasks.workunit.client.0.smithi043.stdout:6/423: chown d0/c18 18424116 1 2024-04-25T13:47:03.862 INFO:tasks.workunit.client.0.smithi043.stdout:4/343: sync 2024-04-25T13:47:03.862 INFO:tasks.workunit.client.0.smithi043.stdout:7/529: creat d5/fb1 x:0 0 0 2024-04-25T13:47:03.863 INFO:tasks.workunit.client.0.smithi043.stdout:8/438: dread db/d11/f3d [0,4194304] 0 2024-04-25T13:47:03.865 INFO:tasks.workunit.client.0.smithi043.stdout:4/344: write d1/de/d1d/d20/d38/f46 [200432,54512] 0 2024-04-25T13:47:03.867 INFO:tasks.workunit.client.0.smithi043.stdout:7/530: truncate d5/d32/f4e 1935776 0 2024-04-25T13:47:03.868 INFO:tasks.workunit.client.0.smithi043.stdout:4/345: chown d1/de/df/d1a/f64 8319044 1 2024-04-25T13:47:03.868 INFO:tasks.workunit.client.0.smithi043.stdout:8/439: rmdir db/d46 39 2024-04-25T13:47:03.869 INFO:tasks.workunit.client.0.smithi043.stdout:7/531: fdatasync d5/d75/f3e 0 2024-04-25T13:47:03.871 INFO:tasks.workunit.client.0.smithi043.stdout:4/346: write d1/de/d1d/d20/d38/d3a/f6f [342492,2077] 0 2024-04-25T13:47:03.873 INFO:tasks.workunit.client.0.smithi043.stdout:7/532: creat d5/d11/d84/fb2 x:0 0 0 2024-04-25T13:47:03.874 INFO:tasks.workunit.client.0.smithi043.stdout:6/424: dwrite d0/d76/d2f/d41/f7f [0,4194304] 0 2024-04-25T13:47:03.877 INFO:tasks.workunit.client.0.smithi043.stdout:3/370: dread d0/f3 [0,4194304] 0 2024-04-25T13:47:03.878 INFO:tasks.workunit.client.0.smithi043.stdout:4/347: truncate d1/de/df/d1a/d27/f51 3258912 0 2024-04-25T13:47:03.878 INFO:tasks.workunit.client.0.smithi043.stdout:6/425: truncate d0/d24/f6b 67092 0 2024-04-25T13:47:03.880 INFO:tasks.workunit.client.0.smithi043.stdout:8/440: dwrite db/d44/d8e/f56 [0,4194304] 0 2024-04-25T13:47:03.880 INFO:tasks.workunit.client.0.smithi043.stdout:6/426: chown d0/d24/f5b 1426 1 2024-04-25T13:47:03.881 INFO:tasks.workunit.client.0.smithi043.stdout:4/348: write d1/de/f1c [1005295,33607] 0 2024-04-25T13:47:03.882 INFO:tasks.workunit.client.0.smithi043.stdout:3/371: read d0/d13/f27 [1305742,55820] 0 2024-04-25T13:47:03.885 INFO:tasks.workunit.client.0.smithi043.stdout:3/372: dread - d0/d13/d2e/f76 zero size 2024-04-25T13:47:03.888 INFO:tasks.workunit.client.0.smithi043.stdout:7/533: dwrite d5/d11/f24 [0,4194304] 0 2024-04-25T13:47:03.891 INFO:tasks.workunit.client.0.smithi043.stdout:4/349: write d1/de/d1d/d20/d38/f37 [1214101,96031] 0 2024-04-25T13:47:03.893 INFO:tasks.workunit.client.0.smithi043.stdout:7/534: symlink d5/d11/d3b/d3f/d5a/d89/lb3 0 2024-04-25T13:47:03.894 INFO:tasks.workunit.client.0.smithi043.stdout:3/373: mkdir d0/d9/d81 0 2024-04-25T13:47:03.896 INFO:tasks.workunit.client.0.smithi043.stdout:7/535: mkdir d5/d11/db4 0 2024-04-25T13:47:03.907 INFO:tasks.workunit.client.0.smithi043.stdout:3/374: dwrite d0/d13/f3d [4194304,4194304] 0 2024-04-25T13:47:03.909 INFO:tasks.workunit.client.0.smithi043.stdout:3/375: mkdir d0/d61/d82 0 2024-04-25T13:47:03.912 INFO:tasks.workunit.client.0.smithi043.stdout:3/376: mkdir d0/d9/d6e/d34/d83 0 2024-04-25T13:47:03.916 INFO:tasks.workunit.client.0.smithi043.stdout:8/441: rename db/l13 to db/d44/d5c/l92 0 2024-04-25T13:47:03.919 INFO:tasks.workunit.client.0.smithi043.stdout:4/350: rename d1/de/df/d1e/l21 to d1/de/df/d1a/d27/d36/l71 0 2024-04-25T13:47:03.920 INFO:tasks.workunit.client.0.smithi043.stdout:4/351: readlink d1/de/d1d/l43 0 2024-04-25T13:47:03.920 INFO:tasks.workunit.client.0.smithi043.stdout:4/352: readlink d1/de/df/d1e/d28/d33/l50 0 2024-04-25T13:47:03.921 INFO:tasks.workunit.client.0.smithi043.stdout:8/442: symlink db/d44/d8e/d27/l93 0 2024-04-25T13:47:03.927 INFO:tasks.workunit.client.0.smithi043.stdout:4/353: getdents d1/de/df 0 2024-04-25T13:47:03.927 INFO:tasks.workunit.client.0.smithi043.stdout:4/354: chown d1/de/df/d1e/d28/l2e 28363 1 2024-04-25T13:47:03.930 INFO:tasks.workunit.client.0.smithi043.stdout:4/355: creat d1/d34/d35/d3d/f72 x:0 0 0 2024-04-25T13:47:03.934 INFO:tasks.workunit.client.0.smithi043.stdout:4/356: creat d1/de/df/d1a/f73 x:0 0 0 2024-04-25T13:47:03.942 INFO:tasks.workunit.client.0.smithi043.stdout:7/536: rename d5/d11/d3b/d61/f87 to d5/d75/d64/fb5 0 2024-04-25T13:47:03.943 INFO:tasks.workunit.client.0.smithi043.stdout:7/537: readlink d5/l30 0 2024-04-25T13:47:03.943 INFO:tasks.workunit.client.0.smithi043.stdout:4/357: dwrite d1/de/df/f18 [0,4194304] 0 2024-04-25T13:47:03.944 INFO:tasks.workunit.client.0.smithi043.stdout:7/538: fdatasync d5/f72 0 2024-04-25T13:47:03.945 INFO:tasks.workunit.client.0.smithi043.stdout:4/358: read d1/de/d1d/d20/d38/f46 [202330,27548] 0 2024-04-25T13:47:03.946 INFO:tasks.workunit.client.0.smithi043.stdout:7/539: symlink d5/d11/d3b/d61/d68/lb6 0 2024-04-25T13:47:03.947 INFO:tasks.workunit.client.0.smithi043.stdout:7/540: chown d5/d11/d3b/d3f/c5b 840020441 1 2024-04-25T13:47:03.948 INFO:tasks.workunit.client.0.smithi043.stdout:4/359: write d1/de/df/d1a/f4c [1077362,86321] 0 2024-04-25T13:47:03.953 INFO:tasks.workunit.client.0.smithi043.stdout:7/541: read d5/f3c [631433,111117] 0 2024-04-25T13:47:03.953 INFO:tasks.workunit.client.0.smithi043.stdout:4/360: dread d1/de/df/d1a/f65 [0,4194304] 0 2024-04-25T13:47:03.954 INFO:tasks.workunit.client.0.smithi043.stdout:4/361: fsync d1/de/f1c 0 2024-04-25T13:47:03.955 INFO:tasks.workunit.client.0.smithi043.stdout:7/542: write d5/d11/f19 [4529366,25560] 0 2024-04-25T13:47:03.967 INFO:tasks.workunit.client.0.smithi043.stdout:3/377: rename d0/d9/d6e/d34/d36/d57/f5f to d0/d9/d81/f84 0 2024-04-25T13:47:03.969 INFO:tasks.workunit.client.0.smithi043.stdout:3/378: readlink d0/d14/l24 0 2024-04-25T13:47:03.969 INFO:tasks.workunit.client.0.smithi043.stdout:3/379: readlink d0/l47 0 2024-04-25T13:47:03.970 INFO:tasks.workunit.client.0.smithi043.stdout:3/380: write d0/d13/d2e/f76 [615503,68044] 0 2024-04-25T13:47:03.974 INFO:tasks.workunit.client.0.smithi043.stdout:3/381: creat d0/d9/f85 x:0 0 0 2024-04-25T13:47:03.975 INFO:tasks.workunit.client.0.smithi043.stdout:4/362: dread d1/de/df/d1a/f2d [0,4194304] 0 2024-04-25T13:47:03.975 INFO:tasks.workunit.client.0.smithi043.stdout:5/336: sync 2024-04-25T13:47:03.975 INFO:tasks.workunit.client.0.smithi043.stdout:2/307: sync 2024-04-25T13:47:03.975 INFO:tasks.workunit.client.0.smithi043.stdout:1/426: sync 2024-04-25T13:47:03.978 INFO:tasks.workunit.client.0.smithi043.stdout:3/382: read d0/fe [328264,43473] 0 2024-04-25T13:47:03.978 INFO:tasks.workunit.client.0.smithi043.stdout:1/427: mkdir df/d31/d34/d91 0 2024-04-25T13:47:03.979 INFO:tasks.workunit.client.0.smithi043.stdout:5/337: read d1/d3/d7/d8/f44 [4186337,47042] 0 2024-04-25T13:47:03.979 INFO:tasks.workunit.client.0.smithi043.stdout:3/383: dread - d0/d9/f72 zero size 2024-04-25T13:47:03.979 INFO:tasks.workunit.client.0.smithi043.stdout:2/308: mkdir d0/d34/d3f/d59 0 2024-04-25T13:47:03.981 INFO:tasks.workunit.client.0.smithi043.stdout:4/363: creat d1/de/df/d1e/d28/d33/f74 x:0 0 0 2024-04-25T13:47:03.982 INFO:tasks.workunit.client.0.smithi043.stdout:4/364: chown d1/de/df/f18 262 1 2024-04-25T13:47:03.983 INFO:tasks.workunit.client.0.smithi043.stdout:5/338: unlink d1/d3/d7/d2f/d67/f39 0 2024-04-25T13:47:03.988 INFO:tasks.workunit.client.0.smithi043.stdout:2/309: link d0/d34/f20 d0/d5/d1e/d32/f5a 0 2024-04-25T13:47:03.989 INFO:tasks.workunit.client.0.smithi043.stdout:1/428: dwrite df/d14/f56 [0,4194304] 0 2024-04-25T13:47:03.991 INFO:tasks.workunit.client.0.smithi043.stdout:3/384: dwrite d0/f35 [0,4194304] 0 2024-04-25T13:47:03.994 INFO:tasks.workunit.client.0.smithi043.stdout:4/365: link d1/de/d1d/d20/f52 d1/de/df/d1a/d27/d36/d53/d66/f75 0 2024-04-25T13:47:03.996 INFO:tasks.workunit.client.0.smithi043.stdout:7/543: rename d5/f2e to d5/d75/d64/fb7 0 2024-04-25T13:47:03.996 INFO:tasks.workunit.client.0.smithi043.stdout:4/366: chown d1/de/df/d1a/d27/d36/c4a 0 1 2024-04-25T13:47:03.996 INFO:tasks.workunit.client.0.smithi043.stdout:1/429: link df/d31/d38/d3f/f8a df/d14/d3d/d82/d8c/f92 0 2024-04-25T13:47:03.999 INFO:tasks.workunit.client.0.smithi043.stdout:3/385: link d0/d14/f22 d0/d9/f86 0 2024-04-25T13:47:04.002 INFO:tasks.workunit.client.0.smithi043.stdout:1/430: mknod df/d31/d38/d43/d81/c93 0 2024-04-25T13:47:04.002 INFO:tasks.workunit.client.0.smithi043.stdout:1/431: stat df/d14/c64 0 2024-04-25T13:47:04.004 INFO:tasks.workunit.client.0.smithi043.stdout:3/386: stat d0/d9/c54 0 2024-04-25T13:47:04.006 INFO:tasks.workunit.client.0.smithi043.stdout:5/339: rename d1/d3/d7/f61 to d1/d4/f73 0 2024-04-25T13:47:04.008 INFO:tasks.workunit.client.0.smithi043.stdout:4/367: rename d1/de/df/d1e/d45 to d1/de/df/d1e/d45/d76 22 2024-04-25T13:47:04.009 INFO:tasks.workunit.client.0.smithi043.stdout:7/544: creat d5/d75/d79/fb8 x:0 0 0 2024-04-25T13:47:04.009 INFO:tasks.workunit.client.0.smithi043.stdout:3/387: symlink d0/d9/d6e/d38/l87 0 2024-04-25T13:47:04.014 INFO:tasks.workunit.client.0.smithi043.stdout:1/432: dwrite df/d31/f79 [0,4194304] 0 2024-04-25T13:47:04.016 INFO:tasks.workunit.client.0.smithi043.stdout:3/388: creat d0/d13/f88 x:0 0 0 2024-04-25T13:47:04.017 INFO:tasks.workunit.client.0.smithi043.stdout:3/389: chown d0/d9/f20 6 1 2024-04-25T13:47:04.021 INFO:tasks.workunit.client.0.smithi043.stdout:6/427: sync 2024-04-25T13:47:04.021 INFO:tasks.workunit.client.0.smithi043.stdout:0/392: sync 2024-04-25T13:47:04.023 INFO:tasks.workunit.client.0.smithi043.stdout:4/368: mkdir d1/d3/d54/d62/d77 0 2024-04-25T13:47:04.023 INFO:tasks.workunit.client.0.smithi043.stdout:5/340: link d1/d3/d7/d8/da/d2e/f55 d1/d3/d7/d9/d2d/d5b/f74 0 2024-04-25T13:47:04.025 INFO:tasks.workunit.client.0.smithi043.stdout:7/545: creat d5/d11/d3b/fb9 x:0 0 0 2024-04-25T13:47:04.030 INFO:tasks.workunit.client.0.smithi043.stdout:4/369: chown d1/de/d1d/d20/f52 3812 1 2024-04-25T13:47:04.030 INFO:tasks.workunit.client.0.smithi043.stdout:2/310: dread d0/d34/d17/f23 [0,4194304] 0 2024-04-25T13:47:04.030 INFO:tasks.workunit.client.0.smithi043.stdout:5/341: symlink d1/d3/d7/d8/l75 0 2024-04-25T13:47:04.032 INFO:tasks.workunit.client.0.smithi043.stdout:3/390: dwrite d0/d9/f44 [0,4194304] 0 2024-04-25T13:47:04.034 INFO:tasks.workunit.client.0.smithi043.stdout:2/311: dread - d0/d26/f31 zero size 2024-04-25T13:47:04.034 INFO:tasks.workunit.client.0.smithi043.stdout:7/546: mknod d5/d11/d3b/d3f/d5a/d8d/cba 0 2024-04-25T13:47:04.035 INFO:tasks.workunit.client.0.smithi043.stdout:1/433: dwrite df/d31/d34/d8b/f6b [0,4194304] 0 2024-04-25T13:47:04.037 INFO:tasks.workunit.client.0.smithi043.stdout:7/547: write d5/d11/f4d [90566,108815] 0 2024-04-25T13:47:04.037 INFO:tasks.workunit.client.0.smithi043.stdout:4/370: rmdir d1/de/df/d1e 39 2024-04-25T13:47:04.038 INFO:tasks.workunit.client.0.smithi043.stdout:6/428: dread d0/d3d/f62 [0,4194304] 0 2024-04-25T13:47:04.041 INFO:tasks.workunit.client.0.smithi043.stdout:0/393: truncate db/d1b/f47 3575753 0 2024-04-25T13:47:04.044 INFO:tasks.workunit.client.0.smithi043.stdout:6/429: unlink d0/d76/d2f/d41/d4c/c52 0 2024-04-25T13:47:04.068 INFO:tasks.workunit.client.0.smithi043.stdout:3/391: symlink d0/d9/d6e/l89 0 2024-04-25T13:47:04.070 INFO:tasks.workunit.client.0.smithi043.stdout:2/312: creat d0/d26/f5b x:0 0 0 2024-04-25T13:47:04.072 INFO:tasks.workunit.client.0.smithi043.stdout:5/342: truncate d1/d3/d7/d8/da/d11/f25 3929534 0 2024-04-25T13:47:04.073 INFO:tasks.workunit.client.0.smithi043.stdout:6/430: chown d0/c14 3 1 2024-04-25T13:47:04.073 INFO:tasks.workunit.client.0.smithi043.stdout:2/313: read - d0/d26/f31 zero size 2024-04-25T13:47:04.075 INFO:tasks.workunit.client.0.smithi043.stdout:3/392: truncate d0/d13/f27 3097553 0 2024-04-25T13:47:04.076 INFO:tasks.workunit.client.0.smithi043.stdout:7/548: dwrite d5/d11/d3b/fb9 [0,4194304] 0 2024-04-25T13:47:04.077 INFO:tasks.workunit.client.0.smithi043.stdout:0/394: creat db/d1b/d36/d41/d71/f82 x:0 0 0 2024-04-25T13:47:04.079 INFO:tasks.workunit.client.0.smithi043.stdout:4/371: dwrite d1/de/d1d/d20/d38/f37 [0,4194304] 0 2024-04-25T13:47:04.080 INFO:tasks.workunit.client.0.smithi043.stdout:6/431: symlink d0/d3d/d6e/d71/l83 0 2024-04-25T13:47:04.080 INFO:tasks.workunit.client.0.smithi043.stdout:7/549: chown d5/d11/c2a 54973425 1 2024-04-25T13:47:04.080 INFO:tasks.workunit.client.0.smithi043.stdout:0/395: chown db/d5b/d68/c7f 4683 1 2024-04-25T13:47:04.082 INFO:tasks.workunit.client.0.smithi043.stdout:0/396: write db/d5b/f60 [777619,32162] 0 2024-04-25T13:47:04.084 INFO:tasks.workunit.client.0.smithi043.stdout:6/432: mknod d0/d3d/c84 0 2024-04-25T13:47:04.087 INFO:tasks.workunit.client.0.smithi043.stdout:2/314: truncate d0/d34/f20 3027903 0 2024-04-25T13:47:04.091 INFO:tasks.workunit.client.0.smithi043.stdout:0/397: creat db/d5b/f83 x:0 0 0 2024-04-25T13:47:04.092 INFO:tasks.workunit.client.0.smithi043.stdout:6/433: rmdir d0/d76/d2f/d41/d48 39 2024-04-25T13:47:04.099 INFO:tasks.workunit.client.0.smithi043.stdout:6/434: dwrite d0/d76/d5c/f7d [0,4194304] 0 2024-04-25T13:47:04.101 INFO:tasks.workunit.client.0.smithi043.stdout:5/343: truncate d1/d3/d7/d8/f44 423310 0 2024-04-25T13:47:04.102 INFO:tasks.workunit.client.0.smithi043.stdout:4/372: write d1/de/df/f40 [163664,59146] 0 2024-04-25T13:47:04.103 INFO:tasks.workunit.client.0.smithi043.stdout:7/550: truncate d5/d75/d64/fb5 1077011 0 2024-04-25T13:47:04.103 INFO:tasks.workunit.client.0.smithi043.stdout:0/398: symlink db/d1b/d23/d27/d39/l84 0 2024-04-25T13:47:04.103 INFO:tasks.workunit.client.0.smithi043.stdout:8/443: sync 2024-04-25T13:47:04.108 INFO:tasks.workunit.client.0.smithi043.stdout:8/444: rmdir db/d11/d1b/d59 39 2024-04-25T13:47:04.111 INFO:tasks.workunit.client.0.smithi043.stdout:6/435: symlink d0/l85 0 2024-04-25T13:47:04.111 INFO:tasks.workunit.client.0.smithi043.stdout:7/551: dwrite d5/d11/d84/fb2 [0,4194304] 0 2024-04-25T13:47:04.118 INFO:tasks.workunit.client.0.smithi043.stdout:7/552: read d5/f45 [3477749,115695] 0 2024-04-25T13:47:04.118 INFO:tasks.workunit.client.0.smithi043.stdout:0/399: truncate db/d1b/d23/d27/f6b 11353 0 2024-04-25T13:47:04.118 INFO:tasks.workunit.client.0.smithi043.stdout:7/553: stat d5/fd 0 2024-04-25T13:47:04.120 INFO:tasks.workunit.client.0.smithi043.stdout:7/554: fsync d5/fb1 0 2024-04-25T13:47:04.120 INFO:tasks.workunit.client.0.smithi043.stdout:3/393: dread d0/da/f28 [0,4194304] 0 2024-04-25T13:47:04.121 INFO:tasks.workunit.client.0.smithi043.stdout:5/344: creat d1/d3/d7/f76 x:0 0 0 2024-04-25T13:47:04.122 INFO:tasks.workunit.client.0.smithi043.stdout:6/436: read d0/ff [631634,76302] 0 2024-04-25T13:47:04.122 INFO:tasks.workunit.client.0.smithi043.stdout:8/445: truncate db/f35 1502637 0 2024-04-25T13:47:04.124 INFO:tasks.workunit.client.0.smithi043.stdout:0/400: chown db/d1b/d4f/f63 4184 1 2024-04-25T13:47:04.126 INFO:tasks.workunit.client.0.smithi043.stdout:4/373: dwrite d1/de/df/d1a/f65 [0,4194304] 0 2024-04-25T13:47:04.128 INFO:tasks.workunit.client.0.smithi043.stdout:5/345: readlink d1/d4/d42/l5f 0 2024-04-25T13:47:04.128 INFO:tasks.workunit.client.0.smithi043.stdout:6/437: truncate d0/f5d 929452 0 2024-04-25T13:47:04.130 INFO:tasks.workunit.client.0.smithi043.stdout:0/401: readlink db/l11 0 2024-04-25T13:47:04.137 INFO:tasks.workunit.client.0.smithi043.stdout:6/438: dread d0/d3d/d54/f5e [0,4194304] 0 2024-04-25T13:47:04.138 INFO:tasks.workunit.client.0.smithi043.stdout:6/439: write d0/d3d/f6c [307584,23293] 0 2024-04-25T13:47:04.139 INFO:tasks.workunit.client.0.smithi043.stdout:4/374: creat d1/de/df/d1a/d27/f78 x:0 0 0 2024-04-25T13:47:04.139 INFO:tasks.workunit.client.0.smithi043.stdout:1/434: sync 2024-04-25T13:47:04.140 INFO:tasks.workunit.client.0.smithi043.stdout:1/435: chown df/f20 135397 1 2024-04-25T13:47:04.141 INFO:tasks.workunit.client.0.smithi043.stdout:0/402: unlink db/d1b/d36/d41/d71/f82 0 2024-04-25T13:47:04.142 INFO:tasks.workunit.client.0.smithi043.stdout:1/436: chown df/d31/d38/d43/l40 201 1 2024-04-25T13:47:04.143 INFO:tasks.workunit.client.0.smithi043.stdout:5/346: mknod d1/d3/d7/d9/c77 0 2024-04-25T13:47:04.145 INFO:tasks.workunit.client.0.smithi043.stdout:1/437: creat df/d31/d34/f94 x:0 0 0 2024-04-25T13:47:04.145 INFO:tasks.workunit.client.0.smithi043.stdout:1/438: chown df/d31/d38/d3f/d41/f74 1366 1 2024-04-25T13:47:04.146 INFO:tasks.workunit.client.0.smithi043.stdout:6/440: creat d0/d3d/d6e/f86 x:0 0 0 2024-04-25T13:47:04.147 INFO:tasks.workunit.client.0.smithi043.stdout:1/439: write df/d14/d63/d67/f75 [1857177,82829] 0 2024-04-25T13:47:04.148 INFO:tasks.workunit.client.0.smithi043.stdout:1/440: chown df/d31/d34/f6c 54699 1 2024-04-25T13:47:04.149 INFO:tasks.workunit.client.0.smithi043.stdout:3/394: creat d0/d9/d6e/d38/d3f/f8a x:0 0 0 2024-04-25T13:47:04.150 INFO:tasks.workunit.client.0.smithi043.stdout:1/441: unlink df/d31/d38/d43/d81/c93 0 2024-04-25T13:47:04.151 INFO:tasks.workunit.client.0.smithi043.stdout:7/555: getdents d5/d32 0 2024-04-25T13:47:04.154 INFO:tasks.workunit.client.0.smithi043.stdout:0/403: mknod db/d1b/d23/d27/d39/d4c/d74/c85 0 2024-04-25T13:47:04.155 INFO:tasks.workunit.client.0.smithi043.stdout:6/441: dread d0/d24/f6b [0,4194304] 0 2024-04-25T13:47:04.156 INFO:tasks.workunit.client.0.smithi043.stdout:5/347: symlink d1/d3/d7/l78 0 2024-04-25T13:47:04.157 INFO:tasks.workunit.client.0.smithi043.stdout:0/404: stat db/d1b/d23/d27/d39/d4c/f70 0 2024-04-25T13:47:04.158 INFO:tasks.workunit.client.0.smithi043.stdout:3/395: dwrite d0/f2a [8388608,4194304] 0 2024-04-25T13:47:04.162 INFO:tasks.workunit.client.0.smithi043.stdout:0/405: read db/d1b/d23/d27/d39/f3d [2238431,8986] 0 2024-04-25T13:47:04.162 INFO:tasks.workunit.client.0.smithi043.stdout:1/442: truncate df/d14/f56 3327171 0 2024-04-25T13:47:04.164 INFO:tasks.workunit.client.0.smithi043.stdout:6/442: dread d0/f29 [4194304,4194304] 0 2024-04-25T13:47:04.166 INFO:tasks.workunit.client.0.smithi043.stdout:6/443: read d0/ff [1203823,122706] 0 2024-04-25T13:47:04.166 INFO:tasks.workunit.client.0.smithi043.stdout:1/443: mknod df/d31/d38/d43/d53/c95 0 2024-04-25T13:47:04.166 INFO:tasks.workunit.client.0.smithi043.stdout:1/444: readlink df/d31/d34/d8b/d39/l89 0 2024-04-25T13:47:04.169 INFO:tasks.workunit.client.0.smithi043.stdout:1/445: dread df/d31/f48 [0,4194304] 0 2024-04-25T13:47:04.170 INFO:tasks.workunit.client.0.smithi043.stdout:0/406: mkdir db/d25/d2a/d3f/d6a/d86 0 2024-04-25T13:47:04.172 INFO:tasks.workunit.client.0.smithi043.stdout:3/396: creat d0/d9/d6e/d34/f8b x:0 0 0 2024-04-25T13:47:04.173 INFO:tasks.workunit.client.0.smithi043.stdout:6/444: mknod d0/d3d/d54/c87 0 2024-04-25T13:47:04.175 INFO:tasks.workunit.client.0.smithi043.stdout:1/446: readlink df/d14/l1a 0 2024-04-25T13:47:04.177 INFO:tasks.workunit.client.0.smithi043.stdout:1/447: stat df/d14/c29 0 2024-04-25T13:47:04.180 INFO:tasks.workunit.client.0.smithi043.stdout:1/448: read df/d10/d22/f26 [386520,129513] 0 2024-04-25T13:47:04.183 INFO:tasks.workunit.client.0.smithi043.stdout:1/449: mknod df/d14/d63/c96 0 2024-04-25T13:47:04.186 INFO:tasks.workunit.client.0.smithi043.stdout:5/348: dwrite d1/d3/d7/d8/da/d2e/f55 [0,4194304] 0 2024-04-25T13:47:04.188 INFO:tasks.workunit.client.0.smithi043.stdout:8/446: rename db/f16 to db/dc/d21/d4e/d62/f94 0 2024-04-25T13:47:04.192 INFO:tasks.workunit.client.0.smithi043.stdout:1/450: dread df/f16 [0,4194304] 0 2024-04-25T13:47:04.192 INFO:tasks.workunit.client.0.smithi043.stdout:4/375: rename d1/d34/d35/d3d to d1/d3/d54/d62/d77/d79 0 2024-04-25T13:47:04.193 INFO:tasks.workunit.client.0.smithi043.stdout:4/376: chown d1/f14 15 1 2024-04-25T13:47:04.200 INFO:tasks.workunit.client.0.smithi043.stdout:7/556: rename d5/l2b to d5/d11/d3b/d3f/d5a/lbb 0 2024-04-25T13:47:04.205 INFO:tasks.workunit.client.0.smithi043.stdout:0/407: rename db/d1b/d36/f64 to db/d1b/d23/d27/f87 0 2024-04-25T13:47:04.205 INFO:tasks.workunit.client.0.smithi043.stdout:7/557: chown d5/d11/d3b/d8b/l91 1582370417 1 2024-04-25T13:47:04.207 INFO:tasks.workunit.client.0.smithi043.stdout:8/447: dwrite db/dc/d21/d4e/d62/f94 [4194304,4194304] 0 2024-04-25T13:47:04.211 INFO:tasks.workunit.client.0.smithi043.stdout:6/445: dread d0/d1b/f1d [0,4194304] 0 2024-04-25T13:47:04.212 INFO:tasks.workunit.client.0.smithi043.stdout:4/377: dwrite d1/de/df/f16 [0,4194304] 0 2024-04-25T13:47:04.213 INFO:tasks.workunit.client.0.smithi043.stdout:0/408: mknod db/d25/c88 0 2024-04-25T13:47:04.214 INFO:tasks.workunit.client.0.smithi043.stdout:6/446: write d0/d24/f55 [968485,85825] 0 2024-04-25T13:47:04.216 INFO:tasks.workunit.client.0.smithi043.stdout:7/558: write d5/d11/d3b/f70 [3018984,128395] 0 2024-04-25T13:47:04.224 INFO:tasks.workunit.client.0.smithi043.stdout:7/559: creat d5/d11/d84/fbc x:0 0 0 2024-04-25T13:47:04.226 INFO:tasks.workunit.client.0.smithi043.stdout:6/447: fsync d0/d1c/f3b 0 2024-04-25T13:47:04.227 INFO:tasks.workunit.client.0.smithi043.stdout:8/448: creat db/d11/d1b/f95 x:0 0 0 2024-04-25T13:47:04.228 INFO:tasks.workunit.client.0.smithi043.stdout:8/449: fsync db/d11/d1b/f63 0 2024-04-25T13:47:04.229 INFO:tasks.workunit.client.0.smithi043.stdout:8/450: write db/d11/f17 [4424502,49383] 0 2024-04-25T13:47:04.230 INFO:tasks.workunit.client.0.smithi043.stdout:7/560: mknod d5/d11/d3b/d3f/d5a/d8d/cbd 0 2024-04-25T13:47:04.231 INFO:tasks.workunit.client.0.smithi043.stdout:8/451: dread - db/d44/d8e/d27/f75 zero size 2024-04-25T13:47:04.234 INFO:tasks.workunit.client.0.smithi043.stdout:6/448: mkdir d0/d1b/d88 0 2024-04-25T13:47:04.234 INFO:tasks.workunit.client.0.smithi043.stdout:1/451: dread df/d10/d22/d2f/f5d [0,4194304] 0 2024-04-25T13:47:04.234 INFO:tasks.workunit.client.0.smithi043.stdout:7/561: write d5/fb1 [868342,28778] 0 2024-04-25T13:47:04.235 INFO:tasks.workunit.client.0.smithi043.stdout:6/449: chown d0/d3d 0 1 2024-04-25T13:47:04.236 INFO:tasks.workunit.client.0.smithi043.stdout:8/452: creat db/d44/d8e/f96 x:0 0 0 2024-04-25T13:47:04.238 INFO:tasks.workunit.client.0.smithi043.stdout:2/315: dwrite d0/d26/f33 [0,4194304] 0 2024-04-25T13:47:04.240 INFO:tasks.workunit.client.0.smithi043.stdout:8/453: mknod db/d38/d3c/d71/d5d/d67/c97 0 2024-04-25T13:47:04.240 INFO:tasks.workunit.client.0.smithi043.stdout:2/316: mkdir d0/d8/d22/d5c 0 2024-04-25T13:47:04.242 INFO:tasks.workunit.client.0.smithi043.stdout:1/452: getdents df/d31/d38/d43 0 2024-04-25T13:47:04.244 INFO:tasks.workunit.client.0.smithi043.stdout:2/317: write d0/d34/d17/f23 [2766596,94764] 0 2024-04-25T13:47:04.245 INFO:tasks.workunit.client.0.smithi043.stdout:2/318: chown d0/d5/d1e/f1f 1484 1 2024-04-25T13:47:04.245 INFO:tasks.workunit.client.0.smithi043.stdout:1/453: creat df/d31/d38/d3f/d41/f97 x:0 0 0 2024-04-25T13:47:04.247 INFO:tasks.workunit.client.0.smithi043.stdout:8/454: link db/d44/d8e/c36 db/d44/d8e/c98 0 2024-04-25T13:47:04.247 INFO:tasks.workunit.client.0.smithi043.stdout:1/454: chown df/d10/d22 31032539 1 2024-04-25T13:47:04.247 INFO:tasks.workunit.client.0.smithi043.stdout:0/409: dread db/f18 [0,4194304] 0 2024-04-25T13:47:04.248 INFO:tasks.workunit.client.0.smithi043.stdout:7/562: truncate d5/d75/d79/fb8 974480 0 2024-04-25T13:47:04.248 INFO:tasks.workunit.client.0.smithi043.stdout:2/319: truncate d0/d35/f48 781852 0 2024-04-25T13:47:04.250 INFO:tasks.workunit.client.0.smithi043.stdout:1/455: mknod df/d31/d34/d91/c98 0 2024-04-25T13:47:04.250 INFO:tasks.workunit.client.0.smithi043.stdout:2/320: creat d0/d35/f5d x:0 0 0 2024-04-25T13:47:04.251 INFO:tasks.workunit.client.0.smithi043.stdout:3/397: rename d0/d14/f3e to d0/d9/d81/f8c 0 2024-04-25T13:47:04.254 INFO:tasks.workunit.client.0.smithi043.stdout:2/321: read d0/d34/f37 [22699,36841] 0 2024-04-25T13:47:04.256 INFO:tasks.workunit.client.0.smithi043.stdout:8/455: dwrite db/d46/f8f [0,4194304] 0 2024-04-25T13:47:04.257 INFO:tasks.workunit.client.0.smithi043.stdout:2/322: truncate d0/d5/d1e/f1f 4949382 0 2024-04-25T13:47:04.259 INFO:tasks.workunit.client.0.smithi043.stdout:8/456: readlink db/l10 0 2024-04-25T13:47:04.259 INFO:tasks.workunit.client.0.smithi043.stdout:1/456: creat df/d31/d34/d8b/f99 x:0 0 0 2024-04-25T13:47:04.260 INFO:tasks.workunit.client.0.smithi043.stdout:8/457: chown f4 1753267050 1 2024-04-25T13:47:04.260 INFO:tasks.workunit.client.0.smithi043.stdout:5/349: rename d1/d3/d7/d2f/l5a to d1/d3/d7/d8/da/l79 0 2024-04-25T13:47:04.260 INFO:tasks.workunit.client.0.smithi043.stdout:4/378: rename d1/de to d1/de/d1d/d20/d38/d3a/d7a 22 2024-04-25T13:47:04.261 INFO:tasks.workunit.client.0.smithi043.stdout:3/398: mkdir d0/d8d 0 2024-04-25T13:47:04.262 INFO:tasks.workunit.client.0.smithi043.stdout:1/457: symlink df/d31/d38/d43/d81/l9a 0 2024-04-25T13:47:04.264 INFO:tasks.workunit.client.0.smithi043.stdout:4/379: mkdir d1/d3/d7b 0 2024-04-25T13:47:04.266 INFO:tasks.workunit.client.0.smithi043.stdout:7/563: dread d5/d11/d3b/d3f/d5a/f76 [0,4194304] 0 2024-04-25T13:47:04.267 INFO:tasks.workunit.client.0.smithi043.stdout:1/458: creat df/d14/d3d/d82/d8c/f9b x:0 0 0 2024-04-25T13:47:04.268 INFO:tasks.workunit.client.0.smithi043.stdout:4/380: write d1/de/df/d1a/f2d [10241692,73357] 0 2024-04-25T13:47:04.270 INFO:tasks.workunit.client.0.smithi043.stdout:5/350: creat d1/d4/f7a x:0 0 0 2024-04-25T13:47:04.274 INFO:tasks.workunit.client.0.smithi043.stdout:7/564: mknod d5/d11/db4/cbe 0 2024-04-25T13:47:04.275 INFO:tasks.workunit.client.0.smithi043.stdout:4/381: dwrite d1/de/d1d/d20/d38/f37 [0,4194304] 0 2024-04-25T13:47:04.279 INFO:tasks.workunit.client.0.smithi043.stdout:6/450: rename d0/f40 to d0/d76/d2f/f89 0 2024-04-25T13:47:04.280 INFO:tasks.workunit.client.0.smithi043.stdout:5/351: mknod d1/d3/d7/c7b 0 2024-04-25T13:47:04.281 INFO:tasks.workunit.client.0.smithi043.stdout:2/323: dwrite d0/d5/d1e/d32/f5a [0,4194304] 0 2024-04-25T13:47:04.281 INFO:tasks.workunit.client.0.smithi043.stdout:7/565: mkdir d5/d11/d3b/d3f/d5a/d8d/dbf 0 2024-04-25T13:47:04.283 INFO:tasks.workunit.client.0.smithi043.stdout:3/399: write d0/d9/f44 [5273425,59990] 0 2024-04-25T13:47:04.283 INFO:tasks.workunit.client.0.smithi043.stdout:0/410: rename db/d1b/f51 to db/d25/d2a/d3f/d6a/f89 0 2024-04-25T13:47:04.284 INFO:tasks.workunit.client.0.smithi043.stdout:7/566: chown d5/f10 173202749 1 2024-04-25T13:47:04.286 INFO:tasks.workunit.client.0.smithi043.stdout:2/324: mkdir d0/d34/d17/d5e 0 2024-04-25T13:47:04.287 INFO:tasks.workunit.client.0.smithi043.stdout:8/458: rename db/d44/f78 to db/d11/d1b/d8c/f99 0 2024-04-25T13:47:04.287 INFO:tasks.workunit.client.0.smithi043.stdout:5/352: rmdir d1/d3/d7/d9 39 2024-04-25T13:47:04.290 INFO:tasks.workunit.client.0.smithi043.stdout:0/411: symlink db/d5b/l8a 0 2024-04-25T13:47:04.292 INFO:tasks.workunit.client.0.smithi043.stdout:8/459: chown db/d38/c7e 4 1 2024-04-25T13:47:04.292 INFO:tasks.workunit.client.0.smithi043.stdout:3/400: fsync d0/d9/d81/f8c 0 2024-04-25T13:47:04.296 INFO:tasks.workunit.client.0.smithi043.stdout:4/382: dwrite d1/f14 [0,4194304] 0 2024-04-25T13:47:04.296 INFO:tasks.workunit.client.0.smithi043.stdout:0/412: fdatasync db/d1b/d23/d27/f5c 0 2024-04-25T13:47:04.301 INFO:tasks.workunit.client.0.smithi043.stdout:0/413: chown db/d5b/l6f 71642 1 2024-04-25T13:47:04.301 INFO:tasks.workunit.client.0.smithi043.stdout:6/451: dwrite d0/f5d [0,4194304] 0 2024-04-25T13:47:04.301 INFO:tasks.workunit.client.0.smithi043.stdout:3/401: chown d0/d9/d6e/l2b 3854058 1 2024-04-25T13:47:04.302 INFO:tasks.workunit.client.0.smithi043.stdout:5/353: getdents d1/d3/d7/d2f/d67 0 2024-04-25T13:47:04.307 INFO:tasks.workunit.client.0.smithi043.stdout:2/325: dwrite d0/d5/d1e/f1f [0,4194304] 0 2024-04-25T13:47:04.313 INFO:tasks.workunit.client.0.smithi043.stdout:3/402: fsync d0/d13/f27 0 2024-04-25T13:47:04.315 INFO:tasks.workunit.client.0.smithi043.stdout:8/460: dwrite db/d38/d3c/d71/f50 [4194304,4194304] 0 2024-04-25T13:47:04.317 INFO:tasks.workunit.client.0.smithi043.stdout:3/403: fdatasync d0/d9/f62 0 2024-04-25T13:47:04.318 INFO:tasks.workunit.client.0.smithi043.stdout:1/459: rename df/d31/d38/d3f to df/d10/d22/d2f/d9c 0 2024-04-25T13:47:04.321 INFO:tasks.workunit.client.0.smithi043.stdout:4/383: mkdir d1/de/df/d1a/d27/d36/d53/d66/d70/d7c 0 2024-04-25T13:47:04.322 INFO:tasks.workunit.client.0.smithi043.stdout:6/452: truncate d0/d24/f6b 1112646 0 2024-04-25T13:47:04.330 INFO:tasks.workunit.client.0.smithi043.stdout:0/414: dwrite db/d1b/d23/d27/f5a [0,4194304] 0 2024-04-25T13:47:04.332 INFO:tasks.workunit.client.0.smithi043.stdout:4/384: chown d1/de/df/f41 8 1 2024-04-25T13:47:04.340 INFO:tasks.workunit.client.0.smithi043.stdout:2/326: dwrite d0/d8/ff [0,4194304] 0 2024-04-25T13:47:04.344 INFO:tasks.workunit.client.0.smithi043.stdout:5/354: dwrite d1/f19 [4194304,4194304] 0 2024-04-25T13:47:04.344 INFO:tasks.workunit.client.0.smithi043.stdout:7/567: rename d5/d75/d64 to d5/d11/d3b/d61/d68/dc0 0 2024-04-25T13:47:04.345 INFO:tasks.workunit.client.0.smithi043.stdout:8/461: dwrite db/dc/d21/f6b [0,4194304] 0 2024-04-25T13:47:04.347 INFO:tasks.workunit.client.0.smithi043.stdout:0/415: creat db/d25/d2a/d3f/f8b x:0 0 0 2024-04-25T13:47:04.348 INFO:tasks.workunit.client.0.smithi043.stdout:7/568: write d5/f82 [4314227,101811] 0 2024-04-25T13:47:04.349 INFO:tasks.workunit.client.0.smithi043.stdout:4/385: write d1/d3/f68 [4631382,103548] 0 2024-04-25T13:47:04.355 INFO:tasks.workunit.client.0.smithi043.stdout:3/404: rmdir d0 39 2024-04-25T13:47:04.358 INFO:tasks.workunit.client.0.smithi043.stdout:8/462: creat db/d11/d79/d81/f9a x:0 0 0 2024-04-25T13:47:04.358 INFO:tasks.workunit.client.0.smithi043.stdout:1/460: dread df/d10/f12 [0,4194304] 0 2024-04-25T13:47:04.362 INFO:tasks.workunit.client.0.smithi043.stdout:0/416: creat db/d25/d2a/d3f/f8c x:0 0 0 2024-04-25T13:47:04.362 INFO:tasks.workunit.client.0.smithi043.stdout:7/569: dwrite d5/f72 [0,4194304] 0 2024-04-25T13:47:04.363 INFO:tasks.workunit.client.0.smithi043.stdout:2/327: link d0/d5/l44 d0/d35/l5f 0 2024-04-25T13:47:04.365 INFO:tasks.workunit.client.0.smithi043.stdout:7/570: fsync d5/f27 0 2024-04-25T13:47:04.366 INFO:tasks.workunit.client.0.smithi043.stdout:7/571: chown d5/d6b/c74 4049 1 2024-04-25T13:47:04.366 INFO:tasks.workunit.client.0.smithi043.stdout:5/355: rename d1/d3/d7/d8/da/d2e to d1/d3/d24/d7c 0 2024-04-25T13:47:04.368 INFO:tasks.workunit.client.0.smithi043.stdout:0/417: rmdir db/d1b/d23/d27/d39/d4c/d74 39 2024-04-25T13:47:04.369 INFO:tasks.workunit.client.0.smithi043.stdout:7/572: write d5/d11/d3b/d61/f7b [898463,37121] 0 2024-04-25T13:47:04.371 INFO:tasks.workunit.client.0.smithi043.stdout:7/573: fsync d5/d11/f4d 0 2024-04-25T13:47:04.373 INFO:tasks.workunit.client.0.smithi043.stdout:7/574: truncate d5/d11/d3b/d3f/f48 81161 0 2024-04-25T13:47:04.374 INFO:tasks.workunit.client.0.smithi043.stdout:3/405: getdents d0/d13/d2e 0 2024-04-25T13:47:04.377 INFO:tasks.workunit.client.0.smithi043.stdout:4/386: rename d1/de/df/d1a/d49/f59 to d1/d3/d54/d62/d77/f7d 0 2024-04-25T13:47:04.379 INFO:tasks.workunit.client.0.smithi043.stdout:0/418: mknod db/d1b/d62/c8d 0 2024-04-25T13:47:04.381 INFO:tasks.workunit.client.0.smithi043.stdout:8/463: dread db/d11/f15 [0,4194304] 0 2024-04-25T13:47:04.381 INFO:tasks.workunit.client.0.smithi043.stdout:8/464: chown db/d46 1262097 1 2024-04-25T13:47:04.385 INFO:tasks.workunit.client.0.smithi043.stdout:4/387: creat d1/d3/d54/f7e x:0 0 0 2024-04-25T13:47:04.385 INFO:tasks.workunit.client.0.smithi043.stdout:5/356: dread d1/d3/d7/f23 [0,4194304] 0 2024-04-25T13:47:04.389 INFO:tasks.workunit.client.0.smithi043.stdout:2/328: dwrite d0/d34/f37 [0,4194304] 0 2024-04-25T13:47:04.389 INFO:tasks.workunit.client.0.smithi043.stdout:7/575: write d5/d32/f3a [493227,83124] 0 2024-04-25T13:47:04.390 INFO:tasks.workunit.client.0.smithi043.stdout:8/465: fdatasync db/dc/f2f 0 2024-04-25T13:47:04.390 INFO:tasks.workunit.client.0.smithi043.stdout:5/357: mknod d1/d3/d24/d7c/c7d 0 2024-04-25T13:47:04.391 INFO:tasks.workunit.client.0.smithi043.stdout:7/576: write d5/d32/f9d [4532060,37193] 0 2024-04-25T13:47:04.392 INFO:tasks.workunit.client.0.smithi043.stdout:2/329: creat d0/d34/d17/f60 x:0 0 0 2024-04-25T13:47:04.393 INFO:tasks.workunit.client.0.smithi043.stdout:8/466: dread - db/d38/f82 zero size 2024-04-25T13:47:04.394 INFO:tasks.workunit.client.0.smithi043.stdout:4/388: creat d1/d3/d7b/f7f x:0 0 0 2024-04-25T13:47:04.394 INFO:tasks.workunit.client.0.smithi043.stdout:1/461: rename df/f1b to df/d31/d34/f9d 0 2024-04-25T13:47:04.395 INFO:tasks.workunit.client.0.smithi043.stdout:0/419: creat db/d1b/d23/d27/d39/d4c/f8e x:0 0 0 2024-04-25T13:47:04.398 INFO:tasks.workunit.client.0.smithi043.stdout:5/358: write d1/d3/d7/d9/d2d/d5b/f74 [1983162,111995] 0 2024-04-25T13:47:04.399 INFO:tasks.workunit.client.0.smithi043.stdout:4/389: readlink d1/de/df/l26 0 2024-04-25T13:47:04.402 INFO:tasks.workunit.client.0.smithi043.stdout:0/420: write db/f2d [3077791,93974] 0 2024-04-25T13:47:04.403 INFO:tasks.workunit.client.0.smithi043.stdout:4/390: write d1/de/df/d1a/f65 [1472253,14465] 0 2024-04-25T13:47:04.405 INFO:tasks.workunit.client.0.smithi043.stdout:3/406: dwrite d0/d9/d6e/f52 [0,4194304] 0 2024-04-25T13:47:04.406 INFO:tasks.workunit.client.0.smithi043.stdout:4/391: dread - d1/de/df/d1a/f47 zero size 2024-04-25T13:47:04.406 INFO:tasks.workunit.client.0.smithi043.stdout:5/359: read d1/d3/d7/d8/f44 [81353,33717] 0 2024-04-25T13:47:04.408 INFO:tasks.workunit.client.0.smithi043.stdout:7/577: dread d5/d75/d54/f8a [0,4194304] 0 2024-04-25T13:47:04.409 INFO:tasks.workunit.client.0.smithi043.stdout:0/421: creat db/d1b/d62/d72/f8f x:0 0 0 2024-04-25T13:47:04.409 INFO:tasks.workunit.client.0.smithi043.stdout:3/407: mkdir d0/d9/d81/d8e 0 2024-04-25T13:47:04.411 INFO:tasks.workunit.client.0.smithi043.stdout:4/392: unlink d1/de/d1d/d20/d38/d3a/f6f 0 2024-04-25T13:47:04.412 INFO:tasks.workunit.client.0.smithi043.stdout:7/578: symlink d5/d6b/lc1 0 2024-04-25T13:47:04.417 INFO:tasks.workunit.client.0.smithi043.stdout:0/422: dread db/d1b/d23/d27/f6b [0,4194304] 0 2024-04-25T13:47:04.418 INFO:tasks.workunit.client.0.smithi043.stdout:4/393: rename d1/de/df/d1a/l4e to d1/d6a/l80 0 2024-04-25T13:47:04.423 INFO:tasks.workunit.client.0.smithi043.stdout:0/423: creat db/d5b/f90 x:0 0 0 2024-04-25T13:47:04.425 INFO:tasks.workunit.client.0.smithi043.stdout:1/462: write df/d10/d22/f58 [690142,76096] 0 2024-04-25T13:47:04.428 INFO:tasks.workunit.client.0.smithi043.stdout:3/408: symlink d0/da/l8f 0 2024-04-25T13:47:04.429 INFO:tasks.workunit.client.0.smithi043.stdout:1/463: mknod df/d14/d63/c9e 0 2024-04-25T13:47:04.429 INFO:tasks.workunit.client.0.smithi043.stdout:7/579: creat d5/d11/d3b/fc2 x:0 0 0 2024-04-25T13:47:04.433 INFO:tasks.workunit.client.0.smithi043.stdout:7/580: chown d5/d11/d3b/d8b/l91 60 1 2024-04-25T13:47:04.433 INFO:tasks.workunit.client.0.smithi043.stdout:1/464: mkdir df/d14/d63/d67/d9f 0 2024-04-25T13:47:04.434 INFO:tasks.workunit.client.0.smithi043.stdout:5/360: dwrite d1/d3/d24/f3d [4194304,4194304] 0 2024-04-25T13:47:04.436 INFO:tasks.workunit.client.0.smithi043.stdout:4/394: dread d1/de/df/d1a/f58 [0,4194304] 0 2024-04-25T13:47:04.438 INFO:tasks.workunit.client.0.smithi043.stdout:1/465: creat df/d31/d38/d43/fa0 x:0 0 0 2024-04-25T13:47:04.440 INFO:tasks.workunit.client.0.smithi043.stdout:7/581: rename d5/d11/d3b/d61/f7b to d5/d11/d8f/fc3 0 2024-04-25T13:47:04.442 INFO:tasks.workunit.client.0.smithi043.stdout:4/395: mknod d1/d6a/c81 0 2024-04-25T13:47:04.447 INFO:tasks.workunit.client.0.smithi043.stdout:1/466: write df/d14/d3d/d82/d8c/f92 [768145,98317] 0 2024-04-25T13:47:04.452 INFO:tasks.workunit.client.0.smithi043.stdout:1/467: creat df/d10/d22/d2f/d9c/fa1 x:0 0 0 2024-04-25T13:47:04.457 INFO:tasks.workunit.client.0.smithi043.stdout:4/396: truncate d1/de/df/d1a/f2d 2701664 0 2024-04-25T13:47:04.457 INFO:tasks.workunit.client.0.smithi043.stdout:0/424: dwrite db/d25/f2b [0,4194304] 0 2024-04-25T13:47:04.458 INFO:tasks.workunit.client.0.smithi043.stdout:1/468: symlink df/d31/d38/d43/d53/la2 0 2024-04-25T13:47:04.459 INFO:tasks.workunit.client.0.smithi043.stdout:3/409: dwrite d0/f33 [4194304,4194304] 0 2024-04-25T13:47:04.460 INFO:tasks.workunit.client.0.smithi043.stdout:1/469: readlink df/d31/d34/l5c 0 2024-04-25T13:47:04.463 INFO:tasks.workunit.client.0.smithi043.stdout:0/425: symlink db/d25/l91 0 2024-04-25T13:47:04.463 INFO:tasks.workunit.client.0.smithi043.stdout:0/426: chown db/d1b/d62/d72 0 1 2024-04-25T13:47:04.466 INFO:tasks.workunit.client.0.smithi043.stdout:3/410: getdents d0/d13/d55 0 2024-04-25T13:47:04.469 INFO:tasks.workunit.client.0.smithi043.stdout:0/427: rename db/d1b/d23/c3b to db/d1b/d36/c92 0 2024-04-25T13:47:04.470 INFO:tasks.workunit.client.0.smithi043.stdout:1/470: write df/d31/d34/d8b/f6b [4219550,24574] 0 2024-04-25T13:47:04.470 INFO:tasks.workunit.client.0.smithi043.stdout:7/582: dread d5/d75/d79/fa8 [0,4194304] 0 2024-04-25T13:47:04.473 INFO:tasks.workunit.client.0.smithi043.stdout:3/411: mkdir d0/d13/d5a/d90 0 2024-04-25T13:47:04.473 INFO:tasks.workunit.client.0.smithi043.stdout:1/471: chown df/d10/f76 171689 1 2024-04-25T13:47:04.474 INFO:tasks.workunit.client.0.smithi043.stdout:0/428: mkdir db/d25/d2a/d93 0 2024-04-25T13:47:04.475 INFO:tasks.workunit.client.0.smithi043.stdout:3/412: dread - d0/d13/f88 zero size 2024-04-25T13:47:04.479 INFO:tasks.workunit.client.0.smithi043.stdout:3/413: creat d0/d13/d5a/f91 x:0 0 0 2024-04-25T13:47:04.479 INFO:tasks.workunit.client.0.smithi043.stdout:7/583: rename d5/d32/f9d to d5/d11/d84/fc4 0 2024-04-25T13:47:04.483 INFO:tasks.workunit.client.0.smithi043.stdout:7/584: mkdir d5/d11/d3b/d61/dc5 0 2024-04-25T13:47:04.485 INFO:tasks.workunit.client.0.smithi043.stdout:3/414: write d0/da/f43 [1017668,81726] 0 2024-04-25T13:47:04.486 INFO:tasks.workunit.client.0.smithi043.stdout:4/397: dread d1/f14 [4194304,4194304] 0 2024-04-25T13:47:04.487 INFO:tasks.workunit.client.0.smithi043.stdout:7/585: mknod d5/d11/d3b/d8b/d93/cc6 0 2024-04-25T13:47:04.487 INFO:tasks.workunit.client.0.smithi043.stdout:1/472: dread df/d14/d3d/d82/d8c/f92 [0,4194304] 0 2024-04-25T13:47:04.490 INFO:tasks.workunit.client.0.smithi043.stdout:1/473: write df/d10/d22/d2f/d9c/f8a [122757,90244] 0 2024-04-25T13:47:04.491 INFO:tasks.workunit.client.0.smithi043.stdout:1/474: dread - df/d31/d34/f94 zero size 2024-04-25T13:47:04.492 INFO:tasks.workunit.client.0.smithi043.stdout:7/586: read d5/f3c [3001,78781] 0 2024-04-25T13:47:04.493 INFO:tasks.workunit.client.0.smithi043.stdout:0/429: rename db/d5b to db/d1b/d94 0 2024-04-25T13:47:04.494 INFO:tasks.workunit.client.0.smithi043.stdout:1/475: write df/d31/d38/d43/d53/f70 [370423,59561] 0 2024-04-25T13:47:04.497 INFO:tasks.workunit.client.0.smithi043.stdout:0/430: creat db/d25/d2a/d3f/f95 x:0 0 0 2024-04-25T13:47:04.497 INFO:tasks.workunit.client.0.smithi043.stdout:7/587: getdents d5/d11/d80 0 2024-04-25T13:47:04.498 INFO:tasks.workunit.client.0.smithi043.stdout:1/476: creat df/d14/d3d/d82/d8c/fa3 x:0 0 0 2024-04-25T13:47:04.499 INFO:tasks.workunit.client.0.smithi043.stdout:3/415: dread d0/f2 [0,4194304] 0 2024-04-25T13:47:04.500 INFO:tasks.workunit.client.0.smithi043.stdout:3/416: fdatasync d0/d9/d6e/d38/d3f/f56 0 2024-04-25T13:47:04.500 INFO:tasks.workunit.client.0.smithi043.stdout:0/431: unlink db/d1b/f5e 0 2024-04-25T13:47:04.502 INFO:tasks.workunit.client.0.smithi043.stdout:7/588: write d5/f6d [239069,24306] 0 2024-04-25T13:47:04.503 INFO:tasks.workunit.client.0.smithi043.stdout:0/432: chown db/d1b/f26 0 1 2024-04-25T13:47:04.504 INFO:tasks.workunit.client.0.smithi043.stdout:3/417: write d0/fe [306556,62142] 0 2024-04-25T13:47:04.508 INFO:tasks.workunit.client.0.smithi043.stdout:1/477: dwrite df/d10/d22/d2f/d9c/f8a [0,4194304] 0 2024-04-25T13:47:04.509 INFO:tasks.workunit.client.0.smithi043.stdout:0/433: unlink db/d1b/c3a 0 2024-04-25T13:47:04.512 INFO:tasks.workunit.client.0.smithi043.stdout:3/418: write d0/da/fc [3980518,128168] 0 2024-04-25T13:47:04.513 INFO:tasks.workunit.client.0.smithi043.stdout:0/434: readlink db/d1b/d36/d41/l6d 0 2024-04-25T13:47:04.515 INFO:tasks.workunit.client.0.smithi043.stdout:3/419: dread d0/f2 [0,4194304] 0 2024-04-25T13:47:04.516 INFO:tasks.workunit.client.0.smithi043.stdout:7/589: dread d5/d11/f85 [0,4194304] 0 2024-04-25T13:47:04.516 INFO:tasks.workunit.client.0.smithi043.stdout:0/435: fdatasync db/d1b/d23/d27/d39/f3d 0 2024-04-25T13:47:04.520 INFO:tasks.workunit.client.0.smithi043.stdout:7/590: unlink d5/d11/l47 0 2024-04-25T13:47:04.524 INFO:tasks.workunit.client.0.smithi043.stdout:7/591: truncate d5/d11/d3b/d61/d68/f77 557124 0 2024-04-25T13:47:04.525 INFO:tasks.workunit.client.0.smithi043.stdout:7/592: chown d5/c56 113131889 1 2024-04-25T13:47:04.527 INFO:tasks.workunit.client.0.smithi043.stdout:2/330: dwrite d0/d34/f1d [4194304,4194304] 0 2024-04-25T13:47:04.533 INFO:tasks.workunit.client.0.smithi043.stdout:2/331: symlink d0/d5/d1e/l61 0 2024-04-25T13:47:04.536 INFO:tasks.workunit.client.0.smithi043.stdout:1/478: dread df/d10/d22/d2f/d9c/f73 [0,4194304] 0 2024-04-25T13:47:04.537 INFO:tasks.workunit.client.0.smithi043.stdout:1/479: chown df/d31/f60 2014 1 2024-04-25T13:47:04.538 INFO:tasks.workunit.client.0.smithi043.stdout:2/332: dread d0/d34/f37 [0,4194304] 0 2024-04-25T13:47:04.541 INFO:tasks.workunit.client.0.smithi043.stdout:0/436: dread db/d1b/d23/d27/f44 [0,4194304] 0 2024-04-25T13:47:04.544 INFO:tasks.workunit.client.0.smithi043.stdout:3/420: rename d0/d14 to d0/d9/d81/d8e/d92 0 2024-04-25T13:47:04.544 INFO:tasks.workunit.client.0.smithi043.stdout:1/480: truncate df/d31/f48 3193340 0 2024-04-25T13:47:04.548 INFO:tasks.workunit.client.0.smithi043.stdout:2/333: dwrite d0/d34/d17/f41 [0,4194304] 0 2024-04-25T13:47:04.548 INFO:tasks.workunit.client.0.smithi043.stdout:7/593: dread d5/f45 [0,4194304] 0 2024-04-25T13:47:04.549 INFO:tasks.workunit.client.0.smithi043.stdout:1/481: unlink df/d31/d38/d43/f8e 0 2024-04-25T13:47:04.554 INFO:tasks.workunit.client.0.smithi043.stdout:0/437: dwrite db/d25/d2a/d3f/f42 [0,4194304] 0 2024-04-25T13:47:04.556 INFO:tasks.workunit.client.0.smithi043.stdout:7/594: fsync d5/d11/d3b/d61/d68/dc0/f6c 0 2024-04-25T13:47:04.557 INFO:tasks.workunit.client.0.smithi043.stdout:3/421: symlink d0/d13/d55/l93 0 2024-04-25T13:47:04.559 INFO:tasks.workunit.client.0.smithi043.stdout:2/334: truncate d0/d8/d22/f2b 427862 0 2024-04-25T13:47:04.559 INFO:tasks.workunit.client.0.smithi043.stdout:7/595: write d5/d75/d79/fa8 [2274621,9026] 0 2024-04-25T13:47:04.560 INFO:tasks.workunit.client.0.smithi043.stdout:0/438: creat db/d1b/f96 x:0 0 0 2024-04-25T13:47:04.561 INFO:tasks.workunit.client.0.smithi043.stdout:1/482: rename df/d14/f1c to df/d31/d34/d8b/fa4 0 2024-04-25T13:47:04.576 INFO:tasks.workunit.client.0.smithi043.stdout:2/335: dwrite d0/d26/f31 [0,4194304] 0 2024-04-25T13:47:04.578 INFO:tasks.workunit.client.0.smithi043.stdout:0/439: dwrite db/d1b/d23/d27/f75 [0,4194304] 0 2024-04-25T13:47:04.579 INFO:tasks.workunit.client.0.smithi043.stdout:7/596: dwrite d5/d11/d84/fc4 [0,4194304] 0 2024-04-25T13:47:04.584 INFO:tasks.workunit.client.0.smithi043.stdout:7/597: mknod d5/d11/d3b/d61/cc7 0 2024-04-25T13:47:04.589 INFO:tasks.workunit.client.0.smithi043.stdout:0/440: getdents db/d1b/d23/d27/d39 0 2024-04-25T13:47:04.593 INFO:tasks.workunit.client.0.smithi043.stdout:7/598: creat d5/d11/d3b/d61/dc5/fc8 x:0 0 0 2024-04-25T13:47:04.597 INFO:tasks.workunit.client.0.smithi043.stdout:3/422: rename d0/d9/d6e/d38/d3f/l6c to d0/da/l94 0 2024-04-25T13:47:04.597 INFO:tasks.workunit.client.0.smithi043.stdout:7/599: write d5/d11/d3b/d3f/d5a/f76 [3067245,44319] 0 2024-04-25T13:47:04.598 INFO:tasks.workunit.client.0.smithi043.stdout:0/441: mknod db/d1b/d4f/c97 0 2024-04-25T13:47:04.598 INFO:tasks.workunit.client.0.smithi043.stdout:2/336: write d0/d5/d1e/d32/f50 [4596597,18696] 0 2024-04-25T13:47:04.600 INFO:tasks.workunit.client.0.smithi043.stdout:0/442: dread - db/d25/d2a/d3f/f95 zero size 2024-04-25T13:47:04.601 INFO:tasks.workunit.client.0.smithi043.stdout:7/600: read - d5/d11/d3b/d61/dc5/fc8 zero size 2024-04-25T13:47:04.602 INFO:tasks.workunit.client.0.smithi043.stdout:1/483: rename df/d10/d22/d2f/d9c/f73 to df/d14/d63/fa5 0 2024-04-25T13:47:04.603 INFO:tasks.workunit.client.0.smithi043.stdout:1/484: chown df/d14/d63/d67 3712407 1 2024-04-25T13:47:04.603 INFO:tasks.workunit.client.0.smithi043.stdout:0/443: mkdir db/d1b/d23/d27/d98 0 2024-04-25T13:47:04.604 INFO:tasks.workunit.client.0.smithi043.stdout:1/485: fdatasync fe 0 2024-04-25T13:47:04.604 INFO:tasks.workunit.client.0.smithi043.stdout:7/601: creat d5/d11/d80/fc9 x:0 0 0 2024-04-25T13:47:04.607 INFO:tasks.workunit.client.0.smithi043.stdout:1/486: creat df/d10/fa6 x:0 0 0 2024-04-25T13:47:04.609 INFO:tasks.workunit.client.0.smithi043.stdout:7/602: unlink d5/d11/f41 0 2024-04-25T13:47:04.609 INFO:tasks.workunit.client.0.smithi043.stdout:2/337: dwrite d0/d34/f1a [0,4194304] 0 2024-04-25T13:47:04.610 INFO:tasks.workunit.client.0.smithi043.stdout:7/603: fsync d5/d11/f14 0 2024-04-25T13:47:04.612 INFO:tasks.workunit.client.0.smithi043.stdout:7/604: creat d5/d11/db4/fca x:0 0 0 2024-04-25T13:47:04.613 INFO:tasks.workunit.client.0.smithi043.stdout:1/487: truncate f3 2897784 0 2024-04-25T13:47:04.613 INFO:tasks.workunit.client.0.smithi043.stdout:0/444: symlink db/d1b/d23/d27/d39/d4b/l99 0 2024-04-25T13:47:04.615 INFO:tasks.workunit.client.0.smithi043.stdout:0/445: write db/d25/f2b [1616793,117951] 0 2024-04-25T13:47:04.616 INFO:tasks.workunit.client.0.smithi043.stdout:1/488: mkdir df/d14/d63/d67/da7 0 2024-04-25T13:47:04.616 INFO:tasks.workunit.client.0.smithi043.stdout:0/446: truncate db/d25/d2a/d3f/f95 37692 0 2024-04-25T13:47:04.618 INFO:tasks.workunit.client.0.smithi043.stdout:0/447: write db/d1b/d94/f79 [919090,85302] 0 2024-04-25T13:47:04.620 INFO:tasks.workunit.client.0.smithi043.stdout:1/489: creat df/d14/fa8 x:0 0 0 2024-04-25T13:47:04.621 INFO:tasks.workunit.client.0.smithi043.stdout:1/490: chown df/d31/d38/d43/d53 0 1 2024-04-25T13:47:04.624 INFO:tasks.workunit.client.0.smithi043.stdout:7/605: getdents d5/d11 0 2024-04-25T13:47:04.629 INFO:tasks.workunit.client.0.smithi043.stdout:7/606: symlink d5/d11/d3b/d8b/lcb 0 2024-04-25T13:47:04.631 INFO:tasks.workunit.client.0.smithi043.stdout:1/491: dwrite df/d10/f76 [0,4194304] 0 2024-04-25T13:47:04.632 INFO:tasks.workunit.client.0.smithi043.stdout:7/607: truncate d5/d6b/f92 1032450 0 2024-04-25T13:47:04.632 INFO:tasks.workunit.client.0.smithi043.stdout:7/608: readlink d5/d11/d3b/d3f/l4f 0 2024-04-25T13:47:04.636 INFO:tasks.workunit.client.0.smithi043.stdout:0/448: stat db/d1b/d4f/l67 0 2024-04-25T13:47:04.637 INFO:tasks.workunit.client.0.smithi043.stdout:0/449: stat db/d1b/f96 0 2024-04-25T13:47:04.638 INFO:tasks.workunit.client.0.smithi043.stdout:1/492: dwrite df/d31/d34/f6c [0,4194304] 0 2024-04-25T13:47:04.639 INFO:tasks.workunit.client.0.smithi043.stdout:3/423: rename d0/d9/d6e/d38/f6a to d0/d9/f95 0 2024-04-25T13:47:04.643 INFO:tasks.workunit.client.0.smithi043.stdout:3/424: chown d0/d9/f86 0 1 2024-04-25T13:47:04.643 INFO:tasks.workunit.client.0.smithi043.stdout:1/493: mknod df/d14/d3d/d82/d8c/ca9 0 2024-04-25T13:47:04.643 INFO:tasks.workunit.client.0.smithi043.stdout:7/609: truncate d5/d75/d79/fa8 4012995 0 2024-04-25T13:47:04.645 INFO:tasks.workunit.client.0.smithi043.stdout:0/450: link db/d1b/d23/d27/d39/d4c/f77 db/d1b/d62/d72/f9a 0 2024-04-25T13:47:04.647 INFO:tasks.workunit.client.0.smithi043.stdout:7/610: mkdir d5/d11/d3b/d61/dc5/dcc 0 2024-04-25T13:47:04.649 INFO:tasks.workunit.client.0.smithi043.stdout:0/451: write db/d1b/d94/f79 [1185830,93816] 0 2024-04-25T13:47:04.649 INFO:tasks.workunit.client.0.smithi043.stdout:1/494: dread df/d10/d22/f88 [0,4194304] 0 2024-04-25T13:47:04.649 INFO:tasks.workunit.client.0.smithi043.stdout:7/611: symlink d5/d11/lcd 0 2024-04-25T13:47:04.652 INFO:tasks.workunit.client.0.smithi043.stdout:3/425: creat d0/f96 x:0 0 0 2024-04-25T13:47:04.653 INFO:tasks.workunit.client.0.smithi043.stdout:1/495: rmdir df/d31/d34/d91 39 2024-04-25T13:47:04.659 INFO:tasks.workunit.client.0.smithi043.stdout:1/496: link df/d31/d34/f9d df/d31/d38/d43/faa 0 2024-04-25T13:47:04.662 INFO:tasks.workunit.client.0.smithi043.stdout:7/612: unlink d5/d32/f3d 0 2024-04-25T13:47:04.662 INFO:tasks.workunit.client.0.smithi043.stdout:1/497: creat df/d31/d34/d91/fab x:0 0 0 2024-04-25T13:47:04.664 INFO:tasks.workunit.client.0.smithi043.stdout:0/452: dwrite db/fc [0,4194304] 0 2024-04-25T13:47:04.664 INFO:tasks.workunit.client.0.smithi043.stdout:7/613: chown d5/d11/ca6 5 1 2024-04-25T13:47:04.667 INFO:tasks.workunit.client.0.smithi043.stdout:1/498: creat df/d14/d3d/d82/fac x:0 0 0 2024-04-25T13:47:04.667 INFO:tasks.workunit.client.0.smithi043.stdout:3/426: rmdir d0/d13/d2e 39 2024-04-25T13:47:04.669 INFO:tasks.workunit.client.0.smithi043.stdout:2/338: rename d0/d34/f1d to d0/d34/d3f/d59/f62 0 2024-04-25T13:47:04.672 INFO:tasks.workunit.client.0.smithi043.stdout:0/453: dread db/fc [0,4194304] 0 2024-04-25T13:47:04.672 INFO:tasks.workunit.client.0.smithi043.stdout:1/499: mknod df/d31/d38/d43/d81/cad 0 2024-04-25T13:47:04.675 INFO:tasks.workunit.client.0.smithi043.stdout:7/614: dwrite d5/d75/f3e [0,4194304] 0 2024-04-25T13:47:04.675 INFO:tasks.workunit.client.0.smithi043.stdout:1/500: readlink df/d31/d38/d43/d53/l69 0 2024-04-25T13:47:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:2/339: rename d0/d26/f4a to d0/f63 0 2024-04-25T13:47:04.677 INFO:tasks.workunit.client.0.smithi043.stdout:3/427: symlink d0/d9/l97 0 2024-04-25T13:47:04.681 INFO:tasks.workunit.client.0.smithi043.stdout:0/454: dwrite db/d1b/d23/d27/f5a [0,4194304] 0 2024-04-25T13:47:04.690 INFO:tasks.workunit.client.0.smithi043.stdout:0/455: dwrite db/d1b/d23/d27/d39/d4c/f8e [0,4194304] 0 2024-04-25T13:47:04.692 INFO:tasks.workunit.client.0.smithi043.stdout:6/453: sync 2024-04-25T13:47:04.694 INFO:tasks.workunit.client.0.smithi043.stdout:6/454: write d0/d3d/d54/f68 [166745,78484] 0 2024-04-25T13:47:04.698 INFO:tasks.workunit.client.0.smithi043.stdout:6/455: creat d0/d76/d5c/f8a x:0 0 0 2024-04-25T13:47:04.699 INFO:tasks.workunit.client.0.smithi043.stdout:0/456: truncate db/d25/f2b 579399 0 2024-04-25T13:47:04.700 INFO:tasks.workunit.client.0.smithi043.stdout:3/428: write d0/d9/d81/f8c [3152610,73170] 0 2024-04-25T13:47:04.703 INFO:tasks.workunit.client.0.smithi043.stdout:2/340: mknod d0/d34/d3f/d46/d55/c64 0 2024-04-25T13:47:04.706 INFO:tasks.workunit.client.0.smithi043.stdout:6/456: mknod d0/d76/d2f/d64/c8b 0 2024-04-25T13:47:04.707 INFO:tasks.workunit.client.0.smithi043.stdout:2/341: creat d0/d34/d3f/d46/d55/f65 x:0 0 0 2024-04-25T13:47:04.707 INFO:tasks.workunit.client.0.smithi043.stdout:2/342: dread - d0/d26/f40 zero size 2024-04-25T13:47:04.711 INFO:tasks.workunit.client.0.smithi043.stdout:6/457: chown d0/d76/d2f/d41/d4c/l5f 24 1 2024-04-25T13:47:04.714 INFO:tasks.workunit.client.0.smithi043.stdout:2/343: mkdir d0/d66 0 2024-04-25T13:47:04.716 INFO:tasks.workunit.client.0.smithi043.stdout:0/457: dwrite db/d1b/d62/d72/f9a [0,4194304] 0 2024-04-25T13:47:04.719 INFO:tasks.workunit.client.0.smithi043.stdout:2/344: mknod d0/d4b/c67 0 2024-04-25T13:47:04.719 INFO:tasks.workunit.client.0.smithi043.stdout:0/458: rmdir db/d1b/d62/d72 39 2024-04-25T13:47:04.721 INFO:tasks.workunit.client.0.smithi043.stdout:0/459: truncate db/d1b/d94/f90 1002179 0 2024-04-25T13:47:04.725 INFO:tasks.workunit.client.0.smithi043.stdout:6/458: rename d0/d76/d2f/d41/f69 to d0/d76/d2f/d41/f8c 0 2024-04-25T13:47:04.727 INFO:tasks.workunit.client.0.smithi043.stdout:0/460: mknod db/d1b/d23/d27/d39/d4c/c9b 0 2024-04-25T13:47:04.728 INFO:tasks.workunit.client.0.smithi043.stdout:0/461: chown db/d25/d2a/f7a 158 1 2024-04-25T13:47:04.731 INFO:tasks.workunit.client.0.smithi043.stdout:2/345: write d0/d8/d22/f2b [826110,1393] 0 2024-04-25T13:47:04.732 INFO:tasks.workunit.client.0.smithi043.stdout:3/429: rename d0/f33 to d0/d9/d6e/d34/d36/d57/f98 0 2024-04-25T13:47:04.735 INFO:tasks.workunit.client.0.smithi043.stdout:0/462: write db/d1b/f47 [675680,9676] 0 2024-04-25T13:47:04.736 INFO:tasks.workunit.client.0.smithi043.stdout:0/463: stat db/d1b/d94/f83 0 2024-04-25T13:47:04.737 INFO:tasks.workunit.client.0.smithi043.stdout:6/459: rename d0/d76/f34 to d0/d1c/f8d 0 2024-04-25T13:47:04.738 INFO:tasks.workunit.client.0.smithi043.stdout:0/464: creat db/d1b/d94/d68/f9c x:0 0 0 2024-04-25T13:47:04.743 INFO:tasks.workunit.client.0.smithi043.stdout:0/465: mkdir db/d25/d2a/d9d 0 2024-04-25T13:47:04.747 INFO:tasks.workunit.client.0.smithi043.stdout:0/466: link db/d1b/d94/f79 db/d1b/d23/d27/d98/f9e 0 2024-04-25T13:47:04.750 INFO:tasks.workunit.client.0.smithi043.stdout:6/460: dwrite d0/f13 [0,4194304] 0 2024-04-25T13:47:04.750 INFO:tasks.workunit.client.0.smithi043.stdout:0/467: symlink db/d1b/d94/d68/l9f 0 2024-04-25T13:47:04.756 INFO:tasks.workunit.client.0.smithi043.stdout:0/468: creat db/d1b/d23/d27/fa0 x:0 0 0 2024-04-25T13:47:04.756 INFO:tasks.workunit.client.0.smithi043.stdout:2/346: link d0/d34/f37 d0/d4b/f68 0 2024-04-25T13:47:04.757 INFO:tasks.workunit.client.0.smithi043.stdout:3/430: dwrite d0/d9/f62 [0,4194304] 0 2024-04-25T13:47:04.757 INFO:tasks.workunit.client.0.smithi043.stdout:6/461: mknod d0/c8e 0 2024-04-25T13:47:04.758 INFO:tasks.workunit.client.0.smithi043.stdout:6/462: chown d0/d24/l2d 1 1 2024-04-25T13:47:04.759 INFO:tasks.workunit.client.0.smithi043.stdout:0/469: mkdir db/d1b/d94/da1 0 2024-04-25T13:47:04.761 INFO:tasks.workunit.client.0.smithi043.stdout:3/431: write d0/d9/f72 [108347,124196] 0 2024-04-25T13:47:04.762 INFO:tasks.workunit.client.0.smithi043.stdout:6/463: creat d0/d3d/d6e/d71/f8f x:0 0 0 2024-04-25T13:47:04.764 INFO:tasks.workunit.client.0.smithi043.stdout:3/432: mknod d0/d9/d81/d8e/c99 0 2024-04-25T13:47:04.764 INFO:tasks.workunit.client.0.smithi043.stdout:0/470: read db/d25/f2b [334500,85079] 0 2024-04-25T13:47:04.772 INFO:tasks.workunit.client.0.smithi043.stdout:0/471: dwrite f8 [0,4194304] 0 2024-04-25T13:47:04.776 INFO:tasks.workunit.client.0.smithi043.stdout:0/472: mkdir db/d1b/d62/d72/da2 0 2024-04-25T13:47:04.778 INFO:tasks.workunit.client.0.smithi043.stdout:0/473: creat db/d25/fa3 x:0 0 0 2024-04-25T13:47:04.780 INFO:tasks.workunit.client.0.smithi043.stdout:0/474: creat db/d25/d2a/d3f/d6a/d86/fa4 x:0 0 0 2024-04-25T13:47:04.782 INFO:tasks.workunit.client.0.smithi043.stdout:0/475: symlink db/d1b/d94/da1/la5 0 2024-04-25T13:47:04.783 INFO:tasks.workunit.client.0.smithi043.stdout:0/476: write db/d1b/d94/f83 [282381,85102] 0 2024-04-25T13:47:04.786 INFO:tasks.workunit.client.0.smithi043.stdout:0/477: symlink db/d25/d2a/d9d/la6 0 2024-04-25T13:47:04.787 INFO:tasks.workunit.client.0.smithi043.stdout:0/478: read - db/d25/d2a/d3f/f8c zero size 2024-04-25T13:47:04.788 INFO:tasks.workunit.client.0.smithi043.stdout:0/479: chown db/d1b/d94/d68/c7f 475173 1 2024-04-25T13:47:04.790 INFO:tasks.workunit.client.0.smithi043.stdout:0/480: creat db/d1b/d36/d41/d71/fa7 x:0 0 0 2024-04-25T13:47:04.801 INFO:tasks.workunit.client.0.smithi043.stdout:0/481: truncate db/d1b/d62/d72/f9a 1936670 0 2024-04-25T13:47:04.819 INFO:tasks.workunit.client.0.smithi043.stdout:0/482: link db/d1b/d4f/f58 db/d1b/d23/d27/d39/d4b/fa8 0 2024-04-25T13:47:04.823 INFO:tasks.workunit.client.0.smithi043.stdout:2/347: rename d0/d34/d3f/d46/f56 to d0/d8/f69 0 2024-04-25T13:47:04.826 INFO:tasks.workunit.client.0.smithi043.stdout:0/483: dwrite db/d25/d2a/d3f/f8c [0,4194304] 0 2024-04-25T13:47:04.827 INFO:tasks.workunit.client.0.smithi043.stdout:6/464: rename d0/d76/d2f/d41 to d0/d90 0 2024-04-25T13:47:04.829 INFO:tasks.workunit.client.0.smithi043.stdout:2/348: unlink d0/d34/l3c 0 2024-04-25T13:47:04.829 INFO:tasks.workunit.client.0.smithi043.stdout:0/484: truncate db/d1b/d4f/f58 773599 0 2024-04-25T13:47:04.831 INFO:tasks.workunit.client.0.smithi043.stdout:0/485: write f6 [1200544,23336] 0 2024-04-25T13:47:04.834 INFO:tasks.workunit.client.0.smithi043.stdout:6/465: link d0/l85 d0/d90/d48/d4d/l91 0 2024-04-25T13:47:04.835 INFO:tasks.workunit.client.0.smithi043.stdout:6/466: chown d0/f13 2849887 1 2024-04-25T13:47:04.837 INFO:tasks.workunit.client.0.smithi043.stdout:0/486: mkdir db/d1b/d23/d27/d39/d4c/da9 0 2024-04-25T13:47:04.838 INFO:tasks.workunit.client.0.smithi043.stdout:6/467: read d0/d90/d4c/f61 [1675406,90681] 0 2024-04-25T13:47:04.841 INFO:tasks.workunit.client.0.smithi043.stdout:2/349: symlink d0/d34/d17/l6a 0 2024-04-25T13:47:04.842 INFO:tasks.workunit.client.0.smithi043.stdout:6/468: link d0/d3d/d6e/d71/l83 d0/d3d/d6e/d71/l92 0 2024-04-25T13:47:04.843 INFO:tasks.workunit.client.0.smithi043.stdout:2/350: rmdir d0/d26 39 2024-04-25T13:47:04.844 INFO:tasks.workunit.client.0.smithi043.stdout:0/487: dwrite db/d1b/d23/d27/f5a [0,4194304] 0 2024-04-25T13:47:04.844 INFO:tasks.workunit.client.0.smithi043.stdout:6/469: mknod d0/d1b/c93 0 2024-04-25T13:47:04.848 INFO:tasks.workunit.client.0.smithi043.stdout:2/351: link d0/f63 d0/d5/d1e/f6b 0 2024-04-25T13:47:04.849 INFO:tasks.workunit.client.0.smithi043.stdout:2/352: chown d0/d34/l2e 2 1 2024-04-25T13:47:04.849 INFO:tasks.workunit.client.0.smithi043.stdout:0/488: read db/d1b/d94/f90 [613521,114602] 0 2024-04-25T13:47:04.849 INFO:tasks.workunit.client.0.smithi043.stdout:6/470: creat d0/d24/f94 x:0 0 0 2024-04-25T13:47:04.852 INFO:tasks.workunit.client.0.smithi043.stdout:0/489: symlink db/d1b/d94/laa 0 2024-04-25T13:47:04.854 INFO:tasks.workunit.client.0.smithi043.stdout:0/490: mknod db/d25/d2a/d9d/cab 0 2024-04-25T13:47:04.854 INFO:tasks.workunit.client.0.smithi043.stdout:8/467: sync 2024-04-25T13:47:04.858 INFO:tasks.workunit.client.0.smithi043.stdout:0/491: truncate db/d1b/d62/d72/f9a 1933065 0 2024-04-25T13:47:04.866 INFO:tasks.workunit.client.0.smithi043.stdout:0/492: dwrite f6 [0,4194304] 0 2024-04-25T13:47:04.867 INFO:tasks.workunit.client.0.smithi043.stdout:6/471: dread d0/f16 [0,4194304] 0 2024-04-25T13:47:04.868 INFO:tasks.workunit.client.0.smithi043.stdout:0/493: truncate db/d25/d2a/d3f/d6a/d86/fa4 521010 0 2024-04-25T13:47:04.869 INFO:tasks.workunit.client.0.smithi043.stdout:6/472: fdatasync d0/d3d/f5a 0 2024-04-25T13:47:04.870 INFO:tasks.workunit.client.0.smithi043.stdout:6/473: fdatasync d0/d24/f50 0 2024-04-25T13:47:04.871 INFO:tasks.workunit.client.0.smithi043.stdout:0/494: truncate db/d1b/d23/d27/d39/f7b 900897 0 2024-04-25T13:47:04.878 INFO:tasks.workunit.client.0.smithi043.stdout:6/474: unlink d0/c17 0 2024-04-25T13:47:04.879 INFO:tasks.workunit.client.0.smithi043.stdout:2/353: link d0/l6 d0/d34/d3f/d46/l6c 0 2024-04-25T13:47:04.880 INFO:tasks.workunit.client.0.smithi043.stdout:2/354: chown d0/d35/f48 16338 1 2024-04-25T13:47:04.880 INFO:tasks.workunit.client.0.smithi043.stdout:0/495: creat db/d1b/d23/d27/d39/d4c/da9/fac x:0 0 0 2024-04-25T13:47:04.882 INFO:tasks.workunit.client.0.smithi043.stdout:6/475: mknod d0/d24/d3a/c95 0 2024-04-25T13:47:04.886 INFO:tasks.workunit.client.0.smithi043.stdout:6/476: unlink d0/d3d/f5a 0 2024-04-25T13:47:04.890 INFO:tasks.workunit.client.0.smithi043.stdout:2/355: rmdir d0/d66 0 2024-04-25T13:47:04.893 INFO:tasks.workunit.client.0.smithi043.stdout:6/477: fdatasync d0/f31 0 2024-04-25T13:47:04.895 INFO:tasks.workunit.client.0.smithi043.stdout:2/356: creat d0/d8/d22/f6d x:0 0 0 2024-04-25T13:47:04.896 INFO:tasks.workunit.client.0.smithi043.stdout:2/357: getdents d0/d34/d17/d5e 0 2024-04-25T13:47:04.899 INFO:tasks.workunit.client.0.smithi043.stdout:6/478: mkdir d0/d1b/d96 0 2024-04-25T13:47:04.900 INFO:tasks.workunit.client.0.smithi043.stdout:2/358: creat d0/d5/d2f/f6e x:0 0 0 2024-04-25T13:47:04.904 INFO:tasks.workunit.client.0.smithi043.stdout:0/496: write db/d1b/d23/d27/d39/d4c/f77 [1444968,113082] 0 2024-04-25T13:47:04.908 INFO:tasks.workunit.client.0.smithi043.stdout:6/479: rmdir d0/d3d/d6e/d81 0 2024-04-25T13:47:04.911 INFO:tasks.workunit.client.0.smithi043.stdout:0/497: dwrite db/d25/d2a/f7a [0,4194304] 0 2024-04-25T13:47:04.911 INFO:tasks.workunit.client.0.smithi043.stdout:6/480: mknod d0/c97 0 2024-04-25T13:47:04.915 INFO:tasks.workunit.client.0.smithi043.stdout:6/481: creat d0/d24/d3a/f98 x:0 0 0 2024-04-25T13:47:04.917 INFO:tasks.workunit.client.0.smithi043.stdout:6/482: read d0/d90/d4c/f61 [4072540,78748] 0 2024-04-25T13:47:04.922 INFO:tasks.workunit.client.0.smithi043.stdout:6/483: mknod d0/d76/d2f/d64/c99 0 2024-04-25T13:47:04.924 INFO:tasks.workunit.client.0.smithi043.stdout:6/484: mknod d0/d90/d48/c9a 0 2024-04-25T13:47:04.926 INFO:tasks.workunit.client.0.smithi043.stdout:6/485: creat d0/d76/d2f/d64/f9b x:0 0 0 2024-04-25T13:47:04.932 INFO:tasks.workunit.client.0.smithi043.stdout:0/498: rename db/d1b/d94/l6f to db/d1b/d4f/lad 0 2024-04-25T13:47:04.935 INFO:tasks.workunit.client.0.smithi043.stdout:0/499: unlink db/l13 0 2024-04-25T13:47:04.936 INFO:tasks.workunit.client.0.smithi043.stdout:0/500: readlink db/d1b/d23/l32 0 2024-04-25T13:47:04.942 INFO:tasks.workunit.client.0.smithi043.stdout:6/486: dread d0/d90/d48/d4d/f53 [0,4194304] 0 2024-04-25T13:47:04.945 INFO:tasks.workunit.client.0.smithi043.stdout:6/487: unlink d0/f4 0 2024-04-25T13:47:04.948 INFO:tasks.workunit.client.0.smithi043.stdout:6/488: mknod d0/d1b/d96/c9c 0 2024-04-25T13:47:04.949 INFO:tasks.workunit.client.0.smithi043.stdout:6/489: dread - d0/d3d/d6e/d71/f8f zero size 2024-04-25T13:47:04.952 INFO:tasks.workunit.client.0.smithi043.stdout:6/490: read d0/d1c/f8d [3987929,52070] 0 2024-04-25T13:47:04.953 INFO:tasks.workunit.client.0.smithi043.stdout:6/491: stat d0/l39 0 2024-04-25T13:47:04.955 INFO:tasks.workunit.client.0.smithi043.stdout:6/492: mkdir d0/d90/d48/d9d 0 2024-04-25T13:47:04.956 INFO:tasks.workunit.client.0.smithi043.stdout:6/493: mknod d0/d24/d3a/c9e 0 2024-04-25T13:47:04.965 INFO:tasks.workunit.client.0.smithi043.stdout:6/494: write d0/d24/f6b [2076176,101608] 0 2024-04-25T13:47:04.970 INFO:tasks.workunit.client.0.smithi043.stdout:6/495: creat d0/d3d/d54/f9f x:0 0 0 2024-04-25T13:47:04.973 INFO:tasks.workunit.client.0.smithi043.stdout:6/496: rmdir d0/d24/d3a 39 2024-04-25T13:47:04.980 INFO:tasks.workunit.client.0.smithi043.stdout:6/497: link d0/d1c/c2a d0/d90/d4c/ca0 0 2024-04-25T13:47:04.980 INFO:tasks.workunit.client.0.smithi043.stdout:4/398: sync 2024-04-25T13:47:04.980 INFO:tasks.workunit.client.0.smithi043.stdout:7/615: sync 2024-04-25T13:47:04.981 INFO:tasks.workunit.client.0.smithi043.stdout:5/361: sync 2024-04-25T13:47:04.982 INFO:tasks.workunit.client.0.smithi043.stdout:6/498: write d0/d3d/f62 [1492114,80305] 0 2024-04-25T13:47:04.984 INFO:tasks.workunit.client.0.smithi043.stdout:5/362: mknod d1/c7e 0 2024-04-25T13:47:04.985 INFO:tasks.workunit.client.0.smithi043.stdout:5/363: truncate d1/d4/f7a 862416 0 2024-04-25T13:47:04.987 INFO:tasks.workunit.client.0.smithi043.stdout:7/616: rename d5/d11/d3b/d8b/f9e to d5/d11/d3b/d61/d68/fce 0 2024-04-25T13:47:04.988 INFO:tasks.workunit.client.0.smithi043.stdout:4/399: creat d1/de/d1d/d20/f82 x:0 0 0 2024-04-25T13:47:04.988 INFO:tasks.workunit.client.0.smithi043.stdout:5/364: fsync d1/d3/d7/d2f/d67/f51 0 2024-04-25T13:47:04.990 INFO:tasks.workunit.client.0.smithi043.stdout:6/499: rename d0/d90/d48/d4d to d0/d76/d2f/d64/da1 0 2024-04-25T13:47:04.991 INFO:tasks.workunit.client.0.smithi043.stdout:4/400: mkdir d1/d34/d83 0 2024-04-25T13:47:04.993 INFO:tasks.workunit.client.0.smithi043.stdout:7/617: link d5/d11/f63 d5/d11/d3b/d61/dc5/fcf 0 2024-04-25T13:47:04.994 INFO:tasks.workunit.client.0.smithi043.stdout:4/401: write d1/d3/d7b/f7f [459836,72170] 0 2024-04-25T13:47:04.996 INFO:tasks.workunit.client.0.smithi043.stdout:5/365: dwrite d1/d3/d26/f27 [0,4194304] 0 2024-04-25T13:47:04.997 INFO:tasks.workunit.client.0.smithi043.stdout:7/618: mkdir d5/d11/d3b/d8b/dd0 0 2024-04-25T13:47:05.001 INFO:tasks.workunit.client.0.smithi043.stdout:4/402: dread d1/de/d1d/d20/d38/f37 [0,4194304] 0 2024-04-25T13:47:05.002 INFO:tasks.workunit.client.0.smithi043.stdout:5/366: rename d1/f69 to d1/d4/f7f 0 2024-04-25T13:47:05.005 INFO:tasks.workunit.client.0.smithi043.stdout:5/367: read - d1/d4/f73 zero size 2024-04-25T13:47:05.006 INFO:tasks.workunit.client.0.smithi043.stdout:4/403: truncate d1/de/d1d/d20/d38/f5f 422202 0 2024-04-25T13:47:05.007 INFO:tasks.workunit.client.0.smithi043.stdout:5/368: chown d1/d3/d24/l66 5 1 2024-04-25T13:47:05.009 INFO:tasks.workunit.client.0.smithi043.stdout:6/500: dread d0/d3d/d6e/f74 [0,4194304] 0 2024-04-25T13:47:05.011 INFO:tasks.workunit.client.0.smithi043.stdout:4/404: creat d1/de/df/d1e/d28/f84 x:0 0 0 2024-04-25T13:47:05.014 INFO:tasks.workunit.client.0.smithi043.stdout:4/405: write d1/de/df/d1a/f58 [3553152,43251] 0 2024-04-25T13:47:05.014 INFO:tasks.workunit.client.0.smithi043.stdout:7/619: truncate d5/d11/d3b/d61/dc5/fcf 3033911 0 2024-04-25T13:47:05.015 INFO:tasks.workunit.client.0.smithi043.stdout:4/406: chown d1/c2 8227 1 2024-04-25T13:47:05.016 INFO:tasks.workunit.client.0.smithi043.stdout:6/501: rename d0/d1c/f28 to d0/d1b/d96/fa2 0 2024-04-25T13:47:05.017 INFO:tasks.workunit.client.0.smithi043.stdout:6/502: read d0/d1c/f3e [1817104,88783] 0 2024-04-25T13:47:05.019 INFO:tasks.workunit.client.0.smithi043.stdout:6/503: write d0/d76/f7c [457744,94002] 0 2024-04-25T13:47:05.020 INFO:tasks.workunit.client.0.smithi043.stdout:5/369: write d1/d3/d7/d8/f44 [673190,114885] 0 2024-04-25T13:47:05.021 INFO:tasks.workunit.client.0.smithi043.stdout:4/407: dwrite d1/de/df/f16 [0,4194304] 0 2024-04-25T13:47:05.022 INFO:tasks.workunit.client.0.smithi043.stdout:6/504: mkdir d0/d76/d2f/d64/da1/da3 0 2024-04-25T13:47:05.024 INFO:tasks.workunit.client.0.smithi043.stdout:5/370: mkdir d1/d3/d7/d2f/d80 0 2024-04-25T13:47:05.025 INFO:tasks.workunit.client.0.smithi043.stdout:7/620: creat d5/d75/d79/fd1 x:0 0 0 2024-04-25T13:47:05.027 INFO:tasks.workunit.client.0.smithi043.stdout:6/505: truncate d0/d90/d4c/f61 1709820 0 2024-04-25T13:47:05.031 INFO:tasks.workunit.client.0.smithi043.stdout:4/408: dwrite d1/de/df/d1a/d27/f78 [0,4194304] 0 2024-04-25T13:47:05.033 INFO:tasks.workunit.client.0.smithi043.stdout:7/621: rename d5/d11/f24 to d5/d11/d3b/d61/dc5/dcc/fd2 0 2024-04-25T13:47:05.035 INFO:tasks.workunit.client.0.smithi043.stdout:7/622: chown d5/d75/d54 536 1 2024-04-25T13:47:05.036 INFO:tasks.workunit.client.0.smithi043.stdout:5/371: dwrite d1/d4/f73 [0,4194304] 0 2024-04-25T13:47:05.039 INFO:tasks.workunit.client.0.smithi043.stdout:6/506: rmdir d0/d3d 39 2024-04-25T13:47:05.044 INFO:tasks.workunit.client.0.smithi043.stdout:5/372: dwrite d1/d3/d26/f2a [0,4194304] 0 2024-04-25T13:47:05.045 INFO:tasks.workunit.client.0.smithi043.stdout:5/373: readlink d1/d3/d24/l66 0 2024-04-25T13:47:05.046 INFO:tasks.workunit.client.0.smithi043.stdout:5/374: stat d1/d3/d7/c7b 0 2024-04-25T13:47:05.046 INFO:tasks.workunit.client.0.smithi043.stdout:4/409: mknod d1/de/df/d1e/d45/c85 0 2024-04-25T13:47:05.050 INFO:tasks.workunit.client.0.smithi043.stdout:4/410: creat d1/de/df/d1e/d28/d33/f86 x:0 0 0 2024-04-25T13:47:05.050 INFO:tasks.workunit.client.0.smithi043.stdout:6/507: read d0/d1c/f3f [332835,119889] 0 2024-04-25T13:47:05.051 INFO:tasks.workunit.client.0.smithi043.stdout:7/623: getdents d5/d11/d80 0 2024-04-25T13:47:05.055 INFO:tasks.workunit.client.0.smithi043.stdout:5/375: creat d1/d3/f81 x:0 0 0 2024-04-25T13:47:05.057 INFO:tasks.workunit.client.0.smithi043.stdout:7/624: fsync d5/d11/d3b/d61/d68/dc0/fb5 0 2024-04-25T13:47:05.059 INFO:tasks.workunit.client.0.smithi043.stdout:1/501: sync 2024-04-25T13:47:05.061 INFO:tasks.workunit.client.0.smithi043.stdout:6/508: write d0/d76/d2f/d64/da1/f53 [1234787,100805] 0 2024-04-25T13:47:05.062 INFO:tasks.workunit.client.0.smithi043.stdout:5/376: write d1/d3/d24/f65 [1028142,112847] 0 2024-04-25T13:47:05.064 INFO:tasks.workunit.client.0.smithi043.stdout:4/411: dwrite d1/de/df/d1e/d28/d33/f86 [0,4194304] 0 2024-04-25T13:47:05.066 INFO:tasks.workunit.client.0.smithi043.stdout:1/502: symlink df/d14/d63/d67/d9f/lae 0 2024-04-25T13:47:05.066 INFO:tasks.workunit.client.0.smithi043.stdout:5/377: write d1/d3/d7/d8/f44 [457404,10953] 0 2024-04-25T13:47:05.072 INFO:tasks.workunit.client.0.smithi043.stdout:4/412: symlink d1/de/df/d1a/d27/d36/d53/d66/d70/l87 0 2024-04-25T13:47:05.074 INFO:tasks.workunit.client.0.smithi043.stdout:5/378: symlink d1/d3/d7/d9/l82 0 2024-04-25T13:47:05.075 INFO:tasks.workunit.client.0.smithi043.stdout:4/413: stat d1/d34/d35/l4f 0 2024-04-25T13:47:05.075 INFO:tasks.workunit.client.0.smithi043.stdout:6/509: truncate d0/d76/d2f/f89 2941753 0 2024-04-25T13:47:05.076 INFO:tasks.workunit.client.0.smithi043.stdout:4/414: dread - d1/d3/d54/f7e zero size 2024-04-25T13:47:05.077 INFO:tasks.workunit.client.0.smithi043.stdout:6/510: write d0/d76/f82 [990658,114210] 0 2024-04-25T13:47:05.079 INFO:tasks.workunit.client.0.smithi043.stdout:5/379: dread d1/f19 [4194304,4194304] 0 2024-04-25T13:47:05.083 INFO:tasks.workunit.client.0.smithi043.stdout:6/511: creat d0/fa4 x:0 0 0 2024-04-25T13:47:05.086 INFO:tasks.workunit.client.0.smithi043.stdout:4/415: link d1/de/f1c d1/de/df/d1e/d45/f88 0 2024-04-25T13:47:05.087 INFO:tasks.workunit.client.0.smithi043.stdout:5/380: chown d1/d3/d7/d8/da/d11/f25 4681249 1 2024-04-25T13:47:05.088 INFO:tasks.workunit.client.0.smithi043.stdout:6/512: chown d0/d1b/d96 56293 1 2024-04-25T13:47:05.091 INFO:tasks.workunit.client.0.smithi043.stdout:4/416: dread d1/de/df/d1a/f58 [0,4194304] 0 2024-04-25T13:47:05.092 INFO:tasks.workunit.client.0.smithi043.stdout:6/513: chown d0/d3d/d6e/d71/f8f 0 1 2024-04-25T13:47:05.095 INFO:tasks.workunit.client.0.smithi043.stdout:5/381: dread d1/d3/d24/f65 [0,4194304] 0 2024-04-25T13:47:05.096 INFO:tasks.workunit.client.0.smithi043.stdout:6/514: creat d0/d24/fa5 x:0 0 0 2024-04-25T13:47:05.098 INFO:tasks.workunit.client.0.smithi043.stdout:4/417: dwrite d1/d3/d54/f7e [0,4194304] 0 2024-04-25T13:47:05.100 INFO:tasks.workunit.client.0.smithi043.stdout:5/382: mknod d1/d3/d7/c83 0 2024-04-25T13:47:05.101 INFO:tasks.workunit.client.0.smithi043.stdout:5/383: chown d1/d3/d7/d8/df/d28/f48 17550 1 2024-04-25T13:47:05.101 INFO:tasks.workunit.client.0.smithi043.stdout:4/418: creat d1/d34/d35/f89 x:0 0 0 2024-04-25T13:47:05.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:04 smithi161 ceph-mon[32696]: pgmap v77: 129 pgs: 129 active+clean; 841 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 102 MiB/s wr, 191 op/s 2024-04-25T13:47:05.102 INFO:tasks.workunit.client.0.smithi043.stdout:5/384: fdatasync d1/d3/d7/f76 0 2024-04-25T13:47:05.102 INFO:tasks.workunit.client.0.smithi043.stdout:4/419: fdatasync d1/de/d1d/f5c 0 2024-04-25T13:47:05.104 INFO:tasks.workunit.client.0.smithi043.stdout:6/515: creat d0/d1c/fa6 x:0 0 0 2024-04-25T13:47:05.104 INFO:tasks.workunit.client.0.smithi043.stdout:4/420: write d1/de/df/d1e/d28/d33/f74 [393887,89713] 0 2024-04-25T13:47:05.105 INFO:tasks.workunit.client.0.smithi043.stdout:5/385: symlink d1/d3/d7/d8/df/l84 0 2024-04-25T13:47:05.112 INFO:tasks.workunit.client.0.smithi043.stdout:4/421: rmdir d1 39 2024-04-25T13:47:05.115 INFO:tasks.workunit.client.0.smithi043.stdout:5/386: link d1/l3f d1/d3/d7/d9/d2d/d36/l85 0 2024-04-25T13:47:05.116 INFO:tasks.workunit.client.0.smithi043.stdout:7/625: rename d5/d75/d79/fa8 to d5/d11/d84/fd3 0 2024-04-25T13:47:05.122 INFO:tasks.workunit.client.0.smithi043.stdout:6/516: mkdir d0/d76/d2f/da7 0 2024-04-25T13:47:05.123 INFO:tasks.workunit.client.0.smithi043.stdout:7/626: mkdir d5/d11/d3b/d61/dd4 0 2024-04-25T13:47:05.124 INFO:tasks.workunit.client.0.smithi043.stdout:7/627: fdatasync d5/d11/f19 0 2024-04-25T13:47:05.125 INFO:tasks.workunit.client.0.smithi043.stdout:4/422: dwrite d1/de/df/f18 [0,4194304] 0 2024-04-25T13:47:05.126 INFO:tasks.workunit.client.0.smithi043.stdout:5/387: dread d1/d3/d7/d8/da/f53 [0,4194304] 0 2024-04-25T13:47:05.127 INFO:tasks.workunit.client.0.smithi043.stdout:4/423: fdatasync d1/de/d1d/d20/f82 0 2024-04-25T13:47:05.128 INFO:tasks.workunit.client.0.smithi043.stdout:4/424: stat d1/de/df/d1a/d27/d36/d53/d66 0 2024-04-25T13:47:05.132 INFO:tasks.workunit.client.0.smithi043.stdout:4/425: creat d1/d3/d54/d62/d77/d79/f8a x:0 0 0 2024-04-25T13:47:05.133 INFO:tasks.workunit.client.0.smithi043.stdout:6/517: dread - d0/d76/d2f/d64/f9b zero size 2024-04-25T13:47:05.134 INFO:tasks.workunit.client.0.smithi043.stdout:7/628: getdents d5/d11/d8f 0 2024-04-25T13:47:05.137 INFO:tasks.workunit.client.0.smithi043.stdout:5/388: rmdir d1/d3/d7/d9/d6a 0 2024-04-25T13:47:05.138 INFO:tasks.workunit.client.0.smithi043.stdout:6/518: creat d0/d76/d2f/d64/fa8 x:0 0 0 2024-04-25T13:47:05.139 INFO:tasks.workunit.client.0.smithi043.stdout:7/629: readlink d5/d32/l39 0 2024-04-25T13:47:05.142 INFO:tasks.workunit.client.0.smithi043.stdout:6/519: dread - d0/d90/d4c/f6f zero size 2024-04-25T13:47:05.143 INFO:tasks.workunit.client.0.smithi043.stdout:7/630: symlink d5/d11/d3b/d61/ld5 0 2024-04-25T13:47:05.144 INFO:tasks.workunit.client.0.smithi043.stdout:7/631: readlink d5/d11/d3b/d8b/lcb 0 2024-04-25T13:47:05.145 INFO:tasks.workunit.client.0.smithi043.stdout:7/632: write d5/d11/f85 [1307742,129110] 0 2024-04-25T13:47:05.146 INFO:tasks.workunit.client.0.smithi043.stdout:4/426: link d1/de/df/d1a/d27/d36/l71 d1/de/df/d1a/d27/d36/d53/d66/d70/d7c/l8b 0 2024-04-25T13:47:05.147 INFO:tasks.workunit.client.0.smithi043.stdout:7/633: read - d5/d11/d3b/d61/dc5/fc8 zero size 2024-04-25T13:47:05.147 INFO:tasks.workunit.client.0.smithi043.stdout:4/427: fdatasync d1/de/df/d1a/f47 0 2024-04-25T13:47:05.148 INFO:tasks.workunit.client.0.smithi043.stdout:3/433: sync 2024-04-25T13:47:05.148 INFO:tasks.workunit.client.0.smithi043.stdout:8/468: sync 2024-04-25T13:47:05.148 INFO:tasks.workunit.client.0.smithi043.stdout:2/359: sync 2024-04-25T13:47:05.148 INFO:tasks.workunit.client.0.smithi043.stdout:0/501: sync 2024-04-25T13:47:05.151 INFO:tasks.workunit.client.0.smithi043.stdout:4/428: creat d1/de/f8c x:0 0 0 2024-04-25T13:47:05.151 INFO:tasks.workunit.client.0.smithi043.stdout:0/502: chown db/d25/d2a/d3f/d6a/d86 0 1 2024-04-25T13:47:05.152 INFO:tasks.workunit.client.0.smithi043.stdout:8/469: write db/dc/d21/f39 [1040833,102023] 0 2024-04-25T13:47:05.153 INFO:tasks.workunit.client.0.smithi043.stdout:2/360: rmdir d0/d34/d3f/d59 39 2024-04-25T13:47:05.154 INFO:tasks.workunit.client.0.smithi043.stdout:4/429: chown d1/de/df/d1a/d27/d36/d53 3177 1 2024-04-25T13:47:05.156 INFO:tasks.workunit.client.0.smithi043.stdout:6/520: write d0/d76/d2f/f32 [1528213,115554] 0 2024-04-25T13:47:05.158 INFO:tasks.workunit.client.0.smithi043.stdout:0/503: write db/d1b/d23/d27/d39/d4c/f70 [964446,38676] 0 2024-04-25T13:47:05.158 INFO:tasks.workunit.client.0.smithi043.stdout:7/634: mknod d5/d11/d3b/d61/d68/dc0/cd6 0 2024-04-25T13:47:05.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:04 smithi175 ceph-mon[32649]: pgmap v77: 129 pgs: 129 active+clean; 841 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 102 MiB/s wr, 191 op/s 2024-04-25T13:47:05.196 INFO:tasks.workunit.client.0.smithi043.stdout:6/521: mknod d0/d76/d5c/ca9 0 2024-04-25T13:47:05.196 INFO:tasks.workunit.client.0.smithi043.stdout:5/389: dread d1/d3/d7/d8/da/f2c [0,4194304] 0 2024-04-25T13:47:05.199 INFO:tasks.workunit.client.0.smithi043.stdout:7/635: creat d5/d75/d54/fd7 x:0 0 0 2024-04-25T13:47:05.200 INFO:tasks.workunit.client.0.smithi043.stdout:0/504: mknod db/d1b/d36/cae 0 2024-04-25T13:47:05.203 INFO:tasks.workunit.client.0.smithi043.stdout:7/636: dread - d5/d11/d80/fc9 zero size 2024-04-25T13:47:05.203 INFO:tasks.workunit.client.0.smithi043.stdout:8/470: dwrite db/d44/d8e/d27/f75 [0,4194304] 0 2024-04-25T13:47:05.203 INFO:tasks.workunit.client.0.smithi043.stdout:5/390: write d1/d3/d7/d9/d2d/f72 [998030,83724] 0 2024-04-25T13:47:05.208 INFO:tasks.workunit.client.0.smithi043.stdout:4/430: dwrite d1/de/d1d/d20/d38/f37 [4194304,4194304] 0 2024-04-25T13:47:05.209 INFO:tasks.workunit.client.0.smithi043.stdout:5/391: creat d1/d3/d24/d7c/f86 x:0 0 0 2024-04-25T13:47:05.210 INFO:tasks.workunit.client.0.smithi043.stdout:0/505: truncate db/d1b/d23/d27/fa0 351145 0 2024-04-25T13:47:05.210 INFO:tasks.workunit.client.0.smithi043.stdout:7/637: stat d5/d11/d3b/d3f/d5a/lae 0 2024-04-25T13:47:05.211 INFO:tasks.workunit.client.0.smithi043.stdout:8/471: write db/d11/d1b/f6c [2075610,78585] 0 2024-04-25T13:47:05.211 INFO:tasks.workunit.client.0.smithi043.stdout:6/522: dread d0/f16 [0,4194304] 0 2024-04-25T13:47:05.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:04 smithi043 ceph-mon[29195]: pgmap v77: 129 pgs: 129 active+clean; 841 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 102 MiB/s wr, 191 op/s 2024-04-25T13:47:05.215 INFO:tasks.workunit.client.0.smithi043.stdout:7/638: write d5/d11/d84/fbc [109647,117463] 0 2024-04-25T13:47:05.218 INFO:tasks.workunit.client.0.smithi043.stdout:4/431: write d1/de/df/f41 [330034,61553] 0 2024-04-25T13:47:05.219 INFO:tasks.workunit.client.0.smithi043.stdout:0/506: write db/d1b/d23/d27/f44 [2293911,34445] 0 2024-04-25T13:47:05.220 INFO:tasks.workunit.client.0.smithi043.stdout:8/472: stat db/dc/d28/l33 0 2024-04-25T13:47:05.224 INFO:tasks.workunit.client.0.smithi043.stdout:0/507: write db/d1b/d23/d27/f44 [3227709,27655] 0 2024-04-25T13:47:05.227 INFO:tasks.workunit.client.0.smithi043.stdout:4/432: write d1/de/df/d1e/d28/d33/f86 [978685,47845] 0 2024-04-25T13:47:05.229 INFO:tasks.workunit.client.0.smithi043.stdout:5/392: dwrite d1/d3/d24/f65 [0,4194304] 0 2024-04-25T13:47:05.229 INFO:tasks.workunit.client.0.smithi043.stdout:0/508: chown db/d1b/d94/d68/l9f 8053020 1 2024-04-25T13:47:05.232 INFO:tasks.workunit.client.0.smithi043.stdout:7/639: truncate d5/f6d 701745 0 2024-04-25T13:47:05.234 INFO:tasks.workunit.client.0.smithi043.stdout:0/509: mkdir db/d1b/d36/d41/daf 0 2024-04-25T13:47:05.235 INFO:tasks.workunit.client.0.smithi043.stdout:8/473: dwrite db/dc/d21/f2e [0,4194304] 0 2024-04-25T13:47:05.237 INFO:tasks.workunit.client.0.smithi043.stdout:3/434: rename d0/d9/f85 to d0/d9/d6e/d34/d36/f9a 0 2024-04-25T13:47:05.240 INFO:tasks.workunit.client.0.smithi043.stdout:7/640: dread d5/d75/d54/f8a [0,4194304] 0 2024-04-25T13:47:05.241 INFO:tasks.workunit.client.0.smithi043.stdout:4/433: dread d1/de/df/f16 [0,4194304] 0 2024-04-25T13:47:05.244 INFO:tasks.workunit.client.0.smithi043.stdout:7/641: read d5/d11/f19 [1900407,69495] 0 2024-04-25T13:47:05.245 INFO:tasks.workunit.client.0.smithi043.stdout:6/523: rename d0/ff to d0/d76/d2f/d64/da1/da3/faa 0 2024-04-25T13:47:05.246 INFO:tasks.workunit.client.0.smithi043.stdout:3/435: unlink d0/d9/d6e/d38/l87 0 2024-04-25T13:47:05.247 INFO:tasks.workunit.client.0.smithi043.stdout:8/474: getdents db/d38/d3c/d71/d5d/d67 0 2024-04-25T13:47:05.247 INFO:tasks.workunit.client.0.smithi043.stdout:1/503: sync 2024-04-25T13:47:05.248 INFO:tasks.workunit.client.0.smithi043.stdout:3/436: fdatasync d0/d13/f7c 0 2024-04-25T13:47:05.249 INFO:tasks.workunit.client.0.smithi043.stdout:0/510: rename db/d1b/d23/l52 to db/d25/lb0 0 2024-04-25T13:47:05.249 INFO:tasks.workunit.client.0.smithi043.stdout:8/475: fdatasync db/d11/d1b/f6c 0 2024-04-25T13:47:05.250 INFO:tasks.workunit.client.0.smithi043.stdout:4/434: dread d1/de/df/f16 [0,4194304] 0 2024-04-25T13:47:05.255 INFO:tasks.workunit.client.0.smithi043.stdout:1/504: symlink df/d14/d63/laf 0 2024-04-25T13:47:05.255 INFO:tasks.workunit.client.0.smithi043.stdout:7/642: rmdir d5/d11/d3b/d8b/dd0 0 2024-04-25T13:47:05.257 INFO:tasks.workunit.client.0.smithi043.stdout:6/524: dwrite d0/f16 [0,4194304] 0 2024-04-25T13:47:05.260 INFO:tasks.workunit.client.0.smithi043.stdout:7/643: readlink d5/d11/d3b/d8b/d9b/la9 0 2024-04-25T13:47:05.260 INFO:tasks.workunit.client.0.smithi043.stdout:0/511: link db/d1b/d36/f34 db/d1b/d23/d27/d98/fb1 0 2024-04-25T13:47:05.260 INFO:tasks.workunit.client.0.smithi043.stdout:1/505: mknod df/d14/d63/d67/cb0 0 2024-04-25T13:47:05.261 INFO:tasks.workunit.client.0.smithi043.stdout:4/435: mknod d1/de/df/d1a/d27/d36/d53/d66/d70/d7c/c8d 0 2024-04-25T13:47:05.261 INFO:tasks.workunit.client.0.smithi043.stdout:6/525: write d0/d24/f7e [517355,121061] 0 2024-04-25T13:47:05.267 INFO:tasks.workunit.client.0.smithi043.stdout:8/476: dwrite db/dc/d21/f39 [0,4194304] 0 2024-04-25T13:47:05.268 INFO:tasks.workunit.client.0.smithi043.stdout:5/393: dread d1/d3/d7/d9/d2d/d5b/f74 [0,4194304] 0 2024-04-25T13:47:05.270 INFO:tasks.workunit.client.0.smithi043.stdout:6/526: rmdir d0/d76/d2f 39 2024-04-25T13:47:05.284 INFO:tasks.workunit.client.0.smithi043.stdout:1/506: symlink df/d14/d63/d67/lb1 0 2024-04-25T13:47:05.285 INFO:tasks.workunit.client.0.smithi043.stdout:3/437: fdatasync d0/d9/d6e/f1f 0 2024-04-25T13:47:05.285 INFO:tasks.workunit.client.0.smithi043.stdout:0/512: truncate db/d25/d2a/d3f/f95 299222 0 2024-04-25T13:47:05.289 INFO:tasks.workunit.client.0.smithi043.stdout:5/394: dread d1/d3/d7/d8/da/f53 [0,4194304] 0 2024-04-25T13:47:05.291 INFO:tasks.workunit.client.0.smithi043.stdout:6/527: creat d0/fab x:0 0 0 2024-04-25T13:47:05.291 INFO:tasks.workunit.client.0.smithi043.stdout:1/507: creat df/d10/d22/d2f/fb2 x:0 0 0 2024-04-25T13:47:05.292 INFO:tasks.workunit.client.0.smithi043.stdout:7/644: dwrite d5/d11/d3b/d61/d68/fa5 [0,4194304] 0 2024-04-25T13:47:05.293 INFO:tasks.workunit.client.0.smithi043.stdout:0/513: creat db/d25/d2a/d9d/fb2 x:0 0 0 2024-04-25T13:47:05.297 INFO:tasks.workunit.client.0.smithi043.stdout:1/508: creat df/d14/d3d/d82/fb3 x:0 0 0 2024-04-25T13:47:05.302 INFO:tasks.workunit.client.0.smithi043.stdout:3/438: dwrite d0/f35 [4194304,4194304] 0 2024-04-25T13:47:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:6/528: truncate d0/d3d/d54/f57 3470569 0 2024-04-25T13:47:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:1/509: rmdir df/d14/d63/d67/d9f 39 2024-04-25T13:47:05.318 INFO:tasks.workunit.client.0.smithi043.stdout:0/514: dwrite db/d1b/d23/d27/d39/f7b [0,4194304] 0 2024-04-25T13:47:05.319 INFO:tasks.workunit.client.0.smithi043.stdout:8/477: rename db/dc/d21/d4e/d62/f64 to db/d7d/f9b 0 2024-04-25T13:47:05.320 INFO:tasks.workunit.client.0.smithi043.stdout:7/645: dwrite d5/d11/d84/fd3 [0,4194304] 0 2024-04-25T13:47:05.331 INFO:tasks.workunit.client.0.smithi043.stdout:3/439: dwrite d0/d61/f70 [0,4194304] 0 2024-04-25T13:47:05.331 INFO:tasks.workunit.client.0.smithi043.stdout:5/395: dread d1/d3/d7/d8/da/d11/f25 [0,4194304] 0 2024-04-25T13:47:05.333 INFO:tasks.workunit.client.0.smithi043.stdout:8/478: readlink db/dc/d28/l6a 0 2024-04-25T13:47:05.333 INFO:tasks.workunit.client.0.smithi043.stdout:0/515: mkdir db/d1b/d36/d41/daf/db3 0 2024-04-25T13:47:05.336 INFO:tasks.workunit.client.0.smithi043.stdout:6/529: dwrite d0/d76/f7c [0,4194304] 0 2024-04-25T13:47:05.338 INFO:tasks.workunit.client.0.smithi043.stdout:2/361: sync 2024-04-25T13:47:05.343 INFO:tasks.workunit.client.0.smithi043.stdout:1/510: dwrite df/d10/d22/d2f/d9c/f8a [0,4194304] 0 2024-04-25T13:47:05.343 INFO:tasks.workunit.client.0.smithi043.stdout:2/362: chown d0/d8 258870 1 2024-04-25T13:47:05.344 INFO:tasks.workunit.client.0.smithi043.stdout:5/396: dread d1/d3/d7/d9/d2d/f6c [0,4194304] 0 2024-04-25T13:47:05.345 INFO:tasks.workunit.client.0.smithi043.stdout:8/479: truncate db/d11/d1b/f63 457623 0 2024-04-25T13:47:05.345 INFO:tasks.workunit.client.0.smithi043.stdout:0/516: write db/d1b/d23/d27/f87 [1815809,42128] 0 2024-04-25T13:47:05.346 INFO:tasks.workunit.client.0.smithi043.stdout:6/530: mknod d0/d90/d48/d73/cac 0 2024-04-25T13:47:05.346 INFO:tasks.workunit.client.0.smithi043.stdout:3/440: symlink d0/d9/d6e/l9b 0 2024-04-25T13:47:05.347 INFO:tasks.workunit.client.0.smithi043.stdout:2/363: mkdir d0/d5/d2f/d6f 0 2024-04-25T13:47:05.348 INFO:tasks.workunit.client.0.smithi043.stdout:0/517: readlink db/l45 0 2024-04-25T13:47:05.350 INFO:tasks.workunit.client.0.smithi043.stdout:2/364: mknod d0/d34/d3f/d46/d55/c70 0 2024-04-25T13:47:05.350 INFO:tasks.workunit.client.0.smithi043.stdout:8/480: write db/d11/f3d [2678804,110738] 0 2024-04-25T13:47:05.351 INFO:tasks.workunit.client.0.smithi043.stdout:2/365: fdatasync d0/d8/d22/f6d 0 2024-04-25T13:47:05.352 INFO:tasks.workunit.client.0.smithi043.stdout:5/397: rename d1/d3/d7/d9/c77 to d1/d3/d7/d9/d2d/c87 0 2024-04-25T13:47:05.353 INFO:tasks.workunit.client.0.smithi043.stdout:3/441: symlink d0/d9/l9c 0 2024-04-25T13:47:05.355 INFO:tasks.workunit.client.0.smithi043.stdout:7/646: getdents d5/d75/d79 0 2024-04-25T13:47:05.356 INFO:tasks.workunit.client.0.smithi043.stdout:5/398: write d1/d3/d24/f3d [508406,91005] 0 2024-04-25T13:47:05.357 INFO:tasks.workunit.client.0.smithi043.stdout:6/531: link d0/d76/d2f/d64/f6d d0/d90/d48/fad 0 2024-04-25T13:47:05.360 INFO:tasks.workunit.client.0.smithi043.stdout:6/532: truncate d0/d76/d2f/d64/fa8 161406 0 2024-04-25T13:47:05.360 INFO:tasks.workunit.client.0.smithi043.stdout:7/647: rmdir d5/d11/d3b/d61/dc5/dcc 39 2024-04-25T13:47:05.361 INFO:tasks.workunit.client.0.smithi043.stdout:6/533: fdatasync d0/d1c/fa6 0 2024-04-25T13:47:05.362 INFO:tasks.workunit.client.0.smithi043.stdout:0/518: creat db/d1b/d62/fb4 x:0 0 0 2024-04-25T13:47:05.363 INFO:tasks.workunit.client.0.smithi043.stdout:0/519: chown db/d1b/d23/d27 2 1 2024-04-25T13:47:05.363 INFO:tasks.workunit.client.0.smithi043.stdout:6/534: truncate d0/d1c/f63 924869 0 2024-04-25T13:47:05.364 INFO:tasks.workunit.client.0.smithi043.stdout:1/511: fdatasync df/d14/d3d/d82/d8c/f92 0 2024-04-25T13:47:05.367 INFO:tasks.workunit.client.0.smithi043.stdout:5/399: creat d1/d3/d7/d8/da/f88 x:0 0 0 2024-04-25T13:47:05.368 INFO:tasks.workunit.client.0.smithi043.stdout:7/648: dread d5/d11/d3b/f4b [0,4194304] 0 2024-04-25T13:47:05.370 INFO:tasks.workunit.client.0.smithi043.stdout:6/535: rename d0/d76/f82 to d0/d76/d2f/da7/fae 0 2024-04-25T13:47:05.374 INFO:tasks.workunit.client.0.smithi043.stdout:1/512: rename df/d31/d38/d43/d53/f80 to df/d10/d22/d2f/d9c/d41/fb4 0 2024-04-25T13:47:05.377 INFO:tasks.workunit.client.0.smithi043.stdout:5/400: creat d1/d3/d24/d7c/f89 x:0 0 0 2024-04-25T13:47:05.377 INFO:tasks.workunit.client.0.smithi043.stdout:2/366: dread d0/d8/ff [0,4194304] 0 2024-04-25T13:47:05.379 INFO:tasks.workunit.client.0.smithi043.stdout:1/513: link df/d31/d34/d8b/f6b df/d14/d63/d67/d9f/fb5 0 2024-04-25T13:47:05.381 INFO:tasks.workunit.client.0.smithi043.stdout:3/442: write d0/d9/d6e/d34/d36/f4e [1694270,92020] 0 2024-04-25T13:47:05.382 INFO:tasks.workunit.client.0.smithi043.stdout:2/367: mkdir d0/d34/d17/d5e/d71 0 2024-04-25T13:47:05.385 INFO:tasks.workunit.client.0.smithi043.stdout:6/536: dwrite d0/d1c/f8d [0,4194304] 0 2024-04-25T13:47:05.385 INFO:tasks.workunit.client.0.smithi043.stdout:5/401: dread d1/d3/d24/f65 [0,4194304] 0 2024-04-25T13:47:05.387 INFO:tasks.workunit.client.0.smithi043.stdout:7/649: link d5/d32/l58 d5/d11/db4/ld8 0 2024-04-25T13:47:05.389 INFO:tasks.workunit.client.0.smithi043.stdout:7/650: chown d5/d6b/f71 6748085 1 2024-04-25T13:47:05.391 INFO:tasks.workunit.client.0.smithi043.stdout:6/537: symlink d0/d90/d48/laf 0 2024-04-25T13:47:05.392 INFO:tasks.workunit.client.0.smithi043.stdout:3/443: dwrite d0/d9/d6e/d38/d3f/f56 [0,4194304] 0 2024-04-25T13:47:05.392 INFO:tasks.workunit.client.0.smithi043.stdout:8/481: link db/dc/d28/f6f db/d44/d8e/f9c 0 2024-04-25T13:47:05.392 INFO:tasks.workunit.client.0.smithi043.stdout:7/651: read d5/f5d [1320207,120167] 0 2024-04-25T13:47:05.393 INFO:tasks.workunit.client.0.smithi043.stdout:3/444: chown d0/d9/d81/d8e/d92 637 1 2024-04-25T13:47:05.394 INFO:tasks.workunit.client.0.smithi043.stdout:5/402: creat d1/d3/d7/d2f/d67/f8a x:0 0 0 2024-04-25T13:47:05.399 INFO:tasks.workunit.client.0.smithi043.stdout:5/403: truncate d1/d3/d7/d2f/d67/f8a 525684 0 2024-04-25T13:47:05.404 INFO:tasks.workunit.client.0.smithi043.stdout:7/652: dwrite d5/d11/d3b/d3f/d5a/d89/fad [0,4194304] 0 2024-04-25T13:47:05.404 INFO:tasks.workunit.client.0.smithi043.stdout:1/514: rmdir df 39 2024-04-25T13:47:05.406 INFO:tasks.workunit.client.0.smithi043.stdout:5/404: symlink d1/l8b 0 2024-04-25T13:47:05.409 INFO:tasks.workunit.client.0.smithi043.stdout:7/653: getdents d5/d11/d3b/d3f 0 2024-04-25T13:47:05.410 INFO:tasks.workunit.client.0.smithi043.stdout:5/405: chown d1/d3/d7/c83 301 1 2024-04-25T13:47:05.410 INFO:tasks.workunit.client.0.smithi043.stdout:2/368: dwrite d0/d5/d1e/f39 [4194304,4194304] 0 2024-04-25T13:47:05.410 INFO:tasks.workunit.client.0.smithi043.stdout:7/654: readlink d5/d11/d3b/d3f/l6a 0 2024-04-25T13:47:05.411 INFO:tasks.workunit.client.0.smithi043.stdout:1/515: mknod df/d14/d63/d67/cb6 0 2024-04-25T13:47:05.412 INFO:tasks.workunit.client.0.smithi043.stdout:1/516: stat df/d31/d38/d43/fa0 0 2024-04-25T13:47:05.413 INFO:tasks.workunit.client.0.smithi043.stdout:7/655: symlink d5/d11/d3b/d8b/ld9 0 2024-04-25T13:47:05.413 INFO:tasks.workunit.client.0.smithi043.stdout:1/517: chown df/d31/d34 123 1 2024-04-25T13:47:05.415 INFO:tasks.workunit.client.0.smithi043.stdout:2/369: rmdir d0/d34/d3f/d4e 0 2024-04-25T13:47:05.416 INFO:tasks.workunit.client.0.smithi043.stdout:1/518: symlink df/d31/lb7 0 2024-04-25T13:47:05.417 INFO:tasks.workunit.client.0.smithi043.stdout:2/370: creat d0/d4b/f72 x:0 0 0 2024-04-25T13:47:05.418 INFO:tasks.workunit.client.0.smithi043.stdout:2/371: chown d0/d34/le 0 1 2024-04-25T13:47:05.419 INFO:tasks.workunit.client.0.smithi043.stdout:1/519: mkdir df/d10/d22/d2f/d9c/d41/db8 0 2024-04-25T13:47:05.421 INFO:tasks.workunit.client.0.smithi043.stdout:2/372: truncate d0/d34/f37 3070452 0 2024-04-25T13:47:05.423 INFO:tasks.workunit.client.0.smithi043.stdout:2/373: chown d0/d26/f40 5 1 2024-04-25T13:47:05.435 INFO:tasks.workunit.client.0.smithi043.stdout:2/374: dwrite d0/d5/d1e/f6b [0,4194304] 0 2024-04-25T13:47:05.439 INFO:tasks.workunit.client.0.smithi043.stdout:2/375: mknod d0/c73 0 2024-04-25T13:47:05.440 INFO:tasks.workunit.client.0.smithi043.stdout:3/445: rename d0/d9/d6e/d38/d3f/f56 to d0/d13/d5a/d90/f9d 0 2024-04-25T13:47:05.441 INFO:tasks.workunit.client.0.smithi043.stdout:7/656: dread d5/d11/f31 [0,4194304] 0 2024-04-25T13:47:05.445 INFO:tasks.workunit.client.0.smithi043.stdout:1/520: rename df/d14/d63/d67/c8d to df/d14/d63/cb9 0 2024-04-25T13:47:05.446 INFO:tasks.workunit.client.0.smithi043.stdout:1/521: chown df/d10/f13 140 1 2024-04-25T13:47:05.447 INFO:tasks.workunit.client.0.smithi043.stdout:2/376: truncate d0/d8/d22/f2b 46729 0 2024-04-25T13:47:05.448 INFO:tasks.workunit.client.0.smithi043.stdout:3/446: dwrite d0/d13/d2e/f31 [0,4194304] 0 2024-04-25T13:47:05.450 INFO:tasks.workunit.client.0.smithi043.stdout:7/657: truncate d5/d11/d3b/d61/d68/fa5 44996 0 2024-04-25T13:47:05.450 INFO:tasks.workunit.client.0.smithi043.stdout:2/377: write d0/d5/d1e/f2c [3209109,28006] 0 2024-04-25T13:47:05.450 INFO:tasks.workunit.client.0.smithi043.stdout:3/447: write d0/d9/f62 [717956,25263] 0 2024-04-25T13:47:05.451 INFO:tasks.workunit.client.0.smithi043.stdout:1/522: chown df/d31/d34/d8b/d39 1 1 2024-04-25T13:47:05.453 INFO:tasks.workunit.client.0.smithi043.stdout:7/658: truncate d5/d11/d84/fbc 769493 0 2024-04-25T13:47:05.455 INFO:tasks.workunit.client.0.smithi043.stdout:2/378: mknod d0/d34/d3f/d59/c74 0 2024-04-25T13:47:05.456 INFO:tasks.workunit.client.0.smithi043.stdout:7/659: symlink d5/d11/db4/lda 0 2024-04-25T13:47:05.457 INFO:tasks.workunit.client.0.smithi043.stdout:3/448: mkdir d0/d9/d6e/d34/d83/d9e 0 2024-04-25T13:47:05.461 INFO:tasks.workunit.client.0.smithi043.stdout:1/523: rename df/d10/d22/d2f/d9c/f8a to df/d31/d34/fba 0 2024-04-25T13:47:05.461 INFO:tasks.workunit.client.0.smithi043.stdout:3/449: readlink d0/d9/d81/d8e/d92/l32 0 2024-04-25T13:47:05.462 INFO:tasks.workunit.client.0.smithi043.stdout:1/524: chown df/d31/d34/fba 922 1 2024-04-25T13:47:05.470 INFO:tasks.workunit.client.0.smithi043.stdout:3/450: write d0/d9/d6e/d34/d36/d57/f98 [1626370,20269] 0 2024-04-25T13:47:05.474 INFO:tasks.workunit.client.0.smithi043.stdout:2/379: dwrite d0/d8/d22/f2b [0,4194304] 0 2024-04-25T13:47:05.476 INFO:tasks.workunit.client.0.smithi043.stdout:3/451: creat d0/f9f x:0 0 0 2024-04-25T13:47:05.476 INFO:tasks.workunit.client.0.smithi043.stdout:2/380: mknod d0/d5/c75 0 2024-04-25T13:47:05.478 INFO:tasks.workunit.client.0.smithi043.stdout:2/381: symlink d0/d34/d3f/d46/l76 0 2024-04-25T13:47:05.488 INFO:tasks.workunit.client.0.smithi043.stdout:4/436: sync 2024-04-25T13:47:05.489 INFO:tasks.workunit.client.0.smithi043.stdout:2/382: dwrite d0/d8/f69 [0,4194304] 0 2024-04-25T13:47:05.489 INFO:tasks.workunit.client.0.smithi043.stdout:2/383: fdatasync d0/d34/f1a 0 2024-04-25T13:47:05.491 INFO:tasks.workunit.client.0.smithi043.stdout:2/384: write d0/f18 [6545063,121801] 0 2024-04-25T13:47:05.492 INFO:tasks.workunit.client.0.smithi043.stdout:1/525: dread f2 [4194304,4194304] 0 2024-04-25T13:47:05.492 INFO:tasks.workunit.client.0.smithi043.stdout:3/452: symlink d0/d9/d6e/la0 0 2024-04-25T13:47:05.493 INFO:tasks.workunit.client.0.smithi043.stdout:2/385: write d0/d26/f4d [300234,69828] 0 2024-04-25T13:47:05.493 INFO:tasks.workunit.client.0.smithi043.stdout:1/526: chown df/f20 158254766 1 2024-04-25T13:47:05.495 INFO:tasks.workunit.client.0.smithi043.stdout:2/386: fdatasync d0/d35/f5d 0 2024-04-25T13:47:05.497 INFO:tasks.workunit.client.0.smithi043.stdout:2/387: rmdir d0/d4b 39 2024-04-25T13:47:05.499 INFO:tasks.workunit.client.0.smithi043.stdout:3/453: link d0/d13/d5a/f68 d0/d9/d81/fa1 0 2024-04-25T13:47:05.503 INFO:tasks.workunit.client.0.smithi043.stdout:1/527: dread df/d10/d22/f58 [0,4194304] 0 2024-04-25T13:47:05.504 INFO:tasks.workunit.client.0.smithi043.stdout:1/528: chown df/d10/d22/d2f/f4f 45 1 2024-04-25T13:47:05.505 INFO:tasks.workunit.client.0.smithi043.stdout:1/529: dread - df/d14/d3d/d82/d8c/f8f zero size 2024-04-25T13:47:05.516 INFO:tasks.workunit.client.0.smithi043.stdout:2/388: dread d0/d34/d17/f23 [0,4194304] 0 2024-04-25T13:47:05.517 INFO:tasks.workunit.client.0.smithi043.stdout:3/454: dwrite d0/d9/d6e/d34/f7f [0,4194304] 0 2024-04-25T13:47:05.521 INFO:tasks.workunit.client.0.smithi043.stdout:3/455: readlink d0/d9/d81/d8e/d92/l24 0 2024-04-25T13:47:05.602 INFO:tasks.workunit.client.0.smithi043.stdout:2/389: truncate d0/d8/fd 4287145 0 2024-04-25T13:47:05.604 INFO:tasks.workunit.client.0.smithi043.stdout:1/530: dread fe [0,4194304] 0 2024-04-25T13:47:05.606 INFO:tasks.workunit.client.0.smithi043.stdout:3/456: dread d0/d61/f70 [0,4194304] 0 2024-04-25T13:47:05.606 INFO:tasks.workunit.client.0.smithi043.stdout:1/531: mkdir df/d31/d38/dbb 0 2024-04-25T13:47:05.607 INFO:tasks.workunit.client.0.smithi043.stdout:2/390: mkdir d0/d34/d77 0 2024-04-25T13:47:05.608 INFO:tasks.workunit.client.0.smithi043.stdout:2/391: read - d0/d5/d2f/f6e zero size 2024-04-25T13:47:05.609 INFO:tasks.workunit.client.0.smithi043.stdout:3/457: rename d0/d13/d55/c75 to d0/d13/d55/ca2 0 2024-04-25T13:47:05.609 INFO:tasks.workunit.client.0.smithi043.stdout:3/458: write d0/d9/d6e/d34/f7f [2791617,19401] 0 2024-04-25T13:47:05.617 INFO:tasks.workunit.client.0.smithi043.stdout:3/459: dwrite d0/d9/d81/f8c [0,4194304] 0 2024-04-25T13:47:05.622 INFO:tasks.workunit.client.0.smithi043.stdout:3/460: mknod d0/d9/ca3 0 2024-04-25T13:47:05.622 INFO:tasks.workunit.client.0.smithi043.stdout:1/532: truncate df/d10/f12 4066930 0 2024-04-25T13:47:05.623 INFO:tasks.workunit.client.0.smithi043.stdout:3/461: truncate d0/d13/f7c 337079 0 2024-04-25T13:47:05.623 INFO:tasks.workunit.client.0.smithi043.stdout:1/533: fsync df/d31/d38/d43/f65 0 2024-04-25T13:47:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:3/462: chown d0/d13/d5a/d90 35207 1 2024-04-25T13:47:05.624 INFO:tasks.workunit.client.0.smithi043.stdout:3/463: fsync d0/d9/d6e/d34/f80 0 2024-04-25T13:47:05.626 INFO:tasks.workunit.client.0.smithi043.stdout:1/534: read df/d31/f60 [5204601,74277] 0 2024-04-25T13:47:05.626 INFO:tasks.workunit.client.0.smithi043.stdout:3/464: write d0/d13/d5a/f91 [691208,60117] 0 2024-04-25T13:47:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:3/465: write d0/d13/f3d [1570620,110076] 0 2024-04-25T13:47:05.627 INFO:tasks.workunit.client.0.smithi043.stdout:0/520: sync 2024-04-25T13:47:05.628 INFO:tasks.workunit.client.0.smithi043.stdout:1/535: chown df/d31/d38/d43/faa 14704 1 2024-04-25T13:47:05.629 INFO:tasks.workunit.client.0.smithi043.stdout:3/466: fsync d0/d9/f44 0 2024-04-25T13:47:05.631 INFO:tasks.workunit.client.0.smithi043.stdout:2/392: write d0/d34/d3f/d46/d55/f65 [887020,40809] 0 2024-04-25T13:47:05.631 INFO:tasks.workunit.client.0.smithi043.stdout:1/536: mkdir df/d31/d38/d43/dbc 0 2024-04-25T13:47:05.633 INFO:tasks.workunit.client.0.smithi043.stdout:1/537: readlink df/d31/d34/d8b/d39/l89 0 2024-04-25T13:47:05.635 INFO:tasks.workunit.client.0.smithi043.stdout:1/538: chown df/d31 30017353 1 2024-04-25T13:47:05.636 INFO:tasks.workunit.client.0.smithi043.stdout:2/393: unlink d0/d5/d1e/f1f 0 2024-04-25T13:47:05.638 INFO:tasks.workunit.client.0.smithi043.stdout:1/539: chown df/d14/d63/cb9 4977877 1 2024-04-25T13:47:05.639 INFO:tasks.workunit.client.0.smithi043.stdout:3/467: dwrite d0/d9/f62 [0,4194304] 0 2024-04-25T13:47:05.640 INFO:tasks.workunit.client.0.smithi043.stdout:3/468: readlink d0/d13/d55/l65 0 2024-04-25T13:47:05.641 INFO:tasks.workunit.client.0.smithi043.stdout:2/394: rename d0/d5/d1e/d32/c38 to d0/d5/d1e/d32/c78 0 2024-04-25T13:47:05.641 INFO:tasks.workunit.client.0.smithi043.stdout:3/469: chown d0/d9/d6e/d34/d83 37 1 2024-04-25T13:47:05.645 INFO:tasks.workunit.client.0.smithi043.stdout:0/521: write db/d1b/d4f/f58 [984102,101596] 0 2024-04-25T13:47:05.646 INFO:tasks.workunit.client.0.smithi043.stdout:2/395: dread d0/d5/d1e/f6b [0,4194304] 0 2024-04-25T13:47:05.648 INFO:tasks.workunit.client.0.smithi043.stdout:3/470: write d0/d9/f86 [1844328,53796] 0 2024-04-25T13:47:05.649 INFO:tasks.workunit.client.0.smithi043.stdout:0/522: mknod db/d25/d2a/d3f/d6a/cb5 0 2024-04-25T13:47:05.652 INFO:tasks.workunit.client.0.smithi043.stdout:0/523: fdatasync db/f2d 0 2024-04-25T13:47:05.656 INFO:tasks.workunit.client.0.smithi043.stdout:2/396: dwrite d0/d34/d17/f23 [0,4194304] 0 2024-04-25T13:47:05.656 INFO:tasks.workunit.client.0.smithi043.stdout:3/471: creat d0/d9/d81/d8e/d92/fa4 x:0 0 0 2024-04-25T13:47:05.662 INFO:tasks.workunit.client.0.smithi043.stdout:3/472: creat d0/d13/fa5 x:0 0 0 2024-04-25T13:47:05.663 INFO:tasks.workunit.client.0.smithi043.stdout:0/524: write db/d1b/d23/d27/d39/d4b/fa8 [1594151,128305] 0 2024-04-25T13:47:05.665 INFO:tasks.workunit.client.0.smithi043.stdout:0/525: read - db/d1b/d23/d27/d39/d4c/da9/fac zero size 2024-04-25T13:47:05.667 INFO:tasks.workunit.client.0.smithi043.stdout:0/526: fsync db/d1b/d23/d27/d39/d4c/f8e 0 2024-04-25T13:47:05.668 INFO:tasks.workunit.client.0.smithi043.stdout:3/473: mknod d0/d9/d81/d8e/d92/ca6 0 2024-04-25T13:47:05.668 INFO:tasks.workunit.client.0.smithi043.stdout:0/527: write db/d1b/f26 [2467193,17851] 0 2024-04-25T13:47:05.675 INFO:tasks.workunit.client.0.smithi043.stdout:2/397: rename d0/d5/d1e/d32/f50 to d0/d5/d2f/f79 0 2024-04-25T13:47:05.677 INFO:tasks.workunit.client.0.smithi043.stdout:3/474: dwrite d0/d9/d6e/d38/d3f/f8a [0,4194304] 0 2024-04-25T13:47:05.678 INFO:tasks.workunit.client.0.smithi043.stdout:3/475: write d0/d9/d6e/d38/d3f/f8a [1745354,91578] 0 2024-04-25T13:47:05.681 INFO:tasks.workunit.client.0.smithi043.stdout:0/528: dread db/d1b/d23/d27/d39/d4b/fa8 [0,4194304] 0 2024-04-25T13:47:05.682 INFO:tasks.workunit.client.0.smithi043.stdout:3/476: creat d0/d9/d6e/d34/fa7 x:0 0 0 2024-04-25T13:47:05.684 INFO:tasks.workunit.client.0.smithi043.stdout:2/398: link d0/d34/d3f/d46/l76 d0/d34/l7a 0 2024-04-25T13:47:05.690 INFO:tasks.workunit.client.0.smithi043.stdout:3/477: truncate d0/d9/f86 2256682 0 2024-04-25T13:47:05.694 INFO:tasks.workunit.client.0.smithi043.stdout:2/399: truncate d0/d26/f33 1021836 0 2024-04-25T13:47:05.695 INFO:tasks.workunit.client.0.smithi043.stdout:3/478: fsync d0/da/f28 0 2024-04-25T13:47:05.728 INFO:tasks.workunit.client.0.smithi043.stdout:8/482: sync 2024-04-25T13:47:05.728 INFO:tasks.workunit.client.0.smithi043.stdout:6/538: sync 2024-04-25T13:47:05.735 INFO:tasks.workunit.client.0.smithi043.stdout:3/479: readlink d0/da/l5b 0 2024-04-25T13:47:05.737 INFO:tasks.workunit.client.0.smithi043.stdout:3/480: write d0/da/f28 [2144216,127374] 0 2024-04-25T13:47:05.738 INFO:tasks.workunit.client.0.smithi043.stdout:8/483: creat db/d38/d40/f9d x:0 0 0 2024-04-25T13:47:05.738 INFO:tasks.workunit.client.0.smithi043.stdout:6/539: mkdir d0/d90/db0 0 2024-04-25T13:47:05.739 INFO:tasks.workunit.client.0.smithi043.stdout:8/484: readlink db/d46/l6e 0 2024-04-25T13:47:05.741 INFO:tasks.workunit.client.0.smithi043.stdout:3/481: mknod d0/d9/d6e/d34/d83/d9e/ca8 0 2024-04-25T13:47:05.743 INFO:tasks.workunit.client.0.smithi043.stdout:3/482: creat d0/d13/d55/fa9 x:0 0 0 2024-04-25T13:47:05.746 INFO:tasks.workunit.client.0.smithi043.stdout:3/483: creat d0/d9/d6e/d34/d36/faa x:0 0 0 2024-04-25T13:47:05.750 INFO:tasks.workunit.client.0.smithi043.stdout:8/485: creat db/d44/d5c/f9e x:0 0 0 2024-04-25T13:47:05.751 INFO:tasks.workunit.client.0.smithi043.stdout:3/484: dwrite d0/d9/d6e/d38/d3f/f8a [0,4194304] 0 2024-04-25T13:47:05.752 INFO:tasks.workunit.client.0.smithi043.stdout:3/485: chown d0/d9/d6e/l66 12600339 1 2024-04-25T13:47:05.752 INFO:tasks.workunit.client.0.smithi043.stdout:8/486: truncate db/d11/d79/f84 529772 0 2024-04-25T13:47:05.755 INFO:tasks.workunit.client.0.smithi043.stdout:8/487: write db/d11/f15 [1323578,35397] 0 2024-04-25T13:47:05.756 INFO:tasks.workunit.client.0.smithi043.stdout:2/400: rename d0/d5/d2f/d6f to d0/d34/d3f/d7b 0 2024-04-25T13:47:05.758 INFO:tasks.workunit.client.0.smithi043.stdout:2/401: truncate d0/d26/f31 4517200 0 2024-04-25T13:47:05.759 INFO:tasks.workunit.client.0.smithi043.stdout:8/488: mknod db/d11/d1b/d59/d7c/c9f 0 2024-04-25T13:47:05.760 INFO:tasks.workunit.client.0.smithi043.stdout:2/402: mkdir d0/d5/d1e/d32/d7c 0 2024-04-25T13:47:05.763 INFO:tasks.workunit.client.0.smithi043.stdout:2/403: symlink d0/d34/d3f/d59/l7d 0 2024-04-25T13:47:05.763 INFO:tasks.workunit.client.0.smithi043.stdout:3/486: link d0/f3 d0/fab 0 2024-04-25T13:47:05.765 INFO:tasks.workunit.client.0.smithi043.stdout:2/404: write d0/d5/d1e/f52 [838282,117478] 0 2024-04-25T13:47:05.765 INFO:tasks.workunit.client.0.smithi043.stdout:2/405: readlink d0/d34/l2e 0 2024-04-25T13:47:05.776 INFO:tasks.workunit.client.0.smithi043.stdout:8/489: dread db/dc/f45 [0,4194304] 0 2024-04-25T13:47:05.777 INFO:tasks.workunit.client.0.smithi043.stdout:2/406: dwrite d0/d34/d17/f23 [4194304,4194304] 0 2024-04-25T13:47:05.779 INFO:tasks.workunit.client.0.smithi043.stdout:8/490: mkdir db/dc/d21/d4e/d62/da0 0 2024-04-25T13:47:05.780 INFO:tasks.workunit.client.0.smithi043.stdout:2/407: creat d0/d8/d22/f7e x:0 0 0 2024-04-25T13:47:05.781 INFO:tasks.workunit.client.0.smithi043.stdout:2/408: readlink d0/d5/l9 0 2024-04-25T13:47:05.782 INFO:tasks.workunit.client.0.smithi043.stdout:2/409: read - d0/d5/d2f/f6e zero size 2024-04-25T13:47:05.782 INFO:tasks.workunit.client.0.smithi043.stdout:8/491: truncate db/d11/d79/d81/f83 922933 0 2024-04-25T13:47:05.784 INFO:tasks.workunit.client.0.smithi043.stdout:3/487: dwrite d0/d9/d6e/d34/d36/f9a [0,4194304] 0 2024-04-25T13:47:05.787 INFO:tasks.workunit.client.0.smithi043.stdout:8/492: mkdir db/d11/da1 0 2024-04-25T13:47:05.788 INFO:tasks.workunit.client.0.smithi043.stdout:2/410: read d0/d8/fd [60970,1] 0 2024-04-25T13:47:05.790 INFO:tasks.workunit.client.0.smithi043.stdout:3/488: getdents d0/d9/d6e/d34/d83 0 2024-04-25T13:47:05.792 INFO:tasks.workunit.client.0.smithi043.stdout:3/489: readlink d0/d9/d6e/l26 0 2024-04-25T13:47:05.793 INFO:tasks.workunit.client.0.smithi043.stdout:2/411: read d0/d5/d2f/f79 [1225189,88505] 0 2024-04-25T13:47:05.794 INFO:tasks.workunit.client.0.smithi043.stdout:3/490: fsync d0/d13/d5a/f68 0 2024-04-25T13:47:05.794 INFO:tasks.workunit.client.0.smithi043.stdout:2/412: stat d0/d34/d3f/d59/c74 0 2024-04-25T13:47:05.801 INFO:tasks.workunit.client.0.smithi043.stdout:3/491: rename d0/d9/d81/d8e/d92/f4b to d0/d61/d82/fac 0 2024-04-25T13:47:05.802 INFO:tasks.workunit.client.0.smithi043.stdout:2/413: dwrite d0/d5/d1e/f52 [0,4194304] 0 2024-04-25T13:47:05.803 INFO:tasks.workunit.client.0.smithi043.stdout:2/414: chown d0/d35/f5d 0 1 2024-04-25T13:47:05.805 INFO:tasks.workunit.client.0.smithi043.stdout:3/492: creat d0/d9/d6e/d34/d36/d57/fad x:0 0 0 2024-04-25T13:47:05.807 INFO:tasks.workunit.client.0.smithi043.stdout:2/415: write d0/d4b/f72 [711248,130600] 0 2024-04-25T13:47:05.807 INFO:tasks.workunit.client.0.smithi043.stdout:3/493: fsync d0/d9/d6e/d34/d36/f9a 0 2024-04-25T13:47:05.808 INFO:tasks.workunit.client.0.smithi043.stdout:3/494: readlink d0/d13/d55/l93 0 2024-04-25T13:47:05.809 INFO:tasks.workunit.client.0.smithi043.stdout:3/495: dread - d0/d9/d81/fa1 zero size 2024-04-25T13:47:05.815 INFO:tasks.workunit.client.0.smithi043.stdout:2/416: getdents d0/d5 0 2024-04-25T13:47:05.816 INFO:tasks.workunit.client.0.smithi043.stdout:3/496: creat d0/d9/d81/fae x:0 0 0 2024-04-25T13:47:05.817 INFO:tasks.workunit.client.0.smithi043.stdout:8/493: dread db/dc/d21/d4e/d62/f94 [0,4194304] 0 2024-04-25T13:47:05.817 INFO:tasks.workunit.client.0.smithi043.stdout:2/417: unlink d0/d26/f5b 0 2024-04-25T13:47:05.819 INFO:tasks.workunit.client.0.smithi043.stdout:3/497: symlink d0/d13/d55/laf 0 2024-04-25T13:47:05.820 INFO:tasks.workunit.client.0.smithi043.stdout:8/494: mknod db/d11/d1b/d59/ca2 0 2024-04-25T13:47:05.821 INFO:tasks.workunit.client.0.smithi043.stdout:3/498: unlink d0/d9/d81/fae 0 2024-04-25T13:47:05.824 INFO:tasks.workunit.client.0.smithi043.stdout:8/495: rmdir db/dc/d21/d4e 39 2024-04-25T13:47:05.826 INFO:tasks.workunit.client.0.smithi043.stdout:8/496: mknod db/ca3 0 2024-04-25T13:47:05.828 INFO:tasks.workunit.client.0.smithi043.stdout:3/499: dwrite d0/d9/d6e/d34/f80 [0,4194304] 0 2024-04-25T13:47:05.829 INFO:tasks.workunit.client.0.smithi043.stdout:3/500: chown d0/d13/f7c 3470990 1 2024-04-25T13:47:05.830 INFO:tasks.workunit.client.0.smithi043.stdout:8/497: dread db/d11/d79/f84 [0,4194304] 0 2024-04-25T13:47:05.833 INFO:tasks.workunit.client.0.smithi043.stdout:8/498: mknod db/d38/d3c/d71/d5d/d67/ca4 0 2024-04-25T13:47:05.835 INFO:tasks.workunit.client.0.smithi043.stdout:8/499: creat db/d46/fa5 x:0 0 0 2024-04-25T13:47:05.835 INFO:tasks.workunit.client.0.smithi043.stdout:2/418: rename d0/d34/f37 to d0/d5/d2f/f7f 0 2024-04-25T13:47:05.836 INFO:tasks.workunit.client.0.smithi043.stdout:3/501: link d0/d13/f67 d0/d9/d81/d8e/d92/fb0 0 2024-04-25T13:47:05.838 INFO:tasks.workunit.client.0.smithi043.stdout:7/660: sync 2024-04-25T13:47:05.838 INFO:tasks.workunit.client.0.smithi043.stdout:5/406: sync 2024-04-25T13:47:05.838 INFO:tasks.workunit.client.0.smithi043.stdout:8/500: symlink db/d46/la6 0 2024-04-25T13:47:05.839 INFO:tasks.workunit.client.0.smithi043.stdout:5/407: truncate d1/d3/f81 61100 0 2024-04-25T13:47:05.841 INFO:tasks.workunit.client.0.smithi043.stdout:7/661: symlink d5/d11/d3b/d8b/d93/ldb 0 2024-04-25T13:47:05.842 INFO:tasks.workunit.client.0.smithi043.stdout:8/501: chown db/dc/f23 6 1 2024-04-25T13:47:05.844 INFO:tasks.workunit.client.0.smithi043.stdout:5/408: creat d1/d3/d7/d8/da/d11/d52/f8c x:0 0 0 2024-04-25T13:47:05.848 INFO:tasks.workunit.client.0.smithi043.stdout:2/419: truncate d0/d26/f31 1518062 0 2024-04-25T13:47:05.849 INFO:tasks.workunit.client.0.smithi043.stdout:8/502: dwrite db/d44/d8e/f56 [0,4194304] 0 2024-04-25T13:47:05.851 INFO:tasks.workunit.client.0.smithi043.stdout:7/662: truncate d5/f18 827220 0 2024-04-25T13:47:05.851 INFO:tasks.workunit.client.0.smithi043.stdout:3/502: dread d0/d9/d81/d8e/d92/f22 [0,4194304] 0 2024-04-25T13:47:05.852 INFO:tasks.workunit.client.0.smithi043.stdout:3/503: chown d0/d9/f86 179965 1 2024-04-25T13:47:05.855 INFO:tasks.workunit.client.0.smithi043.stdout:5/409: dwrite d1/d3/d7/d8/da/d11/d52/f59 [0,4194304] 0 2024-04-25T13:47:05.858 INFO:tasks.workunit.client.0.smithi043.stdout:5/410: dread - d1/d4/f7f zero size 2024-04-25T13:47:05.860 INFO:tasks.workunit.client.0.smithi043.stdout:5/411: stat d1/d3/d7/d2f/d67/l58 0 2024-04-25T13:47:05.861 INFO:tasks.workunit.client.0.smithi043.stdout:2/420: chown d0/d34/d17/l6a 3 1 2024-04-25T13:47:05.861 INFO:tasks.workunit.client.0.smithi043.stdout:8/503: write db/d44/d5c/f9e [494216,69180] 0 2024-04-25T13:47:05.861 INFO:tasks.workunit.client.0.smithi043.stdout:6/540: sync 2024-04-25T13:47:05.862 INFO:tasks.workunit.client.0.smithi043.stdout:0/529: sync 2024-04-25T13:47:05.862 INFO:tasks.workunit.client.0.smithi043.stdout:4/437: sync 2024-04-25T13:47:05.862 INFO:tasks.workunit.client.0.smithi043.stdout:1/540: sync 2024-04-25T13:47:05.865 INFO:tasks.workunit.client.0.smithi043.stdout:2/421: write d0/d8/d22/d36/f3a [1778694,127715] 0 2024-04-25T13:47:05.867 INFO:tasks.workunit.client.0.smithi043.stdout:0/530: creat db/d25/d2a/fb6 x:0 0 0 2024-04-25T13:47:05.867 INFO:tasks.workunit.client.0.smithi043.stdout:1/541: mkdir df/d10/d22/d2f/d9c/dbd 0 2024-04-25T13:47:05.868 INFO:tasks.workunit.client.0.smithi043.stdout:2/422: dread - d0/d34/d17/f60 zero size 2024-04-25T13:47:05.870 INFO:tasks.workunit.client.0.smithi043.stdout:0/531: fsync db/d1b/d23/f31 0 2024-04-25T13:47:05.871 INFO:tasks.workunit.client.0.smithi043.stdout:6/541: link d0/f31 d0/d1c/fb1 0 2024-04-25T13:47:05.873 INFO:tasks.workunit.client.0.smithi043.stdout:1/542: fdatasync df/d31/d38/d43/f57 0 2024-04-25T13:47:05.876 INFO:tasks.workunit.client.0.smithi043.stdout:3/504: write d0/d9/f95 [1004670,84330] 0 2024-04-25T13:47:05.879 INFO:tasks.workunit.client.0.smithi043.stdout:0/532: unlink db/d1b/d62/d72/f8f 0 2024-04-25T13:47:05.882 INFO:tasks.workunit.client.0.smithi043.stdout:4/438: link d1/de/df/d1a/d27/d36/d53/d66/f75 d1/de/f8e 0 2024-04-25T13:47:05.883 INFO:tasks.workunit.client.0.smithi043.stdout:2/423: unlink d0/d8/f69 0 2024-04-25T13:47:05.884 INFO:tasks.workunit.client.0.smithi043.stdout:3/505: unlink d0/d13/f3d 0 2024-04-25T13:47:05.884 INFO:tasks.workunit.client.0.smithi043.stdout:5/412: dread d1/d3/d7/d8/f44 [0,4194304] 0 2024-04-25T13:47:05.887 INFO:tasks.workunit.client.0.smithi043.stdout:4/439: rmdir d1/d3/d54/d62 39 2024-04-25T13:47:05.888 INFO:tasks.workunit.client.0.smithi043.stdout:6/542: dwrite d0/d1c/f63 [0,4194304] 0 2024-04-25T13:47:05.889 INFO:tasks.workunit.client.0.smithi043.stdout:5/413: readlink d1/d4/d42/l5f 0 2024-04-25T13:47:05.889 INFO:tasks.workunit.client.0.smithi043.stdout:8/504: dwrite db/dc/f48 [0,4194304] 0 2024-04-25T13:47:05.894 INFO:tasks.workunit.client.0.smithi043.stdout:1/543: dwrite df/d31/d34/d8b/d39/f4e [0,4194304] 0 2024-04-25T13:47:05.895 INFO:tasks.workunit.client.0.smithi043.stdout:4/440: mkdir d1/d3/d8f 0 2024-04-25T13:47:05.900 INFO:tasks.workunit.client.0.smithi043.stdout:7/663: rename d5/d11/f85 to d5/d11/d84/fdc 0 2024-04-25T13:47:05.901 INFO:tasks.workunit.client.0.smithi043.stdout:3/506: dwrite d0/f3 [0,4194304] 0 2024-04-25T13:47:05.901 INFO:tasks.workunit.client.0.smithi043.stdout:8/505: symlink db/d7d/la7 0 2024-04-25T13:47:05.903 INFO:tasks.workunit.client.0.smithi043.stdout:3/507: dread d0/d13/f7c [0,4194304] 0 2024-04-25T13:47:05.906 INFO:tasks.workunit.client.0.smithi043.stdout:5/414: mkdir d1/d8d 0 2024-04-25T13:47:05.908 INFO:tasks.workunit.client.0.smithi043.stdout:6/543: write d0/d1c/f3e [2923250,54558] 0 2024-04-25T13:47:05.909 INFO:tasks.workunit.client.0.smithi043.stdout:6/544: stat d0 0 2024-04-25T13:47:05.909 INFO:tasks.workunit.client.0.smithi043.stdout:2/424: truncate d0/f63 2043049 0 2024-04-25T13:47:05.911 INFO:tasks.workunit.client.0.smithi043.stdout:3/508: dwrite d0/d9/f62 [0,4194304] 0 2024-04-25T13:47:05.914 INFO:tasks.workunit.client.0.smithi043.stdout:8/506: readlink db/le 0 2024-04-25T13:47:05.915 INFO:tasks.workunit.client.0.smithi043.stdout:8/507: fsync db/d44/d8e/f96 0 2024-04-25T13:47:05.916 INFO:tasks.workunit.client.0.smithi043.stdout:0/533: rename db/d1b/d23/d27/d39/f7b to db/d25/d2a/d93/fb7 0 2024-04-25T13:47:05.920 INFO:tasks.workunit.client.0.smithi043.stdout:1/544: rename df/d31/d38/d43/l40 to df/d31/lbe 0 2024-04-25T13:47:05.920 INFO:tasks.workunit.client.0.smithi043.stdout:4/441: creat d1/d3/d54/d62/f90 x:0 0 0 2024-04-25T13:47:05.921 INFO:tasks.workunit.client.0.smithi043.stdout:8/508: read db/d11/d1b/f89 [3334046,65560] 0 2024-04-25T13:47:05.922 INFO:tasks.workunit.client.0.smithi043.stdout:5/415: rmdir d1/d3/d7/d2f 39 2024-04-25T13:47:05.924 INFO:tasks.workunit.client.0.smithi043.stdout:1/545: mknod df/d14/d3d/d82/d8c/cbf 0 2024-04-25T13:47:05.926 INFO:tasks.workunit.client.0.smithi043.stdout:3/509: unlink d0/d13/d5a/d90/f9d 0 2024-04-25T13:47:05.928 INFO:tasks.workunit.client.0.smithi043.stdout:1/546: creat df/d14/d63/d67/da7/fc0 x:0 0 0 2024-04-25T13:47:05.930 INFO:tasks.workunit.client.0.smithi043.stdout:3/510: mkdir d0/d13/d2e/db1 0 2024-04-25T13:47:05.930 INFO:tasks.workunit.client.0.smithi043.stdout:4/442: rmdir d1/de/d1d 39 2024-04-25T13:47:05.931 INFO:tasks.workunit.client.0.smithi043.stdout:2/425: dwrite d0/d8/ff [0,4194304] 0 2024-04-25T13:47:05.932 INFO:tasks.workunit.client.0.smithi043.stdout:4/443: dread - d1/de/f8c zero size 2024-04-25T13:47:05.932 INFO:tasks.workunit.client.0.smithi043.stdout:7/664: creat d5/d11/d3b/d61/dc5/fdd x:0 0 0 2024-04-25T13:47:05.934 INFO:tasks.workunit.client.0.smithi043.stdout:2/426: readlink d0/d5/d1e/l61 0 2024-04-25T13:47:05.935 INFO:tasks.workunit.client.0.smithi043.stdout:4/444: chown d1/d3/c24 141778432 1 2024-04-25T13:47:05.936 INFO:tasks.workunit.client.0.smithi043.stdout:0/534: mkdir db/d1b/d62/db8 0 2024-04-25T13:47:05.937 INFO:tasks.workunit.client.0.smithi043.stdout:2/427: chown d0/d34/d3f/d59/c74 13878 1 2024-04-25T13:47:05.938 INFO:tasks.workunit.client.0.smithi043.stdout:5/416: dread d1/d3/d7/d8/df/d28/f48 [0,4194304] 0 2024-04-25T13:47:05.939 INFO:tasks.workunit.client.0.smithi043.stdout:6/545: rename d0/d76/d2f/d64/da1/l91 to d0/d90/d48/d73/lb2 0 2024-04-25T13:47:05.941 INFO:tasks.workunit.client.0.smithi043.stdout:3/511: write d0/d9/d81/f8c [679623,12569] 0 2024-04-25T13:47:05.941 INFO:tasks.workunit.client.0.smithi043.stdout:7/665: symlink d5/d11/d80/lde 0 2024-04-25T13:47:05.945 INFO:tasks.workunit.client.0.smithi043.stdout:4/445: creat d1/de/df/d1a/d27/d36/d53/d66/d70/d7c/f91 x:0 0 0 2024-04-25T13:47:05.946 INFO:tasks.workunit.client.0.smithi043.stdout:1/547: dwrite df/d14/d63/d67/d9f/fb5 [0,4194304] 0 2024-04-25T13:47:05.947 INFO:tasks.workunit.client.0.smithi043.stdout:4/446: chown d1/d34/d35/l4f 65897373 1 2024-04-25T13:47:05.948 INFO:tasks.workunit.client.0.smithi043.stdout:6/546: rename d0/d76/l58 to d0/d76/d2f/d64/da1/da3/lb3 0 2024-04-25T13:47:05.948 INFO:tasks.workunit.client.0.smithi043.stdout:7/666: symlink d5/d11/d8f/ldf 0 2024-04-25T13:47:05.949 INFO:tasks.workunit.client.0.smithi043.stdout:5/417: symlink d1/d3/d62/l8e 0 2024-04-25T13:47:05.951 INFO:tasks.workunit.client.0.smithi043.stdout:1/548: rmdir df/d31/d34/d8b 39 2024-04-25T13:47:05.951 INFO:tasks.workunit.client.0.smithi043.stdout:4/447: mkdir d1/d3/d54/d62/d77/d92 0 2024-04-25T13:47:05.952 INFO:tasks.workunit.client.0.smithi043.stdout:7/667: read - d5/d11/d84/f94 zero size 2024-04-25T13:47:05.953 INFO:tasks.workunit.client.0.smithi043.stdout:8/509: write db/dc/d21/f4c [345123,25850] 0 2024-04-25T13:47:05.954 INFO:tasks.workunit.client.0.smithi043.stdout:1/549: stat df/d31/d34/d8b/d39/f4e 0 2024-04-25T13:47:05.955 INFO:tasks.workunit.client.0.smithi043.stdout:5/418: mknod d1/d3/d7/d9/d2d/c8f 0 2024-04-25T13:47:05.956 INFO:tasks.workunit.client.0.smithi043.stdout:1/550: dread - df/d14/fa8 zero size 2024-04-25T13:47:05.957 INFO:tasks.workunit.client.0.smithi043.stdout:3/512: dwrite d0/d9/f72 [0,4194304] 0 2024-04-25T13:47:05.958 INFO:tasks.workunit.client.0.smithi043.stdout:7/668: creat d5/d11/d84/fe0 x:0 0 0 2024-04-25T13:47:05.960 INFO:tasks.workunit.client.0.smithi043.stdout:8/510: mkdir db/d46/da8 0 2024-04-25T13:47:05.960 INFO:tasks.workunit.client.0.smithi043.stdout:7/669: readlink d5/d11/d3b/d3f/d5a/l9c 0 2024-04-25T13:47:05.963 INFO:tasks.workunit.client.0.smithi043.stdout:5/419: creat d1/d3/d7/d8/da/d11/d52/f90 x:0 0 0 2024-04-25T13:47:05.965 INFO:tasks.workunit.client.0.smithi043.stdout:3/513: rmdir d0/d13/d2e 39 2024-04-25T13:47:05.967 INFO:tasks.workunit.client.0.smithi043.stdout:1/551: rmdir df/d31/d34/d8b/d39 39 2024-04-25T13:47:05.969 INFO:tasks.workunit.client.0.smithi043.stdout:5/420: symlink d1/d3/d62/l91 0 2024-04-25T13:47:05.970 INFO:tasks.workunit.client.0.smithi043.stdout:6/547: write d0/d76/d2f/d64/f6d [591557,63586] 0 2024-04-25T13:47:05.972 INFO:tasks.workunit.client.0.smithi043.stdout:1/552: rmdir df/d14/d63 39 2024-04-25T13:47:05.972 INFO:tasks.workunit.client.0.smithi043.stdout:8/511: dwrite db/d38/f82 [0,4194304] 0 2024-04-25T13:47:05.975 INFO:tasks.workunit.client.0.smithi043.stdout:6/548: symlink d0/d76/d5c/lb4 0 2024-04-25T13:47:05.977 INFO:tasks.workunit.client.0.smithi043.stdout:1/553: symlink df/d31/d38/d43/d81/lc1 0 2024-04-25T13:47:05.978 INFO:tasks.workunit.client.0.smithi043.stdout:3/514: write d0/d9/f45 [3294664,122232] 0 2024-04-25T13:47:05.978 INFO:tasks.workunit.client.0.smithi043.stdout:6/549: mknod d0/d76/cb5 0 2024-04-25T13:47:05.983 INFO:tasks.workunit.client.0.smithi043.stdout:7/670: dwrite d5/d11/d3b/d3f/d5a/f76 [0,4194304] 0 2024-04-25T13:47:05.986 INFO:tasks.workunit.client.0.smithi043.stdout:6/550: creat d0/d90/d48/d9d/fb6 x:0 0 0 2024-04-25T13:47:05.988 INFO:tasks.workunit.client.0.smithi043.stdout:3/515: write d0/d9/d81/f84 [1420203,103120] 0 2024-04-25T13:47:05.990 INFO:tasks.workunit.client.0.smithi043.stdout:7/671: write d5/d11/d3b/d61/d68/fce [4843497,23101] 0 2024-04-25T13:47:05.993 INFO:tasks.workunit.client.0.smithi043.stdout:3/516: mknod d0/d13/cb2 0 2024-04-25T13:47:05.993 INFO:tasks.workunit.client.0.smithi043.stdout:6/551: dread d0/d3d/d54/f68 [0,4194304] 0 2024-04-25T13:47:05.996 INFO:tasks.workunit.client.0.smithi043.stdout:7/672: creat d5/d11/d3b/d61/dc5/dcc/fe1 x:0 0 0 2024-04-25T13:47:06.001 INFO:tasks.workunit.client.0.smithi043.stdout:7/673: creat d5/d11/d3b/d3f/fe2 x:0 0 0 2024-04-25T13:47:06.005 INFO:tasks.workunit.client.0.smithi043.stdout:6/552: dwrite d0/d24/f55 [0,4194304] 0 2024-04-25T13:47:06.006 INFO:tasks.workunit.client.0.smithi043.stdout:1/554: dread df/d10/d22/f3a [0,4194304] 0 2024-04-25T13:47:06.007 INFO:tasks.workunit.client.0.smithi043.stdout:8/512: dread db/dc/d28/f6d [0,4194304] 0 2024-04-25T13:47:06.013 INFO:tasks.workunit.client.0.smithi043.stdout:7/674: dwrite d5/d11/d3b/d61/dc5/fc8 [0,4194304] 0 2024-04-25T13:47:06.013 INFO:tasks.workunit.client.0.smithi043.stdout:8/513: creat db/d11/fa9 x:0 0 0 2024-04-25T13:47:06.014 INFO:tasks.workunit.client.0.smithi043.stdout:6/553: rmdir d0/d1b 39 2024-04-25T13:47:06.019 INFO:tasks.workunit.client.0.smithi043.stdout:1/555: write df/d14/d63/d67/f75 [1021655,57561] 0 2024-04-25T13:47:06.020 INFO:tasks.workunit.client.0.smithi043.stdout:6/554: unlink d0/c36 0 2024-04-25T13:47:06.020 INFO:tasks.workunit.client.0.smithi043.stdout:1/556: read df/d31/d34/d8b/d39/f4e [3255692,54777] 0 2024-04-25T13:47:06.023 INFO:tasks.workunit.client.0.smithi043.stdout:1/557: write df/d10/d22/d2f/d9c/d41/f74 [543102,20555] 0 2024-04-25T13:47:06.025 INFO:tasks.workunit.client.0.smithi043.stdout:6/555: truncate d0/d24/d3a/f98 983086 0 2024-04-25T13:47:06.026 INFO:tasks.workunit.client.0.smithi043.stdout:3/517: rename d0/d9/d6e/c63 to d0/d9/d81/cb3 0 2024-04-25T13:47:06.034 INFO:tasks.workunit.client.0.smithi043.stdout:8/514: truncate db/dc/d21/f6b 2134239 0 2024-04-25T13:47:06.037 INFO:tasks.workunit.client.0.smithi043.stdout:6/556: dwrite d0/d24/fa5 [0,4194304] 0 2024-04-25T13:47:06.038 INFO:tasks.workunit.client.0.smithi043.stdout:7/675: dwrite d5/d11/d84/fdc [0,4194304] 0 2024-04-25T13:47:06.040 INFO:tasks.workunit.client.0.smithi043.stdout:7/676: stat d5/c9 0 2024-04-25T13:47:06.041 INFO:tasks.workunit.client.0.smithi043.stdout:3/518: dread d0/d13/d2e/f31 [0,4194304] 0 2024-04-25T13:47:06.042 INFO:tasks.workunit.client.0.smithi043.stdout:8/515: creat db/d11/d1b/faa x:0 0 0 2024-04-25T13:47:06.043 INFO:tasks.workunit.client.0.smithi043.stdout:7/677: mknod d5/d11/d3b/d8b/d9b/ce3 0 2024-04-25T13:47:06.045 INFO:tasks.workunit.client.0.smithi043.stdout:6/557: dread d0/d24/fa5 [0,4194304] 0 2024-04-25T13:47:06.046 INFO:tasks.workunit.client.0.smithi043.stdout:7/678: creat d5/d11/db4/fe4 x:0 0 0 2024-04-25T13:47:06.047 INFO:tasks.workunit.client.0.smithi043.stdout:6/558: rmdir d0/d24 39 2024-04-25T13:47:06.048 INFO:tasks.workunit.client.0.smithi043.stdout:6/559: write d0/fab [373921,9943] 0 2024-04-25T13:47:06.049 INFO:tasks.workunit.client.0.smithi043.stdout:1/558: dread df/d10/f12 [0,4194304] 0 2024-04-25T13:47:06.049 INFO:tasks.workunit.client.0.smithi043.stdout:7/679: creat d5/d11/d3b/d3f/d5a/fe5 x:0 0 0 2024-04-25T13:47:06.051 INFO:tasks.workunit.client.0.smithi043.stdout:1/559: chown df/d10/f76 9831 1 2024-04-25T13:47:06.052 INFO:tasks.workunit.client.0.smithi043.stdout:6/560: creat d0/d3d/d6e/fb7 x:0 0 0 2024-04-25T13:47:06.052 INFO:tasks.workunit.client.0.smithi043.stdout:7/680: write d5/d11/f31 [4367492,90767] 0 2024-04-25T13:47:06.162 INFO:tasks.workunit.client.0.smithi043.stdout:7/681: mknod d5/d11/d3b/d3f/d5a/d8d/ce6 0 2024-04-25T13:47:06.162 INFO:tasks.workunit.client.0.smithi043.stdout:3/519: rename d0/d9/c79 to d0/da/cb4 0 2024-04-25T13:47:06.164 INFO:tasks.workunit.client.0.smithi043.stdout:7/682: mknod d5/d11/d3b/d3f/d5a/ce7 0 2024-04-25T13:47:06.164 INFO:tasks.workunit.client.0.smithi043.stdout:7/683: readlink d5/d11/d3b/d8b/l97 0 2024-04-25T13:47:06.172 INFO:tasks.workunit.client.0.smithi043.stdout:3/520: readlink d0/d9/d6e/d34/d36/d57/l7e 0 2024-04-25T13:47:06.173 INFO:tasks.workunit.client.0.smithi043.stdout:7/684: chown d5/d11/d3b/d61/d68/dc0/f6c 367 1 2024-04-25T13:47:06.175 INFO:tasks.workunit.client.0.smithi043.stdout:7/685: mknod d5/d6b/ce8 0 2024-04-25T13:47:06.182 INFO:tasks.workunit.client.0.smithi043.stdout:7/686: write d5/d11/d3b/d61/d68/dc0/fb7 [1179094,97115] 0 2024-04-25T13:47:06.184 INFO:tasks.workunit.client.0.smithi043.stdout:7/687: creat d5/d11/fe9 x:0 0 0 2024-04-25T13:47:06.186 INFO:tasks.workunit.client.0.smithi043.stdout:7/688: mknod d5/d32/cea 0 2024-04-25T13:47:06.187 INFO:tasks.workunit.client.0.smithi043.stdout:8/516: rename db/d11/fa9 to db/dc/d21/d4e/fab 0 2024-04-25T13:47:06.189 INFO:tasks.workunit.client.0.smithi043.stdout:3/521: dread d0/d9/f20 [0,4194304] 0 2024-04-25T13:47:06.191 INFO:tasks.workunit.client.0.smithi043.stdout:1/560: rename df/d14/f3c to df/d14/d3d/d82/d8c/fc2 0 2024-04-25T13:47:06.193 INFO:tasks.workunit.client.0.smithi043.stdout:7/689: unlink d5/d11/d3b/d8b/d93/f9a 0 2024-04-25T13:47:06.201 INFO:tasks.workunit.client.0.smithi043.stdout:1/561: symlink df/d31/d38/d43/d53/lc3 0 2024-04-25T13:47:06.202 INFO:tasks.workunit.client.0.smithi043.stdout:0/535: sync 2024-04-25T13:47:06.203 INFO:tasks.workunit.client.0.smithi043.stdout:8/517: dwrite db/d11/d1b/f95 [0,4194304] 0 2024-04-25T13:47:06.203 INFO:tasks.workunit.client.0.smithi043.stdout:6/561: rename d0/c15 to d0/d24/cb8 0 2024-04-25T13:47:06.204 INFO:tasks.workunit.client.0.smithi043.stdout:1/562: chown df/d14/d3d/l4c 55233734 1 2024-04-25T13:47:06.205 INFO:tasks.workunit.client.0.smithi043.stdout:0/536: chown db/d1b/d62/fb4 1528071 1 2024-04-25T13:47:06.207 INFO:tasks.workunit.client.0.smithi043.stdout:3/522: dwrite d0/d9/f62 [0,4194304] 0 2024-04-25T13:47:06.207 INFO:tasks.workunit.client.0.smithi043.stdout:7/690: rename d5/d11/ca6 to d5/d11/d3b/d61/dd4/ceb 0 2024-04-25T13:47:06.207 INFO:tasks.workunit.client.0.smithi043.stdout:1/563: symlink df/d31/lc4 0 2024-04-25T13:47:06.207 INFO:tasks.workunit.client.0.smithi043.stdout:0/537: fdatasync db/d25/d2a/fb6 0 2024-04-25T13:47:06.210 INFO:tasks.workunit.client.0.smithi043.stdout:6/562: creat d0/d90/d48/d9d/fb9 x:0 0 0 2024-04-25T13:47:06.210 INFO:tasks.workunit.client.0.smithi043.stdout:0/538: read - db/d1b/d36/f34 zero size 2024-04-25T13:47:06.212 INFO:tasks.workunit.client.0.smithi043.stdout:3/523: mknod d0/d13/d5a/d90/cb5 0 2024-04-25T13:47:06.215 INFO:tasks.workunit.client.0.smithi043.stdout:6/563: truncate d0/d3d/d6e/d71/f8f 111981 0 2024-04-25T13:47:06.216 INFO:tasks.workunit.client.0.smithi043.stdout:8/518: dwrite db/d11/f17 [0,4194304] 0 2024-04-25T13:47:06.216 INFO:tasks.workunit.client.0.smithi043.stdout:7/691: rename d5/d11/d3b/d3f/d5a/d8d/cba to d5/d11/d8f/cec 0 2024-04-25T13:47:06.218 INFO:tasks.workunit.client.0.smithi043.stdout:8/519: write db/d11/d1b/f95 [500212,82813] 0 2024-04-25T13:47:06.219 INFO:tasks.workunit.client.0.smithi043.stdout:1/564: getdents df/d10/d22/d2f 0 2024-04-25T13:47:06.220 INFO:tasks.workunit.client.0.smithi043.stdout:3/524: write d0/d9/f45 [3091390,98493] 0 2024-04-25T13:47:06.224 INFO:tasks.workunit.client.0.smithi043.stdout:0/539: mknod db/d1b/d4f/cb9 0 2024-04-25T13:47:06.224 INFO:tasks.workunit.client.0.smithi043.stdout:6/564: readlink d0/d76/d2f/d64/da1/da3/lb3 0 2024-04-25T13:47:06.225 INFO:tasks.workunit.client.0.smithi043.stdout:1/565: chown df/d31/d38/l7d 11 1 2024-04-25T13:47:06.225 INFO:tasks.workunit.client.0.smithi043.stdout:7/692: unlink d5/d11/d3b/d3f/d5a/d89/lb3 0 2024-04-25T13:47:06.228 INFO:tasks.workunit.client.0.smithi043.stdout:8/520: mknod db/d11/d1b/d59/d7c/cac 0 2024-04-25T13:47:06.231 INFO:tasks.workunit.client.0.smithi043.stdout:3/525: symlink d0/d9/d81/d8e/d92/lb6 0 2024-04-25T13:47:06.232 INFO:tasks.workunit.client.0.smithi043.stdout:1/566: write df/d10/d22/f58 [1266267,31379] 0 2024-04-25T13:47:06.233 INFO:tasks.workunit.client.0.smithi043.stdout:7/693: fdatasync d5/d11/d3b/d61/dc5/fc8 0 2024-04-25T13:47:06.236 INFO:tasks.workunit.client.0.smithi043.stdout:6/565: dread d0/fab [0,4194304] 0 2024-04-25T13:47:06.236 INFO:tasks.workunit.client.0.smithi043.stdout:1/567: write fe [4526118,47388] 0 2024-04-25T13:47:06.239 INFO:tasks.workunit.client.0.smithi043.stdout:7/694: chown d5/cb 42905471 1 2024-04-25T13:47:06.242 INFO:tasks.workunit.client.0.smithi043.stdout:1/568: fsync df/d31/d34/f4a 0 2024-04-25T13:47:06.244 INFO:tasks.workunit.client.0.smithi043.stdout:8/521: dwrite db/d11/f2a [0,4194304] 0 2024-04-25T13:47:06.253 INFO:tasks.workunit.client.0.smithi043.stdout:3/526: dwrite d0/d13/d55/fa9 [0,4194304] 0 2024-04-25T13:47:06.255 INFO:tasks.workunit.client.0.smithi043.stdout:0/540: dread db/d1b/f47 [0,4194304] 0 2024-04-25T13:47:06.261 INFO:tasks.workunit.client.0.smithi043.stdout:6/566: dwrite d0/d76/d2f/d64/f9b [0,4194304] 0 2024-04-25T13:47:06.262 INFO:tasks.workunit.client.0.smithi043.stdout:4/448: sync 2024-04-25T13:47:06.262 INFO:tasks.workunit.client.0.smithi043.stdout:2/428: sync 2024-04-25T13:47:06.262 INFO:tasks.workunit.client.0.smithi043.stdout:1/569: rename df/d31/d34/d8b/f36 to df/d14/d63/d67/fc5 0 2024-04-25T13:47:06.267 INFO:tasks.workunit.client.0.smithi043.stdout:7/695: dwrite d5/d11/f31 [4194304,4194304] 0 2024-04-25T13:47:06.270 INFO:tasks.workunit.client.0.smithi043.stdout:8/522: dwrite db/d11/d1b/f66 [0,4194304] 0 2024-04-25T13:47:06.270 INFO:tasks.workunit.client.0.smithi043.stdout:0/541: creat db/d1b/d62/d72/da2/fba x:0 0 0 2024-04-25T13:47:06.275 INFO:tasks.workunit.client.0.smithi043.stdout:2/429: creat d0/d34/d3f/d46/d55/f80 x:0 0 0 2024-04-25T13:47:06.276 INFO:tasks.workunit.client.0.smithi043.stdout:0/542: readlink db/d25/l91 0 2024-04-25T13:47:06.278 INFO:tasks.workunit.client.0.smithi043.stdout:6/567: dread d0/d76/d2f/d64/fa8 [0,4194304] 0 2024-04-25T13:47:06.278 INFO:tasks.workunit.client.0.smithi043.stdout:8/523: write db/dc/f23 [5092805,52120] 0 2024-04-25T13:47:06.280 INFO:tasks.workunit.client.0.smithi043.stdout:3/527: dwrite d0/f3b [0,4194304] 0 2024-04-25T13:47:06.283 INFO:tasks.workunit.client.0.smithi043.stdout:7/696: write d5/d11/d3b/d3f/d5a/f65 [60898,13137] 0 2024-04-25T13:47:06.283 INFO:tasks.workunit.client.0.smithi043.stdout:1/570: getdents df/d31/d34/d8b 0 2024-04-25T13:47:06.285 INFO:tasks.workunit.client.0.smithi043.stdout:8/524: stat db/dc/d28/l6a 0 2024-04-25T13:47:06.289 INFO:tasks.workunit.client.0.smithi043.stdout:3/528: mknod d0/d9/d6e/d34/d36/d57/cb7 0 2024-04-25T13:47:06.290 INFO:tasks.workunit.client.0.smithi043.stdout:8/525: rmdir db 39 2024-04-25T13:47:06.292 INFO:tasks.workunit.client.0.smithi043.stdout:2/430: dread d0/d8/ff [0,4194304] 0 2024-04-25T13:47:06.292 INFO:tasks.workunit.client.0.smithi043.stdout:6/568: unlink d0/l1e 0 2024-04-25T13:47:06.294 INFO:tasks.workunit.client.0.smithi043.stdout:4/449: dwrite d1/de/df/d1a/d27/f51 [0,4194304] 0 2024-04-25T13:47:06.295 INFO:tasks.workunit.client.0.smithi043.stdout:3/529: write d0/d9/f45 [3858364,116443] 0 2024-04-25T13:47:06.296 INFO:tasks.workunit.client.0.smithi043.stdout:1/571: creat df/d14/d63/d67/fc6 x:0 0 0 2024-04-25T13:47:06.296 INFO:tasks.workunit.client.0.smithi043.stdout:6/569: dread - d0/d3d/d54/f9f zero size 2024-04-25T13:47:06.298 INFO:tasks.workunit.client.0.smithi043.stdout:2/431: write d0/d8/fa [2380879,107816] 0 2024-04-25T13:47:06.298 INFO:tasks.workunit.client.0.smithi043.stdout:7/697: symlink d5/d11/d3b/d8b/d93/led 0 2024-04-25T13:47:06.299 INFO:tasks.workunit.client.0.smithi043.stdout:0/543: mkdir db/d1b/d23/d27/d39/d4c/dbb 0 2024-04-25T13:47:06.300 INFO:tasks.workunit.client.0.smithi043.stdout:4/450: write d1/d3/f3e [1475083,69637] 0 2024-04-25T13:47:06.305 INFO:tasks.workunit.client.0.smithi043.stdout:7/698: chown d5/d11/d3b/d61/d68/dc0/cd6 279 1 2024-04-25T13:47:06.305 INFO:tasks.workunit.client.0.smithi043.stdout:4/451: chown d1/de/d1d/d20 83553427 1 2024-04-25T13:47:06.306 INFO:tasks.workunit.client.0.smithi043.stdout:3/530: mknod d0/d9/d78/cb8 0 2024-04-25T13:47:06.309 INFO:tasks.workunit.client.0.smithi043.stdout:5/421: sync 2024-04-25T13:47:06.314 INFO:tasks.workunit.client.0.smithi043.stdout:5/422: mkdir d1/d4/d92 0 2024-04-25T13:47:06.317 INFO:tasks.workunit.client.0.smithi043.stdout:1/572: dwrite df/d10/d22/d2f/d9c/d41/f74 [0,4194304] 0 2024-04-25T13:47:06.318 INFO:tasks.workunit.client.0.smithi043.stdout:4/452: dread d1/d3/d54/d62/d77/d79/f5e [0,4194304] 0 2024-04-25T13:47:06.318 INFO:tasks.workunit.client.0.smithi043.stdout:6/570: truncate d0/d24/f6b 870593 0 2024-04-25T13:47:06.323 INFO:tasks.workunit.client.0.smithi043.stdout:0/544: dwrite db/d1b/d23/d27/d39/d4c/da9/fac [0,4194304] 0 2024-04-25T13:47:06.324 INFO:tasks.workunit.client.0.smithi043.stdout:5/423: mknod d1/d4/d42/c93 0 2024-04-25T13:47:06.325 INFO:tasks.workunit.client.0.smithi043.stdout:7/699: dwrite d5/d75/f66 [0,4194304] 0 2024-04-25T13:47:06.329 INFO:tasks.workunit.client.0.smithi043.stdout:8/526: dwrite db/f35 [0,4194304] 0 2024-04-25T13:47:06.330 INFO:tasks.workunit.client.0.smithi043.stdout:0/545: chown db/d1b/d36/d41/d71 365751 1 2024-04-25T13:47:06.333 INFO:tasks.workunit.client.0.smithi043.stdout:4/453: unlink d1/de/df/d1a/f64 0 2024-04-25T13:47:06.336 INFO:tasks.workunit.client.0.smithi043.stdout:1/573: getdents df/d14/d63/d67/da7 0 2024-04-25T13:47:06.338 INFO:tasks.workunit.client.0.smithi043.stdout:4/454: write d1/de/df/f40 [1358013,28419] 0 2024-04-25T13:47:06.341 INFO:tasks.workunit.client.0.smithi043.stdout:2/432: dread d0/d5/d2f/f79 [0,4194304] 0 2024-04-25T13:47:06.341 INFO:tasks.workunit.client.0.smithi043.stdout:8/527: getdents db/d11/d1b/d59 0 2024-04-25T13:47:06.346 INFO:tasks.workunit.client.0.smithi043.stdout:4/455: readlink d1/d3/l6 0 2024-04-25T13:47:06.348 INFO:tasks.workunit.client.0.smithi043.stdout:5/424: dwrite d1/d4/f7a [0,4194304] 0 2024-04-25T13:47:06.356 INFO:tasks.workunit.client.0.smithi043.stdout:8/528: chown db/d11/d79/c8a 10295261 1 2024-04-25T13:47:06.358 INFO:tasks.workunit.client.0.smithi043.stdout:5/425: creat d1/d3/d7/d9/d2d/f94 x:0 0 0 2024-04-25T13:47:06.359 INFO:tasks.workunit.client.0.smithi043.stdout:1/574: dwrite df/d10/d22/d2f/d9c/f85 [0,4194304] 0 2024-04-25T13:47:06.362 INFO:tasks.workunit.client.0.smithi043.stdout:0/546: mknod db/d1b/d4f/cbc 0 2024-04-25T13:47:06.364 INFO:tasks.workunit.client.0.smithi043.stdout:2/433: dwrite d0/d34/d3f/d46/d55/f65 [0,4194304] 0 2024-04-25T13:47:06.364 INFO:tasks.workunit.client.0.smithi043.stdout:4/456: dwrite d1/de/df/d1e/d28/d33/f74 [0,4194304] 0 2024-04-25T13:47:06.365 INFO:tasks.workunit.client.0.smithi043.stdout:5/426: mkdir d1/d4/d92/d95 0 2024-04-25T13:47:06.367 INFO:tasks.workunit.client.0.smithi043.stdout:1/575: fdatasync df/d14/d63/d71/f7c 0 2024-04-25T13:47:06.369 INFO:tasks.workunit.client.0.smithi043.stdout:2/434: chown d0/d5/d2f 3633208 1 2024-04-25T13:47:06.369 INFO:tasks.workunit.client.0.smithi043.stdout:8/529: getdents db/dc/d21/d4e/d62/da0 0 2024-04-25T13:47:06.372 INFO:tasks.workunit.client.0.smithi043.stdout:8/530: chown db/d46/l5e 186763855 1 2024-04-25T13:47:06.373 INFO:tasks.workunit.client.0.smithi043.stdout:3/531: rename d0/d9/d6e/d34/d83 to d0/da/db9 0 2024-04-25T13:47:06.376 INFO:tasks.workunit.client.0.smithi043.stdout:5/427: dread d1/d3/d7/d8/da/d11/d52/f59 [0,4194304] 0 2024-04-25T13:47:06.378 INFO:tasks.workunit.client.0.smithi043.stdout:3/532: chown d0/d13/d55/l65 24 1 2024-04-25T13:47:06.378 INFO:tasks.workunit.client.0.smithi043.stdout:2/435: dread d0/d4b/f68 [0,4194304] 0 2024-04-25T13:47:06.380 INFO:tasks.workunit.client.0.smithi043.stdout:5/428: dread - d1/d4/f68 zero size 2024-04-25T13:47:06.384 INFO:tasks.workunit.client.0.smithi043.stdout:6/571: rename d0/d24/f6b to d0/d76/d2f/fba 0 2024-04-25T13:47:06.386 INFO:tasks.workunit.client.0.smithi043.stdout:4/457: dwrite d1/de/f1c [0,4194304] 0 2024-04-25T13:47:06.386 INFO:tasks.workunit.client.0.smithi043.stdout:3/533: symlink d0/d9/d6e/d34/d36/d57/lba 0 2024-04-25T13:47:06.386 INFO:tasks.workunit.client.0.smithi043.stdout:5/429: write d1/f19 [4288682,91856] 0 2024-04-25T13:47:06.387 INFO:tasks.workunit.client.0.smithi043.stdout:6/572: readlink d0/d76/d5c/lb4 0 2024-04-25T13:47:06.387 INFO:tasks.workunit.client.0.smithi043.stdout:2/436: mkdir d0/d34/d17/d5e/d71/d81 0 2024-04-25T13:47:06.389 INFO:tasks.workunit.client.0.smithi043.stdout:8/531: dwrite db/d44/d8e/f96 [0,4194304] 0 2024-04-25T13:47:06.390 INFO:tasks.workunit.client.0.smithi043.stdout:4/458: fsync d1/de/df/d1e/d28/f84 0 2024-04-25T13:47:06.391 INFO:tasks.workunit.client.0.smithi043.stdout:3/534: symlink d0/d61/lbb 0 2024-04-25T13:47:06.391 INFO:tasks.workunit.client.0.smithi043.stdout:2/437: chown d0/l19 223 1 2024-04-25T13:47:06.393 INFO:tasks.workunit.client.0.smithi043.stdout:5/430: chown d1/d3/d7/d9/d2d/f6c 607 1 2024-04-25T13:47:06.394 INFO:tasks.workunit.client.0.smithi043.stdout:6/573: unlink d0/d90/d48/d9d/fb9 0 2024-04-25T13:47:06.397 INFO:tasks.workunit.client.0.smithi043.stdout:7/700: rename d5/d11/d3b/d3f to d5/d11/d3b/d61/dc5/dee 0 2024-04-25T13:47:06.397 INFO:tasks.workunit.client.0.smithi043.stdout:3/535: chown d0/d9/f23 167228 1 2024-04-25T13:47:06.397 INFO:tasks.workunit.client.0.smithi043.stdout:2/438: symlink d0/d8/d22/d5c/l82 0 2024-04-25T13:47:06.398 INFO:tasks.workunit.client.0.smithi043.stdout:6/574: symlink d0/d24/d3a/lbb 0 2024-04-25T13:47:06.399 INFO:tasks.workunit.client.0.smithi043.stdout:7/701: chown d5/d11/d3b 125261 1 2024-04-25T13:47:06.399 INFO:tasks.workunit.client.0.smithi043.stdout:8/532: getdents db/d38/d3c/d71/d5d/d67 0 2024-04-25T13:47:06.400 INFO:tasks.workunit.client.0.smithi043.stdout:5/431: creat d1/d3/d7/d2f/d80/f96 x:0 0 0 2024-04-25T13:47:06.401 INFO:tasks.workunit.client.0.smithi043.stdout:3/536: chown d0/d13/d2e/f31 18 1 2024-04-25T13:47:06.401 INFO:tasks.workunit.client.0.smithi043.stdout:6/575: readlink d0/d1c/l1f 0 2024-04-25T13:47:06.403 INFO:tasks.workunit.client.0.smithi043.stdout:8/533: dread - db/d46/fa5 zero size 2024-04-25T13:47:06.404 INFO:tasks.workunit.client.0.smithi043.stdout:4/459: dwrite d1/d3/d54/d62/d77/d79/f72 [0,4194304] 0 2024-04-25T13:47:06.405 INFO:tasks.workunit.client.0.smithi043.stdout:5/432: write d1/d3/f81 [895858,16066] 0 2024-04-25T13:47:06.409 INFO:tasks.workunit.client.0.smithi043.stdout:6/576: creat d0/d1b/fbc x:0 0 0 2024-04-25T13:47:06.410 INFO:tasks.workunit.client.0.smithi043.stdout:4/460: chown d1/de/df/d1e/d45/f88 2 1 2024-04-25T13:47:06.412 INFO:tasks.workunit.client.0.smithi043.stdout:2/439: dwrite d0/d8/fa [0,4194304] 0 2024-04-25T13:47:06.413 INFO:tasks.workunit.client.0.smithi043.stdout:5/433: unlink d1/d3/d7/d8/l54 0 2024-04-25T13:47:06.417 INFO:tasks.workunit.client.0.smithi043.stdout:6/577: rename d0/d1c/f3f to d0/d76/d5c/fbd 0 2024-04-25T13:47:06.417 INFO:tasks.workunit.client.0.smithi043.stdout:8/534: dread db/dc/f48 [0,4194304] 0 2024-04-25T13:47:06.417 INFO:tasks.workunit.client.0.smithi043.stdout:2/440: unlink d0/d34/d3f/d59/l7d 0 2024-04-25T13:47:06.423 INFO:tasks.workunit.client.0.smithi043.stdout:3/537: dwrite d0/d9/d6e/d34/fa7 [0,4194304] 0 2024-04-25T13:47:06.423 INFO:tasks.workunit.client.0.smithi043.stdout:4/461: rename d1/d3/d54/c6e to d1/c93 0 2024-04-25T13:47:06.424 INFO:tasks.workunit.client.0.smithi043.stdout:2/441: write d0/d8/d22/f7e [75547,3381] 0 2024-04-25T13:47:06.425 INFO:tasks.workunit.client.0.smithi043.stdout:4/462: readlink d1/l61 0 2024-04-25T13:47:06.428 INFO:tasks.workunit.client.0.smithi043.stdout:6/578: creat d0/fbe x:0 0 0 2024-04-25T13:47:06.430 INFO:tasks.workunit.client.0.smithi043.stdout:5/434: link d1/d3/d7/d2f/d67/f6d d1/d4/d42/f97 0 2024-04-25T13:47:06.432 INFO:tasks.workunit.client.0.smithi043.stdout:3/538: unlink d0/d9/d6e/d34/d36/c5c 0 2024-04-25T13:47:06.434 INFO:tasks.workunit.client.0.smithi043.stdout:4/463: mkdir d1/de/df/d1a/d27/d36/d53/d66/d94 0 2024-04-25T13:47:06.435 INFO:tasks.workunit.client.0.smithi043.stdout:8/535: dwrite db/dc/f48 [0,4194304] 0 2024-04-25T13:47:06.439 INFO:tasks.workunit.client.0.smithi043.stdout:5/435: mkdir d1/d3/d7/d8/df/d98 0 2024-04-25T13:47:06.440 INFO:tasks.workunit.client.0.smithi043.stdout:2/442: mknod d0/d34/d3f/d7b/c83 0 2024-04-25T13:47:06.440 INFO:tasks.workunit.client.0.smithi043.stdout:7/702: dread d5/d11/d3b/fb9 [0,4194304] 0 2024-04-25T13:47:06.448 INFO:tasks.workunit.client.0.smithi043.stdout:6/579: rename d0/d1c/f63 to d0/d76/d2f/d64/da1/fbf 0 2024-04-25T13:47:06.448 INFO:tasks.workunit.client.0.smithi043.stdout:7/703: chown d5/d32/f3a 750 1 2024-04-25T13:47:06.449 INFO:tasks.workunit.client.0.smithi043.stdout:2/443: creat d0/d8/d22/f84 x:0 0 0 2024-04-25T13:47:06.452 INFO:tasks.workunit.client.0.smithi043.stdout:3/539: dwrite d0/d13/f88 [0,4194304] 0 2024-04-25T13:47:06.454 INFO:tasks.workunit.client.0.smithi043.stdout:6/580: read d0/d24/f55 [516024,103294] 0 2024-04-25T13:47:06.456 INFO:tasks.workunit.client.0.smithi043.stdout:4/464: dwrite d1/d3/d54/d62/f90 [0,4194304] 0 2024-04-25T13:47:06.457 INFO:tasks.workunit.client.0.smithi043.stdout:3/540: dread - d0/f96 zero size 2024-04-25T13:47:06.458 INFO:tasks.workunit.client.0.smithi043.stdout:8/536: dwrite db/d11/d1b/f95 [0,4194304] 0 2024-04-25T13:47:06.460 INFO:tasks.workunit.client.0.smithi043.stdout:2/444: creat d0/d34/d17/d5e/d71/f85 x:0 0 0 2024-04-25T13:47:06.465 INFO:tasks.workunit.client.0.smithi043.stdout:2/445: chown d0/d26 290 1 2024-04-25T13:47:06.466 INFO:tasks.workunit.client.0.smithi043.stdout:8/537: chown db/dc/f2f 150339831 1 2024-04-25T13:47:06.467 INFO:tasks.workunit.client.0.smithi043.stdout:4/465: write d1/de/df/d1e/d45/f88 [2820287,16790] 0 2024-04-25T13:47:06.470 INFO:tasks.workunit.client.0.smithi043.stdout:5/436: dwrite d1/d3/d7/d8/f44 [0,4194304] 0 2024-04-25T13:47:06.471 INFO:tasks.workunit.client.0.smithi043.stdout:3/541: creat d0/d8d/fbc x:0 0 0 2024-04-25T13:47:06.475 INFO:tasks.workunit.client.0.smithi043.stdout:7/704: dwrite d5/d75/f66 [0,4194304] 0 2024-04-25T13:47:06.477 INFO:tasks.workunit.client.0.smithi043.stdout:3/542: readlink d0/d9/l30 0 2024-04-25T13:47:06.478 INFO:tasks.workunit.client.0.smithi043.stdout:5/437: symlink d1/d4/d42/l99 0 2024-04-25T13:47:06.479 INFO:tasks.workunit.client.0.smithi043.stdout:5/438: stat d1/d3/l3e 0 2024-04-25T13:47:06.482 INFO:tasks.workunit.client.0.smithi043.stdout:5/439: fdatasync d1/d3/d24/f65 0 2024-04-25T13:47:06.485 INFO:tasks.workunit.client.0.smithi043.stdout:8/538: getdents db 0 2024-04-25T13:47:06.486 INFO:tasks.workunit.client.0.smithi043.stdout:4/466: write d1/de/d1d/d20/f52 [3713833,54245] 0 2024-04-25T13:47:06.487 INFO:tasks.workunit.client.0.smithi043.stdout:2/446: truncate d0/d5/d2f/f45 13973 0 2024-04-25T13:47:06.489 INFO:tasks.workunit.client.0.smithi043.stdout:4/467: read - d1/d34/d35/f89 zero size 2024-04-25T13:47:06.491 INFO:tasks.workunit.client.0.smithi043.stdout:2/447: rmdir d0/d4b 39 2024-04-25T13:47:06.492 INFO:tasks.workunit.client.0.smithi043.stdout:8/539: fsync db/dc/d21/f39 0 2024-04-25T13:47:06.494 INFO:tasks.workunit.client.0.smithi043.stdout:5/440: dwrite d1/d3/d7/f76 [0,4194304] 0 2024-04-25T13:47:06.494 INFO:tasks.workunit.client.0.smithi043.stdout:4/468: chown d1/de/df/f41 618 1 2024-04-25T13:47:06.494 INFO:tasks.workunit.client.0.smithi043.stdout:8/540: fsync db/d11/f17 0 2024-04-25T13:47:06.496 INFO:tasks.workunit.client.0.smithi043.stdout:8/541: fdatasync db/d11/d79/d81/f83 0 2024-04-25T13:47:06.497 INFO:tasks.workunit.client.0.smithi043.stdout:3/543: write d0/d9/f95 [477100,111697] 0 2024-04-25T13:47:06.510 INFO:tasks.workunit.client.0.smithi043.stdout:5/441: unlink d1/d3/d24/f3d 0 2024-04-25T13:47:06.511 INFO:tasks.workunit.client.0.smithi043.stdout:3/544: readlink d0/da/l94 0 2024-04-25T13:47:06.514 INFO:tasks.workunit.client.0.smithi043.stdout:7/705: dread d5/d11/d3b/d61/d68/dc0/fac [0,4194304] 0 2024-04-25T13:47:06.514 INFO:tasks.workunit.client.0.smithi043.stdout:6/581: dread d0/d90/f45 [0,4194304] 0 2024-04-25T13:47:06.515 INFO:tasks.workunit.client.0.smithi043.stdout:5/442: write d1/d4/f73 [3820123,57813] 0 2024-04-25T13:47:06.518 INFO:tasks.workunit.client.0.smithi043.stdout:7/706: readlink d5/d11/d8f/ldf 0 2024-04-25T13:47:06.518 INFO:tasks.workunit.client.0.smithi043.stdout:8/542: dwrite db/dc/d21/f4c [4194304,4194304] 0 2024-04-25T13:47:06.518 INFO:tasks.workunit.client.0.smithi043.stdout:3/545: creat d0/da/db9/fbd x:0 0 0 2024-04-25T13:47:06.519 INFO:tasks.workunit.client.0.smithi043.stdout:5/443: readlink d1/d3/d26/l5c 0 2024-04-25T13:47:06.521 INFO:tasks.workunit.client.0.smithi043.stdout:2/448: dwrite d0/d34/f20 [0,4194304] 0 2024-04-25T13:47:06.522 INFO:tasks.workunit.client.0.smithi043.stdout:6/582: symlink d0/d1c/lc0 0 2024-04-25T13:47:06.524 INFO:tasks.workunit.client.0.smithi043.stdout:8/543: creat db/d44/d8e/fad x:0 0 0 2024-04-25T13:47:06.526 INFO:tasks.workunit.client.0.smithi043.stdout:3/546: mkdir d0/d13/dbe 0 2024-04-25T13:47:06.526 INFO:tasks.workunit.client.0.smithi043.stdout:5/444: chown d1/d3/d7/d8/da/l79 114024228 1 2024-04-25T13:47:06.526 INFO:tasks.workunit.client.0.smithi043.stdout:6/583: symlink d0/d76/d5c/lc1 0 2024-04-25T13:47:06.526 INFO:tasks.workunit.client.0.smithi043.stdout:8/544: read db/d11/f17 [3164944,46400] 0 2024-04-25T13:47:06.527 INFO:tasks.workunit.client.0.smithi043.stdout:7/707: mknod d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/cef 0 2024-04-25T13:47:06.528 INFO:tasks.workunit.client.0.smithi043.stdout:6/584: dread - d0/d1c/fa6 zero size 2024-04-25T13:47:06.531 INFO:tasks.workunit.client.0.smithi043.stdout:5/445: fdatasync d1/d3/d7/d2f/d67/f6d 0 2024-04-25T13:47:06.532 INFO:tasks.workunit.client.0.smithi043.stdout:7/708: mkdir d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/df0 0 2024-04-25T13:47:06.533 INFO:tasks.workunit.client.0.smithi043.stdout:3/547: rmdir d0/d13 39 2024-04-25T13:47:06.534 INFO:tasks.workunit.client.0.smithi043.stdout:2/449: dwrite d0/d5/d1e/d32/f5a [0,4194304] 0 2024-04-25T13:47:06.536 INFO:tasks.workunit.client.0.smithi043.stdout:6/585: rename d0/d3d/d54/f5e to d0/d90/db0/fc2 0 2024-04-25T13:47:06.537 INFO:tasks.workunit.client.0.smithi043.stdout:2/450: fsync d0/d26/f40 0 2024-04-25T13:47:06.538 INFO:tasks.workunit.client.0.smithi043.stdout:7/709: creat d5/d11/d3b/d61/dc5/dee/d5a/ff1 x:0 0 0 2024-04-25T13:47:06.539 INFO:tasks.workunit.client.0.smithi043.stdout:5/446: rename d1/d3/d7/d2f/d80/f96 to d1/d3/d7/d9/d2d/f9a 0 2024-04-25T13:47:06.541 INFO:tasks.workunit.client.0.smithi043.stdout:6/586: mkdir d0/d76/d2f/da7/dc3 0 2024-04-25T13:47:06.542 INFO:tasks.workunit.client.0.smithi043.stdout:8/545: dwrite db/dc/d21/f25 [0,4194304] 0 2024-04-25T13:47:06.545 INFO:tasks.workunit.client.0.smithi043.stdout:5/447: write d1/d3/d7/d2f/d67/f6d [551523,38046] 0 2024-04-25T13:47:06.547 INFO:tasks.workunit.client.0.smithi043.stdout:3/548: dread - d0/d13/fa5 zero size 2024-04-25T13:47:06.547 INFO:tasks.workunit.client.0.smithi043.stdout:7/710: rename d5/d11/c21 to d5/d11/d3b/d61/dc5/dcc/cf2 0 2024-04-25T13:47:06.548 INFO:tasks.workunit.client.0.smithi043.stdout:5/448: truncate d1/d3/d26/f27 4755004 0 2024-04-25T13:47:06.548 INFO:tasks.workunit.client.0.smithi043.stdout:6/587: write d0/d76/d5c/fbd [3065284,113529] 0 2024-04-25T13:47:06.549 INFO:tasks.workunit.client.0.smithi043.stdout:5/449: stat d1/d3/d7/d8 0 2024-04-25T13:47:06.550 INFO:tasks.workunit.client.0.smithi043.stdout:7/711: stat d5/d32/c50 0 2024-04-25T13:47:06.551 INFO:tasks.workunit.client.0.smithi043.stdout:6/588: chown d0/d76/d2f/d64/fa8 654 1 2024-04-25T13:47:06.554 INFO:tasks.workunit.client.0.smithi043.stdout:7/712: truncate d5/d11/d8f/fc3 1139932 0 2024-04-25T13:47:06.555 INFO:tasks.workunit.client.0.smithi043.stdout:8/546: read db/dc/d28/f6f [300127,45903] 0 2024-04-25T13:47:06.556 INFO:tasks.workunit.client.0.smithi043.stdout:6/589: mknod d0/d3d/d6e/cc4 0 2024-04-25T13:47:06.558 INFO:tasks.workunit.client.0.smithi043.stdout:6/590: read d0/d24/d3a/f98 [482966,36812] 0 2024-04-25T13:47:06.559 INFO:tasks.workunit.client.0.smithi043.stdout:7/713: creat d5/d11/d3b/d61/dc5/dee/d5a/d8d/ff3 x:0 0 0 2024-04-25T13:47:06.560 INFO:tasks.workunit.client.0.smithi043.stdout:2/451: write d0/d5/d2f/f7f [375801,70440] 0 2024-04-25T13:47:06.561 INFO:tasks.workunit.client.0.smithi043.stdout:3/549: mknod d0/d9/cbf 0 2024-04-25T13:47:06.562 INFO:tasks.workunit.client.0.smithi043.stdout:6/591: creat d0/d90/d48/d9d/fc5 x:0 0 0 2024-04-25T13:47:06.563 INFO:tasks.workunit.client.0.smithi043.stdout:6/592: read - d0/d76/d5c/f8a zero size 2024-04-25T13:47:06.563 INFO:tasks.workunit.client.0.smithi043.stdout:2/452: mkdir d0/d34/d17/d5e/d86 0 2024-04-25T13:47:06.564 INFO:tasks.workunit.client.0.smithi043.stdout:6/593: chown d0/fbe 102305837 1 2024-04-25T13:47:06.565 INFO:tasks.workunit.client.0.smithi043.stdout:8/547: creat db/d44/d5c/fae x:0 0 0 2024-04-25T13:47:06.567 INFO:tasks.workunit.client.0.smithi043.stdout:7/714: getdents d5/d75/d54 0 2024-04-25T13:47:06.568 INFO:tasks.workunit.client.0.smithi043.stdout:3/550: mknod d0/cc0 0 2024-04-25T13:47:06.568 INFO:tasks.workunit.client.0.smithi043.stdout:6/594: mknod d0/d1c/cc6 0 2024-04-25T13:47:06.569 INFO:tasks.workunit.client.0.smithi043.stdout:2/453: unlink d0/d5/d1e/f2c 0 2024-04-25T13:47:06.570 INFO:tasks.workunit.client.0.smithi043.stdout:5/450: dread d1/d3/d7/d9/d2d/d5b/f74 [0,4194304] 0 2024-04-25T13:47:06.570 INFO:tasks.workunit.client.0.smithi043.stdout:8/548: fsync db/d11/f1d 0 2024-04-25T13:47:06.571 INFO:tasks.workunit.client.0.smithi043.stdout:8/549: write db/dc/d21/f25 [3750388,79473] 0 2024-04-25T13:47:06.573 INFO:tasks.workunit.client.0.smithi043.stdout:2/454: symlink d0/d5/d2f/l87 0 2024-04-25T13:47:06.577 INFO:tasks.workunit.client.0.smithi043.stdout:5/451: mknod d1/d3/d62/c9b 0 2024-04-25T13:47:06.578 INFO:tasks.workunit.client.0.smithi043.stdout:5/452: chown d1/d4/d42/l99 7526459 1 2024-04-25T13:47:06.579 INFO:tasks.workunit.client.0.smithi043.stdout:7/715: dread d5/f18 [0,4194304] 0 2024-04-25T13:47:06.580 INFO:tasks.workunit.client.0.smithi043.stdout:6/595: mkdir d0/d76/d2f/d64/dc7 0 2024-04-25T13:47:06.580 INFO:tasks.workunit.client.0.smithi043.stdout:7/716: write d5/d11/d3b/d61/d68/fce [4244747,99437] 0 2024-04-25T13:47:06.582 INFO:tasks.workunit.client.0.smithi043.stdout:8/550: mkdir db/d11/d1b/d59/d7c/daf 0 2024-04-25T13:47:06.585 INFO:tasks.workunit.client.0.smithi043.stdout:5/453: creat d1/d3/d62/f9c x:0 0 0 2024-04-25T13:47:06.585 INFO:tasks.workunit.client.0.smithi043.stdout:7/717: dread d5/d11/d3b/d61/d68/f77 [0,4194304] 0 2024-04-25T13:47:06.591 INFO:tasks.workunit.client.0.smithi043.stdout:2/455: dwrite d0/d4b/f68 [0,4194304] 0 2024-04-25T13:47:06.591 INFO:tasks.workunit.client.0.smithi043.stdout:6/596: getdents d0/d90/d4c 0 2024-04-25T13:47:06.592 INFO:tasks.workunit.client.0.smithi043.stdout:3/551: truncate d0/d9/d81/d8e/d92/f22 4257434 0 2024-04-25T13:47:06.592 INFO:tasks.workunit.client.0.smithi043.stdout:2/456: readlink d0/d35/l3d 0 2024-04-25T13:47:06.592 INFO:tasks.workunit.client.0.smithi043.stdout:5/454: link d1/d3/d24/d7c/f55 d1/d3/d7/d8/da/f9d 0 2024-04-25T13:47:06.593 INFO:tasks.workunit.client.0.smithi043.stdout:5/455: stat d1/d3/d7/f76 0 2024-04-25T13:47:06.593 INFO:tasks.workunit.client.0.smithi043.stdout:2/457: write d0/d5/d2f/f7f [2706855,12925] 0 2024-04-25T13:47:06.594 INFO:tasks.workunit.client.0.smithi043.stdout:3/552: mknod d0/d8d/cc1 0 2024-04-25T13:47:06.595 INFO:tasks.workunit.client.0.smithi043.stdout:5/456: write d1/d3/d7/f23 [5158488,87730] 0 2024-04-25T13:47:06.596 INFO:tasks.workunit.client.0.smithi043.stdout:6/597: creat d0/fc8 x:0 0 0 2024-04-25T13:47:06.597 INFO:tasks.workunit.client.0.smithi043.stdout:2/458: symlink d0/d35/l88 0 2024-04-25T13:47:06.601 INFO:tasks.workunit.client.0.smithi043.stdout:5/457: write d1/d3/d24/d7c/f55 [2934079,59525] 0 2024-04-25T13:47:06.602 INFO:tasks.workunit.client.0.smithi043.stdout:5/458: fdatasync d1/d3/d24/f65 0 2024-04-25T13:47:06.604 INFO:tasks.workunit.client.0.smithi043.stdout:6/598: fsync d0/d90/d4c/f61 0 2024-04-25T13:47:06.607 INFO:tasks.workunit.client.0.smithi043.stdout:6/599: write d0/d1c/f3e [4186487,85281] 0 2024-04-25T13:47:06.610 INFO:tasks.workunit.client.0.smithi043.stdout:5/459: dwrite d1/d3/d7/d2f/d67/f6d [0,4194304] 0 2024-04-25T13:47:06.610 INFO:tasks.workunit.client.0.smithi043.stdout:3/553: dread d0/da/f2d [0,4194304] 0 2024-04-25T13:47:06.612 INFO:tasks.workunit.client.0.smithi043.stdout:2/459: rmdir d0/d8 39 2024-04-25T13:47:06.615 INFO:tasks.workunit.client.0.smithi043.stdout:8/551: rename db/d44/d8e/f9c to db/d7d/fb0 0 2024-04-25T13:47:06.616 INFO:tasks.workunit.client.0.smithi043.stdout:6/600: read d0/f13 [809698,115244] 0 2024-04-25T13:47:06.618 INFO:tasks.workunit.client.0.smithi043.stdout:3/554: mkdir d0/d9/d78/dc2 0 2024-04-25T13:47:06.619 INFO:tasks.workunit.client.0.smithi043.stdout:8/552: mknod db/dc/d80/cb1 0 2024-04-25T13:47:06.620 INFO:tasks.workunit.client.0.smithi043.stdout:2/460: fsync d0/d8/d22/f7e 0 2024-04-25T13:47:06.621 INFO:tasks.workunit.client.0.smithi043.stdout:5/460: dwrite d1/d3/d7/d2f/d67/f8a [0,4194304] 0 2024-04-25T13:47:06.623 INFO:tasks.workunit.client.0.smithi043.stdout:3/555: write d0/d61/d82/fac [404624,130638] 0 2024-04-25T13:47:06.625 INFO:tasks.workunit.client.0.smithi043.stdout:2/461: creat d0/d34/d17/f89 x:0 0 0 2024-04-25T13:47:06.626 INFO:tasks.workunit.client.0.smithi043.stdout:2/462: readlink d0/d8/d22/d5c/l82 0 2024-04-25T13:47:06.627 INFO:tasks.workunit.client.0.smithi043.stdout:3/556: read - d0/da/f48 zero size 2024-04-25T13:47:06.628 INFO:tasks.workunit.client.0.smithi043.stdout:8/553: creat db/d11/d1b/fb2 x:0 0 0 2024-04-25T13:47:06.629 INFO:tasks.workunit.client.0.smithi043.stdout:2/463: creat d0/d5/d2f/f8a x:0 0 0 2024-04-25T13:47:06.630 INFO:tasks.workunit.client.0.smithi043.stdout:6/601: getdents d0/d1b/d96 0 2024-04-25T13:47:06.630 INFO:tasks.workunit.client.0.smithi043.stdout:2/464: chown d0/c16 19 1 2024-04-25T13:47:06.631 INFO:tasks.workunit.client.0.smithi043.stdout:2/465: dread - d0/d34/d17/f60 zero size 2024-04-25T13:47:06.632 INFO:tasks.workunit.client.0.smithi043.stdout:8/554: stat db/dc/d28/f6f 0 2024-04-25T13:47:06.633 INFO:tasks.workunit.client.0.smithi043.stdout:6/602: stat d0/d3d/d54/f57 0 2024-04-25T13:47:06.634 INFO:tasks.workunit.client.0.smithi043.stdout:8/555: chown db/d44 29246755 1 2024-04-25T13:47:06.638 INFO:tasks.workunit.client.0.smithi043.stdout:2/466: unlink d0/c73 0 2024-04-25T13:47:06.641 INFO:tasks.workunit.client.0.smithi043.stdout:5/461: dwrite d1/d3/d7/d8/df/d28/f48 [0,4194304] 0 2024-04-25T13:47:06.646 INFO:tasks.workunit.client.0.smithi043.stdout:3/557: write d0/d9/f95 [1752621,10016] 0 2024-04-25T13:47:06.647 INFO:tasks.workunit.client.0.smithi043.stdout:2/467: creat d0/d8/f8b x:0 0 0 2024-04-25T13:47:06.649 INFO:tasks.workunit.client.0.smithi043.stdout:5/462: dwrite d1/d3/d24/d7c/f86 [0,4194304] 0 2024-04-25T13:47:06.652 INFO:tasks.workunit.client.0.smithi043.stdout:2/468: mkdir d0/d8/d22/d5c/d8c 0 2024-04-25T13:47:06.653 INFO:tasks.workunit.client.0.smithi043.stdout:5/463: symlink d1/d3/d26/l9e 0 2024-04-25T13:47:06.656 INFO:tasks.workunit.client.0.smithi043.stdout:3/558: mkdir d0/d9/d81/d8e/d92/dc3 0 2024-04-25T13:47:06.656 INFO:tasks.workunit.client.0.smithi043.stdout:5/464: creat d1/d3/d62/f9f x:0 0 0 2024-04-25T13:47:06.663 INFO:tasks.workunit.client.0.smithi043.stdout:2/469: dread d0/d26/f4d [0,4194304] 0 2024-04-25T13:47:06.665 INFO:tasks.workunit.client.0.smithi043.stdout:6/603: dread d0/d3d/d6e/f74 [0,4194304] 0 2024-04-25T13:47:06.666 INFO:tasks.workunit.client.0.smithi043.stdout:3/559: unlink d0/f3 0 2024-04-25T13:47:06.668 INFO:tasks.workunit.client.0.smithi043.stdout:2/470: write d0/d8/d22/f84 [95583,48375] 0 2024-04-25T13:47:06.669 INFO:tasks.workunit.client.0.smithi043.stdout:5/465: dwrite d1/d3/d24/d7c/f86 [0,4194304] 0 2024-04-25T13:47:06.670 INFO:tasks.workunit.client.0.smithi043.stdout:8/556: dread db/d46/f61 [0,4194304] 0 2024-04-25T13:47:06.671 INFO:tasks.workunit.client.0.smithi043.stdout:6/604: truncate d0/d90/d48/d73/f80 217476 0 2024-04-25T13:47:06.674 INFO:tasks.workunit.client.0.smithi043.stdout:6/605: chown d0/c8e 17012241 1 2024-04-25T13:47:06.674 INFO:tasks.workunit.client.0.smithi043.stdout:8/557: write db/d38/d3c/d71/f50 [1006421,49951] 0 2024-04-25T13:47:06.674 INFO:tasks.workunit.client.0.smithi043.stdout:5/466: symlink d1/d4/d42/la0 0 2024-04-25T13:47:06.675 INFO:tasks.workunit.client.0.smithi043.stdout:2/471: getdents d0/d4b 0 2024-04-25T13:47:06.675 INFO:tasks.workunit.client.0.smithi043.stdout:2/472: readlink d0/d35/l3d 0 2024-04-25T13:47:06.676 INFO:tasks.workunit.client.0.smithi043.stdout:8/558: symlink db/d11/d79/lb3 0 2024-04-25T13:47:06.678 INFO:tasks.workunit.client.0.smithi043.stdout:5/467: symlink d1/d3/d24/la1 0 2024-04-25T13:47:06.678 INFO:tasks.workunit.client.0.smithi043.stdout:8/559: write db/d11/f2a [682433,62801] 0 2024-04-25T13:47:06.678 INFO:tasks.workunit.client.0.smithi043.stdout:6/606: rmdir d0/d90 39 2024-04-25T13:47:06.679 INFO:tasks.workunit.client.0.smithi043.stdout:2/473: mkdir d0/d5/d2f/d8d 0 2024-04-25T13:47:06.680 INFO:tasks.workunit.client.0.smithi043.stdout:8/560: chown db/d11/d79/f84 511 1 2024-04-25T13:47:06.681 INFO:tasks.workunit.client.0.smithi043.stdout:2/474: read d0/d5/d2f/f79 [3508425,114535] 0 2024-04-25T13:47:06.682 INFO:tasks.workunit.client.0.smithi043.stdout:8/561: chown db/d11/d1b/d8c 6809 1 2024-04-25T13:47:06.684 INFO:tasks.workunit.client.0.smithi043.stdout:8/562: fsync db/dc/d21/d4e/f58 0 2024-04-25T13:47:06.685 INFO:tasks.workunit.client.0.smithi043.stdout:6/607: unlink d0/d1b/c30 0 2024-04-25T13:47:06.689 INFO:tasks.workunit.client.0.smithi043.stdout:6/608: dread - d0/d90/f8c zero size 2024-04-25T13:47:06.690 INFO:tasks.workunit.client.0.smithi043.stdout:8/563: mkdir db/dc/d21/db4 0 2024-04-25T13:47:06.694 INFO:tasks.workunit.client.0.smithi043.stdout:6/609: getdents d0/d90/d48/d73 0 2024-04-25T13:47:06.695 INFO:tasks.workunit.client.0.smithi043.stdout:8/564: dwrite db/dc/f2f [0,4194304] 0 2024-04-25T13:47:06.696 INFO:tasks.workunit.client.0.smithi043.stdout:3/560: creat d0/da/db9/d9e/fc4 x:0 0 0 2024-04-25T13:47:06.697 INFO:tasks.workunit.client.0.smithi043.stdout:2/475: truncate d0/d34/d3f/d59/f62 5578815 0 2024-04-25T13:47:06.697 INFO:tasks.workunit.client.0.smithi043.stdout:8/565: dread - db/d11/d79/d81/f9a zero size 2024-04-25T13:47:06.697 INFO:tasks.workunit.client.0.smithi043.stdout:6/610: mkdir d0/d3d/dc9 0 2024-04-25T13:47:06.698 INFO:tasks.workunit.client.0.smithi043.stdout:6/611: readlink d0/d3d/d6e/l70 0 2024-04-25T13:47:06.701 INFO:tasks.workunit.client.0.smithi043.stdout:8/566: write db/d38/d3c/d71/f50 [9193259,69706] 0 2024-04-25T13:47:06.702 INFO:tasks.workunit.client.0.smithi043.stdout:6/612: fdatasync d0/d3d/f62 0 2024-04-25T13:47:06.705 INFO:tasks.workunit.client.0.smithi043.stdout:8/567: read db/d44/d8e/d27/f75 [2323504,93461] 0 2024-04-25T13:47:06.711 INFO:tasks.workunit.client.0.smithi043.stdout:8/568: dwrite db/d44/d8e/f56 [0,4194304] 0 2024-04-25T13:47:06.711 INFO:tasks.workunit.client.0.smithi043.stdout:3/561: mkdir d0/d9/d6e/dc5 0 2024-04-25T13:47:06.713 INFO:tasks.workunit.client.0.smithi043.stdout:8/569: mknod db/d11/d79/d81/cb5 0 2024-04-25T13:47:06.715 INFO:tasks.workunit.client.0.smithi043.stdout:3/562: rename d0/d9/d81/d8e/d92/f22 to d0/d61/d82/fc6 0 2024-04-25T13:47:06.716 INFO:tasks.workunit.client.0.smithi043.stdout:6/613: truncate d0/fc 910419 0 2024-04-25T13:47:06.717 INFO:tasks.workunit.client.0.smithi043.stdout:6/614: stat d0/c8 0 2024-04-25T13:47:06.722 INFO:tasks.workunit.client.0.smithi043.stdout:6/615: creat d0/d1b/d88/fca x:0 0 0 2024-04-25T13:47:06.726 INFO:tasks.workunit.client.0.smithi043.stdout:6/616: symlink d0/d3d/lcb 0 2024-04-25T13:47:06.729 INFO:tasks.workunit.client.0.smithi043.stdout:6/617: creat d0/d1b/fcc x:0 0 0 2024-04-25T13:47:06.730 INFO:tasks.workunit.client.0.smithi043.stdout:3/563: mkdir d0/d9/d6e/d38/d3f/dc7 0 2024-04-25T13:47:06.732 INFO:tasks.workunit.client.0.smithi043.stdout:6/618: mknod d0/d90/d4c/ccd 0 2024-04-25T13:47:06.734 INFO:tasks.workunit.client.0.smithi043.stdout:6/619: chown d0/fb 1 1 2024-04-25T13:47:06.740 INFO:tasks.workunit.client.0.smithi043.stdout:6/620: write d0/d24/d3a/f98 [343038,114156] 0 2024-04-25T13:47:06.744 INFO:tasks.workunit.client.0.smithi043.stdout:6/621: write d0/d90/d4c/f61 [1787302,99402] 0 2024-04-25T13:47:06.750 INFO:tasks.workunit.client.0.smithi043.stdout:3/564: dread d0/d9/d6e/d34/f80 [0,4194304] 0 2024-04-25T13:47:06.752 INFO:tasks.workunit.client.0.smithi043.stdout:6/622: dwrite d0/d90/f45 [0,4194304] 0 2024-04-25T13:47:06.754 INFO:tasks.workunit.client.0.smithi043.stdout:6/623: rmdir d0/d3d/d54 39 2024-04-25T13:47:06.756 INFO:tasks.workunit.client.0.smithi043.stdout:3/565: getdents d0/d61/d82 0 2024-04-25T13:47:06.771 INFO:tasks.workunit.client.0.smithi043.stdout:6/624: dread d0/fb [0,4194304] 0 2024-04-25T13:47:06.773 INFO:tasks.workunit.client.0.smithi043.stdout:6/625: mknod d0/d3d/d6e/d71/cce 0 2024-04-25T13:47:06.780 INFO:tasks.workunit.client.0.smithi043.stdout:6/626: dwrite d0/d3d/d6e/f86 [0,4194304] 0 2024-04-25T13:47:06.781 INFO:tasks.workunit.client.0.smithi043.stdout:6/627: chown d0/d90/d48/d73/cac 9 1 2024-04-25T13:47:06.788 INFO:tasks.workunit.client.0.smithi043.stdout:6/628: write d0/d90/f4e [10176,77032] 0 2024-04-25T13:47:06.792 INFO:tasks.workunit.client.0.smithi043.stdout:6/629: unlink d0/d90/d48/d60/c72 0 2024-04-25T13:47:06.793 INFO:tasks.workunit.client.0.smithi043.stdout:8/570: rename db/dc/d21/f2e to db/d44/d8e/d27/fb6 0 2024-04-25T13:47:06.794 INFO:tasks.workunit.client.0.smithi043.stdout:6/630: chown d0/d3d/d6e/d71/l92 424 1 2024-04-25T13:47:06.796 INFO:tasks.workunit.client.0.smithi043.stdout:6/631: creat d0/d76/d2f/d64/da1/fcf x:0 0 0 2024-04-25T13:47:06.798 INFO:tasks.workunit.client.0.smithi043.stdout:6/632: dread d0/d24/f50 [0,4194304] 0 2024-04-25T13:47:06.800 INFO:tasks.workunit.client.0.smithi043.stdout:8/571: creat db/dc/d21/d4e/fb7 x:0 0 0 2024-04-25T13:47:06.803 INFO:tasks.workunit.client.0.smithi043.stdout:8/572: read db/dc/d21/f6b [328958,40767] 0 2024-04-25T13:47:06.814 INFO:tasks.workunit.client.0.smithi043.stdout:8/573: creat db/d44/d5c/fb8 x:0 0 0 2024-04-25T13:47:06.814 INFO:tasks.workunit.client.0.smithi043.stdout:8/574: readlink db/d11/d79/lb3 0 2024-04-25T13:47:06.815 INFO:tasks.workunit.client.0.smithi043.stdout:6/633: dread d0/d1c/f8d [0,4194304] 0 2024-04-25T13:47:06.817 INFO:tasks.workunit.client.0.smithi043.stdout:8/575: creat db/d38/d77/fb9 x:0 0 0 2024-04-25T13:47:06.817 INFO:tasks.workunit.client.0.smithi043.stdout:6/634: creat d0/d76/d2f/da7/fd0 x:0 0 0 2024-04-25T13:47:06.818 INFO:tasks.workunit.client.0.smithi043.stdout:8/576: fdatasync db/d11/d1b/f6c 0 2024-04-25T13:47:06.820 INFO:tasks.workunit.client.0.smithi043.stdout:6/635: rename d0/d24/f5b to d0/d24/d3a/fd1 0 2024-04-25T13:47:06.821 INFO:tasks.workunit.client.0.smithi043.stdout:6/636: rmdir d0/d90/d48/d9d 39 2024-04-25T13:47:06.823 INFO:tasks.workunit.client.0.smithi043.stdout:6/637: write d0/d24/fa5 [1809655,97373] 0 2024-04-25T13:47:06.830 INFO:tasks.workunit.client.0.smithi043.stdout:6/638: rename d0/d24/d3a/fd1 to d0/d90/d48/d73/fd2 0 2024-04-25T13:47:06.831 INFO:tasks.workunit.client.0.smithi043.stdout:6/639: rmdir d0/d90/db0 39 2024-04-25T13:47:06.832 INFO:tasks.workunit.client.0.smithi043.stdout:8/577: dwrite db/dc/d21/d4e/fab [0,4194304] 0 2024-04-25T13:47:06.835 INFO:tasks.workunit.client.0.smithi043.stdout:6/640: mknod d0/d90/db0/cd3 0 2024-04-25T13:47:06.836 INFO:tasks.workunit.client.0.smithi043.stdout:8/578: read db/dc/d21/f25 [1495240,56341] 0 2024-04-25T13:47:06.838 INFO:tasks.workunit.client.0.smithi043.stdout:8/579: mkdir db/d11/d79/dba 0 2024-04-25T13:47:06.838 INFO:tasks.workunit.client.0.smithi043.stdout:4/469: sync 2024-04-25T13:47:06.838 INFO:tasks.workunit.client.0.smithi043.stdout:0/547: sync 2024-04-25T13:47:06.838 INFO:tasks.workunit.client.0.smithi043.stdout:1/576: sync 2024-04-25T13:47:06.838 INFO:tasks.workunit.client.0.smithi043.stdout:8/580: fsync db/d38/f7f 0 2024-04-25T13:47:06.842 INFO:tasks.workunit.client.0.smithi043.stdout:6/641: link d0/d76/d2f/d64/da1/f53 d0/d76/fd4 0 2024-04-25T13:47:06.848 INFO:tasks.workunit.client.0.smithi043.stdout:8/581: getdents db/d7d 0 2024-04-25T13:47:06.849 INFO:tasks.workunit.client.0.smithi043.stdout:1/577: dwrite df/d10/d22/d2f/f4f [0,4194304] 0 2024-04-25T13:47:06.850 INFO:tasks.workunit.client.0.smithi043.stdout:1/578: dread - df/d14/d3d/d82/fac zero size 2024-04-25T13:47:06.853 INFO:tasks.workunit.client.0.smithi043.stdout:1/579: mkdir df/d31/dc7 0 2024-04-25T13:47:06.853 INFO:tasks.workunit.client.0.smithi043.stdout:1/580: stat df/d31/lc4 0 2024-04-25T13:47:06.854 INFO:tasks.workunit.client.0.smithi043.stdout:1/581: chown df/d14/d3d/d82/d8c/fa3 1796 1 2024-04-25T13:47:06.856 INFO:tasks.workunit.client.0.smithi043.stdout:8/582: write db/d7d/fb0 [371861,63705] 0 2024-04-25T13:47:06.859 INFO:tasks.workunit.client.0.smithi043.stdout:0/548: fdatasync db/d1b/d4f/f5d 0 2024-04-25T13:47:06.861 INFO:tasks.workunit.client.0.smithi043.stdout:8/583: unlink db/dc/d21/f25 0 2024-04-25T13:47:06.864 INFO:tasks.workunit.client.0.smithi043.stdout:0/549: creat db/d1b/d23/d27/d39/d4c/dbb/fbd x:0 0 0 2024-04-25T13:47:06.865 INFO:tasks.workunit.client.0.smithi043.stdout:8/584: symlink db/d44/d8e/lbb 0 2024-04-25T13:47:06.866 INFO:tasks.workunit.client.0.smithi043.stdout:8/585: fsync db/d46/f8f 0 2024-04-25T13:47:06.867 INFO:tasks.workunit.client.0.smithi043.stdout:0/550: truncate db/d1b/d36/d41/d71/fa7 145552 0 2024-04-25T13:47:06.871 INFO:tasks.workunit.client.0.smithi043.stdout:8/586: getdents db/d38/d3c/d71/d5d 0 2024-04-25T13:47:06.874 INFO:tasks.workunit.client.0.smithi043.stdout:8/587: mkdir db/d11/d79/dbc 0 2024-04-25T13:47:06.874 INFO:tasks.workunit.client.0.smithi043.stdout:0/551: write db/d25/f2b [430389,508] 0 2024-04-25T13:47:06.875 INFO:tasks.workunit.client.0.smithi043.stdout:1/582: dread df/d10/d22/f5f [0,4194304] 0 2024-04-25T13:47:06.881 INFO:tasks.workunit.client.0.smithi043.stdout:0/552: link db/d1b/d23/d27/f6b db/d25/d2a/d9d/fbe 0 2024-04-25T13:47:06.882 INFO:tasks.workunit.client.0.smithi043.stdout:1/583: rmdir df/d14/d63/d67/d9f 39 2024-04-25T13:47:06.884 INFO:tasks.workunit.client.0.smithi043.stdout:1/584: mkdir df/d31/dc7/dc8 0 2024-04-25T13:47:06.886 INFO:tasks.workunit.client.0.smithi043.stdout:0/553: rmdir db/d1b/d36/d41/daf/db3 0 2024-04-25T13:47:06.886 INFO:tasks.workunit.client.0.smithi043.stdout:1/585: symlink df/d10/d22/d2f/d9c/d41/lc9 0 2024-04-25T13:47:06.890 INFO:tasks.workunit.client.0.smithi043.stdout:8/588: dread db/d38/d3c/d71/f50 [4194304,4194304] 0 2024-04-25T13:47:06.892 INFO:tasks.workunit.client.0.smithi043.stdout:1/586: write df/d31/d38/d43/f57 [4064682,124346] 0 2024-04-25T13:47:06.892 INFO:tasks.workunit.client.0.smithi043.stdout:8/589: read db/dc/f45 [2795987,112644] 0 2024-04-25T13:47:06.894 INFO:tasks.workunit.client.0.smithi043.stdout:1/587: symlink df/d14/d63/d71/lca 0 2024-04-25T13:47:06.895 INFO:tasks.workunit.client.0.smithi043.stdout:1/588: chown df/d31/lb7 41 1 2024-04-25T13:47:06.897 INFO:tasks.workunit.client.0.smithi043.stdout:8/590: truncate db/d11/d1b/d59/f7b 85542 0 2024-04-25T13:47:06.899 INFO:tasks.workunit.client.0.smithi043.stdout:8/591: symlink db/d11/da1/lbd 0 2024-04-25T13:47:06.900 INFO:tasks.workunit.client.0.smithi043.stdout:8/592: readlink db/d44/d8e/d27/l85 0 2024-04-25T13:47:06.902 INFO:tasks.workunit.client.0.smithi043.stdout:8/593: mkdir db/dc/d21/db4/dbe 0 2024-04-25T13:47:06.902 INFO:tasks.workunit.client.0.smithi043.stdout:8/594: stat c6 0 2024-04-25T13:47:06.903 INFO:tasks.workunit.client.0.smithi043.stdout:8/595: dread - db/d38/f7f zero size 2024-04-25T13:47:06.906 INFO:tasks.workunit.client.0.smithi043.stdout:0/554: dread db/f1d [0,4194304] 0 2024-04-25T13:47:06.907 INFO:tasks.workunit.client.0.smithi043.stdout:0/555: read - db/d25/d2a/d3f/f8b zero size 2024-04-25T13:47:06.908 INFO:tasks.workunit.client.0.smithi043.stdout:8/596: getdents db/dc/d21/d4e 0 2024-04-25T13:47:06.909 INFO:tasks.workunit.client.0.smithi043.stdout:1/589: dread df/d10/d22/f3a [0,4194304] 0 2024-04-25T13:47:06.911 INFO:tasks.workunit.client.0.smithi043.stdout:0/556: stat db/d25/d2a/d9d/fbe 0 2024-04-25T13:47:06.913 INFO:tasks.workunit.client.0.smithi043.stdout:0/557: dread db/d1b/d23/d27/fa0 [0,4194304] 0 2024-04-25T13:47:06.916 INFO:tasks.workunit.client.0.smithi043.stdout:0/558: creat db/d25/d2a/d93/fbf x:0 0 0 2024-04-25T13:47:06.916 INFO:tasks.workunit.client.0.smithi043.stdout:1/590: creat df/d14/d63/d67/da7/fcb x:0 0 0 2024-04-25T13:47:06.919 INFO:tasks.workunit.client.0.smithi043.stdout:1/591: symlink df/d31/d34/d8b/d39/lcc 0 2024-04-25T13:47:06.922 INFO:tasks.workunit.client.0.smithi043.stdout:1/592: mknod df/d31/d38/d43/d81/ccd 0 2024-04-25T13:47:06.922 INFO:tasks.workunit.client.0.smithi043.stdout:0/559: dwrite db/fc [0,4194304] 0 2024-04-25T13:47:06.925 INFO:tasks.workunit.client.0.smithi043.stdout:1/593: unlink df/d31/d34/d8b/d39/c51 0 2024-04-25T13:47:06.926 INFO:tasks.workunit.client.0.smithi043.stdout:0/560: mkdir db/d1b/d94/d68/dc0 0 2024-04-25T13:47:06.928 INFO:tasks.workunit.client.0.smithi043.stdout:0/561: symlink db/d1b/d23/d27/d39/d4c/da9/lc1 0 2024-04-25T13:47:06.928 INFO:tasks.workunit.client.0.smithi043.stdout:1/594: truncate df/d10/d22/f88 1117776 0 2024-04-25T13:47:06.930 INFO:tasks.workunit.client.0.smithi043.stdout:1/595: dread - df/d10/fa6 zero size 2024-04-25T13:47:06.930 INFO:tasks.workunit.client.0.smithi043.stdout:8/597: dread db/dc/d21/f39 [0,4194304] 0 2024-04-25T13:47:06.931 INFO:tasks.workunit.client.0.smithi043.stdout:0/562: write db/f18 [5029677,117183] 0 2024-04-25T13:47:06.932 INFO:tasks.workunit.client.0.smithi043.stdout:0/563: fsync db/d1b/d23/d27/f87 0 2024-04-25T13:47:06.934 INFO:tasks.workunit.client.0.smithi043.stdout:0/564: write db/d25/f46 [445098,75949] 0 2024-04-25T13:47:06.934 INFO:tasks.workunit.client.0.smithi043.stdout:1/596: symlink df/d31/d38/lce 0 2024-04-25T13:47:06.936 INFO:tasks.workunit.client.0.smithi043.stdout:0/565: write db/d25/f2b [931579,96195] 0 2024-04-25T13:47:06.938 INFO:tasks.workunit.client.0.smithi043.stdout:1/597: mknod df/d31/d38/d43/dbc/ccf 0 2024-04-25T13:47:06.940 INFO:tasks.workunit.client.0.smithi043.stdout:0/566: rmdir db/d1b/d94 39 2024-04-25T13:47:06.941 INFO:tasks.workunit.client.0.smithi043.stdout:0/567: fsync db/f1d 0 2024-04-25T13:47:06.941 INFO:tasks.workunit.client.0.smithi043.stdout:0/568: chown db/d25/d2a/d3f/d6a/c7e 10081 1 2024-04-25T13:47:06.943 INFO:tasks.workunit.client.0.smithi043.stdout:1/598: link df/d31/d34/l77 df/d31/dc7/ld0 0 2024-04-25T13:47:06.945 INFO:tasks.workunit.client.0.smithi043.stdout:8/598: dread db/d11/d1b/d59/f7b [0,4194304] 0 2024-04-25T13:47:06.946 INFO:tasks.workunit.client.0.smithi043.stdout:1/599: creat df/d31/d38/d43/fd1 x:0 0 0 2024-04-25T13:47:06.948 INFO:tasks.workunit.client.0.smithi043.stdout:0/569: mkdir db/d1b/d94/dc2 0 2024-04-25T13:47:06.949 INFO:tasks.workunit.client.0.smithi043.stdout:1/600: mkdir df/d31/dc7/dc8/dd2 0 2024-04-25T13:47:06.949 INFO:tasks.workunit.client.0.smithi043.stdout:0/570: dread - db/d1b/f96 zero size 2024-04-25T13:47:06.951 INFO:tasks.workunit.client.0.smithi043.stdout:0/571: rmdir db/d25/d2a/d93 39 2024-04-25T13:47:06.952 INFO:tasks.workunit.client.0.smithi043.stdout:8/599: dwrite db/d11/d1b/f6c [0,4194304] 0 2024-04-25T13:47:06.953 INFO:tasks.workunit.client.0.smithi043.stdout:0/572: write db/d1b/d4f/f63 [3343823,116244] 0 2024-04-25T13:47:06.953 INFO:tasks.workunit.client.0.smithi043.stdout:1/601: creat df/fd3 x:0 0 0 2024-04-25T13:47:06.955 INFO:tasks.workunit.client.0.smithi043.stdout:8/600: creat db/d46/da8/fbf x:0 0 0 2024-04-25T13:47:06.956 INFO:tasks.workunit.client.0.smithi043.stdout:5/468: sync 2024-04-25T13:47:06.957 INFO:tasks.workunit.client.0.smithi043.stdout:7/718: sync 2024-04-25T13:47:06.957 INFO:tasks.workunit.client.0.smithi043.stdout:5/469: stat d1/d4/f7f 0 2024-04-25T13:47:06.959 INFO:tasks.workunit.client.0.smithi043.stdout:8/601: creat db/d38/d3c/d71/d5d/fc0 x:0 0 0 2024-04-25T13:47:06.959 INFO:tasks.workunit.client.0.smithi043.stdout:0/573: rmdir db/d1b/d23/d27/d39/d4c/dbb 39 2024-04-25T13:47:06.960 INFO:tasks.workunit.client.0.smithi043.stdout:5/470: stat d1/d3/d7/d9/d2d/d5b/d6e 0 2024-04-25T13:47:06.960 INFO:tasks.workunit.client.0.smithi043.stdout:7/719: symlink d5/d6b/lf4 0 2024-04-25T13:47:06.962 INFO:tasks.workunit.client.0.smithi043.stdout:7/720: chown d5/d11/d3b/d61/dc5/dee/d5a 509 1 2024-04-25T13:47:06.963 INFO:tasks.workunit.client.0.smithi043.stdout:8/602: rmdir db/d11/d1b/d59/d7c 39 2024-04-25T13:47:06.967 INFO:tasks.workunit.client.0.smithi043.stdout:0/574: dwrite db/fc [0,4194304] 0 2024-04-25T13:47:06.970 INFO:tasks.workunit.client.0.smithi043.stdout:0/575: dread - db/d1b/f96 zero size 2024-04-25T13:47:06.972 INFO:tasks.workunit.client.0.smithi043.stdout:8/603: dread db/dc/d28/f6f [0,4194304] 0 2024-04-25T13:47:06.972 INFO:tasks.workunit.client.0.smithi043.stdout:0/576: write f8 [115045,129276] 0 2024-04-25T13:47:06.974 INFO:tasks.workunit.client.0.smithi043.stdout:1/602: dwrite f2 [0,4194304] 0 2024-04-25T13:47:06.976 INFO:tasks.workunit.client.0.smithi043.stdout:0/577: read - db/d25/d2a/d3f/d6a/f89 zero size 2024-04-25T13:47:06.978 INFO:tasks.workunit.client.0.smithi043.stdout:8/604: unlink db/d11/f1d 0 2024-04-25T13:47:06.979 INFO:tasks.workunit.client.0.smithi043.stdout:5/471: dread d1/d3/d7/d2f/d67/f51 [4194304,4194304] 0 2024-04-25T13:47:06.984 INFO:tasks.workunit.client.0.smithi043.stdout:7/721: dwrite d5/d11/d3b/f46 [0,4194304] 0 2024-04-25T13:47:06.984 INFO:tasks.workunit.client.0.smithi043.stdout:5/472: write d1/d3/d7/d9/d2d/f9a [79746,4689] 0 2024-04-25T13:47:06.986 INFO:tasks.workunit.client.0.smithi043.stdout:5/473: truncate d1/d3/f81 1485763 0 2024-04-25T13:47:06.987 INFO:tasks.workunit.client.0.smithi043.stdout:0/578: rename db/d25/d2a/d3f/c81 to db/d1b/d23/d27/d98/cc3 0 2024-04-25T13:47:06.989 INFO:tasks.workunit.client.0.smithi043.stdout:5/474: dread - d1/d3/d7/d8/da/d11/d52/f8c zero size 2024-04-25T13:47:06.992 INFO:tasks.workunit.client.0.smithi043.stdout:8/605: dread db/d11/d1b/f63 [0,4194304] 0 2024-04-25T13:47:06.994 INFO:tasks.workunit.client.0.smithi043.stdout:8/606: fsync db/dc/d21/f39 0 2024-04-25T13:47:06.996 INFO:tasks.workunit.client.0.smithi043.stdout:0/579: dwrite db/f17 [0,4194304] 0 2024-04-25T13:47:06.998 INFO:tasks.workunit.client.0.smithi043.stdout:1/603: write df/d10/f24 [1464041,91217] 0 2024-04-25T13:47:07.002 INFO:tasks.workunit.client.0.smithi043.stdout:0/580: fsync db/d1b/d23/d27/d39/d4c/dbb/fbd 0 2024-04-25T13:47:07.002 INFO:tasks.workunit.client.0.smithi043.stdout:1/604: write df/d31/d38/d43/fd1 [182237,18923] 0 2024-04-25T13:47:07.003 INFO:tasks.workunit.client.0.smithi043.stdout:8/607: dwrite db/d11/f20 [0,4194304] 0 2024-04-25T13:47:07.005 INFO:tasks.workunit.client.0.smithi043.stdout:1/605: write df/d10/d22/d2f/d9c/fa1 [470331,15634] 0 2024-04-25T13:47:07.008 INFO:tasks.workunit.client.0.smithi043.stdout:8/608: creat db/d38/d3c/d71/d5d/fc1 x:0 0 0 2024-04-25T13:47:07.013 INFO:tasks.workunit.client.0.smithi043.stdout:5/475: dread d1/f56 [0,4194304] 0 2024-04-25T13:47:07.014 INFO:tasks.workunit.client.0.smithi043.stdout:8/609: creat db/d11/d1b/d59/d7c/daf/fc2 x:0 0 0 2024-04-25T13:47:07.016 INFO:tasks.workunit.client.0.smithi043.stdout:8/610: fsync db/d7d/fb0 0 2024-04-25T13:47:07.017 INFO:tasks.workunit.client.0.smithi043.stdout:5/476: symlink d1/d3/d7/d8/da/d11/d52/la2 0 2024-04-25T13:47:07.021 INFO:tasks.workunit.client.0.smithi043.stdout:5/477: mkdir d1/d3/d7/d9/d2d/d5b/d6e/da3 0 2024-04-25T13:47:07.021 INFO:tasks.workunit.client.0.smithi043.stdout:8/611: symlink db/dc/d28/lc3 0 2024-04-25T13:47:07.021 INFO:tasks.workunit.client.0.smithi043.stdout:5/478: chown d1/c7e 852853 1 2024-04-25T13:47:07.022 INFO:tasks.workunit.client.0.smithi043.stdout:8/612: readlink db/dc/d28/lc3 0 2024-04-25T13:47:07.024 INFO:tasks.workunit.client.0.smithi043.stdout:1/606: creat df/d14/d63/d67/da7/fd4 x:0 0 0 2024-04-25T13:47:07.024 INFO:tasks.workunit.client.0.smithi043.stdout:8/613: creat db/fc4 x:0 0 0 2024-04-25T13:47:07.027 INFO:tasks.workunit.client.0.smithi043.stdout:5/479: link d1/d3/d62/l8e d1/d8d/la4 0 2024-04-25T13:47:07.027 INFO:tasks.workunit.client.0.smithi043.stdout:5/480: stat d1/d3/c64 0 2024-04-25T13:47:07.028 INFO:tasks.workunit.client.0.smithi043.stdout:8/614: mknod db/d38/d3c/d71/d5d/cc5 0 2024-04-25T13:47:07.029 INFO:tasks.workunit.client.0.smithi043.stdout:5/481: creat d1/d3/d7/d9/d2d/d5b/fa5 x:0 0 0 2024-04-25T13:47:07.029 INFO:tasks.workunit.client.0.smithi043.stdout:1/607: truncate df/d10/d22/d2f/d9c/fa1 254198 0 2024-04-25T13:47:07.032 INFO:tasks.workunit.client.0.smithi043.stdout:5/482: write d1/d3/d7/d9/d2d/d5b/fa5 [434640,91252] 0 2024-04-25T13:47:07.034 INFO:tasks.workunit.client.0.smithi043.stdout:5/483: symlink d1/d3/d7/d2f/d67/la6 0 2024-04-25T13:47:07.035 INFO:tasks.workunit.client.0.smithi043.stdout:1/608: dread df/d31/d38/d43/fd1 [0,4194304] 0 2024-04-25T13:47:07.036 INFO:tasks.workunit.client.0.smithi043.stdout:5/484: write d1/d3/d26/f27 [1047935,96306] 0 2024-04-25T13:47:07.037 INFO:tasks.workunit.client.0.smithi043.stdout:8/615: rename db/d44/d8e/d27/fb6 to db/d11/d79/fc6 0 2024-04-25T13:47:07.038 INFO:tasks.workunit.client.0.smithi043.stdout:5/485: read - d1/d3/d7/d9/d2d/f94 zero size 2024-04-25T13:47:07.038 INFO:tasks.workunit.client.0.smithi043.stdout:1/609: creat df/d31/d38/d43/d53/fd5 x:0 0 0 2024-04-25T13:47:07.039 INFO:tasks.workunit.client.0.smithi043.stdout:1/610: chown df/d31/d34/d91 1772771 1 2024-04-25T13:47:07.042 INFO:tasks.workunit.client.0.smithi043.stdout:5/486: mknod d1/d3/d7/d8/da/d11/ca7 0 2024-04-25T13:47:07.044 INFO:tasks.workunit.client.0.smithi043.stdout:5/487: write d1/d3/d24/d7c/f89 [705852,100462] 0 2024-04-25T13:47:07.044 INFO:tasks.workunit.client.0.smithi043.stdout:1/611: link df/d10/d22/d2f/f4f df/d31/dc7/dc8/fd6 0 2024-04-25T13:47:07.046 INFO:tasks.workunit.client.0.smithi043.stdout:8/616: dwrite db/d11/d1b/d59/d7c/daf/fc2 [0,4194304] 0 2024-04-25T13:47:07.046 INFO:tasks.workunit.client.0.smithi043.stdout:5/488: read - d1/d4/f68 zero size 2024-04-25T13:47:07.053 INFO:tasks.workunit.client.0.smithi043.stdout:1/612: link df/d14/d63/cb9 df/d31/dc7/cd7 0 2024-04-25T13:47:07.056 INFO:tasks.workunit.client.0.smithi043.stdout:8/617: dwrite db/d11/d1b/f89 [0,4194304] 0 2024-04-25T13:47:07.059 INFO:tasks.workunit.client.0.smithi043.stdout:5/489: dread d1/d3/f81 [0,4194304] 0 2024-04-25T13:47:07.060 INFO:tasks.workunit.client.0.smithi043.stdout:5/490: stat d1/d3/d7/d9/d2d/d5b/f74 0 2024-04-25T13:47:07.067 INFO:tasks.workunit.client.0.smithi043.stdout:5/491: creat d1/d4/fa8 x:0 0 0 2024-04-25T13:47:07.069 INFO:tasks.workunit.client.0.smithi043.stdout:5/492: dread d1/d3/f81 [0,4194304] 0 2024-04-25T13:47:07.070 INFO:tasks.workunit.client.0.smithi043.stdout:1/613: dread - df/d14/d63/d67/da7/fcb zero size 2024-04-25T13:47:07.070 INFO:tasks.workunit.client.0.smithi043.stdout:5/493: readlink d1/d3/d26/l5c 0 2024-04-25T13:47:07.071 INFO:tasks.workunit.client.0.smithi043.stdout:1/614: write df/d31/d38/d43/f65 [150971,81783] 0 2024-04-25T13:47:07.073 INFO:tasks.workunit.client.0.smithi043.stdout:5/494: write d1/d3/d7/d9/d2d/f6c [604226,114258] 0 2024-04-25T13:47:07.077 INFO:tasks.workunit.client.0.smithi043.stdout:5/495: write d1/d4/f68 [120550,10412] 0 2024-04-25T13:47:07.081 INFO:tasks.workunit.client.0.smithi043.stdout:1/615: dwrite df/d14/d3d/d82/d8c/f9b [0,4194304] 0 2024-04-25T13:47:07.082 INFO:tasks.workunit.client.0.smithi043.stdout:8/618: dread db/d11/f15 [0,4194304] 0 2024-04-25T13:47:07.087 INFO:tasks.workunit.client.0.smithi043.stdout:5/496: dwrite d1/d3/d7/d8/df/d28/f48 [0,4194304] 0 2024-04-25T13:47:07.088 INFO:tasks.workunit.client.0.smithi043.stdout:1/616: symlink df/d14/ld8 0 2024-04-25T13:47:07.090 INFO:tasks.workunit.client.0.smithi043.stdout:8/619: mkdir db/dc/d21/dc7 0 2024-04-25T13:47:07.092 INFO:tasks.workunit.client.0.smithi043.stdout:1/617: mkdir df/d10/d22/d2f/d9c/dbd/dd9 0 2024-04-25T13:47:07.095 INFO:tasks.workunit.client.0.smithi043.stdout:5/497: dwrite d1/f56 [4194304,4194304] 0 2024-04-25T13:47:07.096 INFO:tasks.workunit.client.0.smithi043.stdout:8/620: creat db/d11/d1b/d59/d7c/fc8 x:0 0 0 2024-04-25T13:47:07.096 INFO:tasks.workunit.client.0.smithi043.stdout:4/470: sync 2024-04-25T13:47:07.096 INFO:tasks.workunit.client.0.smithi043.stdout:2/476: sync 2024-04-25T13:47:07.096 INFO:tasks.workunit.client.0.smithi043.stdout:3/566: sync 2024-04-25T13:47:07.097 INFO:tasks.workunit.client.0.smithi043.stdout:8/621: stat db/d38 0 2024-04-25T13:47:07.098 INFO:tasks.workunit.client.0.smithi043.stdout:1/618: link df/d31/d34/d91/c98 df/d31/d38/dbb/cda 0 2024-04-25T13:47:07.099 INFO:tasks.workunit.client.0.smithi043.stdout:5/498: creat d1/d4/d42/fa9 x:0 0 0 2024-04-25T13:47:07.101 INFO:tasks.workunit.client.0.smithi043.stdout:3/567: write d0/d13/f27 [1494188,47683] 0 2024-04-25T13:47:07.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:06 smithi161 ceph-mon[32696]: pgmap v78: 129 pgs: 129 active+clean; 841 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 102 MiB/s wr, 191 op/s 2024-04-25T13:47:07.103 INFO:tasks.workunit.client.0.smithi043.stdout:5/499: read d1/d4/f73 [2191409,101951] 0 2024-04-25T13:47:07.107 INFO:tasks.workunit.client.0.smithi043.stdout:4/471: creat d1/de/df/d1a/d27/d36/d53/d66/d70/d7c/f95 x:0 0 0 2024-04-25T13:47:07.107 INFO:tasks.workunit.client.0.smithi043.stdout:8/622: rename db/dc/d21/f6b to db/d38/d3c/d71/d5d/d67/fc9 0 2024-04-25T13:47:07.107 INFO:tasks.workunit.client.0.smithi043.stdout:2/477: write d0/d5/d2f/f45 [861785,25895] 0 2024-04-25T13:47:07.162 INFO:tasks.workunit.client.0.smithi043.stdout:8/623: stat db/dc 0 2024-04-25T13:47:07.162 INFO:tasks.workunit.client.0.smithi043.stdout:5/500: creat d1/d3/d7/d9/d2d/faa x:0 0 0 2024-04-25T13:47:07.163 INFO:tasks.workunit.client.0.smithi043.stdout:3/568: write d0/d9/f44 [1869103,29215] 0 2024-04-25T13:47:07.163 INFO:tasks.workunit.client.0.smithi043.stdout:2/478: readlink d0/d34/d3f/d46/l6c 0 2024-04-25T13:47:07.164 INFO:tasks.workunit.client.0.smithi043.stdout:2/479: stat d0/d26/f4d 0 2024-04-25T13:47:07.165 INFO:tasks.workunit.client.0.smithi043.stdout:8/624: write db/dc/f45 [3175440,65157] 0 2024-04-25T13:47:07.165 INFO:tasks.workunit.client.0.smithi043.stdout:4/472: mknod d1/de/d1d/d20/c96 0 2024-04-25T13:47:07.166 INFO:tasks.workunit.client.0.smithi043.stdout:3/569: mknod d0/d61/d82/cc8 0 2024-04-25T13:47:07.171 INFO:tasks.workunit.client.0.smithi043.stdout:8/625: creat db/d38/d3c/d71/d5d/d67/fca x:0 0 0 2024-04-25T13:47:07.174 INFO:tasks.workunit.client.0.smithi043.stdout:4/473: dwrite d1/d3/f68 [4194304,4194304] 0 2024-04-25T13:47:07.174 INFO:tasks.workunit.client.0.smithi043.stdout:2/480: rename d0/d8/d22/d36/c42 to d0/d34/d3f/d59/c8e 0 2024-04-25T13:47:07.178 INFO:tasks.workunit.client.0.smithi043.stdout:8/626: truncate db/d11/d79/d81/f83 106648 0 2024-04-25T13:47:07.178 INFO:tasks.workunit.client.0.smithi043.stdout:8/627: chown db/d44 249916 1 2024-04-25T13:47:07.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:06 smithi175 ceph-mon[32649]: pgmap v78: 129 pgs: 129 active+clean; 841 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 102 MiB/s wr, 191 op/s 2024-04-25T13:47:07.180 INFO:tasks.workunit.client.0.smithi043.stdout:5/501: truncate d1/d3/d7/d8/da/d11/d52/f59 3791411 0 2024-04-25T13:47:07.181 INFO:tasks.workunit.client.0.smithi043.stdout:4/474: creat d1/de/df/d1a/d27/d36/d53/d66/d94/f97 x:0 0 0 2024-04-25T13:47:07.183 INFO:tasks.workunit.client.0.smithi043.stdout:4/475: fsync d1/d3/d54/d62/f90 0 2024-04-25T13:47:07.184 INFO:tasks.workunit.client.0.smithi043.stdout:5/502: creat d1/d3/d7/d8/df/d28/fab x:0 0 0 2024-04-25T13:47:07.185 INFO:tasks.workunit.client.0.smithi043.stdout:2/481: dwrite d0/d5/d1e/d32/f5a [0,4194304] 0 2024-04-25T13:47:07.189 INFO:tasks.workunit.client.0.smithi043.stdout:5/503: creat d1/d3/d62/fac x:0 0 0 2024-04-25T13:47:07.190 INFO:tasks.workunit.client.0.smithi043.stdout:5/504: write d1/d3/d7/f23 [1370716,29189] 0 2024-04-25T13:47:07.197 INFO:tasks.workunit.client.0.smithi043.stdout:5/505: rmdir d1/d3/d7/d9/d2d/d5b/d6e 39 2024-04-25T13:47:07.199 INFO:tasks.workunit.client.0.smithi043.stdout:5/506: stat d1/d3/d7/d9/d2d/c4e 0 2024-04-25T13:47:07.204 INFO:tasks.workunit.client.0.smithi043.stdout:2/482: dwrite d0/d5/d2f/f7f [0,4194304] 0 2024-04-25T13:47:07.204 INFO:tasks.workunit.client.0.smithi043.stdout:5/507: read d1/d3/d24/f65 [371748,21898] 0 2024-04-25T13:47:07.205 INFO:tasks.workunit.client.0.smithi043.stdout:5/508: chown d1/d3/d7/c7b 0 1 2024-04-25T13:47:07.207 INFO:tasks.workunit.client.0.smithi043.stdout:5/509: rmdir d1/d3/d24 39 2024-04-25T13:47:07.208 INFO:tasks.workunit.client.0.smithi043.stdout:2/483: read d0/d5/d1e/f6b [1957399,126860] 0 2024-04-25T13:47:07.210 INFO:tasks.workunit.client.0.smithi043.stdout:4/476: dread d1/de/df/d1e/d45/f88 [0,4194304] 0 2024-04-25T13:47:07.211 INFO:tasks.workunit.client.0.smithi043.stdout:6/642: sync 2024-04-25T13:47:07.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:06 smithi043 ceph-mon[29195]: pgmap v78: 129 pgs: 129 active+clean; 841 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 102 MiB/s wr, 191 op/s 2024-04-25T13:47:07.212 INFO:tasks.workunit.client.0.smithi043.stdout:6/643: chown d0/d24/d3a/c95 1250613 1 2024-04-25T13:47:07.213 INFO:tasks.workunit.client.0.smithi043.stdout:5/510: link d1/d4/d42/l99 d1/d3/d7/d8/lad 0 2024-04-25T13:47:07.213 INFO:tasks.workunit.client.0.smithi043.stdout:6/644: fsync d0/d90/d4c/f6f 0 2024-04-25T13:47:07.214 INFO:tasks.workunit.client.0.smithi043.stdout:2/484: write d0/d5/d1e/f6b [34254,19943] 0 2024-04-25T13:47:07.215 INFO:tasks.workunit.client.0.smithi043.stdout:6/645: write d0/f16 [201900,113320] 0 2024-04-25T13:47:07.219 INFO:tasks.workunit.client.0.smithi043.stdout:2/485: symlink d0/l8f 0 2024-04-25T13:47:07.221 INFO:tasks.workunit.client.0.smithi043.stdout:4/477: dwrite d1/de/df/d1a/f73 [0,4194304] 0 2024-04-25T13:47:07.222 INFO:tasks.workunit.client.0.smithi043.stdout:2/486: chown d0/d34/d3f/d46/d55 12775024 1 2024-04-25T13:47:07.222 INFO:tasks.workunit.client.0.smithi043.stdout:6/646: mknod d0/d76/d2f/d64/cd5 0 2024-04-25T13:47:07.225 INFO:tasks.workunit.client.0.smithi043.stdout:4/478: write d1/de/df/f40 [1527104,108608] 0 2024-04-25T13:47:07.228 INFO:tasks.workunit.client.0.smithi043.stdout:5/511: dwrite d1/d3/d7/d8/da/d11/d52/f8c [0,4194304] 0 2024-04-25T13:47:07.234 INFO:tasks.workunit.client.0.smithi043.stdout:5/512: creat d1/d3/d7/d8/df/d98/fae x:0 0 0 2024-04-25T13:47:07.237 INFO:tasks.workunit.client.0.smithi043.stdout:5/513: chown d1/d3/d7/d2f/d67/la6 0 1 2024-04-25T13:47:07.237 INFO:tasks.workunit.client.0.smithi043.stdout:4/479: dwrite d1/de/df/d1a/f65 [0,4194304] 0 2024-04-25T13:47:07.238 INFO:tasks.workunit.client.0.smithi043.stdout:4/480: chown d1/d3 3 1 2024-04-25T13:47:07.240 INFO:tasks.workunit.client.0.smithi043.stdout:2/487: truncate d0/d5/d2f/f7f 3426395 0 2024-04-25T13:47:07.243 INFO:tasks.workunit.client.0.smithi043.stdout:5/514: creat d1/d3/d7/d8/df/d28/faf x:0 0 0 2024-04-25T13:47:07.247 INFO:tasks.workunit.client.0.smithi043.stdout:5/515: creat d1/d4/d92/fb0 x:0 0 0 2024-04-25T13:47:07.249 INFO:tasks.workunit.client.0.smithi043.stdout:4/481: dwrite d1/de/df/d1e/d28/d33/f74 [0,4194304] 0 2024-04-25T13:47:07.249 INFO:tasks.workunit.client.0.smithi043.stdout:5/516: write d1/d3/d62/f9f [176947,44279] 0 2024-04-25T13:47:07.258 INFO:tasks.workunit.client.0.smithi043.stdout:5/517: dwrite d1/d3/d7/d8/da/f88 [0,4194304] 0 2024-04-25T13:47:07.272 INFO:tasks.workunit.client.0.smithi043.stdout:6/647: dread d0/d3d/f62 [0,4194304] 0 2024-04-25T13:47:07.276 INFO:tasks.workunit.client.0.smithi043.stdout:6/648: mkdir d0/d76/d2f/dd6 0 2024-04-25T13:47:07.280 INFO:tasks.workunit.client.0.smithi043.stdout:6/649: link d0/d76/l78 d0/d76/ld7 0 2024-04-25T13:47:07.283 INFO:tasks.workunit.client.0.smithi043.stdout:6/650: creat d0/d76/fd8 x:0 0 0 2024-04-25T13:47:07.284 INFO:tasks.workunit.client.0.smithi043.stdout:6/651: write d0/d24/f55 [984176,16295] 0 2024-04-25T13:47:07.291 INFO:tasks.workunit.client.0.smithi043.stdout:6/652: truncate d0/d76/d2f/f32 3352080 0 2024-04-25T13:47:07.293 INFO:tasks.workunit.client.0.smithi043.stdout:5/518: dread d1/d3/d26/f2a [0,4194304] 0 2024-04-25T13:47:07.295 INFO:tasks.workunit.client.0.smithi043.stdout:5/519: write d1/d3/d7/d2f/d67/f6d [1023348,114675] 0 2024-04-25T13:47:07.299 INFO:tasks.workunit.client.0.smithi043.stdout:2/488: rename d0/f18 to d0/d34/d17/d5e/d71/f90 0 2024-04-25T13:47:07.303 INFO:tasks.workunit.client.0.smithi043.stdout:4/482: rename d1/de/l1b to d1/de/df/d1e/d45/l98 0 2024-04-25T13:47:07.304 INFO:tasks.workunit.client.0.smithi043.stdout:5/520: dwrite d1/d3/d26/f2a [0,4194304] 0 2024-04-25T13:47:07.306 INFO:tasks.workunit.client.0.smithi043.stdout:2/489: creat d0/d34/f91 x:0 0 0 2024-04-25T13:47:07.306 INFO:tasks.workunit.client.0.smithi043.stdout:6/653: dread d0/f31 [0,4194304] 0 2024-04-25T13:47:07.307 INFO:tasks.workunit.client.0.smithi043.stdout:6/654: dread - d0/d76/d5c/f75 zero size 2024-04-25T13:47:07.312 INFO:tasks.workunit.client.0.smithi043.stdout:4/483: link d1/de/df/d1e/d28/d33/f74 d1/de/d1d/f99 0 2024-04-25T13:47:07.314 INFO:tasks.workunit.client.0.smithi043.stdout:5/521: getdents d1/d3/d7/d9/d2d/d36 0 2024-04-25T13:47:07.316 INFO:tasks.workunit.client.0.smithi043.stdout:6/655: dread d0/d90/d48/fad [0,4194304] 0 2024-04-25T13:47:07.317 INFO:tasks.workunit.client.0.smithi043.stdout:4/484: dread d1/de/df/d1e/d45/f88 [0,4194304] 0 2024-04-25T13:47:07.322 INFO:tasks.workunit.client.0.smithi043.stdout:4/485: mknod d1/d3/d54/d62/c9a 0 2024-04-25T13:47:07.322 INFO:tasks.workunit.client.0.smithi043.stdout:5/522: creat d1/d3/d7/d9/d2d/d5b/fb1 x:0 0 0 2024-04-25T13:47:07.323 INFO:tasks.workunit.client.0.smithi043.stdout:5/523: fdatasync d1/d3/d7/d8/df/d28/fab 0 2024-04-25T13:47:07.324 INFO:tasks.workunit.client.0.smithi043.stdout:4/486: creat d1/d3/d54/d62/d77/d92/f9b x:0 0 0 2024-04-25T13:47:07.326 INFO:tasks.workunit.client.0.smithi043.stdout:4/487: stat d1/de/d1d/d20/f52 0 2024-04-25T13:47:07.328 INFO:tasks.workunit.client.0.smithi043.stdout:5/524: mknod d1/d4/d92/d95/cb2 0 2024-04-25T13:47:07.330 INFO:tasks.workunit.client.0.smithi043.stdout:5/525: dread d1/d3/d7/d8/df/f6b [0,4194304] 0 2024-04-25T13:47:07.332 INFO:tasks.workunit.client.0.smithi043.stdout:0/581: sync 2024-04-25T13:47:07.332 INFO:tasks.workunit.client.0.smithi043.stdout:7/722: sync 2024-04-25T13:47:07.333 INFO:tasks.workunit.client.0.smithi043.stdout:7/723: stat d5/d11/d3b/f4b 0 2024-04-25T13:47:07.334 INFO:tasks.workunit.client.0.smithi043.stdout:0/582: write db/d1b/d23/d27/d39/d4c/f8e [1207450,77470] 0 2024-04-25T13:47:07.336 INFO:tasks.workunit.client.0.smithi043.stdout:4/488: link d1/d3/c67 d1/de/df/d1e/d28/d33/c9c 0 2024-04-25T13:47:07.337 INFO:tasks.workunit.client.0.smithi043.stdout:6/656: dread d0/d76/d2f/f89 [0,4194304] 0 2024-04-25T13:47:07.337 INFO:tasks.workunit.client.0.smithi043.stdout:5/526: symlink d1/d3/lb3 0 2024-04-25T13:47:07.339 INFO:tasks.workunit.client.0.smithi043.stdout:5/527: chown d1/d4/d92/d95/cb2 45211 1 2024-04-25T13:47:07.341 INFO:tasks.workunit.client.0.smithi043.stdout:5/528: write d1/d3/d7/d8/df/d28/faf [404937,86003] 0 2024-04-25T13:47:07.342 INFO:tasks.workunit.client.0.smithi043.stdout:5/529: chown d1/d3/d7/d2f/d67/f51 391 1 2024-04-25T13:47:07.342 INFO:tasks.workunit.client.0.smithi043.stdout:6/657: mkdir d0/d90/dd9 0 2024-04-25T13:47:07.344 INFO:tasks.workunit.client.0.smithi043.stdout:2/490: link d0/d34/f20 d0/d34/d17/d5e/f92 0 2024-04-25T13:47:07.346 INFO:tasks.workunit.client.0.smithi043.stdout:7/724: getdents d5/d11/d3b/d61/dc5/dee/d5a/d8d 0 2024-04-25T13:47:07.350 INFO:tasks.workunit.client.0.smithi043.stdout:0/583: link db/d25/d2a/d3f/c48 db/d1b/d62/cc4 0 2024-04-25T13:47:07.351 INFO:tasks.workunit.client.0.smithi043.stdout:7/725: stat d5/d75/d54/la1 0 2024-04-25T13:47:07.351 INFO:tasks.workunit.client.0.smithi043.stdout:0/584: write f7 [6143617,11655] 0 2024-04-25T13:47:07.352 INFO:tasks.workunit.client.0.smithi043.stdout:2/491: creat d0/d34/d3f/f93 x:0 0 0 2024-04-25T13:47:07.352 INFO:tasks.workunit.client.0.smithi043.stdout:4/489: rename d1/de/d1d/d20/d38 to d1/de/df/d1a/d27/d36/d53/d66/d70/d9d 0 2024-04-25T13:47:07.353 INFO:tasks.workunit.client.0.smithi043.stdout:0/585: chown db/d1b/d94/d68 235 1 2024-04-25T13:47:07.357 INFO:tasks.workunit.client.0.smithi043.stdout:6/658: mknod d0/d3d/d54/cda 0 2024-04-25T13:47:07.359 INFO:tasks.workunit.client.0.smithi043.stdout:5/530: rename d1/d4/d42/l5f to d1/d3/d24/d7c/lb4 0 2024-04-25T13:47:07.361 INFO:tasks.workunit.client.0.smithi043.stdout:7/726: dwrite d5/d11/d84/f94 [0,4194304] 0 2024-04-25T13:47:07.361 INFO:tasks.workunit.client.0.smithi043.stdout:6/659: write d0/d3d/f62 [9697,71134] 0 2024-04-25T13:47:07.364 INFO:tasks.workunit.client.0.smithi043.stdout:6/660: truncate d0/fbe 627144 0 2024-04-25T13:47:07.365 INFO:tasks.workunit.client.0.smithi043.stdout:2/492: read d0/d34/d3f/d46/d55/f65 [2227039,93712] 0 2024-04-25T13:47:07.365 INFO:tasks.workunit.client.0.smithi043.stdout:5/531: write d1/d3/d7/f23 [2232918,110832] 0 2024-04-25T13:47:07.366 INFO:tasks.workunit.client.0.smithi043.stdout:4/490: dread d1/de/df/d1e/d28/d33/f5d [0,4194304] 0 2024-04-25T13:47:07.366 INFO:tasks.workunit.client.0.smithi043.stdout:0/586: rename db/d1b/c1c to db/d1b/d36/d41/cc5 0 2024-04-25T13:47:07.369 INFO:tasks.workunit.client.0.smithi043.stdout:0/587: chown db/d1b/f29 1251964 1 2024-04-25T13:47:07.369 INFO:tasks.workunit.client.0.smithi043.stdout:2/493: stat d0/d34/d3f/d46/d55/c64 0 2024-04-25T13:47:07.371 INFO:tasks.workunit.client.0.smithi043.stdout:6/661: unlink d0/d1c/f56 0 2024-04-25T13:47:07.372 INFO:tasks.workunit.client.0.smithi043.stdout:8/628: sync 2024-04-25T13:47:07.372 INFO:tasks.workunit.client.0.smithi043.stdout:3/570: sync 2024-04-25T13:47:07.372 INFO:tasks.workunit.client.0.smithi043.stdout:1/619: sync 2024-04-25T13:47:07.372 INFO:tasks.workunit.client.0.smithi043.stdout:7/727: symlink d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/df0/lf5 0 2024-04-25T13:47:07.373 INFO:tasks.workunit.client.0.smithi043.stdout:5/532: truncate d1/d4/d42/fa9 874708 0 2024-04-25T13:47:07.373 INFO:tasks.workunit.client.0.smithi043.stdout:6/662: dread - d0/fa4 zero size 2024-04-25T13:47:07.373 INFO:tasks.workunit.client.0.smithi043.stdout:2/494: chown d0/d5/d1e/f6b 1624156 1 2024-04-25T13:47:07.375 INFO:tasks.workunit.client.0.smithi043.stdout:7/728: chown d5/l86 0 1 2024-04-25T13:47:07.376 INFO:tasks.workunit.client.0.smithi043.stdout:1/620: creat df/d31/dc7/fdb x:0 0 0 2024-04-25T13:47:07.378 INFO:tasks.workunit.client.0.smithi043.stdout:2/495: write d0/d8/d22/f7e [915087,119085] 0 2024-04-25T13:47:07.382 INFO:tasks.workunit.client.0.smithi043.stdout:2/496: symlink d0/d34/d17/l94 0 2024-04-25T13:47:07.385 INFO:tasks.workunit.client.0.smithi043.stdout:0/588: unlink db/d1b/d4f/c7c 0 2024-04-25T13:47:07.386 INFO:tasks.workunit.client.0.smithi043.stdout:3/571: write d0/fab [2714272,113123] 0 2024-04-25T13:47:07.386 INFO:tasks.workunit.client.0.smithi043.stdout:6/663: dread d0/f31 [0,4194304] 0 2024-04-25T13:47:07.387 INFO:tasks.workunit.client.0.smithi043.stdout:4/491: dwrite d1/de/df/d1a/d27/d36/d53/d66/d70/d9d/f37 [4194304,4194304] 0 2024-04-25T13:47:07.388 INFO:tasks.workunit.client.0.smithi043.stdout:8/629: getdents db/dc/d21/d4e/d62 0 2024-04-25T13:47:07.400 INFO:tasks.workunit.client.0.smithi043.stdout:5/533: dread d1/d3/d7/d8/da/d11/f25 [0,4194304] 0 2024-04-25T13:47:07.401 INFO:tasks.workunit.client.0.smithi043.stdout:2/497: dwrite d0/d8/d22/f84 [0,4194304] 0 2024-04-25T13:47:07.402 INFO:tasks.workunit.client.0.smithi043.stdout:1/621: dwrite df/d31/d34/d8b/d39/f7f [0,4194304] 0 2024-04-25T13:47:07.405 INFO:tasks.workunit.client.0.smithi043.stdout:4/492: rename d1/de/df/d1a/d27/d36/d53/d66/d70 to d1/de/df/d1a/d27/d36/d9e 0 2024-04-25T13:47:07.406 INFO:tasks.workunit.client.0.smithi043.stdout:5/534: mkdir d1/d3/d7/d2f/d80/db5 0 2024-04-25T13:47:07.407 INFO:tasks.workunit.client.0.smithi043.stdout:2/498: rmdir d0/d8/d22/d5c 39 2024-04-25T13:47:07.408 INFO:tasks.workunit.client.0.smithi043.stdout:3/572: dwrite d0/da/f28 [0,4194304] 0 2024-04-25T13:47:07.412 INFO:tasks.workunit.client.0.smithi043.stdout:4/493: write d1/de/df/d1e/d45/f88 [1108902,68189] 0 2024-04-25T13:47:07.414 INFO:tasks.workunit.client.0.smithi043.stdout:8/630: dwrite db/d44/d5c/fae [0,4194304] 0 2024-04-25T13:47:07.416 INFO:tasks.workunit.client.0.smithi043.stdout:3/573: read d0/fab [774732,57083] 0 2024-04-25T13:47:07.416 INFO:tasks.workunit.client.0.smithi043.stdout:8/631: dread - db/d11/d1b/fb2 zero size 2024-04-25T13:47:07.418 INFO:tasks.workunit.client.0.smithi043.stdout:4/494: creat d1/de/df/d1e/d45/f9f x:0 0 0 2024-04-25T13:47:07.419 INFO:tasks.workunit.client.0.smithi043.stdout:2/499: dread d0/d26/f33 [0,4194304] 0 2024-04-25T13:47:07.420 INFO:tasks.workunit.client.0.smithi043.stdout:4/495: chown d1/d3/f3e 7 1 2024-04-25T13:47:07.420 INFO:tasks.workunit.client.0.smithi043.stdout:1/622: creat df/d14/d63/d67/d9f/fdc x:0 0 0 2024-04-25T13:47:07.421 INFO:tasks.workunit.client.0.smithi043.stdout:8/632: mkdir db/d11/d1b/dcb 0 2024-04-25T13:47:07.422 INFO:tasks.workunit.client.0.smithi043.stdout:1/623: chown df/d31/d38/d43/d53/l68 2736 1 2024-04-25T13:47:07.424 INFO:tasks.workunit.client.0.smithi043.stdout:2/500: creat d0/d34/d77/f95 x:0 0 0 2024-04-25T13:47:07.426 INFO:tasks.workunit.client.0.smithi043.stdout:2/501: write d0/d5/d1e/f52 [3681744,118060] 0 2024-04-25T13:47:07.427 INFO:tasks.workunit.client.0.smithi043.stdout:8/633: dread db/d11/d1b/f6c [0,4194304] 0 2024-04-25T13:47:07.428 INFO:tasks.workunit.client.0.smithi043.stdout:5/535: truncate d1/d3/d62/f9f 79894 0 2024-04-25T13:47:07.430 INFO:tasks.workunit.client.0.smithi043.stdout:8/634: read db/dc/d21/d4e/fab [3495782,80473] 0 2024-04-25T13:47:07.431 INFO:tasks.workunit.client.0.smithi043.stdout:1/624: mkdir df/d31/d34/d8b/ddd 0 2024-04-25T13:47:07.434 INFO:tasks.workunit.client.0.smithi043.stdout:4/496: link d1/de/df/d1a/d27/d36/l71 d1/de/df/d1a/d27/d36/d9e/la0 0 2024-04-25T13:47:07.438 INFO:tasks.workunit.client.0.smithi043.stdout:8/635: symlink db/dc/d21/db4/lcc 0 2024-04-25T13:47:07.443 INFO:tasks.workunit.client.0.smithi043.stdout:2/502: dwrite d0/d4b/f72 [0,4194304] 0 2024-04-25T13:47:07.444 INFO:tasks.workunit.client.0.smithi043.stdout:4/497: mkdir d1/de/df/d1e/d45/da1 0 2024-04-25T13:47:07.446 INFO:tasks.workunit.client.0.smithi043.stdout:1/625: rename df/d14/d3d/d82/d8c/fa3 to df/d31/dc7/dc8/dd2/fde 0 2024-04-25T13:47:07.449 INFO:tasks.workunit.client.0.smithi043.stdout:5/536: dwrite d1/d3/d26/f27 [4194304,4194304] 0 2024-04-25T13:47:07.450 INFO:tasks.workunit.client.0.smithi043.stdout:2/503: creat d0/d5/d1e/d32/f96 x:0 0 0 2024-04-25T13:47:07.451 INFO:tasks.workunit.client.0.smithi043.stdout:1/626: write df/d10/d22/f58 [1777891,91230] 0 2024-04-25T13:47:07.452 INFO:tasks.workunit.client.0.smithi043.stdout:4/498: creat d1/de/df/d1a/d27/d36/d53/fa2 x:0 0 0 2024-04-25T13:47:07.453 INFO:tasks.workunit.client.0.smithi043.stdout:5/537: stat d1/d3/d7/d8/da/d11 0 2024-04-25T13:47:07.456 INFO:tasks.workunit.client.0.smithi043.stdout:2/504: creat d0/d5/f97 x:0 0 0 2024-04-25T13:47:07.459 INFO:tasks.workunit.client.0.smithi043.stdout:3/574: dread d0/d9/d81/f8c [0,4194304] 0 2024-04-25T13:47:07.461 INFO:tasks.workunit.client.0.smithi043.stdout:8/636: dwrite db/d11/f20 [4194304,4194304] 0 2024-04-25T13:47:07.461 INFO:tasks.workunit.client.0.smithi043.stdout:4/499: rename d1/de/df/d1a/d27/l2f to d1/la3 0 2024-04-25T13:47:07.463 INFO:tasks.workunit.client.0.smithi043.stdout:2/505: mknod d0/c98 0 2024-04-25T13:47:07.464 INFO:tasks.workunit.client.0.smithi043.stdout:4/500: readlink d1/de/df/l29 0 2024-04-25T13:47:07.465 INFO:tasks.workunit.client.0.smithi043.stdout:1/627: creat df/d31/d34/d8b/fdf x:0 0 0 2024-04-25T13:47:07.465 INFO:tasks.workunit.client.0.smithi043.stdout:8/637: getdents db/dc/d21/d4e/d62/da0 0 2024-04-25T13:47:07.465 INFO:tasks.workunit.client.0.smithi043.stdout:5/538: dread d1/d3/d26/f2a [0,4194304] 0 2024-04-25T13:47:07.466 INFO:tasks.workunit.client.0.smithi043.stdout:2/506: mknod d0/d5/d1e/c99 0 2024-04-25T13:47:07.471 INFO:tasks.workunit.client.0.smithi043.stdout:5/539: mkdir d1/d3/d7/d2f/d80/db6 0 2024-04-25T13:47:07.476 INFO:tasks.workunit.client.0.smithi043.stdout:3/575: dwrite d0/d9/f95 [0,4194304] 0 2024-04-25T13:47:07.480 INFO:tasks.workunit.client.0.smithi043.stdout:1/628: dwrite df/d14/d3d/d82/fac [0,4194304] 0 2024-04-25T13:47:07.483 INFO:tasks.workunit.client.0.smithi043.stdout:4/501: getdents d1/de/df/d1a/d27/d36/d53 0 2024-04-25T13:47:07.484 INFO:tasks.workunit.client.0.smithi043.stdout:1/629: symlink df/d31/d38/d43/d53/le0 0 2024-04-25T13:47:07.485 INFO:tasks.workunit.client.0.smithi043.stdout:5/540: link d1/d3/d7/d8/l75 d1/d3/d7/d2f/lb7 0 2024-04-25T13:47:07.485 INFO:tasks.workunit.client.0.smithi043.stdout:3/576: unlink d0/d13/f7c 0 2024-04-25T13:47:07.486 INFO:tasks.workunit.client.0.smithi043.stdout:1/630: chown df/d31/d34/d91 15 1 2024-04-25T13:47:07.487 INFO:tasks.workunit.client.0.smithi043.stdout:4/502: rmdir d1 39 2024-04-25T13:47:07.489 INFO:tasks.workunit.client.0.smithi043.stdout:8/638: dwrite db/d11/d1b/d59/f7b [0,4194304] 0 2024-04-25T13:47:07.490 INFO:tasks.workunit.client.0.smithi043.stdout:5/541: write d1/d3/d7/d8/df/d28/f48 [3683600,86671] 0 2024-04-25T13:47:07.492 INFO:tasks.workunit.client.0.smithi043.stdout:3/577: creat d0/d9/d6e/d34/d36/fc9 x:0 0 0 2024-04-25T13:47:07.494 INFO:tasks.workunit.client.0.smithi043.stdout:4/503: creat d1/de/df/d1e/fa4 x:0 0 0 2024-04-25T13:47:07.495 INFO:tasks.workunit.client.0.smithi043.stdout:5/542: mkdir d1/d8d/db8 0 2024-04-25T13:47:07.496 INFO:tasks.workunit.client.0.smithi043.stdout:3/578: readlink d0/d9/d6e/l26 0 2024-04-25T13:47:07.496 INFO:tasks.workunit.client.0.smithi043.stdout:8/639: rmdir db/d7d 39 2024-04-25T13:47:07.497 INFO:tasks.workunit.client.0.smithi043.stdout:4/504: chown d1/de/df/d1e/d28/d33/l50 10472238 1 2024-04-25T13:47:07.498 INFO:tasks.workunit.client.0.smithi043.stdout:5/543: stat d1/d3/d7/d2f/lb7 0 2024-04-25T13:47:07.498 INFO:tasks.workunit.client.0.smithi043.stdout:4/505: rmdir d1/d6a 39 2024-04-25T13:47:07.500 INFO:tasks.workunit.client.0.smithi043.stdout:1/631: creat df/d14/d63/d67/da7/fe1 x:0 0 0 2024-04-25T13:47:07.502 INFO:tasks.workunit.client.0.smithi043.stdout:2/507: link d0/d8/d22/d5c/l82 d0/d34/d17/d5e/d86/l9a 0 2024-04-25T13:47:07.504 INFO:tasks.workunit.client.0.smithi043.stdout:3/579: creat d0/d13/d2e/fca x:0 0 0 2024-04-25T13:47:07.505 INFO:tasks.workunit.client.0.smithi043.stdout:2/508: write d0/d8/d22/f7e [967740,117882] 0 2024-04-25T13:47:07.509 INFO:tasks.workunit.client.0.smithi043.stdout:1/632: rename df/d31/c83 to df/d31/d34/d8b/ddd/ce2 0 2024-04-25T13:47:07.509 INFO:tasks.workunit.client.0.smithi043.stdout:5/544: dwrite d1/f56 [0,4194304] 0 2024-04-25T13:47:07.515 INFO:tasks.workunit.client.0.smithi043.stdout:5/545: mknod d1/d3/d62/cb9 0 2024-04-25T13:47:07.515 INFO:tasks.workunit.client.0.smithi043.stdout:4/506: dwrite d1/de/d1d/f99 [0,4194304] 0 2024-04-25T13:47:07.518 INFO:tasks.workunit.client.0.smithi043.stdout:5/546: write d1/d3/d62/f9c [472559,69985] 0 2024-04-25T13:47:07.518 INFO:tasks.workunit.client.0.smithi043.stdout:2/509: dread d0/d5/d2f/f7f [0,4194304] 0 2024-04-25T13:47:07.520 INFO:tasks.workunit.client.0.smithi043.stdout:2/510: fdatasync d0/d34/d3f/d46/d55/f80 0 2024-04-25T13:47:07.521 INFO:tasks.workunit.client.0.smithi043.stdout:4/507: symlink d1/de/df/d1a/d27/d36/d53/d66/la5 0 2024-04-25T13:47:07.522 INFO:tasks.workunit.client.0.smithi043.stdout:5/547: readlink d1/d4/d42/l99 0 2024-04-25T13:47:07.523 INFO:tasks.workunit.client.0.smithi043.stdout:1/633: rmdir df/d14/d63/d67/d9f 39 2024-04-25T13:47:07.528 INFO:tasks.workunit.client.0.smithi043.stdout:5/548: creat d1/d3/d7/d8/da/d11/fba x:0 0 0 2024-04-25T13:47:07.530 INFO:tasks.workunit.client.0.smithi043.stdout:2/511: dwrite d0/d34/d17/f60 [0,4194304] 0 2024-04-25T13:47:07.532 INFO:tasks.workunit.client.0.smithi043.stdout:2/512: write d0/d34/d77/f95 [330658,4205] 0 2024-04-25T13:47:07.535 INFO:tasks.workunit.client.0.smithi043.stdout:4/508: truncate d1/de/df/d1a/d27/f78 1061948 0 2024-04-25T13:47:07.536 INFO:tasks.workunit.client.0.smithi043.stdout:5/549: write d1/d3/d7/d8/df/f6b [785851,130164] 0 2024-04-25T13:47:07.538 INFO:tasks.workunit.client.0.smithi043.stdout:2/513: mkdir d0/d8/d9b 0 2024-04-25T13:47:07.541 INFO:tasks.workunit.client.0.smithi043.stdout:4/509: creat d1/de/d1d/d20/fa6 x:0 0 0 2024-04-25T13:47:07.543 INFO:tasks.workunit.client.0.smithi043.stdout:4/510: write d1/de/d1d/d20/f82 [698180,83273] 0 2024-04-25T13:47:07.546 INFO:tasks.workunit.client.0.smithi043.stdout:5/550: dwrite d1/d3/d7/d2f/d67/f6d [0,4194304] 0 2024-04-25T13:47:07.546 INFO:tasks.workunit.client.0.smithi043.stdout:3/580: rename d0/d9/d81/d8e/d92/l32 to d0/d9/d6e/lcb 0 2024-04-25T13:47:07.547 INFO:tasks.workunit.client.0.smithi043.stdout:4/511: chown d1/de/df/d1e/c31 51 1 2024-04-25T13:47:07.552 INFO:tasks.workunit.client.0.smithi043.stdout:1/634: rename df/d10/d22/d2f/d9c/c47 to df/d31/dc7/ce3 0 2024-04-25T13:47:07.556 INFO:tasks.workunit.client.0.smithi043.stdout:4/512: creat d1/de/df/d1a/d49/fa7 x:0 0 0 2024-04-25T13:47:07.556 INFO:tasks.workunit.client.0.smithi043.stdout:1/635: dread - df/d31/d34/d8b/fdf zero size 2024-04-25T13:47:07.559 INFO:tasks.workunit.client.0.smithi043.stdout:2/514: dwrite d0/d5/d2f/f79 [0,4194304] 0 2024-04-25T13:47:07.562 INFO:tasks.workunit.client.0.smithi043.stdout:3/581: chown d0/d9/d6e/d34/d36/d57/cb7 2 1 2024-04-25T13:47:07.562 INFO:tasks.workunit.client.0.smithi043.stdout:5/551: dwrite d1/d4/d42/fa9 [0,4194304] 0 2024-04-25T13:47:07.563 INFO:tasks.workunit.client.0.smithi043.stdout:1/636: symlink df/d31/d38/d43/dbc/le4 0 2024-04-25T13:47:07.565 INFO:tasks.workunit.client.0.smithi043.stdout:4/513: rename d1/de/f8e to d1/d3/d7b/fa8 0 2024-04-25T13:47:07.566 INFO:tasks.workunit.client.0.smithi043.stdout:1/637: creat df/d31/d38/d43/d81/fe5 x:0 0 0 2024-04-25T13:47:07.568 INFO:tasks.workunit.client.0.smithi043.stdout:5/552: unlink d1/d3/l3e 0 2024-04-25T13:47:07.570 INFO:tasks.workunit.client.0.smithi043.stdout:1/638: read df/f35 [71552,65582] 0 2024-04-25T13:47:07.570 INFO:tasks.workunit.client.0.smithi043.stdout:3/582: read d0/d9/d6e/f52 [6653411,40414] 0 2024-04-25T13:47:07.571 INFO:tasks.workunit.client.0.smithi043.stdout:3/583: dread - d0/da/db9/fbd zero size 2024-04-25T13:47:07.572 INFO:tasks.workunit.client.0.smithi043.stdout:2/515: mknod d0/d8/d22/d5c/d8c/c9c 0 2024-04-25T13:47:07.573 INFO:tasks.workunit.client.0.smithi043.stdout:2/516: dread - d0/d34/d3f/d46/d55/f80 zero size 2024-04-25T13:47:07.575 INFO:tasks.workunit.client.0.smithi043.stdout:5/553: creat d1/d3/d7/d2f/d80/fbb x:0 0 0 2024-04-25T13:47:07.578 INFO:tasks.workunit.client.0.smithi043.stdout:4/514: mknod d1/de/df/d1a/ca9 0 2024-04-25T13:47:07.580 INFO:tasks.workunit.client.0.smithi043.stdout:5/554: creat d1/d4/d92/d95/fbc x:0 0 0 2024-04-25T13:47:07.581 INFO:tasks.workunit.client.0.smithi043.stdout:4/515: mknod d1/de/df/d1a/d27/d36/caa 0 2024-04-25T13:47:07.585 INFO:tasks.workunit.client.0.smithi043.stdout:4/516: write d1/f14 [8690653,91001] 0 2024-04-25T13:47:07.585 INFO:tasks.workunit.client.0.smithi043.stdout:5/555: dread d1/d3/d7/d2f/d67/f6d [0,4194304] 0 2024-04-25T13:47:07.590 INFO:tasks.workunit.client.0.smithi043.stdout:4/517: rename d1/de/df/d1e/d28/l2e to d1/de/df/d1a/d49/lab 0 2024-04-25T13:47:07.591 INFO:tasks.workunit.client.0.smithi043.stdout:3/584: rmdir d0/d9/d6e 39 2024-04-25T13:47:07.593 INFO:tasks.workunit.client.0.smithi043.stdout:5/556: dwrite d1/d4/f73 [0,4194304] 0 2024-04-25T13:47:07.597 INFO:tasks.workunit.client.0.smithi043.stdout:5/557: readlink d1/d3/d7/d8/df/l4c 0 2024-04-25T13:47:07.598 INFO:tasks.workunit.client.0.smithi043.stdout:4/518: rename d1/de/df/d1a/d27/d36/d9e/d9d/c32 to d1/d3/d54/d62/cac 0 2024-04-25T13:47:07.599 INFO:tasks.workunit.client.0.smithi043.stdout:1/639: dread df/d14/f56 [0,4194304] 0 2024-04-25T13:47:07.599 INFO:tasks.workunit.client.0.smithi043.stdout:2/517: dwrite d0/d26/f33 [0,4194304] 0 2024-04-25T13:47:07.601 INFO:tasks.workunit.client.0.smithi043.stdout:2/518: write d0/d8/f8b [799003,84422] 0 2024-04-25T13:47:07.602 INFO:tasks.workunit.client.0.smithi043.stdout:3/585: truncate d0/d9/f62 1774928 0 2024-04-25T13:47:07.604 INFO:tasks.workunit.client.0.smithi043.stdout:1/640: creat df/d31/d38/d43/fe6 x:0 0 0 2024-04-25T13:47:07.604 INFO:tasks.workunit.client.0.smithi043.stdout:4/519: symlink d1/de/df/d1a/d27/lad 0 2024-04-25T13:47:07.605 INFO:tasks.workunit.client.0.smithi043.stdout:2/519: write d0/d34/d17/d5e/d71/f85 [1044513,2800] 0 2024-04-25T13:47:07.613 INFO:tasks.workunit.client.0.smithi043.stdout:1/641: creat df/d31/d38/fe7 x:0 0 0 2024-04-25T13:47:07.615 INFO:tasks.workunit.client.0.smithi043.stdout:4/520: dread d1/d3/d54/d62/d77/d79/f60 [0,4194304] 0 2024-04-25T13:47:07.617 INFO:tasks.workunit.client.0.smithi043.stdout:4/521: write d1/d3/d54/d62/d77/d79/f8a [657759,41491] 0 2024-04-25T13:47:07.622 INFO:tasks.workunit.client.0.smithi043.stdout:1/642: dwrite df/d14/d63/fa5 [0,4194304] 0 2024-04-25T13:47:07.625 INFO:tasks.workunit.client.0.smithi043.stdout:3/586: dread d0/d13/d5a/f91 [0,4194304] 0 2024-04-25T13:47:07.628 INFO:tasks.workunit.client.0.smithi043.stdout:4/522: dwrite d1/de/df/d1a/d27/d36/d9e/d9d/f37 [0,4194304] 0 2024-04-25T13:47:07.629 INFO:tasks.workunit.client.0.smithi043.stdout:3/587: mkdir d0/da/dcc 0 2024-04-25T13:47:07.632 INFO:tasks.workunit.client.0.smithi043.stdout:2/520: dread d0/d8/d22/f2b [0,4194304] 0 2024-04-25T13:47:07.635 INFO:tasks.workunit.client.0.smithi043.stdout:3/588: mknod d0/d9/d6e/dc5/ccd 0 2024-04-25T13:47:07.636 INFO:tasks.workunit.client.0.smithi043.stdout:7/729: sync 2024-04-25T13:47:07.637 INFO:tasks.workunit.client.0.smithi043.stdout:4/523: link d1/de/df/d1a/f2d d1/de/df/d1e/d45/fae 0 2024-04-25T13:47:07.640 INFO:tasks.workunit.client.0.smithi043.stdout:2/521: dwrite d0/d4b/f72 [0,4194304] 0 2024-04-25T13:47:07.642 INFO:tasks.workunit.client.0.smithi043.stdout:7/730: mkdir d5/d11/d3b/d8b/d9b/df6 0 2024-04-25T13:47:07.644 INFO:tasks.workunit.client.0.smithi043.stdout:4/524: write d1/de/df/d1e/d28/d33/f5d [1722329,20117] 0 2024-04-25T13:47:07.652 INFO:tasks.workunit.client.0.smithi043.stdout:4/525: mknod d1/d6a/caf 0 2024-04-25T13:47:07.652 INFO:tasks.workunit.client.0.smithi043.stdout:3/589: dwrite d0/d9/d81/d8e/d92/fa4 [0,4194304] 0 2024-04-25T13:47:07.654 INFO:tasks.workunit.client.0.smithi043.stdout:7/731: rename d5/d11/d3b/d61/cc7 to d5/d11/d3b/d61/dd4/cf7 0 2024-04-25T13:47:07.659 INFO:tasks.workunit.client.0.smithi043.stdout:7/732: write d5/d75/d54/f8a [2100996,49084] 0 2024-04-25T13:47:07.660 INFO:tasks.workunit.client.0.smithi043.stdout:2/522: truncate d0/d8/ff 1444889 0 2024-04-25T13:47:07.660 INFO:tasks.workunit.client.0.smithi043.stdout:4/526: read d1/de/df/d1e/d28/d33/f86 [3800011,78768] 0 2024-04-25T13:47:07.661 INFO:tasks.workunit.client.0.smithi043.stdout:3/590: creat d0/d9/d78/dc2/fce x:0 0 0 2024-04-25T13:47:07.666 INFO:tasks.workunit.client.0.smithi043.stdout:7/733: mkdir d5/d11/d3b/d61/dc5/dcc/df8 0 2024-04-25T13:47:07.666 INFO:tasks.workunit.client.0.smithi043.stdout:1/643: dread df/d14/d3d/f84 [0,4194304] 0 2024-04-25T13:47:07.666 INFO:tasks.workunit.client.0.smithi043.stdout:2/523: creat d0/d5/d1e/f9d x:0 0 0 2024-04-25T13:47:07.666 INFO:tasks.workunit.client.0.smithi043.stdout:3/591: mknod d0/d9/d6e/dc5/ccf 0 2024-04-25T13:47:07.666 INFO:tasks.workunit.client.0.smithi043.stdout:1/644: fsync df/d31/d38/d43/f65 0 2024-04-25T13:47:07.667 INFO:tasks.workunit.client.0.smithi043.stdout:4/527: symlink d1/de/df/d1a/d27/d36/d53/d66/lb0 0 2024-04-25T13:47:07.669 INFO:tasks.workunit.client.0.smithi043.stdout:1/645: symlink df/d31/le8 0 2024-04-25T13:47:07.669 INFO:tasks.workunit.client.0.smithi043.stdout:4/528: chown d1/de/df/d1a/d27/d36/d9e/d7c 0 1 2024-04-25T13:47:07.670 INFO:tasks.workunit.client.0.smithi043.stdout:2/524: read d0/d26/f4d [243140,106825] 0 2024-04-25T13:47:07.670 INFO:tasks.workunit.client.0.smithi043.stdout:3/592: write d0/d13/d5a/f91 [106241,122007] 0 2024-04-25T13:47:07.672 INFO:tasks.workunit.client.0.smithi043.stdout:3/593: readlink d0/l60 0 2024-04-25T13:47:07.673 INFO:tasks.workunit.client.0.smithi043.stdout:2/525: chown d0/c16 18 1 2024-04-25T13:47:07.676 INFO:tasks.workunit.client.0.smithi043.stdout:3/594: write d0/d8d/fbc [717934,31573] 0 2024-04-25T13:47:07.677 INFO:tasks.workunit.client.0.smithi043.stdout:1/646: readlink df/d31/d34/d8b/d39/lcc 0 2024-04-25T13:47:07.678 INFO:tasks.workunit.client.0.smithi043.stdout:2/526: fdatasync d0/d5/d1e/f9d 0 2024-04-25T13:47:07.679 INFO:tasks.workunit.client.0.smithi043.stdout:7/734: dwrite d5/d11/d3b/d61/dc5/dee/d5a/f5e [0,4194304] 0 2024-04-25T13:47:07.682 INFO:tasks.workunit.client.0.smithi043.stdout:3/595: read - d0/d13/f73 zero size 2024-04-25T13:47:07.683 INFO:tasks.workunit.client.0.smithi043.stdout:7/735: write d5/d11/d84/f94 [1125076,5330] 0 2024-04-25T13:47:07.684 INFO:tasks.workunit.client.0.smithi043.stdout:1/647: creat df/d31/d38/d43/d53/fe9 x:0 0 0 2024-04-25T13:47:07.686 INFO:tasks.workunit.client.0.smithi043.stdout:4/529: dwrite d1/de/df/d1e/d45/f88 [4194304,4194304] 0 2024-04-25T13:47:07.688 INFO:tasks.workunit.client.0.smithi043.stdout:7/736: write d5/d11/d84/fc4 [4342485,93070] 0 2024-04-25T13:47:07.689 INFO:tasks.workunit.client.0.smithi043.stdout:1/648: dread - df/d31/d34/d8b/fdf zero size 2024-04-25T13:47:07.696 INFO:tasks.workunit.client.0.smithi043.stdout:2/527: truncate d0/d8/fa 2156844 0 2024-04-25T13:47:07.699 INFO:tasks.workunit.client.0.smithi043.stdout:3/596: creat d0/d9/d81/fd0 x:0 0 0 2024-04-25T13:47:07.699 INFO:tasks.workunit.client.0.smithi043.stdout:7/737: write d5/f3c [1292706,77054] 0 2024-04-25T13:47:07.700 INFO:tasks.workunit.client.0.smithi043.stdout:2/528: mknod d0/d5/c9e 0 2024-04-25T13:47:07.702 INFO:tasks.workunit.client.0.smithi043.stdout:4/530: dwrite d1/de/f8c [0,4194304] 0 2024-04-25T13:47:07.704 INFO:tasks.workunit.client.0.smithi043.stdout:3/597: dread - d0/da/db9/fbd zero size 2024-04-25T13:47:07.705 INFO:tasks.workunit.client.0.smithi043.stdout:2/529: mkdir d0/d34/d17/d5e/d9f 0 2024-04-25T13:47:07.708 INFO:tasks.workunit.client.0.smithi043.stdout:7/738: mknod d5/d11/d3b/d61/dd4/cf9 0 2024-04-25T13:47:07.708 INFO:tasks.workunit.client.0.smithi043.stdout:2/530: dread - d0/d34/f91 zero size 2024-04-25T13:47:07.709 INFO:tasks.workunit.client.0.smithi043.stdout:1/649: dwrite df/d31/d38/fe7 [0,4194304] 0 2024-04-25T13:47:07.712 INFO:tasks.workunit.client.0.smithi043.stdout:7/739: symlink d5/d6b/lfa 0 2024-04-25T13:47:07.713 INFO:tasks.workunit.client.0.smithi043.stdout:4/531: write d1/de/df/d1a/d27/d36/d53/fa2 [301964,97204] 0 2024-04-25T13:47:07.717 INFO:tasks.workunit.client.0.smithi043.stdout:7/740: creat d5/d11/d3b/d61/dc5/dee/d5a/ffb x:0 0 0 2024-04-25T13:47:07.718 INFO:tasks.workunit.client.0.smithi043.stdout:7/741: write d5/f72 [1510845,8197] 0 2024-04-25T13:47:07.721 INFO:tasks.workunit.client.0.smithi043.stdout:4/532: truncate d1/de/df/d1a/d27/f78 518372 0 2024-04-25T13:47:07.722 INFO:tasks.workunit.client.0.smithi043.stdout:7/742: dread d5/d11/d3b/d61/dc5/dee/f48 [0,4194304] 0 2024-04-25T13:47:07.725 INFO:tasks.workunit.client.0.smithi043.stdout:4/533: symlink d1/d3/lb1 0 2024-04-25T13:47:07.729 INFO:tasks.workunit.client.0.smithi043.stdout:4/534: creat d1/de/df/d1a/d27/d36/d9e/d7c/fb2 x:0 0 0 2024-04-25T13:47:07.732 INFO:tasks.workunit.client.0.smithi043.stdout:2/531: truncate d0/d5/d1e/f52 2444145 0 2024-04-25T13:47:07.740 INFO:tasks.workunit.client.0.smithi043.stdout:7/743: dread d5/f45 [0,4194304] 0 2024-04-25T13:47:07.740 INFO:tasks.workunit.client.0.smithi043.stdout:3/598: dread d0/d9/d6e/d34/f7f [0,4194304] 0 2024-04-25T13:47:07.741 INFO:tasks.workunit.client.0.smithi043.stdout:7/744: read d5/d11/d84/fbc [653123,9431] 0 2024-04-25T13:47:07.745 INFO:tasks.workunit.client.0.smithi043.stdout:3/599: creat d0/d13/d2e/db1/fd1 x:0 0 0 2024-04-25T13:47:07.753 INFO:tasks.workunit.client.0.smithi043.stdout:3/600: dwrite d0/d61/d82/fc6 [0,4194304] 0 2024-04-25T13:47:07.754 INFO:tasks.workunit.client.0.smithi043.stdout:3/601: fsync d0/d13/d2e/f76 0 2024-04-25T13:47:07.755 INFO:tasks.workunit.client.0.smithi043.stdout:0/589: sync 2024-04-25T13:47:07.755 INFO:tasks.workunit.client.0.smithi043.stdout:7/745: unlink d5/f18 0 2024-04-25T13:47:07.756 INFO:tasks.workunit.client.0.smithi043.stdout:0/590: dread - db/d25/fa3 zero size 2024-04-25T13:47:07.775 INFO:tasks.workunit.client.0.smithi043.stdout:3/602: symlink d0/da/db9/d9e/ld2 0 2024-04-25T13:47:07.787 INFO:tasks.workunit.client.0.smithi043.stdout:3/603: dwrite d0/da/f28 [0,4194304] 0 2024-04-25T13:47:07.789 INFO:tasks.workunit.client.0.smithi043.stdout:6/664: sync 2024-04-25T13:47:07.789 INFO:tasks.workunit.client.0.smithi043.stdout:8/640: sync 2024-04-25T13:47:07.789 INFO:tasks.workunit.client.0.smithi043.stdout:5/558: sync 2024-04-25T13:47:07.791 INFO:tasks.workunit.client.0.smithi043.stdout:8/641: fdatasync db/d11/d79/d81/f9a 0 2024-04-25T13:47:07.793 INFO:tasks.workunit.client.0.smithi043.stdout:8/642: read db/d11/f2a [3259774,45024] 0 2024-04-25T13:47:07.798 INFO:tasks.workunit.client.0.smithi043.stdout:8/643: symlink db/d11/d1b/d59/d7c/daf/lcd 0 2024-04-25T13:47:07.812 INFO:tasks.workunit.client.0.smithi043.stdout:3/604: dread d0/d13/f27 [0,4194304] 0 2024-04-25T13:47:07.812 INFO:tasks.workunit.client.0.smithi043.stdout:0/591: creat db/d1b/d23/d27/fc6 x:0 0 0 2024-04-25T13:47:07.818 INFO:tasks.workunit.client.0.smithi043.stdout:3/605: truncate d0/fab 460892 0 2024-04-25T13:47:07.819 INFO:tasks.workunit.client.0.smithi043.stdout:0/592: symlink db/d1b/d36/lc7 0 2024-04-25T13:47:07.819 INFO:tasks.workunit.client.0.smithi043.stdout:0/593: chown db/d1b/d94 0 1 2024-04-25T13:47:07.823 INFO:tasks.workunit.client.0.smithi043.stdout:0/594: mkdir db/d1b/d23/d27/d39/d4c/dbb/dc8 0 2024-04-25T13:47:07.825 INFO:tasks.workunit.client.0.smithi043.stdout:6/665: creat d0/d90/d48/fdb x:0 0 0 2024-04-25T13:47:07.831 INFO:tasks.workunit.client.0.smithi043.stdout:6/666: unlink d0/d3d/d6e/d71/c7a 0 2024-04-25T13:47:07.833 INFO:tasks.workunit.client.0.smithi043.stdout:0/595: creat db/d1b/d36/d41/daf/fc9 x:0 0 0 2024-04-25T13:47:07.843 INFO:tasks.workunit.client.0.smithi043.stdout:5/559: dread - d1/d3/d62/fac zero size 2024-04-25T13:47:07.843 INFO:tasks.workunit.client.0.smithi043.stdout:8/644: creat db/dc/d21/d4e/fce x:0 0 0 2024-04-25T13:47:07.846 INFO:tasks.workunit.client.0.smithi043.stdout:5/560: symlink d1/d3/d7/d8/df/lbd 0 2024-04-25T13:47:07.849 INFO:tasks.workunit.client.0.smithi043.stdout:0/596: getdents db/d1b/d36/d41 0 2024-04-25T13:47:07.851 INFO:tasks.workunit.client.0.smithi043.stdout:8/645: dwrite db/d11/d79/d81/f9a [0,4194304] 0 2024-04-25T13:47:07.852 INFO:tasks.workunit.client.0.smithi043.stdout:8/646: fsync db/d44/d8e/f56 0 2024-04-25T13:47:07.852 INFO:tasks.workunit.client.0.smithi043.stdout:5/561: symlink d1/d3/d7/d2f/lbe 0 2024-04-25T13:47:07.853 INFO:tasks.workunit.client.0.smithi043.stdout:5/562: chown d1/d3/d7/d9/l82 1595 1 2024-04-25T13:47:07.854 INFO:tasks.workunit.client.0.smithi043.stdout:4/535: rename d1/de/df/d1e/d28 to d1/de/df/d1e/d45/da1/db3 0 2024-04-25T13:47:07.855 INFO:tasks.workunit.client.0.smithi043.stdout:8/647: write db/d38/d3c/d71/f50 [6689844,11636] 0 2024-04-25T13:47:07.856 INFO:tasks.workunit.client.0.smithi043.stdout:6/667: truncate d0/d76/d2f/da7/fd0 123364 0 2024-04-25T13:47:07.860 INFO:tasks.workunit.client.0.smithi043.stdout:5/563: fdatasync d1/d3/d7/d8/da/f2c 0 2024-04-25T13:47:07.861 INFO:tasks.workunit.client.0.smithi043.stdout:1/650: truncate df/d14/d63/d67/d9f/fb5 4964370 0 2024-04-25T13:47:07.864 INFO:tasks.workunit.client.0.smithi043.stdout:1/651: mkdir df/d31/d38/d43/d6e/dea 0 2024-04-25T13:47:07.874 INFO:tasks.workunit.client.0.smithi043.stdout:1/652: dwrite df/d10/d22/f26 [0,4194304] 0 2024-04-25T13:47:07.874 INFO:tasks.workunit.client.0.smithi043.stdout:4/536: fdatasync d1/de/df/d1e/d45/fae 0 2024-04-25T13:47:07.876 INFO:tasks.workunit.client.0.smithi043.stdout:4/537: dread - d1/de/df/d1a/f47 zero size 2024-04-25T13:47:07.877 INFO:tasks.workunit.client.0.smithi043.stdout:1/653: creat df/d31/feb x:0 0 0 2024-04-25T13:47:07.878 INFO:tasks.workunit.client.0.smithi043.stdout:6/668: creat d0/d76/d2f/dd6/fdc x:0 0 0 2024-04-25T13:47:07.881 INFO:tasks.workunit.client.0.smithi043.stdout:1/654: symlink df/d10/d22/d2f/d9c/d41/lec 0 2024-04-25T13:47:07.888 INFO:tasks.workunit.client.0.smithi043.stdout:8/648: creat db/d11/d1b/d59/fcf x:0 0 0 2024-04-25T13:47:07.889 INFO:tasks.workunit.client.0.smithi043.stdout:1/655: link df/d31/d34/d8b/d39/f7f df/d31/dc7/dc8/fed 0 2024-04-25T13:47:07.894 INFO:tasks.workunit.client.0.smithi043.stdout:4/538: rmdir d1 39 2024-04-25T13:47:07.896 INFO:tasks.workunit.client.0.smithi043.stdout:8/649: creat db/d46/da8/fd0 x:0 0 0 2024-04-25T13:47:07.897 INFO:tasks.workunit.client.0.smithi043.stdout:1/656: write df/f35 [394621,59542] 0 2024-04-25T13:47:07.898 INFO:tasks.workunit.client.0.smithi043.stdout:0/597: creat db/d1b/d23/d27/d39/d4b/fca x:0 0 0 2024-04-25T13:47:07.899 INFO:tasks.workunit.client.0.smithi043.stdout:8/650: rmdir db/d11/d1b/d59 39 2024-04-25T13:47:07.900 INFO:tasks.workunit.client.0.smithi043.stdout:5/564: symlink d1/d3/d7/d9/d2d/d36/lbf 0 2024-04-25T13:47:07.900 INFO:tasks.workunit.client.0.smithi043.stdout:5/565: stat d1/d4/d92/d95 0 2024-04-25T13:47:07.900 INFO:tasks.workunit.client.0.smithi043.stdout:1/657: read df/d14/d3d/f55 [712592,120785] 0 2024-04-25T13:47:07.901 INFO:tasks.workunit.client.0.smithi043.stdout:0/598: mkdir db/d1b/d23/d27/dcb 0 2024-04-25T13:47:07.902 INFO:tasks.workunit.client.0.smithi043.stdout:8/651: read db/d44/d8e/f96 [514575,13617] 0 2024-04-25T13:47:07.903 INFO:tasks.workunit.client.0.smithi043.stdout:0/599: write db/d1b/d94/f83 [748671,71252] 0 2024-04-25T13:47:07.904 INFO:tasks.workunit.client.0.smithi043.stdout:5/566: write d1/d4/d42/f97 [573900,81732] 0 2024-04-25T13:47:07.905 INFO:tasks.workunit.client.0.smithi043.stdout:1/658: creat df/d14/d3d/d82/fee x:0 0 0 2024-04-25T13:47:07.912 INFO:tasks.workunit.client.0.smithi043.stdout:5/567: mknod d1/d3/d7/d8/df/d98/cc0 0 2024-04-25T13:47:07.912 INFO:tasks.workunit.client.0.smithi043.stdout:0/600: mknod db/d1b/ccc 0 2024-04-25T13:47:07.913 INFO:tasks.workunit.client.0.smithi043.stdout:0/601: stat db/d1b/d23/d27/d98/f9e 0 2024-04-25T13:47:07.914 INFO:tasks.workunit.client.0.smithi043.stdout:0/602: fdatasync db/d25/d2a/f7a 0 2024-04-25T13:47:07.915 INFO:tasks.workunit.client.0.smithi043.stdout:0/603: fdatasync db/d1b/f38 0 2024-04-25T13:47:07.920 INFO:tasks.workunit.client.0.smithi043.stdout:0/604: mknod db/d1b/d23/d27/d39/d4c/d74/ccd 0 2024-04-25T13:47:07.921 INFO:tasks.workunit.client.0.smithi043.stdout:5/568: getdents d1/d3/d7/d2f/d67 0 2024-04-25T13:47:07.922 INFO:tasks.workunit.client.0.smithi043.stdout:0/605: truncate db/d1b/d62/fb4 556944 0 2024-04-25T13:47:07.926 INFO:tasks.workunit.client.0.smithi043.stdout:8/652: write db/d7d/fb0 [873063,81079] 0 2024-04-25T13:47:07.928 INFO:tasks.workunit.client.0.smithi043.stdout:5/569: dread d1/d3/d7/d8/da/f88 [0,4194304] 0 2024-04-25T13:47:07.929 INFO:tasks.workunit.client.0.smithi043.stdout:8/653: symlink db/d11/d79/dbc/ld1 0 2024-04-25T13:47:07.930 INFO:tasks.workunit.client.0.smithi043.stdout:0/606: dwrite db/d25/d2a/d3f/f8c [0,4194304] 0 2024-04-25T13:47:07.930 INFO:tasks.workunit.client.0.smithi043.stdout:2/532: rename d0/d5/d1e/d32/d7c to d0/d34/d17/da0 0 2024-04-25T13:47:07.931 INFO:tasks.workunit.client.0.smithi043.stdout:6/669: link d0/d76/d2f/d64/cd5 d0/cdd 0 2024-04-25T13:47:07.932 INFO:tasks.workunit.client.0.smithi043.stdout:2/533: dread - d0/d5/d1e/d32/f96 zero size 2024-04-25T13:47:07.934 INFO:tasks.workunit.client.0.smithi043.stdout:7/746: rename d5/d11/d3b/d8b/d9b/faf to d5/d6b/ffc 0 2024-04-25T13:47:07.939 INFO:tasks.workunit.client.0.smithi043.stdout:7/747: mkdir d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/dfd 0 2024-04-25T13:47:07.940 INFO:tasks.workunit.client.0.smithi043.stdout:0/607: write db/d1b/d23/d27/d98/fb1 [885474,76885] 0 2024-04-25T13:47:07.944 INFO:tasks.workunit.client.0.smithi043.stdout:2/534: creat d0/fa1 x:0 0 0 2024-04-25T13:47:07.946 INFO:tasks.workunit.client.0.smithi043.stdout:8/654: truncate db/d44/d8e/d27/f75 153743 0 2024-04-25T13:47:07.947 INFO:tasks.workunit.client.0.smithi043.stdout:6/670: creat d0/d76/d2f/da7/fde x:0 0 0 2024-04-25T13:47:07.948 INFO:tasks.workunit.client.0.smithi043.stdout:7/748: dwrite d5/d11/db4/fca [0,4194304] 0 2024-04-25T13:47:07.949 INFO:tasks.workunit.client.0.smithi043.stdout:0/608: creat db/d1b/d23/d27/dcb/fce x:0 0 0 2024-04-25T13:47:07.950 INFO:tasks.workunit.client.0.smithi043.stdout:7/749: chown d5/d75/d54/cb0 5283 1 2024-04-25T13:47:07.951 INFO:tasks.workunit.client.0.smithi043.stdout:6/671: creat d0/d1b/fdf x:0 0 0 2024-04-25T13:47:07.951 INFO:tasks.workunit.client.0.smithi043.stdout:7/750: chown d5/d75/d54/f8a 46180729 1 2024-04-25T13:47:07.952 INFO:tasks.workunit.client.0.smithi043.stdout:6/672: dread - d0/d1c/fa6 zero size 2024-04-25T13:47:07.954 INFO:tasks.workunit.client.0.smithi043.stdout:0/609: creat db/d25/fcf x:0 0 0 2024-04-25T13:47:07.955 INFO:tasks.workunit.client.0.smithi043.stdout:0/610: chown db/d25/d2a 21 1 2024-04-25T13:47:07.955 INFO:tasks.workunit.client.0.smithi043.stdout:0/611: dread - db/d25/f69 zero size 2024-04-25T13:47:07.957 INFO:tasks.workunit.client.0.smithi043.stdout:7/751: rmdir d5/d11/d3b/d8b/d9b 39 2024-04-25T13:47:07.961 INFO:tasks.workunit.client.0.smithi043.stdout:2/535: getdents d0/d8/d22/d5c 0 2024-04-25T13:47:07.962 INFO:tasks.workunit.client.0.smithi043.stdout:6/673: mknod d0/d76/d2f/d64/da1/ce0 0 2024-04-25T13:47:07.963 INFO:tasks.workunit.client.0.smithi043.stdout:7/752: mknod d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/cfe 0 2024-04-25T13:47:07.963 INFO:tasks.workunit.client.0.smithi043.stdout:2/536: fdatasync d0/d8/f8b 0 2024-04-25T13:47:07.968 INFO:tasks.workunit.client.0.smithi043.stdout:6/674: creat d0/d90/dd9/fe1 x:0 0 0 2024-04-25T13:47:07.968 INFO:tasks.workunit.client.0.smithi043.stdout:0/612: dwrite db/d25/d2a/d3f/d6a/f89 [0,4194304] 0 2024-04-25T13:47:07.970 INFO:tasks.workunit.client.0.smithi043.stdout:0/613: dread - db/d25/fa3 zero size 2024-04-25T13:47:07.970 INFO:tasks.workunit.client.0.smithi043.stdout:7/753: creat d5/d11/d3b/d8b/d9b/fff x:0 0 0 2024-04-25T13:47:07.970 INFO:tasks.workunit.client.0.smithi043.stdout:6/675: creat d0/d76/d5c/fe2 x:0 0 0 2024-04-25T13:47:07.972 INFO:tasks.workunit.client.0.smithi043.stdout:0/614: symlink db/d1b/d94/da1/ld0 0 2024-04-25T13:47:07.976 INFO:tasks.workunit.client.0.smithi043.stdout:7/754: link d5/d11/d80/fc9 d5/d11/d3b/d61/dc5/dee/d5a/d89/f100 0 2024-04-25T13:47:07.977 INFO:tasks.workunit.client.0.smithi043.stdout:0/615: creat db/d1b/d23/d27/d39/d4c/d74/fd1 x:0 0 0 2024-04-25T13:47:07.979 INFO:tasks.workunit.client.0.smithi043.stdout:6/676: getdents d0/d24/d3a 0 2024-04-25T13:47:07.981 INFO:tasks.workunit.client.0.smithi043.stdout:7/755: truncate d5/d32/f4e 1023753 0 2024-04-25T13:47:07.982 INFO:tasks.workunit.client.0.smithi043.stdout:2/537: dwrite d0/d26/f31 [0,4194304] 0 2024-04-25T13:47:07.985 INFO:tasks.workunit.client.0.smithi043.stdout:7/756: rmdir d5/d6b 39 2024-04-25T13:47:07.987 INFO:tasks.workunit.client.0.smithi043.stdout:2/538: mkdir d0/d34/d3f/d59/da2 0 2024-04-25T13:47:08.062 INFO:tasks.workunit.client.0.smithi043.stdout:7/757: unlink d5/d11/d3b/l99 0 2024-04-25T13:47:08.062 INFO:tasks.workunit.client.0.smithi043.stdout:2/539: chown d0/l8f 190 1 2024-04-25T13:47:08.067 INFO:tasks.workunit.client.0.smithi043.stdout:7/758: unlink d5/d11/d3b/d61/dd4/cf7 0 2024-04-25T13:47:08.068 INFO:tasks.workunit.client.0.smithi043.stdout:2/540: dwrite d0/d5/d2f/f7f [0,4194304] 0 2024-04-25T13:47:08.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:07 smithi161 ceph-mon[32696]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:47:08.139 INFO:tasks.workunit.client.0.smithi043.stdout:2/541: dread d0/d34/d17/f23 [4194304,4194304] 0 2024-04-25T13:47:08.142 INFO:tasks.workunit.client.0.smithi043.stdout:2/542: mknod d0/d8/d22/d5c/d8c/ca3 0 2024-04-25T13:47:08.144 INFO:tasks.workunit.client.0.smithi043.stdout:2/543: rmdir d0/d34/d17/d5e/d71 39 2024-04-25T13:47:08.145 INFO:tasks.workunit.client.0.smithi043.stdout:2/544: rmdir d0/d26 39 2024-04-25T13:47:08.146 INFO:tasks.workunit.client.0.smithi043.stdout:2/545: dread - d0/d5/d2f/f8a zero size 2024-04-25T13:47:08.146 INFO:tasks.workunit.client.0.smithi043.stdout:2/546: readlink d0/d34/d17/d5e/d86/l9a 0 2024-04-25T13:47:08.153 INFO:tasks.workunit.client.0.smithi043.stdout:2/547: write d0/d5/d1e/f52 [697842,28180] 0 2024-04-25T13:47:08.156 INFO:tasks.workunit.client.0.smithi043.stdout:2/548: creat d0/d34/d77/fa4 x:0 0 0 2024-04-25T13:47:08.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:07 smithi175 ceph-mon[32649]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:47:08.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:07 smithi043 ceph-mon[29195]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:47:08.216 INFO:tasks.workunit.client.0.smithi043.stdout:0/616: sync 2024-04-25T13:47:08.222 INFO:tasks.workunit.client.0.smithi043.stdout:0/617: dwrite db/d1b/d23/d27/dcb/fce [0,4194304] 0 2024-04-25T13:47:08.228 INFO:tasks.workunit.client.0.smithi043.stdout:0/618: link db/l7d db/d1b/d23/d27/d39/d4c/d74/ld2 0 2024-04-25T13:47:08.229 INFO:tasks.workunit.client.0.smithi043.stdout:0/619: truncate db/d1b/d23/d27/dcb/fce 4980327 0 2024-04-25T13:47:08.231 INFO:tasks.workunit.client.0.smithi043.stdout:0/620: mkdir db/d25/d2a/d3f/d6a/dd3 0 2024-04-25T13:47:08.233 INFO:tasks.workunit.client.0.smithi043.stdout:0/621: unlink db/d1b/ccc 0 2024-04-25T13:47:08.235 INFO:tasks.workunit.client.0.smithi043.stdout:0/622: symlink db/d1b/d23/d27/d39/d4c/dbb/dc8/ld4 0 2024-04-25T13:47:08.246 INFO:tasks.workunit.client.0.smithi043.stdout:0/623: dwrite db/d1b/d23/d27/fa0 [0,4194304] 0 2024-04-25T13:47:08.253 INFO:tasks.workunit.client.0.smithi043.stdout:0/624: dwrite db/d1b/d23/d27/d98/fb1 [0,4194304] 0 2024-04-25T13:47:08.255 INFO:tasks.workunit.client.0.smithi043.stdout:0/625: write db/d25/f2b [159367,108646] 0 2024-04-25T13:47:08.264 INFO:tasks.workunit.client.0.smithi043.stdout:6/677: sync 2024-04-25T13:47:08.265 INFO:tasks.workunit.client.0.smithi043.stdout:0/626: dwrite db/d25/d2a/fb6 [0,4194304] 0 2024-04-25T13:47:08.280 INFO:tasks.workunit.client.0.smithi043.stdout:6/678: rename d0/d76/d2f to d0/d76/de3 0 2024-04-25T13:47:08.283 INFO:tasks.workunit.client.0.smithi043.stdout:6/679: link d0/d90/d48/laf d0/d1c/le4 0 2024-04-25T13:47:08.284 INFO:tasks.workunit.client.0.smithi043.stdout:6/680: chown d0/d90/d4c/ca0 85768467 1 2024-04-25T13:47:08.288 INFO:tasks.workunit.client.0.smithi043.stdout:0/627: dread db/d1b/f26 [0,4194304] 0 2024-04-25T13:47:08.288 INFO:tasks.workunit.client.0.smithi043.stdout:0/628: stat db/d1b/f35 0 2024-04-25T13:47:08.291 INFO:tasks.workunit.client.0.smithi043.stdout:0/629: link db/d1b/f96 db/d1b/d94/fd5 0 2024-04-25T13:47:08.296 INFO:tasks.workunit.client.0.smithi043.stdout:6/681: dread d0/d76/de3/f89 [0,4194304] 0 2024-04-25T13:47:08.297 INFO:tasks.workunit.client.0.smithi043.stdout:0/630: dwrite db/d25/d2a/d3f/f42 [0,4194304] 0 2024-04-25T13:47:08.300 INFO:tasks.workunit.client.0.smithi043.stdout:0/631: symlink db/d1b/d23/d27/d39/d4c/ld6 0 2024-04-25T13:47:08.301 INFO:tasks.workunit.client.0.smithi043.stdout:0/632: write db/d25/f2b [1371603,88311] 0 2024-04-25T13:47:08.305 INFO:tasks.workunit.client.0.smithi043.stdout:6/682: link d0/d1c/le4 d0/d90/d48/d9d/le5 0 2024-04-25T13:47:08.315 INFO:tasks.workunit.client.0.smithi043.stdout:0/633: fdatasync db/d25/d2a/d3f/f42 0 2024-04-25T13:47:08.320 INFO:tasks.workunit.client.0.smithi043.stdout:0/634: link db/d1b/d94/d68/f9c db/d25/d2a/d3f/d6a/dd3/fd7 0 2024-04-25T13:47:08.321 INFO:tasks.workunit.client.0.smithi043.stdout:6/683: dread d0/d3d/d54/f57 [0,4194304] 0 2024-04-25T13:47:08.322 INFO:tasks.workunit.client.0.smithi043.stdout:0/635: unlink db/d1b/d36/d41/l6d 0 2024-04-25T13:47:08.324 INFO:tasks.workunit.client.0.smithi043.stdout:6/684: creat d0/d3d/fe6 x:0 0 0 2024-04-25T13:47:08.325 INFO:tasks.workunit.client.0.smithi043.stdout:0/636: creat db/d1b/fd8 x:0 0 0 2024-04-25T13:47:08.326 INFO:tasks.workunit.client.0.smithi043.stdout:6/685: fsync d0/d3d/d54/f57 0 2024-04-25T13:47:08.333 INFO:tasks.workunit.client.0.smithi043.stdout:0/637: symlink db/d25/d2a/d9d/ld9 0 2024-04-25T13:47:08.335 INFO:tasks.workunit.client.0.smithi043.stdout:0/638: symlink db/d1b/d36/lda 0 2024-04-25T13:47:08.339 INFO:tasks.workunit.client.0.smithi043.stdout:6/686: write d0/d76/de3/f89 [3840209,118957] 0 2024-04-25T13:47:08.341 INFO:tasks.workunit.client.0.smithi043.stdout:6/687: getdents d0/d3d/dc9 0 2024-04-25T13:47:08.344 INFO:tasks.workunit.client.0.smithi043.stdout:6/688: creat d0/d76/de3/d64/da1/da3/fe7 x:0 0 0 2024-04-25T13:47:08.346 INFO:tasks.workunit.client.0.smithi043.stdout:6/689: read d0/d90/d48/d73/f80 [14855,128022] 0 2024-04-25T13:47:08.354 INFO:tasks.workunit.client.0.smithi043.stdout:0/639: write db/d1b/d23/d27/d39/d4b/fa8 [2096774,102254] 0 2024-04-25T13:47:08.354 INFO:tasks.workunit.client.0.smithi043.stdout:6/690: creat d0/d76/de3/da7/fe8 x:0 0 0 2024-04-25T13:47:08.355 INFO:tasks.workunit.client.0.smithi043.stdout:3/606: rename d0/d13/d2e/f31 to d0/d9/d6e/d34/d36/fd3 0 2024-04-25T13:47:08.357 INFO:tasks.workunit.client.0.smithi043.stdout:0/640: write db/d25/f2b [58926,79356] 0 2024-04-25T13:47:08.357 INFO:tasks.workunit.client.0.smithi043.stdout:6/691: read d0/fbe [580993,82330] 0 2024-04-25T13:47:08.358 INFO:tasks.workunit.client.0.smithi043.stdout:0/641: chown db/d1b/d23/d27/d39/d4c/da9/fac 10864 1 2024-04-25T13:47:08.363 INFO:tasks.workunit.client.0.smithi043.stdout:6/692: readlink d0/d76/l78 0 2024-04-25T13:47:08.364 INFO:tasks.workunit.client.0.smithi043.stdout:3/607: dwrite d0/da/db9/d9e/fc4 [0,4194304] 0 2024-04-25T13:47:08.364 INFO:tasks.workunit.client.0.smithi043.stdout:6/693: fdatasync d0/d90/d4c/f6f 0 2024-04-25T13:47:08.365 INFO:tasks.workunit.client.0.smithi043.stdout:6/694: dread - d0/d1b/fcc zero size 2024-04-25T13:47:08.366 INFO:tasks.workunit.client.0.smithi043.stdout:6/695: fsync d0/d3d/d6e/f86 0 2024-04-25T13:47:08.368 INFO:tasks.workunit.client.0.smithi043.stdout:6/696: truncate d0/d90/d48/d9d/fc5 811445 0 2024-04-25T13:47:08.368 INFO:tasks.workunit.client.0.smithi043.stdout:3/608: unlink d0/d61/d82/cc8 0 2024-04-25T13:47:08.374 INFO:tasks.workunit.client.0.smithi043.stdout:3/609: dwrite d0/d13/d2e/f76 [0,4194304] 0 2024-04-25T13:47:08.379 INFO:tasks.workunit.client.0.smithi043.stdout:3/610: chown d0/d9/d6e/l16 217104866 1 2024-04-25T13:47:08.380 INFO:tasks.workunit.client.0.smithi043.stdout:3/611: write d0/d13/f73 [657084,125213] 0 2024-04-25T13:47:08.381 INFO:tasks.workunit.client.0.smithi043.stdout:3/612: chown d0/d9/d6e/d38 66736 1 2024-04-25T13:47:08.382 INFO:tasks.workunit.client.0.smithi043.stdout:3/613: write d0/d13/d2e/fca [141012,109026] 0 2024-04-25T13:47:08.386 INFO:tasks.workunit.client.0.smithi043.stdout:4/539: rename d1/de/df/d1a/d27 to d1/de/df/db4 0 2024-04-25T13:47:08.390 INFO:tasks.workunit.client.0.smithi043.stdout:3/614: truncate d0/f2a 5567043 0 2024-04-25T13:47:08.392 INFO:tasks.workunit.client.0.smithi043.stdout:3/615: mknod d0/d61/cd4 0 2024-04-25T13:47:08.392 INFO:tasks.workunit.client.0.smithi043.stdout:1/659: rename df/d14/d63/cb9 to df/d31/d38/d43/d81/cef 0 2024-04-25T13:47:08.392 INFO:tasks.workunit.client.0.smithi043.stdout:5/570: rename d1/d3/d7 to d1/d3/d7/d2f/dc1 22 2024-04-25T13:47:08.393 INFO:tasks.workunit.client.0.smithi043.stdout:4/540: stat d1/de/df/db4/d36/d9e/d9d/f5f 0 2024-04-25T13:47:08.397 INFO:tasks.workunit.client.0.smithi043.stdout:5/571: creat d1/d3/d7/d8/fc2 x:0 0 0 2024-04-25T13:47:08.398 INFO:tasks.workunit.client.0.smithi043.stdout:5/572: write d1/d3/d7/d2f/d80/fbb [828955,62742] 0 2024-04-25T13:47:08.403 INFO:tasks.workunit.client.0.smithi043.stdout:4/541: mknod d1/d3/d54/d62/d77/d79/cb5 0 2024-04-25T13:47:08.405 INFO:tasks.workunit.client.0.smithi043.stdout:4/542: read d1/d3/f3e [145848,94738] 0 2024-04-25T13:47:08.406 INFO:tasks.workunit.client.0.smithi043.stdout:8/655: rename db/d44/d5c/c72 to db/dc/d21/d4e/d62/cd2 0 2024-04-25T13:47:08.407 INFO:tasks.workunit.client.0.smithi043.stdout:3/616: write d0/d9/d6e/f52 [3092956,115092] 0 2024-04-25T13:47:08.509 INFO:tasks.workunit.client.0.smithi043.stdout:7/759: rename d5/d11/d3b/d61/dc5/dee/d5a/f65 to d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/f101 0 2024-04-25T13:47:08.510 INFO:tasks.workunit.client.0.smithi043.stdout:8/656: readlink db/dc/d28/l4b 0 2024-04-25T13:47:08.510 INFO:tasks.workunit.client.0.smithi043.stdout:5/573: dwrite d1/d3/f81 [0,4194304] 0 2024-04-25T13:47:08.514 INFO:tasks.workunit.client.0.smithi043.stdout:8/657: dread - db/d11/d1b/fb2 zero size 2024-04-25T13:47:08.514 INFO:tasks.workunit.client.0.smithi043.stdout:7/760: fdatasync d5/d11/d3b/d61/dc5/dee/d5a/f5e 0 2024-04-25T13:47:08.515 INFO:tasks.workunit.client.0.smithi043.stdout:1/660: dwrite df/d14/d63/d67/fc5 [0,4194304] 0 2024-04-25T13:47:08.516 INFO:tasks.workunit.client.0.smithi043.stdout:5/574: symlink d1/d4/d42/lc3 0 2024-04-25T13:47:08.518 INFO:tasks.workunit.client.0.smithi043.stdout:8/658: symlink db/dc/d21/d4e/d62/da0/ld3 0 2024-04-25T13:47:08.518 INFO:tasks.workunit.client.0.smithi043.stdout:2/549: rename d0/d34/d3f/d7b/c83 to d0/d34/d17/da0/ca5 0 2024-04-25T13:47:08.520 INFO:tasks.workunit.client.0.smithi043.stdout:5/575: creat d1/d3/d7/d2f/d80/fc4 x:0 0 0 2024-04-25T13:47:08.520 INFO:tasks.workunit.client.0.smithi043.stdout:7/761: rmdir d5/d11/d3b/d61/d68 39 2024-04-25T13:47:08.520 INFO:tasks.workunit.client.0.smithi043.stdout:8/659: readlink db/dc/l3a 0 2024-04-25T13:47:08.521 INFO:tasks.workunit.client.0.smithi043.stdout:2/550: chown d0/d5/d1e/c99 417213 1 2024-04-25T13:47:08.521 INFO:tasks.workunit.client.0.smithi043.stdout:1/661: dread df/d14/d63/d71/f7c [0,4194304] 0 2024-04-25T13:47:08.522 INFO:tasks.workunit.client.0.smithi043.stdout:6/697: rename d0/d90/f8c to d0/d76/d5c/fe9 0 2024-04-25T13:47:08.525 INFO:tasks.workunit.client.0.smithi043.stdout:7/762: creat d5/d11/d3b/d61/dc5/dcc/f102 x:0 0 0 2024-04-25T13:47:08.526 INFO:tasks.workunit.client.0.smithi043.stdout:8/660: write db/d11/d1b/d8c/f99 [528636,128225] 0 2024-04-25T13:47:08.528 INFO:tasks.workunit.client.0.smithi043.stdout:6/698: truncate d0/d24/d3a/f98 1519209 0 2024-04-25T13:47:08.530 INFO:tasks.workunit.client.0.smithi043.stdout:8/661: symlink db/d7d/ld4 0 2024-04-25T13:47:08.532 INFO:tasks.workunit.client.0.smithi043.stdout:6/699: write d0/d24/f50 [1116813,14738] 0 2024-04-25T13:47:08.533 INFO:tasks.workunit.client.0.smithi043.stdout:6/700: stat d0/d76/de3/da7/fe8 0 2024-04-25T13:47:08.534 INFO:tasks.workunit.client.0.smithi043.stdout:2/551: getdents d0/d34/d3f/d59 0 2024-04-25T13:47:08.535 INFO:tasks.workunit.client.0.smithi043.stdout:8/662: readlink db/d11/d1b/d59/d7c/daf/lcd 0 2024-04-25T13:47:08.535 INFO:tasks.workunit.client.0.smithi043.stdout:6/701: readlink d0/d3d/d6e/d71/l83 0 2024-04-25T13:47:08.537 INFO:tasks.workunit.client.0.smithi043.stdout:6/702: fdatasync d0/fc8 0 2024-04-25T13:47:08.538 INFO:tasks.workunit.client.0.smithi043.stdout:8/663: read - db/d11/d1b/d59/fcf zero size 2024-04-25T13:47:08.538 INFO:tasks.workunit.client.0.smithi043.stdout:2/552: mknod d0/d8/d9b/ca6 0 2024-04-25T13:47:08.540 INFO:tasks.workunit.client.0.smithi043.stdout:8/664: write db/fc4 [205421,65619] 0 2024-04-25T13:47:08.541 INFO:tasks.workunit.client.0.smithi043.stdout:8/665: stat db/dc/d21/d4e 0 2024-04-25T13:47:08.543 INFO:tasks.workunit.client.0.smithi043.stdout:6/703: mknod d0/d76/de3/d64/da1/da3/cea 0 2024-04-25T13:47:08.543 INFO:tasks.workunit.client.0.smithi043.stdout:8/666: truncate db/d11/d1b/f6c 4200632 0 2024-04-25T13:47:08.544 INFO:tasks.workunit.client.0.smithi043.stdout:6/704: fdatasync d0/d76/de3/d64/da1/fcf 0 2024-04-25T13:47:08.546 INFO:tasks.workunit.client.0.smithi043.stdout:7/763: dread d5/d11/d8f/fc3 [0,4194304] 0 2024-04-25T13:47:08.546 INFO:tasks.workunit.client.0.smithi043.stdout:6/705: chown d0/d3d/d54/cda 77106005 1 2024-04-25T13:47:08.548 INFO:tasks.workunit.client.0.smithi043.stdout:5/576: dread d1/d3/d26/f27 [0,4194304] 0 2024-04-25T13:47:08.548 INFO:tasks.workunit.client.0.smithi043.stdout:8/667: symlink db/dc/d21/ld5 0 2024-04-25T13:47:08.549 INFO:tasks.workunit.client.0.smithi043.stdout:7/764: unlink d5/f6d 0 2024-04-25T13:47:08.550 INFO:tasks.workunit.client.0.smithi043.stdout:5/577: write d1/d3/d7/d8/df/d28/faf [1284158,100048] 0 2024-04-25T13:47:08.553 INFO:tasks.workunit.client.0.smithi043.stdout:7/765: mkdir d5/d103 0 2024-04-25T13:47:08.553 INFO:tasks.workunit.client.0.smithi043.stdout:1/662: read df/d31/d34/d8b/f6b [1245416,81119] 0 2024-04-25T13:47:08.556 INFO:tasks.workunit.client.0.smithi043.stdout:2/553: rmdir d0/d34/d17/da0 39 2024-04-25T13:47:08.556 INFO:tasks.workunit.client.0.smithi043.stdout:7/766: write d5/f82 [4230174,24137] 0 2024-04-25T13:47:08.560 INFO:tasks.workunit.client.0.smithi043.stdout:7/767: write d5/d11/d3b/d61/dc5/dee/d5a/fe5 [278247,46122] 0 2024-04-25T13:47:08.566 INFO:tasks.workunit.client.0.smithi043.stdout:5/578: truncate d1/d3/d26/f27 2069357 0 2024-04-25T13:47:08.566 INFO:tasks.workunit.client.0.smithi043.stdout:0/642: rename db/d1b/d23/d27/d39/d4c/d74/c85 to db/d25/d2a/d9d/cdb 0 2024-04-25T13:47:08.573 INFO:tasks.workunit.client.0.smithi043.stdout:1/663: dwrite df/d10/d22/f3a [0,4194304] 0 2024-04-25T13:47:08.576 INFO:tasks.workunit.client.0.smithi043.stdout:2/554: dwrite d0/d34/d17/d5e/d71/f85 [0,4194304] 0 2024-04-25T13:47:08.577 INFO:tasks.workunit.client.0.smithi043.stdout:7/768: truncate d5/f27 2764630 0 2024-04-25T13:47:08.578 INFO:tasks.workunit.client.0.smithi043.stdout:8/668: dread db/dc/d21/d4e/fab [0,4194304] 0 2024-04-25T13:47:08.580 INFO:tasks.workunit.client.0.smithi043.stdout:6/706: dread d0/d1b/d96/fa2 [4194304,4194304] 0 2024-04-25T13:47:08.581 INFO:tasks.workunit.client.0.smithi043.stdout:2/555: readlink d0/d5/d2f/l87 0 2024-04-25T13:47:08.582 INFO:tasks.workunit.client.0.smithi043.stdout:4/543: sync 2024-04-25T13:47:08.583 INFO:tasks.workunit.client.0.smithi043.stdout:3/617: rename d0/d9/l97 to d0/d61/d82/ld5 0 2024-04-25T13:47:08.585 INFO:tasks.workunit.client.0.smithi043.stdout:2/556: chown d0/f63 32 1 2024-04-25T13:47:08.586 INFO:tasks.workunit.client.0.smithi043.stdout:0/643: truncate db/d1b/d94/f83 411527 0 2024-04-25T13:47:08.588 INFO:tasks.workunit.client.0.smithi043.stdout:5/579: getdents d1/d4/d42 0 2024-04-25T13:47:08.592 INFO:tasks.workunit.client.0.smithi043.stdout:1/664: dread df/d14/d63/d67/fc5 [0,4194304] 0 2024-04-25T13:47:08.592 INFO:tasks.workunit.client.0.smithi043.stdout:7/769: truncate d5/d11/d3b/d61/dc5/dee/d5a/d89/f100 787202 0 2024-04-25T13:47:08.593 INFO:tasks.workunit.client.0.smithi043.stdout:8/669: dread - db/dc/d21/d4e/fb7 zero size 2024-04-25T13:47:08.594 INFO:tasks.workunit.client.0.smithi043.stdout:4/544: fdatasync d1/de/df/d1e/d45/f9f 0 2024-04-25T13:47:08.595 INFO:tasks.workunit.client.0.smithi043.stdout:6/707: unlink d0/l39 0 2024-04-25T13:47:08.599 INFO:tasks.workunit.client.0.smithi043.stdout:0/644: mknod db/d1b/d62/d72/da2/cdc 0 2024-04-25T13:47:08.600 INFO:tasks.workunit.client.0.smithi043.stdout:1/665: symlink df/d31/d38/d43/d6e/dea/lf0 0 2024-04-25T13:47:08.602 INFO:tasks.workunit.client.0.smithi043.stdout:7/770: mknod d5/d11/db4/c104 0 2024-04-25T13:47:08.604 INFO:tasks.workunit.client.0.smithi043.stdout:5/580: dread d1/d3/d26/f27 [0,4194304] 0 2024-04-25T13:47:08.605 INFO:tasks.workunit.client.0.smithi043.stdout:1/666: creat df/d10/d22/d2f/ff1 x:0 0 0 2024-04-25T13:47:08.607 INFO:tasks.workunit.client.0.smithi043.stdout:5/581: chown d1/d3/d7/d9/d2d/d5b/fa5 62848162 1 2024-04-25T13:47:08.608 INFO:tasks.workunit.client.0.smithi043.stdout:4/545: rename d1/de/df/db4/d36/d9e/d7c/f95 to d1/de/df/db4/d36/d53/fb6 0 2024-04-25T13:47:08.610 INFO:tasks.workunit.client.0.smithi043.stdout:3/618: unlink d0/d9/d6e/l9b 0 2024-04-25T13:47:08.612 INFO:tasks.workunit.client.0.smithi043.stdout:7/771: fsync d5/d11/d3b/d61/d68/f77 0 2024-04-25T13:47:08.614 INFO:tasks.workunit.client.0.smithi043.stdout:1/667: readlink df/d14/l1a 0 2024-04-25T13:47:08.615 INFO:tasks.workunit.client.0.smithi043.stdout:6/708: creat d0/d24/feb x:0 0 0 2024-04-25T13:47:08.618 INFO:tasks.workunit.client.0.smithi043.stdout:5/582: dwrite d1/d3/d7/d2f/d67/f8a [0,4194304] 0 2024-04-25T13:47:08.621 INFO:tasks.workunit.client.0.smithi043.stdout:7/772: unlink d5/d11/d3b/d61/dc5/dee/d5a/lbb 0 2024-04-25T13:47:08.622 INFO:tasks.workunit.client.0.smithi043.stdout:5/583: chown d1/d3/d7/d9/d2d/faa 5 1 2024-04-25T13:47:08.625 INFO:tasks.workunit.client.0.smithi043.stdout:0/645: dread db/d1b/d23/d27/d39/d4c/da9/fac [0,4194304] 0 2024-04-25T13:47:08.625 INFO:tasks.workunit.client.0.smithi043.stdout:5/584: fsync d1/d4/d42/fa9 0 2024-04-25T13:47:08.629 INFO:tasks.workunit.client.0.smithi043.stdout:4/546: dwrite d1/de/df/f40 [0,4194304] 0 2024-04-25T13:47:08.641 INFO:tasks.workunit.client.0.smithi043.stdout:7/773: creat d5/d11/d3b/d61/dc5/f105 x:0 0 0 2024-04-25T13:47:08.641 INFO:tasks.workunit.client.0.smithi043.stdout:3/619: dread d0/f4 [0,4194304] 0 2024-04-25T13:47:08.641 INFO:tasks.workunit.client.0.smithi043.stdout:8/670: link db/d11/d1b/fb2 db/dc/d80/fd6 0 2024-04-25T13:47:08.646 INFO:tasks.workunit.client.0.smithi043.stdout:8/671: dread - db/dc/d21/d4e/fce zero size 2024-04-25T13:47:08.647 INFO:tasks.workunit.client.0.smithi043.stdout:3/620: mknod d0/d8d/cd6 0 2024-04-25T13:47:08.648 INFO:tasks.workunit.client.0.smithi043.stdout:0/646: getdents db/d1b/d23/d27/d39/d4c/d74 0 2024-04-25T13:47:08.649 INFO:tasks.workunit.client.0.smithi043.stdout:2/557: dread d0/d34/f20 [0,4194304] 0 2024-04-25T13:47:08.651 INFO:tasks.workunit.client.0.smithi043.stdout:6/709: dwrite d0/fc [0,4194304] 0 2024-04-25T13:47:08.651 INFO:tasks.workunit.client.0.smithi043.stdout:7/774: write d5/d11/d3b/d61/dc5/dcc/f102 [634182,41623] 0 2024-04-25T13:47:08.651 INFO:tasks.workunit.client.0.smithi043.stdout:4/547: rename d1/de/df/d1a/f73 to d1/fb7 0 2024-04-25T13:47:08.652 INFO:tasks.workunit.client.0.smithi043.stdout:1/668: dread df/d31/d34/d8b/fa4 [0,4194304] 0 2024-04-25T13:47:08.653 INFO:tasks.workunit.client.0.smithi043.stdout:8/672: mkdir db/d38/d77/dd7 0 2024-04-25T13:47:08.655 INFO:tasks.workunit.client.0.smithi043.stdout:3/621: fdatasync d0/fe 0 2024-04-25T13:47:08.656 INFO:tasks.workunit.client.0.smithi043.stdout:2/558: mknod d0/d34/d3f/d59/ca7 0 2024-04-25T13:47:08.665 INFO:tasks.workunit.client.0.smithi043.stdout:4/548: rename d1/de/df/l10 to d1/de/df/d1e/d45/da1/db3/lb8 0 2024-04-25T13:47:08.665 INFO:tasks.workunit.client.0.smithi043.stdout:2/559: creat d0/d34/d17/d5e/d71/d81/fa8 x:0 0 0 2024-04-25T13:47:08.667 INFO:tasks.workunit.client.0.smithi043.stdout:0/647: dwrite db/d1b/d23/d27/d39/d4c/f70 [0,4194304] 0 2024-04-25T13:47:08.667 INFO:tasks.workunit.client.0.smithi043.stdout:6/710: dwrite d0/d90/d48/fdb [0,4194304] 0 2024-04-25T13:47:08.667 INFO:tasks.workunit.client.0.smithi043.stdout:1/669: creat df/d14/d3d/ff2 x:0 0 0 2024-04-25T13:47:08.669 INFO:tasks.workunit.client.0.smithi043.stdout:6/711: fsync d0/d1b/fdf 0 2024-04-25T13:47:08.672 INFO:tasks.workunit.client.0.smithi043.stdout:0/648: truncate db/d25/f46 1801914 0 2024-04-25T13:47:08.672 INFO:tasks.workunit.client.0.smithi043.stdout:2/560: rmdir d0/d34/d3f/d46/d55 39 2024-04-25T13:47:08.672 INFO:tasks.workunit.client.0.smithi043.stdout:5/585: dread d1/d3/d7/d8/da/d11/d52/f8c [0,4194304] 0 2024-04-25T13:47:08.674 INFO:tasks.workunit.client.0.smithi043.stdout:5/586: stat d1/d3/d7/d8/da/f88 0 2024-04-25T13:47:08.674 INFO:tasks.workunit.client.0.smithi043.stdout:3/622: write d0/d9/d6e/d34/d36/f9a [1796151,78345] 0 2024-04-25T13:47:08.675 INFO:tasks.workunit.client.0.smithi043.stdout:4/549: creat d1/d3/d54/d62/d77/fb9 x:0 0 0 2024-04-25T13:47:08.680 INFO:tasks.workunit.client.0.smithi043.stdout:3/623: mkdir d0/d13/dbe/dd7 0 2024-04-25T13:47:08.681 INFO:tasks.workunit.client.0.smithi043.stdout:0/649: symlink db/d1b/d62/ldd 0 2024-04-25T13:47:08.684 INFO:tasks.workunit.client.0.smithi043.stdout:6/712: link d0/d3d/d54/f9f d0/d90/d4c/fec 0 2024-04-25T13:47:08.687 INFO:tasks.workunit.client.0.smithi043.stdout:5/587: write d1/d3/d62/f9c [662631,108540] 0 2024-04-25T13:47:08.690 INFO:tasks.workunit.client.0.smithi043.stdout:6/713: dread d0/d3d/d54/f68 [0,4194304] 0 2024-04-25T13:47:08.693 INFO:tasks.workunit.client.0.smithi043.stdout:6/714: fdatasync d0/f16 0 2024-04-25T13:47:08.693 INFO:tasks.workunit.client.0.smithi043.stdout:6/715: stat d0/d76/de3/d64/da1/da3/cea 0 2024-04-25T13:47:08.695 INFO:tasks.workunit.client.0.smithi043.stdout:8/673: link db/d46/f8f db/d38/d40/fd8 0 2024-04-25T13:47:08.695 INFO:tasks.workunit.client.0.smithi043.stdout:8/674: fsync db/d44/d8e/f56 0 2024-04-25T13:47:08.696 INFO:tasks.workunit.client.0.smithi043.stdout:5/588: creat d1/d3/d7/d9/d2d/fc5 x:0 0 0 2024-04-25T13:47:08.697 INFO:tasks.workunit.client.0.smithi043.stdout:2/561: write d0/d26/f33 [4402833,45339] 0 2024-04-25T13:47:08.697 INFO:tasks.workunit.client.0.smithi043.stdout:0/650: truncate db/d1b/d23/d27/d39/d4c/f8e 1549184 0 2024-04-25T13:47:08.699 INFO:tasks.workunit.client.0.smithi043.stdout:2/562: truncate d0/d26/f40 392894 0 2024-04-25T13:47:08.700 INFO:tasks.workunit.client.0.smithi043.stdout:2/563: write d0/d34/d77/f95 [1019620,113494] 0 2024-04-25T13:47:08.700 INFO:tasks.workunit.client.0.smithi043.stdout:6/716: mknod d0/d76/d5c/ced 0 2024-04-25T13:47:08.701 INFO:tasks.workunit.client.0.smithi043.stdout:2/564: stat d0/d5/c9e 0 2024-04-25T13:47:08.703 INFO:tasks.workunit.client.0.smithi043.stdout:5/589: rmdir d1/d4/d92/d95 39 2024-04-25T13:47:08.706 INFO:tasks.workunit.client.0.smithi043.stdout:5/590: write d1/d3/d7/d9/d2d/f72 [1455533,51239] 0 2024-04-25T13:47:08.706 INFO:tasks.workunit.client.0.smithi043.stdout:4/550: truncate d1/de/df/db4/d36/d9e/d9d/d3a/f4d 259367 0 2024-04-25T13:47:08.709 INFO:tasks.workunit.client.0.smithi043.stdout:1/670: creat df/d14/d63/d67/da7/ff3 x:0 0 0 2024-04-25T13:47:08.710 INFO:tasks.workunit.client.0.smithi043.stdout:2/565: dwrite d0/d26/f31 [0,4194304] 0 2024-04-25T13:47:08.713 INFO:tasks.workunit.client.0.smithi043.stdout:1/671: fdatasync df/d31/d38/d43/d81/fe5 0 2024-04-25T13:47:08.716 INFO:tasks.workunit.client.0.smithi043.stdout:2/566: write d0/d5/d1e/f52 [1118405,101442] 0 2024-04-25T13:47:08.719 INFO:tasks.workunit.client.0.smithi043.stdout:3/624: rename d0/d9/d81/f8c to d0/d9/d6e/d38/fd8 0 2024-04-25T13:47:08.720 INFO:tasks.workunit.client.0.smithi043.stdout:1/672: mknod df/d31/cf4 0 2024-04-25T13:47:08.720 INFO:tasks.workunit.client.0.smithi043.stdout:2/567: dread - d0/d8/d22/f6d zero size 2024-04-25T13:47:08.722 INFO:tasks.workunit.client.0.smithi043.stdout:5/591: dwrite d1/d4/f7a [0,4194304] 0 2024-04-25T13:47:08.722 INFO:tasks.workunit.client.0.smithi043.stdout:4/551: read d1/de/df/f18 [4105309,108920] 0 2024-04-25T13:47:08.727 INFO:tasks.workunit.client.0.smithi043.stdout:4/552: chown d1/de/df/db4/d36/d53 18255707 1 2024-04-25T13:47:08.727 INFO:tasks.workunit.client.0.smithi043.stdout:3/625: dread - d0/d9/d6e/d34/f8b zero size 2024-04-25T13:47:08.727 INFO:tasks.workunit.client.0.smithi043.stdout:1/673: write df/d14/d63/d67/f75 [2009663,13389] 0 2024-04-25T13:47:08.730 INFO:tasks.workunit.client.0.smithi043.stdout:5/592: chown d1/d3/d7/d2f/d67/l58 6 1 2024-04-25T13:47:08.732 INFO:tasks.workunit.client.0.smithi043.stdout:0/651: dread f8 [4194304,4194304] 0 2024-04-25T13:47:08.733 INFO:tasks.workunit.client.0.smithi043.stdout:8/675: dwrite db/d44/d5c/f9e [0,4194304] 0 2024-04-25T13:47:08.735 INFO:tasks.workunit.client.0.smithi043.stdout:3/626: chown d0/d9/ca3 26049031 1 2024-04-25T13:47:08.737 INFO:tasks.workunit.client.0.smithi043.stdout:5/593: fdatasync d1/d4/d92/d95/fbc 0 2024-04-25T13:47:08.739 INFO:tasks.workunit.client.0.smithi043.stdout:7/775: dread d5/d11/f19 [0,4194304] 0 2024-04-25T13:47:08.740 INFO:tasks.workunit.client.0.smithi043.stdout:7/776: chown d5/d11/d84/fc4 10191059 1 2024-04-25T13:47:08.741 INFO:tasks.workunit.client.0.smithi043.stdout:0/652: mkdir db/d1b/d23/d27/d39/d4b/dde 0 2024-04-25T13:47:08.743 INFO:tasks.workunit.client.0.smithi043.stdout:8/676: truncate db/d44/d5c/f9e 1911614 0 2024-04-25T13:47:08.744 INFO:tasks.workunit.client.0.smithi043.stdout:7/777: creat d5/d11/d84/f106 x:0 0 0 2024-04-25T13:47:08.746 INFO:tasks.workunit.client.0.smithi043.stdout:3/627: mkdir d0/d13/d55/dd9 0 2024-04-25T13:47:08.746 INFO:tasks.workunit.client.0.smithi043.stdout:5/594: getdents d1/d3/d7/d2f/d80 0 2024-04-25T13:47:08.747 INFO:tasks.workunit.client.0.smithi043.stdout:0/653: dread db/d1b/f22 [0,4194304] 0 2024-04-25T13:47:08.747 INFO:tasks.workunit.client.0.smithi043.stdout:7/778: read d5/d11/f26 [204549,100099] 0 2024-04-25T13:47:08.748 INFO:tasks.workunit.client.0.smithi043.stdout:1/674: rename df/d31/d34/l77 to df/d14/d63/lf5 0 2024-04-25T13:47:08.748 INFO:tasks.workunit.client.0.smithi043.stdout:8/677: mkdir db/d38/d3c/dd9 0 2024-04-25T13:47:08.748 INFO:tasks.workunit.client.0.smithi043.stdout:5/595: stat d1/d3/d7/d2f/d67/l58 0 2024-04-25T13:47:08.749 INFO:tasks.workunit.client.0.smithi043.stdout:3/628: chown d0/da/l5b 10190 1 2024-04-25T13:47:08.750 INFO:tasks.workunit.client.0.smithi043.stdout:0/654: unlink db/d1b/d23/l32 0 2024-04-25T13:47:08.751 INFO:tasks.workunit.client.0.smithi043.stdout:1/675: read - df/d31/d38/f61 zero size 2024-04-25T13:47:08.751 INFO:tasks.workunit.client.0.smithi043.stdout:5/596: fsync d1/d3/d7/d8/da/f88 0 2024-04-25T13:47:08.752 INFO:tasks.workunit.client.0.smithi043.stdout:8/678: creat db/d38/d3c/d71/d5d/fda x:0 0 0 2024-04-25T13:47:08.754 INFO:tasks.workunit.client.0.smithi043.stdout:3/629: fdatasync d0/d9/f86 0 2024-04-25T13:47:08.754 INFO:tasks.workunit.client.0.smithi043.stdout:7/779: chown d5/d11/d3b/d61/dc5/dee/d5a/f76 685481 1 2024-04-25T13:47:08.756 INFO:tasks.workunit.client.0.smithi043.stdout:3/630: write d0/f96 [414901,25120] 0 2024-04-25T13:47:08.759 INFO:tasks.workunit.client.0.smithi043.stdout:7/780: write d5/d75/f66 [1811533,59] 0 2024-04-25T13:47:08.760 INFO:tasks.workunit.client.0.smithi043.stdout:1/676: truncate df/d10/d22/d2f/d9c/d41/fb4 419194 0 2024-04-25T13:47:08.762 INFO:tasks.workunit.client.0.smithi043.stdout:4/553: dread d1/de/df/db4/f78 [0,4194304] 0 2024-04-25T13:47:08.762 INFO:tasks.workunit.client.0.smithi043.stdout:5/597: rename d1/d3/d7/f76 to d1/d3/d7/d8/da/fc6 0 2024-04-25T13:47:08.764 INFO:tasks.workunit.client.0.smithi043.stdout:0/655: dwrite db/fc [0,4194304] 0 2024-04-25T13:47:08.764 INFO:tasks.workunit.client.0.smithi043.stdout:3/631: mknod d0/da/db9/d9e/cda 0 2024-04-25T13:47:08.765 INFO:tasks.workunit.client.0.smithi043.stdout:7/781: chown d5/d11/db4/lda 148816 1 2024-04-25T13:47:08.767 INFO:tasks.workunit.client.0.smithi043.stdout:5/598: readlink d1/d4/d42/l99 0 2024-04-25T13:47:08.767 INFO:tasks.workunit.client.0.smithi043.stdout:6/717: fdatasync d0/d76/de3/d64/f6d 0 2024-04-25T13:47:08.768 INFO:tasks.workunit.client.0.smithi043.stdout:3/632: stat d0/d9/d6e/d34 0 2024-04-25T13:47:08.769 INFO:tasks.workunit.client.0.smithi043.stdout:4/554: mkdir d1/d3/d54/d62/dba 0 2024-04-25T13:47:08.770 INFO:tasks.workunit.client.0.smithi043.stdout:5/599: fdatasync d1/d4/f68 0 2024-04-25T13:47:08.772 INFO:tasks.workunit.client.0.smithi043.stdout:8/679: dwrite db/d11/d1b/d59/d7c/daf/fc2 [0,4194304] 0 2024-04-25T13:47:08.776 INFO:tasks.workunit.client.0.smithi043.stdout:6/718: unlink d0/d1b/fcc 0 2024-04-25T13:47:08.776 INFO:tasks.workunit.client.0.smithi043.stdout:3/633: chown d0/d9/d81/d8e/d92/dc3 63 1 2024-04-25T13:47:08.777 INFO:tasks.workunit.client.0.smithi043.stdout:5/600: truncate d1/d3/d7/d9/d2d/f94 298688 0 2024-04-25T13:47:08.778 INFO:tasks.workunit.client.0.smithi043.stdout:4/555: truncate d1/d3/d54/d62/d77/fb9 777852 0 2024-04-25T13:47:08.778 INFO:tasks.workunit.client.0.smithi043.stdout:6/719: creat d0/d1b/fee x:0 0 0 2024-04-25T13:47:08.782 INFO:tasks.workunit.client.0.smithi043.stdout:5/601: chown d1/d3/d7/d8/da/d11/ca7 22246 1 2024-04-25T13:47:08.783 INFO:tasks.workunit.client.0.smithi043.stdout:8/680: mknod db/dc/d21/d4e/d62/cdb 0 2024-04-25T13:47:08.783 INFO:tasks.workunit.client.0.smithi043.stdout:7/782: dwrite d5/d11/db4/fca [0,4194304] 0 2024-04-25T13:47:08.786 INFO:tasks.workunit.client.0.smithi043.stdout:3/634: creat d0/da/db9/fdb x:0 0 0 2024-04-25T13:47:08.790 INFO:tasks.workunit.client.0.smithi043.stdout:7/783: write d5/d11/f26 [2886995,29171] 0 2024-04-25T13:47:08.792 INFO:tasks.workunit.client.0.smithi043.stdout:8/681: truncate db/d38/d40/f9d 464622 0 2024-04-25T13:47:08.794 INFO:tasks.workunit.client.0.smithi043.stdout:6/720: dwrite d0/f5d [0,4194304] 0 2024-04-25T13:47:08.795 INFO:tasks.workunit.client.0.smithi043.stdout:8/682: read - db/d38/d3c/d71/d5d/d67/fca zero size 2024-04-25T13:47:08.796 INFO:tasks.workunit.client.0.smithi043.stdout:6/721: stat d0/d1c/f3b 0 2024-04-25T13:47:08.797 INFO:tasks.workunit.client.0.smithi043.stdout:5/602: link d1/d3/d7/c7b d1/cc7 0 2024-04-25T13:47:08.801 INFO:tasks.workunit.client.0.smithi043.stdout:6/722: symlink d0/d3d/d6e/lef 0 2024-04-25T13:47:08.804 INFO:tasks.workunit.client.0.smithi043.stdout:6/723: dread - d0/d76/d5c/f75 zero size 2024-04-25T13:47:08.806 INFO:tasks.workunit.client.0.smithi043.stdout:1/677: dread df/d31/d34/fba [0,4194304] 0 2024-04-25T13:47:08.807 INFO:tasks.workunit.client.0.smithi043.stdout:8/683: dwrite db/d11/f17 [4194304,4194304] 0 2024-04-25T13:47:08.809 INFO:tasks.workunit.client.0.smithi043.stdout:6/724: mknod d0/d90/d4c/cf0 0 2024-04-25T13:47:08.811 INFO:tasks.workunit.client.0.smithi043.stdout:3/635: readlink d0/da/db9/d9e/ld2 0 2024-04-25T13:47:08.814 INFO:tasks.workunit.client.0.smithi043.stdout:6/725: creat d0/d76/de3/dd6/ff1 x:0 0 0 2024-04-25T13:47:08.815 INFO:tasks.workunit.client.0.smithi043.stdout:6/726: readlink d0/d24/d3a/lbb 0 2024-04-25T13:47:08.815 INFO:tasks.workunit.client.0.smithi043.stdout:8/684: read db/d7d/f9b [19377,41680] 0 2024-04-25T13:47:08.817 INFO:tasks.workunit.client.0.smithi043.stdout:6/727: chown d0/d76/de3/da7/fde 6 1 2024-04-25T13:47:08.824 INFO:tasks.workunit.client.0.smithi043.stdout:6/728: rmdir d0/d76/d5c 39 2024-04-25T13:47:08.825 INFO:tasks.workunit.client.0.smithi043.stdout:8/685: rmdir db/d11 39 2024-04-25T13:47:08.829 INFO:tasks.workunit.client.0.smithi043.stdout:4/556: rename d1/de/df/db4/d36/d53/d66/f75 to d1/de/df/db4/d36/d9e/d9d/fbb 0 2024-04-25T13:47:08.832 INFO:tasks.workunit.client.0.smithi043.stdout:7/784: dread d5/f81 [4194304,4194304] 0 2024-04-25T13:47:08.833 INFO:tasks.workunit.client.0.smithi043.stdout:8/686: fsync db/d44/d8e/d27/f75 0 2024-04-25T13:47:08.836 INFO:tasks.workunit.client.0.smithi043.stdout:1/678: dread df/d10/d22/f5b [0,4194304] 0 2024-04-25T13:47:08.838 INFO:tasks.workunit.client.0.smithi043.stdout:8/687: mknod db/d38/d3c/d71/d5d/cdc 0 2024-04-25T13:47:08.839 INFO:tasks.workunit.client.0.smithi043.stdout:6/729: dwrite d0/d76/de3/d64/da1/fcf [0,4194304] 0 2024-04-25T13:47:08.839 INFO:tasks.workunit.client.0.smithi043.stdout:1/679: symlink df/d31/lf6 0 2024-04-25T13:47:08.839 INFO:tasks.workunit.client.0.smithi043.stdout:3/636: dread d0/d9/f62 [0,4194304] 0 2024-04-25T13:47:08.840 INFO:tasks.workunit.client.0.smithi043.stdout:4/557: getdents d1/de/d1d/d20 0 2024-04-25T13:47:08.841 INFO:tasks.workunit.client.0.smithi043.stdout:8/688: readlink db/dc/d28/l8d 0 2024-04-25T13:47:08.842 INFO:tasks.workunit.client.0.smithi043.stdout:6/730: chown d0/d76/d5c/f7d 7023175 1 2024-04-25T13:47:08.842 INFO:tasks.workunit.client.0.smithi043.stdout:3/637: chown d0/d9/d6e/d38/d3f/f42 2172383 1 2024-04-25T13:47:08.843 INFO:tasks.workunit.client.0.smithi043.stdout:1/680: unlink df/d10/d22/c27 0 2024-04-25T13:47:08.844 INFO:tasks.workunit.client.0.smithi043.stdout:3/638: dread - d0/d13/d2e/db1/fd1 zero size 2024-04-25T13:47:08.845 INFO:tasks.workunit.client.0.smithi043.stdout:8/689: mknod db/d11/d79/cdd 0 2024-04-25T13:47:08.848 INFO:tasks.workunit.client.0.smithi043.stdout:4/558: write d1/de/df/f16 [2696714,51765] 0 2024-04-25T13:47:08.849 INFO:tasks.workunit.client.0.smithi043.stdout:3/639: symlink d0/d61/d82/ldc 0 2024-04-25T13:47:08.849 INFO:tasks.workunit.client.0.smithi043.stdout:1/681: write df/d31/d38/d43/f57 [2024931,32371] 0 2024-04-25T13:47:08.851 INFO:tasks.workunit.client.0.smithi043.stdout:8/690: symlink db/d38/d77/lde 0 2024-04-25T13:47:08.856 INFO:tasks.workunit.client.0.smithi043.stdout:3/640: rmdir d0/d13/dbe 39 2024-04-25T13:47:08.857 INFO:tasks.workunit.client.0.smithi043.stdout:8/691: chown db/d11/f15 32 1 2024-04-25T13:47:08.858 INFO:tasks.workunit.client.0.smithi043.stdout:1/682: read df/d31/d34/f9d [3245860,70014] 0 2024-04-25T13:47:08.859 INFO:tasks.workunit.client.0.smithi043.stdout:3/641: chown d0/d9/d6e/dc5 7 1 2024-04-25T13:47:08.859 INFO:tasks.workunit.client.0.smithi043.stdout:6/731: dwrite d0/d90/d4c/fec [0,4194304] 0 2024-04-25T13:47:08.860 INFO:tasks.workunit.client.0.smithi043.stdout:6/732: fdatasync d0/d1b/d88/fca 0 2024-04-25T13:47:08.861 INFO:tasks.workunit.client.0.smithi043.stdout:4/559: mknod d1/de/df/d1e/d45/da1/db3/cbc 0 2024-04-25T13:47:08.862 INFO:tasks.workunit.client.0.smithi043.stdout:8/692: fsync db/d44/d8e/f42 0 2024-04-25T13:47:08.862 INFO:tasks.workunit.client.0.smithi043.stdout:1/683: write df/d31/d34/fba [2529395,91108] 0 2024-04-25T13:47:08.864 INFO:tasks.workunit.client.0.smithi043.stdout:1/684: stat df/d10/f76 0 2024-04-25T13:47:08.865 INFO:tasks.workunit.client.0.smithi043.stdout:7/785: dread d5/d11/d84/fb2 [0,4194304] 0 2024-04-25T13:47:08.866 INFO:tasks.workunit.client.0.smithi043.stdout:4/560: mknod d1/d34/cbd 0 2024-04-25T13:47:08.866 INFO:tasks.workunit.client.0.smithi043.stdout:8/693: rmdir db/dc/d21/d4e/d62/da0 39 2024-04-25T13:47:08.867 INFO:tasks.workunit.client.0.smithi043.stdout:7/786: fdatasync d5/fb1 0 2024-04-25T13:47:08.869 INFO:tasks.workunit.client.0.smithi043.stdout:7/787: fdatasync d5/d11/d8f/fa7 0 2024-04-25T13:47:08.869 INFO:tasks.workunit.client.0.smithi043.stdout:1/685: symlink df/d31/d38/d43/d6e/dea/lf7 0 2024-04-25T13:47:08.870 INFO:tasks.workunit.client.0.smithi043.stdout:3/642: dread d0/d61/d82/fac [0,4194304] 0 2024-04-25T13:47:08.871 INFO:tasks.workunit.client.0.smithi043.stdout:4/561: write d1/d3/d54/d62/d77/d92/f9b [965186,82511] 0 2024-04-25T13:47:08.873 INFO:tasks.workunit.client.0.smithi043.stdout:6/733: dwrite d0/d1c/fb1 [4194304,4194304] 0 2024-04-25T13:47:08.873 INFO:tasks.workunit.client.0.smithi043.stdout:3/643: dread - d0/d13/d2e/db1/fd1 zero size 2024-04-25T13:47:08.875 INFO:tasks.workunit.client.0.smithi043.stdout:8/694: creat db/dc/d21/fdf x:0 0 0 2024-04-25T13:47:08.875 INFO:tasks.workunit.client.0.smithi043.stdout:1/686: mkdir df/d31/dc7/dc8/dd2/df8 0 2024-04-25T13:47:08.875 INFO:tasks.workunit.client.0.smithi043.stdout:4/562: creat d1/d6a/fbe x:0 0 0 2024-04-25T13:47:08.876 INFO:tasks.workunit.client.0.smithi043.stdout:6/734: creat d0/d76/de3/dd6/ff2 x:0 0 0 2024-04-25T13:47:08.877 INFO:tasks.workunit.client.0.smithi043.stdout:3/644: creat d0/d61/d82/fdd x:0 0 0 2024-04-25T13:47:08.878 INFO:tasks.workunit.client.0.smithi043.stdout:8/695: chown db/dc/d21/db4/lcc 46019 1 2024-04-25T13:47:08.878 INFO:tasks.workunit.client.0.smithi043.stdout:7/788: mknod d5/d11/d3b/d61/d68/dc0/c107 0 2024-04-25T13:47:08.881 INFO:tasks.workunit.client.0.smithi043.stdout:6/735: mkdir d0/d90/db0/df3 0 2024-04-25T13:47:08.883 INFO:tasks.workunit.client.0.smithi043.stdout:4/563: creat d1/d3/d54/d62/d77/fbf x:0 0 0 2024-04-25T13:47:08.883 INFO:tasks.workunit.client.0.smithi043.stdout:8/696: mknod db/dc/d21/dc7/ce0 0 2024-04-25T13:47:08.884 INFO:tasks.workunit.client.0.smithi043.stdout:3/645: truncate d0/d9/f23 117436 0 2024-04-25T13:47:08.885 INFO:tasks.workunit.client.0.smithi043.stdout:7/789: chown d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/f101 518023 1 2024-04-25T13:47:08.888 INFO:tasks.workunit.client.0.smithi043.stdout:8/697: rename db/d11/d1b/f6c to db/d46/fe1 0 2024-04-25T13:47:08.895 INFO:tasks.workunit.client.0.smithi043.stdout:1/687: truncate df/d14/d3d/d82/d8c/f92 2816358 0 2024-04-25T13:47:08.895 INFO:tasks.workunit.client.0.smithi043.stdout:4/564: write d1/de/df/d1a/f3c [172702,37503] 0 2024-04-25T13:47:08.895 INFO:tasks.workunit.client.0.smithi043.stdout:8/698: getdents db/d38/d3c/dd9 0 2024-04-25T13:47:08.897 INFO:tasks.workunit.client.0.smithi043.stdout:7/790: dwrite d5/d75/d54/fd7 [0,4194304] 0 2024-04-25T13:47:08.898 INFO:tasks.workunit.client.0.smithi043.stdout:3/646: dwrite d0/d61/d82/fac [0,4194304] 0 2024-04-25T13:47:08.900 INFO:tasks.workunit.client.0.smithi043.stdout:8/699: symlink db/d11/da1/le2 0 2024-04-25T13:47:08.900 INFO:tasks.workunit.client.0.smithi043.stdout:1/688: rmdir df/d14/d63/d71 39 2024-04-25T13:47:08.902 INFO:tasks.workunit.client.0.smithi043.stdout:1/689: chown df/d10/l86 138788 1 2024-04-25T13:47:08.902 INFO:tasks.workunit.client.0.smithi043.stdout:3/647: rmdir d0/d8d 39 2024-04-25T13:47:08.904 INFO:tasks.workunit.client.0.smithi043.stdout:1/690: readlink df/d31/d34/d8b/d39/l89 0 2024-04-25T13:47:08.904 INFO:tasks.workunit.client.0.smithi043.stdout:7/791: write d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/f101 [1212664,76113] 0 2024-04-25T13:47:08.909 INFO:tasks.workunit.client.0.smithi043.stdout:7/792: write d5/d11/d3b/f4b [925488,55094] 0 2024-04-25T13:47:08.910 INFO:tasks.workunit.client.0.smithi043.stdout:8/700: creat db/dc/d21/d4e/d62/fe3 x:0 0 0 2024-04-25T13:47:08.912 INFO:tasks.workunit.client.0.smithi043.stdout:3/648: readlink d0/d9/d81/d8e/d92/l24 0 2024-04-25T13:47:08.914 INFO:tasks.workunit.client.0.smithi043.stdout:7/793: symlink d5/d11/db4/l108 0 2024-04-25T13:47:08.915 INFO:tasks.workunit.client.0.smithi043.stdout:4/565: dread d1/d3/f3e [0,4194304] 0 2024-04-25T13:47:08.917 INFO:tasks.workunit.client.0.smithi043.stdout:7/794: dread - d5/d11/d3b/fc2 zero size 2024-04-25T13:47:08.920 INFO:tasks.workunit.client.0.smithi043.stdout:3/649: rmdir d0/d13/dbe 39 2024-04-25T13:47:08.921 INFO:tasks.workunit.client.0.smithi043.stdout:3/650: write d0/d9/f86 [2340964,5102] 0 2024-04-25T13:47:08.924 INFO:tasks.workunit.client.0.smithi043.stdout:1/691: dread df/d14/d3d/f84 [0,4194304] 0 2024-04-25T13:47:08.926 INFO:tasks.workunit.client.0.smithi043.stdout:3/651: truncate d0/d13/f27 3115160 0 2024-04-25T13:47:08.929 INFO:tasks.workunit.client.0.smithi043.stdout:3/652: truncate d0/f2a 6592160 0 2024-04-25T13:47:08.930 INFO:tasks.workunit.client.0.smithi043.stdout:4/566: write d1/de/df/db4/d36/d9e/d9d/d3a/f48 [2170913,123516] 0 2024-04-25T13:47:08.933 INFO:tasks.workunit.client.0.smithi043.stdout:3/653: truncate d0/d9/d6e/d34/d36/fc9 983548 0 2024-04-25T13:47:08.935 INFO:tasks.workunit.client.0.smithi043.stdout:3/654: chown d0/d9/f20 553 1 2024-04-25T13:47:08.936 INFO:tasks.workunit.client.0.smithi043.stdout:4/567: truncate d1/de/df/f18 2644024 0 2024-04-25T13:47:08.938 INFO:tasks.workunit.client.0.smithi043.stdout:4/568: rmdir d1/d34/d35 39 2024-04-25T13:47:08.939 INFO:tasks.workunit.client.0.smithi043.stdout:8/701: rename db/d11/d1b to db/d38/de4 0 2024-04-25T13:47:08.940 INFO:tasks.workunit.client.0.smithi043.stdout:8/702: dread - db/d44/d8e/fad zero size 2024-04-25T13:47:08.941 INFO:tasks.workunit.client.0.smithi043.stdout:8/703: write db/d46/da8/fd0 [656116,34799] 0 2024-04-25T13:47:08.945 INFO:tasks.workunit.client.0.smithi043.stdout:7/795: rename d5/d32/c60 to d5/d11/d3b/d61/dc5/dcc/df8/c109 0 2024-04-25T13:47:08.950 INFO:tasks.workunit.client.0.smithi043.stdout:7/796: chown d5/fd 466780 1 2024-04-25T13:47:08.950 INFO:tasks.workunit.client.0.smithi043.stdout:7/797: dread - d5/d11/d3b/d61/dc5/fdd zero size 2024-04-25T13:47:08.951 INFO:tasks.workunit.client.0.smithi043.stdout:7/798: chown d5/d11/d8f/fa7 26445150 1 2024-04-25T13:47:08.952 INFO:tasks.workunit.client.0.smithi043.stdout:4/569: rename d1/de/df/d1a/f2d to d1/de/df/d1e/fc0 0 2024-04-25T13:47:08.953 INFO:tasks.workunit.client.0.smithi043.stdout:3/655: rmdir d0/d13/d5a 39 2024-04-25T13:47:08.954 INFO:tasks.workunit.client.0.smithi043.stdout:4/570: write d1/de/df/db4/d36/d9e/d7c/f91 [316751,121901] 0 2024-04-25T13:47:08.955 INFO:tasks.workunit.client.0.smithi043.stdout:7/799: creat d5/d11/d3b/d61/f10a x:0 0 0 2024-04-25T13:47:08.957 INFO:tasks.workunit.client.0.smithi043.stdout:3/656: mknod d0/d9/d6e/d34/d36/cde 0 2024-04-25T13:47:08.958 INFO:tasks.workunit.client.0.smithi043.stdout:8/704: getdents db/d38/de4/d59/d7c/daf 0 2024-04-25T13:47:08.959 INFO:tasks.workunit.client.0.smithi043.stdout:8/705: chown db/d44/d5c/fb8 1297 1 2024-04-25T13:47:08.961 INFO:tasks.workunit.client.0.smithi043.stdout:8/706: symlink db/d11/d79/d81/le5 0 2024-04-25T13:47:08.962 INFO:tasks.workunit.client.0.smithi043.stdout:4/571: link d1/de/df/db4/d36/d9e/d7c/c8d d1/de/df/db4/d36/cc1 0 2024-04-25T13:47:08.962 INFO:tasks.workunit.client.0.smithi043.stdout:8/707: chown db/d7d/f9b 3260485 1 2024-04-25T13:47:08.963 INFO:tasks.workunit.client.0.smithi043.stdout:7/800: rename d5/d11/d3b/d61/d68/f77 to d5/d11/d3b/d61/f10b 0 2024-04-25T13:47:08.963 INFO:tasks.workunit.client.0.smithi043.stdout:8/708: read db/d38/de4/f95 [1407672,33722] 0 2024-04-25T13:47:08.966 INFO:tasks.workunit.client.0.smithi043.stdout:7/801: mknod d5/d103/c10c 0 2024-04-25T13:47:08.967 INFO:tasks.workunit.client.0.smithi043.stdout:3/657: link d0/d13/f27 d0/d9/d78/fdf 0 2024-04-25T13:47:08.968 INFO:tasks.workunit.client.0.smithi043.stdout:4/572: fsync d1/de/df/f18 0 2024-04-25T13:47:08.969 INFO:tasks.workunit.client.0.smithi043.stdout:8/709: creat db/dc/d21/d4e/d62/fe6 x:0 0 0 2024-04-25T13:47:08.969 INFO:tasks.workunit.client.0.smithi043.stdout:3/658: mknod d0/d9/d81/d8e/ce0 0 2024-04-25T13:47:08.971 INFO:tasks.workunit.client.0.smithi043.stdout:8/710: creat db/dc/d21/db4/fe7 x:0 0 0 2024-04-25T13:47:08.971 INFO:tasks.workunit.client.0.smithi043.stdout:4/573: chown d1/de/df/db4/d36/d9e/d9d/d3a/f4d 38137655 1 2024-04-25T13:47:08.972 INFO:tasks.workunit.client.0.smithi043.stdout:7/802: symlink d5/d11/d3b/d8b/l10d 0 2024-04-25T13:47:08.975 INFO:tasks.workunit.client.0.smithi043.stdout:8/711: creat db/d11/fe8 x:0 0 0 2024-04-25T13:47:08.975 INFO:tasks.workunit.client.0.smithi043.stdout:8/712: stat db/d46/da8/fd0 0 2024-04-25T13:47:08.977 INFO:tasks.workunit.client.0.smithi043.stdout:8/713: symlink db/dc/d80/le9 0 2024-04-25T13:47:08.980 INFO:tasks.workunit.client.0.smithi043.stdout:4/574: dread d1/de/d1d/d20/f82 [0,4194304] 0 2024-04-25T13:47:08.980 INFO:tasks.workunit.client.0.smithi043.stdout:7/803: rename d5/d75/d54/f8a to d5/d11/d3b/f10e 0 2024-04-25T13:47:08.981 INFO:tasks.workunit.client.0.smithi043.stdout:8/714: truncate db/d38/de4/f3e 1034327 0 2024-04-25T13:47:08.982 INFO:tasks.workunit.client.0.smithi043.stdout:7/804: creat d5/d75/f10f x:0 0 0 2024-04-25T13:47:08.982 INFO:tasks.workunit.client.0.smithi043.stdout:8/715: write db/d38/de4/f89 [4696553,6955] 0 2024-04-25T13:47:08.984 INFO:tasks.workunit.client.0.smithi043.stdout:8/716: read - db/dc/d21/d4e/d62/fe3 zero size 2024-04-25T13:47:08.986 INFO:tasks.workunit.client.0.smithi043.stdout:4/575: dwrite d1/d3/d7b/f7f [0,4194304] 0 2024-04-25T13:47:08.988 INFO:tasks.workunit.client.0.smithi043.stdout:8/717: symlink db/dc/d21/db4/dbe/lea 0 2024-04-25T13:47:08.993 INFO:tasks.workunit.client.0.smithi043.stdout:8/718: symlink db/dc/d21/d4e/d62/leb 0 2024-04-25T13:47:08.994 INFO:tasks.workunit.client.0.smithi043.stdout:8/719: stat db/dc/d21/d4e/d62/f94 0 2024-04-25T13:47:08.996 INFO:tasks.workunit.client.0.smithi043.stdout:7/805: dread d5/d11/d3b/d61/dc5/dee/d5a/f88 [0,4194304] 0 2024-04-25T13:47:09.001 INFO:tasks.workunit.client.0.smithi043.stdout:7/806: getdents d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/dfd 0 2024-04-25T13:47:09.003 INFO:tasks.workunit.client.0.smithi043.stdout:7/807: creat d5/d11/d3b/d8b/d93/f110 x:0 0 0 2024-04-25T13:47:09.004 INFO:tasks.workunit.client.0.smithi043.stdout:8/720: write db/d11/d79/fc6 [879067,9696] 0 2024-04-25T13:47:09.005 INFO:tasks.workunit.client.0.smithi043.stdout:8/721: truncate db/d38/f7f 872440 0 2024-04-25T13:47:09.008 INFO:tasks.workunit.client.0.smithi043.stdout:3/659: rename d0/d9/d6e/d38/l71 to d0/d13/dbe/dd7/le1 0 2024-04-25T13:47:09.011 INFO:tasks.workunit.client.0.smithi043.stdout:3/660: symlink d0/d13/d2e/db1/le2 0 2024-04-25T13:47:09.012 INFO:tasks.workunit.client.0.smithi043.stdout:8/722: rename db/d46/fe1 to db/d7d/fec 0 2024-04-25T13:47:09.017 INFO:tasks.workunit.client.0.smithi043.stdout:7/808: dwrite d5/fd [0,4194304] 0 2024-04-25T13:47:09.021 INFO:tasks.workunit.client.0.smithi043.stdout:8/723: dread db/d11/d79/f84 [0,4194304] 0 2024-04-25T13:47:09.021 INFO:tasks.workunit.client.0.smithi043.stdout:4/576: dread d1/de/df/db4/d36/d9e/d9d/f37 [4194304,4194304] 0 2024-04-25T13:47:09.022 INFO:tasks.workunit.client.0.smithi043.stdout:3/661: dwrite d0/d13/d55/fa9 [0,4194304] 0 2024-04-25T13:47:09.026 INFO:tasks.workunit.client.0.smithi043.stdout:7/809: creat d5/d11/d84/f111 x:0 0 0 2024-04-25T13:47:09.032 INFO:tasks.workunit.client.0.smithi043.stdout:8/724: read db/dc/d21/d4e/f58 [1468613,61558] 0 2024-04-25T13:47:09.035 INFO:tasks.workunit.client.0.smithi043.stdout:7/810: chown d5/d11/d3b/d61/dc5/dcc/df8/c109 46862 1 2024-04-25T13:47:09.038 INFO:tasks.workunit.client.0.smithi043.stdout:3/662: dwrite d0/d9/f62 [0,4194304] 0 2024-04-25T13:47:09.038 INFO:tasks.workunit.client.0.smithi043.stdout:4/577: dwrite d1/de/df/db4/d36/d9e/d7c/fb2 [0,4194304] 0 2024-04-25T13:47:09.042 INFO:tasks.workunit.client.0.smithi043.stdout:4/578: fdatasync d1/d3/d54/d62/d77/d79/f60 0 2024-04-25T13:47:09.044 INFO:tasks.workunit.client.0.smithi043.stdout:4/579: write d1/de/df/d1a/f58 [543009,52651] 0 2024-04-25T13:47:09.044 INFO:tasks.workunit.client.0.smithi043.stdout:8/725: write db/d11/d79/d81/f83 [745101,13865] 0 2024-04-25T13:47:09.048 INFO:tasks.workunit.client.0.smithi043.stdout:8/726: truncate db/d38/de4/faa 256798 0 2024-04-25T13:47:09.051 INFO:tasks.workunit.client.0.smithi043.stdout:4/580: rename d1/d3/d54/d62/d77/d79/f72 to d1/d3/d54/d62/d77/d79/fc2 0 2024-04-25T13:47:09.054 INFO:tasks.workunit.client.0.smithi043.stdout:4/581: chown d1/de/df/d1a/f47 80 1 2024-04-25T13:47:09.058 INFO:tasks.workunit.client.0.smithi043.stdout:8/727: dwrite db/dc/d21/d4e/d62/fe3 [0,4194304] 0 2024-04-25T13:47:09.063 INFO:tasks.workunit.client.0.smithi043.stdout:4/582: dread d1/d3/d54/d62/d77/d79/f5e [0,4194304] 0 2024-04-25T13:47:09.065 INFO:tasks.workunit.client.0.smithi043.stdout:4/583: chown d1/f14 2766 1 2024-04-25T13:47:09.065 INFO:tasks.workunit.client.0.smithi043.stdout:3/663: dread d0/d9/d81/d8e/d92/fb0 [0,4194304] 0 2024-04-25T13:47:09.065 INFO:tasks.workunit.client.0.smithi043.stdout:8/728: write db/d44/d8e/f42 [1208314,43818] 0 2024-04-25T13:47:09.068 INFO:tasks.workunit.client.0.smithi043.stdout:3/664: creat d0/d61/fe3 x:0 0 0 2024-04-25T13:47:09.071 INFO:tasks.workunit.client.0.smithi043.stdout:3/665: chown d0/d9/l30 13 1 2024-04-25T13:47:09.072 INFO:tasks.workunit.client.0.smithi043.stdout:4/584: dread d1/d3/d7b/f7f [0,4194304] 0 2024-04-25T13:47:09.073 INFO:tasks.workunit.client.0.smithi043.stdout:8/729: getdents db 0 2024-04-25T13:47:09.074 INFO:tasks.workunit.client.0.smithi043.stdout:4/585: rmdir d1/d3/d7b 39 2024-04-25T13:47:09.075 INFO:tasks.workunit.client.0.smithi043.stdout:3/666: unlink d0/d9/l30 0 2024-04-25T13:47:09.077 INFO:tasks.workunit.client.0.smithi043.stdout:4/586: read d1/de/df/d1e/d45/f88 [5697396,116232] 0 2024-04-25T13:47:09.078 INFO:tasks.workunit.client.0.smithi043.stdout:3/667: symlink d0/d9/d6e/d34/d36/d57/le4 0 2024-04-25T13:47:09.079 INFO:tasks.workunit.client.0.smithi043.stdout:4/587: readlink d1/d34/l55 0 2024-04-25T13:47:09.083 INFO:tasks.workunit.client.0.smithi043.stdout:4/588: mknod d1/de/d1d/cc3 0 2024-04-25T13:47:09.083 INFO:tasks.workunit.client.0.smithi043.stdout:4/589: stat d1/d3/d54/d62/c9a 0 2024-04-25T13:47:09.083 INFO:tasks.workunit.client.0.smithi043.stdout:4/590: chown d1/de/df 0 1 2024-04-25T13:47:09.087 INFO:tasks.workunit.client.0.smithi043.stdout:3/668: dread d0/d13/f73 [0,4194304] 0 2024-04-25T13:47:09.087 INFO:tasks.workunit.client.0.smithi043.stdout:8/730: write db/dc/d28/f6d [3255408,76686] 0 2024-04-25T13:47:09.089 INFO:tasks.workunit.client.0.smithi043.stdout:3/669: chown d0/d9/d81/d8e/d92 8 1 2024-04-25T13:47:09.095 INFO:tasks.workunit.client.0.smithi043.stdout:8/731: write db/d38/de4/f3e [1125590,14110] 0 2024-04-25T13:47:09.101 INFO:tasks.workunit.client.0.smithi043.stdout:8/732: write db/d38/d40/f9d [1442152,85808] 0 2024-04-25T13:47:09.102 INFO:tasks.workunit.client.0.smithi043.stdout:8/733: chown db/d38/d77 208837 1 2024-04-25T13:47:09.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:08 smithi161 ceph-mon[32696]: pgmap v79: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 193 MiB/s wr, 383 op/s 2024-04-25T13:47:09.103 INFO:tasks.workunit.client.0.smithi043.stdout:3/670: dwrite d0/da/db9/fdb [0,4194304] 0 2024-04-25T13:47:09.103 INFO:tasks.workunit.client.0.smithi043.stdout:8/734: read db/d11/d79/f84 [422682,3109] 0 2024-04-25T13:47:09.105 INFO:tasks.workunit.client.0.smithi043.stdout:3/671: write d0/f35 [1048629,107368] 0 2024-04-25T13:47:09.106 INFO:tasks.workunit.client.0.smithi043.stdout:4/591: dread d1/de/df/d1a/f58 [0,4194304] 0 2024-04-25T13:47:09.108 INFO:tasks.workunit.client.0.smithi043.stdout:8/735: creat db/d11/d79/dbc/fed x:0 0 0 2024-04-25T13:47:09.110 INFO:tasks.workunit.client.0.smithi043.stdout:4/592: write d1/de/df/db4/d36/d53/fb6 [399234,74153] 0 2024-04-25T13:47:09.110 INFO:tasks.workunit.client.0.smithi043.stdout:8/736: rmdir db/d11/d79 39 2024-04-25T13:47:09.114 INFO:tasks.workunit.client.0.smithi043.stdout:8/737: mknod db/dc/d21/db4/dbe/cee 0 2024-04-25T13:47:09.114 INFO:tasks.workunit.client.0.smithi043.stdout:4/593: creat d1/de/fc4 x:0 0 0 2024-04-25T13:47:09.118 INFO:tasks.workunit.client.0.smithi043.stdout:8/738: mknod db/d38/cef 0 2024-04-25T13:47:09.122 INFO:tasks.workunit.client.0.smithi043.stdout:4/594: write d1/de/df/db4/d36/d9e/d9d/f46 [806371,28807] 0 2024-04-25T13:47:09.125 INFO:tasks.workunit.client.0.smithi043.stdout:2/568: sync 2024-04-25T13:47:09.128 INFO:tasks.workunit.client.0.smithi043.stdout:2/569: mkdir d0/d34/d17/d5e/da9 0 2024-04-25T13:47:09.130 INFO:tasks.workunit.client.0.smithi043.stdout:4/595: write d1/de/d1d/d20/f52 [787330,104933] 0 2024-04-25T13:47:09.131 INFO:tasks.workunit.client.0.smithi043.stdout:3/672: rename d0/d9/d78 to d0/d9/d6e/d34/d36/d57/de5 0 2024-04-25T13:47:09.134 INFO:tasks.workunit.client.0.smithi043.stdout:8/739: fsync db/d38/d3c/d71/d5d/fda 0 2024-04-25T13:47:09.136 INFO:tasks.workunit.client.0.smithi043.stdout:2/570: dwrite d0/d34/d17/d5e/d71/d81/fa8 [0,4194304] 0 2024-04-25T13:47:09.137 INFO:tasks.workunit.client.0.smithi043.stdout:3/673: fsync d0/d9/f23 0 2024-04-25T13:47:09.141 INFO:tasks.workunit.client.0.smithi043.stdout:3/674: read d0/d9/d6e/d34/d36/f4e [3580501,20815] 0 2024-04-25T13:47:09.142 INFO:tasks.workunit.client.0.smithi043.stdout:4/596: dread d1/d3/d7b/f7f [0,4194304] 0 2024-04-25T13:47:09.146 INFO:tasks.workunit.client.0.smithi043.stdout:8/740: dwrite db/dc/f23 [0,4194304] 0 2024-04-25T13:47:09.148 INFO:tasks.workunit.client.0.smithi043.stdout:4/597: fdatasync d1/de/df/d1e/fc0 0 2024-04-25T13:47:09.150 INFO:tasks.workunit.client.0.smithi043.stdout:2/571: dwrite d0/d34/d17/f60 [4194304,4194304] 0 2024-04-25T13:47:09.153 INFO:tasks.workunit.client.0.smithi043.stdout:8/741: mkdir db/d11/d79/df0 0 2024-04-25T13:47:09.156 INFO:tasks.workunit.client.0.smithi043.stdout:2/572: mknod d0/d8/d9b/caa 0 2024-04-25T13:47:09.157 INFO:tasks.workunit.client.0.smithi043.stdout:3/675: dwrite d0/d13/f67 [4194304,4194304] 0 2024-04-25T13:47:09.163 INFO:tasks.workunit.client.0.smithi043.stdout:2/573: symlink d0/d8/d9b/lab 0 2024-04-25T13:47:09.167 INFO:tasks.workunit.client.0.smithi043.stdout:8/742: dread db/d38/de4/d8c/f99 [0,4194304] 0 2024-04-25T13:47:09.168 INFO:tasks.workunit.client.0.smithi043.stdout:2/574: creat d0/d34/d17/d5e/d86/fac x:0 0 0 2024-04-25T13:47:09.169 INFO:tasks.workunit.client.0.smithi043.stdout:2/575: fdatasync d0/fa1 0 2024-04-25T13:47:09.169 INFO:tasks.workunit.client.0.smithi043.stdout:3/676: symlink d0/da/db9/le6 0 2024-04-25T13:47:09.171 INFO:tasks.workunit.client.0.smithi043.stdout:8/743: chown db/d38/d3c/d71/d5d/fc0 665909696 1 2024-04-25T13:47:09.175 INFO:tasks.workunit.client.0.smithi043.stdout:8/744: chown db/d44/d8e/c36 95462 1 2024-04-25T13:47:09.177 INFO:tasks.workunit.client.0.smithi043.stdout:8/745: mknod db/dc/d21/db4/cf1 0 2024-04-25T13:47:09.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:08 smithi175 ceph-mon[32649]: pgmap v79: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 193 MiB/s wr, 383 op/s 2024-04-25T13:47:09.181 INFO:tasks.workunit.client.0.smithi043.stdout:2/576: dwrite d0/d34/d3f/d46/d55/f65 [0,4194304] 0 2024-04-25T13:47:09.185 INFO:tasks.workunit.client.0.smithi043.stdout:4/598: rename d1/de/df/db4/d36/d9e/d7c to d1/d3/d54/d62/d77/d92/dc5 0 2024-04-25T13:47:09.187 INFO:tasks.workunit.client.0.smithi043.stdout:2/577: rmdir d0/d34/d77 39 2024-04-25T13:47:09.188 INFO:tasks.workunit.client.0.smithi043.stdout:8/746: dwrite db/dc/d21/d4e/fce [0,4194304] 0 2024-04-25T13:47:09.189 INFO:tasks.workunit.client.0.smithi043.stdout:4/599: chown d1/de/df/l26 121448801 1 2024-04-25T13:47:09.197 INFO:tasks.workunit.client.0.smithi043.stdout:2/578: creat d0/d34/d17/d5e/d9f/fad x:0 0 0 2024-04-25T13:47:09.197 INFO:tasks.workunit.client.0.smithi043.stdout:3/677: dread d0/d9/d6e/d34/f80 [0,4194304] 0 2024-04-25T13:47:09.204 INFO:tasks.workunit.client.0.smithi043.stdout:8/747: dwrite db/d46/da8/fbf [0,4194304] 0 2024-04-25T13:47:09.208 INFO:tasks.workunit.client.0.smithi043.stdout:4/600: dwrite d1/d3/f68 [0,4194304] 0 2024-04-25T13:47:09.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:08 smithi043 ceph-mon[29195]: pgmap v79: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 193 MiB/s wr, 383 op/s 2024-04-25T13:47:09.212 INFO:tasks.workunit.client.0.smithi043.stdout:4/601: stat d1/de/d1d/d20/f52 0 2024-04-25T13:47:09.216 INFO:tasks.workunit.client.0.smithi043.stdout:2/579: truncate d0/d34/d17/d5e/d71/d81/fa8 4026010 0 2024-04-25T13:47:09.218 INFO:tasks.workunit.client.0.smithi043.stdout:3/678: dwrite d0/d9/f95 [4194304,4194304] 0 2024-04-25T13:47:09.220 INFO:tasks.workunit.client.0.smithi043.stdout:0/656: sync 2024-04-25T13:47:09.221 INFO:tasks.workunit.client.0.smithi043.stdout:2/580: chown d0/d34/d3f/d59/ca7 18 1 2024-04-25T13:47:09.222 INFO:tasks.workunit.client.0.smithi043.stdout:3/679: chown d0/d13/d2e/c4a 3319 1 2024-04-25T13:47:09.224 INFO:tasks.workunit.client.0.smithi043.stdout:0/657: chown db/d1b/d94/da1/ld0 6 1 2024-04-25T13:47:09.224 INFO:tasks.workunit.client.0.smithi043.stdout:4/602: mknod d1/de/df/db4/d36/d9e/d9d/cc6 0 2024-04-25T13:47:09.226 INFO:tasks.workunit.client.0.smithi043.stdout:8/748: dwrite db/d38/d40/fd8 [0,4194304] 0 2024-04-25T13:47:09.227 INFO:tasks.workunit.client.0.smithi043.stdout:0/658: chown db/d1b/d62/d72/da2/cdc 376644728 1 2024-04-25T13:47:09.228 INFO:tasks.workunit.client.0.smithi043.stdout:3/680: creat d0/d13/d5a/d90/fe7 x:0 0 0 2024-04-25T13:47:09.229 INFO:tasks.workunit.client.0.smithi043.stdout:8/749: mkdir db/d7d/df2 0 2024-04-25T13:47:09.230 INFO:tasks.workunit.client.0.smithi043.stdout:4/603: creat d1/d34/d83/fc7 x:0 0 0 2024-04-25T13:47:09.233 INFO:tasks.workunit.client.0.smithi043.stdout:0/659: write db/d1b/d36/d41/daf/fc9 [639219,42745] 0 2024-04-25T13:47:09.236 INFO:tasks.workunit.client.0.smithi043.stdout:8/750: mkdir db/d46/da8/df3 0 2024-04-25T13:47:09.237 INFO:tasks.workunit.client.0.smithi043.stdout:8/751: readlink db/l73 0 2024-04-25T13:47:09.301 INFO:tasks.workunit.client.0.smithi043.stdout:0/660: dread - db/d1b/d23/d27/d39/d4b/fca zero size 2024-04-25T13:47:09.301 INFO:tasks.workunit.client.0.smithi043.stdout:4/604: dread d1/d3/d54/d62/d77/d92/dc5/fb2 [0,4194304] 0 2024-04-25T13:47:09.303 INFO:tasks.workunit.client.0.smithi043.stdout:2/581: dwrite d0/d34/d17/d5e/d71/d81/fa8 [0,4194304] 0 2024-04-25T13:47:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:0/661: creat db/d1b/d23/d27/fdf x:0 0 0 2024-04-25T13:47:09.309 INFO:tasks.workunit.client.0.smithi043.stdout:8/752: dwrite db/d44/d5c/fb8 [0,4194304] 0 2024-04-25T13:47:09.310 INFO:tasks.workunit.client.0.smithi043.stdout:8/753: read - db/d44/d8e/d27/f91 zero size 2024-04-25T13:47:09.315 INFO:tasks.workunit.client.0.smithi043.stdout:8/754: chown db/dc/d80/le9 243509 1 2024-04-25T13:47:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:0/662: link db/d1b/d36/d41/daf/fc9 db/d1b/d23/fe0 0 2024-04-25T13:47:09.316 INFO:tasks.workunit.client.0.smithi043.stdout:4/605: dwrite d1/d3/d7b/fa8 [0,4194304] 0 2024-04-25T13:47:09.319 INFO:tasks.workunit.client.0.smithi043.stdout:8/755: write db/dc/d21/fdf [1033693,103383] 0 2024-04-25T13:47:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:7/811: sync 2024-04-25T13:47:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:5/603: sync 2024-04-25T13:47:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:6/736: sync 2024-04-25T13:47:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:1/692: sync 2024-04-25T13:47:09.322 INFO:tasks.workunit.client.0.smithi043.stdout:2/582: dwrite d0/d26/f4d [0,4194304] 0 2024-04-25T13:47:09.326 INFO:tasks.workunit.client.0.smithi043.stdout:6/737: fdatasync d0/d1c/fb1 0 2024-04-25T13:47:09.327 INFO:tasks.workunit.client.0.smithi043.stdout:4/606: unlink d1/de/df/l29 0 2024-04-25T13:47:09.331 INFO:tasks.workunit.client.0.smithi043.stdout:5/604: rmdir d1/d3/d7/d8/df 39 2024-04-25T13:47:09.336 INFO:tasks.workunit.client.0.smithi043.stdout:0/663: dwrite db/d1b/d62/d72/f9a [0,4194304] 0 2024-04-25T13:47:09.341 INFO:tasks.workunit.client.0.smithi043.stdout:2/583: truncate d0/d26/f4d 2801491 0 2024-04-25T13:47:09.341 INFO:tasks.workunit.client.0.smithi043.stdout:5/605: rmdir d1/d3/d7/d8/df 39 2024-04-25T13:47:09.342 INFO:tasks.workunit.client.0.smithi043.stdout:4/607: truncate d1/d3/d54/d62/d77/d79/f60 884737 0 2024-04-25T13:47:09.344 INFO:tasks.workunit.client.0.smithi043.stdout:7/812: link d5/d11/d3b/d61/dc5/dee/c5b d5/d11/d3b/c112 0 2024-04-25T13:47:09.346 INFO:tasks.workunit.client.0.smithi043.stdout:2/584: symlink d0/d34/d17/d5e/d71/lae 0 2024-04-25T13:47:09.353 INFO:tasks.workunit.client.0.smithi043.stdout:4/608: mkdir d1/de/df/d1e/dc8 0 2024-04-25T13:47:09.354 INFO:tasks.workunit.client.0.smithi043.stdout:7/813: chown d5/d6b/f71 3787958 1 2024-04-25T13:47:09.359 INFO:tasks.workunit.client.0.smithi043.stdout:0/664: dread db/d1b/d94/f79 [0,4194304] 0 2024-04-25T13:47:09.360 INFO:tasks.workunit.client.0.smithi043.stdout:8/756: dread db/d38/de4/f66 [0,4194304] 0 2024-04-25T13:47:09.360 INFO:tasks.workunit.client.0.smithi043.stdout:5/606: truncate d1/d3/d7/d8/df/f6b 75186 0 2024-04-25T13:47:09.364 INFO:tasks.workunit.client.0.smithi043.stdout:5/607: read - d1/d3/d7/d8/da/d11/d52/f90 zero size 2024-04-25T13:47:09.368 INFO:tasks.workunit.client.0.smithi043.stdout:2/585: dwrite d0/d8/fa [0,4194304] 0 2024-04-25T13:47:09.369 INFO:tasks.workunit.client.0.smithi043.stdout:5/608: creat d1/d3/d7/d2f/fc8 x:0 0 0 2024-04-25T13:47:09.369 INFO:tasks.workunit.client.0.smithi043.stdout:4/609: dwrite d1/d3/d7b/f7f [0,4194304] 0 2024-04-25T13:47:09.372 INFO:tasks.workunit.client.0.smithi043.stdout:8/757: read db/fd [2747300,89250] 0 2024-04-25T13:47:09.374 INFO:tasks.workunit.client.0.smithi043.stdout:4/610: unlink d1/d6a/fbe 0 2024-04-25T13:47:09.378 INFO:tasks.workunit.client.0.smithi043.stdout:2/586: dwrite d0/d5/d2f/f79 [0,4194304] 0 2024-04-25T13:47:09.379 INFO:tasks.workunit.client.0.smithi043.stdout:4/611: creat d1/d3/d54/d62/fc9 x:0 0 0 2024-04-25T13:47:09.380 INFO:tasks.workunit.client.0.smithi043.stdout:4/612: stat d1/c4 0 2024-04-25T13:47:09.380 INFO:tasks.workunit.client.0.smithi043.stdout:2/587: write d0/d5/d1e/f6b [895119,8982] 0 2024-04-25T13:47:09.381 INFO:tasks.workunit.client.0.smithi043.stdout:8/758: mknod db/d44/cf4 0 2024-04-25T13:47:09.386 INFO:tasks.workunit.client.0.smithi043.stdout:4/613: write d1/de/df/d1a/d49/fa7 [600429,86079] 0 2024-04-25T13:47:09.388 INFO:tasks.workunit.client.0.smithi043.stdout:0/665: dread db/d25/d2a/d3f/f42 [0,4194304] 0 2024-04-25T13:47:09.389 INFO:tasks.workunit.client.0.smithi043.stdout:4/614: readlink d1/d6a/l80 0 2024-04-25T13:47:09.414 INFO:tasks.workunit.client.0.smithi043.stdout:0/666: fsync db/d1b/d62/d72/da2/fba 0 2024-04-25T13:47:09.415 INFO:tasks.workunit.client.0.smithi043.stdout:6/738: rename d0/d90/l4a to d0/d76/de3/d64/lf4 0 2024-04-25T13:47:09.418 INFO:tasks.workunit.client.0.smithi043.stdout:7/814: dwrite d5/d11/d3b/d61/d68/fa5 [0,4194304] 0 2024-04-25T13:47:09.418 INFO:tasks.workunit.client.0.smithi043.stdout:4/615: truncate d1/de/d1d/f5c 841165 0 2024-04-25T13:47:09.418 INFO:tasks.workunit.client.0.smithi043.stdout:0/667: dread - db/d25/d2a/d3f/f8b zero size 2024-04-25T13:47:09.419 INFO:tasks.workunit.client.0.smithi043.stdout:5/609: dwrite d1/d3/d26/f27 [0,4194304] 0 2024-04-25T13:47:09.420 INFO:tasks.workunit.client.0.smithi043.stdout:6/739: symlink d0/d90/lf5 0 2024-04-25T13:47:09.423 INFO:tasks.workunit.client.0.smithi043.stdout:4/616: creat d1/d3/d54/d62/d77/d79/fca x:0 0 0 2024-04-25T13:47:09.424 INFO:tasks.workunit.client.0.smithi043.stdout:4/617: chown d1/d3 65343 1 2024-04-25T13:47:09.425 INFO:tasks.workunit.client.0.smithi043.stdout:6/740: creat d0/d90/db0/ff6 x:0 0 0 2024-04-25T13:47:09.426 INFO:tasks.workunit.client.0.smithi043.stdout:6/741: chown d0/d90/d48 6590837 1 2024-04-25T13:47:09.427 INFO:tasks.workunit.client.0.smithi043.stdout:4/618: write d1/de/df/d1a/f3c [990032,88008] 0 2024-04-25T13:47:09.428 INFO:tasks.workunit.client.0.smithi043.stdout:5/610: creat d1/d3/d7/d9/d2d/d5b/fc9 x:0 0 0 2024-04-25T13:47:09.428 INFO:tasks.workunit.client.0.smithi043.stdout:4/619: readlink d1/de/df/d1a/d49/l63 0 2024-04-25T13:47:09.433 INFO:tasks.workunit.client.0.smithi043.stdout:5/611: rmdir d1/d3/d7/d8/da/d11/d52 39 2024-04-25T13:47:09.435 INFO:tasks.workunit.client.0.smithi043.stdout:4/620: creat d1/de/df/db4/fcb x:0 0 0 2024-04-25T13:47:09.436 INFO:tasks.workunit.client.0.smithi043.stdout:4/621: stat d1/de/d1d/c56 0 2024-04-25T13:47:09.438 INFO:tasks.workunit.client.0.smithi043.stdout:4/622: chown d1/de/df 219319861 1 2024-04-25T13:47:09.443 INFO:tasks.workunit.client.0.smithi043.stdout:4/623: write d1/de/df/d1a/f65 [283740,16238] 0 2024-04-25T13:47:09.444 INFO:tasks.workunit.client.0.smithi043.stdout:7/815: dwrite d5/d11/d3b/d61/d68/dc0/f6c [0,4194304] 0 2024-04-25T13:47:09.446 INFO:tasks.workunit.client.0.smithi043.stdout:5/612: dwrite d1/d3/d7/d9/d2d/d5b/fc9 [0,4194304] 0 2024-04-25T13:47:09.448 INFO:tasks.workunit.client.0.smithi043.stdout:4/624: fdatasync d1/d3/f9 0 2024-04-25T13:47:09.450 INFO:tasks.workunit.client.0.smithi043.stdout:5/613: creat d1/d3/d7/d2f/fca x:0 0 0 2024-04-25T13:47:09.452 INFO:tasks.workunit.client.0.smithi043.stdout:0/668: dread db/d1b/d23/d27/f5a [0,4194304] 0 2024-04-25T13:47:09.452 INFO:tasks.workunit.client.0.smithi043.stdout:5/614: readlink d1/d4/d42/lc3 0 2024-04-25T13:47:09.456 INFO:tasks.workunit.client.0.smithi043.stdout:4/625: truncate d1/de/df/db4/f78 881249 0 2024-04-25T13:47:09.462 INFO:tasks.workunit.client.0.smithi043.stdout:7/816: dread d5/d11/d3b/f10e [0,4194304] 0 2024-04-25T13:47:09.463 INFO:tasks.workunit.client.0.smithi043.stdout:5/615: dread d1/d3/d7/d9/d2d/d5b/fa5 [0,4194304] 0 2024-04-25T13:47:09.464 INFO:tasks.workunit.client.0.smithi043.stdout:2/588: rename d0/d5/d2f/f6e to d0/d34/faf 0 2024-04-25T13:47:09.466 INFO:tasks.workunit.client.0.smithi043.stdout:5/616: mkdir d1/d4/d42/dcb 0 2024-04-25T13:47:09.466 INFO:tasks.workunit.client.0.smithi043.stdout:0/669: unlink db/d1b/d4f/f63 0 2024-04-25T13:47:09.468 INFO:tasks.workunit.client.0.smithi043.stdout:2/589: write d0/d26/f4d [342443,98006] 0 2024-04-25T13:47:09.469 INFO:tasks.workunit.client.0.smithi043.stdout:0/670: write db/d1b/d94/f79 [491726,39736] 0 2024-04-25T13:47:09.471 INFO:tasks.workunit.client.0.smithi043.stdout:7/817: dread d5/d11/d3b/d61/dc5/dee/f4a [0,4194304] 0 2024-04-25T13:47:09.471 INFO:tasks.workunit.client.0.smithi043.stdout:6/742: rename d0/c97 to d0/d1b/d88/cf7 0 2024-04-25T13:47:09.473 INFO:tasks.workunit.client.0.smithi043.stdout:6/743: dread - d0/d76/de3/da7/fde zero size 2024-04-25T13:47:09.475 INFO:tasks.workunit.client.0.smithi043.stdout:4/626: rename d1/c2 to d1/d3/d7b/ccc 0 2024-04-25T13:47:09.476 INFO:tasks.workunit.client.0.smithi043.stdout:7/818: creat d5/d11/f113 x:0 0 0 2024-04-25T13:47:09.476 INFO:tasks.workunit.client.0.smithi043.stdout:7/819: chown d5/d75/la2 6 1 2024-04-25T13:47:09.477 INFO:tasks.workunit.client.0.smithi043.stdout:0/671: creat db/d1b/d23/d27/d39/d4c/fe1 x:0 0 0 2024-04-25T13:47:09.480 INFO:tasks.workunit.client.0.smithi043.stdout:5/617: rename d1/d3/d7/d2f/d67/f6d to d1/d3/d7/d2f/d80/fcc 0 2024-04-25T13:47:09.481 INFO:tasks.workunit.client.0.smithi043.stdout:4/627: stat d1/d3/d54/d62/d77/d92/dc5/l8b 0 2024-04-25T13:47:09.482 INFO:tasks.workunit.client.0.smithi043.stdout:0/672: mkdir db/d1b/d94/da1/de2 0 2024-04-25T13:47:09.482 INFO:tasks.workunit.client.0.smithi043.stdout:4/628: chown d1/de/df/d1a/d49/c69 142649485 1 2024-04-25T13:47:09.483 INFO:tasks.workunit.client.0.smithi043.stdout:3/681: sync 2024-04-25T13:47:09.483 INFO:tasks.workunit.client.0.smithi043.stdout:7/820: rmdir d5/d11/d3b/d8b 39 2024-04-25T13:47:09.484 INFO:tasks.workunit.client.0.smithi043.stdout:4/629: mkdir d1/d3/d54/d62/d77/dcd 0 2024-04-25T13:47:09.484 INFO:tasks.workunit.client.0.smithi043.stdout:5/618: unlink d1/d3/d7/d8/da/d11/ca7 0 2024-04-25T13:47:09.485 INFO:tasks.workunit.client.0.smithi043.stdout:6/744: creat d0/d90/d48/ff8 x:0 0 0 2024-04-25T13:47:09.486 INFO:tasks.workunit.client.0.smithi043.stdout:5/619: chown d1/d4/d92/d95/cb2 38 1 2024-04-25T13:47:09.487 INFO:tasks.workunit.client.0.smithi043.stdout:6/745: dread - d0/d90/d48/d9d/fb6 zero size 2024-04-25T13:47:09.488 INFO:tasks.workunit.client.0.smithi043.stdout:4/630: mknod d1/de/df/d1e/cce 0 2024-04-25T13:47:09.489 INFO:tasks.workunit.client.0.smithi043.stdout:5/620: fsync d1/d3/f81 0 2024-04-25T13:47:09.490 INFO:tasks.workunit.client.0.smithi043.stdout:7/821: mknod d5/d11/d3b/c114 0 2024-04-25T13:47:09.492 INFO:tasks.workunit.client.0.smithi043.stdout:6/746: symlink d0/d24/d3a/lf9 0 2024-04-25T13:47:09.494 INFO:tasks.workunit.client.0.smithi043.stdout:3/682: dwrite d0/f2a [0,4194304] 0 2024-04-25T13:47:09.496 INFO:tasks.workunit.client.0.smithi043.stdout:0/673: write db/d1b/d36/d41/daf/fc9 [1413428,87133] 0 2024-04-25T13:47:09.498 INFO:tasks.workunit.client.0.smithi043.stdout:6/747: mknod d0/d24/d3a/cfa 0 2024-04-25T13:47:09.498 INFO:tasks.workunit.client.0.smithi043.stdout:7/822: write d5/d11/d3b/d61/dc5/dee/d5a/fe5 [206488,38817] 0 2024-04-25T13:47:09.499 INFO:tasks.workunit.client.0.smithi043.stdout:4/631: symlink d1/d3/d8f/lcf 0 2024-04-25T13:47:09.500 INFO:tasks.workunit.client.0.smithi043.stdout:3/683: creat d0/d9/d6e/d34/d36/d57/fe8 x:0 0 0 2024-04-25T13:47:09.503 INFO:tasks.workunit.client.0.smithi043.stdout:7/823: write d5/d11/d3b/d61/dc5/dee/d5a/fe5 [539935,105307] 0 2024-04-25T13:47:09.503 INFO:tasks.workunit.client.0.smithi043.stdout:5/621: symlink d1/d3/d7/d2f/d80/db6/lcd 0 2024-04-25T13:47:09.504 INFO:tasks.workunit.client.0.smithi043.stdout:0/674: unlink db/l45 0 2024-04-25T13:47:09.507 INFO:tasks.workunit.client.0.smithi043.stdout:3/684: dread - d0/da/f48 zero size 2024-04-25T13:47:09.509 INFO:tasks.workunit.client.0.smithi043.stdout:7/824: symlink d5/d11/d3b/d61/dc5/dee/d5a/d8d/l115 0 2024-04-25T13:47:09.514 INFO:tasks.workunit.client.0.smithi043.stdout:6/748: mknod d0/d76/de3/da7/dc3/cfb 0 2024-04-25T13:47:09.516 INFO:tasks.workunit.client.0.smithi043.stdout:6/749: write d0/d90/db0/ff6 [289373,118185] 0 2024-04-25T13:47:09.520 INFO:tasks.workunit.client.0.smithi043.stdout:5/622: creat d1/d3/d7/d9/fce x:0 0 0 2024-04-25T13:47:09.523 INFO:tasks.workunit.client.0.smithi043.stdout:5/623: fsync d1/d3/d7/d8/df/d28/fab 0 2024-04-25T13:47:09.524 INFO:tasks.workunit.client.0.smithi043.stdout:4/632: mkdir d1/de/df/db4/d36/d9e/d9d/dd0 0 2024-04-25T13:47:09.525 INFO:tasks.workunit.client.0.smithi043.stdout:6/750: dwrite d0/d1b/fbc [0,4194304] 0 2024-04-25T13:47:09.527 INFO:tasks.workunit.client.0.smithi043.stdout:2/590: rename d0/d8/d9b/lab to d0/d34/d17/d5e/d9f/lb0 0 2024-04-25T13:47:09.527 INFO:tasks.workunit.client.0.smithi043.stdout:6/751: fsync d0/d90/d48/fad 0 2024-04-25T13:47:09.530 INFO:tasks.workunit.client.0.smithi043.stdout:2/591: readlink d0/d34/l2e 0 2024-04-25T13:47:09.533 INFO:tasks.workunit.client.0.smithi043.stdout:0/675: dread db/d25/d2a/fb6 [0,4194304] 0 2024-04-25T13:47:09.533 INFO:tasks.workunit.client.0.smithi043.stdout:6/752: creat d0/d3d/d54/ffc x:0 0 0 2024-04-25T13:47:09.534 INFO:tasks.workunit.client.0.smithi043.stdout:3/685: unlink d0/l7d 0 2024-04-25T13:47:09.537 INFO:tasks.workunit.client.0.smithi043.stdout:2/592: creat d0/d26/fb1 x:0 0 0 2024-04-25T13:47:09.538 INFO:tasks.workunit.client.0.smithi043.stdout:5/624: dwrite d1/d3/d7/f23 [4194304,4194304] 0 2024-04-25T13:47:09.541 INFO:tasks.workunit.client.0.smithi043.stdout:2/593: chown d0/d34/d3f/d46 0 1 2024-04-25T13:47:09.542 INFO:tasks.workunit.client.0.smithi043.stdout:5/625: readlink d1/d3/d7/d8/df/l4c 0 2024-04-25T13:47:09.543 INFO:tasks.workunit.client.0.smithi043.stdout:4/633: dwrite d1/de/df/d1a/d49/fa7 [0,4194304] 0 2024-04-25T13:47:09.543 INFO:tasks.workunit.client.0.smithi043.stdout:0/676: mknod db/d1b/d23/d27/d39/d4c/dbb/dc8/ce3 0 2024-04-25T13:47:09.544 INFO:tasks.workunit.client.0.smithi043.stdout:5/626: chown d1/d4/d92/d95 0 1 2024-04-25T13:47:09.544 INFO:tasks.workunit.client.0.smithi043.stdout:4/634: stat d1 0 2024-04-25T13:47:09.548 INFO:tasks.workunit.client.0.smithi043.stdout:2/594: stat d0/d34/d77 0 2024-04-25T13:47:09.548 INFO:tasks.workunit.client.0.smithi043.stdout:4/635: fdatasync d1/de/df/db4/d36/f6c 0 2024-04-25T13:47:09.549 INFO:tasks.workunit.client.0.smithi043.stdout:0/677: mkdir db/d1b/d23/d27/d98/de4 0 2024-04-25T13:47:09.549 INFO:tasks.workunit.client.0.smithi043.stdout:4/636: readlink d1/d6a/l80 0 2024-04-25T13:47:09.550 INFO:tasks.workunit.client.0.smithi043.stdout:0/678: write db/fc [3471325,51571] 0 2024-04-25T13:47:09.551 INFO:tasks.workunit.client.0.smithi043.stdout:0/679: chown db/d1b/d23/d27/d39/d4b/dde 99 1 2024-04-25T13:47:09.556 INFO:tasks.workunit.client.0.smithi043.stdout:5/627: link d1/d4/d42/f97 d1/d3/d7/d8/df/d98/fcf 0 2024-04-25T13:47:09.558 INFO:tasks.workunit.client.0.smithi043.stdout:0/680: symlink db/d25/d2a/d3f/d6a/le5 0 2024-04-25T13:47:09.559 INFO:tasks.workunit.client.0.smithi043.stdout:0/681: stat db/d25/d2a/l3c 0 2024-04-25T13:47:09.560 INFO:tasks.workunit.client.0.smithi043.stdout:0/682: chown db/d1b/d36/lda 3715890 1 2024-04-25T13:47:09.561 INFO:tasks.workunit.client.0.smithi043.stdout:2/595: getdents d0/d35 0 2024-04-25T13:47:09.566 INFO:tasks.workunit.client.0.smithi043.stdout:5/628: dread d1/d3/d24/d7c/f89 [0,4194304] 0 2024-04-25T13:47:09.568 INFO:tasks.workunit.client.0.smithi043.stdout:6/753: creat d0/d76/de3/d64/ffd x:0 0 0 2024-04-25T13:47:09.571 INFO:tasks.workunit.client.0.smithi043.stdout:4/637: dwrite d1/d3/d54/d62/d77/d79/f60 [0,4194304] 0 2024-04-25T13:47:09.572 INFO:tasks.workunit.client.0.smithi043.stdout:0/683: rename db/d1b/d23/d27/d39/l50 to db/d1b/d23/d27/d39/le6 0 2024-04-25T13:47:09.573 INFO:tasks.workunit.client.0.smithi043.stdout:2/596: dwrite d0/d5/f97 [0,4194304] 0 2024-04-25T13:47:09.575 INFO:tasks.workunit.client.0.smithi043.stdout:3/686: write d0/da/f2d [3966081,13190] 0 2024-04-25T13:47:09.576 INFO:tasks.workunit.client.0.smithi043.stdout:4/638: mknod d1/d3/d54/d62/d77/cd1 0 2024-04-25T13:47:09.578 INFO:tasks.workunit.client.0.smithi043.stdout:0/684: unlink db/d25/d2a/c2c 0 2024-04-25T13:47:09.582 INFO:tasks.workunit.client.0.smithi043.stdout:4/639: chown d1/d34/d35 54 1 2024-04-25T13:47:09.586 INFO:tasks.workunit.client.0.smithi043.stdout:5/629: creat d1/d3/d7/d8/da/d11/fd0 x:0 0 0 2024-04-25T13:47:09.588 INFO:tasks.workunit.client.0.smithi043.stdout:5/630: fsync d1/d3/d24/f65 0 2024-04-25T13:47:09.589 INFO:tasks.workunit.client.0.smithi043.stdout:3/687: dwrite d0/f96 [0,4194304] 0 2024-04-25T13:47:09.589 INFO:tasks.workunit.client.0.smithi043.stdout:4/640: mknod d1/de/df/d1e/dc8/cd2 0 2024-04-25T13:47:09.591 INFO:tasks.workunit.client.0.smithi043.stdout:0/685: creat db/d1b/d23/d27/d39/d4c/dbb/dc8/fe7 x:0 0 0 2024-04-25T13:47:09.592 INFO:tasks.workunit.client.0.smithi043.stdout:4/641: readlink d1/de/df/d1e/d45/l98 0 2024-04-25T13:47:09.595 INFO:tasks.workunit.client.0.smithi043.stdout:5/631: link d1/d3/d26/f27 d1/d3/d7/d2f/fd1 0 2024-04-25T13:47:09.596 INFO:tasks.workunit.client.0.smithi043.stdout:3/688: unlink d0/d13/f67 0 2024-04-25T13:47:09.598 INFO:tasks.workunit.client.0.smithi043.stdout:4/642: creat d1/de/df/d1e/d45/da1/db3/d33/fd3 x:0 0 0 2024-04-25T13:47:09.599 INFO:tasks.workunit.client.0.smithi043.stdout:4/643: fdatasync d1/de/df/d1e/d45/da1/db3/d33/fd3 0 2024-04-25T13:47:09.600 INFO:tasks.workunit.client.0.smithi043.stdout:6/754: creat d0/d76/de3/d64/ffe x:0 0 0 2024-04-25T13:47:09.601 INFO:tasks.workunit.client.0.smithi043.stdout:6/755: stat d0/d1c/f8d 0 2024-04-25T13:47:09.601 INFO:tasks.workunit.client.0.smithi043.stdout:5/632: link d1/d3/d7/d9/d2d/d5b/fc9 d1/d3/d7/d2f/d67/fd2 0 2024-04-25T13:47:09.603 INFO:tasks.workunit.client.0.smithi043.stdout:4/644: truncate d1/de/d1d/f99 4357420 0 2024-04-25T13:47:09.604 INFO:tasks.workunit.client.0.smithi043.stdout:5/633: read - d1/d3/d7/d8/df/d28/fab zero size 2024-04-25T13:47:09.604 INFO:tasks.workunit.client.0.smithi043.stdout:3/689: chown d0/d9/d6e/d34/d36/f4e 22 1 2024-04-25T13:47:09.605 INFO:tasks.workunit.client.0.smithi043.stdout:3/690: fdatasync d0/d13/fa5 0 2024-04-25T13:47:09.610 INFO:tasks.workunit.client.0.smithi043.stdout:4/645: dwrite d1/de/df/d1e/d45/da1/db3/d33/fd3 [0,4194304] 0 2024-04-25T13:47:09.614 INFO:tasks.workunit.client.0.smithi043.stdout:0/686: dread db/d1b/d23/d27/d39/d4c/f8e [0,4194304] 0 2024-04-25T13:47:09.615 INFO:tasks.workunit.client.0.smithi043.stdout:0/687: dread - db/d1b/f96 zero size 2024-04-25T13:47:09.615 INFO:tasks.workunit.client.0.smithi043.stdout:1/693: sync 2024-04-25T13:47:09.621 INFO:tasks.workunit.client.0.smithi043.stdout:0/688: dread db/d1b/d36/d41/d71/fa7 [0,4194304] 0 2024-04-25T13:47:09.622 INFO:tasks.workunit.client.0.smithi043.stdout:1/694: truncate df/d14/fa8 814017 0 2024-04-25T13:47:09.624 INFO:tasks.workunit.client.0.smithi043.stdout:2/597: rename d0/d8/d22/f7e to d0/d34/d3f/d46/d55/fb2 0 2024-04-25T13:47:09.626 INFO:tasks.workunit.client.0.smithi043.stdout:0/689: stat db/d1b/d23/d27/d39/d4b/l99 0 2024-04-25T13:47:09.626 INFO:tasks.workunit.client.0.smithi043.stdout:1/695: mkdir df/d31/d38/d43/d6e/df9 0 2024-04-25T13:47:09.628 INFO:tasks.workunit.client.0.smithi043.stdout:0/690: write db/d25/f46 [2136719,52427] 0 2024-04-25T13:47:09.632 INFO:tasks.workunit.client.0.smithi043.stdout:6/756: truncate d0/d76/de3/d64/f6d 92542 0 2024-04-25T13:47:09.705 INFO:tasks.workunit.client.0.smithi043.stdout:2/598: dwrite d0/d34/d17/f60 [4194304,4194304] 0 2024-04-25T13:47:09.706 INFO:tasks.workunit.client.0.smithi043.stdout:4/646: dread d1/de/df/f40 [0,4194304] 0 2024-04-25T13:47:09.709 INFO:tasks.workunit.client.0.smithi043.stdout:6/757: getdents d0/d3d/d54 0 2024-04-25T13:47:09.710 INFO:tasks.workunit.client.0.smithi043.stdout:6/758: write d0/d1b/d88/fca [572083,2277] 0 2024-04-25T13:47:09.714 INFO:tasks.workunit.client.0.smithi043.stdout:2/599: dwrite d0/d5/d2f/f7f [0,4194304] 0 2024-04-25T13:47:09.718 INFO:tasks.workunit.client.0.smithi043.stdout:4/647: write d1/de/df/db4/d36/d9e/d9d/f46 [461842,106489] 0 2024-04-25T13:47:09.720 INFO:tasks.workunit.client.0.smithi043.stdout:4/648: mkdir d1/d6a/dd4 0 2024-04-25T13:47:09.721 INFO:tasks.workunit.client.0.smithi043.stdout:3/691: rename d0/da/db9/d9e/ca8 to d0/d13/dbe/ce9 0 2024-04-25T13:47:09.722 INFO:tasks.workunit.client.0.smithi043.stdout:6/759: dwrite d0/d3d/d54/ffc [0,4194304] 0 2024-04-25T13:47:09.723 INFO:tasks.workunit.client.0.smithi043.stdout:2/600: truncate d0/d5/d2f/f79 3925497 0 2024-04-25T13:47:09.724 INFO:tasks.workunit.client.0.smithi043.stdout:4/649: write d1/de/fc4 [372830,119097] 0 2024-04-25T13:47:09.726 INFO:tasks.workunit.client.0.smithi043.stdout:0/691: rename la to db/d1b/d23/d27/d39/d4c/dbb/dc8/le8 0 2024-04-25T13:47:09.727 INFO:tasks.workunit.client.0.smithi043.stdout:2/601: fdatasync d0/d34/d3f/d59/f62 0 2024-04-25T13:47:09.728 INFO:tasks.workunit.client.0.smithi043.stdout:0/692: write db/d1b/d23/d27/d39/d4c/dbb/dc8/fe7 [566190,18996] 0 2024-04-25T13:47:09.731 INFO:tasks.workunit.client.0.smithi043.stdout:8/759: sync 2024-04-25T13:47:09.731 INFO:tasks.workunit.client.0.smithi043.stdout:7/825: sync 2024-04-25T13:47:09.734 INFO:tasks.workunit.client.0.smithi043.stdout:6/760: dread - d0/d76/de3/d64/da1/da3/fe7 zero size 2024-04-25T13:47:09.736 INFO:tasks.workunit.client.0.smithi043.stdout:4/650: rename d1/d34/cbd to d1/cd5 0 2024-04-25T13:47:09.736 INFO:tasks.workunit.client.0.smithi043.stdout:8/760: read db/dc/f45 [1740986,62969] 0 2024-04-25T13:47:09.738 INFO:tasks.workunit.client.0.smithi043.stdout:7/826: write d5/d11/d3b/d61/dc5/dcc/fe1 [1039714,106652] 0 2024-04-25T13:47:09.738 INFO:tasks.workunit.client.0.smithi043.stdout:3/692: truncate d0/d9/d81/f84 1793370 0 2024-04-25T13:47:09.740 INFO:tasks.workunit.client.0.smithi043.stdout:0/693: dwrite db/d25/fa3 [0,4194304] 0 2024-04-25T13:47:09.742 INFO:tasks.workunit.client.0.smithi043.stdout:4/651: chown d1/de/df/d1e/d45/f88 4 1 2024-04-25T13:47:09.743 INFO:tasks.workunit.client.0.smithi043.stdout:2/602: link d0/d5/d1e/d32/c78 d0/d8/d22/d5c/d8c/cb3 0 2024-04-25T13:47:09.747 INFO:tasks.workunit.client.0.smithi043.stdout:8/761: creat db/d38/de4/d8c/ff5 x:0 0 0 2024-04-25T13:47:09.748 INFO:tasks.workunit.client.0.smithi043.stdout:4/652: write d1/de/df/db4/d36/d9e/d9d/fbb [82199,35191] 0 2024-04-25T13:47:09.752 INFO:tasks.workunit.client.0.smithi043.stdout:6/761: getdents d0 0 2024-04-25T13:47:09.754 INFO:tasks.workunit.client.0.smithi043.stdout:4/653: mkdir d1/de/d1d/dd6 0 2024-04-25T13:47:09.756 INFO:tasks.workunit.client.0.smithi043.stdout:6/762: creat d0/d90/d4c/fff x:0 0 0 2024-04-25T13:47:09.760 INFO:tasks.workunit.client.0.smithi043.stdout:7/827: rename d5/d75/d54 to d5/d11/d3b/d61/dc5/dee/d116 0 2024-04-25T13:47:09.762 INFO:tasks.workunit.client.0.smithi043.stdout:3/693: rmdir d0/da/db9 39 2024-04-25T13:47:09.764 INFO:tasks.workunit.client.0.smithi043.stdout:8/762: rename db/d11/d79/lb3 to db/d11/d79/d81/lf6 0 2024-04-25T13:47:09.764 INFO:tasks.workunit.client.0.smithi043.stdout:7/828: fsync d5/d11/d3b/d61/d68/dc0/fb7 0 2024-04-25T13:47:09.765 INFO:tasks.workunit.client.0.smithi043.stdout:4/654: dwrite d1/d3/d54/d62/d77/d92/dc5/fb2 [0,4194304] 0 2024-04-25T13:47:09.766 INFO:tasks.workunit.client.0.smithi043.stdout:4/655: chown d1/d34/d35 12180082 1 2024-04-25T13:47:09.767 INFO:tasks.workunit.client.0.smithi043.stdout:8/763: mkdir db/d38/d77/df7 0 2024-04-25T13:47:09.768 INFO:tasks.workunit.client.0.smithi043.stdout:3/694: fsync d0/d13/f27 0 2024-04-25T13:47:09.770 INFO:tasks.workunit.client.0.smithi043.stdout:8/764: fsync db/d38/de4/d59/f7b 0 2024-04-25T13:47:09.772 INFO:tasks.workunit.client.0.smithi043.stdout:2/603: write d0/d34/d17/d5e/f92 [41337,71890] 0 2024-04-25T13:47:09.772 INFO:tasks.workunit.client.0.smithi043.stdout:3/695: read d0/f4 [2621704,15462] 0 2024-04-25T13:47:09.773 INFO:tasks.workunit.client.0.smithi043.stdout:4/656: creat d1/de/df/d1e/d45/da1/db3/fd7 x:0 0 0 2024-04-25T13:47:09.775 INFO:tasks.workunit.client.0.smithi043.stdout:7/829: dwrite d5/d75/f10f [0,4194304] 0 2024-04-25T13:47:09.780 INFO:tasks.workunit.client.0.smithi043.stdout:8/765: mknod db/d38/de4/dcb/cf8 0 2024-04-25T13:47:09.781 INFO:tasks.workunit.client.0.smithi043.stdout:7/830: mknod d5/d11/d80/c117 0 2024-04-25T13:47:09.788 INFO:tasks.workunit.client.0.smithi043.stdout:7/831: write d5/d6b/ffc [760675,32285] 0 2024-04-25T13:47:09.790 INFO:tasks.workunit.client.0.smithi043.stdout:8/766: write db/d44/d8e/d27/f75 [663805,51139] 0 2024-04-25T13:47:09.790 INFO:tasks.workunit.client.0.smithi043.stdout:7/832: read - d5/d11/d3b/d61/dc5/fdd zero size 2024-04-25T13:47:09.792 INFO:tasks.workunit.client.0.smithi043.stdout:2/604: rename d0/d34/d3f/d59/f62 to d0/d34/d3f/d59/fb4 0 2024-04-25T13:47:09.795 INFO:tasks.workunit.client.0.smithi043.stdout:5/634: sync 2024-04-25T13:47:09.800 INFO:tasks.workunit.client.0.smithi043.stdout:3/696: link d0/d61/fe3 d0/d9/d6e/d34/d36/fea 0 2024-04-25T13:47:09.802 INFO:tasks.workunit.client.0.smithi043.stdout:5/635: write d1/d3/d7/d8/df/d98/fae [75052,45963] 0 2024-04-25T13:47:09.805 INFO:tasks.workunit.client.0.smithi043.stdout:8/767: dwrite db/d44/d5c/fae [0,4194304] 0 2024-04-25T13:47:09.806 INFO:tasks.workunit.client.0.smithi043.stdout:2/605: dwrite d0/d34/d3f/d46/d55/f80 [0,4194304] 0 2024-04-25T13:47:09.808 INFO:tasks.workunit.client.0.smithi043.stdout:7/833: dwrite d5/d11/d3b/d61/f7c [4194304,4194304] 0 2024-04-25T13:47:09.809 INFO:tasks.workunit.client.0.smithi043.stdout:8/768: mkdir db/d46/df9 0 2024-04-25T13:47:09.813 INFO:tasks.workunit.client.0.smithi043.stdout:2/606: unlink d0/d4b/c67 0 2024-04-25T13:47:09.815 INFO:tasks.workunit.client.0.smithi043.stdout:2/607: write d0/d26/f4d [1633479,68182] 0 2024-04-25T13:47:09.816 INFO:tasks.workunit.client.0.smithi043.stdout:7/834: symlink d5/d11/d3b/l118 0 2024-04-25T13:47:09.819 INFO:tasks.workunit.client.0.smithi043.stdout:5/636: write d1/d3/d7/d2f/d80/fcc [4528343,73714] 0 2024-04-25T13:47:09.821 INFO:tasks.workunit.client.0.smithi043.stdout:2/608: write d0/d34/d3f/d59/fb4 [6119864,107524] 0 2024-04-25T13:47:09.826 INFO:tasks.workunit.client.0.smithi043.stdout:3/697: truncate d0/da/db9/fdb 1013916 0 2024-04-25T13:47:09.828 INFO:tasks.workunit.client.0.smithi043.stdout:7/835: mkdir d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/df0/d119 0 2024-04-25T13:47:09.830 INFO:tasks.workunit.client.0.smithi043.stdout:2/609: mknod d0/d4b/cb5 0 2024-04-25T13:47:09.830 INFO:tasks.workunit.client.0.smithi043.stdout:3/698: mknod d0/da/db9/d9e/ceb 0 2024-04-25T13:47:09.834 INFO:tasks.workunit.client.0.smithi043.stdout:3/699: mknod d0/d9/d6e/d38/d3f/cec 0 2024-04-25T13:47:09.837 INFO:tasks.workunit.client.0.smithi043.stdout:7/836: dwrite d5/d11/d3b/fc2 [0,4194304] 0 2024-04-25T13:47:09.839 INFO:tasks.workunit.client.0.smithi043.stdout:5/637: write d1/d3/d7/f23 [7746002,46830] 0 2024-04-25T13:47:09.844 INFO:tasks.workunit.client.0.smithi043.stdout:3/700: dwrite d0/d13/d55/fa9 [0,4194304] 0 2024-04-25T13:47:09.847 INFO:tasks.workunit.client.0.smithi043.stdout:3/701: read d0/d9/d6e/d34/f7f [1726864,105163] 0 2024-04-25T13:47:09.848 INFO:tasks.workunit.client.0.smithi043.stdout:5/638: mknod d1/d3/d7/d8/da/d11/d52/cd3 0 2024-04-25T13:47:09.850 INFO:tasks.workunit.client.0.smithi043.stdout:3/702: creat d0/da/db9/d9e/fed x:0 0 0 2024-04-25T13:47:09.851 INFO:tasks.workunit.client.0.smithi043.stdout:5/639: creat d1/d3/d7/d2f/d80/fd4 x:0 0 0 2024-04-25T13:47:09.853 INFO:tasks.workunit.client.0.smithi043.stdout:5/640: fdatasync d1/d3/d7/d2f/d67/f8a 0 2024-04-25T13:47:09.854 INFO:tasks.workunit.client.0.smithi043.stdout:3/703: fdatasync d0/d9/f45 0 2024-04-25T13:47:09.855 INFO:tasks.workunit.client.0.smithi043.stdout:5/641: readlink d1/d3/d7/d2f/d67/la6 0 2024-04-25T13:47:09.856 INFO:tasks.workunit.client.0.smithi043.stdout:5/642: write d1/d3/d7/d8/f44 [4299583,97720] 0 2024-04-25T13:47:09.860 INFO:tasks.workunit.client.0.smithi043.stdout:3/704: getdents d0/d9/d6e/d34/d36/d57/de5/dc2 0 2024-04-25T13:47:09.863 INFO:tasks.workunit.client.0.smithi043.stdout:5/643: dwrite d1/d3/f81 [4194304,4194304] 0 2024-04-25T13:47:09.866 INFO:tasks.workunit.client.0.smithi043.stdout:7/837: dread d5/d11/d3b/d61/dc5/fcf [0,4194304] 0 2024-04-25T13:47:09.867 INFO:tasks.workunit.client.0.smithi043.stdout:5/644: mknod d1/d4/d42/dcb/cd5 0 2024-04-25T13:47:09.869 INFO:tasks.workunit.client.0.smithi043.stdout:7/838: write d5/d11/d3b/d61/dc5/dee/d5a/ff1 [48429,93441] 0 2024-04-25T13:47:09.872 INFO:tasks.workunit.client.0.smithi043.stdout:7/839: read d5/f5d [4166324,95241] 0 2024-04-25T13:47:09.872 INFO:tasks.workunit.client.0.smithi043.stdout:5/645: truncate d1/d3/d62/f9f 348238 0 2024-04-25T13:47:09.874 INFO:tasks.workunit.client.0.smithi043.stdout:5/646: chown d1/d4/d42/lc3 7409135 1 2024-04-25T13:47:09.877 INFO:tasks.workunit.client.0.smithi043.stdout:5/647: creat d1/d3/fd6 x:0 0 0 2024-04-25T13:47:09.879 INFO:tasks.workunit.client.0.smithi043.stdout:7/840: dwrite d5/d75/f10f [0,4194304] 0 2024-04-25T13:47:09.882 INFO:tasks.workunit.client.0.smithi043.stdout:7/841: write d5/d11/d3b/d8b/d93/f110 [297197,59756] 0 2024-04-25T13:47:09.883 INFO:tasks.workunit.client.0.smithi043.stdout:7/842: write d5/d75/f10f [4870850,51661] 0 2024-04-25T13:47:09.885 INFO:tasks.workunit.client.0.smithi043.stdout:1/696: sync 2024-04-25T13:47:09.885 INFO:tasks.workunit.client.0.smithi043.stdout:0/694: sync 2024-04-25T13:47:09.889 INFO:tasks.workunit.client.0.smithi043.stdout:7/843: mknod d5/d11/d3b/d61/dc5/dcc/df8/c11a 0 2024-04-25T13:47:09.890 INFO:tasks.workunit.client.0.smithi043.stdout:0/695: mkdir db/d1b/d94/da1/de2/de9 0 2024-04-25T13:47:09.892 INFO:tasks.workunit.client.0.smithi043.stdout:1/697: getdents df/d31/d38/d43/d81 0 2024-04-25T13:47:09.901 INFO:tasks.workunit.client.0.smithi043.stdout:0/696: truncate db/d1b/d36/d41/daf/fc9 642736 0 2024-04-25T13:47:09.901 INFO:tasks.workunit.client.0.smithi043.stdout:5/648: dread d1/d3/d26/f2a [0,4194304] 0 2024-04-25T13:47:09.902 INFO:tasks.workunit.client.0.smithi043.stdout:1/698: fsync df/d14/d63/d67/da7/fe1 0 2024-04-25T13:47:09.903 INFO:tasks.workunit.client.0.smithi043.stdout:5/649: write d1/d3/d7/d8/df/d28/faf [389620,21080] 0 2024-04-25T13:47:09.904 INFO:tasks.workunit.client.0.smithi043.stdout:5/650: chown d1/d3/d7/l78 4058518 1 2024-04-25T13:47:09.905 INFO:tasks.workunit.client.0.smithi043.stdout:1/699: mknod df/d10/d22/d2f/d9c/cfa 0 2024-04-25T13:47:09.908 INFO:tasks.workunit.client.0.smithi043.stdout:1/700: creat df/d31/d34/d8b/ddd/ffb x:0 0 0 2024-04-25T13:47:09.909 INFO:tasks.workunit.client.0.smithi043.stdout:1/701: readlink df/d31/d38/d43/d53/l68 0 2024-04-25T13:47:09.910 INFO:tasks.workunit.client.0.smithi043.stdout:5/651: getdents d1/d4/d42/dcb 0 2024-04-25T13:47:09.913 INFO:tasks.workunit.client.0.smithi043.stdout:5/652: symlink d1/d8d/ld7 0 2024-04-25T13:47:09.914 INFO:tasks.workunit.client.0.smithi043.stdout:0/697: rmdir db/d25/d2a/d9d 39 2024-04-25T13:47:09.918 INFO:tasks.workunit.client.0.smithi043.stdout:5/653: chown d1/d3/d7/d2f/d80/db6 1 1 2024-04-25T13:47:09.918 INFO:tasks.workunit.client.0.smithi043.stdout:5/654: creat d1/d4/d92/d95/fd8 x:0 0 0 2024-04-25T13:47:09.920 INFO:tasks.workunit.client.0.smithi043.stdout:1/702: dwrite df/d10/d22/d2f/d9c/fa1 [0,4194304] 0 2024-04-25T13:47:09.928 INFO:tasks.workunit.client.0.smithi043.stdout:5/655: dwrite d1/d4/d92/d95/fbc [0,4194304] 0 2024-04-25T13:47:09.933 INFO:tasks.workunit.client.0.smithi043.stdout:5/656: creat d1/d3/d7/d9/d2d/d5b/fd9 x:0 0 0 2024-04-25T13:47:09.936 INFO:tasks.workunit.client.0.smithi043.stdout:5/657: creat d1/d8d/db8/fda x:0 0 0 2024-04-25T13:47:09.939 INFO:tasks.workunit.client.0.smithi043.stdout:5/658: creat d1/d8d/db8/fdb x:0 0 0 2024-04-25T13:47:09.940 INFO:tasks.workunit.client.0.smithi043.stdout:1/703: dread df/d14/d3d/d82/d8c/f9b [0,4194304] 0 2024-04-25T13:47:09.944 INFO:tasks.workunit.client.0.smithi043.stdout:1/704: dread df/d14/d3d/d82/d8c/f9b [0,4194304] 0 2024-04-25T13:47:09.948 INFO:tasks.workunit.client.0.smithi043.stdout:1/705: write df/d31/dc7/dc8/fed [3570566,21013] 0 2024-04-25T13:47:09.950 INFO:tasks.workunit.client.0.smithi043.stdout:1/706: write df/d31/dc7/dc8/dd2/fde [689600,103776] 0 2024-04-25T13:47:09.951 INFO:tasks.workunit.client.0.smithi043.stdout:1/707: fdatasync df/d14/fa8 0 2024-04-25T13:47:09.955 INFO:tasks.workunit.client.0.smithi043.stdout:1/708: symlink df/d31/d34/d8b/d39/lfc 0 2024-04-25T13:47:09.957 INFO:tasks.workunit.client.0.smithi043.stdout:1/709: creat df/d31/d38/d43/dbc/ffd x:0 0 0 2024-04-25T13:47:09.959 INFO:tasks.workunit.client.0.smithi043.stdout:1/710: mknod df/d31/dc7/cfe 0 2024-04-25T13:47:09.962 INFO:tasks.workunit.client.0.smithi043.stdout:1/711: symlink df/d31/d34/d8b/lff 0 2024-04-25T13:47:09.963 INFO:tasks.workunit.client.0.smithi043.stdout:5/659: dread d1/d3/d7/d8/f44 [0,4194304] 0 2024-04-25T13:47:09.971 INFO:tasks.workunit.client.0.smithi043.stdout:5/660: dread d1/d3/d7/d2f/d80/fbb [0,4194304] 0 2024-04-25T13:47:09.980 INFO:tasks.workunit.client.0.smithi043.stdout:1/712: dread df/d10/d22/d2f/f4f [0,4194304] 0 2024-04-25T13:47:09.981 INFO:tasks.workunit.client.0.smithi043.stdout:5/661: dwrite d1/d3/d7/f70 [0,4194304] 0 2024-04-25T13:47:09.982 INFO:tasks.workunit.client.0.smithi043.stdout:1/713: chown df/d31/d38/d43/d6e/dea 5 1 2024-04-25T13:47:09.983 INFO:tasks.workunit.client.0.smithi043.stdout:1/714: write df/d31/d34/f94 [331888,62661] 0 2024-04-25T13:47:09.988 INFO:tasks.workunit.client.0.smithi043.stdout:5/662: truncate d1/d4/d42/f97 1876418 0 2024-04-25T13:47:09.998 INFO:tasks.workunit.client.0.smithi043.stdout:1/715: dread df/d31/f48 [0,4194304] 0 2024-04-25T13:47:10.000 INFO:tasks.workunit.client.0.smithi043.stdout:1/716: creat df/d31/dc7/f100 x:0 0 0 2024-04-25T13:47:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:6/763: sync 2024-04-25T13:47:10.007 INFO:tasks.workunit.client.0.smithi043.stdout:4/657: sync 2024-04-25T13:47:10.011 INFO:tasks.workunit.client.0.smithi043.stdout:6/764: getdents d0/d76/de3/da7 0 2024-04-25T13:47:10.013 INFO:tasks.workunit.client.0.smithi043.stdout:4/658: mknod d1/de/df/db4/d36/d9e/d9d/cd8 0 2024-04-25T13:47:10.013 INFO:tasks.workunit.client.0.smithi043.stdout:6/765: symlink d0/d90/dd9/l100 0 2024-04-25T13:47:10.014 INFO:tasks.workunit.client.0.smithi043.stdout:4/659: dread - d1/d34/d83/fc7 zero size 2024-04-25T13:47:10.014 INFO:tasks.workunit.client.0.smithi043.stdout:5/663: dread d1/d3/d7/d8/da/f88 [0,4194304] 0 2024-04-25T13:47:10.015 INFO:tasks.workunit.client.0.smithi043.stdout:6/766: mkdir d0/d90/dd9/d101 0 2024-04-25T13:47:10.018 INFO:tasks.workunit.client.0.smithi043.stdout:5/664: creat d1/d3/d7/d9/fdc x:0 0 0 2024-04-25T13:47:10.020 INFO:tasks.workunit.client.0.smithi043.stdout:4/660: dwrite d1/d3/d54/d62/f90 [0,4194304] 0 2024-04-25T13:47:10.023 INFO:tasks.workunit.client.0.smithi043.stdout:4/661: truncate d1/d3/d54/d62/d77/d79/fca 545365 0 2024-04-25T13:47:10.024 INFO:tasks.workunit.client.0.smithi043.stdout:6/767: truncate d0/d90/f45 3113324 0 2024-04-25T13:47:10.029 INFO:tasks.workunit.client.0.smithi043.stdout:4/662: rmdir d1/de/d1d/dd6 0 2024-04-25T13:47:10.030 INFO:tasks.workunit.client.0.smithi043.stdout:6/768: read d0/d3d/d54/f68 [163562,117964] 0 2024-04-25T13:47:10.031 INFO:tasks.workunit.client.0.smithi043.stdout:4/663: write d1/de/df/d1e/d45/f9f [755494,22792] 0 2024-04-25T13:47:10.033 INFO:tasks.workunit.client.0.smithi043.stdout:6/769: symlink d0/d3d/l102 0 2024-04-25T13:47:10.034 INFO:tasks.workunit.client.0.smithi043.stdout:6/770: fdatasync d0/d3d/d6e/d71/f8f 0 2024-04-25T13:47:10.034 INFO:tasks.workunit.client.0.smithi043.stdout:6/771: readlink d0/d24/d3a/lbb 0 2024-04-25T13:47:10.053 INFO:tasks.workunit.client.0.smithi043.stdout:6/772: link d0/d76/de3/d64/f9b d0/d76/f103 0 2024-04-25T13:47:10.055 INFO:tasks.workunit.client.0.smithi043.stdout:6/773: write d0/d76/de3/da7/fae [1257196,121400] 0 2024-04-25T13:47:10.055 INFO:tasks.workunit.client.0.smithi043.stdout:6/774: fsync d0/d90/d4c/fec 0 2024-04-25T13:47:10.056 INFO:tasks.workunit.client.0.smithi043.stdout:6/775: write d0/d76/de3/d64/ffe [767566,52437] 0 2024-04-25T13:47:10.073 INFO:tasks.workunit.client.0.smithi043.stdout:6/776: dread d0/d90/d48/fdb [0,4194304] 0 2024-04-25T13:47:10.170 INFO:tasks.workunit.client.0.smithi043.stdout:0/698: sync 2024-04-25T13:47:10.171 INFO:tasks.workunit.client.0.smithi043.stdout:1/717: sync 2024-04-25T13:47:10.171 INFO:tasks.workunit.client.0.smithi043.stdout:1/718: stat df/d31/d34/d91 0 2024-04-25T13:47:10.173 INFO:tasks.workunit.client.0.smithi043.stdout:0/699: creat db/d1b/d23/d27/d39/d4c/dbb/fea x:0 0 0 2024-04-25T13:47:10.173 INFO:tasks.workunit.client.0.smithi043.stdout:0/700: readlink db/d1b/d62/ldd 0 2024-04-25T13:47:10.174 INFO:tasks.workunit.client.0.smithi043.stdout:1/719: truncate df/d14/d63/d67/d9f/fb5 3896890 0 2024-04-25T13:47:10.176 INFO:tasks.workunit.client.0.smithi043.stdout:0/701: unlink f7 0 2024-04-25T13:47:10.177 INFO:tasks.workunit.client.0.smithi043.stdout:1/720: creat df/d10/d22/d2f/d9c/f101 x:0 0 0 2024-04-25T13:47:10.177 INFO:tasks.workunit.client.0.smithi043.stdout:0/702: write db/d1b/d23/d27/d39/d4c/f70 [1295560,48997] 0 2024-04-25T13:47:10.178 INFO:tasks.workunit.client.0.smithi043.stdout:0/703: stat db/d1b/d23/d27/dcb 0 2024-04-25T13:47:10.179 INFO:tasks.workunit.client.0.smithi043.stdout:0/704: dread - db/d1b/d23/d27/d39/d4c/dbb/fbd zero size 2024-04-25T13:47:10.180 INFO:tasks.workunit.client.0.smithi043.stdout:1/721: mknod df/d31/d34/d8b/ddd/c102 0 2024-04-25T13:47:10.181 INFO:tasks.workunit.client.0.smithi043.stdout:1/722: chown df/d14/d63/d67/da7/fe1 64400124 1 2024-04-25T13:47:10.184 INFO:tasks.workunit.client.0.smithi043.stdout:1/723: truncate df/d14/d63/d67/da7/fc0 626066 0 2024-04-25T13:47:10.186 INFO:tasks.workunit.client.0.smithi043.stdout:1/724: symlink df/d31/d38/l103 0 2024-04-25T13:47:10.188 INFO:tasks.workunit.client.0.smithi043.stdout:1/725: rmdir df/d14/d63/d67 39 2024-04-25T13:47:10.190 INFO:tasks.workunit.client.0.smithi043.stdout:1/726: symlink df/d31/d34/l104 0 2024-04-25T13:47:10.195 INFO:tasks.workunit.client.0.smithi043.stdout:0/705: dread db/f2d [0,4194304] 0 2024-04-25T13:47:10.198 INFO:tasks.workunit.client.0.smithi043.stdout:0/706: chown db/d25/d2a/d9d/fbe 699 1 2024-04-25T13:47:10.200 INFO:tasks.workunit.client.0.smithi043.stdout:0/707: write db/d25/d2a/d3f/d6a/d86/fa4 [422735,32890] 0 2024-04-25T13:47:10.200 INFO:tasks.workunit.client.0.smithi043.stdout:0/708: stat db/d1b/d94 0 2024-04-25T13:47:10.210 INFO:tasks.workunit.client.0.smithi043.stdout:0/709: dwrite db/d1b/d23/d27/fdf [0,4194304] 0 2024-04-25T13:47:10.211 INFO:tasks.workunit.client.0.smithi043.stdout:0/710: creat db/d1b/d62/feb x:0 0 0 2024-04-25T13:47:10.218 INFO:tasks.workunit.client.0.smithi043.stdout:0/711: truncate db/f18 4998759 0 2024-04-25T13:47:10.224 INFO:tasks.workunit.client.0.smithi043.stdout:0/712: truncate db/d1b/d23/d27/fa0 3848899 0 2024-04-25T13:47:10.227 INFO:tasks.workunit.client.0.smithi043.stdout:0/713: creat db/d25/d2a/d3f/fec x:0 0 0 2024-04-25T13:47:10.227 INFO:tasks.workunit.client.0.smithi043.stdout:0/714: stat db/d25/d2a/l3c 0 2024-04-25T13:47:10.233 INFO:tasks.workunit.client.0.smithi043.stdout:0/715: write db/d1b/d23/d27/f5c [4220028,111368] 0 2024-04-25T13:47:10.257 INFO:tasks.workunit.client.0.smithi043.stdout:6/777: sync 2024-04-25T13:47:10.279 INFO:tasks.workunit.client.0.smithi043.stdout:1/727: sync 2024-04-25T13:47:10.281 INFO:tasks.workunit.client.0.smithi043.stdout:1/728: rmdir df/d31/d34/d91 39 2024-04-25T13:47:10.282 INFO:tasks.workunit.client.0.smithi043.stdout:1/729: truncate df/f35 552641 0 2024-04-25T13:47:10.282 INFO:tasks.workunit.client.0.smithi043.stdout:1/730: stat df/d31/d34/l104 0 2024-04-25T13:47:10.283 INFO:tasks.workunit.client.0.smithi043.stdout:1/731: stat df/d14/c15 0 2024-04-25T13:47:10.286 INFO:tasks.workunit.client.0.smithi043.stdout:1/732: mknod df/d14/d3d/d82/c105 0 2024-04-25T13:47:10.288 INFO:tasks.workunit.client.0.smithi043.stdout:1/733: read df/d14/d3d/d82/d8c/f92 [1133743,52162] 0 2024-04-25T13:47:11.103 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:10 smithi161 ceph-mon[32696]: pgmap v80: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 181 MiB/s wr, 353 op/s 2024-04-25T13:47:11.116 INFO:tasks.workunit.client.0.smithi043.stdout:8/769: rename db/d38/d40/f9d to db/d38/de4/d59/d7c/daf/ffa 0 2024-04-25T13:47:11.117 INFO:tasks.workunit.client.0.smithi043.stdout:8/770: dread - db/d38/d3c/d71/d5d/fda zero size 2024-04-25T13:47:11.120 INFO:tasks.workunit.client.0.smithi043.stdout:8/771: getdents db/d11/d79/df0 0 2024-04-25T13:47:11.125 INFO:tasks.workunit.client.0.smithi043.stdout:8/772: write db/d44/d8e/f96 [2730702,27187] 0 2024-04-25T13:47:11.125 INFO:tasks.workunit.client.0.smithi043.stdout:2/610: rename d0/d34/d3f/d46/d55/f65 to d0/d8/d22/d36/fb6 0 2024-04-25T13:47:11.125 INFO:tasks.workunit.client.0.smithi043.stdout:2/611: chown d0/l6 173720294 1 2024-04-25T13:47:11.128 INFO:tasks.workunit.client.0.smithi043.stdout:8/773: mknod db/d38/d3c/d71/d5d/d67/cfb 0 2024-04-25T13:47:11.129 INFO:tasks.workunit.client.0.smithi043.stdout:8/774: write db/d38/de4/d59/d7c/fc8 [241153,63158] 0 2024-04-25T13:47:11.131 INFO:tasks.workunit.client.0.smithi043.stdout:8/775: rmdir db/dc/d21/dc7 39 2024-04-25T13:47:11.136 INFO:tasks.workunit.client.0.smithi043.stdout:8/776: getdents db/d38 0 2024-04-25T13:47:11.138 INFO:tasks.workunit.client.0.smithi043.stdout:2/612: dread d0/d8/ff [0,4194304] 0 2024-04-25T13:47:11.139 INFO:tasks.workunit.client.0.smithi043.stdout:8/777: symlink db/d38/d3c/d71/lfc 0 2024-04-25T13:47:11.139 INFO:tasks.workunit.client.0.smithi043.stdout:8/778: stat db/l60 0 2024-04-25T13:47:11.141 INFO:tasks.workunit.client.0.smithi043.stdout:8/779: symlink db/d7d/lfd 0 2024-04-25T13:47:11.142 INFO:tasks.workunit.client.0.smithi043.stdout:8/780: fdatasync db/dc/d21/d4e/d62/fe6 0 2024-04-25T13:47:11.142 INFO:tasks.workunit.client.0.smithi043.stdout:3/705: rename d0/d9/d6e/d34/d36/fea to d0/d9/fee 0 2024-04-25T13:47:11.147 INFO:tasks.workunit.client.0.smithi043.stdout:7/844: rename d5/d11/d3b/d61/c7f to d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/df0/d119/c11b 0 2024-04-25T13:47:11.148 INFO:tasks.workunit.client.0.smithi043.stdout:8/781: symlink db/d38/de4/d59/d7c/lfe 0 2024-04-25T13:47:11.149 INFO:tasks.workunit.client.0.smithi043.stdout:3/706: mknod d0/d9/d6e/d34/d36/d57/cef 0 2024-04-25T13:47:11.149 INFO:tasks.workunit.client.0.smithi043.stdout:5/665: rename d1/d3 to d1/d3/d7/ddd 22 2024-04-25T13:47:11.150 INFO:tasks.workunit.client.0.smithi043.stdout:8/782: write db/d38/f82 [679658,103768] 0 2024-04-25T13:47:11.152 INFO:tasks.workunit.client.0.smithi043.stdout:7/845: mkdir d5/d11/d3b/d8b/d11c 0 2024-04-25T13:47:11.152 INFO:tasks.workunit.client.0.smithi043.stdout:7/846: chown d5/d6b 39966398 1 2024-04-25T13:47:11.155 INFO:tasks.workunit.client.0.smithi043.stdout:4/664: rename d1/de/df/l26 to d1/de/df/d1e/d45/ld9 0 2024-04-25T13:47:11.155 INFO:tasks.workunit.client.0.smithi043.stdout:7/847: write d5/d11/d3b/d61/dc5/f105 [437411,88462] 0 2024-04-25T13:47:11.157 INFO:tasks.workunit.client.0.smithi043.stdout:4/665: fdatasync d1/de/df/d1e/d45/da1/db3/d33/f74 0 2024-04-25T13:47:11.159 INFO:tasks.workunit.client.0.smithi043.stdout:3/707: truncate d0/d13/f73 180409 0 2024-04-25T13:47:11.160 INFO:tasks.workunit.client.0.smithi043.stdout:2/613: dread d0/d34/d17/f41 [0,4194304] 0 2024-04-25T13:47:11.162 INFO:tasks.workunit.client.0.smithi043.stdout:4/666: truncate d1/de/df/d1e/d45/da1/db3/fd7 337065 0 2024-04-25T13:47:11.163 INFO:tasks.workunit.client.0.smithi043.stdout:0/716: rename db/d1b/d62/d72/f9a to db/d1b/fed 0 2024-04-25T13:47:11.163 INFO:tasks.workunit.client.0.smithi043.stdout:3/708: mknod d0/d13/d2e/cf0 0 2024-04-25T13:47:11.165 INFO:tasks.workunit.client.0.smithi043.stdout:7/848: creat d5/d11/d3b/d61/dc5/dee/d5a/d8d/f11d x:0 0 0 2024-04-25T13:47:11.165 INFO:tasks.workunit.client.0.smithi043.stdout:3/709: chown d0/d9/d6e/d38/d3f 6283582 1 2024-04-25T13:47:11.165 INFO:tasks.workunit.client.0.smithi043.stdout:0/717: chown db/d1b/d36/lda 371250977 1 2024-04-25T13:47:11.168 INFO:tasks.workunit.client.0.smithi043.stdout:4/667: creat d1/de/df/db4/fda x:0 0 0 2024-04-25T13:47:11.169 INFO:tasks.workunit.client.0.smithi043.stdout:4/668: readlink d1/de/df/d1a/d49/l6b 0 2024-04-25T13:47:11.170 INFO:tasks.workunit.client.0.smithi043.stdout:6/778: rename d0/d1c/c2a to d0/d90/db0/c104 0 2024-04-25T13:47:11.172 INFO:tasks.workunit.client.0.smithi043.stdout:2/614: rmdir d0/d8/d22/d5c 39 2024-04-25T13:47:11.173 INFO:tasks.workunit.client.0.smithi043.stdout:8/783: dwrite db/d7d/f9b [0,4194304] 0 2024-04-25T13:47:11.175 INFO:tasks.workunit.client.0.smithi043.stdout:4/669: creat d1/d3/d54/d62/dba/fdb x:0 0 0 2024-04-25T13:47:11.176 INFO:tasks.workunit.client.0.smithi043.stdout:3/710: symlink d0/d9/d6e/d34/d36/d57/de5/lf1 0 2024-04-25T13:47:11.177 INFO:tasks.workunit.client.0.smithi043.stdout:2/615: creat d0/d34/d17/d5e/d71/fb7 x:0 0 0 2024-04-25T13:47:11.180 INFO:tasks.workunit.client.0.smithi043.stdout:1/734: rename df/d14/d63/d71 to df/d31/d38/d43/d53/d106 0 2024-04-25T13:47:11.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:10 smithi175 ceph-mon[32649]: pgmap v80: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 181 MiB/s wr, 353 op/s 2024-04-25T13:47:11.181 INFO:tasks.workunit.client.0.smithi043.stdout:4/670: creat d1/d3/d54/d62/d77/fdc x:0 0 0 2024-04-25T13:47:11.183 INFO:tasks.workunit.client.0.smithi043.stdout:6/779: creat d0/d76/de3/d64/da1/f105 x:0 0 0 2024-04-25T13:47:11.187 INFO:tasks.workunit.client.0.smithi043.stdout:7/849: dwrite d5/d11/d3b/fb9 [0,4194304] 0 2024-04-25T13:47:11.189 INFO:tasks.workunit.client.0.smithi043.stdout:1/735: write df/d14/d63/d67/d9f/fdc [113146,98795] 0 2024-04-25T13:47:11.189 INFO:tasks.workunit.client.0.smithi043.stdout:0/718: rename db/d1b/d23/d27/l73 to db/d25/d2a/d3f/lee 0 2024-04-25T13:47:11.193 INFO:tasks.workunit.client.0.smithi043.stdout:8/784: dwrite db/d46/fa5 [0,4194304] 0 2024-04-25T13:47:11.194 INFO:tasks.workunit.client.0.smithi043.stdout:0/719: chown db/d1b/d94/da1/de2/de9 12884 1 2024-04-25T13:47:11.197 INFO:tasks.workunit.client.0.smithi043.stdout:6/780: read d0/d76/f7c [1468658,55742] 0 2024-04-25T13:47:11.198 INFO:tasks.workunit.client.0.smithi043.stdout:4/671: dread d1/de/df/d1e/d45/da1/db3/fd7 [0,4194304] 0 2024-04-25T13:47:11.200 INFO:tasks.workunit.client.0.smithi043.stdout:2/616: write d0/d34/d3f/d46/d55/fb2 [1808557,128235] 0 2024-04-25T13:47:11.200 INFO:tasks.workunit.client.0.smithi043.stdout:8/785: creat db/d7d/df2/fff x:0 0 0 2024-04-25T13:47:11.200 INFO:tasks.workunit.client.0.smithi043.stdout:6/781: mknod d0/d90/db0/c106 0 2024-04-25T13:47:11.202 INFO:tasks.workunit.client.0.smithi043.stdout:4/672: mknod d1/de/df/db4/cdd 0 2024-04-25T13:47:11.204 INFO:tasks.workunit.client.0.smithi043.stdout:3/711: creat d0/d9/d6e/d34/d36/d57/de5/dc2/ff2 x:0 0 0 2024-04-25T13:47:11.204 INFO:tasks.workunit.client.0.smithi043.stdout:2/617: mknod d0/d4b/cb8 0 2024-04-25T13:47:11.207 INFO:tasks.workunit.client.0.smithi043.stdout:6/782: mkdir d0/d90/d4c/d107 0 2024-04-25T13:47:11.207 INFO:tasks.workunit.client.0.smithi043.stdout:2/618: read - d0/fa1 zero size 2024-04-25T13:47:11.210 INFO:tasks.workunit.client.0.smithi043.stdout:7/850: dwrite d5/d11/d3b/f10e [0,4194304] 0 2024-04-25T13:47:11.211 INFO:tasks.workunit.client.0.smithi043.stdout:2/619: dread - d0/d34/d17/d5e/d86/fac zero size 2024-04-25T13:47:11.211 INFO:tasks.workunit.client.0.smithi043.stdout:6/783: unlink d0/d3d/lcb 0 2024-04-25T13:47:11.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:10 smithi043 ceph-mon[29195]: pgmap v80: 129 pgs: 129 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 181 MiB/s wr, 353 op/s 2024-04-25T13:47:11.212 INFO:tasks.workunit.client.0.smithi043.stdout:3/712: creat d0/d9/d6e/dc5/ff3 x:0 0 0 2024-04-25T13:47:11.213 INFO:tasks.workunit.client.0.smithi043.stdout:2/620: dread - d0/d34/d17/f89 zero size 2024-04-25T13:47:11.216 INFO:tasks.workunit.client.0.smithi043.stdout:8/786: read db/d11/f15 [3478156,89635] 0 2024-04-25T13:47:11.216 INFO:tasks.workunit.client.0.smithi043.stdout:3/713: fdatasync d0/d9/d6e/d34/d36/d57/fe8 0 2024-04-25T13:47:11.219 INFO:tasks.workunit.client.0.smithi043.stdout:4/673: truncate d1/d3/d54/d62/d77/d79/f60 3090876 0 2024-04-25T13:47:11.222 INFO:tasks.workunit.client.0.smithi043.stdout:7/851: dwrite d5/d11/d3b/d61/dc5/dee/d5a/f76 [4194304,4194304] 0 2024-04-25T13:47:11.226 INFO:tasks.workunit.client.0.smithi043.stdout:4/674: creat d1/de/df/d1e/d45/da1/db3/fde x:0 0 0 2024-04-25T13:47:11.227 INFO:tasks.workunit.client.0.smithi043.stdout:3/714: mknod d0/d13/d5a/cf4 0 2024-04-25T13:47:11.228 INFO:tasks.workunit.client.0.smithi043.stdout:3/715: chown d0/d9/d6e/d34/d36/d57/de5/lf1 4 1 2024-04-25T13:47:11.228 INFO:tasks.workunit.client.0.smithi043.stdout:7/852: mkdir d5/d11/d3b/d61/dc5/dee/d116/d11e 0 2024-04-25T13:47:11.230 INFO:tasks.workunit.client.0.smithi043.stdout:3/716: fsync d0/d9/fee 0 2024-04-25T13:47:11.235 INFO:tasks.workunit.client.0.smithi043.stdout:7/853: creat d5/d11/d3b/d61/dc5/dcc/f11f x:0 0 0 2024-04-25T13:47:11.238 INFO:tasks.workunit.client.0.smithi043.stdout:8/787: write db/dc/d80/fd6 [512800,87440] 0 2024-04-25T13:47:11.239 INFO:tasks.workunit.client.0.smithi043.stdout:4/675: dwrite d1/de/df/d1a/f58 [0,4194304] 0 2024-04-25T13:47:11.244 INFO:tasks.workunit.client.0.smithi043.stdout:0/720: rename db/d1b/d23/d27/d39/d4b/f55 to db/d25/d2a/d3f/d6a/d86/fef 0 2024-04-25T13:47:11.246 INFO:tasks.workunit.client.0.smithi043.stdout:4/676: creat d1/de/df/db4/d36/d53/fdf x:0 0 0 2024-04-25T13:47:11.249 INFO:tasks.workunit.client.0.smithi043.stdout:8/788: dwrite db/d38/de4/d59/fcf [0,4194304] 0 2024-04-25T13:47:11.250 INFO:tasks.workunit.client.0.smithi043.stdout:4/677: read - d1/de/df/d1e/d45/da1/db3/f84 zero size 2024-04-25T13:47:11.251 INFO:tasks.workunit.client.0.smithi043.stdout:0/721: fsync db/d1b/d23/d27/d39/d4c/da9/fac 0 2024-04-25T13:47:11.262 INFO:tasks.workunit.client.0.smithi043.stdout:4/678: dwrite d1/de/df/d1a/f47 [0,4194304] 0 2024-04-25T13:47:11.268 INFO:tasks.workunit.client.0.smithi043.stdout:2/621: dread d0/d8/d22/d36/fb6 [0,4194304] 0 2024-04-25T13:47:11.270 INFO:tasks.workunit.client.0.smithi043.stdout:7/854: dread d5/d11/d3b/d61/f7c [0,4194304] 0 2024-04-25T13:47:11.270 INFO:tasks.workunit.client.0.smithi043.stdout:4/679: link d1/de/df/db4/d36/d9e/l87 d1/de/df/d1a/d49/le0 0 2024-04-25T13:47:11.272 INFO:tasks.workunit.client.0.smithi043.stdout:8/789: dread db/dc/d21/d4e/f58 [0,4194304] 0 2024-04-25T13:47:11.274 INFO:tasks.workunit.client.0.smithi043.stdout:4/680: stat d1/d3/d54/d62/d77/dcd 0 2024-04-25T13:47:11.274 INFO:tasks.workunit.client.0.smithi043.stdout:2/622: stat d0/d34/d17/da0/ca5 0 2024-04-25T13:47:11.276 INFO:tasks.workunit.client.0.smithi043.stdout:8/790: chown db/d11/da1/le2 1 1 2024-04-25T13:47:11.276 INFO:tasks.workunit.client.0.smithi043.stdout:4/681: write d1/d3/f68 [5269808,123261] 0 2024-04-25T13:47:11.281 INFO:tasks.workunit.client.0.smithi043.stdout:0/722: link db/d1b/d23/d27/f44 db/d25/d2a/d9d/ff0 0 2024-04-25T13:47:11.283 INFO:tasks.workunit.client.0.smithi043.stdout:6/784: rename d0/d76/de3/da7/fde to d0/d76/de3/d64/f108 0 2024-04-25T13:47:11.285 INFO:tasks.workunit.client.0.smithi043.stdout:5/666: sync 2024-04-25T13:47:11.286 INFO:tasks.workunit.client.0.smithi043.stdout:8/791: dwrite db/d44/d8e/f96 [0,4194304] 0 2024-04-25T13:47:11.287 INFO:tasks.workunit.client.0.smithi043.stdout:4/682: dwrite d1/de/f8c [0,4194304] 0 2024-04-25T13:47:11.291 INFO:tasks.workunit.client.0.smithi043.stdout:5/667: creat d1/d3/d26/fde x:0 0 0 2024-04-25T13:47:11.293 INFO:tasks.workunit.client.0.smithi043.stdout:8/792: creat db/d46/da8/f100 x:0 0 0 2024-04-25T13:47:11.297 INFO:tasks.workunit.client.0.smithi043.stdout:4/683: dread d1/de/df/d1e/d45/da1/db3/fd7 [0,4194304] 0 2024-04-25T13:47:11.299 INFO:tasks.workunit.client.0.smithi043.stdout:6/785: dwrite d0/d1b/fee [0,4194304] 0 2024-04-25T13:47:11.300 INFO:tasks.workunit.client.0.smithi043.stdout:3/717: rename d0/d9/d81 to d0/d13/d55/dd9/df5 0 2024-04-25T13:47:11.300 INFO:tasks.workunit.client.0.smithi043.stdout:0/723: dwrite db/d1b/d23/d27/d39/d4c/f8e [0,4194304] 0 2024-04-25T13:47:11.302 INFO:tasks.workunit.client.0.smithi043.stdout:8/793: symlink db/d7d/df2/l101 0 2024-04-25T13:47:11.303 INFO:tasks.workunit.client.0.smithi043.stdout:6/786: fsync d0/d3d/d6e/fb7 0 2024-04-25T13:47:11.305 INFO:tasks.workunit.client.0.smithi043.stdout:4/684: mkdir d1/de/df/d1e/de1 0 2024-04-25T13:47:11.305 INFO:tasks.workunit.client.0.smithi043.stdout:8/794: creat db/d38/d40/f102 x:0 0 0 2024-04-25T13:47:11.308 INFO:tasks.workunit.client.0.smithi043.stdout:7/855: rename d5/c9 to d5/d11/d3b/d61/dc5/dee/d116/d11e/c120 0 2024-04-25T13:47:11.312 INFO:tasks.workunit.client.0.smithi043.stdout:4/685: mknod d1/de/df/db4/d36/d9e/ce2 0 2024-04-25T13:47:11.313 INFO:tasks.workunit.client.0.smithi043.stdout:1/736: sync 2024-04-25T13:47:11.314 INFO:tasks.workunit.client.0.smithi043.stdout:0/724: symlink db/d25/d2a/lf1 0 2024-04-25T13:47:11.316 INFO:tasks.workunit.client.0.smithi043.stdout:7/856: creat d5/d11/d3b/d61/dc5/dee/f121 x:0 0 0 2024-04-25T13:47:11.316 INFO:tasks.workunit.client.0.smithi043.stdout:5/668: dwrite d1/d3/d62/f9f [0,4194304] 0 2024-04-25T13:47:11.324 INFO:tasks.workunit.client.0.smithi043.stdout:5/669: creat d1/d8d/db8/fdf x:0 0 0 2024-04-25T13:47:11.326 INFO:tasks.workunit.client.0.smithi043.stdout:4/686: dwrite d1/d3/d54/d62/dba/fdb [0,4194304] 0 2024-04-25T13:47:11.327 INFO:tasks.workunit.client.0.smithi043.stdout:0/725: unlink db/c1a 0 2024-04-25T13:47:11.327 INFO:tasks.workunit.client.0.smithi043.stdout:5/670: fdatasync d1/d3/d7/d8/df/d28/fab 0 2024-04-25T13:47:11.329 INFO:tasks.workunit.client.0.smithi043.stdout:5/671: chown d1/d4/d92/fb0 7372 1 2024-04-25T13:47:11.330 INFO:tasks.workunit.client.0.smithi043.stdout:7/857: dread d5/d11/d3b/d8b/d93/f110 [0,4194304] 0 2024-04-25T13:47:11.330 INFO:tasks.workunit.client.0.smithi043.stdout:3/718: read - d0/d9/f5d zero size 2024-04-25T13:47:11.331 INFO:tasks.workunit.client.0.smithi043.stdout:1/737: creat df/d14/d3d/f107 x:0 0 0 2024-04-25T13:47:11.332 INFO:tasks.workunit.client.0.smithi043.stdout:0/726: unlink db/d1b/d36/f34 0 2024-04-25T13:47:11.333 INFO:tasks.workunit.client.0.smithi043.stdout:4/687: mknod d1/de/df/db4/d36/d9e/ce3 0 2024-04-25T13:47:11.334 INFO:tasks.workunit.client.0.smithi043.stdout:4/688: chown d1/d3/d54/d62/d77 14 1 2024-04-25T13:47:11.334 INFO:tasks.workunit.client.0.smithi043.stdout:3/719: creat d0/d13/d2e/db1/ff6 x:0 0 0 2024-04-25T13:47:11.335 INFO:tasks.workunit.client.0.smithi043.stdout:1/738: creat df/d31/d38/d43/d6e/dea/f108 x:0 0 0 2024-04-25T13:47:11.337 INFO:tasks.workunit.client.0.smithi043.stdout:4/689: chown d1/de/df/d1e/d45/da1/db3/cbc 24 1 2024-04-25T13:47:11.337 INFO:tasks.workunit.client.0.smithi043.stdout:0/727: mknod db/d1b/d94/da1/de2/cf2 0 2024-04-25T13:47:11.337 INFO:tasks.workunit.client.0.smithi043.stdout:7/858: dread d5/d11/d3b/d61/dc5/dee/d5a/f76 [4194304,4194304] 0 2024-04-25T13:47:11.339 INFO:tasks.workunit.client.0.smithi043.stdout:5/672: mknod d1/d3/d7/d8/da/ce0 0 2024-04-25T13:47:11.340 INFO:tasks.workunit.client.0.smithi043.stdout:1/739: getdents df/d14/d63/d67 0 2024-04-25T13:47:11.341 INFO:tasks.workunit.client.0.smithi043.stdout:7/859: mknod d5/d11/d3b/d8b/d93/c122 0 2024-04-25T13:47:11.343 INFO:tasks.workunit.client.0.smithi043.stdout:5/673: dread - d1/d3/d7/d2f/d80/fd4 zero size 2024-04-25T13:47:11.345 INFO:tasks.workunit.client.0.smithi043.stdout:3/720: write d0/d9/f20 [5140937,108257] 0 2024-04-25T13:47:11.346 INFO:tasks.workunit.client.0.smithi043.stdout:1/740: dread df/d14/d63/d67/d9f/fdc [0,4194304] 0 2024-04-25T13:47:11.347 INFO:tasks.workunit.client.0.smithi043.stdout:4/690: dwrite d1/de/f8c [0,4194304] 0 2024-04-25T13:47:11.350 INFO:tasks.workunit.client.0.smithi043.stdout:5/674: mkdir d1/d3/d7/de1 0 2024-04-25T13:47:11.350 INFO:tasks.workunit.client.0.smithi043.stdout:1/741: fdatasync df/d31/d38/fe7 0 2024-04-25T13:47:11.350 INFO:tasks.workunit.client.0.smithi043.stdout:7/860: link d5/f72 d5/d11/d3b/d8b/d9b/f123 0 2024-04-25T13:47:11.350 INFO:tasks.workunit.client.0.smithi043.stdout:4/691: write d1/de/d1d/f5c [760321,56974] 0 2024-04-25T13:47:11.352 INFO:tasks.workunit.client.0.smithi043.stdout:1/742: read df/d14/d3d/d82/d8c/f9b [1131751,114675] 0 2024-04-25T13:47:11.355 INFO:tasks.workunit.client.0.smithi043.stdout:5/675: write d1/d3/d24/d7c/f89 [495967,102431] 0 2024-04-25T13:47:11.358 INFO:tasks.workunit.client.0.smithi043.stdout:5/676: dread - d1/d3/fd6 zero size 2024-04-25T13:47:11.362 INFO:tasks.workunit.client.0.smithi043.stdout:7/861: dwrite d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/f101 [0,4194304] 0 2024-04-25T13:47:11.366 INFO:tasks.workunit.client.0.smithi043.stdout:2/623: rename d0/d34/d3f/d59/c74 to d0/d8/d22/d5c/cb9 0 2024-04-25T13:47:11.368 INFO:tasks.workunit.client.0.smithi043.stdout:5/677: write d1/d3/d7/d8/da/fc6 [4874004,71550] 0 2024-04-25T13:47:11.371 INFO:tasks.workunit.client.0.smithi043.stdout:5/678: readlink d1/d3/d7/d8/da/d11/d52/la2 0 2024-04-25T13:47:11.374 INFO:tasks.workunit.client.0.smithi043.stdout:2/624: creat d0/d34/d77/fba x:0 0 0 2024-04-25T13:47:11.377 INFO:tasks.workunit.client.0.smithi043.stdout:5/679: write d1/d3/d62/f9f [1246436,58736] 0 2024-04-25T13:47:11.378 INFO:tasks.workunit.client.0.smithi043.stdout:4/692: dwrite d1/de/df/d1e/d45/da1/db3/fd7 [0,4194304] 0 2024-04-25T13:47:11.382 INFO:tasks.workunit.client.0.smithi043.stdout:2/625: write d0/d34/d17/f23 [7343751,95843] 0 2024-04-25T13:47:11.383 INFO:tasks.workunit.client.0.smithi043.stdout:2/626: stat d0/l8f 0 2024-04-25T13:47:11.384 INFO:tasks.workunit.client.0.smithi043.stdout:3/721: dwrite d0/d9/d6e/f1f [4194304,4194304] 0 2024-04-25T13:47:11.384 INFO:tasks.workunit.client.0.smithi043.stdout:1/743: link df/d31/d34/d8b/f99 df/d10/d22/d2f/d9c/d41/db8/f109 0 2024-04-25T13:47:11.386 INFO:tasks.workunit.client.0.smithi043.stdout:7/862: dread d5/d11/d3b/d61/dc5/dee/d5a/f88 [0,4194304] 0 2024-04-25T13:47:11.387 INFO:tasks.workunit.client.0.smithi043.stdout:4/693: read d1/de/df/d1e/fc0 [2202251,53380] 0 2024-04-25T13:47:11.390 INFO:tasks.workunit.client.0.smithi043.stdout:1/744: truncate df/d14/d63/d67/da7/fcb 6450 0 2024-04-25T13:47:11.394 INFO:tasks.workunit.client.0.smithi043.stdout:7/863: read d5/d11/d3b/d61/d68/dc0/fa0 [2467740,24356] 0 2024-04-25T13:47:11.396 INFO:tasks.workunit.client.0.smithi043.stdout:1/745: creat df/d31/d38/d43/d81/f10a x:0 0 0 2024-04-25T13:47:11.396 INFO:tasks.workunit.client.0.smithi043.stdout:3/722: dread - d0/d13/d5a/f68 zero size 2024-04-25T13:47:11.397 INFO:tasks.workunit.client.0.smithi043.stdout:5/680: mkdir d1/d3/d7/d9/d2d/d5b/de2 0 2024-04-25T13:47:11.397 INFO:tasks.workunit.client.0.smithi043.stdout:4/694: creat d1/d3/d8f/fe4 x:0 0 0 2024-04-25T13:47:11.398 INFO:tasks.workunit.client.0.smithi043.stdout:7/864: write d5/d11/d3b/d61/dc5/dcc/fe1 [1689539,47560] 0 2024-04-25T13:47:11.400 INFO:tasks.workunit.client.0.smithi043.stdout:4/695: stat d1/de/df/d1e/dc8/cd2 0 2024-04-25T13:47:11.400 INFO:tasks.workunit.client.0.smithi043.stdout:6/787: rename d0/d24 to d0/d3d/d109 0 2024-04-25T13:47:11.402 INFO:tasks.workunit.client.0.smithi043.stdout:5/681: read d1/d3/d24/d7c/f55 [1926905,1928] 0 2024-04-25T13:47:11.404 INFO:tasks.workunit.client.0.smithi043.stdout:7/865: chown d5/d32/f4e 27183295 1 2024-04-25T13:47:11.406 INFO:tasks.workunit.client.0.smithi043.stdout:2/627: dread d0/d5/d1e/f52 [0,4194304] 0 2024-04-25T13:47:11.407 INFO:tasks.workunit.client.0.smithi043.stdout:3/723: truncate d0/d61/f70 4320255 0 2024-04-25T13:47:11.407 INFO:tasks.workunit.client.0.smithi043.stdout:8/795: rename db/d38/de4/dcb/cf8 to db/c103 0 2024-04-25T13:47:11.409 INFO:tasks.workunit.client.0.smithi043.stdout:7/866: mknod d5/d11/c124 0 2024-04-25T13:47:11.410 INFO:tasks.workunit.client.0.smithi043.stdout:3/724: fsync d0/f3b 0 2024-04-25T13:47:11.412 INFO:tasks.workunit.client.0.smithi043.stdout:1/746: dwrite df/d10/d22/d2f/ff1 [0,4194304] 0 2024-04-25T13:47:11.416 INFO:tasks.workunit.client.0.smithi043.stdout:2/628: symlink d0/d34/d17/d5e/da9/lbb 0 2024-04-25T13:47:11.417 INFO:tasks.workunit.client.0.smithi043.stdout:7/867: creat d5/d11/d3b/d61/dc5/dee/d116/d11e/f125 x:0 0 0 2024-04-25T13:47:11.417 INFO:tasks.workunit.client.0.smithi043.stdout:1/747: rmdir df/d31/d34/d8b/ddd 39 2024-04-25T13:47:11.418 INFO:tasks.workunit.client.0.smithi043.stdout:4/696: dwrite d1/d3/d54/d62/d77/d79/f5e [0,4194304] 0 2024-04-25T13:47:11.418 INFO:tasks.workunit.client.0.smithi043.stdout:8/796: mkdir db/dc/d28/d104 0 2024-04-25T13:47:11.420 INFO:tasks.workunit.client.0.smithi043.stdout:2/629: chown d0/d8/d22/d5c/cb9 100599 1 2024-04-25T13:47:11.421 INFO:tasks.workunit.client.0.smithi043.stdout:8/797: chown db/dc/d28/l4b 1339492692 1 2024-04-25T13:47:11.422 INFO:tasks.workunit.client.0.smithi043.stdout:4/697: readlink d1/de/df/db4/d36/d53/d66/lb0 0 2024-04-25T13:47:11.422 INFO:tasks.workunit.client.0.smithi043.stdout:1/748: dread - df/d14/d63/d67/fc6 zero size 2024-04-25T13:47:11.423 INFO:tasks.workunit.client.0.smithi043.stdout:2/630: mkdir d0/d34/d3f/d59/dbc 0 2024-04-25T13:47:11.424 INFO:tasks.workunit.client.0.smithi043.stdout:7/868: rename d5/fb1 to d5/d11/d3b/d8b/d9b/df6/f126 0 2024-04-25T13:47:11.426 INFO:tasks.workunit.client.0.smithi043.stdout:1/749: unlink df/d14/d3d/f107 0 2024-04-25T13:47:11.426 INFO:tasks.workunit.client.0.smithi043.stdout:1/750: stat df/d14/d3d/c7a 0 2024-04-25T13:47:11.428 INFO:tasks.workunit.client.0.smithi043.stdout:1/751: chown df/d31/d34/d8b/fa4 47665 1 2024-04-25T13:47:11.428 INFO:tasks.workunit.client.0.smithi043.stdout:2/631: mknod d0/d34/d17/d5e/cbd 0 2024-04-25T13:47:11.430 INFO:tasks.workunit.client.0.smithi043.stdout:3/725: mkdir d0/da/db9/df7 0 2024-04-25T13:47:11.431 INFO:tasks.workunit.client.0.smithi043.stdout:7/869: stat d5/d32/l58 0 2024-04-25T13:47:11.431 INFO:tasks.workunit.client.0.smithi043.stdout:2/632: readlink d0/d8/d22/d5c/l82 0 2024-04-25T13:47:11.433 INFO:tasks.workunit.client.0.smithi043.stdout:2/633: dread - d0/d5/d2f/f8a zero size 2024-04-25T13:47:11.433 INFO:tasks.workunit.client.0.smithi043.stdout:7/870: stat d5/d11/d3b/d61/dc5/dee/l4f 0 2024-04-25T13:47:11.436 INFO:tasks.workunit.client.0.smithi043.stdout:2/634: fsync d0/d34/d17/d5e/d71/f85 0 2024-04-25T13:47:11.438 INFO:tasks.workunit.client.0.smithi043.stdout:3/726: creat d0/d13/d55/dd9/df5/ff8 x:0 0 0 2024-04-25T13:47:11.442 INFO:tasks.workunit.client.0.smithi043.stdout:8/798: dwrite db/d38/de4/fb2 [0,4194304] 0 2024-04-25T13:47:11.444 INFO:tasks.workunit.client.0.smithi043.stdout:6/788: creat d0/d76/de3/d64/da1/f10a x:0 0 0 2024-04-25T13:47:11.444 INFO:tasks.workunit.client.0.smithi043.stdout:5/682: dread d1/d3/d7/d8/da/d11/d52/f59 [0,4194304] 0 2024-04-25T13:47:11.445 INFO:tasks.workunit.client.0.smithi043.stdout:2/635: creat d0/d8/d22/fbe x:0 0 0 2024-04-25T13:47:11.447 INFO:tasks.workunit.client.0.smithi043.stdout:7/871: getdents d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/df0/d119 0 2024-04-25T13:47:11.447 INFO:tasks.workunit.client.0.smithi043.stdout:8/799: stat db/d38/de4/d59/d7c/daf/ffa 0 2024-04-25T13:47:11.448 INFO:tasks.workunit.client.0.smithi043.stdout:5/683: stat d1/d3/d7/d2f/fd1 0 2024-04-25T13:47:11.448 INFO:tasks.workunit.client.0.smithi043.stdout:1/752: dwrite df/d31/d34/f4d [0,4194304] 0 2024-04-25T13:47:11.451 INFO:tasks.workunit.client.0.smithi043.stdout:6/789: dread d0/d90/d48/d9d/fc5 [0,4194304] 0 2024-04-25T13:47:11.452 INFO:tasks.workunit.client.0.smithi043.stdout:1/753: unlink c5 0 2024-04-25T13:47:11.458 INFO:tasks.workunit.client.0.smithi043.stdout:5/684: dwrite d1/d3/d7/d9/d2d/f6c [0,4194304] 0 2024-04-25T13:47:11.460 INFO:tasks.workunit.client.0.smithi043.stdout:1/754: dwrite df/d14/d63/d67/da7/fcb [0,4194304] 0 2024-04-25T13:47:11.461 INFO:tasks.workunit.client.0.smithi043.stdout:6/790: rmdir d0 39 2024-04-25T13:47:11.462 INFO:tasks.workunit.client.0.smithi043.stdout:4/698: dread d1/de/df/db4/d36/d9e/d9d/f46 [0,4194304] 0 2024-04-25T13:47:11.462 INFO:tasks.workunit.client.0.smithi043.stdout:7/872: mknod d5/d11/d3b/d61/d68/dc0/c127 0 2024-04-25T13:47:11.463 INFO:tasks.workunit.client.0.smithi043.stdout:3/727: mkdir d0/da/db9/df9 0 2024-04-25T13:47:11.471 INFO:tasks.workunit.client.0.smithi043.stdout:1/755: write df/d31/d38/f61 [641322,23212] 0 2024-04-25T13:47:11.481 INFO:tasks.workunit.client.0.smithi043.stdout:3/728: chown d0/d9/l9c 37 1 2024-04-25T13:47:11.481 INFO:tasks.workunit.client.0.smithi043.stdout:0/728: sync 2024-04-25T13:47:11.481 INFO:tasks.workunit.client.0.smithi043.stdout:7/873: write d5/d11/db4/fe4 [1018211,130248] 0 2024-04-25T13:47:11.485 INFO:tasks.workunit.client.0.smithi043.stdout:1/756: write df/d31/d38/d43/fd1 [285322,109372] 0 2024-04-25T13:47:11.485 INFO:tasks.workunit.client.0.smithi043.stdout:4/699: getdents d1/d34 0 2024-04-25T13:47:11.487 INFO:tasks.workunit.client.0.smithi043.stdout:3/729: mknod d0/d9/d6e/d34/d36/cfa 0 2024-04-25T13:47:11.489 INFO:tasks.workunit.client.0.smithi043.stdout:3/730: fdatasync d0/d61/fe3 0 2024-04-25T13:47:11.490 INFO:tasks.workunit.client.0.smithi043.stdout:4/700: unlink d1/de/df/db4/d36/l71 0 2024-04-25T13:47:11.493 INFO:tasks.workunit.client.0.smithi043.stdout:0/729: dwrite db/d1b/f22 [0,4194304] 0 2024-04-25T13:47:11.495 INFO:tasks.workunit.client.0.smithi043.stdout:1/757: link df/d10/d22/d2f/ff1 df/d31/d34/d91/f10b 0 2024-04-25T13:47:11.496 INFO:tasks.workunit.client.0.smithi043.stdout:4/701: unlink d1/de/df/c6d 0 2024-04-25T13:47:11.496 INFO:tasks.workunit.client.0.smithi043.stdout:8/800: rename f4 to db/d38/d77/f105 0 2024-04-25T13:47:11.496 INFO:tasks.workunit.client.0.smithi043.stdout:0/730: stat db/d1b/d23/d27/d39/d4c/ld6 0 2024-04-25T13:47:11.498 INFO:tasks.workunit.client.0.smithi043.stdout:4/702: chown d1/d3/d54/d62/c9a 114308 1 2024-04-25T13:47:11.498 INFO:tasks.workunit.client.0.smithi043.stdout:3/731: creat d0/d13/ffb x:0 0 0 2024-04-25T13:47:11.499 INFO:tasks.workunit.client.0.smithi043.stdout:7/874: dread d5/d11/f4d [0,4194304] 0 2024-04-25T13:47:11.502 INFO:tasks.workunit.client.0.smithi043.stdout:2/636: dread d0/d26/f33 [0,4194304] 0 2024-04-25T13:47:11.502 INFO:tasks.workunit.client.0.smithi043.stdout:4/703: dread d1/d3/d54/d62/d77/fb9 [0,4194304] 0 2024-04-25T13:47:11.503 INFO:tasks.workunit.client.0.smithi043.stdout:7/875: dread d5/d11/f4d [0,4194304] 0 2024-04-25T13:47:11.504 INFO:tasks.workunit.client.0.smithi043.stdout:8/801: write db/d38/de4/f95 [183390,101453] 0 2024-04-25T13:47:11.505 INFO:tasks.workunit.client.0.smithi043.stdout:2/637: truncate d0/d5/d2f/f8a 109116 0 2024-04-25T13:47:11.508 INFO:tasks.workunit.client.0.smithi043.stdout:4/704: creat d1/de/d1d/d20/fe5 x:0 0 0 2024-04-25T13:47:11.509 INFO:tasks.workunit.client.0.smithi043.stdout:0/731: rename db/d1b/f96 to db/ff3 0 2024-04-25T13:47:11.510 INFO:tasks.workunit.client.0.smithi043.stdout:1/758: write df/d14/d3d/f84 [192020,56035] 0 2024-04-25T13:47:11.512 INFO:tasks.workunit.client.0.smithi043.stdout:2/638: read d0/d34/d3f/d59/fb4 [5003362,120368] 0 2024-04-25T13:47:11.512 INFO:tasks.workunit.client.0.smithi043.stdout:4/705: fdatasync d1/d3/d54/d62/d77/d79/f8a 0 2024-04-25T13:47:11.514 INFO:tasks.workunit.client.0.smithi043.stdout:1/759: chown df/d14/d3d/d82/fb3 179365375 1 2024-04-25T13:47:11.514 INFO:tasks.workunit.client.0.smithi043.stdout:7/876: dread d5/d11/d8f/fa7 [0,4194304] 0 2024-04-25T13:47:11.515 INFO:tasks.workunit.client.0.smithi043.stdout:0/732: truncate db/d1b/d94/d68/f9c 68277 0 2024-04-25T13:47:11.517 INFO:tasks.workunit.client.0.smithi043.stdout:2/639: fsync d0/d34/d17/f41 0 2024-04-25T13:47:11.517 INFO:tasks.workunit.client.0.smithi043.stdout:8/802: write db/f35 [549074,97965] 0 2024-04-25T13:47:11.518 INFO:tasks.workunit.client.0.smithi043.stdout:1/760: symlink df/d31/d38/d43/d6e/dea/l10c 0 2024-04-25T13:47:11.520 INFO:tasks.workunit.client.0.smithi043.stdout:7/877: creat d5/d11/d3b/d61/dc5/dee/d116/f128 x:0 0 0 2024-04-25T13:47:11.520 INFO:tasks.workunit.client.0.smithi043.stdout:8/803: chown db/d38/d3c/d71/d5d/fc0 909989 1 2024-04-25T13:47:11.522 INFO:tasks.workunit.client.0.smithi043.stdout:3/732: rename d0/d9/l4c to d0/d13/d55/dd9/df5/d8e/lfc 0 2024-04-25T13:47:11.524 INFO:tasks.workunit.client.0.smithi043.stdout:1/761: symlink df/d10/d22/d2f/l10d 0 2024-04-25T13:47:11.526 INFO:tasks.workunit.client.0.smithi043.stdout:8/804: mkdir db/d11/da1/d106 0 2024-04-25T13:47:11.527 INFO:tasks.workunit.client.0.smithi043.stdout:7/878: symlink d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/df0/l129 0 2024-04-25T13:47:11.527 INFO:tasks.workunit.client.0.smithi043.stdout:1/762: mknod df/d31/dc7/dc8/c10e 0 2024-04-25T13:47:11.531 INFO:tasks.workunit.client.0.smithi043.stdout:2/640: dwrite d0/d34/d17/d5e/d71/d81/fa8 [0,4194304] 0 2024-04-25T13:47:11.531 INFO:tasks.workunit.client.0.smithi043.stdout:8/805: creat db/d38/d3c/dd9/f107 x:0 0 0 2024-04-25T13:47:11.535 INFO:tasks.workunit.client.0.smithi043.stdout:3/733: write d0/d9/f72 [4999278,15723] 0 2024-04-25T13:47:11.536 INFO:tasks.workunit.client.0.smithi043.stdout:0/733: dread db/fc [0,4194304] 0 2024-04-25T13:47:11.537 INFO:tasks.workunit.client.0.smithi043.stdout:1/763: getdents df/d31/d38/d43/dbc 0 2024-04-25T13:47:11.542 INFO:tasks.workunit.client.0.smithi043.stdout:0/734: read f6 [1805674,103579] 0 2024-04-25T13:47:11.544 INFO:tasks.workunit.client.0.smithi043.stdout:2/641: rename d0/d34/f91 to d0/d34/d17/d5e/fbf 0 2024-04-25T13:47:11.547 INFO:tasks.workunit.client.0.smithi043.stdout:0/735: mknod db/d1b/d23/d27/d98/de4/cf4 0 2024-04-25T13:47:11.550 INFO:tasks.workunit.client.0.smithi043.stdout:0/736: mkdir db/d1b/d23/d27/d39/d4c/dbb/dc8/df5 0 2024-04-25T13:47:11.551 INFO:tasks.workunit.client.0.smithi043.stdout:3/734: rename d0/d61/d82/ldc to d0/d13/d55/lfd 0 2024-04-25T13:47:11.552 INFO:tasks.workunit.client.0.smithi043.stdout:4/706: link d1/d3/d54/d62/d77/d92/dc5/l8b d1/d3/d54/le6 0 2024-04-25T13:47:11.553 INFO:tasks.workunit.client.0.smithi043.stdout:3/735: write d0/d9/d6e/dc5/ff3 [516775,94787] 0 2024-04-25T13:47:11.554 INFO:tasks.workunit.client.0.smithi043.stdout:2/642: rename d0/d8/d22/d5c/d8c/c9c to d0/d5/d2f/cc0 0 2024-04-25T13:47:11.556 INFO:tasks.workunit.client.0.smithi043.stdout:0/737: unlink db/d25/d2a/d3f/d6a/f89 0 2024-04-25T13:47:11.559 INFO:tasks.workunit.client.0.smithi043.stdout:7/879: dread d5/d11/d3b/f70 [0,4194304] 0 2024-04-25T13:47:11.565 INFO:tasks.workunit.client.0.smithi043.stdout:1/764: link df/d31/d38/dbb/cda df/d14/d63/d67/d9f/c10f 0 2024-04-25T13:47:11.566 INFO:tasks.workunit.client.0.smithi043.stdout:3/736: mkdir d0/da/db9/df7/dfe 0 2024-04-25T13:47:11.569 INFO:tasks.workunit.client.0.smithi043.stdout:8/806: dread db/d7d/fec [0,4194304] 0 2024-04-25T13:47:11.570 INFO:tasks.workunit.client.0.smithi043.stdout:4/707: dread d1/de/f1c [4194304,4194304] 0 2024-04-25T13:47:11.571 INFO:tasks.workunit.client.0.smithi043.stdout:7/880: truncate d5/d75/f66 4459150 0 2024-04-25T13:47:11.571 INFO:tasks.workunit.client.0.smithi043.stdout:1/765: rename df/d14/d63/d67/cb6 to df/d14/d3d/d82/c110 0 2024-04-25T13:47:11.571 INFO:tasks.workunit.client.0.smithi043.stdout:8/807: write db/d11/fe8 [122131,25150] 0 2024-04-25T13:47:11.574 INFO:tasks.workunit.client.0.smithi043.stdout:1/766: chown df/d10/d22/d2f/d9c/f42 111574 1 2024-04-25T13:47:11.575 INFO:tasks.workunit.client.0.smithi043.stdout:8/808: creat db/d38/d77/df7/f108 x:0 0 0 2024-04-25T13:47:11.576 INFO:tasks.workunit.client.0.smithi043.stdout:7/881: dread d5/d11/d3b/d61/dc5/dee/f48 [0,4194304] 0 2024-04-25T13:47:11.578 INFO:tasks.workunit.client.0.smithi043.stdout:1/767: symlink df/d10/d22/d2f/d9c/d41/l111 0 2024-04-25T13:47:11.578 INFO:tasks.workunit.client.0.smithi043.stdout:0/738: dread db/d25/d2a/d3f/d6a/d86/fef [4194304,4194304] 0 2024-04-25T13:47:11.579 INFO:tasks.workunit.client.0.smithi043.stdout:8/809: dread - db/d44/d8e/d27/f91 zero size 2024-04-25T13:47:11.584 INFO:tasks.workunit.client.0.smithi043.stdout:8/810: mkdir db/d11/da1/d109 0 2024-04-25T13:47:11.586 INFO:tasks.workunit.client.0.smithi043.stdout:4/708: dwrite d1/d3/d54/d62/fc9 [0,4194304] 0 2024-04-25T13:47:11.587 INFO:tasks.workunit.client.0.smithi043.stdout:8/811: write db/dc/d21/d4e/f58 [855675,44126] 0 2024-04-25T13:47:11.588 INFO:tasks.workunit.client.0.smithi043.stdout:4/709: dread - d1/de/df/d1e/d45/da1/db3/f84 zero size 2024-04-25T13:47:11.589 INFO:tasks.workunit.client.0.smithi043.stdout:7/882: getdents d5/d11/d3b/d61/dc5/dee 0 2024-04-25T13:47:11.592 INFO:tasks.workunit.client.0.smithi043.stdout:7/883: write d5/d11/d3b/d61/f7c [3194031,33888] 0 2024-04-25T13:47:11.592 INFO:tasks.workunit.client.0.smithi043.stdout:4/710: creat d1/d3/d54/d62/d77/d92/fe7 x:0 0 0 2024-04-25T13:47:11.597 INFO:tasks.workunit.client.0.smithi043.stdout:4/711: mkdir d1/de/d1d/d20/de8 0 2024-04-25T13:47:11.601 INFO:tasks.workunit.client.0.smithi043.stdout:4/712: getdents d1/de/d1d/d20/de8 0 2024-04-25T13:47:11.602 INFO:tasks.workunit.client.0.smithi043.stdout:7/884: write d5/d11/d3b/d61/dc5/dee/d5a/d89/f95 [94178,38115] 0 2024-04-25T13:47:11.602 INFO:tasks.workunit.client.0.smithi043.stdout:4/713: write d1/de/fc4 [1052993,48171] 0 2024-04-25T13:47:11.603 INFO:tasks.workunit.client.0.smithi043.stdout:8/812: dread db/d38/de4/f95 [0,4194304] 0 2024-04-25T13:47:11.605 INFO:tasks.workunit.client.0.smithi043.stdout:3/737: rename d0/d9/d6e/l26 to d0/d13/d55/dd9/df5/lff 0 2024-04-25T13:47:11.612 INFO:tasks.workunit.client.0.smithi043.stdout:4/714: truncate d1/de/df/d1a/f65 1549237 0 2024-04-25T13:47:11.613 INFO:tasks.workunit.client.0.smithi043.stdout:8/813: dwrite db/d46/da8/fbf [0,4194304] 0 2024-04-25T13:47:11.615 INFO:tasks.workunit.client.0.smithi043.stdout:8/814: chown db/d46/da8/fd0 0 1 2024-04-25T13:47:11.616 INFO:tasks.workunit.client.0.smithi043.stdout:4/715: stat d1/cd5 0 2024-04-25T13:47:11.617 INFO:tasks.workunit.client.0.smithi043.stdout:0/739: dread db/f18 [0,4194304] 0 2024-04-25T13:47:11.617 INFO:tasks.workunit.client.0.smithi043.stdout:8/815: chown db/dc/f45 1 1 2024-04-25T13:47:11.617 INFO:tasks.workunit.client.0.smithi043.stdout:7/885: dwrite d5/d11/f31 [0,4194304] 0 2024-04-25T13:47:11.622 INFO:tasks.workunit.client.0.smithi043.stdout:0/740: symlink db/d1b/d62/d72/lf6 0 2024-04-25T13:47:11.624 INFO:tasks.workunit.client.0.smithi043.stdout:8/816: symlink db/d11/d79/dba/l10a 0 2024-04-25T13:47:11.625 INFO:tasks.workunit.client.0.smithi043.stdout:0/741: write db/d1b/d23/d27/d39/d4c/d74/fd1 [274099,6502] 0 2024-04-25T13:47:11.626 INFO:tasks.workunit.client.0.smithi043.stdout:4/716: fsync d1/de/df/db4/d36/d9e/d9d/f37 0 2024-04-25T13:47:11.628 INFO:tasks.workunit.client.0.smithi043.stdout:8/817: dread - db/d38/d3c/d71/d5d/fc0 zero size 2024-04-25T13:47:11.632 INFO:tasks.workunit.client.0.smithi043.stdout:7/886: write d5/d75/f66 [3391720,54862] 0 2024-04-25T13:47:11.634 INFO:tasks.workunit.client.0.smithi043.stdout:8/818: creat db/d7d/df2/f10b x:0 0 0 2024-04-25T13:47:11.638 INFO:tasks.workunit.client.0.smithi043.stdout:8/819: rename db/d38/d77/df7/f108 to db/d38/d77/df7/f10c 0 2024-04-25T13:47:11.640 INFO:tasks.workunit.client.0.smithi043.stdout:8/820: read db/d38/de4/d59/f7b [3277417,105152] 0 2024-04-25T13:47:11.641 INFO:tasks.workunit.client.0.smithi043.stdout:4/717: getdents d1/d3/d54 0 2024-04-25T13:47:11.642 INFO:tasks.workunit.client.0.smithi043.stdout:8/821: fsync db/d38/f82 0 2024-04-25T13:47:11.644 INFO:tasks.workunit.client.0.smithi043.stdout:4/718: creat d1/d6a/fe9 x:0 0 0 2024-04-25T13:47:11.644 INFO:tasks.workunit.client.0.smithi043.stdout:0/742: dwrite db/d1b/d23/d27/f44 [0,4194304] 0 2024-04-25T13:47:11.647 INFO:tasks.workunit.client.0.smithi043.stdout:7/887: write d5/d11/d3b/d61/d68/dc0/fac [2787683,87072] 0 2024-04-25T13:47:11.647 INFO:tasks.workunit.client.0.smithi043.stdout:4/719: symlink d1/de/df/db4/lea 0 2024-04-25T13:47:11.652 INFO:tasks.workunit.client.0.smithi043.stdout:3/738: rename d0/d13/d55/dd9/df5/d8e/d92/ca6 to d0/d9/d6e/d34/d36/d57/c100 0 2024-04-25T13:47:11.652 INFO:tasks.workunit.client.0.smithi043.stdout:8/822: dwrite db/d38/f7f [0,4194304] 0 2024-04-25T13:47:11.654 INFO:tasks.workunit.client.0.smithi043.stdout:4/720: read d1/d3/d54/d62/d77/d92/f9b [250877,36892] 0 2024-04-25T13:47:11.656 INFO:tasks.workunit.client.0.smithi043.stdout:0/743: rename db/d1b/d23/d27/d39/d4c/dbb/dc8/ce3 to db/d25/d2a/d93/cf7 0 2024-04-25T13:47:11.658 INFO:tasks.workunit.client.0.smithi043.stdout:8/823: write db/d44/d5c/f9e [2954983,51425] 0 2024-04-25T13:47:11.658 INFO:tasks.workunit.client.0.smithi043.stdout:4/721: dread - d1/de/df/d1e/d45/da1/db3/f84 zero size 2024-04-25T13:47:11.658 INFO:tasks.workunit.client.0.smithi043.stdout:0/744: readlink db/d1b/d94/l8a 0 2024-04-25T13:47:11.660 INFO:tasks.workunit.client.0.smithi043.stdout:0/745: write db/d25/d2a/f7a [59750,16490] 0 2024-04-25T13:47:11.664 INFO:tasks.workunit.client.0.smithi043.stdout:4/722: mknod d1/d3/d54/d62/d77/d92/ceb 0 2024-04-25T13:47:11.664 INFO:tasks.workunit.client.0.smithi043.stdout:8/824: mknod db/d44/d8e/c10d 0 2024-04-25T13:47:11.664 INFO:tasks.workunit.client.0.smithi043.stdout:7/888: link d5/d11/d3b/d61/dc5/dee/f48 d5/d11/d3b/d8b/d9b/df6/f12a 0 2024-04-25T13:47:11.666 INFO:tasks.workunit.client.0.smithi043.stdout:0/746: mknod db/d1b/d94/dc2/cf8 0 2024-04-25T13:47:11.668 INFO:tasks.workunit.client.0.smithi043.stdout:0/747: write db/d1b/d94/f79 [1626475,29404] 0 2024-04-25T13:47:11.669 INFO:tasks.workunit.client.0.smithi043.stdout:8/825: read db/d46/da8/fd0 [543476,3727] 0 2024-04-25T13:47:11.670 INFO:tasks.workunit.client.0.smithi043.stdout:4/723: fsync d1/d3/d54/d62/d77/d92/fe7 0 2024-04-25T13:47:11.671 INFO:tasks.workunit.client.0.smithi043.stdout:3/739: write d0/da/db9/fdb [1156301,56533] 0 2024-04-25T13:47:11.671 INFO:tasks.workunit.client.0.smithi043.stdout:8/826: chown db/d44/d8e/lbb 15083 1 2024-04-25T13:47:11.674 INFO:tasks.workunit.client.0.smithi043.stdout:8/827: dread - db/dc/d21/db4/fe7 zero size 2024-04-25T13:47:11.674 INFO:tasks.workunit.client.0.smithi043.stdout:7/889: dread d5/d11/d3b/d61/dc5/f105 [0,4194304] 0 2024-04-25T13:47:11.675 INFO:tasks.workunit.client.0.smithi043.stdout:4/724: creat d1/de/df/d1e/fec x:0 0 0 2024-04-25T13:47:11.679 INFO:tasks.workunit.client.0.smithi043.stdout:7/890: mkdir d5/d11/d84/d12b 0 2024-04-25T13:47:11.681 INFO:tasks.workunit.client.0.smithi043.stdout:4/725: write d1/d3/f9 [4557080,111540] 0 2024-04-25T13:47:11.681 INFO:tasks.workunit.client.0.smithi043.stdout:4/726: stat d1/d6a/fe9 0 2024-04-25T13:47:11.681 INFO:tasks.workunit.client.0.smithi043.stdout:7/891: symlink d5/d103/l12c 0 2024-04-25T13:47:11.682 INFO:tasks.workunit.client.0.smithi043.stdout:3/740: link d0/d61/d82/fdd d0/da/f101 0 2024-04-25T13:47:11.686 INFO:tasks.workunit.client.0.smithi043.stdout:3/741: read d0/d13/d55/fa9 [1751121,71606] 0 2024-04-25T13:47:11.686 INFO:tasks.workunit.client.0.smithi043.stdout:8/828: truncate db/d46/da8/fbf 4008045 0 2024-04-25T13:47:11.687 INFO:tasks.workunit.client.0.smithi043.stdout:7/892: write d5/d11/d3b/d61/dc5/dee/f48 [781593,98675] 0 2024-04-25T13:47:11.687 INFO:tasks.workunit.client.0.smithi043.stdout:0/748: creat db/d1b/d4f/ff9 x:0 0 0 2024-04-25T13:47:11.688 INFO:tasks.workunit.client.0.smithi043.stdout:7/893: fdatasync d5/f3c 0 2024-04-25T13:47:11.690 INFO:tasks.workunit.client.0.smithi043.stdout:3/742: creat d0/d9/d6e/d34/d36/f102 x:0 0 0 2024-04-25T13:47:11.690 INFO:tasks.workunit.client.0.smithi043.stdout:8/829: getdents db/dc/d80 0 2024-04-25T13:47:11.691 INFO:tasks.workunit.client.0.smithi043.stdout:8/830: chown db/d38/d3c/dd9 1 1 2024-04-25T13:47:11.694 INFO:tasks.workunit.client.0.smithi043.stdout:0/749: truncate db/f1d 791477 0 2024-04-25T13:47:11.697 INFO:tasks.workunit.client.0.smithi043.stdout:8/831: mkdir db/d46/da8/d10e 0 2024-04-25T13:47:11.699 INFO:tasks.workunit.client.0.smithi043.stdout:8/832: mkdir db/dc/d21/db4/dbe/d10f 0 2024-04-25T13:47:11.700 INFO:tasks.workunit.client.0.smithi043.stdout:0/750: mkdir db/d25/dfa 0 2024-04-25T13:47:11.700 INFO:tasks.workunit.client.0.smithi043.stdout:3/743: rmdir d0/d9/d6e/dc5 39 2024-04-25T13:47:11.704 INFO:tasks.workunit.client.0.smithi043.stdout:7/894: dwrite d5/d11/f19 [0,4194304] 0 2024-04-25T13:47:11.705 INFO:tasks.workunit.client.0.smithi043.stdout:0/751: write db/d1b/fed [801989,45547] 0 2024-04-25T13:47:11.706 INFO:tasks.workunit.client.0.smithi043.stdout:7/895: chown d5/d11/d3b/d61/dc5/dcc/fd2 3 1 2024-04-25T13:47:11.707 INFO:tasks.workunit.client.0.smithi043.stdout:3/744: symlink d0/d13/l103 0 2024-04-25T13:47:11.709 INFO:tasks.workunit.client.0.smithi043.stdout:0/752: creat db/d1b/d23/d27/d39/d4c/dbb/dc8/ffb x:0 0 0 2024-04-25T13:47:11.711 INFO:tasks.workunit.client.0.smithi043.stdout:0/753: chown db/d1b/d23/d27/d39/d4c/d74/fd1 13 1 2024-04-25T13:47:11.711 INFO:tasks.workunit.client.0.smithi043.stdout:7/896: link d5/d11/c59 d5/d11/d84/d12b/c12d 0 2024-04-25T13:47:11.715 INFO:tasks.workunit.client.0.smithi043.stdout:0/754: truncate db/d1b/d94/fd5 1010446 0 2024-04-25T13:47:11.724 INFO:tasks.workunit.client.0.smithi043.stdout:0/755: creat db/d1b/d23/d27/d39/d4b/dde/ffc x:0 0 0 2024-04-25T13:47:11.725 INFO:tasks.workunit.client.0.smithi043.stdout:7/897: dwrite d5/f15 [0,4194304] 0 2024-04-25T13:47:11.729 INFO:tasks.workunit.client.0.smithi043.stdout:0/756: mkdir db/d1b/d23/d27/dfd 0 2024-04-25T13:47:11.729 INFO:tasks.workunit.client.0.smithi043.stdout:8/833: dread db/fd [0,4194304] 0 2024-04-25T13:47:11.730 INFO:tasks.workunit.client.0.smithi043.stdout:7/898: mkdir d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/d12e 0 2024-04-25T13:47:11.730 INFO:tasks.workunit.client.0.smithi043.stdout:8/834: fdatasync db/d38/de4/f89 0 2024-04-25T13:47:11.731 INFO:tasks.workunit.client.0.smithi043.stdout:0/757: chown db/d1b/d23/fe0 167007 1 2024-04-25T13:47:11.733 INFO:tasks.workunit.client.0.smithi043.stdout:7/899: rmdir d5/d11/d3b/d61/dc5/dee/d5a/d8d 39 2024-04-25T13:47:11.737 INFO:tasks.workunit.client.0.smithi043.stdout:0/758: getdents db/d1b/d62/d72 0 2024-04-25T13:47:11.741 INFO:tasks.workunit.client.0.smithi043.stdout:0/759: chown db/d1b/d23/d27/d98/fb1 2039838 1 2024-04-25T13:47:11.742 INFO:tasks.workunit.client.0.smithi043.stdout:8/835: truncate db/d38/de4/d59/d7c/daf/fc2 2404695 0 2024-04-25T13:47:11.744 INFO:tasks.workunit.client.0.smithi043.stdout:8/836: write db/d11/d79/fc6 [3675737,25479] 0 2024-04-25T13:47:11.746 INFO:tasks.workunit.client.0.smithi043.stdout:7/900: dwrite d5/d11/d80/fc9 [0,4194304] 0 2024-04-25T13:47:11.752 INFO:tasks.workunit.client.0.smithi043.stdout:7/901: rmdir d5/d32 39 2024-04-25T13:47:11.752 INFO:tasks.workunit.client.0.smithi043.stdout:7/902: stat d5/d11/d3b/d8b/d9b/ce3 0 2024-04-25T13:47:11.757 INFO:tasks.workunit.client.0.smithi043.stdout:3/745: creat d0/da/db9/df9/f104 x:0 0 0 2024-04-25T13:47:11.759 INFO:tasks.workunit.client.0.smithi043.stdout:8/837: rename db/d38/de4/f95 to db/d38/de4/dcb/f110 0 2024-04-25T13:47:11.763 INFO:tasks.workunit.client.0.smithi043.stdout:7/903: rename d5/d11/d3b/f10e to d5/d11/f12f 0 2024-04-25T13:47:11.766 INFO:tasks.workunit.client.0.smithi043.stdout:7/904: chown d5/d6b/l9f 1768069338 1 2024-04-25T13:47:11.769 INFO:tasks.workunit.client.0.smithi043.stdout:8/838: write db/d11/f3d [413771,109420] 0 2024-04-25T13:47:11.771 INFO:tasks.workunit.client.0.smithi043.stdout:3/746: dread - d0/d9/d6e/d34/d36/d57/fad zero size 2024-04-25T13:47:11.773 INFO:tasks.workunit.client.0.smithi043.stdout:7/905: getdents d5/d11/d3b/d61/dc5/dee 0 2024-04-25T13:47:11.773 INFO:tasks.workunit.client.0.smithi043.stdout:7/906: chown d5/d75 31159 1 2024-04-25T13:47:11.774 INFO:tasks.workunit.client.0.smithi043.stdout:8/839: getdents db/d38/d3c/d71/d5d/d67 0 2024-04-25T13:47:11.774 INFO:tasks.workunit.client.0.smithi043.stdout:3/747: mkdir d0/d9/d6e/d34/d36/d105 0 2024-04-25T13:47:11.776 INFO:tasks.workunit.client.0.smithi043.stdout:7/907: write d5/d11/d3b/d8b/d9b/df6/f126 [1383779,35471] 0 2024-04-25T13:47:11.776 INFO:tasks.workunit.client.0.smithi043.stdout:8/840: symlink db/d38/d3c/d71/d5d/d67/l111 0 2024-04-25T13:47:11.778 INFO:tasks.workunit.client.0.smithi043.stdout:8/841: chown db/dc/d21/d4e/d62 17448503 1 2024-04-25T13:47:11.784 INFO:tasks.workunit.client.0.smithi043.stdout:7/908: dwrite d5/d11/d84/fb2 [0,4194304] 0 2024-04-25T13:47:11.788 INFO:tasks.workunit.client.0.smithi043.stdout:3/748: dwrite d0/da/fc [4194304,4194304] 0 2024-04-25T13:47:11.788 INFO:tasks.workunit.client.0.smithi043.stdout:0/760: rename db/d1b/d4f/f5d to db/d1b/d94/dc2/ffe 0 2024-04-25T13:47:11.790 INFO:tasks.workunit.client.0.smithi043.stdout:7/909: mknod d5/d11/d3b/d61/d68/c130 0 2024-04-25T13:47:11.794 INFO:tasks.workunit.client.0.smithi043.stdout:7/910: rmdir d5/d103 39 2024-04-25T13:47:11.798 INFO:tasks.workunit.client.0.smithi043.stdout:8/842: write db/d38/de4/d59/d7c/daf/fc2 [851584,119886] 0 2024-04-25T13:47:11.798 INFO:tasks.workunit.client.0.smithi043.stdout:0/761: dwrite db/d1b/d62/d72/da2/fba [0,4194304] 0 2024-04-25T13:47:11.800 INFO:tasks.workunit.client.0.smithi043.stdout:7/911: chown d5/d11/d3b/d61/d68/c8c 21022563 1 2024-04-25T13:47:11.803 INFO:tasks.workunit.client.0.smithi043.stdout:3/749: creat d0/d13/d55/dd9/df5/d8e/d92/f106 x:0 0 0 2024-04-25T13:47:11.808 INFO:tasks.workunit.client.0.smithi043.stdout:8/843: getdents db/d44/d8e/d27 0 2024-04-25T13:47:11.810 INFO:tasks.workunit.client.0.smithi043.stdout:0/762: dwrite db/d1b/d23/d27/fc6 [0,4194304] 0 2024-04-25T13:47:11.813 INFO:tasks.workunit.client.0.smithi043.stdout:0/763: mknod db/d1b/d94/d68/cff 0 2024-04-25T13:47:11.814 INFO:tasks.workunit.client.0.smithi043.stdout:5/685: sync 2024-04-25T13:47:11.814 INFO:tasks.workunit.client.0.smithi043.stdout:6/791: sync 2024-04-25T13:47:11.815 INFO:tasks.workunit.client.0.smithi043.stdout:0/764: mknod db/d1b/d23/c100 0 2024-04-25T13:47:11.821 INFO:tasks.workunit.client.0.smithi043.stdout:5/686: dwrite d1/d3/d7/d8/fc2 [0,4194304] 0 2024-04-25T13:47:11.832 INFO:tasks.workunit.client.0.smithi043.stdout:6/792: dwrite d0/d90/f7f [0,4194304] 0 2024-04-25T13:47:11.838 INFO:tasks.workunit.client.0.smithi043.stdout:0/765: dwrite db/d1b/d4f/ff9 [0,4194304] 0 2024-04-25T13:47:11.838 INFO:tasks.workunit.client.0.smithi043.stdout:6/793: mkdir d0/d90/d10b 0 2024-04-25T13:47:11.840 INFO:tasks.workunit.client.0.smithi043.stdout:5/687: dwrite d1/d4/f7f [0,4194304] 0 2024-04-25T13:47:11.842 INFO:tasks.workunit.client.0.smithi043.stdout:7/912: dread d5/d11/d84/fd3 [0,4194304] 0 2024-04-25T13:47:11.844 INFO:tasks.workunit.client.0.smithi043.stdout:0/766: mknod db/d1b/d23/d27/d39/d4c/da9/c101 0 2024-04-25T13:47:11.845 INFO:tasks.workunit.client.0.smithi043.stdout:6/794: write d0/d76/de3/d64/da1/da3/fe7 [988873,59218] 0 2024-04-25T13:47:11.846 INFO:tasks.workunit.client.0.smithi043.stdout:7/913: unlink d5/d11/d3b/d61/f10a 0 2024-04-25T13:47:11.851 INFO:tasks.workunit.client.0.smithi043.stdout:0/767: rename db/f18 to db/d1b/d23/f102 0 2024-04-25T13:47:11.856 INFO:tasks.workunit.client.0.smithi043.stdout:0/768: rename db/d1b/d62/fb4 to db/d25/d2a/d3f/d6a/f103 0 2024-04-25T13:47:11.859 INFO:tasks.workunit.client.0.smithi043.stdout:6/795: creat d0/d76/de3/f10c x:0 0 0 2024-04-25T13:47:11.860 INFO:tasks.workunit.client.0.smithi043.stdout:0/769: fdatasync db/d1b/d36/d41/d71/fa7 0 2024-04-25T13:47:11.865 INFO:tasks.workunit.client.0.smithi043.stdout:0/770: read db/d1b/d94/f90 [696126,20835] 0 2024-04-25T13:47:11.866 INFO:tasks.workunit.client.0.smithi043.stdout:6/796: getdents d0/d90/d10b 0 2024-04-25T13:47:11.871 INFO:tasks.workunit.client.0.smithi043.stdout:0/771: dwrite db/d1b/d23/d27/d39/d4c/f8e [0,4194304] 0 2024-04-25T13:47:11.872 INFO:tasks.workunit.client.0.smithi043.stdout:0/772: dread - db/d25/d2a/d93/fbf zero size 2024-04-25T13:47:11.872 INFO:tasks.workunit.client.0.smithi043.stdout:6/797: creat d0/d90/f10d x:0 0 0 2024-04-25T13:47:11.879 INFO:tasks.workunit.client.0.smithi043.stdout:6/798: dread - d0/d76/de3/da7/fe8 zero size 2024-04-25T13:47:11.879 INFO:tasks.workunit.client.0.smithi043.stdout:0/773: dwrite db/d1b/d23/d27/d39/d4c/f77 [4194304,4194304] 0 2024-04-25T13:47:11.879 INFO:tasks.workunit.client.0.smithi043.stdout:6/799: dread - d0/d90/f10d zero size 2024-04-25T13:47:11.880 INFO:tasks.workunit.client.0.smithi043.stdout:6/800: dread - d0/d90/d4c/f6f zero size 2024-04-25T13:47:11.886 INFO:tasks.workunit.client.0.smithi043.stdout:0/774: dwrite db/d25/d2a/d3f/f42 [4194304,4194304] 0 2024-04-25T13:47:11.891 INFO:tasks.workunit.client.0.smithi043.stdout:0/775: creat db/d1b/d23/d27/d98/f104 x:0 0 0 2024-04-25T13:47:11.891 INFO:tasks.workunit.client.0.smithi043.stdout:6/801: dread d0/d3d/f6c [0,4194304] 0 2024-04-25T13:47:11.892 INFO:tasks.workunit.client.0.smithi043.stdout:6/802: dread - d0/d3d/d109/feb zero size 2024-04-25T13:47:11.894 INFO:tasks.workunit.client.0.smithi043.stdout:0/776: mkdir db/d1b/d62/d72/da2/d105 0 2024-04-25T13:47:11.896 INFO:tasks.workunit.client.0.smithi043.stdout:0/777: mknod db/d1b/d62/c106 0 2024-04-25T13:47:11.899 INFO:tasks.workunit.client.0.smithi043.stdout:0/778: chown db/d1b/d23/d27/d39/d4c/da9/lc1 24567 1 2024-04-25T13:47:11.900 INFO:tasks.workunit.client.0.smithi043.stdout:6/803: dwrite d0/d3d/d54/f68 [0,4194304] 0 2024-04-25T13:47:11.902 INFO:tasks.workunit.client.0.smithi043.stdout:0/779: mkdir db/d1b/d23/d27/dcb/d107 0 2024-04-25T13:47:11.910 INFO:tasks.workunit.client.0.smithi043.stdout:6/804: rename d0/d90/d48/d73 to d0/d76/d5c/d10e 0 2024-04-25T13:47:11.913 INFO:tasks.workunit.client.0.smithi043.stdout:6/805: unlink d0/d3d/d109/f55 0 2024-04-25T13:47:11.925 INFO:tasks.workunit.client.0.smithi043.stdout:0/780: dread f6 [0,4194304] 0 2024-04-25T13:47:11.926 INFO:tasks.workunit.client.0.smithi043.stdout:0/781: chown db/d1b/d62/d72/da2/cdc 1536 1 2024-04-25T13:47:11.926 INFO:tasks.workunit.client.0.smithi043.stdout:0/782: readlink db/d25/d2a/d3f/d6a/le5 0 2024-04-25T13:47:11.929 INFO:tasks.workunit.client.0.smithi043.stdout:0/783: mknod db/d1b/d94/da1/de2/de9/c108 0 2024-04-25T13:47:11.932 INFO:tasks.workunit.client.0.smithi043.stdout:6/806: dread d0/d1b/d96/fa2 [0,4194304] 0 2024-04-25T13:47:11.933 INFO:tasks.workunit.client.0.smithi043.stdout:0/784: getdents db/d25/d2a 0 2024-04-25T13:47:11.935 INFO:tasks.workunit.client.0.smithi043.stdout:0/785: creat db/d1b/d23/d27/d98/de4/f109 x:0 0 0 2024-04-25T13:47:11.940 INFO:tasks.workunit.client.0.smithi043.stdout:0/786: creat db/d1b/d23/d27/f10a x:0 0 0 2024-04-25T13:47:11.942 INFO:tasks.workunit.client.0.smithi043.stdout:0/787: chown db/d1b/d23/d27/d39/d4c/d74/ccd 481364770 1 2024-04-25T13:47:11.944 INFO:tasks.workunit.client.0.smithi043.stdout:6/807: dwrite d0/d76/f7c [0,4194304] 0 2024-04-25T13:47:11.944 INFO:tasks.workunit.client.0.smithi043.stdout:0/788: unlink db/d1b/d23/d27/d39/d4c/ld6 0 2024-04-25T13:47:11.946 INFO:tasks.workunit.client.0.smithi043.stdout:6/808: symlink d0/d90/d4c/l10f 0 2024-04-25T13:47:11.946 INFO:tasks.workunit.client.0.smithi043.stdout:0/789: dread - db/d1b/d23/f31 zero size 2024-04-25T13:47:11.959 INFO:tasks.workunit.client.0.smithi043.stdout:6/809: dwrite d0/d1c/f3b [0,4194304] 0 2024-04-25T13:47:11.962 INFO:tasks.workunit.client.0.smithi043.stdout:6/810: fsync d0/d3d/f6c 0 2024-04-25T13:47:11.964 INFO:tasks.workunit.client.0.smithi043.stdout:6/811: fsync d0/f29 0 2024-04-25T13:47:11.966 INFO:tasks.workunit.client.0.smithi043.stdout:6/812: write d0/d1b/fee [4755074,83711] 0 2024-04-25T13:47:11.966 INFO:tasks.workunit.client.0.smithi043.stdout:0/790: dread db/d1b/d23/d27/d39/d4b/fa8 [0,4194304] 0 2024-04-25T13:47:11.970 INFO:tasks.workunit.client.0.smithi043.stdout:6/813: dread - d0/d3d/d109/f94 zero size 2024-04-25T13:47:11.970 INFO:tasks.workunit.client.0.smithi043.stdout:0/791: mkdir db/d1b/d23/d27/dfd/d10b 0 2024-04-25T13:47:11.971 INFO:tasks.workunit.client.0.smithi043.stdout:6/814: mknod d0/d90/d4c/d107/c110 0 2024-04-25T13:47:11.972 INFO:tasks.workunit.client.0.smithi043.stdout:6/815: readlink d0/d3d/d6e/d71/l83 0 2024-04-25T13:47:11.976 INFO:tasks.workunit.client.0.smithi043.stdout:0/792: write db/d1b/d23/d27/f6b [101386,60916] 0 2024-04-25T13:47:11.978 INFO:tasks.workunit.client.0.smithi043.stdout:0/793: creat db/d1b/d62/db8/f10c x:0 0 0 2024-04-25T13:47:11.979 INFO:tasks.workunit.client.0.smithi043.stdout:0/794: write db/d1b/f26 [2621729,53912] 0 2024-04-25T13:47:11.985 INFO:tasks.workunit.client.0.smithi043.stdout:0/795: dwrite db/d1b/d23/d27/d39/d4c/d74/fd1 [0,4194304] 0 2024-04-25T13:47:11.986 INFO:tasks.workunit.client.0.smithi043.stdout:0/796: fsync db/d1b/d62/feb 0 2024-04-25T13:47:11.993 INFO:tasks.workunit.client.0.smithi043.stdout:2/643: sync 2024-04-25T13:47:11.993 INFO:tasks.workunit.client.0.smithi043.stdout:1/768: sync 2024-04-25T13:47:11.996 INFO:tasks.workunit.client.0.smithi043.stdout:1/769: truncate f3 3055658 0 2024-04-25T13:47:11.999 INFO:tasks.workunit.client.0.smithi043.stdout:0/797: rename db/d1b/d4f to db/d1b/d94/d10d 0 2024-04-25T13:47:12.000 INFO:tasks.workunit.client.0.smithi043.stdout:0/798: write db/d1b/d23/d27/fdf [1539550,66321] 0 2024-04-25T13:47:12.003 INFO:tasks.workunit.client.0.smithi043.stdout:0/799: rmdir db/d25/d2a/d93 39 2024-04-25T13:47:12.005 INFO:tasks.workunit.client.0.smithi043.stdout:2/644: truncate d0/d26/f40 43717 0 2024-04-25T13:47:12.007 INFO:tasks.workunit.client.0.smithi043.stdout:0/800: mknod db/d1b/d23/d27/d39/d4c/da9/c10e 0 2024-04-25T13:47:12.008 INFO:tasks.workunit.client.0.smithi043.stdout:1/770: creat df/d14/d63/d67/f112 x:0 0 0 2024-04-25T13:47:12.010 INFO:tasks.workunit.client.0.smithi043.stdout:1/771: creat df/d31/d38/d43/d81/f113 x:0 0 0 2024-04-25T13:47:12.012 INFO:tasks.workunit.client.0.smithi043.stdout:2/645: creat d0/d8/d22/d36/fc1 x:0 0 0 2024-04-25T13:47:12.012 INFO:tasks.workunit.client.0.smithi043.stdout:0/801: link db/d25/f69 db/d1b/d94/da1/f10f 0 2024-04-25T13:47:12.096 INFO:tasks.workunit.client.0.smithi043.stdout:2/646: mknod d0/d8/d22/cc2 0 2024-04-25T13:47:12.097 INFO:tasks.workunit.client.0.smithi043.stdout:2/647: dread - d0/d5/d1e/f9d zero size 2024-04-25T13:47:12.097 INFO:tasks.workunit.client.0.smithi043.stdout:0/802: getdents db/d1b/d36/d41/d71 0 2024-04-25T13:47:12.100 INFO:tasks.workunit.client.0.smithi043.stdout:0/803: fsync db/d25/d2a/d3f/f8b 0 2024-04-25T13:47:12.108 INFO:tasks.workunit.client.0.smithi043.stdout:2/648: write d0/d34/d3f/d46/d55/fb2 [846120,126177] 0 2024-04-25T13:47:12.108 INFO:tasks.workunit.client.0.smithi043.stdout:0/804: dwrite db/d25/d2a/d93/fb7 [0,4194304] 0 2024-04-25T13:47:12.111 INFO:tasks.workunit.client.0.smithi043.stdout:0/805: chown db/d1b/d23/f102 628 1 2024-04-25T13:47:12.111 INFO:tasks.workunit.client.0.smithi043.stdout:2/649: mkdir d0/d34/d17/d5e/da9/dc3 0 2024-04-25T13:47:12.112 INFO:tasks.workunit.client.0.smithi043.stdout:2/650: chown d0/d34/d3f/d59/da2 0 1 2024-04-25T13:47:12.115 INFO:tasks.workunit.client.0.smithi043.stdout:2/651: chown d0/d34/d17/d5e/d71/d81/fa8 8836001 1 2024-04-25T13:47:12.119 INFO:tasks.workunit.client.0.smithi043.stdout:2/652: creat d0/d34/d3f/d46/fc4 x:0 0 0 2024-04-25T13:47:12.122 INFO:tasks.workunit.client.0.smithi043.stdout:2/653: creat d0/d35/fc5 x:0 0 0 2024-04-25T13:47:12.142 INFO:tasks.workunit.client.0.smithi043.stdout:2/654: dread d0/d34/d17/d5e/d71/f85 [0,4194304] 0 2024-04-25T13:47:12.144 INFO:tasks.workunit.client.0.smithi043.stdout:2/655: read d0/d5/d1e/f6b [763535,106071] 0 2024-04-25T13:47:12.144 INFO:tasks.workunit.client.0.smithi043.stdout:4/727: sync 2024-04-25T13:47:12.149 INFO:tasks.workunit.client.0.smithi043.stdout:4/728: unlink d1/de/df/d1a/f65 0 2024-04-25T13:47:12.150 INFO:tasks.workunit.client.0.smithi043.stdout:4/729: fdatasync d1/d3/d7b/f7f 0 2024-04-25T13:47:12.151 INFO:tasks.workunit.client.0.smithi043.stdout:4/730: readlink d1/de/df/db4/lea 0 2024-04-25T13:47:12.155 INFO:tasks.workunit.client.0.smithi043.stdout:4/731: creat d1/de/df/d1e/dc8/fed x:0 0 0 2024-04-25T13:47:12.156 INFO:tasks.workunit.client.0.smithi043.stdout:4/732: chown d1/de/df/d1e 4651680 1 2024-04-25T13:47:12.157 INFO:tasks.workunit.client.0.smithi043.stdout:2/656: dwrite d0/d34/f1a [0,4194304] 0 2024-04-25T13:47:12.159 INFO:tasks.workunit.client.0.smithi043.stdout:2/657: write d0/fa1 [129320,106744] 0 2024-04-25T13:47:12.161 INFO:tasks.workunit.client.0.smithi043.stdout:4/733: dread d1/de/df/d1e/d45/da1/db3/d33/f74 [4194304,4194304] 0 2024-04-25T13:47:12.164 INFO:tasks.workunit.client.0.smithi043.stdout:2/658: write d0/d5/d1e/f39 [6865364,78359] 0 2024-04-25T13:47:12.176 INFO:tasks.workunit.client.0.smithi043.stdout:4/734: truncate d1/de/df/d1e/d45/da1/db3/d33/fd3 817028 0 2024-04-25T13:47:12.181 INFO:tasks.workunit.client.0.smithi043.stdout:4/735: getdents d1/d34/d35 0 2024-04-25T13:47:12.189 INFO:tasks.workunit.client.0.smithi043.stdout:2/659: rename d0/d8/d22 to d0/d34/d17/dc6 0 2024-04-25T13:47:12.192 INFO:tasks.workunit.client.0.smithi043.stdout:2/660: symlink d0/d5/d2f/lc7 0 2024-04-25T13:47:12.193 INFO:tasks.workunit.client.0.smithi043.stdout:2/661: chown d0/d34/d17/l6a 1012 1 2024-04-25T13:47:12.194 INFO:tasks.workunit.client.0.smithi043.stdout:2/662: dread - d0/d34/d3f/f93 zero size 2024-04-25T13:47:12.200 INFO:tasks.workunit.client.0.smithi043.stdout:2/663: link d0/d34/d17/d5e/d86/l9a d0/d5/d2f/d8d/lc8 0 2024-04-25T13:47:12.202 INFO:tasks.workunit.client.0.smithi043.stdout:2/664: write d0/d34/d17/f23 [4640204,113046] 0 2024-04-25T13:47:12.204 INFO:tasks.workunit.client.0.smithi043.stdout:4/736: dread d1/de/df/db4/f51 [0,4194304] 0 2024-04-25T13:47:12.205 INFO:tasks.workunit.client.0.smithi043.stdout:2/665: rmdir d0/d34/d17/d5e/d71 39 2024-04-25T13:47:12.206 INFO:tasks.workunit.client.0.smithi043.stdout:4/737: chown d1/de/df/db4/d36/d9e/d9d/cc6 13 1 2024-04-25T13:47:12.209 INFO:tasks.workunit.client.0.smithi043.stdout:0/806: dwrite db/d1b/d23/d27/d39/d4b/fa8 [0,4194304] 0 2024-04-25T13:47:12.209 INFO:tasks.workunit.client.0.smithi043.stdout:4/738: mknod d1/de/df/d1e/d45/cee 0 2024-04-25T13:47:12.210 INFO:tasks.workunit.client.0.smithi043.stdout:4/739: chown d1/d3/d54/f7e 880757 1 2024-04-25T13:47:12.212 INFO:tasks.workunit.client.0.smithi043.stdout:2/666: mkdir d0/d34/d77/dc9 0 2024-04-25T13:47:12.212 INFO:tasks.workunit.client.0.smithi043.stdout:2/667: fdatasync d0/d8/f8b 0 2024-04-25T13:47:12.212 INFO:tasks.workunit.client.0.smithi043.stdout:4/740: rmdir d1/de/df 39 2024-04-25T13:47:12.213 INFO:tasks.workunit.client.0.smithi043.stdout:8/844: sync 2024-04-25T13:47:12.213 INFO:tasks.workunit.client.0.smithi043.stdout:3/750: sync 2024-04-25T13:47:12.215 INFO:tasks.workunit.client.0.smithi043.stdout:3/751: fdatasync d0/d13/d55/dd9/df5/d8e/d92/f106 0 2024-04-25T13:47:12.215 INFO:tasks.workunit.client.0.smithi043.stdout:4/741: mknod d1/d6a/dd4/cef 0 2024-04-25T13:47:12.215 INFO:tasks.workunit.client.0.smithi043.stdout:2/668: truncate d0/d34/d17/d5e/d71/fb7 786087 0 2024-04-25T13:47:12.216 INFO:tasks.workunit.client.0.smithi043.stdout:4/742: chown d1/d34/d35/l4f 61394433 1 2024-04-25T13:47:12.216 INFO:tasks.workunit.client.0.smithi043.stdout:8/845: unlink db/dc/d21/ld5 0 2024-04-25T13:47:12.219 INFO:tasks.workunit.client.0.smithi043.stdout:0/807: fsync db/d25/d2a/d9d/fb2 0 2024-04-25T13:47:12.219 INFO:tasks.workunit.client.0.smithi043.stdout:8/846: symlink db/d38/d3c/d71/l112 0 2024-04-25T13:47:12.220 INFO:tasks.workunit.client.0.smithi043.stdout:0/808: write db/d25/fa3 [5169271,40502] 0 2024-04-25T13:47:12.221 INFO:tasks.workunit.client.0.smithi043.stdout:0/809: chown db/d25/d2a/d9d/fb2 0 1 2024-04-25T13:47:12.223 INFO:tasks.workunit.client.0.smithi043.stdout:8/847: getdents db/d38/d3c/dd9 0 2024-04-25T13:47:12.223 INFO:tasks.workunit.client.0.smithi043.stdout:8/848: chown db/d44 153035 1 2024-04-25T13:47:12.224 INFO:tasks.workunit.client.0.smithi043.stdout:3/752: creat d0/da/db9/d9e/f107 x:0 0 0 2024-04-25T13:47:12.225 INFO:tasks.workunit.client.0.smithi043.stdout:2/669: link d0/d5/d2f/f7f d0/d34/d17/dc6/d5c/d8c/fca 0 2024-04-25T13:47:12.225 INFO:tasks.workunit.client.0.smithi043.stdout:8/849: read db/d44/d5c/fb8 [3929679,101796] 0 2024-04-25T13:47:12.228 INFO:tasks.workunit.client.0.smithi043.stdout:8/850: rmdir db/d38/d3c/d71/d5d/d67 39 2024-04-25T13:47:12.228 INFO:tasks.workunit.client.0.smithi043.stdout:3/753: mknod d0/d13/d55/dd9/df5/d8e/d92/dc3/c108 0 2024-04-25T13:47:12.232 INFO:tasks.workunit.client.0.smithi043.stdout:3/754: symlink d0/da/l109 0 2024-04-25T13:47:12.234 INFO:tasks.workunit.client.0.smithi043.stdout:8/851: dwrite db/dc/d80/fd6 [0,4194304] 0 2024-04-25T13:47:12.237 INFO:tasks.workunit.client.0.smithi043.stdout:4/743: rename d1/d3/d54/f7e to d1/ff0 0 2024-04-25T13:47:12.239 INFO:tasks.workunit.client.0.smithi043.stdout:8/852: mknod db/dc/d21/d4e/d62/c113 0 2024-04-25T13:47:12.241 INFO:tasks.workunit.client.0.smithi043.stdout:5/688: sync 2024-04-25T13:47:12.241 INFO:tasks.workunit.client.0.smithi043.stdout:6/816: sync 2024-04-25T13:47:12.241 INFO:tasks.workunit.client.0.smithi043.stdout:1/772: sync 2024-04-25T13:47:12.241 INFO:tasks.workunit.client.0.smithi043.stdout:7/914: sync 2024-04-25T13:47:12.242 INFO:tasks.workunit.client.0.smithi043.stdout:7/915: chown d5/l38 64 1 2024-04-25T13:47:12.244 INFO:tasks.workunit.client.0.smithi043.stdout:7/916: fdatasync d5/d11/d3b/d61/f7c 0 2024-04-25T13:47:12.244 INFO:tasks.workunit.client.0.smithi043.stdout:5/689: symlink d1/d3/d7/d8/da/le3 0 2024-04-25T13:47:12.245 INFO:tasks.workunit.client.0.smithi043.stdout:1/773: mkdir df/d14/d3d/d114 0 2024-04-25T13:47:12.246 INFO:tasks.workunit.client.0.smithi043.stdout:4/744: dwrite d1/de/d1d/d20/f52 [0,4194304] 0 2024-04-25T13:47:12.247 INFO:tasks.workunit.client.0.smithi043.stdout:5/690: write d1/d3/d7/d2f/fc8 [848253,71402] 0 2024-04-25T13:47:12.250 INFO:tasks.workunit.client.0.smithi043.stdout:5/691: truncate d1/d3/d24/d7c/f86 4277428 0 2024-04-25T13:47:12.250 INFO:tasks.workunit.client.0.smithi043.stdout:1/774: creat df/d31/d38/d43/dbc/f115 x:0 0 0 2024-04-25T13:47:12.250 INFO:tasks.workunit.client.0.smithi043.stdout:3/755: read d0/d9/d6e/d34/d36/d57/de5/fdf [362142,112487] 0 2024-04-25T13:47:12.254 INFO:tasks.workunit.client.0.smithi043.stdout:5/692: symlink d1/d8d/db8/le4 0 2024-04-25T13:47:12.258 INFO:tasks.workunit.client.0.smithi043.stdout:7/917: dread d5/d11/d3b/d61/dc5/dee/d5a/f88 [0,4194304] 0 2024-04-25T13:47:12.260 INFO:tasks.workunit.client.0.smithi043.stdout:1/775: getdents df/d31/dc7/dc8/dd2 0 2024-04-25T13:47:12.263 INFO:tasks.workunit.client.0.smithi043.stdout:5/693: dwrite d1/d8d/db8/fdb [0,4194304] 0 2024-04-25T13:47:12.263 INFO:tasks.workunit.client.0.smithi043.stdout:1/776: write df/d31/d38/d43/dbc/ffd [724035,9320] 0 2024-04-25T13:47:12.264 INFO:tasks.workunit.client.0.smithi043.stdout:5/694: readlink d1/l8b 0 2024-04-25T13:47:12.268 INFO:tasks.workunit.client.0.smithi043.stdout:4/745: dread d1/de/df/db4/d36/d53/fa2 [0,4194304] 0 2024-04-25T13:47:12.269 INFO:tasks.workunit.client.0.smithi043.stdout:7/918: dwrite d5/d11/f19 [0,4194304] 0 2024-04-25T13:47:12.270 INFO:tasks.workunit.client.0.smithi043.stdout:4/746: chown d1/de/df/d1e/dc8/fed 1925885 1 2024-04-25T13:47:12.271 INFO:tasks.workunit.client.0.smithi043.stdout:5/695: link d1/d3/d24/d7c/c7d d1/d3/d7/d8/df/ce5 0 2024-04-25T13:47:12.273 INFO:tasks.workunit.client.0.smithi043.stdout:0/810: rename db/d1b/d94/d10d/l67 to db/d1b/d23/d27/d39/d4c/l110 0 2024-04-25T13:47:12.273 INFO:tasks.workunit.client.0.smithi043.stdout:5/696: chown d1/d3/d7/d8/df/d98/fae 368 1 2024-04-25T13:47:12.274 INFO:tasks.workunit.client.0.smithi043.stdout:7/919: stat d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/d12e 0 2024-04-25T13:47:12.275 INFO:tasks.workunit.client.0.smithi043.stdout:0/811: chown db/d1b/d23/d27/f75 255522394 1 2024-04-25T13:47:12.275 INFO:tasks.workunit.client.0.smithi043.stdout:5/697: write d1/d3/d7/d9/d2d/f6c [3238938,76646] 0 2024-04-25T13:47:12.279 INFO:tasks.workunit.client.0.smithi043.stdout:1/777: creat df/d14/d63/d67/da7/f116 x:0 0 0 2024-04-25T13:47:12.279 INFO:tasks.workunit.client.0.smithi043.stdout:5/698: unlink d1/l8b 0 2024-04-25T13:47:12.282 INFO:tasks.workunit.client.0.smithi043.stdout:1/778: mknod df/d10/d22/c117 0 2024-04-25T13:47:12.283 INFO:tasks.workunit.client.0.smithi043.stdout:4/747: truncate d1/de/fc4 255930 0 2024-04-25T13:47:12.296 INFO:tasks.workunit.client.0.smithi043.stdout:0/812: read db/d1b/d94/d10d/f58 [3381617,21766] 0 2024-04-25T13:47:12.296 INFO:tasks.workunit.client.0.smithi043.stdout:2/670: rename d0/d34/f20 to d0/d5/d2f/fcb 0 2024-04-25T13:47:12.297 INFO:tasks.workunit.client.0.smithi043.stdout:4/748: write d1/d3/d54/d62/d77/d79/f60 [2646699,73229] 0 2024-04-25T13:47:12.299 INFO:tasks.workunit.client.0.smithi043.stdout:8/853: rename db/d11/d79/d81/le5 to db/d46/da8/l114 0 2024-04-25T13:47:12.300 INFO:tasks.workunit.client.0.smithi043.stdout:4/749: chown d1/de/df/db4/d36/d9e/d9d/cd8 10234 1 2024-04-25T13:47:12.300 INFO:tasks.workunit.client.0.smithi043.stdout:0/813: creat db/d1b/d23/d27/d39/d4c/dbb/dc8/f111 x:0 0 0 2024-04-25T13:47:12.302 INFO:tasks.workunit.client.0.smithi043.stdout:0/814: stat db/d1b/f22 0 2024-04-25T13:47:12.302 INFO:tasks.workunit.client.0.smithi043.stdout:8/854: readlink db/l1c 0 2024-04-25T13:47:12.303 INFO:tasks.workunit.client.0.smithi043.stdout:4/750: chown d1/de/d1d/d20/f82 1971841 1 2024-04-25T13:47:12.303 INFO:tasks.workunit.client.0.smithi043.stdout:8/855: fsync db/dc/f45 0 2024-04-25T13:47:12.303 INFO:tasks.workunit.client.0.smithi043.stdout:2/671: getdents d0/d5/d2f/d8d 0 2024-04-25T13:47:12.305 INFO:tasks.workunit.client.0.smithi043.stdout:4/751: write d1/de/df/db4/d36/d53/fb6 [782488,93365] 0 2024-04-25T13:47:12.310 INFO:tasks.workunit.client.0.smithi043.stdout:0/815: dwrite db/d1b/d23/d27/f5a [0,4194304] 0 2024-04-25T13:47:12.311 INFO:tasks.workunit.client.0.smithi043.stdout:4/752: read d1/de/df/db4/d36/d53/fb6 [544941,62684] 0 2024-04-25T13:47:12.314 INFO:tasks.workunit.client.0.smithi043.stdout:0/816: fdatasync db/d1b/d36/d41/d71/fa7 0 2024-04-25T13:47:12.322 INFO:tasks.workunit.client.0.smithi043.stdout:0/817: dwrite db/d1b/d23/d27/d98/f104 [0,4194304] 0 2024-04-25T13:47:12.322 INFO:tasks.workunit.client.0.smithi043.stdout:3/756: rename d0/d61/lbb to d0/d9/d6e/d34/d36/l10a 0 2024-04-25T13:47:12.323 INFO:tasks.workunit.client.0.smithi043.stdout:7/920: rename d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/df0 to d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/df0/d119/d131 22 2024-04-25T13:47:12.328 INFO:tasks.workunit.client.0.smithi043.stdout:5/699: rename d1/d3/d7/d2f/d67/f51 to d1/d8d/fe6 0 2024-04-25T13:47:12.330 INFO:tasks.workunit.client.0.smithi043.stdout:3/757: symlink d0/d13/d55/l10b 0 2024-04-25T13:47:12.332 INFO:tasks.workunit.client.0.smithi043.stdout:7/921: dread d5/f15 [0,4194304] 0 2024-04-25T13:47:12.332 INFO:tasks.workunit.client.0.smithi043.stdout:8/856: rename db/dc to db/dc/d21/d4e/d62/d115 22 2024-04-25T13:47:12.335 INFO:tasks.workunit.client.0.smithi043.stdout:0/818: getdents db/d1b/d94/dc2 0 2024-04-25T13:47:12.335 INFO:tasks.workunit.client.0.smithi043.stdout:8/857: chown db/d38/d3c/dd9/f107 100694 1 2024-04-25T13:47:12.336 INFO:tasks.workunit.client.0.smithi043.stdout:5/700: dread d1/d4/f68 [0,4194304] 0 2024-04-25T13:47:12.338 INFO:tasks.workunit.client.0.smithi043.stdout:8/858: fsync db/dc/f2f 0 2024-04-25T13:47:12.339 INFO:tasks.workunit.client.0.smithi043.stdout:2/672: dwrite d0/d34/d17/dc6/d36/fb6 [0,4194304] 0 2024-04-25T13:47:12.340 INFO:tasks.workunit.client.0.smithi043.stdout:0/819: creat db/d1b/d62/d72/da2/f112 x:0 0 0 2024-04-25T13:47:12.342 INFO:tasks.workunit.client.0.smithi043.stdout:0/820: chown db/d25/f46 71 1 2024-04-25T13:47:12.344 INFO:tasks.workunit.client.0.smithi043.stdout:2/673: fdatasync d0/d35/f48 0 2024-04-25T13:47:12.348 INFO:tasks.workunit.client.0.smithi043.stdout:5/701: getdents d1/d3/d7/d8/da/d11 0 2024-04-25T13:47:12.349 INFO:tasks.workunit.client.0.smithi043.stdout:4/753: dread d1/d3/d54/d62/d77/d92/dc5/fb2 [0,4194304] 0 2024-04-25T13:47:12.349 INFO:tasks.workunit.client.0.smithi043.stdout:7/922: dwrite d5/d11/d3b/d61/dc5/dcc/fd2 [4194304,4194304] 0 2024-04-25T13:47:12.351 INFO:tasks.workunit.client.0.smithi043.stdout:5/702: dread - d1/d3/fd6 zero size 2024-04-25T13:47:12.352 INFO:tasks.workunit.client.0.smithi043.stdout:4/754: write d1/d3/f68 [6587675,14514] 0 2024-04-25T13:47:12.353 INFO:tasks.workunit.client.0.smithi043.stdout:7/923: chown d5/f3c 19 1 2024-04-25T13:47:12.353 INFO:tasks.workunit.client.0.smithi043.stdout:2/674: symlink d0/d34/d17/d5e/d71/d81/lcc 0 2024-04-25T13:47:12.354 INFO:tasks.workunit.client.0.smithi043.stdout:0/821: read db/d1b/d23/d27/d39/d4c/f70 [548739,103768] 0 2024-04-25T13:47:12.355 INFO:tasks.workunit.client.0.smithi043.stdout:5/703: chown d1/d3/d7/d8/da/d11/d52 6738485 1 2024-04-25T13:47:12.363 INFO:tasks.workunit.client.0.smithi043.stdout:0/822: mkdir db/d1b/d62/d72/da2/d105/d113 0 2024-04-25T13:47:12.366 INFO:tasks.workunit.client.0.smithi043.stdout:4/755: getdents d1/de/df/db4/d36/d53 0 2024-04-25T13:47:12.373 INFO:tasks.workunit.client.0.smithi043.stdout:3/758: dread d0/d61/f70 [0,4194304] 0 2024-04-25T13:47:12.378 INFO:tasks.workunit.client.0.smithi043.stdout:4/756: write d1/de/f8c [1638072,70192] 0 2024-04-25T13:47:12.378 INFO:tasks.workunit.client.0.smithi043.stdout:8/859: rename db/d38/de4/d59/d7c/daf to db/dc/d28/d104/d116 0 2024-04-25T13:47:12.379 INFO:tasks.workunit.client.0.smithi043.stdout:5/704: dwrite d1/d3/d7/d9/d2d/d5b/fa5 [0,4194304] 0 2024-04-25T13:47:12.381 INFO:tasks.workunit.client.0.smithi043.stdout:7/924: dwrite d5/f10 [4194304,4194304] 0 2024-04-25T13:47:12.386 INFO:tasks.workunit.client.0.smithi043.stdout:0/823: dread db/d1b/d23/d27/d39/d4c/f77 [4194304,4194304] 0 2024-04-25T13:47:12.387 INFO:tasks.workunit.client.0.smithi043.stdout:2/675: dread d0/d5/d2f/f79 [0,4194304] 0 2024-04-25T13:47:12.391 INFO:tasks.workunit.client.0.smithi043.stdout:4/757: dwrite d1/de/df/d1a/f3c [0,4194304] 0 2024-04-25T13:47:12.402 INFO:tasks.workunit.client.0.smithi043.stdout:7/925: dread d5/f3c [0,4194304] 0 2024-04-25T13:47:12.402 INFO:tasks.workunit.client.0.smithi043.stdout:7/926: chown d5/l1a 5758888 1 2024-04-25T13:47:12.403 INFO:tasks.workunit.client.0.smithi043.stdout:7/927: stat d5/d11/d8f/fc3 0 2024-04-25T13:47:12.403 INFO:tasks.workunit.client.0.smithi043.stdout:7/928: chown d5/d11/d3b/f46 15 1 2024-04-25T13:47:12.404 INFO:tasks.workunit.client.0.smithi043.stdout:7/929: stat d5/d11/d3b/d61/d68/dc0 0 2024-04-25T13:47:12.407 INFO:tasks.workunit.client.0.smithi043.stdout:2/676: creat d0/d8/fcd x:0 0 0 2024-04-25T13:47:12.408 INFO:tasks.workunit.client.0.smithi043.stdout:4/758: link d1/de/df/db4/d36/d53/d66/d94/f97 d1/de/df/d1a/d49/ff1 0 2024-04-25T13:47:12.408 INFO:tasks.workunit.client.0.smithi043.stdout:2/677: dread - d0/d26/fb1 zero size 2024-04-25T13:47:12.409 INFO:tasks.workunit.client.0.smithi043.stdout:7/930: dread - d5/d11/d3b/d61/dc5/dee/d5a/d8d/ff3 zero size 2024-04-25T13:47:12.410 INFO:tasks.workunit.client.0.smithi043.stdout:8/860: write db/d46/f61 [4424739,64769] 0 2024-04-25T13:47:12.413 INFO:tasks.workunit.client.0.smithi043.stdout:8/861: chown db/d7d/f9b 497774526 1 2024-04-25T13:47:12.413 INFO:tasks.workunit.client.0.smithi043.stdout:0/824: write db/d25/d2a/d3f/f95 [1255558,31343] 0 2024-04-25T13:47:12.413 INFO:tasks.workunit.client.0.smithi043.stdout:4/759: getdents d1/de/df/db4/d36/d9e/d9d/dd0 0 2024-04-25T13:47:12.414 INFO:tasks.workunit.client.0.smithi043.stdout:3/759: creat d0/da/db9/f10c x:0 0 0 2024-04-25T13:47:12.419 INFO:tasks.workunit.client.0.smithi043.stdout:2/678: dwrite d0/d34/d17/f23 [4194304,4194304] 0 2024-04-25T13:47:12.423 INFO:tasks.workunit.client.0.smithi043.stdout:7/931: dwrite d5/d11/d3b/d61/dc5/dcc/fe1 [0,4194304] 0 2024-04-25T13:47:12.424 INFO:tasks.workunit.client.0.smithi043.stdout:7/932: stat d5/d11/d80/lde 0 2024-04-25T13:47:12.425 INFO:tasks.workunit.client.0.smithi043.stdout:0/825: creat db/d1b/d23/d27/d39/d4c/dbb/dc8/df5/f114 x:0 0 0 2024-04-25T13:47:12.427 INFO:tasks.workunit.client.0.smithi043.stdout:2/679: mkdir d0/d34/d17/dc6/d5c/d8c/dce 0 2024-04-25T13:47:12.429 INFO:tasks.workunit.client.0.smithi043.stdout:4/760: link d1/de/d1d/d20/fa6 d1/de/d1d/d20/ff2 0 2024-04-25T13:47:12.432 INFO:tasks.workunit.client.0.smithi043.stdout:0/826: mkdir db/d1b/d94/d68/dc0/d115 0 2024-04-25T13:47:12.434 INFO:tasks.workunit.client.0.smithi043.stdout:2/680: link d0/d34/d3f/d46/fc4 d0/d34/d3f/d46/d55/fcf 0 2024-04-25T13:47:12.434 INFO:tasks.workunit.client.0.smithi043.stdout:7/933: creat d5/f132 x:0 0 0 2024-04-25T13:47:12.436 INFO:tasks.workunit.client.0.smithi043.stdout:0/827: creat db/d1b/d94/d68/f116 x:0 0 0 2024-04-25T13:47:12.438 INFO:tasks.workunit.client.0.smithi043.stdout:2/681: write d0/d34/d3f/d46/d55/fcf [445349,51741] 0 2024-04-25T13:47:12.440 INFO:tasks.workunit.client.0.smithi043.stdout:3/760: creat d0/da/db9/f10d x:0 0 0 2024-04-25T13:47:12.441 INFO:tasks.workunit.client.0.smithi043.stdout:0/828: mkdir db/d1b/d23/d27/d39/d4c/da9/d117 0 2024-04-25T13:47:12.445 INFO:tasks.workunit.client.0.smithi043.stdout:0/829: write db/d1b/d23/d27/fc6 [4090418,97367] 0 2024-04-25T13:47:12.446 INFO:tasks.workunit.client.0.smithi043.stdout:0/830: chown db/d1b/d94/d68/dc0 1 1 2024-04-25T13:47:12.447 INFO:tasks.workunit.client.0.smithi043.stdout:2/682: dread d0/d5/d2f/f7f [0,4194304] 0 2024-04-25T13:47:12.452 INFO:tasks.workunit.client.0.smithi043.stdout:0/831: creat db/d1b/d23/d27/d39/d4c/dbb/dc8/f118 x:0 0 0 2024-04-25T13:47:12.452 INFO:tasks.workunit.client.0.smithi043.stdout:2/683: unlink d0/d34/d17/d5e/cbd 0 2024-04-25T13:47:12.457 INFO:tasks.workunit.client.0.smithi043.stdout:5/705: rename d1/d4/d92/fb0 to d1/d3/d7/d9/d2d/d36/fe7 0 2024-04-25T13:47:12.460 INFO:tasks.workunit.client.0.smithi043.stdout:8/862: dread db/dc/d28/f6d [0,4194304] 0 2024-04-25T13:47:12.460 INFO:tasks.workunit.client.0.smithi043.stdout:4/761: dread d1/fb7 [0,4194304] 0 2024-04-25T13:47:12.461 INFO:tasks.workunit.client.0.smithi043.stdout:0/832: dwrite db/d1b/d23/d27/f5a [0,4194304] 0 2024-04-25T13:47:12.463 INFO:tasks.workunit.client.0.smithi043.stdout:2/684: creat d0/d34/d3f/d7b/fd0 x:0 0 0 2024-04-25T13:47:12.464 INFO:tasks.workunit.client.0.smithi043.stdout:7/934: dread d5/d75/f66 [0,4194304] 0 2024-04-25T13:47:12.464 INFO:tasks.workunit.client.0.smithi043.stdout:0/833: fdatasync db/d1b/d23/d27/d39/d4b/dde/ffc 0 2024-04-25T13:47:12.465 INFO:tasks.workunit.client.0.smithi043.stdout:8/863: chown db/d38/d3c/d71/d5d/d67/fc9 104 1 2024-04-25T13:47:12.465 INFO:tasks.workunit.client.0.smithi043.stdout:3/761: rename d0/d9/d6e/d34/d36/d57/de5/dc2/ff2 to d0/d13/d55/dd9/df5/d8e/d92/f10e 0 2024-04-25T13:47:12.468 INFO:tasks.workunit.client.0.smithi043.stdout:8/864: fdatasync db/d44/d5c/fb8 0 2024-04-25T13:47:12.469 INFO:tasks.workunit.client.0.smithi043.stdout:7/935: mkdir d5/d75/d79/d133 0 2024-04-25T13:47:12.471 INFO:tasks.workunit.client.0.smithi043.stdout:4/762: rename d1/d6a/l80 to d1/lf3 0 2024-04-25T13:47:12.472 INFO:tasks.workunit.client.0.smithi043.stdout:8/865: fdatasync db/dc/d21/f39 0 2024-04-25T13:47:12.474 INFO:tasks.workunit.client.0.smithi043.stdout:5/706: dwrite d1/d3/d7/d8/df/d98/fcf [0,4194304] 0 2024-04-25T13:47:12.475 INFO:tasks.workunit.client.0.smithi043.stdout:6/817: sync 2024-04-25T13:47:12.475 INFO:tasks.workunit.client.0.smithi043.stdout:1/779: sync 2024-04-25T13:47:12.478 INFO:tasks.workunit.client.0.smithi043.stdout:7/936: mkdir d5/d11/d3b/d8b/d9b/df6/d134 0 2024-04-25T13:47:12.478 INFO:tasks.workunit.client.0.smithi043.stdout:4/763: write d1/d3/d54/d62/dba/fdb [1197595,76303] 0 2024-04-25T13:47:12.479 INFO:tasks.workunit.client.0.smithi043.stdout:2/685: creat d0/d34/d17/da0/fd1 x:0 0 0 2024-04-25T13:47:12.480 INFO:tasks.workunit.client.0.smithi043.stdout:5/707: rmdir d1/d3/d7/d2f/d80 39 2024-04-25T13:47:12.485 INFO:tasks.workunit.client.0.smithi043.stdout:1/780: creat df/d10/f118 x:0 0 0 2024-04-25T13:47:12.486 INFO:tasks.workunit.client.0.smithi043.stdout:6/818: mknod d0/d3d/dc9/c111 0 2024-04-25T13:47:12.486 INFO:tasks.workunit.client.0.smithi043.stdout:8/866: symlink db/dc/d28/l117 0 2024-04-25T13:47:12.489 INFO:tasks.workunit.client.0.smithi043.stdout:4/764: unlink d1/de/df/db4/d36/d9e/ce2 0 2024-04-25T13:47:12.489 INFO:tasks.workunit.client.0.smithi043.stdout:0/834: dread db/d1b/d23/f102 [0,4194304] 0 2024-04-25T13:47:12.489 INFO:tasks.workunit.client.0.smithi043.stdout:7/937: rmdir d5/d11/d3b/d61/dc5/dcc 39 2024-04-25T13:47:12.491 INFO:tasks.workunit.client.0.smithi043.stdout:8/867: mknod db/dc/d21/db4/dbe/c118 0 2024-04-25T13:47:12.494 INFO:tasks.workunit.client.0.smithi043.stdout:1/781: truncate df/d10/d22/d2f/d9c/d41/fb4 1054441 0 2024-04-25T13:47:12.496 INFO:tasks.workunit.client.0.smithi043.stdout:5/708: dwrite d1/d8d/db8/fda [0,4194304] 0 2024-04-25T13:47:12.500 INFO:tasks.workunit.client.0.smithi043.stdout:2/686: truncate d0/d5/d2f/f7f 3511793 0 2024-04-25T13:47:12.502 INFO:tasks.workunit.client.0.smithi043.stdout:0/835: write db/ff3 [1077969,41506] 0 2024-04-25T13:47:12.504 INFO:tasks.workunit.client.0.smithi043.stdout:2/687: write d0/d5/d1e/d32/f96 [110694,118039] 0 2024-04-25T13:47:12.505 INFO:tasks.workunit.client.0.smithi043.stdout:8/868: write db/dc/d28/d104/d116/ffa [1985997,39283] 0 2024-04-25T13:47:12.507 INFO:tasks.workunit.client.0.smithi043.stdout:6/819: dwrite d0/d76/d5c/d10e/f80 [0,4194304] 0 2024-04-25T13:47:12.516 INFO:tasks.workunit.client.0.smithi043.stdout:8/869: dwrite db/d7d/df2/fff [0,4194304] 0 2024-04-25T13:47:12.521 INFO:tasks.workunit.client.0.smithi043.stdout:6/820: rmdir d0/d76/de3/da7/dc3 39 2024-04-25T13:47:12.523 INFO:tasks.workunit.client.0.smithi043.stdout:6/821: readlink d0/l35 0 2024-04-25T13:47:12.524 INFO:tasks.workunit.client.0.smithi043.stdout:6/822: fdatasync d0/d3d/fe6 0 2024-04-25T13:47:12.525 INFO:tasks.workunit.client.0.smithi043.stdout:6/823: chown d0/d3d/d6e/f86 3687 1 2024-04-25T13:47:12.527 INFO:tasks.workunit.client.0.smithi043.stdout:2/688: mkdir d0/d34/d17/da0/dd2 0 2024-04-25T13:47:12.527 INFO:tasks.workunit.client.0.smithi043.stdout:6/824: truncate d0/d90/db0/ff6 422383 0 2024-04-25T13:47:12.528 INFO:tasks.workunit.client.0.smithi043.stdout:4/765: link d1/de/d1d/d20/c96 d1/d3/d54/d62/dba/cf4 0 2024-04-25T13:47:12.528 INFO:tasks.workunit.client.0.smithi043.stdout:5/709: creat d1/d3/d7/d9/d2d/d36/fe8 x:0 0 0 2024-04-25T13:47:12.530 INFO:tasks.workunit.client.0.smithi043.stdout:2/689: chown d0/d26/f40 78 1 2024-04-25T13:47:12.530 INFO:tasks.workunit.client.0.smithi043.stdout:6/825: mkdir d0/d1b/d112 0 2024-04-25T13:47:12.532 INFO:tasks.workunit.client.0.smithi043.stdout:6/826: fdatasync d0/d90/d48/ff8 0 2024-04-25T13:47:12.532 INFO:tasks.workunit.client.0.smithi043.stdout:4/766: mknod d1/de/df/db4/cf5 0 2024-04-25T13:47:12.533 INFO:tasks.workunit.client.0.smithi043.stdout:6/827: read - d0/d1b/fdf zero size 2024-04-25T13:47:12.534 INFO:tasks.workunit.client.0.smithi043.stdout:2/690: mknod d0/d34/d17/dc6/d5c/d8c/cd3 0 2024-04-25T13:47:12.535 INFO:tasks.workunit.client.0.smithi043.stdout:4/767: mkdir d1/d3/d54/d62/d77/d92/df6 0 2024-04-25T13:47:12.536 INFO:tasks.workunit.client.0.smithi043.stdout:6/828: creat d0/d90/dd9/f113 x:0 0 0 2024-04-25T13:47:12.538 INFO:tasks.workunit.client.0.smithi043.stdout:0/836: link db/d25/d2a/d9d/ld9 db/d1b/d23/d27/d39/d4c/da9/d117/l119 0 2024-04-25T13:47:12.542 INFO:tasks.workunit.client.0.smithi043.stdout:0/837: creat db/d1b/d23/d27/d98/de4/f11a x:0 0 0 2024-04-25T13:47:12.543 INFO:tasks.workunit.client.0.smithi043.stdout:6/829: dwrite d0/d90/db0/ff6 [0,4194304] 0 2024-04-25T13:47:12.549 INFO:tasks.workunit.client.0.smithi043.stdout:4/768: dwrite d1/de/df/db4/d36/f6c [0,4194304] 0 2024-04-25T13:47:12.550 INFO:tasks.workunit.client.0.smithi043.stdout:4/769: chown d1/c4 1739 1 2024-04-25T13:47:12.552 INFO:tasks.workunit.client.0.smithi043.stdout:0/838: write f6 [404422,65837] 0 2024-04-25T13:47:12.552 INFO:tasks.workunit.client.0.smithi043.stdout:4/770: chown d1/de/df/d1e/d45 4 1 2024-04-25T13:47:12.557 INFO:tasks.workunit.client.0.smithi043.stdout:4/771: fdatasync d1/de/df/db4/d36/d9e/d9d/d3a/f4d 0 2024-04-25T13:47:12.557 INFO:tasks.workunit.client.0.smithi043.stdout:6/830: dwrite d0/d1b/f1d [0,4194304] 0 2024-04-25T13:47:12.561 INFO:tasks.workunit.client.0.smithi043.stdout:4/772: creat d1/de/df/d1e/ff7 x:0 0 0 2024-04-25T13:47:12.564 INFO:tasks.workunit.client.0.smithi043.stdout:6/831: creat d0/d76/de3/d64/dc7/f114 x:0 0 0 2024-04-25T13:47:12.564 INFO:tasks.workunit.client.0.smithi043.stdout:4/773: getdents d1/d6a/dd4 0 2024-04-25T13:47:12.566 INFO:tasks.workunit.client.0.smithi043.stdout:6/832: mknod d0/d3d/dc9/c115 0 2024-04-25T13:47:12.567 INFO:tasks.workunit.client.0.smithi043.stdout:4/774: unlink d1/de/df/d1e/c31 0 2024-04-25T13:47:12.577 INFO:tasks.workunit.client.0.smithi043.stdout:4/775: dwrite d1/de/df/db4/d36/f6c [0,4194304] 0 2024-04-25T13:47:12.581 INFO:tasks.workunit.client.0.smithi043.stdout:6/833: dwrite d0/d3d/f49 [0,4194304] 0 2024-04-25T13:47:12.582 INFO:tasks.workunit.client.0.smithi043.stdout:4/776: mknod d1/de/df/db4/d36/d9e/d9d/dd0/cf8 0 2024-04-25T13:47:12.585 INFO:tasks.workunit.client.0.smithi043.stdout:4/777: symlink d1/de/d1d/lf9 0 2024-04-25T13:47:12.589 INFO:tasks.workunit.client.0.smithi043.stdout:4/778: truncate d1/de/fc4 790665 0 2024-04-25T13:47:12.591 INFO:tasks.workunit.client.0.smithi043.stdout:6/834: dwrite d0/fc [0,4194304] 0 2024-04-25T13:47:12.603 INFO:tasks.workunit.client.0.smithi043.stdout:6/835: truncate d0/d76/de3/da7/fd0 3714 0 2024-04-25T13:47:12.606 INFO:tasks.workunit.client.0.smithi043.stdout:6/836: symlink d0/d3d/d109/l116 0 2024-04-25T13:47:12.609 INFO:tasks.workunit.client.0.smithi043.stdout:6/837: symlink d0/d76/de3/d64/da1/l117 0 2024-04-25T13:47:12.612 INFO:tasks.workunit.client.0.smithi043.stdout:6/838: fdatasync d0/d76/de3/d64/f6d 0 2024-04-25T13:47:12.614 INFO:tasks.workunit.client.0.smithi043.stdout:6/839: creat d0/d1b/d88/f118 x:0 0 0 2024-04-25T13:47:12.614 INFO:tasks.workunit.client.0.smithi043.stdout:6/840: stat d0/l35 0 2024-04-25T13:47:12.619 INFO:tasks.workunit.client.0.smithi043.stdout:6/841: link d0/c11 d0/d90/d48/d60/c119 0 2024-04-25T13:47:12.620 INFO:tasks.workunit.client.0.smithi043.stdout:6/842: stat d0/d3d/d109/fa5 0 2024-04-25T13:47:12.732 INFO:tasks.workunit.client.0.smithi043.stdout:1/782: sync 2024-04-25T13:47:12.737 INFO:tasks.workunit.client.0.smithi043.stdout:1/783: dwrite df/d31/d38/f61 [0,4194304] 0 2024-04-25T13:47:12.737 INFO:tasks.workunit.client.0.smithi043.stdout:1/784: stat df/d31/dc7/dc8 0 2024-04-25T13:47:12.738 INFO:tasks.workunit.client.0.smithi043.stdout:1/785: chown df/d31/d38/dbb/cda 41 1 2024-04-25T13:47:12.740 INFO:tasks.workunit.client.0.smithi043.stdout:1/786: write df/d31/d38/d43/d81/f10a [288929,9175] 0 2024-04-25T13:47:12.767 INFO:tasks.workunit.client.0.smithi043.stdout:0/839: sync 2024-04-25T13:47:12.767 INFO:tasks.workunit.client.0.smithi043.stdout:6/843: sync 2024-04-25T13:47:12.767 INFO:tasks.workunit.client.0.smithi043.stdout:8/870: sync 2024-04-25T13:47:12.770 INFO:tasks.workunit.client.0.smithi043.stdout:6/844: creat d0/d76/de3/d64/dc7/f11a x:0 0 0 2024-04-25T13:47:12.781 INFO:tasks.workunit.client.0.smithi043.stdout:0/840: creat db/d1b/d94/da1/de2/f11b x:0 0 0 2024-04-25T13:47:12.785 INFO:tasks.workunit.client.0.smithi043.stdout:8/871: write db/dc/d21/f4c [9253109,112976] 0 2024-04-25T13:47:12.793 INFO:tasks.workunit.client.0.smithi043.stdout:0/841: creat db/f11c x:0 0 0 2024-04-25T13:47:12.794 INFO:tasks.workunit.client.0.smithi043.stdout:8/872: write db/d46/da8/fbf [3590506,25335] 0 2024-04-25T13:47:12.818 INFO:tasks.workunit.client.0.smithi043.stdout:0/842: symlink db/d1b/d36/d41/l11d 0 2024-04-25T13:47:12.820 INFO:tasks.workunit.client.0.smithi043.stdout:8/873: dread db/d38/d77/f105 [0,4194304] 0 2024-04-25T13:47:12.821 INFO:tasks.workunit.client.0.smithi043.stdout:0/843: unlink db/d1b/d23/d27/f10a 0 2024-04-25T13:47:12.827 INFO:tasks.workunit.client.0.smithi043.stdout:8/874: read - db/d38/de4/d8c/ff5 zero size 2024-04-25T13:47:12.828 INFO:tasks.workunit.client.0.smithi043.stdout:8/875: write db/d38/f7f [2288563,95030] 0 2024-04-25T13:47:12.828 INFO:tasks.workunit.client.0.smithi043.stdout:0/844: fsync db/fc 0 2024-04-25T13:47:12.830 INFO:tasks.workunit.client.0.smithi043.stdout:8/876: write db/d38/d77/df7/f10c [365945,107195] 0 2024-04-25T13:47:12.833 INFO:tasks.workunit.client.0.smithi043.stdout:0/845: mknod db/d1b/d94/d68/dc0/c11e 0 2024-04-25T13:47:12.845 INFO:tasks.workunit.client.0.smithi043.stdout:0/846: dwrite db/d1b/d23/d27/fa0 [0,4194304] 0 2024-04-25T13:47:12.847 INFO:tasks.workunit.client.0.smithi043.stdout:3/762: rename d0/d13/d2e/db1/fd1 to d0/d9/d6e/d34/f10f 0 2024-04-25T13:47:12.849 INFO:tasks.workunit.client.0.smithi043.stdout:0/847: symlink db/d1b/d23/d27/dcb/l11f 0 2024-04-25T13:47:12.851 INFO:tasks.workunit.client.0.smithi043.stdout:0/848: dread db/d1b/d94/d68/f9c [0,4194304] 0 2024-04-25T13:47:12.852 INFO:tasks.workunit.client.0.smithi043.stdout:3/763: write d0/d9/f45 [312509,54551] 0 2024-04-25T13:47:12.853 INFO:tasks.workunit.client.0.smithi043.stdout:7/938: rename d5/d11/db4/cbe to d5/d103/c135 0 2024-04-25T13:47:12.856 INFO:tasks.workunit.client.0.smithi043.stdout:1/787: read - df/d14/d63/d67/da7/fe1 zero size 2024-04-25T13:47:12.859 INFO:tasks.workunit.client.0.smithi043.stdout:3/764: fsync d0/d13/d55/dd9/df5/d8e/d92/fb0 0 2024-04-25T13:47:12.860 INFO:tasks.workunit.client.0.smithi043.stdout:5/710: rename d1/d3/d24/d7c/c7d to d1/d4/d42/dcb/ce9 0 2024-04-25T13:47:12.867 INFO:tasks.workunit.client.0.smithi043.stdout:3/765: getdents d0/d13/d55/dd9/df5 0 2024-04-25T13:47:12.868 INFO:tasks.workunit.client.0.smithi043.stdout:3/766: write d0/d13/ffb [212003,128790] 0 2024-04-25T13:47:12.869 INFO:tasks.workunit.client.0.smithi043.stdout:5/711: write d1/d3/d7/d9/d2d/d5b/fb1 [657247,7902] 0 2024-04-25T13:47:12.872 INFO:tasks.workunit.client.0.smithi043.stdout:5/712: symlink d1/d3/d24/d7c/lea 0 2024-04-25T13:47:12.874 INFO:tasks.workunit.client.0.smithi043.stdout:5/713: chown d1/d3/d7/d8/da/d11/c1c 3670 1 2024-04-25T13:47:12.876 INFO:tasks.workunit.client.0.smithi043.stdout:5/714: dread - d1/d3/d7/d8/da/d11/fd0 zero size 2024-04-25T13:47:12.882 INFO:tasks.workunit.client.0.smithi043.stdout:5/715: write d1/d3/d7/d8/f44 [47324,31136] 0 2024-04-25T13:47:12.883 INFO:tasks.workunit.client.0.smithi043.stdout:5/716: write d1/d4/d92/d95/fbc [1000677,108913] 0 2024-04-25T13:47:12.891 INFO:tasks.workunit.client.0.smithi043.stdout:3/767: dread - d0/da/db9/d9e/fed zero size 2024-04-25T13:47:12.893 INFO:tasks.workunit.client.0.smithi043.stdout:5/717: mkdir d1/d4/deb 0 2024-04-25T13:47:12.894 INFO:tasks.workunit.client.0.smithi043.stdout:5/718: chown d1/d3/d7/d8/da/d11/fba 578615041 1 2024-04-25T13:47:12.894 INFO:tasks.workunit.client.0.smithi043.stdout:5/719: chown d1/d8d 6 1 2024-04-25T13:47:12.898 INFO:tasks.workunit.client.0.smithi043.stdout:5/720: dread d1/d4/d42/f97 [0,4194304] 0 2024-04-25T13:47:12.899 INFO:tasks.workunit.client.0.smithi043.stdout:9/309: getdents d0/d1d/dc/d26/d39/d46/d62 0 2024-04-25T13:47:12.899 INFO:tasks.workunit.client.0.smithi043.stdout:6/845: symlink d0/d76/de3/da7/l11b 0 2024-04-25T13:47:12.901 INFO:tasks.workunit.client.0.smithi043.stdout:5/721: dread - d1/d3/d7/d2f/d80/fc4 zero size 2024-04-25T13:47:12.904 INFO:tasks.workunit.client.0.smithi043.stdout:5/722: read d1/d3/d7/d8/df/d98/fae [57809,26667] 0 2024-04-25T13:47:12.906 INFO:tasks.workunit.client.0.smithi043.stdout:9/310: dread - d0/d1d/dc/d26/d47/d4d/f58 zero size 2024-04-25T13:47:12.907 INFO:tasks.workunit.client.0.smithi043.stdout:6/846: dwrite d0/d76/de3/d64/ffe [0,4194304] 0 2024-04-25T13:47:12.909 INFO:tasks.workunit.client.0.smithi043.stdout:5/723: mknod d1/d3/d7/d9/d2d/d5b/de2/cec 0 2024-04-25T13:47:12.910 INFO:tasks.workunit.client.0.smithi043.stdout:9/311: symlink d0/d77/l7a 0 2024-04-25T13:47:12.915 INFO:tasks.workunit.client.0.smithi043.stdout:5/724: unlink d1/d3/d7/d8/df/d98/cc0 0 2024-04-25T13:47:12.915 INFO:tasks.workunit.client.0.smithi043.stdout:2/691: rename d0/d34/d3f/d46 to d0/d34/d3f/d7b/dd4 0 2024-04-25T13:47:12.918 INFO:tasks.workunit.client.0.smithi043.stdout:6/847: truncate d0/d3d/d109/d3a/f98 189520 0 2024-04-25T13:47:12.918 INFO:tasks.workunit.client.0.smithi043.stdout:2/692: readlink d0/d5/l9 0 2024-04-25T13:47:12.919 INFO:tasks.workunit.client.0.smithi043.stdout:9/312: dwrite d0/d1d/dc/d26/d47/d4d/f58 [0,4194304] 0 2024-04-25T13:47:12.919 INFO:tasks.workunit.client.0.smithi043.stdout:6/848: dread - d0/d76/de3/d64/ffd zero size 2024-04-25T13:47:12.920 INFO:tasks.workunit.client.0.smithi043.stdout:4/779: rename d1/de/df/d1e/d45/l98 to d1/de/d1d/lfa 0 2024-04-25T13:47:12.921 INFO:tasks.workunit.client.0.smithi043.stdout:2/693: symlink d0/d5/d2f/ld5 0 2024-04-25T13:47:12.924 INFO:tasks.workunit.client.0.smithi043.stdout:4/780: mkdir d1/de/d1d/dfb 0 2024-04-25T13:47:12.927 INFO:tasks.workunit.client.0.smithi043.stdout:4/781: mknod d1/d3/d54/d62/d77/d79/cfc 0 2024-04-25T13:47:12.933 INFO:tasks.workunit.client.0.smithi043.stdout:2/694: dwrite d0/d34/d17/d5e/d86/fac [0,4194304] 0 2024-04-25T13:47:12.939 INFO:tasks.workunit.client.0.smithi043.stdout:4/782: dread d1/de/df/d1a/f3c [0,4194304] 0 2024-04-25T13:47:12.940 INFO:tasks.workunit.client.0.smithi043.stdout:9/313: dwrite d0/d1d/d22/f63 [0,4194304] 0 2024-04-25T13:47:12.940 INFO:tasks.workunit.client.0.smithi043.stdout:2/695: truncate d0/d8/ff 823127 0 2024-04-25T13:47:12.943 INFO:tasks.workunit.client.0.smithi043.stdout:4/783: symlink d1/d34/d83/lfd 0 2024-04-25T13:47:12.944 INFO:tasks.workunit.client.0.smithi043.stdout:2/696: fdatasync d0/d5/d1e/f9d 0 2024-04-25T13:47:12.945 INFO:tasks.workunit.client.0.smithi043.stdout:4/784: readlink d1/de/df/db4/d36/d53/d66/lb0 0 2024-04-25T13:47:12.946 INFO:tasks.workunit.client.0.smithi043.stdout:4/785: stat d1/de/df/d1e/fec 0 2024-04-25T13:47:12.949 INFO:tasks.workunit.client.0.smithi043.stdout:8/877: rename db/d38/d77/fb9 to db/d38/de4/f119 0 2024-04-25T13:47:12.950 INFO:tasks.workunit.client.0.smithi043.stdout:6/849: dread d0/d76/de3/d64/da1/da3/faa [0,4194304] 0 2024-04-25T13:47:12.950 INFO:tasks.workunit.client.0.smithi043.stdout:9/314: mknod d0/d1d/dc/d26/c7b 0 2024-04-25T13:47:12.954 INFO:tasks.workunit.client.0.smithi043.stdout:5/725: dread d1/d3/d24/d7c/f86 [0,4194304] 0 2024-04-25T13:47:12.955 INFO:tasks.workunit.client.0.smithi043.stdout:8/878: symlink db/d38/d40/l11a 0 2024-04-25T13:47:12.957 INFO:tasks.workunit.client.0.smithi043.stdout:0/849: rename db/d1b/d23/d27/dcb/fce to db/f120 0 2024-04-25T13:47:12.959 INFO:tasks.workunit.client.0.smithi043.stdout:4/786: dwrite d1/d3/d54/d62/d77/fbf [0,4194304] 0 2024-04-25T13:47:12.959 INFO:tasks.workunit.client.0.smithi043.stdout:7/939: rename d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf to d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/d136 22 2024-04-25T13:47:12.963 INFO:tasks.workunit.client.0.smithi043.stdout:5/726: symlink d1/d4/led 0 2024-04-25T13:47:12.970 INFO:tasks.workunit.client.0.smithi043.stdout:0/850: creat db/d1b/d23/d27/d39/d4c/d74/f121 x:0 0 0 2024-04-25T13:47:12.970 INFO:tasks.workunit.client.0.smithi043.stdout:5/727: truncate d1/d4/f68 1155502 0 2024-04-25T13:47:12.971 INFO:tasks.workunit.client.0.smithi043.stdout:2/697: link d0/d34/d3f/f93 d0/d5/d2f/fd6 0 2024-04-25T13:47:12.974 INFO:tasks.workunit.client.0.smithi043.stdout:1/788: rename df/d31/d38/l103 to df/l119 0 2024-04-25T13:47:12.976 INFO:tasks.workunit.client.0.smithi043.stdout:6/850: dwrite d0/d76/de3/d64/f108 [0,4194304] 0 2024-04-25T13:47:12.977 INFO:tasks.workunit.client.0.smithi043.stdout:9/315: symlink d0/d1d/dc/d26/d39/l7c 0 2024-04-25T13:47:12.977 INFO:tasks.workunit.client.0.smithi043.stdout:5/728: dread - d1/d3/d7/d8/da/d11/fd0 zero size 2024-04-25T13:47:12.978 INFO:tasks.workunit.client.0.smithi043.stdout:2/698: mkdir d0/d26/dd7 0 2024-04-25T13:47:12.979 INFO:tasks.workunit.client.0.smithi043.stdout:0/851: rmdir db/d1b/d94/d68 39 2024-04-25T13:47:12.981 INFO:tasks.workunit.client.0.smithi043.stdout:7/940: dwrite d5/d11/d3b/d61/dc5/dcc/f102 [0,4194304] 0 2024-04-25T13:47:12.988 INFO:tasks.workunit.client.0.smithi043.stdout:6/851: dwrite d0/d90/d4c/fff [0,4194304] 0 2024-04-25T13:47:12.990 INFO:tasks.workunit.client.0.smithi043.stdout:8/879: link db/d11/c5a db/dc/d21/d4e/d62/c11b 0 2024-04-25T13:47:12.991 INFO:tasks.workunit.client.0.smithi043.stdout:9/316: mknod d0/d1d/dc/d26/c7d 0 2024-04-25T13:47:12.997 INFO:tasks.workunit.client.0.smithi043.stdout:6/852: truncate d0/d3d/f6c 560800 0 2024-04-25T13:47:12.998 INFO:tasks.workunit.client.0.smithi043.stdout:4/787: dread d1/d3/d54/d62/dba/fdb [0,4194304] 0 2024-04-25T13:47:12.998 INFO:tasks.workunit.client.0.smithi043.stdout:6/853: write d0/d3d/fe6 [526434,84840] 0 2024-04-25T13:47:12.999 INFO:tasks.workunit.client.0.smithi043.stdout:2/699: link d0/d34/d3f/d7b/dd4/d55/f80 d0/d34/d17/d5e/fd8 0 2024-04-25T13:47:13.001 INFO:tasks.workunit.client.0.smithi043.stdout:7/941: getdents d5/d11/d84 0 2024-04-25T13:47:13.001 INFO:tasks.workunit.client.0.smithi043.stdout:3/768: sync 2024-04-25T13:47:13.004 INFO:tasks.workunit.client.0.smithi043.stdout:2/700: write d0/d34/d17/f60 [3970783,110423] 0 2024-04-25T13:47:13.006 INFO:tasks.workunit.client.0.smithi043.stdout:5/729: dread d1/d3/d7/d8/da/f88 [0,4194304] 0 2024-04-25T13:47:13.006 INFO:tasks.workunit.client.0.smithi043.stdout:8/880: fdatasync db/d38/de4/f119 0 2024-04-25T13:47:13.007 INFO:tasks.workunit.client.0.smithi043.stdout:3/769: readlink d0/d13/l103 0 2024-04-25T13:47:13.007 INFO:tasks.workunit.client.0.smithi043.stdout:4/788: rmdir d1/de/df/db4/d36/d53 39 2024-04-25T13:47:13.008 INFO:tasks.workunit.client.0.smithi043.stdout:7/942: mkdir d5/d11/d3b/d8b/d9b/d137 0 2024-04-25T13:47:13.010 INFO:tasks.workunit.client.0.smithi043.stdout:1/789: creat df/d14/d3d/f11a x:0 0 0 2024-04-25T13:47:13.011 INFO:tasks.workunit.client.0.smithi043.stdout:5/730: unlink d1/d4/f68 0 2024-04-25T13:47:13.012 INFO:tasks.workunit.client.0.smithi043.stdout:2/701: mknod d0/d34/d17/d5e/d71/cd9 0 2024-04-25T13:47:13.013 INFO:tasks.workunit.client.0.smithi043.stdout:4/789: write d1/d3/d54/d62/d77/d79/fca [508884,94359] 0 2024-04-25T13:47:13.015 INFO:tasks.workunit.client.0.smithi043.stdout:1/790: mkdir df/d14/d3d/d114/d11b 0 2024-04-25T13:47:13.016 INFO:tasks.workunit.client.0.smithi043.stdout:2/702: chown d0/d34/d17/d5e/da9/dc3 109343 1 2024-04-25T13:47:13.017 INFO:tasks.workunit.client.0.smithi043.stdout:0/852: link db/d1b/d94/d10d/lad db/d1b/d94/l122 0 2024-04-25T13:47:13.020 INFO:tasks.workunit.client.0.smithi043.stdout:5/731: mknod d1/d3/d7/d2f/d67/cee 0 2024-04-25T13:47:13.020 INFO:tasks.workunit.client.0.smithi043.stdout:1/791: symlink df/d14/d3d/d114/l11c 0 2024-04-25T13:47:13.023 INFO:tasks.workunit.client.0.smithi043.stdout:4/790: chown d1/de/df/d1e/d45/da1/db3/lb8 6 1 2024-04-25T13:47:13.023 INFO:tasks.workunit.client.0.smithi043.stdout:7/943: dread d5/d11/d3b/d8b/d9b/df6/f12a [0,4194304] 0 2024-04-25T13:47:13.024 INFO:tasks.workunit.client.0.smithi043.stdout:2/703: mkdir d0/d34/d17/dc6/d5c/d8c/dda 0 2024-04-25T13:47:13.026 INFO:tasks.workunit.client.0.smithi043.stdout:1/792: chown df/d14/d63/fa5 0 1 2024-04-25T13:47:13.027 INFO:tasks.workunit.client.0.smithi043.stdout:3/770: dwrite d0/d9/d6e/d34/d36/fd3 [4194304,4194304] 0 2024-04-25T13:47:13.027 INFO:tasks.workunit.client.0.smithi043.stdout:5/732: creat d1/d3/d7/d2f/d80/fef x:0 0 0 2024-04-25T13:47:13.028 INFO:tasks.workunit.client.0.smithi043.stdout:9/317: write d0/d1d/dc/d26/d47/f65 [84791,85658] 0 2024-04-25T13:47:13.031 INFO:tasks.workunit.client.0.smithi043.stdout:2/704: dread d0/fa1 [0,4194304] 0 2024-04-25T13:47:13.031 INFO:tasks.workunit.client.0.smithi043.stdout:0/853: creat db/d1b/d23/d27/d39/f123 x:0 0 0 2024-04-25T13:47:13.032 INFO:tasks.workunit.client.0.smithi043.stdout:1/793: symlink df/d31/dc7/dc8/l11d 0 2024-04-25T13:47:13.033 INFO:tasks.workunit.client.0.smithi043.stdout:7/944: mknod d5/c138 0 2024-04-25T13:47:13.036 INFO:tasks.workunit.client.0.smithi043.stdout:2/705: read d0/d5/d1e/d32/f96 [188554,109985] 0 2024-04-25T13:47:13.036 INFO:tasks.workunit.client.0.smithi043.stdout:9/318: read d0/d1d/fa [1100596,5263] 0 2024-04-25T13:47:13.038 INFO:tasks.workunit.client.0.smithi043.stdout:4/791: truncate d1/fb7 4153871 0 2024-04-25T13:47:13.039 INFO:tasks.workunit.client.0.smithi043.stdout:1/794: truncate df/d31/d34/fba 872620 0 2024-04-25T13:47:13.041 INFO:tasks.workunit.client.0.smithi043.stdout:9/319: symlink d0/d1d/d22/l7e 0 2024-04-25T13:47:13.042 INFO:tasks.workunit.client.0.smithi043.stdout:9/320: chown d0/d1d/f25 1467423 1 2024-04-25T13:47:13.044 INFO:tasks.workunit.client.0.smithi043.stdout:1/795: mknod df/d31/d38/d43/dbc/c11e 0 2024-04-25T13:47:13.044 INFO:tasks.workunit.client.0.smithi043.stdout:4/792: mknod d1/d6a/dd4/cfe 0 2024-04-25T13:47:13.044 INFO:tasks.workunit.client.0.smithi043.stdout:7/945: link d5/d6b/l9f d5/d11/d3b/d61/dc5/dcc/l139 0 2024-04-25T13:47:13.045 INFO:tasks.workunit.client.0.smithi043.stdout:6/854: rename d0/d76/de3/d64/da1/da3/faa to d0/d1b/d96/f11c 0 2024-04-25T13:47:13.046 INFO:tasks.workunit.client.0.smithi043.stdout:9/321: symlink d0/d1d/d7/d3a/l7f 0 2024-04-25T13:47:13.049 INFO:tasks.workunit.client.0.smithi043.stdout:4/793: write d1/d3/d54/d62/d77/fbf [93686,114460] 0 2024-04-25T13:47:13.050 INFO:tasks.workunit.client.0.smithi043.stdout:4/794: chown d1/f14 215152741 1 2024-04-25T13:47:13.050 INFO:tasks.workunit.client.0.smithi043.stdout:3/771: write d0/d9/fee [584929,95827] 0 2024-04-25T13:47:13.050 INFO:tasks.workunit.client.0.smithi043.stdout:1/796: creat df/d31/d38/d43/d81/f11f x:0 0 0 2024-04-25T13:47:13.051 INFO:tasks.workunit.client.0.smithi043.stdout:5/733: dread d1/d3/d7/d9/d2d/f6c [0,4194304] 0 2024-04-25T13:47:13.053 INFO:tasks.workunit.client.0.smithi043.stdout:8/881: rename db/d11/d79/dbc to db/d46/da8/d10e/d11c 0 2024-04-25T13:47:13.058 INFO:tasks.workunit.client.0.smithi043.stdout:9/322: read d0/d1d/d4a/f6a [4307202,48633] 0 2024-04-25T13:47:13.058 INFO:tasks.workunit.client.0.smithi043.stdout:6/855: fsync d0/d76/de3/d64/f9b 0 2024-04-25T13:47:13.058 INFO:tasks.workunit.client.0.smithi043.stdout:5/734: chown d1/d8d/la4 351448 1 2024-04-25T13:47:13.058 INFO:tasks.workunit.client.0.smithi043.stdout:3/772: truncate d0/da/db9/df9/f104 36512 0 2024-04-25T13:47:13.059 INFO:tasks.workunit.client.0.smithi043.stdout:2/706: rename d0/d34/d17/dc6/d5c/d8c to d0/d8/d9b/ddb 0 2024-04-25T13:47:13.059 INFO:tasks.workunit.client.0.smithi043.stdout:9/323: stat d0/d1d/d4a/f6a 0 2024-04-25T13:47:13.061 INFO:tasks.workunit.client.0.smithi043.stdout:1/797: link df/d31/d34/d91/fab df/d31/d38/d43/d6e/df9/f120 0 2024-04-25T13:47:13.063 INFO:tasks.workunit.client.0.smithi043.stdout:7/946: rename d5/d103/l12c to d5/d11/d3b/d61/dd4/l13a 0 2024-04-25T13:47:13.064 INFO:tasks.workunit.client.0.smithi043.stdout:2/707: creat d0/d34/d17/fdc x:0 0 0 2024-04-25T13:47:13.064 INFO:tasks.workunit.client.0.smithi043.stdout:6/856: rmdir d0/d3d/d109/d3a 39 2024-04-25T13:47:13.065 INFO:tasks.workunit.client.0.smithi043.stdout:1/798: mkdir df/d14/d3d/d82/d8c/d121 0 2024-04-25T13:47:13.066 INFO:tasks.workunit.client.0.smithi043.stdout:6/857: write d0/d1c/fb1 [5744684,97230] 0 2024-04-25T13:47:13.067 INFO:tasks.workunit.client.0.smithi043.stdout:7/947: write d5/d11/d3b/d61/dc5/dcc/f11f [109888,24000] 0 2024-04-25T13:47:13.070 INFO:tasks.workunit.client.0.smithi043.stdout:1/799: mknod df/d10/d22/d2f/d9c/c122 0 2024-04-25T13:47:13.073 INFO:tasks.workunit.client.0.smithi043.stdout:1/800: fsync df/d31/dc7/dc8/fed 0 2024-04-25T13:47:13.074 INFO:tasks.workunit.client.0.smithi043.stdout:7/948: chown d5/d11/d3b/d61/d68/dc0/l78 65308 1 2024-04-25T13:47:13.074 INFO:tasks.workunit.client.0.smithi043.stdout:6/858: dread d0/d76/de3/d64/ffe [0,4194304] 0 2024-04-25T13:47:13.076 INFO:tasks.workunit.client.0.smithi043.stdout:8/882: write db/fd [933692,76824] 0 2024-04-25T13:47:13.079 INFO:tasks.workunit.client.0.smithi043.stdout:1/801: chown df/d31/d34/d91/fab 13035879 1 2024-04-25T13:47:13.081 INFO:tasks.workunit.client.0.smithi043.stdout:3/773: mknod d0/d9/d6e/d34/d36/d105/c110 0 2024-04-25T13:47:13.083 INFO:tasks.workunit.client.0.smithi043.stdout:2/708: mknod d0/d34/d17/da0/dd2/cdd 0 2024-04-25T13:47:13.083 INFO:tasks.workunit.client.0.smithi043.stdout:8/883: write db/dc/d21/d4e/d62/fe6 [24958,4726] 0 2024-04-25T13:47:13.088 INFO:tasks.workunit.client.0.smithi043.stdout:7/949: dwrite d5/d11/d3b/d61/dc5/dee/d116/fd7 [0,4194304] 0 2024-04-25T13:47:13.089 INFO:tasks.workunit.client.0.smithi043.stdout:9/324: dwrite d0/d1d/f28 [0,4194304] 0 2024-04-25T13:47:13.089 INFO:tasks.workunit.client.0.smithi043.stdout:1/802: truncate df/d14/d63/d67/da7/fd4 733705 0 2024-04-25T13:47:13.090 INFO:tasks.workunit.client.0.smithi043.stdout:8/884: write db/d38/de4/d59/d7c/fc8 [1058568,109227] 0 2024-04-25T13:47:13.092 INFO:tasks.workunit.client.0.smithi043.stdout:5/735: truncate d1/d3/d62/f9c 501746 0 2024-04-25T13:47:13.094 INFO:tasks.workunit.client.0.smithi043.stdout:2/709: truncate d0/d5/d2f/f7f 3122236 0 2024-04-25T13:47:13.095 INFO:tasks.workunit.client.0.smithi043.stdout:8/885: chown db/dc/d21/d4e/d62/leb 57442 1 2024-04-25T13:47:13.096 INFO:tasks.workunit.client.0.smithi043.stdout:9/325: rmdir d0/d1d/dc/d26/d47/d52 39 2024-04-25T13:47:13.096 INFO:tasks.workunit.client.0.smithi043.stdout:1/803: write df/fd3 [951161,86364] 0 2024-04-25T13:47:13.099 INFO:tasks.workunit.client.0.smithi043.stdout:9/326: chown d0/d1d/f29 113146 1 2024-04-25T13:47:13.101 INFO:tasks.workunit.client.0.smithi043.stdout:7/950: creat d5/d11/d3b/d61/dc5/dee/d116/d11e/f13b x:0 0 0 2024-04-25T13:47:13.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:12 smithi161 ceph-mon[32696]: pgmap v81: 129 pgs: 129 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 MiB/s rd, 242 MiB/s wr, 513 op/s 2024-04-25T13:47:13.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:12 smithi161 ceph-mon[32696]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:47:13.102 INFO:tasks.workunit.client.0.smithi043.stdout:5/736: mknod d1/d3/d7/d8/da/cf0 0 2024-04-25T13:47:13.103 INFO:tasks.workunit.client.0.smithi043.stdout:9/327: rmdir d0/d1d/d7/d3a 39 2024-04-25T13:47:13.106 INFO:tasks.workunit.client.0.smithi043.stdout:1/804: truncate df/d14/d63/d67/fc6 40774 0 2024-04-25T13:47:13.108 INFO:tasks.workunit.client.0.smithi043.stdout:2/710: mknod d0/d34/d77/dc9/cde 0 2024-04-25T13:47:13.109 INFO:tasks.workunit.client.0.smithi043.stdout:5/737: symlink d1/d3/d7/d8/da/d11/lf1 0 2024-04-25T13:47:13.109 INFO:tasks.workunit.client.0.smithi043.stdout:1/805: truncate df/d14/d3d/f55 4613420 0 2024-04-25T13:47:13.111 INFO:tasks.workunit.client.0.smithi043.stdout:2/711: symlink d0/d34/d3f/d7b/dd4/d55/ldf 0 2024-04-25T13:47:13.113 INFO:tasks.workunit.client.0.smithi043.stdout:2/712: chown d0/d34/d3f/d7b/dd4/d55/fb2 6541293 1 2024-04-25T13:47:13.114 INFO:tasks.workunit.client.0.smithi043.stdout:1/806: creat df/d31/dc7/f123 x:0 0 0 2024-04-25T13:47:13.115 INFO:tasks.workunit.client.0.smithi043.stdout:2/713: chown d0/d34/d17/dc6/d5c/cb9 12220964 1 2024-04-25T13:47:13.122 INFO:tasks.workunit.client.0.smithi043.stdout:9/328: creat d0/d1d/dc/d26/d47/d52/f80 x:0 0 0 2024-04-25T13:47:13.124 INFO:tasks.workunit.client.0.smithi043.stdout:5/738: write d1/d3/d62/f9c [591638,100778] 0 2024-04-25T13:47:13.124 INFO:tasks.workunit.client.0.smithi043.stdout:4/795: rename d1/de/df/d1e/dc8/fed to d1/de/df/d1e/d45/da1/db3/d33/fff 0 2024-04-25T13:47:13.127 INFO:tasks.workunit.client.0.smithi043.stdout:4/796: fsync d1/de/df/d1e/d45/da1/db3/fde 0 2024-04-25T13:47:13.128 INFO:tasks.workunit.client.0.smithi043.stdout:9/329: mkdir d0/d1d/d7/d81 0 2024-04-25T13:47:13.129 INFO:tasks.workunit.client.0.smithi043.stdout:1/807: read df/d14/d3d/f55 [1611236,88450] 0 2024-04-25T13:47:13.132 INFO:tasks.workunit.client.0.smithi043.stdout:2/714: rename d0/d34/d17/dc6/f6d to d0/d34/d17/da0/dd2/fe0 0 2024-04-25T13:47:13.133 INFO:tasks.workunit.client.0.smithi043.stdout:9/330: dread - d0/d1d/f25 zero size 2024-04-25T13:47:13.135 INFO:tasks.workunit.client.0.smithi043.stdout:5/739: dread d1/d3/d7/d2f/fc8 [0,4194304] 0 2024-04-25T13:47:13.137 INFO:tasks.workunit.client.0.smithi043.stdout:7/951: dwrite d5/d75/d79/fd1 [0,4194304] 0 2024-04-25T13:47:13.139 INFO:tasks.workunit.client.0.smithi043.stdout:9/331: write d0/d1d/dc/d26/d39/f6e [975406,29393] 0 2024-04-25T13:47:13.140 INFO:tasks.workunit.client.0.smithi043.stdout:4/797: link d1/ff0 d1/d3/f100 0 2024-04-25T13:47:13.141 INFO:tasks.workunit.client.0.smithi043.stdout:1/808: rename df/d31/d34/fba to df/d31/d34/f124 0 2024-04-25T13:47:13.142 INFO:tasks.workunit.client.0.smithi043.stdout:5/740: write d1/d3/d7/d9/d2d/d5b/f74 [4965140,5276] 0 2024-04-25T13:47:13.143 INFO:tasks.workunit.client.0.smithi043.stdout:7/952: symlink d5/d11/d3b/d8b/l13c 0 2024-04-25T13:47:13.145 INFO:tasks.workunit.client.0.smithi043.stdout:5/741: dread d1/d3/d7/d2f/fc8 [0,4194304] 0 2024-04-25T13:47:13.146 INFO:tasks.workunit.client.0.smithi043.stdout:1/809: symlink df/d14/d63/d67/l125 0 2024-04-25T13:47:13.147 INFO:tasks.workunit.client.0.smithi043.stdout:1/810: readlink df/d31/d38/lce 0 2024-04-25T13:47:13.147 INFO:tasks.workunit.client.0.smithi043.stdout:4/798: chown d1/de/df/db4/d36/d9e/l87 1193 1 2024-04-25T13:47:13.149 INFO:tasks.workunit.client.0.smithi043.stdout:9/332: creat d0/f82 x:0 0 0 2024-04-25T13:47:13.151 INFO:tasks.workunit.client.0.smithi043.stdout:1/811: rmdir df/d31/d34/d91 39 2024-04-25T13:47:13.151 INFO:tasks.workunit.client.0.smithi043.stdout:5/742: readlink d1/d3/d24/d7c/lb4 0 2024-04-25T13:47:13.152 INFO:tasks.workunit.client.0.smithi043.stdout:7/953: mkdir d5/d11/d3b/d61/dc5/d13d 0 2024-04-25T13:47:13.158 INFO:tasks.workunit.client.0.smithi043.stdout:2/715: dwrite d0/d34/d17/d5e/f92 [4194304,4194304] 0 2024-04-25T13:47:13.159 INFO:tasks.workunit.client.0.smithi043.stdout:1/812: mkdir df/d14/d63/d67/da7/d126 0 2024-04-25T13:47:13.160 INFO:tasks.workunit.client.0.smithi043.stdout:2/716: chown d0/d34/d17/d5e/d71/d81 202 1 2024-04-25T13:47:13.163 INFO:tasks.workunit.client.0.smithi043.stdout:7/954: rename d5/l86 to d5/d11/d3b/d61/dc5/dee/d116/d11e/l13e 0 2024-04-25T13:47:13.164 INFO:tasks.workunit.client.0.smithi043.stdout:9/333: write d0/f20 [948280,112288] 0 2024-04-25T13:47:13.165 INFO:tasks.workunit.client.0.smithi043.stdout:2/717: truncate d0/d4b/f72 4809692 0 2024-04-25T13:47:13.172 INFO:tasks.workunit.client.0.smithi043.stdout:9/334: dread - d0/d1d/d22/f27 zero size 2024-04-25T13:47:13.172 INFO:tasks.workunit.client.0.smithi043.stdout:4/799: mknod d1/de/df/d1e/dc8/c101 0 2024-04-25T13:47:13.174 INFO:tasks.workunit.client.0.smithi043.stdout:1/813: dwrite df/d31/d38/d43/d81/f10a [0,4194304] 0 2024-04-25T13:47:13.176 INFO:tasks.workunit.client.0.smithi043.stdout:7/955: getdents d5/d11/d3b/d61/dc5/dee/d5a/d8d 0 2024-04-25T13:47:13.177 INFO:tasks.workunit.client.0.smithi043.stdout:5/743: dread d1/f19 [0,4194304] 0 2024-04-25T13:47:13.178 INFO:tasks.workunit.client.0.smithi043.stdout:4/800: dread - d1/de/d1d/d20/fe5 zero size 2024-04-25T13:47:13.178 INFO:tasks.workunit.client.0.smithi043.stdout:9/335: mkdir d0/d1d/d7/d83 0 2024-04-25T13:47:13.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:12 smithi175 ceph-mon[32649]: pgmap v81: 129 pgs: 129 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 MiB/s rd, 242 MiB/s wr, 513 op/s 2024-04-25T13:47:13.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:12 smithi175 ceph-mon[32649]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:47:13.184 INFO:tasks.workunit.client.0.smithi043.stdout:2/718: dwrite d0/d5/d1e/d32/f5a [0,4194304] 0 2024-04-25T13:47:13.185 INFO:tasks.workunit.client.0.smithi043.stdout:9/336: rmdir d0/d1d/dc/d26/d39/d46/d62 39 2024-04-25T13:47:13.186 INFO:tasks.workunit.client.0.smithi043.stdout:7/956: write d5/d11/d3b/d61/d68/fce [563963,11964] 0 2024-04-25T13:47:13.186 INFO:tasks.workunit.client.0.smithi043.stdout:5/744: write d1/f19 [2827298,75308] 0 2024-04-25T13:47:13.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:12 smithi043 ceph-mon[29195]: pgmap v81: 129 pgs: 129 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 MiB/s rd, 242 MiB/s wr, 513 op/s 2024-04-25T13:47:13.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:12 smithi043 ceph-mon[29195]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:47:13.232 INFO:tasks.workunit.client.0.smithi043.stdout:0/854: sync 2024-04-25T13:47:13.251 INFO:tasks.workunit.client.0.smithi043.stdout:9/337: symlink d0/d1d/d4a/l84 0 2024-04-25T13:47:13.251 INFO:tasks.workunit.client.0.smithi043.stdout:2/719: unlink d0/d34/d17/f23 0 2024-04-25T13:47:13.251 INFO:tasks.workunit.client.0.smithi043.stdout:5/745: rmdir d1/d8d 39 2024-04-25T13:47:13.253 INFO:tasks.workunit.client.0.smithi043.stdout:7/957: creat d5/d11/d3b/d61/dd4/f13f x:0 0 0 2024-04-25T13:47:13.253 INFO:tasks.workunit.client.0.smithi043.stdout:9/338: truncate d0/d1d/dc/f60 712989 0 2024-04-25T13:47:13.254 INFO:tasks.workunit.client.0.smithi043.stdout:0/855: truncate db/f17 3901759 0 2024-04-25T13:47:13.255 INFO:tasks.workunit.client.0.smithi043.stdout:7/958: dread - d5/d11/fe9 zero size 2024-04-25T13:47:13.259 INFO:tasks.workunit.client.0.smithi043.stdout:7/959: chown d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/df0/d119/c11b 24 1 2024-04-25T13:47:13.260 INFO:tasks.workunit.client.0.smithi043.stdout:7/960: write d5/d11/d84/fb2 [543928,98738] 0 2024-04-25T13:47:13.263 INFO:tasks.workunit.client.0.smithi043.stdout:7/961: truncate d5/d11/d3b/d61/dd4/f13f 827111 0 2024-04-25T13:47:13.264 INFO:tasks.workunit.client.0.smithi043.stdout:0/856: write db/d1b/f29 [3987953,11716] 0 2024-04-25T13:47:13.266 INFO:tasks.workunit.client.0.smithi043.stdout:1/814: dread df/d31/d34/f4d [0,4194304] 0 2024-04-25T13:47:13.270 INFO:tasks.workunit.client.0.smithi043.stdout:1/815: symlink df/d31/d38/d43/d6e/dea/l127 0 2024-04-25T13:47:13.276 INFO:tasks.workunit.client.0.smithi043.stdout:1/816: chown df/d14/d3d/d82/d8c/f92 2041361385 1 2024-04-25T13:47:13.278 INFO:tasks.workunit.client.0.smithi043.stdout:9/339: rename d0/d1d/dc/d26/d39/c54 to d0/d1d/d4a/c85 0 2024-04-25T13:47:13.279 INFO:tasks.workunit.client.0.smithi043.stdout:1/817: unlink df/d14/d3d/d114/l11c 0 2024-04-25T13:47:13.280 INFO:tasks.workunit.client.0.smithi043.stdout:7/962: dwrite d5/d11/d3b/d61/dc5/dee/d5a/d89/fad [0,4194304] 0 2024-04-25T13:47:13.281 INFO:tasks.workunit.client.0.smithi043.stdout:1/818: dread - df/d10/f118 zero size 2024-04-25T13:47:13.284 INFO:tasks.workunit.client.0.smithi043.stdout:1/819: chown df/d14/d3d/d82/c105 108404 1 2024-04-25T13:47:13.288 INFO:tasks.workunit.client.0.smithi043.stdout:5/746: dread d1/d3/d24/f65 [0,4194304] 0 2024-04-25T13:47:13.290 INFO:tasks.workunit.client.0.smithi043.stdout:9/340: dwrite d0/d1d/f29 [0,4194304] 0 2024-04-25T13:47:13.292 INFO:tasks.workunit.client.0.smithi043.stdout:0/857: dread db/d1b/f26 [0,4194304] 0 2024-04-25T13:47:13.293 INFO:tasks.workunit.client.0.smithi043.stdout:1/820: write df/d10/d22/d2f/f5d [1455340,42015] 0 2024-04-25T13:47:13.294 INFO:tasks.workunit.client.0.smithi043.stdout:0/858: chown db/d1b/d23/d27/d39/d4c/d74/ccd 0 1 2024-04-25T13:47:13.295 INFO:tasks.workunit.client.0.smithi043.stdout:9/341: write d0/d1d/dc/d26/f6c [353810,35723] 0 2024-04-25T13:47:13.299 INFO:tasks.workunit.client.0.smithi043.stdout:1/821: read df/f35 [359259,85540] 0 2024-04-25T13:47:13.299 INFO:tasks.workunit.client.0.smithi043.stdout:9/342: symlink d0/d1d/d7/l86 0 2024-04-25T13:47:13.300 INFO:tasks.workunit.client.0.smithi043.stdout:1/822: write df/d31/d38/d43/dbc/ffd [920049,16472] 0 2024-04-25T13:47:13.301 INFO:tasks.workunit.client.0.smithi043.stdout:9/343: fdatasync d0/f21 0 2024-04-25T13:47:13.301 INFO:tasks.workunit.client.0.smithi043.stdout:7/963: fdatasync d5/d11/d3b/d61/dc5/dee/d5a/d89/fad 0 2024-04-25T13:47:13.304 INFO:tasks.workunit.client.0.smithi043.stdout:7/964: fdatasync d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/f101 0 2024-04-25T13:47:13.305 INFO:tasks.workunit.client.0.smithi043.stdout:9/344: rmdir d0 39 2024-04-25T13:47:13.305 INFO:tasks.workunit.client.0.smithi043.stdout:1/823: dread - df/d31/d34/d8b/f99 zero size 2024-04-25T13:47:13.308 INFO:tasks.workunit.client.0.smithi043.stdout:7/965: mknod d5/d11/d8f/c140 0 2024-04-25T13:47:13.309 INFO:tasks.workunit.client.0.smithi043.stdout:1/824: truncate df/d31/d34/f6c 1739377 0 2024-04-25T13:47:13.313 INFO:tasks.workunit.client.0.smithi043.stdout:1/825: read - df/d31/d34/d8b/ddd/ffb zero size 2024-04-25T13:47:13.314 INFO:tasks.workunit.client.0.smithi043.stdout:9/345: write d0/d1d/d7/f5a [78684,88450] 0 2024-04-25T13:47:13.318 INFO:tasks.workunit.client.0.smithi043.stdout:8/886: dwrite db/d7d/fb0 [0,4194304] 0 2024-04-25T13:47:13.320 INFO:tasks.workunit.client.0.smithi043.stdout:1/826: link df/d14/c15 df/d31/d34/c128 0 2024-04-25T13:47:13.322 INFO:tasks.workunit.client.0.smithi043.stdout:8/887: creat db/d11/da1/f11d x:0 0 0 2024-04-25T13:47:13.323 INFO:tasks.workunit.client.0.smithi043.stdout:9/346: dwrite d0/f82 [0,4194304] 0 2024-04-25T13:47:13.323 INFO:tasks.workunit.client.0.smithi043.stdout:1/827: chown df/d31/d38/d43/dbc/ffd 0 1 2024-04-25T13:47:13.324 INFO:tasks.workunit.client.0.smithi043.stdout:9/347: fdatasync d0/d1d/f29 0 2024-04-25T13:47:13.325 INFO:tasks.workunit.client.0.smithi043.stdout:1/828: stat df/d31/d34/d8b 0 2024-04-25T13:47:13.327 INFO:tasks.workunit.client.0.smithi043.stdout:1/829: unlink df/d31/d34/f9d 0 2024-04-25T13:47:13.327 INFO:tasks.workunit.client.0.smithi043.stdout:8/888: rmdir db/d11/d79 39 2024-04-25T13:47:13.328 INFO:tasks.workunit.client.0.smithi043.stdout:9/348: symlink d0/d1d/d22/d67/l87 0 2024-04-25T13:47:13.330 INFO:tasks.workunit.client.0.smithi043.stdout:1/830: truncate df/d31/d34/f94 850525 0 2024-04-25T13:47:13.332 INFO:tasks.workunit.client.0.smithi043.stdout:9/349: fdatasync d0/d1d/d7/f10 0 2024-04-25T13:47:13.334 INFO:tasks.workunit.client.0.smithi043.stdout:7/966: dread d5/d11/db4/fca [0,4194304] 0 2024-04-25T13:47:13.336 INFO:tasks.workunit.client.0.smithi043.stdout:8/889: truncate db/dc/f23 5431606 0 2024-04-25T13:47:13.337 INFO:tasks.workunit.client.0.smithi043.stdout:9/350: mknod d0/d1d/d7/d3a/c88 0 2024-04-25T13:47:13.339 INFO:tasks.workunit.client.0.smithi043.stdout:1/831: dwrite df/d31/d34/d8b/fa4 [0,4194304] 0 2024-04-25T13:47:13.343 INFO:tasks.workunit.client.0.smithi043.stdout:1/832: write df/d31/f79 [503339,68070] 0 2024-04-25T13:47:13.345 INFO:tasks.workunit.client.0.smithi043.stdout:5/747: rename d1/d3/d62/f9c to d1/d3/d26/ff2 0 2024-04-25T13:47:13.349 INFO:tasks.workunit.client.0.smithi043.stdout:1/833: read - df/d10/fa6 zero size 2024-04-25T13:47:13.349 INFO:tasks.workunit.client.0.smithi043.stdout:5/748: fdatasync d1/d3/f81 0 2024-04-25T13:47:13.351 INFO:tasks.workunit.client.0.smithi043.stdout:7/967: dwrite d5/d11/d3b/d61/dc5/dee/d5a/d89/fad [0,4194304] 0 2024-04-25T13:47:13.352 INFO:tasks.workunit.client.0.smithi043.stdout:0/859: rename db/ff3 to db/d1b/d23/d27/d39/d4c/dbb/f124 0 2024-04-25T13:47:13.356 INFO:tasks.workunit.client.0.smithi043.stdout:8/890: dwrite db/d38/d3c/d71/d5d/d67/fca [0,4194304] 0 2024-04-25T13:47:13.356 INFO:tasks.workunit.client.0.smithi043.stdout:7/968: chown d5/d11/d3b/d8b/l91 61941 1 2024-04-25T13:47:13.356 INFO:tasks.workunit.client.0.smithi043.stdout:1/834: creat df/d31/d34/d91/f129 x:0 0 0 2024-04-25T13:47:13.357 INFO:tasks.workunit.client.0.smithi043.stdout:9/351: rename d0/d1d/d7/d41/f76 to d0/d1d/d4a/f89 0 2024-04-25T13:47:13.360 INFO:tasks.workunit.client.0.smithi043.stdout:7/969: fsync d5/d75/f66 0 2024-04-25T13:47:13.360 INFO:tasks.workunit.client.0.smithi043.stdout:0/860: chown db/d1b/d23/d27/d39/d4c/dbb/dc8/fe7 5956300 1 2024-04-25T13:47:13.361 INFO:tasks.workunit.client.0.smithi043.stdout:7/970: readlink d5/d11/d3b/d8b/lcb 0 2024-04-25T13:47:13.362 INFO:tasks.workunit.client.0.smithi043.stdout:6/859: sync 2024-04-25T13:47:13.362 INFO:tasks.workunit.client.0.smithi043.stdout:1/835: symlink df/d31/d38/d43/d81/l12a 0 2024-04-25T13:47:13.366 INFO:tasks.workunit.client.0.smithi043.stdout:9/352: symlink d0/d1d/dc/d26/d39/d46/l8a 0 2024-04-25T13:47:13.368 INFO:tasks.workunit.client.0.smithi043.stdout:9/353: read - d0/d1d/dc/d26/d39/f5f zero size 2024-04-25T13:47:13.369 INFO:tasks.workunit.client.0.smithi043.stdout:6/860: creat d0/d90/d48/d9d/f11d x:0 0 0 2024-04-25T13:47:13.378 INFO:tasks.workunit.client.0.smithi043.stdout:6/861: unlink d0/d90/d4c/l5f 0 2024-04-25T13:47:13.379 INFO:tasks.workunit.client.0.smithi043.stdout:8/891: truncate db/dc/d28/d104/d116/ffa 417088 0 2024-04-25T13:47:13.381 INFO:tasks.workunit.client.0.smithi043.stdout:8/892: stat db/dc/d28/d104/d116 0 2024-04-25T13:47:13.384 INFO:tasks.workunit.client.0.smithi043.stdout:8/893: fsync db/d38/d3c/d71/d5d/d67/fca 0 2024-04-25T13:47:13.385 INFO:tasks.workunit.client.0.smithi043.stdout:7/971: dwrite d5/d11/d3b/d61/dc5/dee/d5a/d8d/ff3 [0,4194304] 0 2024-04-25T13:47:13.388 INFO:tasks.workunit.client.0.smithi043.stdout:1/836: dread df/d10/d22/d2f/d9c/f85 [0,4194304] 0 2024-04-25T13:47:13.390 INFO:tasks.workunit.client.0.smithi043.stdout:1/837: creat df/d31/d34/d91/f12b x:0 0 0 2024-04-25T13:47:13.393 INFO:tasks.workunit.client.0.smithi043.stdout:1/838: symlink df/d10/l12c 0 2024-04-25T13:47:13.393 INFO:tasks.workunit.client.0.smithi043.stdout:2/720: sync 2024-04-25T13:47:13.393 INFO:tasks.workunit.client.0.smithi043.stdout:3/774: sync 2024-04-25T13:47:13.393 INFO:tasks.workunit.client.0.smithi043.stdout:4/801: sync 2024-04-25T13:47:13.395 INFO:tasks.workunit.client.0.smithi043.stdout:6/862: readlink d0/l85 0 2024-04-25T13:47:13.395 INFO:tasks.workunit.client.0.smithi043.stdout:3/775: read - d0/d9/d6e/d34/f10f zero size 2024-04-25T13:47:13.397 INFO:tasks.workunit.client.0.smithi043.stdout:4/802: read d1/d3/f3e [188420,57878] 0 2024-04-25T13:47:13.399 INFO:tasks.workunit.client.0.smithi043.stdout:0/861: dread db/d1b/d23/d27/f87 [0,4194304] 0 2024-04-25T13:47:13.403 INFO:tasks.workunit.client.0.smithi043.stdout:3/776: creat d0/d9/d6e/d34/f111 x:0 0 0 2024-04-25T13:47:13.405 INFO:tasks.workunit.client.0.smithi043.stdout:3/777: write d0/d13/d2e/fca [159310,22714] 0 2024-04-25T13:47:13.407 INFO:tasks.workunit.client.0.smithi043.stdout:1/839: dwrite df/d31/d38/d43/d81/fe5 [0,4194304] 0 2024-04-25T13:47:13.409 INFO:tasks.workunit.client.0.smithi043.stdout:1/840: write df/d14/d63/d67/f112 [195997,97076] 0 2024-04-25T13:47:13.412 INFO:tasks.workunit.client.0.smithi043.stdout:3/778: symlink d0/da/dcc/l112 0 2024-04-25T13:47:13.414 INFO:tasks.workunit.client.0.smithi043.stdout:4/803: getdents d1/de/df/db4/d36/d9e/d9d/dd0 0 2024-04-25T13:47:13.415 INFO:tasks.workunit.client.0.smithi043.stdout:1/841: chown f3 1622 1 2024-04-25T13:47:13.416 INFO:tasks.workunit.client.0.smithi043.stdout:4/804: fdatasync d1/d3/d54/d62/d77/d79/fca 0 2024-04-25T13:47:13.418 INFO:tasks.workunit.client.0.smithi043.stdout:3/779: write d0/d61/f70 [1263820,90937] 0 2024-04-25T13:47:13.421 INFO:tasks.workunit.client.0.smithi043.stdout:4/805: mkdir d1/de/d1d/d102 0 2024-04-25T13:47:13.426 INFO:tasks.workunit.client.0.smithi043.stdout:3/780: dwrite d0/d13/d2e/f76 [0,4194304] 0 2024-04-25T13:47:13.428 INFO:tasks.workunit.client.0.smithi043.stdout:7/972: write d5/d11/d84/fe0 [517232,29860] 0 2024-04-25T13:47:13.428 INFO:tasks.workunit.client.0.smithi043.stdout:2/721: dwrite d0/d34/faf [0,4194304] 0 2024-04-25T13:47:13.430 INFO:tasks.workunit.client.0.smithi043.stdout:7/973: fsync d5/d11/d3b/d61/dc5/dee/f121 0 2024-04-25T13:47:13.430 INFO:tasks.workunit.client.0.smithi043.stdout:0/862: truncate db/d1b/d94/f79 338447 0 2024-04-25T13:47:13.432 INFO:tasks.workunit.client.0.smithi043.stdout:4/806: truncate d1/d3/d54/d62/fc9 3159186 0 2024-04-25T13:47:13.436 INFO:tasks.workunit.client.0.smithi043.stdout:3/781: mknod d0/d9/d6e/d38/d3f/dc7/c113 0 2024-04-25T13:47:13.436 INFO:tasks.workunit.client.0.smithi043.stdout:5/749: rename d1/d4/d42/dcb to d1/d3/d62/df3 0 2024-04-25T13:47:13.437 INFO:tasks.workunit.client.0.smithi043.stdout:4/807: creat d1/d6a/dd4/f103 x:0 0 0 2024-04-25T13:47:13.440 INFO:tasks.workunit.client.0.smithi043.stdout:3/782: mknod d0/d13/d2e/db1/c114 0 2024-04-25T13:47:13.441 INFO:tasks.workunit.client.0.smithi043.stdout:2/722: dwrite d0/d5/d1e/d32/f5a [4194304,4194304] 0 2024-04-25T13:47:13.442 INFO:tasks.workunit.client.0.smithi043.stdout:2/723: chown d0/d26 418460 1 2024-04-25T13:47:13.444 INFO:tasks.workunit.client.0.smithi043.stdout:5/750: truncate d1/d3/d7/d8/da/f2c 6899151 0 2024-04-25T13:47:13.445 INFO:tasks.workunit.client.0.smithi043.stdout:2/724: write d0/d26/f31 [5070479,112966] 0 2024-04-25T13:47:13.447 INFO:tasks.workunit.client.0.smithi043.stdout:4/808: fdatasync d1/d3/d54/d62/fc9 0 2024-04-25T13:47:13.450 INFO:tasks.workunit.client.0.smithi043.stdout:5/751: write d1/d3/d24/d7c/f89 [119677,12908] 0 2024-04-25T13:47:13.451 INFO:tasks.workunit.client.0.smithi043.stdout:5/752: chown d1/d3/d24 1452 1 2024-04-25T13:47:13.458 INFO:tasks.workunit.client.0.smithi043.stdout:2/725: write d0/d5/d1e/f52 [2185287,61767] 0 2024-04-25T13:47:13.467 INFO:tasks.workunit.client.0.smithi043.stdout:3/783: dwrite d0/d9/d6e/d34/fa7 [0,4194304] 0 2024-04-25T13:47:13.467 INFO:tasks.workunit.client.0.smithi043.stdout:0/863: dread db/d1b/d23/d27/d39/d4c/f77 [4194304,4194304] 0 2024-04-25T13:47:13.467 INFO:tasks.workunit.client.0.smithi043.stdout:9/354: rename d0/d1d/dc to d0/d8b 0 2024-04-25T13:47:13.469 INFO:tasks.workunit.client.0.smithi043.stdout:4/809: rmdir d1/de/d1d/d102 0 2024-04-25T13:47:13.470 INFO:tasks.workunit.client.0.smithi043.stdout:5/753: creat d1/d3/d7/d8/da/ff4 x:0 0 0 2024-04-25T13:47:13.472 INFO:tasks.workunit.client.0.smithi043.stdout:0/864: unlink db/d1b/c21 0 2024-04-25T13:47:13.474 INFO:tasks.workunit.client.0.smithi043.stdout:3/784: symlink d0/d9/d6e/d34/d36/d57/l115 0 2024-04-25T13:47:13.475 INFO:tasks.workunit.client.0.smithi043.stdout:9/355: truncate d0/d1d/f25 980780 0 2024-04-25T13:47:13.476 INFO:tasks.workunit.client.0.smithi043.stdout:4/810: chown d1/d3/d54/d62/d77/d92/dc5/c8d 139 1 2024-04-25T13:47:13.476 INFO:tasks.workunit.client.0.smithi043.stdout:2/726: creat d0/d34/d17/da0/fe1 x:0 0 0 2024-04-25T13:47:13.479 INFO:tasks.workunit.client.0.smithi043.stdout:4/811: mknod d1/de/df/db4/d36/d9e/d9d/d3a/c104 0 2024-04-25T13:47:13.480 INFO:tasks.workunit.client.0.smithi043.stdout:3/785: creat d0/d9/d6e/d34/d36/d105/f116 x:0 0 0 2024-04-25T13:47:13.482 INFO:tasks.workunit.client.0.smithi043.stdout:4/812: mknod d1/d3/d54/d62/d77/d92/df6/c105 0 2024-04-25T13:47:13.486 INFO:tasks.workunit.client.0.smithi043.stdout:9/356: symlink d0/d8b/l8c 0 2024-04-25T13:47:13.487 INFO:tasks.workunit.client.0.smithi043.stdout:4/813: chown d1/de/df/f18 17 1 2024-04-25T13:47:13.489 INFO:tasks.workunit.client.0.smithi043.stdout:3/786: dread d0/f2 [0,4194304] 0 2024-04-25T13:47:13.489 INFO:tasks.workunit.client.0.smithi043.stdout:5/754: write d1/d3/d7/d8/df/d28/f48 [1153863,126642] 0 2024-04-25T13:47:13.489 INFO:tasks.workunit.client.0.smithi043.stdout:4/814: creat d1/d3/d54/d62/dba/f106 x:0 0 0 2024-04-25T13:47:13.492 INFO:tasks.workunit.client.0.smithi043.stdout:9/357: rmdir d0/d8b 39 2024-04-25T13:47:13.495 INFO:tasks.workunit.client.0.smithi043.stdout:0/865: link db/d1b/d23/d27/fc6 db/d1b/d36/d41/daf/f125 0 2024-04-25T13:47:13.498 INFO:tasks.workunit.client.0.smithi043.stdout:4/815: dread d1/d3/d54/d62/d77/d92/dc5/f91 [0,4194304] 0 2024-04-25T13:47:13.498 INFO:tasks.workunit.client.0.smithi043.stdout:2/727: dwrite d0/d26/f40 [0,4194304] 0 2024-04-25T13:47:13.499 INFO:tasks.workunit.client.0.smithi043.stdout:0/866: read - db/d1b/d23/d27/d39/d4c/dbb/dc8/f118 zero size 2024-04-25T13:47:13.500 INFO:tasks.workunit.client.0.smithi043.stdout:0/867: chown db/d1b/d23/c4d 16356 1 2024-04-25T13:47:13.501 INFO:tasks.workunit.client.0.smithi043.stdout:2/728: write d0/d34/d3f/d7b/fd0 [802757,33095] 0 2024-04-25T13:47:13.503 INFO:tasks.workunit.client.0.smithi043.stdout:5/755: creat d1/d3/d7/d2f/d80/db5/ff5 x:0 0 0 2024-04-25T13:47:13.506 INFO:tasks.workunit.client.0.smithi043.stdout:0/868: creat db/d1b/d23/d27/d39/d4c/dbb/dc8/f126 x:0 0 0 2024-04-25T13:47:13.507 INFO:tasks.workunit.client.0.smithi043.stdout:2/729: creat d0/d5/d2f/d8d/fe2 x:0 0 0 2024-04-25T13:47:13.509 INFO:tasks.workunit.client.0.smithi043.stdout:3/787: dwrite d0/d9/d6e/d34/d36/f4e [0,4194304] 0 2024-04-25T13:47:13.509 INFO:tasks.workunit.client.0.smithi043.stdout:2/730: chown d0/d34/d17/f60 29547657 1 2024-04-25T13:47:13.511 INFO:tasks.workunit.client.0.smithi043.stdout:4/816: creat d1/de/df/d1a/f107 x:0 0 0 2024-04-25T13:47:13.512 INFO:tasks.workunit.client.0.smithi043.stdout:5/756: read d1/d3/d7/d8/da/d11/d52/f59 [1681017,68100] 0 2024-04-25T13:47:13.515 INFO:tasks.workunit.client.0.smithi043.stdout:5/757: chown d1/d3/d7/d8/da/c4d 38100 1 2024-04-25T13:47:13.516 INFO:tasks.workunit.client.0.smithi043.stdout:2/731: creat d0/d34/d3f/d59/fe3 x:0 0 0 2024-04-25T13:47:13.517 INFO:tasks.workunit.client.0.smithi043.stdout:4/817: symlink d1/de/d1d/d20/l108 0 2024-04-25T13:47:13.520 INFO:tasks.workunit.client.0.smithi043.stdout:0/869: fsync db/d25/d2a/d9d/ff0 0 2024-04-25T13:47:13.523 INFO:tasks.workunit.client.0.smithi043.stdout:5/758: mkdir d1/d3/d7/d2f/df6 0 2024-04-25T13:47:13.527 INFO:tasks.workunit.client.0.smithi043.stdout:3/788: dwrite d0/d9/d6e/d34/f10f [0,4194304] 0 2024-04-25T13:47:13.527 INFO:tasks.workunit.client.0.smithi043.stdout:4/818: creat d1/d3/f109 x:0 0 0 2024-04-25T13:47:13.529 INFO:tasks.workunit.client.0.smithi043.stdout:4/819: chown d1/de/df/d1a/f58 2163 1 2024-04-25T13:47:13.530 INFO:tasks.workunit.client.0.smithi043.stdout:0/870: write db/f1d [1119797,44973] 0 2024-04-25T13:47:13.533 INFO:tasks.workunit.client.0.smithi043.stdout:5/759: mkdir d1/d3/d7/d2f/df7 0 2024-04-25T13:47:13.533 INFO:tasks.workunit.client.0.smithi043.stdout:4/820: chown d1/de/df/f41 0 1 2024-04-25T13:47:13.534 INFO:tasks.workunit.client.0.smithi043.stdout:8/894: rename db/d11/da1/d109 to db/d38/d3c/d11e 0 2024-04-25T13:47:13.535 INFO:tasks.workunit.client.0.smithi043.stdout:2/732: truncate d0/d34/d17/dc6/f2b 4310987 0 2024-04-25T13:47:13.536 INFO:tasks.workunit.client.0.smithi043.stdout:4/821: readlink d1/de/d1d/lf9 0 2024-04-25T13:47:13.537 INFO:tasks.workunit.client.0.smithi043.stdout:5/760: mknod d1/d3/d7/de1/cf8 0 2024-04-25T13:47:13.538 INFO:tasks.workunit.client.0.smithi043.stdout:8/895: chown db/dc/d80/fd6 3226228 1 2024-04-25T13:47:13.539 INFO:tasks.workunit.client.0.smithi043.stdout:3/789: dwrite d0/da/db9/fdb [0,4194304] 0 2024-04-25T13:47:13.542 INFO:tasks.workunit.client.0.smithi043.stdout:2/733: truncate d0/d26/fb1 406063 0 2024-04-25T13:47:13.542 INFO:tasks.workunit.client.0.smithi043.stdout:8/896: stat db/d38/de4/d59/d7c 0 2024-04-25T13:47:13.543 INFO:tasks.workunit.client.0.smithi043.stdout:4/822: mkdir d1/de/df/db4/d36/d9e/d9d/d3a/d10a 0 2024-04-25T13:47:13.546 INFO:tasks.workunit.client.0.smithi043.stdout:3/790: write d0/d13/d5a/f68 [810017,78873] 0 2024-04-25T13:47:13.550 INFO:tasks.workunit.client.0.smithi043.stdout:2/734: rmdir d0/d34/d3f/d59 39 2024-04-25T13:47:13.553 INFO:tasks.workunit.client.0.smithi043.stdout:2/735: write d0/d5/d1e/f39 [4599737,41214] 0 2024-04-25T13:47:13.554 INFO:tasks.workunit.client.0.smithi043.stdout:3/791: mknod d0/da/db9/c117 0 2024-04-25T13:47:13.562 INFO:tasks.workunit.client.0.smithi043.stdout:2/736: truncate d0/d34/f1a 2280039 0 2024-04-25T13:47:13.565 INFO:tasks.workunit.client.0.smithi043.stdout:6/863: rename d0/d1c/l1f to d0/d76/de3/d64/l11e 0 2024-04-25T13:47:13.566 INFO:tasks.workunit.client.0.smithi043.stdout:0/871: dread db/d1b/d94/d10d/ff9 [0,4194304] 0 2024-04-25T13:47:13.567 INFO:tasks.workunit.client.0.smithi043.stdout:8/897: dread db/d46/da8/fbf [0,4194304] 0 2024-04-25T13:47:13.568 INFO:tasks.workunit.client.0.smithi043.stdout:6/864: symlink d0/d90/d48/d60/l11f 0 2024-04-25T13:47:13.569 INFO:tasks.workunit.client.0.smithi043.stdout:8/898: write db/d11/f3d [2568175,26869] 0 2024-04-25T13:47:13.569 INFO:tasks.workunit.client.0.smithi043.stdout:2/737: link d0/l6 d0/d5/d2f/le4 0 2024-04-25T13:47:13.569 INFO:tasks.workunit.client.0.smithi043.stdout:1/842: rename df/d10/d22/d2f/d9c/d41/db8/f109 to df/d31/d34/d91/f12d 0 2024-04-25T13:47:13.569 INFO:tasks.workunit.client.0.smithi043.stdout:6/865: fdatasync d0/d90/f7f 0 2024-04-25T13:47:13.570 INFO:tasks.workunit.client.0.smithi043.stdout:3/792: write d0/da/db9/fbd [598243,85671] 0 2024-04-25T13:47:13.576 INFO:tasks.workunit.client.0.smithi043.stdout:8/899: dread db/d46/da8/fbf [0,4194304] 0 2024-04-25T13:47:13.576 INFO:tasks.workunit.client.0.smithi043.stdout:1/843: mknod df/d31/d38/d43/c12e 0 2024-04-25T13:47:13.578 INFO:tasks.workunit.client.0.smithi043.stdout:6/866: write d0/d76/d5c/f7d [607820,62536] 0 2024-04-25T13:47:13.579 INFO:tasks.workunit.client.0.smithi043.stdout:1/844: write df/d31/d38/d43/dbc/f115 [429740,901] 0 2024-04-25T13:47:13.579 INFO:tasks.workunit.client.0.smithi043.stdout:3/793: truncate d0/d61/f70 2497854 0 2024-04-25T13:47:13.581 INFO:tasks.workunit.client.0.smithi043.stdout:7/974: rename d5/caa to d5/d11/d3b/d61/dc5/c141 0 2024-04-25T13:47:13.581 INFO:tasks.workunit.client.0.smithi043.stdout:2/738: write d0/d5/d2f/f79 [1542215,101910] 0 2024-04-25T13:47:13.583 INFO:tasks.workunit.client.0.smithi043.stdout:0/872: rmdir db/d25/d2a/d9d 39 2024-04-25T13:47:13.583 INFO:tasks.workunit.client.0.smithi043.stdout:2/739: chown d0/d35/f5d 51774618 1 2024-04-25T13:47:13.584 INFO:tasks.workunit.client.0.smithi043.stdout:0/873: readlink db/d1b/d23/d27/d39/d4b/l99 0 2024-04-25T13:47:13.584 INFO:tasks.workunit.client.0.smithi043.stdout:2/740: chown d0/d34/d17/d5e/d86/l9a 31708907 1 2024-04-25T13:47:13.586 INFO:tasks.workunit.client.0.smithi043.stdout:7/975: symlink d5/d11/d80/l142 0 2024-04-25T13:47:13.587 INFO:tasks.workunit.client.0.smithi043.stdout:6/867: symlink d0/d90/d48/l120 0 2024-04-25T13:47:13.588 INFO:tasks.workunit.client.0.smithi043.stdout:0/874: write db/d1b/d23/d27/d39/d4c/f70 [1684986,39102] 0 2024-04-25T13:47:13.590 INFO:tasks.workunit.client.0.smithi043.stdout:6/868: symlink d0/d90/d48/d60/l121 0 2024-04-25T13:47:13.595 INFO:tasks.workunit.client.0.smithi043.stdout:2/741: mknod d0/d34/d77/ce5 0 2024-04-25T13:47:13.598 INFO:tasks.workunit.client.0.smithi043.stdout:2/742: read d0/d8/d9b/ddb/fca [1910584,116319] 0 2024-04-25T13:47:13.601 INFO:tasks.workunit.client.0.smithi043.stdout:6/869: dwrite d0/d90/f10d [0,4194304] 0 2024-04-25T13:47:13.603 INFO:tasks.workunit.client.0.smithi043.stdout:2/743: write d0/d34/d17/d5e/d9f/fad [903952,66433] 0 2024-04-25T13:47:13.605 INFO:tasks.workunit.client.0.smithi043.stdout:0/875: dwrite db/d25/d2a/fb6 [0,4194304] 0 2024-04-25T13:47:13.608 INFO:tasks.workunit.client.0.smithi043.stdout:2/744: dread d0/d26/fb1 [0,4194304] 0 2024-04-25T13:47:13.609 INFO:tasks.workunit.client.0.smithi043.stdout:3/794: dread d0/d9/d6e/d34/d36/f9a [0,4194304] 0 2024-04-25T13:47:13.614 INFO:tasks.workunit.client.0.smithi043.stdout:8/900: link db/d44/d8e/d27/f91 db/d38/d3c/dd9/f11f 0 2024-04-25T13:47:13.617 INFO:tasks.workunit.client.0.smithi043.stdout:8/901: write db/dc/d21/d4e/fce [2660495,104340] 0 2024-04-25T13:47:13.617 INFO:tasks.workunit.client.0.smithi043.stdout:9/358: rename d0/d1d/d22/f4b to d0/d8b/d26/d39/f8d 0 2024-04-25T13:47:13.622 INFO:tasks.workunit.client.0.smithi043.stdout:8/902: chown db/dc/d21/db4/dbe/lea 11778161 1 2024-04-25T13:47:13.627 INFO:tasks.workunit.client.0.smithi043.stdout:5/761: rename d1/d3/d7/d2f/fc8 to d1/d3/d7/d9/ff9 0 2024-04-25T13:47:13.628 INFO:tasks.workunit.client.0.smithi043.stdout:8/903: creat db/d38/d77/df7/f120 x:0 0 0 2024-04-25T13:47:13.630 INFO:tasks.workunit.client.0.smithi043.stdout:8/904: write db/d38/d40/fd8 [2276758,30147] 0 2024-04-25T13:47:13.631 INFO:tasks.workunit.client.0.smithi043.stdout:1/845: rename df/d10/d22/d2f/l30 to df/d10/d22/d2f/d9c/l12f 0 2024-04-25T13:47:13.631 INFO:tasks.workunit.client.0.smithi043.stdout:6/870: dread d0/d3d/d6e/f86 [0,4194304] 0 2024-04-25T13:47:13.636 INFO:tasks.workunit.client.0.smithi043.stdout:8/905: symlink db/d38/l121 0 2024-04-25T13:47:13.637 INFO:tasks.workunit.client.0.smithi043.stdout:6/871: mkdir d0/d90/dd9/d101/d122 0 2024-04-25T13:47:13.638 INFO:tasks.workunit.client.0.smithi043.stdout:8/906: symlink db/dc/d80/l122 0 2024-04-25T13:47:13.639 INFO:tasks.workunit.client.0.smithi043.stdout:9/359: rename d0/c2d to d0/d8b/c8e 0 2024-04-25T13:47:13.640 INFO:tasks.workunit.client.0.smithi043.stdout:9/360: write d0/d8b/d26/d39/d46/f75 [611562,25889] 0 2024-04-25T13:47:13.641 INFO:tasks.workunit.client.0.smithi043.stdout:9/361: fdatasync d0/d8b/d26/d39/f5f 0 2024-04-25T13:47:13.642 INFO:tasks.workunit.client.0.smithi043.stdout:6/872: mkdir d0/d1b/d112/d123 0 2024-04-25T13:47:13.643 INFO:tasks.workunit.client.0.smithi043.stdout:9/362: fsync d0/d1d/f29 0 2024-04-25T13:47:13.643 INFO:tasks.workunit.client.0.smithi043.stdout:5/762: rmdir d1/d3/d62 39 2024-04-25T13:47:13.646 INFO:tasks.workunit.client.0.smithi043.stdout:5/763: write d1/d3/d7/d9/d2d/d5b/fb1 [1237903,52848] 0 2024-04-25T13:47:13.647 INFO:tasks.workunit.client.0.smithi043.stdout:9/363: creat d0/d1d/d22/f8f x:0 0 0 2024-04-25T13:47:13.648 INFO:tasks.workunit.client.0.smithi043.stdout:5/764: write d1/d3/d7/d9/d2d/d5b/fa5 [4222354,76863] 0 2024-04-25T13:47:13.650 INFO:tasks.workunit.client.0.smithi043.stdout:5/765: dread - d1/d3/d7/d8/df/d28/fab zero size 2024-04-25T13:47:13.651 INFO:tasks.workunit.client.0.smithi043.stdout:6/873: write d0/d1c/fa6 [690421,130434] 0 2024-04-25T13:47:13.652 INFO:tasks.workunit.client.0.smithi043.stdout:1/846: mkdir df/d14/d63/d67/da7/d130 0 2024-04-25T13:47:13.653 INFO:tasks.workunit.client.0.smithi043.stdout:5/766: unlink d1/f56 0 2024-04-25T13:47:13.653 INFO:tasks.workunit.client.0.smithi043.stdout:9/364: symlink d0/d8b/d26/d47/d52/l90 0 2024-04-25T13:47:13.656 INFO:tasks.workunit.client.0.smithi043.stdout:6/874: mknod d0/d3d/dc9/c124 0 2024-04-25T13:47:13.657 INFO:tasks.workunit.client.0.smithi043.stdout:5/767: truncate d1/d3/d7/d9/d2d/fc5 848490 0 2024-04-25T13:47:13.658 INFO:tasks.workunit.client.0.smithi043.stdout:1/847: creat df/d31/d38/d43/d6e/df9/f131 x:0 0 0 2024-04-25T13:47:13.659 INFO:tasks.workunit.client.0.smithi043.stdout:6/875: unlink d0/d1c/f3b 0 2024-04-25T13:47:13.660 INFO:tasks.workunit.client.0.smithi043.stdout:9/365: symlink d0/d8b/d26/d47/d52/l91 0 2024-04-25T13:47:13.660 INFO:tasks.workunit.client.0.smithi043.stdout:6/876: chown d0/d90/dd9/l100 2478216 1 2024-04-25T13:47:13.661 INFO:tasks.workunit.client.0.smithi043.stdout:1/848: mkdir df/d14/d3d/d82/d8c/d132 0 2024-04-25T13:47:13.662 INFO:tasks.workunit.client.0.smithi043.stdout:5/768: symlink d1/d3/d7/d2f/lfa 0 2024-04-25T13:47:13.662 INFO:tasks.workunit.client.0.smithi043.stdout:6/877: chown d0/d3d/d6e/d71/l92 11659224 1 2024-04-25T13:47:13.662 INFO:tasks.workunit.client.0.smithi043.stdout:9/366: fsync d0/d1d/d7/d3a/f56 0 2024-04-25T13:47:13.671 INFO:tasks.workunit.client.0.smithi043.stdout:5/769: creat d1/d3/d7/d2f/df6/ffb x:0 0 0 2024-04-25T13:47:13.674 INFO:tasks.workunit.client.0.smithi043.stdout:9/367: rename d0/d1d/f25 to d0/d1d/d22/f92 0 2024-04-25T13:47:13.678 INFO:tasks.workunit.client.0.smithi043.stdout:6/878: write d0/d76/de3/d64/dc7/f11a [342899,67139] 0 2024-04-25T13:47:13.679 INFO:tasks.workunit.client.0.smithi043.stdout:9/368: fsync d0/d8b/d26/d39/d46/f5e 0 2024-04-25T13:47:13.680 INFO:tasks.workunit.client.0.smithi043.stdout:1/849: dwrite df/d14/d63/d67/d9f/fdc [0,4194304] 0 2024-04-25T13:47:13.681 INFO:tasks.workunit.client.0.smithi043.stdout:8/907: link db/d7d/fb0 db/d38/d77/dd7/f123 0 2024-04-25T13:47:13.684 INFO:tasks.workunit.client.0.smithi043.stdout:6/879: creat d0/d76/de3/d64/dc7/f125 x:0 0 0 2024-04-25T13:47:13.687 INFO:tasks.workunit.client.0.smithi043.stdout:9/369: creat d0/d8b/d26/d39/d46/f93 x:0 0 0 2024-04-25T13:47:13.689 INFO:tasks.workunit.client.0.smithi043.stdout:8/908: creat db/dc/d28/f124 x:0 0 0 2024-04-25T13:47:13.693 INFO:tasks.workunit.client.0.smithi043.stdout:1/850: dwrite df/d31/d38/d43/d6e/df9/f131 [0,4194304] 0 2024-04-25T13:47:13.693 INFO:tasks.workunit.client.0.smithi043.stdout:8/909: read db/dc/f45 [776957,97030] 0 2024-04-25T13:47:13.746 INFO:tasks.workunit.client.0.smithi043.stdout:1/851: fsync df/d10/d22/f88 0 2024-04-25T13:47:13.749 INFO:tasks.workunit.client.0.smithi043.stdout:8/910: creat db/d44/d8e/d27/f125 x:0 0 0 2024-04-25T13:47:13.750 INFO:tasks.workunit.client.0.smithi043.stdout:6/880: dwrite d0/d3d/d54/f57 [0,4194304] 0 2024-04-25T13:47:13.750 INFO:tasks.workunit.client.0.smithi043.stdout:5/770: dread d1/d3/d7/d8/da/f9d [0,4194304] 0 2024-04-25T13:47:13.753 INFO:tasks.workunit.client.0.smithi043.stdout:1/852: symlink df/d31/d38/d43/d6e/dea/l133 0 2024-04-25T13:47:13.754 INFO:tasks.workunit.client.0.smithi043.stdout:9/370: dwrite d0/d1d/d7/f5c [0,4194304] 0 2024-04-25T13:47:13.755 INFO:tasks.workunit.client.0.smithi043.stdout:8/911: stat db/d38/d3c/d71/d5d/fda 0 2024-04-25T13:47:13.759 INFO:tasks.workunit.client.0.smithi043.stdout:9/371: fsync d0/d1d/d4a/f6a 0 2024-04-25T13:47:13.763 INFO:tasks.workunit.client.0.smithi043.stdout:9/372: truncate d0/d1d/d22/d67/f71 113517 0 2024-04-25T13:47:13.764 INFO:tasks.workunit.client.0.smithi043.stdout:5/771: dwrite d1/d3/d7/d2f/d80/fef [0,4194304] 0 2024-04-25T13:47:13.768 INFO:tasks.workunit.client.0.smithi043.stdout:9/373: dread - d0/d8b/d26/f6d zero size 2024-04-25T13:47:13.772 INFO:tasks.workunit.client.0.smithi043.stdout:1/853: dwrite df/d31/d38/d43/f65 [0,4194304] 0 2024-04-25T13:47:13.775 INFO:tasks.workunit.client.0.smithi043.stdout:1/854: write df/d31/f48 [3425505,78541] 0 2024-04-25T13:47:13.777 INFO:tasks.workunit.client.0.smithi043.stdout:9/374: creat d0/d77/f94 x:0 0 0 2024-04-25T13:47:13.777 INFO:tasks.workunit.client.0.smithi043.stdout:6/881: rename d0/d76/fd4 to d0/f126 0 2024-04-25T13:47:13.780 INFO:tasks.workunit.client.0.smithi043.stdout:0/876: dwrite db/d25/d2a/d9d/fbe [0,4194304] 0 2024-04-25T13:47:13.781 INFO:tasks.workunit.client.0.smithi043.stdout:5/772: dwrite d1/d3/d7/d8/df/d28/f48 [0,4194304] 0 2024-04-25T13:47:13.783 INFO:tasks.workunit.client.0.smithi043.stdout:8/912: rename db/d38/d3c/d71/d5d/d67/fc9 to db/dc/d28/d104/f126 0 2024-04-25T13:47:13.783 INFO:tasks.workunit.client.0.smithi043.stdout:9/375: stat d0/d1d/d7/d41/c6b 0 2024-04-25T13:47:13.783 INFO:tasks.workunit.client.0.smithi043.stdout:6/882: write d0/d1c/fb1 [2054676,85553] 0 2024-04-25T13:47:13.785 INFO:tasks.workunit.client.0.smithi043.stdout:5/773: stat d1/d3/d7/d8/l75 0 2024-04-25T13:47:13.787 INFO:tasks.workunit.client.0.smithi043.stdout:1/855: symlink df/d10/d22/d2f/d9c/d41/db8/l134 0 2024-04-25T13:47:13.788 INFO:tasks.workunit.client.0.smithi043.stdout:8/913: unlink db/d46/f61 0 2024-04-25T13:47:13.791 INFO:tasks.workunit.client.0.smithi043.stdout:8/914: creat db/d44/d8e/f127 x:0 0 0 2024-04-25T13:47:13.792 INFO:tasks.workunit.client.0.smithi043.stdout:1/856: dread - df/d31/d38/d43/d53/fe9 zero size 2024-04-25T13:47:13.793 INFO:tasks.workunit.client.0.smithi043.stdout:9/376: creat d0/d1d/d7/f95 x:0 0 0 2024-04-25T13:47:13.796 INFO:tasks.workunit.client.0.smithi043.stdout:0/877: write db/d1b/d23/d27/f87 [2905339,27092] 0 2024-04-25T13:47:13.796 INFO:tasks.workunit.client.0.smithi043.stdout:1/857: creat df/d31/d34/d91/f135 x:0 0 0 2024-04-25T13:47:13.797 INFO:tasks.workunit.client.0.smithi043.stdout:8/915: fdatasync db/d11/f15 0 2024-04-25T13:47:13.804 INFO:tasks.workunit.client.0.smithi043.stdout:5/774: fdatasync d1/d3/d7/d8/df/d28/f48 0 2024-04-25T13:47:13.804 INFO:tasks.workunit.client.0.smithi043.stdout:0/878: mkdir db/d25/d2a/d3f/d6a/d127 0 2024-04-25T13:47:13.806 INFO:tasks.workunit.client.0.smithi043.stdout:9/377: dwrite d0/f20 [0,4194304] 0 2024-04-25T13:47:13.810 INFO:tasks.workunit.client.0.smithi043.stdout:9/378: write d0/d1d/d22/f8f [859842,92351] 0 2024-04-25T13:47:13.810 INFO:tasks.workunit.client.0.smithi043.stdout:5/775: mkdir d1/d3/d7/d8/df/d28/dfc 0 2024-04-25T13:47:13.811 INFO:tasks.workunit.client.0.smithi043.stdout:8/916: dwrite db/dc/d21/f4c [4194304,4194304] 0 2024-04-25T13:47:13.811 INFO:tasks.workunit.client.0.smithi043.stdout:9/379: read d0/d1d/f29 [305903,79926] 0 2024-04-25T13:47:13.812 INFO:tasks.workunit.client.0.smithi043.stdout:9/380: dread - d0/d8b/d26/f6d zero size 2024-04-25T13:47:13.814 INFO:tasks.workunit.client.0.smithi043.stdout:0/879: creat db/d1b/d23/d27/d39/d4c/da9/d117/f128 x:0 0 0 2024-04-25T13:47:13.815 INFO:tasks.workunit.client.0.smithi043.stdout:5/776: creat d1/d4/d92/d95/ffd x:0 0 0 2024-04-25T13:47:13.816 INFO:tasks.workunit.client.0.smithi043.stdout:9/381: fsync d0/f1e 0 2024-04-25T13:47:13.817 INFO:tasks.workunit.client.0.smithi043.stdout:9/382: write d0/f20 [1010857,30305] 0 2024-04-25T13:47:13.826 INFO:tasks.workunit.client.0.smithi043.stdout:8/917: dread db/fc4 [0,4194304] 0 2024-04-25T13:47:13.829 INFO:tasks.workunit.client.0.smithi043.stdout:8/918: creat db/dc/d21/db4/f128 x:0 0 0 2024-04-25T13:47:13.829 INFO:tasks.workunit.client.0.smithi043.stdout:0/880: mkdir db/d25/d2a/d3f/d6a/d127/d129 0 2024-04-25T13:47:13.831 INFO:tasks.workunit.client.0.smithi043.stdout:0/881: dread - db/d1b/d23/d27/d39/d4c/dbb/dc8/f118 zero size 2024-04-25T13:47:13.832 INFO:tasks.workunit.client.0.smithi043.stdout:9/383: creat d0/d1d/f96 x:0 0 0 2024-04-25T13:47:13.833 INFO:tasks.workunit.client.0.smithi043.stdout:0/882: write db/d1b/d23/d27/d98/de4/f109 [850592,33125] 0 2024-04-25T13:47:13.838 INFO:tasks.workunit.client.0.smithi043.stdout:9/384: mknod d0/d1d/c97 0 2024-04-25T13:47:13.839 INFO:tasks.workunit.client.0.smithi043.stdout:9/385: read d0/d1d/fa [1881565,3558] 0 2024-04-25T13:47:13.840 INFO:tasks.workunit.client.0.smithi043.stdout:8/919: truncate db/d44/d8e/f42 4505848 0 2024-04-25T13:47:13.841 INFO:tasks.workunit.client.0.smithi043.stdout:0/883: write db/d1b/d36/d41/f57 [1013088,107904] 0 2024-04-25T13:47:13.843 INFO:tasks.workunit.client.0.smithi043.stdout:4/823: sync 2024-04-25T13:47:13.845 INFO:tasks.workunit.client.0.smithi043.stdout:0/884: fsync db/d25/d2a/d9d/ff0 0 2024-04-25T13:47:13.845 INFO:tasks.workunit.client.0.smithi043.stdout:8/920: creat db/dc/d21/d4e/d62/f129 x:0 0 0 2024-04-25T13:47:13.846 INFO:tasks.workunit.client.0.smithi043.stdout:4/824: chown d1/de/df/db4/fcb 13309321 1 2024-04-25T13:47:13.847 INFO:tasks.workunit.client.0.smithi043.stdout:9/386: dwrite d0/d8b/d26/d47/d4d/f58 [0,4194304] 0 2024-04-25T13:47:13.848 INFO:tasks.workunit.client.0.smithi043.stdout:0/885: fsync db/d1b/d23/d27/d39/f123 0 2024-04-25T13:47:13.849 INFO:tasks.workunit.client.0.smithi043.stdout:8/921: mkdir db/d44/d8e/d12a 0 2024-04-25T13:47:13.850 INFO:tasks.workunit.client.0.smithi043.stdout:9/387: readlink d0/d1d/d22/l7e 0 2024-04-25T13:47:13.851 INFO:tasks.workunit.client.0.smithi043.stdout:4/825: mknod d1/d3/d54/d62/d77/d92/df6/c10b 0 2024-04-25T13:47:13.852 INFO:tasks.workunit.client.0.smithi043.stdout:6/883: rename d0/d76/de3/da7/fd0 to d0/d90/f127 0 2024-04-25T13:47:13.853 INFO:tasks.workunit.client.0.smithi043.stdout:8/922: fdatasync db/dc/d21/db4/fe7 0 2024-04-25T13:47:13.857 INFO:tasks.workunit.client.0.smithi043.stdout:6/884: rmdir d0/d90/dd9 39 2024-04-25T13:47:13.857 INFO:tasks.workunit.client.0.smithi043.stdout:8/923: creat db/d38/d3c/d71/d5d/f12b x:0 0 0 2024-04-25T13:47:13.858 INFO:tasks.workunit.client.0.smithi043.stdout:1/858: rename df/d31/d34/d8b/d39/f7f to df/d14/d3d/d82/f136 0 2024-04-25T13:47:13.860 INFO:tasks.workunit.client.0.smithi043.stdout:9/388: link d0/d8b/f23 d0/d1d/f98 0 2024-04-25T13:47:13.863 INFO:tasks.workunit.client.0.smithi043.stdout:8/924: creat db/d46/f12c x:0 0 0 2024-04-25T13:47:13.865 INFO:tasks.workunit.client.0.smithi043.stdout:5/777: rename d1/d3/d7/d9/d2d/d5b to d1/d3/d7/d8/df/dfe 0 2024-04-25T13:47:13.867 INFO:tasks.workunit.client.0.smithi043.stdout:8/925: write db/dc/f48 [1915483,108475] 0 2024-04-25T13:47:13.868 INFO:tasks.workunit.client.0.smithi043.stdout:5/778: creat d1/d3/d7/d8/df/d28/fff x:0 0 0 2024-04-25T13:47:13.870 INFO:tasks.workunit.client.0.smithi043.stdout:5/779: chown d1/d3/d7/d8/df/lbd 1600 1 2024-04-25T13:47:13.871 INFO:tasks.workunit.client.0.smithi043.stdout:8/926: truncate db/d46/da8/d10e/d11c/fed 231396 0 2024-04-25T13:47:13.873 INFO:tasks.workunit.client.0.smithi043.stdout:6/885: getdents d0/d3d/d6e 0 2024-04-25T13:47:13.874 INFO:tasks.workunit.client.0.smithi043.stdout:5/780: rmdir d1/d8d 39 2024-04-25T13:47:13.875 INFO:tasks.workunit.client.0.smithi043.stdout:6/886: chown d0/d3d/d109/d3a/l46 117367995 1 2024-04-25T13:47:13.876 INFO:tasks.workunit.client.0.smithi043.stdout:8/927: rmdir db/d38/d3c/d71/d5d/d67 39 2024-04-25T13:47:13.876 INFO:tasks.workunit.client.0.smithi043.stdout:6/887: chown d0/d90/f7f 0 1 2024-04-25T13:47:13.878 INFO:tasks.workunit.client.0.smithi043.stdout:4/826: creat d1/de/df/d1e/dc8/f10c x:0 0 0 2024-04-25T13:47:13.881 INFO:tasks.workunit.client.0.smithi043.stdout:1/859: dread df/d31/dc7/dc8/fed [0,4194304] 0 2024-04-25T13:47:13.884 INFO:tasks.workunit.client.0.smithi043.stdout:5/781: dread d1/d3/d7/d8/da/f53 [0,4194304] 0 2024-04-25T13:47:13.885 INFO:tasks.workunit.client.0.smithi043.stdout:8/928: rmdir db/d38/de4 39 2024-04-25T13:47:13.889 INFO:tasks.workunit.client.0.smithi043.stdout:9/389: link d0/d8b/d26/d39/l7c d0/d1d/d22/l99 0 2024-04-25T13:47:13.889 INFO:tasks.workunit.client.0.smithi043.stdout:1/860: write df/d10/d22/d2f/ff1 [1416165,124080] 0 2024-04-25T13:47:13.890 INFO:tasks.workunit.client.0.smithi043.stdout:0/886: link db/d1b/d23/d27/fa0 db/d1b/d23/d27/d39/d4b/f12a 0 2024-04-25T13:47:13.892 INFO:tasks.workunit.client.0.smithi043.stdout:4/827: dwrite d1/de/df/d1a/d49/fa7 [4194304,4194304] 0 2024-04-25T13:47:13.892 INFO:tasks.workunit.client.0.smithi043.stdout:9/390: fsync d0/d8b/d26/f6c 0 2024-04-25T13:47:13.894 INFO:tasks.workunit.client.0.smithi043.stdout:7/976: sync 2024-04-25T13:47:13.894 INFO:tasks.workunit.client.0.smithi043.stdout:2/745: sync 2024-04-25T13:47:13.894 INFO:tasks.workunit.client.0.smithi043.stdout:3/795: sync 2024-04-25T13:47:13.895 INFO:tasks.workunit.client.0.smithi043.stdout:5/782: link d1/f19 d1/d4/deb/f100 0 2024-04-25T13:47:13.897 INFO:tasks.workunit.client.0.smithi043.stdout:6/888: dread d0/d3d/d54/f68 [0,4194304] 0 2024-04-25T13:47:13.898 INFO:tasks.workunit.client.0.smithi043.stdout:4/828: dread - d1/de/df/d1e/d45/da1/db3/d33/fff zero size 2024-04-25T13:47:13.899 INFO:tasks.workunit.client.0.smithi043.stdout:8/929: dread db/d46/da8/fbf [0,4194304] 0 2024-04-25T13:47:13.900 INFO:tasks.workunit.client.0.smithi043.stdout:5/783: chown d1/d3/d7/d8/df/d28/dfc 0 1 2024-04-25T13:47:13.901 INFO:tasks.workunit.client.0.smithi043.stdout:7/977: write d5/d75/f3e [3376577,79674] 0 2024-04-25T13:47:13.902 INFO:tasks.workunit.client.0.smithi043.stdout:3/796: write d0/d9/d6e/d34/f7f [36296,84935] 0 2024-04-25T13:47:13.902 INFO:tasks.workunit.client.0.smithi043.stdout:1/861: getdents df/d31/d38/d43/dbc 0 2024-04-25T13:47:13.903 INFO:tasks.workunit.client.0.smithi043.stdout:6/889: mkdir d0/d76/d5c/d128 0 2024-04-25T13:47:13.909 INFO:tasks.workunit.client.0.smithi043.stdout:9/391: dread d0/d8b/d26/d39/d46/f75 [0,4194304] 0 2024-04-25T13:47:13.910 INFO:tasks.workunit.client.0.smithi043.stdout:5/784: fsync d1/d3/d7/d8/df/d28/f48 0 2024-04-25T13:47:13.911 INFO:tasks.workunit.client.0.smithi043.stdout:4/829: fsync d1/de/df/db4/d36/d9e/d9d/f46 0 2024-04-25T13:47:13.912 INFO:tasks.workunit.client.0.smithi043.stdout:6/890: chown d0/d76/d5c/f7d 112 1 2024-04-25T13:47:13.913 INFO:tasks.workunit.client.0.smithi043.stdout:8/930: write db/d38/de4/d59/fcf [1031717,13178] 0 2024-04-25T13:47:13.915 INFO:tasks.workunit.client.0.smithi043.stdout:0/887: dwrite db/d1b/fd8 [0,4194304] 0 2024-04-25T13:47:13.915 INFO:tasks.workunit.client.0.smithi043.stdout:3/797: read - d0/d9/d6e/d34/d36/d105/f116 zero size 2024-04-25T13:47:13.915 INFO:tasks.workunit.client.0.smithi043.stdout:1/862: chown df/d10/d22/d2f/d9c/d41/lec 11 1 2024-04-25T13:47:13.916 INFO:tasks.workunit.client.0.smithi043.stdout:5/785: fdatasync d1/d4/d92/d95/fbc 0 2024-04-25T13:47:13.919 INFO:tasks.workunit.client.0.smithi043.stdout:9/392: chown d0/d8b/c8e 0 1 2024-04-25T13:47:13.919 INFO:tasks.workunit.client.0.smithi043.stdout:4/830: creat d1/d3/d7b/f10d x:0 0 0 2024-04-25T13:47:13.920 INFO:tasks.workunit.client.0.smithi043.stdout:2/746: mknod d0/d34/d77/ce6 0 2024-04-25T13:47:13.920 INFO:tasks.workunit.client.0.smithi043.stdout:3/798: stat d0/da/dcc 0 2024-04-25T13:47:13.924 INFO:tasks.workunit.client.0.smithi043.stdout:6/891: truncate d0/d90/d48/d9d/f11d 225304 0 2024-04-25T13:47:13.927 INFO:tasks.workunit.client.0.smithi043.stdout:4/831: dread - d1/de/df/d1e/ff7 zero size 2024-04-25T13:47:13.930 INFO:tasks.workunit.client.0.smithi043.stdout:9/393: creat d0/d1d/d7/d83/f9a x:0 0 0 2024-04-25T13:47:13.931 INFO:tasks.workunit.client.0.smithi043.stdout:7/978: dwrite d5/d11/d3b/d61/dc5/dee/f4a [0,4194304] 0 2024-04-25T13:47:13.931 INFO:tasks.workunit.client.0.smithi043.stdout:5/786: mknod d1/d3/d62/df3/c101 0 2024-04-25T13:47:13.931 INFO:tasks.workunit.client.0.smithi043.stdout:0/888: truncate db/d1b/d23/d27/d39/d4c/da9/d117/f128 1032850 0 2024-04-25T13:47:13.934 INFO:tasks.workunit.client.0.smithi043.stdout:1/863: mknod df/d14/d63/d67/da7/c137 0 2024-04-25T13:47:13.935 INFO:tasks.workunit.client.0.smithi043.stdout:6/892: symlink d0/d90/l129 0 2024-04-25T13:47:13.936 INFO:tasks.workunit.client.0.smithi043.stdout:0/889: readlink db/d1b/d62/ldd 0 2024-04-25T13:47:13.944 INFO:tasks.workunit.client.0.smithi043.stdout:8/931: dwrite db/d38/de4/f63 [0,4194304] 0 2024-04-25T13:47:13.946 INFO:tasks.workunit.client.0.smithi043.stdout:2/747: dwrite d0/d34/d17/d5e/d71/d81/fa8 [4194304,4194304] 0 2024-04-25T13:47:13.947 INFO:tasks.workunit.client.0.smithi043.stdout:6/893: symlink d0/d90/d48/l12a 0 2024-04-25T13:47:13.948 INFO:tasks.workunit.client.0.smithi043.stdout:5/787: dread d1/d3/d7/d9/d2d/f9a [0,4194304] 0 2024-04-25T13:47:13.952 INFO:tasks.workunit.client.0.smithi043.stdout:6/894: dread - d0/d76/de3/d64/ffd zero size 2024-04-25T13:47:13.953 INFO:tasks.workunit.client.0.smithi043.stdout:7/979: dwrite d5/d11/d3b/d61/f7c [0,4194304] 0 2024-04-25T13:47:13.954 INFO:tasks.workunit.client.0.smithi043.stdout:9/394: dwrite d0/d8b/f5d [0,4194304] 0 2024-04-25T13:47:13.955 INFO:tasks.workunit.client.0.smithi043.stdout:7/980: chown d5/d11/d3b/c112 35 1 2024-04-25T13:47:13.956 INFO:tasks.workunit.client.0.smithi043.stdout:9/395: dread - d0/d1d/d7/f5b zero size 2024-04-25T13:47:13.960 INFO:tasks.workunit.client.0.smithi043.stdout:6/895: rmdir d0/d90/d4c 39 2024-04-25T13:47:13.963 INFO:tasks.workunit.client.0.smithi043.stdout:6/896: mkdir d0/d76/d5c/d12b 0 2024-04-25T13:47:13.964 INFO:tasks.workunit.client.0.smithi043.stdout:1/864: dread df/d14/d63/d67/da7/fd4 [0,4194304] 0 2024-04-25T13:47:13.965 INFO:tasks.workunit.client.0.smithi043.stdout:1/865: stat df/d14/d63/fa5 0 2024-04-25T13:47:13.966 INFO:tasks.workunit.client.0.smithi043.stdout:6/897: chown d0/c8e 10475 1 2024-04-25T13:47:13.968 INFO:tasks.workunit.client.0.smithi043.stdout:0/890: creat db/d1b/d23/d27/d39/d4b/f12b x:0 0 0 2024-04-25T13:47:13.972 INFO:tasks.workunit.client.0.smithi043.stdout:0/891: dread db/d1b/d94/d68/f9c [0,4194304] 0 2024-04-25T13:47:13.973 INFO:tasks.workunit.client.0.smithi043.stdout:6/898: creat d0/d90/dd9/d101/d122/f12c x:0 0 0 2024-04-25T13:47:13.976 INFO:tasks.workunit.client.0.smithi043.stdout:8/932: truncate db/d7d/df2/fff 885094 0 2024-04-25T13:47:13.976 INFO:tasks.workunit.client.0.smithi043.stdout:6/899: write d0/fe [819353,75505] 0 2024-04-25T13:47:13.977 INFO:tasks.workunit.client.0.smithi043.stdout:0/892: symlink db/d1b/d23/d27/d39/l12c 0 2024-04-25T13:47:13.979 INFO:tasks.workunit.client.0.smithi043.stdout:6/900: fdatasync d0/d3d/d54/f68 0 2024-04-25T13:47:13.983 INFO:tasks.workunit.client.0.smithi043.stdout:1/866: dread df/f35 [0,4194304] 0 2024-04-25T13:47:13.985 INFO:tasks.workunit.client.0.smithi043.stdout:0/893: getdents db/d1b/d23 0 2024-04-25T13:47:13.988 INFO:tasks.workunit.client.0.smithi043.stdout:5/788: dread d1/d4/f73 [0,4194304] 0 2024-04-25T13:47:13.988 INFO:tasks.workunit.client.0.smithi043.stdout:6/901: write d0/f59 [2413158,120853] 0 2024-04-25T13:47:13.990 INFO:tasks.workunit.client.0.smithi043.stdout:6/902: chown d0/d3d/c44 1 1 2024-04-25T13:47:13.990 INFO:tasks.workunit.client.0.smithi043.stdout:3/799: dread d0/d9/d6e/d34/d36/d57/f98 [0,4194304] 0 2024-04-25T13:47:13.991 INFO:tasks.workunit.client.0.smithi043.stdout:5/789: unlink d1/d4/d42/f97 0 2024-04-25T13:47:13.991 INFO:tasks.workunit.client.0.smithi043.stdout:6/903: chown d0/d76/de3/dd6/ff1 3 1 2024-04-25T13:47:13.992 INFO:tasks.workunit.client.0.smithi043.stdout:5/790: readlink d1/d4/d42/l45 0 2024-04-25T13:47:13.993 INFO:tasks.workunit.client.0.smithi043.stdout:4/832: rename d1/d3/d8f/fe4 to d1/d3/d54/d62/d77/f10e 0 2024-04-25T13:47:13.998 INFO:tasks.workunit.client.0.smithi043.stdout:6/904: fdatasync d0/d76/de3/d64/f6d 0 2024-04-25T13:47:13.998 INFO:tasks.workunit.client.0.smithi043.stdout:0/894: dread db/d1b/d23/d27/d98/de4/f109 [0,4194304] 0 2024-04-25T13:47:14.000 INFO:tasks.workunit.client.0.smithi043.stdout:3/800: truncate d0/da/db9/d9e/fed 65409 0 2024-04-25T13:47:14.001 INFO:tasks.workunit.client.0.smithi043.stdout:6/905: write d0/f16 [4017838,823] 0 2024-04-25T13:47:14.002 INFO:tasks.workunit.client.0.smithi043.stdout:7/981: rename d5/d11/c59 to d5/d11/d3b/d61/c143 0 2024-04-25T13:47:14.008 INFO:tasks.workunit.client.0.smithi043.stdout:7/982: mkdir d5/d11/d3b/d8b/d9b/d144 0 2024-04-25T13:47:14.012 INFO:tasks.workunit.client.0.smithi043.stdout:0/895: link db/d1b/d23/d27/d39/d4c/da9/lc1 db/d1b/d36/l12d 0 2024-04-25T13:47:14.014 INFO:tasks.workunit.client.0.smithi043.stdout:6/906: truncate d0/f59 3755926 0 2024-04-25T13:47:14.017 INFO:tasks.workunit.client.0.smithi043.stdout:6/907: fsync d0/d76/d5c/f8a 0 2024-04-25T13:47:14.018 INFO:tasks.workunit.client.0.smithi043.stdout:6/908: write d0/fe [2104356,118808] 0 2024-04-25T13:47:14.019 INFO:tasks.workunit.client.0.smithi043.stdout:6/909: write d0/f16 [1218966,58956] 0 2024-04-25T13:47:14.025 INFO:tasks.workunit.client.0.smithi043.stdout:7/983: truncate d5/d11/d3b/d61/d68/fce 4739221 0 2024-04-25T13:47:14.027 INFO:tasks.workunit.client.0.smithi043.stdout:7/984: chown d5/d6b/lc1 25 1 2024-04-25T13:47:14.028 INFO:tasks.workunit.client.0.smithi043.stdout:7/985: chown d5/d11/d3b/c114 35909415 1 2024-04-25T13:47:14.030 INFO:tasks.workunit.client.0.smithi043.stdout:6/910: write d0/d1c/f8d [3985807,13321] 0 2024-04-25T13:47:14.032 INFO:tasks.workunit.client.0.smithi043.stdout:7/986: creat d5/d11/d3b/d61/dc5/dee/d5a/d8d/dbf/df0/d119/f145 x:0 0 0 2024-04-25T13:47:14.038 INFO:tasks.workunit.client.0.smithi043.stdout:6/911: dwrite d0/d76/de3/dd6/ff1 [0,4194304] 0 2024-04-25T13:47:14.038 INFO:tasks.workunit.client.0.smithi043.stdout:9/396: rename d0/d1d/d7/d3a to d0/d8b/d9b 0 2024-04-25T13:47:14.041 INFO:tasks.workunit.client.0.smithi043.stdout:6/912: creat d0/d1c/f12d x:0 0 0 2024-04-25T13:47:14.045 INFO:tasks.workunit.client.0.smithi043.stdout:7/987: dread d5/d11/d3b/d8b/d9b/df6/f126 [0,4194304] 0 2024-04-25T13:47:14.047 INFO:tasks.workunit.client.0.smithi043.stdout:2/748: rename d0/d5/d1e/d32/f5a to d0/d34/d77/fe7 0 2024-04-25T13:47:14.047 INFO:tasks.workunit.client.0.smithi043.stdout:9/397: dwrite d0/d8b/d26/f6c [0,4194304] 0 2024-04-25T13:47:14.049 INFO:tasks.workunit.client.0.smithi043.stdout:9/398: chown d0/d8b/d26/d47/f65 436745 1 2024-04-25T13:47:14.051 INFO:tasks.workunit.client.0.smithi043.stdout:7/988: creat d5/d11/d3b/d8b/d9b/df6/d134/f146 x:0 0 0 2024-04-25T13:47:14.051 INFO:tasks.workunit.client.0.smithi043.stdout:1/867: rename df/d14/d3d/d82 to df/d31/d34/d91/d138 0 2024-04-25T13:47:14.053 INFO:tasks.workunit.client.0.smithi043.stdout:9/399: unlink d0/d8b/d9b/l7f 0 2024-04-25T13:47:14.056 INFO:tasks.workunit.client.0.smithi043.stdout:7/989: mkdir d5/d11/d3b/d61/dc5/dee/d5a/d8d/d147 0 2024-04-25T13:47:14.059 INFO:tasks.workunit.client.0.smithi043.stdout:6/913: dread d0/d76/de3/d64/da1/da3/fe7 [0,4194304] 0 2024-04-25T13:47:14.060 INFO:tasks.workunit.client.0.smithi043.stdout:9/400: creat d0/d1d/d7/f9c x:0 0 0 2024-04-25T13:47:14.061 INFO:tasks.workunit.client.0.smithi043.stdout:4/833: rename d1/de/df/d1e/d45/da1/db3 to d1/de/d1d/dfb/d10f 0 2024-04-25T13:47:14.062 INFO:tasks.workunit.client.0.smithi043.stdout:7/990: mkdir d5/d11/d8f/d148 0 2024-04-25T13:47:14.064 INFO:tasks.workunit.client.0.smithi043.stdout:5/791: rename d1/d3/lb3 to d1/d3/d7/d8/df/dfe/d6e/da3/l102 0 2024-04-25T13:47:14.066 INFO:tasks.workunit.client.0.smithi043.stdout:9/401: mknod d0/d1d/d7/c9d 0 2024-04-25T13:47:14.067 INFO:tasks.workunit.client.0.smithi043.stdout:7/991: write d5/f15 [2999855,73980] 0 2024-04-25T13:47:14.069 INFO:tasks.workunit.client.0.smithi043.stdout:2/749: dread d0/d34/d17/d5e/d71/f85 [0,4194304] 0 2024-04-25T13:47:14.070 INFO:tasks.workunit.client.0.smithi043.stdout:2/750: stat d0/d34/d17/d5e/d9f 0 2024-04-25T13:47:14.070 INFO:tasks.workunit.client.0.smithi043.stdout:2/751: dread - d0/d34/d17/f89 zero size 2024-04-25T13:47:14.071 INFO:tasks.workunit.client.0.smithi043.stdout:5/792: rmdir d1/d3/d7/d8/da 39 2024-04-25T13:47:14.073 INFO:tasks.workunit.client.0.smithi043.stdout:7/992: mkdir d5/d11/d3b/d149 0 2024-04-25T13:47:14.074 INFO:tasks.workunit.client.0.smithi043.stdout:3/801: rename d0/da/db9/d9e/ld2 to d0/d9/d6e/d38/l118 0 2024-04-25T13:47:14.075 INFO:tasks.workunit.client.0.smithi043.stdout:1/868: dread fe [0,4194304] 0 2024-04-25T13:47:14.075 INFO:tasks.workunit.client.0.smithi043.stdout:4/834: unlink d1/d3/d54/d62/d77/d92/dc5/f91 0 2024-04-25T13:47:14.081 INFO:tasks.workunit.client.0.smithi043.stdout:7/993: symlink d5/d11/d3b/d61/d68/dc0/l14a 0 2024-04-25T13:47:14.082 INFO:tasks.workunit.client.0.smithi043.stdout:2/752: write d0/d34/d17/da0/fe1 [902362,26966] 0 2024-04-25T13:47:14.085 INFO:tasks.workunit.client.0.smithi043.stdout:2/753: stat d0/d34/f1a 0 2024-04-25T13:47:14.086 INFO:tasks.workunit.client.0.smithi043.stdout:7/994: symlink d5/d11/d3b/d61/dc5/dee/d116/l14b 0 2024-04-25T13:47:14.092 INFO:tasks.workunit.client.0.smithi043.stdout:3/802: dread d0/d13/d55/fa9 [0,4194304] 0 2024-04-25T13:47:14.092 INFO:tasks.workunit.client.0.smithi043.stdout:7/995: fdatasync d5/d11/d3b/f70 0 2024-04-25T13:47:14.095 INFO:tasks.workunit.client.0.smithi043.stdout:5/793: truncate d1/d3/d7/d9/d2d/f6c 3768642 0 2024-04-25T13:47:14.095 INFO:tasks.workunit.client.0.smithi043.stdout:7/996: read d5/d11/f12f [2404789,129924] 0 2024-04-25T13:47:14.096 INFO:tasks.workunit.client.0.smithi043.stdout:3/803: symlink d0/d9/d6e/d34/d36/d57/l119 0 2024-04-25T13:47:14.097 INFO:tasks.workunit.client.0.smithi043.stdout:6/914: unlink d0/f126 0 2024-04-25T13:47:14.100 INFO:tasks.workunit.client.0.smithi043.stdout:5/794: rmdir d1 39 2024-04-25T13:47:14.103 INFO:tasks.workunit.client.0.smithi043.stdout:2/754: write d0/d34/d3f/d59/fe3 [331602,115772] 0 2024-04-25T13:47:14.105 INFO:tasks.workunit.client.0.smithi043.stdout:3/804: dwrite d0/d13/d55/dd9/df5/fa1 [0,4194304] 0 2024-04-25T13:47:14.106 INFO:tasks.workunit.client.0.smithi043.stdout:2/755: readlink d0/d5/d1e/l61 0 2024-04-25T13:47:14.108 INFO:tasks.workunit.client.0.smithi043.stdout:2/756: write d0/d4b/f72 [5076263,33611] 0 2024-04-25T13:47:14.109 INFO:tasks.workunit.client.0.smithi043.stdout:6/915: dwrite d0/d3d/fe6 [0,4194304] 0 2024-04-25T13:47:14.117 INFO:tasks.workunit.client.0.smithi043.stdout:6/916: chown d0/d76/de3/d64/c99 20 1 2024-04-25T13:47:14.118 INFO:tasks.workunit.client.0.smithi043.stdout:9/402: rename d0/d8b/d26/l32 to d0/l9e 0 2024-04-25T13:47:14.118 INFO:tasks.workunit.client.0.smithi043.stdout:3/805: mkdir d0/d9/d6e/d34/d36/d57/de5/d11a 0 2024-04-25T13:47:14.120 INFO:tasks.workunit.client.0.smithi043.stdout:6/917: mknod d0/d76/d5c/d10e/c12e 0 2024-04-25T13:47:14.122 INFO:tasks.workunit.client.0.smithi043.stdout:6/918: readlink d0/d3d/d6e/d71/l92 0 2024-04-25T13:47:14.122 INFO:tasks.workunit.client.0.smithi043.stdout:2/757: dread d0/d34/d3f/d7b/fd0 [0,4194304] 0 2024-04-25T13:47:14.127 INFO:tasks.workunit.client.0.smithi043.stdout:9/403: getdents d0/d8b/d9b 0 2024-04-25T13:47:14.127 INFO:tasks.workunit.client.0.smithi043.stdout:1/869: rename df/d31/c54 to df/d31/d34/d8b/c139 0 2024-04-25T13:47:14.128 INFO:tasks.workunit.client.0.smithi043.stdout:2/758: unlink d0/d34/d17/d5e/d9f/lb0 0 2024-04-25T13:47:14.132 INFO:tasks.workunit.client.0.smithi043.stdout:9/404: symlink d0/d1d/l9f 0 2024-04-25T13:47:14.133 INFO:tasks.workunit.client.0.smithi043.stdout:6/919: dwrite d0/d1c/f12d [0,4194304] 0 2024-04-25T13:47:14.133 INFO:tasks.workunit.client.0.smithi043.stdout:9/405: readlink d0/d1d/d4a/l84 0 2024-04-25T13:47:14.133 INFO:tasks.workunit.client.0.smithi043.stdout:1/870: creat df/d31/d38/d43/d53/f13a x:0 0 0 2024-04-25T13:47:14.135 INFO:tasks.workunit.client.0.smithi043.stdout:1/871: chown df/d14/d3d/c3e 210965 1 2024-04-25T13:47:14.136 INFO:tasks.workunit.client.0.smithi043.stdout:2/759: symlink d0/d8/d9b/ddb/dda/le8 0 2024-04-25T13:47:14.136 INFO:tasks.workunit.client.0.smithi043.stdout:1/872: chown df/d31/d34/d8b/fdf 398670184 1 2024-04-25T13:47:14.137 INFO:tasks.workunit.client.0.smithi043.stdout:6/920: symlink d0/d76/de3/d64/da1/da3/l12f 0 2024-04-25T13:47:14.143 INFO:tasks.workunit.client.0.smithi043.stdout:6/921: mkdir d0/d90/d4c/d130 0 2024-04-25T13:47:14.143 INFO:tasks.workunit.client.0.smithi043.stdout:3/806: dwrite d0/d9/d6e/d34/d36/d57/de5/dc2/fce [0,4194304] 0 2024-04-25T13:47:14.146 INFO:tasks.workunit.client.0.smithi043.stdout:9/406: getdents d0/d1d/d22 0 2024-04-25T13:47:14.147 INFO:tasks.workunit.client.0.smithi043.stdout:3/807: mknod d0/da/db9/df7/c11b 0 2024-04-25T13:47:14.149 INFO:tasks.workunit.client.0.smithi043.stdout:6/922: getdents d0/d1b/d112/d123 0 2024-04-25T13:47:14.149 INFO:tasks.workunit.client.0.smithi043.stdout:2/760: rmdir d0/d34/d3f 39 2024-04-25T13:47:14.152 INFO:tasks.workunit.client.0.smithi043.stdout:8/933: sync 2024-04-25T13:47:14.158 INFO:tasks.workunit.client.0.smithi043.stdout:9/407: getdents d0/d1d/d7 0 2024-04-25T13:47:14.158 INFO:tasks.workunit.client.0.smithi043.stdout:8/934: mkdir db/d11/d79/dba/d12d 0 2024-04-25T13:47:14.159 INFO:tasks.workunit.client.0.smithi043.stdout:8/935: chown db/d38/de4 402 1 2024-04-25T13:47:14.159 INFO:tasks.workunit.client.0.smithi043.stdout:9/408: readlink d0/d1d/d7/l86 0 2024-04-25T13:47:14.162 INFO:tasks.workunit.client.0.smithi043.stdout:8/936: creat db/dc/d21/db4/dbe/f12e x:0 0 0 2024-04-25T13:47:14.164 INFO:tasks.workunit.client.0.smithi043.stdout:9/409: creat d0/d1d/fa0 x:0 0 0 2024-04-25T13:47:14.166 INFO:tasks.workunit.client.0.smithi043.stdout:6/923: dread d0/d1c/fb1 [0,4194304] 0 2024-04-25T13:47:14.168 INFO:tasks.workunit.client.0.smithi043.stdout:1/873: dread df/d31/d38/d43/faa [0,4194304] 0 2024-04-25T13:47:14.173 INFO:tasks.workunit.client.0.smithi043.stdout:8/937: dwrite db/d38/de4/faa [0,4194304] 0 2024-04-25T13:47:14.174 INFO:tasks.workunit.client.0.smithi043.stdout:1/874: fdatasync df/d31/d34/f6c 0 2024-04-25T13:47:14.176 INFO:tasks.workunit.client.0.smithi043.stdout:2/761: unlink d0/d34/d77/fba 0 2024-04-25T13:47:14.176 INFO:tasks.workunit.client.0.smithi043.stdout:1/875: chown df/d31/d38/d43/d6e/df9/f120 116917929 1 2024-04-25T13:47:14.177 INFO:tasks.workunit.client.0.smithi043.stdout:2/762: readlink d0/d5/d2f/ld5 0 2024-04-25T13:47:14.177 INFO:tasks.workunit.client.0.smithi043.stdout:4/835: rename d1/de/d1d/dfb/d10f to d1/d3/d54/d110 0 2024-04-25T13:47:14.178 INFO:tasks.workunit.client.0.smithi043.stdout:3/808: link d0/d9/d6e/d34/d36/d105/f116 d0/d9/f11c 0 2024-04-25T13:47:14.179 INFO:tasks.workunit.client.0.smithi043.stdout:8/938: dread db/d44/d8e/f3b [0,4194304] 0 2024-04-25T13:47:14.180 INFO:tasks.workunit.client.0.smithi043.stdout:1/876: creat df/d31/d34/d91/d138/d8c/f13b x:0 0 0 2024-04-25T13:47:14.188 INFO:tasks.workunit.client.0.smithi043.stdout:6/924: dwrite d0/d76/de3/d64/da1/f53 [0,4194304] 0 2024-04-25T13:47:14.191 INFO:tasks.workunit.client.0.smithi043.stdout:8/939: truncate db/fd 2929129 0 2024-04-25T13:47:14.193 INFO:tasks.workunit.client.0.smithi043.stdout:4/836: dwrite d1/d3/d7b/f7f [0,4194304] 0 2024-04-25T13:47:14.195 INFO:tasks.workunit.client.0.smithi043.stdout:2/763: mknod d0/d34/d77/ce9 0 2024-04-25T13:47:14.195 INFO:tasks.workunit.client.0.smithi043.stdout:6/925: write d0/d90/d48/ff8 [939919,11829] 0 2024-04-25T13:47:14.196 INFO:tasks.workunit.client.0.smithi043.stdout:1/877: dwrite df/d31/f79 [0,4194304] 0 2024-04-25T13:47:14.199 INFO:tasks.workunit.client.0.smithi043.stdout:6/926: stat d0/d90/db0/c106 0 2024-04-25T13:47:14.201 INFO:tasks.workunit.client.0.smithi043.stdout:3/809: dread d0/d13/d55/dd9/df5/f84 [0,4194304] 0 2024-04-25T13:47:14.204 INFO:tasks.workunit.client.0.smithi043.stdout:1/878: creat df/d31/d38/d43/dbc/f13c x:0 0 0 2024-04-25T13:47:14.204 INFO:tasks.workunit.client.0.smithi043.stdout:4/837: mknod d1/de/d1d/c111 0 2024-04-25T13:47:14.209 INFO:tasks.workunit.client.0.smithi043.stdout:4/838: stat d1/de/df/d1a/d49/lab 0 2024-04-25T13:47:14.209 INFO:tasks.workunit.client.0.smithi043.stdout:8/940: symlink db/d7d/df2/l12f 0 2024-04-25T13:47:14.217 INFO:tasks.workunit.client.0.smithi043.stdout:8/941: dwrite db/dc/f48 [0,4194304] 0 2024-04-25T13:47:14.218 INFO:tasks.workunit.client.0.smithi043.stdout:3/810: creat d0/d13/d5a/d90/f11d x:0 0 0 2024-04-25T13:47:14.222 INFO:tasks.workunit.client.0.smithi043.stdout:8/942: fdatasync db/d7d/fec 0 2024-04-25T13:47:14.222 INFO:tasks.workunit.client.0.smithi043.stdout:3/811: stat d0/da/f48 0 2024-04-25T13:47:14.223 INFO:tasks.workunit.client.0.smithi043.stdout:3/812: chown d0/d13/d55/dd9 14930 1 2024-04-25T13:47:14.227 INFO:tasks.workunit.client.0.smithi043.stdout:3/813: creat d0/da/dcc/f11e x:0 0 0 2024-04-25T13:47:14.228 INFO:tasks.workunit.client.0.smithi043.stdout:8/943: rmdir db/d38/d77 39 2024-04-25T13:47:14.230 INFO:tasks.workunit.client.0.smithi043.stdout:3/814: write d0/d9/d6e/d34/f111 [446301,14842] 0 2024-04-25T13:47:14.232 INFO:tasks.workunit.client.0.smithi043.stdout:1/879: dwrite f2 [0,4194304] 0 2024-04-25T13:47:14.233 INFO:tasks.workunit.client.0.smithi043.stdout:4/839: read d1/d3/d54/d62/d77/d92/f9b [838129,27194] 0 2024-04-25T13:47:14.235 INFO:tasks.workunit.client.0.smithi043.stdout:1/880: symlink df/d31/d34/d91/d138/d8c/d121/l13d 0 2024-04-25T13:47:14.239 INFO:tasks.workunit.client.0.smithi043.stdout:4/840: mkdir d1/d3/d54/d110/d112 0 2024-04-25T13:47:14.240 INFO:tasks.workunit.client.0.smithi043.stdout:1/881: mkdir df/d31/d34/d91/d138/d8c/d13e 0 2024-04-25T13:47:14.240 INFO:tasks.workunit.client.0.smithi043.stdout:3/815: write d0/d9/d6e/d34/d36/d105/f116 [843484,43010] 0 2024-04-25T13:47:14.243 INFO:tasks.workunit.client.0.smithi043.stdout:8/944: link db/dc/l41 db/dc/l130 0 2024-04-25T13:47:14.243 INFO:tasks.workunit.client.0.smithi043.stdout:4/841: creat d1/d34/d35/f113 x:0 0 0 2024-04-25T13:47:14.246 INFO:tasks.workunit.client.0.smithi043.stdout:8/945: dread db/fc4 [0,4194304] 0 2024-04-25T13:47:14.246 INFO:tasks.workunit.client.0.smithi043.stdout:6/927: dread d0/fe [0,4194304] 0 2024-04-25T13:47:14.246 INFO:tasks.workunit.client.0.smithi043.stdout:1/882: getdents df/d14 0 2024-04-25T13:47:14.247 INFO:tasks.workunit.client.0.smithi043.stdout:4/842: chown d1/de/df/db4/d36/d53/d66/lb0 1298457793 1 2024-04-25T13:47:14.248 INFO:tasks.workunit.client.0.smithi043.stdout:8/946: chown db/c103 513707247 1 2024-04-25T13:47:14.249 INFO:tasks.workunit.client.0.smithi043.stdout:6/928: chown d0/l85 436 1 2024-04-25T13:47:14.251 INFO:tasks.workunit.client.0.smithi043.stdout:4/843: mkdir d1/d3/d54/d62/d77/d79/d114 0 2024-04-25T13:47:14.256 INFO:tasks.workunit.client.0.smithi043.stdout:4/844: creat d1/de/df/db4/d36/d53/d66/d94/f115 x:0 0 0 2024-04-25T13:47:14.256 INFO:tasks.workunit.client.0.smithi043.stdout:6/929: write d0/d3d/d109/f7e [377486,124] 0 2024-04-25T13:47:14.258 INFO:tasks.workunit.client.0.smithi043.stdout:4/845: truncate d1/d3/d54/d62/dba/fdb 5195912 0 2024-04-25T13:47:14.260 INFO:tasks.workunit.client.0.smithi043.stdout:6/930: dread d0/fbe [0,4194304] 0 2024-04-25T13:47:14.260 INFO:tasks.workunit.client.0.smithi043.stdout:1/883: write df/d31/d34/d8b/f99 [385766,66958] 0 2024-04-25T13:47:14.261 INFO:tasks.workunit.client.0.smithi043.stdout:4/846: write d1/de/df/d1e/fec [654269,76113] 0 2024-04-25T13:47:14.262 INFO:tasks.workunit.client.0.smithi043.stdout:4/847: fdatasync d1/de/d1d/d20/fe5 0 2024-04-25T13:47:14.264 INFO:tasks.workunit.client.0.smithi043.stdout:6/931: mkdir d0/d3d/d6e/d71/d131 0 2024-04-25T13:47:14.267 INFO:tasks.workunit.client.0.smithi043.stdout:3/816: dread d0/d9/d6e/d38/d3f/f8a [0,4194304] 0 2024-04-25T13:47:14.268 INFO:tasks.workunit.client.0.smithi043.stdout:1/884: getdents df/d14 0 2024-04-25T13:47:14.268 INFO:tasks.workunit.client.0.smithi043.stdout:7/997: rename d5/d75/d79/fd1 to d5/d11/d3b/d8b/d9b/d144/f14c 0 2024-04-25T13:47:14.270 INFO:tasks.workunit.client.0.smithi043.stdout:6/932: fsync d0/d76/fd8 0 2024-04-25T13:47:14.272 INFO:tasks.workunit.client.0.smithi043.stdout:1/885: write df/d10/f12 [4211466,17835] 0 2024-04-25T13:47:14.273 INFO:tasks.workunit.client.0.smithi043.stdout:5/795: rename d1/d3/d7/d2f/d80/db5 to d1/d3/d7/d8/df/d28/dfc/d103 0 2024-04-25T13:47:14.275 INFO:tasks.workunit.client.0.smithi043.stdout:6/933: dread d0/d3d/d54/f57 [0,4194304] 0 2024-04-25T13:47:14.276 INFO:tasks.workunit.client.0.smithi043.stdout:6/934: fdatasync d0/d3d/d6e/fb7 0 2024-04-25T13:47:14.276 INFO:tasks.workunit.client.0.smithi043.stdout:3/817: mknod d0/da/db9/df7/dfe/c11f 0 2024-04-25T13:47:14.279 INFO:tasks.workunit.client.0.smithi043.stdout:5/796: symlink d1/d3/d24/d7c/l104 0 2024-04-25T13:47:14.283 INFO:tasks.workunit.client.0.smithi043.stdout:3/818: readlink d0/d9/l9c 0 2024-04-25T13:47:14.286 INFO:tasks.workunit.client.0.smithi043.stdout:7/998: dread d5/d11/d3b/f70 [0,4194304] 0 2024-04-25T13:47:14.289 INFO:tasks.workunit.client.0.smithi043.stdout:6/935: creat d0/f132 x:0 0 0 2024-04-25T13:47:14.290 INFO:tasks.workunit.client.0.smithi043.stdout:5/797: write d1/d3/d7/d8/da/d11/d52/f59 [1130038,44440] 0 2024-04-25T13:47:14.292 INFO:tasks.workunit.client.0.smithi043.stdout:7/999: link d5/d11/d3b/d61/dc5/dee/d116/d11e/f125 d5/d11/d3b/d61/dc5/dee/d116/d11e/f14d 0 2024-04-25T13:47:14.293 INFO:tasks.workunit.client.0.smithi043.stdout:6/936: fsync d0/fa4 0 2024-04-25T13:47:14.294 INFO:tasks.workunit.client.0.smithi043.stdout:8/947: rename db/d38/f7f to db/d38/d3c/f131 0 2024-04-25T13:47:14.296 INFO:tasks.workunit.client.0.smithi043.stdout:5/798: creat d1/d3/d7/d8/f105 x:0 0 0 2024-04-25T13:47:14.298 INFO:tasks.workunit.client.0.smithi043.stdout:4/848: dread d1/d3/d54/d110/fd7 [0,4194304] 0 2024-04-25T13:47:14.298 INFO:tasks.workunit.client.0.smithi043.stdout:1/886: rename df/d10/d22/f88 to df/d31/d34/d91/d138/d8c/d13e/f13f 0 2024-04-25T13:47:14.300 INFO:tasks.workunit.client.0.smithi043.stdout:6/937: mknod d0/d76/de3/d64/dc7/c133 0 2024-04-25T13:47:14.300 INFO:tasks.workunit.client.0.smithi043.stdout:5/799: mkdir d1/d4/d92/d106 0 2024-04-25T13:47:14.301 INFO:tasks.workunit.client.0.smithi043.stdout:4/849: fdatasync d1/d3/d54/d62/d77/fbf 0 2024-04-25T13:47:14.302 INFO:tasks.workunit.client.0.smithi043.stdout:1/887: mkdir df/d31/d38/d43/d53/d140 0 2024-04-25T13:47:14.304 INFO:tasks.workunit.client.0.smithi043.stdout:0/896: sync 2024-04-25T13:47:14.305 INFO:tasks.workunit.client.0.smithi043.stdout:6/938: fdatasync d0/d76/de3/fba 0 2024-04-25T13:47:14.306 INFO:tasks.workunit.client.0.smithi043.stdout:1/888: truncate df/d10/fa6 685975 0 2024-04-25T13:47:14.306 INFO:tasks.workunit.client.0.smithi043.stdout:4/850: mknod d1/d3/d8f/c116 0 2024-04-25T13:47:14.309 INFO:tasks.workunit.client.0.smithi043.stdout:3/819: dread d0/d9/f45 [0,4194304] 0 2024-04-25T13:47:14.309 INFO:tasks.workunit.client.0.smithi043.stdout:1/889: mkdir df/d31/dc7/dc8/d141 0 2024-04-25T13:47:14.311 INFO:tasks.workunit.client.0.smithi043.stdout:4/851: write d1/de/d1d/d20/f52 [2045106,126923] 0 2024-04-25T13:47:14.311 INFO:tasks.workunit.client.0.smithi043.stdout:3/820: chown d0/l8 2 1 2024-04-25T13:47:14.311 INFO:tasks.workunit.client.0.smithi043.stdout:6/939: write d0/d90/f45 [121472,68104] 0 2024-04-25T13:47:14.313 INFO:tasks.workunit.client.0.smithi043.stdout:3/821: readlink d0/d13/d55/l10b 0 2024-04-25T13:47:14.316 INFO:tasks.workunit.client.0.smithi043.stdout:6/940: write d0/f16 [3548340,22961] 0 2024-04-25T13:47:14.317 INFO:tasks.workunit.client.0.smithi043.stdout:0/897: dread db/d1b/d94/fd5 [0,4194304] 0 2024-04-25T13:47:14.320 INFO:tasks.workunit.client.0.smithi043.stdout:8/948: dread db/d11/f3d [0,4194304] 0 2024-04-25T13:47:14.320 INFO:tasks.workunit.client.0.smithi043.stdout:3/822: symlink d0/l120 0 2024-04-25T13:47:14.322 INFO:tasks.workunit.client.0.smithi043.stdout:6/941: readlink d0/d76/de3/d64/da1/da3/lb3 0 2024-04-25T13:47:14.326 INFO:tasks.workunit.client.0.smithi043.stdout:4/852: dwrite d1/d3/d54/d62/d77/fdc [0,4194304] 0 2024-04-25T13:47:14.326 INFO:tasks.workunit.client.0.smithi043.stdout:5/800: creat d1/d3/d7/d9/d2d/d36/f107 x:0 0 0 2024-04-25T13:47:14.326 INFO:tasks.workunit.client.0.smithi043.stdout:0/898: unlink db/d1b/d23/d27/d39/f123 0 2024-04-25T13:47:14.330 INFO:tasks.workunit.client.0.smithi043.stdout:1/890: dwrite df/d10/d22/f58 [0,4194304] 0 2024-04-25T13:47:14.336 INFO:tasks.workunit.client.0.smithi043.stdout:6/942: getdents d0/d90 0 2024-04-25T13:47:14.338 INFO:tasks.workunit.client.0.smithi043.stdout:5/801: dwrite d1/d4/f7a [0,4194304] 0 2024-04-25T13:47:14.342 INFO:tasks.workunit.client.0.smithi043.stdout:1/891: dwrite df/d31/d34/d91/d138/f136 [0,4194304] 0 2024-04-25T13:47:14.343 INFO:tasks.workunit.client.0.smithi043.stdout:3/823: symlink d0/d13/d55/dd9/df5/d8e/l121 0 2024-04-25T13:47:14.348 INFO:tasks.workunit.client.0.smithi043.stdout:5/802: getdents d1/d3/d7/d2f 0 2024-04-25T13:47:14.349 INFO:tasks.workunit.client.0.smithi043.stdout:5/803: readlink d1/d3/d24/d7c/lea 0 2024-04-25T13:47:14.353 INFO:tasks.workunit.client.0.smithi043.stdout:3/824: link d0/d9/d6e/d34/d36/d57/cb7 d0/d9/d6e/d34/d36/c122 0 2024-04-25T13:47:14.355 INFO:tasks.workunit.client.0.smithi043.stdout:4/853: rename d1/de/df/db4/d36 to d1/de/df/d117 0 2024-04-25T13:47:14.356 INFO:tasks.workunit.client.0.smithi043.stdout:0/899: rename db/d1b/d62/d72 to db/d1b/d62/d72/da2/d105/d12e 22 2024-04-25T13:47:14.361 INFO:tasks.workunit.client.0.smithi043.stdout:5/804: getdents d1/d3/d7/d8/df/dfe/d6e/da3 0 2024-04-25T13:47:14.370 INFO:tasks.workunit.client.0.smithi043.stdout:0/900: dread db/d25/f2b [0,4194304] 0 2024-04-25T13:47:14.372 INFO:tasks.workunit.client.0.smithi043.stdout:5/805: dread d1/d3/d7/d8/df/d28/faf [0,4194304] 0 2024-04-25T13:47:14.372 INFO:tasks.workunit.client.0.smithi043.stdout:8/949: link db/fc4 db/d38/f132 0 2024-04-25T13:47:14.372 INFO:tasks.workunit.client.0.smithi043.stdout:0/901: write db/d1b/d94/da1/de2/f11b [116120,49179] 0 2024-04-25T13:47:14.374 INFO:tasks.workunit.client.0.smithi043.stdout:0/902: dread db/d1b/d23/d27/d98/de4/f109 [0,4194304] 0 2024-04-25T13:47:14.375 INFO:tasks.workunit.client.0.smithi043.stdout:5/806: mknod d1/d3/d7/d9/c108 0 2024-04-25T13:47:14.388 INFO:tasks.workunit.client.0.smithi043.stdout:0/903: mkdir db/d25/d2a/d3f/d6a/d127/d129/d12f 0 2024-04-25T13:47:14.390 INFO:tasks.workunit.client.0.smithi043.stdout:6/943: rename d0/d76/d5c/d10e/fd2 to d0/d76/de3/da7/dc3/f134 0 2024-04-25T13:47:14.391 INFO:tasks.workunit.client.0.smithi043.stdout:6/944: chown d0/d90/db0/fc2 0 1 2024-04-25T13:47:14.398 INFO:tasks.workunit.client.0.smithi043.stdout:1/892: dread f2 [4194304,4194304] 0 2024-04-25T13:47:14.402 INFO:tasks.workunit.client.0.smithi043.stdout:1/893: creat df/d14/f142 x:0 0 0 2024-04-25T13:47:14.403 INFO:tasks.workunit.client.0.smithi043.stdout:0/904: chown db/d1b/d36/c92 237747 1 2024-04-25T13:47:14.404 INFO:tasks.workunit.client.0.smithi043.stdout:1/894: symlink df/d31/d38/d43/dbc/l143 0 2024-04-25T13:47:14.405 INFO:tasks.workunit.client.0.smithi043.stdout:6/945: symlink d0/d76/d5c/d128/l135 0 2024-04-25T13:47:14.406 INFO:tasks.workunit.client.0.smithi043.stdout:8/950: creat db/d38/de4/d8c/f133 x:0 0 0 2024-04-25T13:47:14.407 INFO:tasks.workunit.client.0.smithi043.stdout:6/946: chown d0/d3d/d109/d3a/l46 3 1 2024-04-25T13:47:14.407 INFO:tasks.workunit.client.0.smithi043.stdout:1/895: creat df/d31/d38/d43/d53/f144 x:0 0 0 2024-04-25T13:47:14.409 INFO:tasks.workunit.client.0.smithi043.stdout:1/896: symlink df/d10/d22/d2f/d9c/dbd/l145 0 2024-04-25T13:47:14.415 INFO:tasks.workunit.client.0.smithi043.stdout:1/897: dwrite df/d31/dc7/f123 [0,4194304] 0 2024-04-25T13:47:14.416 INFO:tasks.workunit.client.0.smithi043.stdout:8/951: truncate db/dc/d80/fd6 4738157 0 2024-04-25T13:47:14.420 INFO:tasks.workunit.client.0.smithi043.stdout:1/898: unlink df/d14/c15 0 2024-04-25T13:47:14.489 INFO:tasks.workunit.client.0.smithi043.stdout:4/854: rename d1/de/d1d/l43 to d1/d3/d54/d62/d77/dcd/l118 0 2024-04-25T13:47:14.490 INFO:tasks.workunit.client.0.smithi043.stdout:1/899: dread - df/d31/d34/d8b/fdf zero size 2024-04-25T13:47:14.492 INFO:tasks.workunit.client.0.smithi043.stdout:8/952: dwrite db/d11/d79/d81/f9a [4194304,4194304] 0 2024-04-25T13:47:14.494 INFO:tasks.workunit.client.0.smithi043.stdout:5/807: rename d1/d3/d7/d8/da/l79 to d1/d3/d7/d8/l109 0 2024-04-25T13:47:14.496 INFO:tasks.workunit.client.0.smithi043.stdout:5/808: stat d1/d4/d42/c93 0 2024-04-25T13:47:14.497 INFO:tasks.workunit.client.0.smithi043.stdout:5/809: chown d1/d3/d7/d8/da/f9d 1 1 2024-04-25T13:47:14.498 INFO:tasks.workunit.client.0.smithi043.stdout:4/855: getdents d1/de/d1d/d20 0 2024-04-25T13:47:14.500 INFO:tasks.workunit.client.0.smithi043.stdout:5/810: creat d1/d3/d7/d8/df/f10a x:0 0 0 2024-04-25T13:47:14.502 INFO:tasks.workunit.client.0.smithi043.stdout:5/811: mknod d1/d3/d7/d2f/d67/c10b 0 2024-04-25T13:47:14.503 INFO:tasks.workunit.client.0.smithi043.stdout:5/812: fdatasync d1/d3/d7/d8/fc2 0 2024-04-25T13:47:14.504 INFO:tasks.workunit.client.0.smithi043.stdout:5/813: fdatasync d1/d3/d7/d2f/fca 0 2024-04-25T13:47:14.508 INFO:tasks.workunit.client.0.smithi043.stdout:5/814: creat d1/d3/d7/d2f/d80/f10c x:0 0 0 2024-04-25T13:47:14.512 INFO:tasks.workunit.client.0.smithi043.stdout:4/856: dwrite d1/de/df/f41 [0,4194304] 0 2024-04-25T13:47:14.513 INFO:tasks.workunit.client.0.smithi043.stdout:5/815: creat d1/d3/d7/d8/df/dfe/f10d x:0 0 0 2024-04-25T13:47:14.516 INFO:tasks.workunit.client.0.smithi043.stdout:5/816: mknod d1/d3/d7/d9/d2d/c10e 0 2024-04-25T13:47:14.516 INFO:tasks.workunit.client.0.smithi043.stdout:5/817: fsync d1/d3/d24/f65 0 2024-04-25T13:47:14.518 INFO:tasks.workunit.client.0.smithi043.stdout:5/818: dread - d1/d8d/db8/fdf zero size 2024-04-25T13:47:14.527 INFO:tasks.workunit.client.0.smithi043.stdout:0/905: rename db/d1b/d94/da1/f10f to db/d1b/d94/d10d/f130 0 2024-04-25T13:47:14.530 INFO:tasks.workunit.client.0.smithi043.stdout:4/857: mknod d1/d3/d54/d62/d77/d92/dc5/c119 0 2024-04-25T13:47:14.531 INFO:tasks.workunit.client.0.smithi043.stdout:0/906: creat db/d25/d2a/d3f/d6a/d86/f131 x:0 0 0 2024-04-25T13:47:14.535 INFO:tasks.workunit.client.0.smithi043.stdout:5/819: dread d1/d3/d7/f23 [0,4194304] 0 2024-04-25T13:47:14.535 INFO:tasks.workunit.client.0.smithi043.stdout:0/907: mknod db/d1b/d23/d27/d39/d4c/c132 0 2024-04-25T13:47:14.536 INFO:tasks.workunit.client.0.smithi043.stdout:1/900: rename df/d31/d34/d91/d138/c110 to df/d14/c146 0 2024-04-25T13:47:14.536 INFO:tasks.workunit.client.0.smithi043.stdout:0/908: write db/f11c [208359,75019] 0 2024-04-25T13:47:14.538 INFO:tasks.workunit.client.0.smithi043.stdout:0/909: chown db/d1b/d94/d68/l9f 42487481 1 2024-04-25T13:47:14.538 INFO:tasks.workunit.client.0.smithi043.stdout:5/820: creat d1/d3/d7/d2f/df6/f10f x:0 0 0 2024-04-25T13:47:14.542 INFO:tasks.workunit.client.0.smithi043.stdout:4/858: readlink d1/d3/d54/d62/d77/d92/dc5/l8b 0 2024-04-25T13:47:14.542 INFO:tasks.workunit.client.0.smithi043.stdout:4/859: readlink d1/l61 0 2024-04-25T13:47:14.544 INFO:tasks.workunit.client.0.smithi043.stdout:5/821: write d1/d3/d62/f9f [3563508,65459] 0 2024-04-25T13:47:14.546 INFO:tasks.workunit.client.0.smithi043.stdout:4/860: fdatasync d1/d3/d54/d110/f84 0 2024-04-25T13:47:14.547 INFO:tasks.workunit.client.0.smithi043.stdout:1/901: dwrite df/d14/d63/d67/da7/fcb [0,4194304] 0 2024-04-25T13:47:14.550 INFO:tasks.workunit.client.0.smithi043.stdout:0/910: dwrite db/d1b/d23/d27/d39/d4c/f8e [0,4194304] 0 2024-04-25T13:47:14.551 INFO:tasks.workunit.client.0.smithi043.stdout:1/902: rmdir df/d31/d38/d43/d6e/df9 39 2024-04-25T13:47:14.552 INFO:tasks.workunit.client.0.smithi043.stdout:2/764: sync 2024-04-25T13:47:14.552 INFO:tasks.workunit.client.0.smithi043.stdout:9/410: sync 2024-04-25T13:47:14.553 INFO:tasks.workunit.client.0.smithi043.stdout:1/903: chown df/d10/f13 157 1 2024-04-25T13:47:14.553 INFO:tasks.workunit.client.0.smithi043.stdout:0/911: readlink db/d1b/d23/d27/d39/d4c/dbb/dc8/ld4 0 2024-04-25T13:47:14.556 INFO:tasks.workunit.client.0.smithi043.stdout:9/411: rmdir d0/d8b 39 2024-04-25T13:47:14.557 INFO:tasks.workunit.client.0.smithi043.stdout:8/953: rename db/dc/d21/d4e/d62/c113 to db/d46/da8/d10e/d11c/c134 0 2024-04-25T13:47:14.558 INFO:tasks.workunit.client.0.smithi043.stdout:1/904: mknod df/d10/d22/d2f/d9c/c147 0 2024-04-25T13:47:14.560 INFO:tasks.workunit.client.0.smithi043.stdout:2/765: mkdir d0/d34/d17/d5e/da9/dc3/dea 0 2024-04-25T13:47:14.561 INFO:tasks.workunit.client.0.smithi043.stdout:1/905: mkdir df/d31/d38/d43/dbc/d148 0 2024-04-25T13:47:14.564 INFO:tasks.workunit.client.0.smithi043.stdout:0/912: mknod db/d1b/c133 0 2024-04-25T13:47:14.568 INFO:tasks.workunit.client.0.smithi043.stdout:8/954: truncate db/d11/f20 5391532 0 2024-04-25T13:47:14.569 INFO:tasks.workunit.client.0.smithi043.stdout:0/913: creat db/d25/d2a/d3f/d6a/f134 x:0 0 0 2024-04-25T13:47:14.570 INFO:tasks.workunit.client.0.smithi043.stdout:2/766: unlink d0/d8/d9b/ddb/ca3 0 2024-04-25T13:47:14.573 INFO:tasks.workunit.client.0.smithi043.stdout:9/412: dwrite d0/d1d/d7/f16 [0,4194304] 0 2024-04-25T13:47:14.574 INFO:tasks.workunit.client.0.smithi043.stdout:4/861: rename d1/de/df/db4 to d1/d34/d83/d11a 0 2024-04-25T13:47:14.575 INFO:tasks.workunit.client.0.smithi043.stdout:0/914: rmdir db/d1b/d94/da1/de2 39 2024-04-25T13:47:14.578 INFO:tasks.workunit.client.0.smithi043.stdout:9/413: symlink d0/d1d/d7/la1 0 2024-04-25T13:47:14.581 INFO:tasks.workunit.client.0.smithi043.stdout:0/915: creat db/d1b/d36/d41/f135 x:0 0 0 2024-04-25T13:47:14.582 INFO:tasks.workunit.client.0.smithi043.stdout:5/822: dwrite d1/d3/d7/d9/d2d/d36/fe7 [0,4194304] 0 2024-04-25T13:47:14.584 INFO:tasks.workunit.client.0.smithi043.stdout:8/955: write db/d38/d3c/d71/d5d/fc1 [991730,25310] 0 2024-04-25T13:47:14.588 INFO:tasks.workunit.client.0.smithi043.stdout:6/947: sync 2024-04-25T13:47:14.588 INFO:tasks.workunit.client.0.smithi043.stdout:3/825: sync 2024-04-25T13:47:14.588 INFO:tasks.workunit.client.0.smithi043.stdout:6/948: stat d0/d3d/dc9/c124 0 2024-04-25T13:47:14.590 INFO:tasks.workunit.client.0.smithi043.stdout:2/767: mkdir d0/d34/d77/deb 0 2024-04-25T13:47:14.598 INFO:tasks.workunit.client.0.smithi043.stdout:6/949: dread - d0/d90/dd9/fe1 zero size 2024-04-25T13:47:14.600 INFO:tasks.workunit.client.0.smithi043.stdout:2/768: rmdir d0/d5/d2f 39 2024-04-25T13:47:14.600 INFO:tasks.workunit.client.0.smithi043.stdout:1/906: dread df/d31/d34/d91/d138/fac [0,4194304] 0 2024-04-25T13:47:14.601 INFO:tasks.workunit.client.0.smithi043.stdout:4/862: dwrite d1/d3/d54/d62/d77/d92/f9b [0,4194304] 0 2024-04-25T13:47:14.601 INFO:tasks.workunit.client.0.smithi043.stdout:0/916: write db/d1b/d23/d27/d39/d4c/dbb/fbd [518714,88073] 0 2024-04-25T13:47:14.603 INFO:tasks.workunit.client.0.smithi043.stdout:8/956: chown db/dc/d21/dc7/ce0 1944 1 2024-04-25T13:47:14.605 INFO:tasks.workunit.client.0.smithi043.stdout:9/414: read - d0/d8b/d26/d39/f3b zero size 2024-04-25T13:47:14.606 INFO:tasks.workunit.client.0.smithi043.stdout:5/823: creat d1/d3/d7/d8/df/dfe/f110 x:0 0 0 2024-04-25T13:47:14.609 INFO:tasks.workunit.client.0.smithi043.stdout:9/415: write d0/d1d/f29 [4049918,64288] 0 2024-04-25T13:47:14.609 INFO:tasks.workunit.client.0.smithi043.stdout:6/950: creat d0/d90/d10b/f136 x:0 0 0 2024-04-25T13:47:14.610 INFO:tasks.workunit.client.0.smithi043.stdout:2/769: creat d0/d34/d3f/d59/dbc/fec x:0 0 0 2024-04-25T13:47:14.611 INFO:tasks.workunit.client.0.smithi043.stdout:5/824: chown d1/d3/d7/d8/df/dfe/de2/cec 4 1 2024-04-25T13:47:14.615 INFO:tasks.workunit.client.0.smithi043.stdout:9/416: mkdir d0/d8b/d9b/da2 0 2024-04-25T13:47:14.616 INFO:tasks.workunit.client.0.smithi043.stdout:2/770: mknod d0/d34/d17/ced 0 2024-04-25T13:47:14.616 INFO:tasks.workunit.client.0.smithi043.stdout:0/917: dwrite db/f1d [0,4194304] 0 2024-04-25T13:47:14.617 INFO:tasks.workunit.client.0.smithi043.stdout:5/825: chown d1/d3/d7/d8/df/lbd 78751079 1 2024-04-25T13:47:14.617 INFO:tasks.workunit.client.0.smithi043.stdout:9/417: chown d0/d77/f94 1612707 1 2024-04-25T13:47:14.619 INFO:tasks.workunit.client.0.smithi043.stdout:0/918: write db/d1b/d23/d27/d39/d4c/f70 [2003080,27561] 0 2024-04-25T13:47:14.620 INFO:tasks.workunit.client.0.smithi043.stdout:4/863: link d1/lf3 d1/de/df/d117/d53/d66/d94/l11b 0 2024-04-25T13:47:14.620 INFO:tasks.workunit.client.0.smithi043.stdout:6/951: getdents d0/d76/d5c/d12b 0 2024-04-25T13:47:14.623 INFO:tasks.workunit.client.0.smithi043.stdout:6/952: write d0/d90/d4c/fec [4650031,117480] 0 2024-04-25T13:47:14.624 INFO:tasks.workunit.client.0.smithi043.stdout:8/957: write db/d7d/df2/f10b [1020389,106220] 0 2024-04-25T13:47:14.625 INFO:tasks.workunit.client.0.smithi043.stdout:8/958: fsync db/d46/da8/f100 0 2024-04-25T13:47:14.626 INFO:tasks.workunit.client.0.smithi043.stdout:0/919: write db/d25/d2a/d93/fb7 [5088475,74552] 0 2024-04-25T13:47:14.630 INFO:tasks.workunit.client.0.smithi043.stdout:6/953: mknod d0/d3d/d6e/c137 0 2024-04-25T13:47:14.633 INFO:tasks.workunit.client.0.smithi043.stdout:0/920: fdatasync db/f2d 0 2024-04-25T13:47:14.634 INFO:tasks.workunit.client.0.smithi043.stdout:6/954: dread - d0/d76/d5c/f75 zero size 2024-04-25T13:47:14.635 INFO:tasks.workunit.client.0.smithi043.stdout:2/771: mkdir d0/d34/d3f/d7b/dd4/dee 0 2024-04-25T13:47:14.635 INFO:tasks.workunit.client.0.smithi043.stdout:5/826: rmdir d1/d3/d7/d9/d2d/d36 39 2024-04-25T13:47:14.640 INFO:tasks.workunit.client.0.smithi043.stdout:5/827: dread - d1/d3/d7/d8/df/d28/fff zero size 2024-04-25T13:47:14.640 INFO:tasks.workunit.client.0.smithi043.stdout:8/959: dwrite db/dc/d28/f124 [0,4194304] 0 2024-04-25T13:47:14.641 INFO:tasks.workunit.client.0.smithi043.stdout:0/921: symlink db/d1b/d62/l136 0 2024-04-25T13:47:14.642 INFO:tasks.workunit.client.0.smithi043.stdout:6/955: mknod d0/d90/d48/c138 0 2024-04-25T13:47:14.645 INFO:tasks.workunit.client.0.smithi043.stdout:4/864: dwrite d1/d3/d54/d110/d33/f74 [0,4194304] 0 2024-04-25T13:47:14.645 INFO:tasks.workunit.client.0.smithi043.stdout:9/418: dread d0/d1d/d4a/f6a [0,4194304] 0 2024-04-25T13:47:14.646 INFO:tasks.workunit.client.0.smithi043.stdout:3/826: link d0/d9/d6e/d34/f80 d0/d13/dbe/f123 0 2024-04-25T13:47:14.647 INFO:tasks.workunit.client.0.smithi043.stdout:4/865: readlink d1/d3/l6 0 2024-04-25T13:47:14.648 INFO:tasks.workunit.client.0.smithi043.stdout:8/960: symlink db/d38/de4/d59/d7c/l135 0 2024-04-25T13:47:14.650 INFO:tasks.workunit.client.0.smithi043.stdout:0/922: rename db/d1b/d23/d27/d39/d4c/fe1 to db/d1b/d62/d72/da2/d105/f137 0 2024-04-25T13:47:14.650 INFO:tasks.workunit.client.0.smithi043.stdout:4/866: mknod d1/d3/d54/d62/c11c 0 2024-04-25T13:47:14.652 INFO:tasks.workunit.client.0.smithi043.stdout:2/772: mkdir d0/d34/d17/dc6/d5c/def 0 2024-04-25T13:47:14.654 INFO:tasks.workunit.client.0.smithi043.stdout:8/961: creat db/dc/d28/d104/f136 x:0 0 0 2024-04-25T13:47:14.654 INFO:tasks.workunit.client.0.smithi043.stdout:3/827: truncate d0/d9/d6e/d34/f8b 855149 0 2024-04-25T13:47:14.658 INFO:tasks.workunit.client.0.smithi043.stdout:6/956: rmdir d0/d1b/d77 39 2024-04-25T13:47:14.659 INFO:tasks.workunit.client.0.smithi043.stdout:5/828: dwrite d1/d3/d7/f23 [4194304,4194304] 0 2024-04-25T13:47:14.659 INFO:tasks.workunit.client.0.smithi043.stdout:0/923: write db/d1b/d23/d27/d39/d4c/dbb/fbd [1604176,49806] 0 2024-04-25T13:47:14.665 INFO:tasks.workunit.client.0.smithi043.stdout:9/419: dwrite d0/d8b/d26/d47/f65 [0,4194304] 0 2024-04-25T13:47:14.665 INFO:tasks.workunit.client.0.smithi043.stdout:8/962: rename db/dc/d28/l6a to db/d38/d40/l137 0 2024-04-25T13:47:14.670 INFO:tasks.workunit.client.0.smithi043.stdout:3/828: chown d0/da/db9/d9e 35 1 2024-04-25T13:47:14.670 INFO:tasks.workunit.client.0.smithi043.stdout:6/957: rename d0/d90/d4c/l10f to d0/d76/d5c/l139 0 2024-04-25T13:47:14.672 INFO:tasks.workunit.client.0.smithi043.stdout:2/773: write d0/d35/f5d [737453,75353] 0 2024-04-25T13:47:14.675 INFO:tasks.workunit.client.0.smithi043.stdout:9/420: write d0/d8b/f60 [23105,115850] 0 2024-04-25T13:47:14.675 INFO:tasks.workunit.client.0.smithi043.stdout:8/963: mknod db/dc/d21/db4/dbe/c138 0 2024-04-25T13:47:14.678 INFO:tasks.workunit.client.0.smithi043.stdout:0/924: rmdir db/d1b/d62/d72/da2/d105/d113 0 2024-04-25T13:47:14.679 INFO:tasks.workunit.client.0.smithi043.stdout:2/774: symlink d0/d34/d17/d5e/da9/lf0 0 2024-04-25T13:47:14.684 INFO:tasks.workunit.client.0.smithi043.stdout:3/829: read d0/d13/f73 [94238,111319] 0 2024-04-25T13:47:14.685 INFO:tasks.workunit.client.0.smithi043.stdout:2/775: read d0/d5/d1e/f52 [508251,73311] 0 2024-04-25T13:47:14.685 INFO:tasks.workunit.client.0.smithi043.stdout:6/958: write d0/d76/de3/f32 [1419192,111034] 0 2024-04-25T13:47:14.686 INFO:tasks.workunit.client.0.smithi043.stdout:2/776: write d0/d8/f8b [1210662,50451] 0 2024-04-25T13:47:14.688 INFO:tasks.workunit.client.0.smithi043.stdout:9/421: write d0/d8b/d9b/f56 [748253,102900] 0 2024-04-25T13:47:14.689 INFO:tasks.workunit.client.0.smithi043.stdout:8/964: write db/d44/d8e/f56 [4393490,28379] 0 2024-04-25T13:47:14.692 INFO:tasks.workunit.client.0.smithi043.stdout:0/925: link db/d1b/d62/d72/da2/f112 db/d1b/d23/d27/d39/d4c/da9/d117/f138 0 2024-04-25T13:47:14.692 INFO:tasks.workunit.client.0.smithi043.stdout:5/829: dread d1/d3/d24/d7c/f86 [0,4194304] 0 2024-04-25T13:47:14.695 INFO:tasks.workunit.client.0.smithi043.stdout:8/965: rmdir db/d11/d79 39 2024-04-25T13:47:14.696 INFO:tasks.workunit.client.0.smithi043.stdout:9/422: symlink d0/d1d/d7/la3 0 2024-04-25T13:47:14.698 INFO:tasks.workunit.client.0.smithi043.stdout:3/830: write d0/da/f28 [4940699,29979] 0 2024-04-25T13:47:14.699 INFO:tasks.workunit.client.0.smithi043.stdout:5/830: dread d1/d3/d7/d9/d2d/f94 [0,4194304] 0 2024-04-25T13:47:14.701 INFO:tasks.workunit.client.0.smithi043.stdout:4/867: link d1/d34/d83/lfd d1/de/df/d117/d9e/d9d/d3a/d10a/l11d 0 2024-04-25T13:47:14.702 INFO:tasks.workunit.client.0.smithi043.stdout:3/831: dread d0/d13/d55/dd9/df5/f84 [0,4194304] 0 2024-04-25T13:47:14.702 INFO:tasks.workunit.client.0.smithi043.stdout:8/966: stat db/d38/d3c/d11e 0 2024-04-25T13:47:14.703 INFO:tasks.workunit.client.0.smithi043.stdout:4/868: chown d1/de/df/f18 69924414 1 2024-04-25T13:47:14.705 INFO:tasks.workunit.client.0.smithi043.stdout:6/959: dread d0/d90/d48/fdb [0,4194304] 0 2024-04-25T13:47:14.705 INFO:tasks.workunit.client.0.smithi043.stdout:0/926: getdents db/d1b/d23/d27/d39/d4c/da9 0 2024-04-25T13:47:14.706 INFO:tasks.workunit.client.0.smithi043.stdout:9/423: creat d0/d8b/d26/d47/fa4 x:0 0 0 2024-04-25T13:47:14.706 INFO:tasks.workunit.client.0.smithi043.stdout:5/831: write d1/d3/d7/d8/df/dfe/fc9 [3416012,121312] 0 2024-04-25T13:47:14.708 INFO:tasks.workunit.client.0.smithi043.stdout:8/967: creat db/d46/da8/d10e/f139 x:0 0 0 2024-04-25T13:47:14.711 INFO:tasks.workunit.client.0.smithi043.stdout:6/960: mkdir d0/d76/de3/d64/da1/d13a 0 2024-04-25T13:47:14.712 INFO:tasks.workunit.client.0.smithi043.stdout:8/968: write db/d11/f3d [3608699,61501] 0 2024-04-25T13:47:14.713 INFO:tasks.workunit.client.0.smithi043.stdout:6/961: read d0/d90/d48/d9d/f11d [58687,62188] 0 2024-04-25T13:47:14.717 INFO:tasks.workunit.client.0.smithi043.stdout:6/962: symlink d0/d3d/d6e/d71/l13b 0 2024-04-25T13:47:14.718 INFO:tasks.workunit.client.0.smithi043.stdout:0/927: link db/d1b/d23/fe0 db/d1b/d23/d27/d39/d4c/f139 0 2024-04-25T13:47:14.721 INFO:tasks.workunit.client.0.smithi043.stdout:0/928: rmdir db/d1b/d62/d72 39 2024-04-25T13:47:14.721 INFO:tasks.workunit.client.0.smithi043.stdout:4/869: creat d1/de/df/d117/d9e/d9d/f11e x:0 0 0 2024-04-25T13:47:14.723 INFO:tasks.workunit.client.0.smithi043.stdout:4/870: dread - d1/d3/d7b/f10d zero size 2024-04-25T13:47:14.724 INFO:tasks.workunit.client.0.smithi043.stdout:6/963: dwrite d0/d76/de3/dd6/ff1 [0,4194304] 0 2024-04-25T13:47:14.727 INFO:tasks.workunit.client.0.smithi043.stdout:0/929: symlink db/d25/d2a/d3f/d6a/d127/d129/d12f/l13a 0 2024-04-25T13:47:14.728 INFO:tasks.workunit.client.0.smithi043.stdout:1/907: sync 2024-04-25T13:47:14.732 INFO:tasks.workunit.client.0.smithi043.stdout:1/908: truncate df/d31/d34/d8b/ddd/ffb 846615 0 2024-04-25T13:47:14.738 INFO:tasks.workunit.client.0.smithi043.stdout:2/777: link d0/d35/l3d d0/d34/d17/dc6/d36/lf1 0 2024-04-25T13:47:14.740 INFO:tasks.workunit.client.0.smithi043.stdout:0/930: truncate db/d25/d2a/fb6 3202474 0 2024-04-25T13:47:14.741 INFO:tasks.workunit.client.0.smithi043.stdout:9/424: link d0/d8b/d26/d39/c3c d0/d1d/d22/ca5 0 2024-04-25T13:47:14.744 INFO:tasks.workunit.client.0.smithi043.stdout:2/778: creat d0/d26/ff2 x:0 0 0 2024-04-25T13:47:14.745 INFO:tasks.workunit.client.0.smithi043.stdout:9/425: dread - d0/d8b/d26/d39/f8d zero size 2024-04-25T13:47:14.747 INFO:tasks.workunit.client.0.smithi043.stdout:1/909: dread df/d31/d38/d43/d53/f70 [0,4194304] 0 2024-04-25T13:47:14.747 INFO:tasks.workunit.client.0.smithi043.stdout:6/964: dread d0/d76/de3/d64/ffe [0,4194304] 0 2024-04-25T13:47:14.750 INFO:tasks.workunit.client.0.smithi043.stdout:3/832: rename d0/da/db9/df9/f104 to d0/d13/d5a/f124 0 2024-04-25T13:47:14.750 INFO:tasks.workunit.client.0.smithi043.stdout:5/832: link d1/d3/d7/d8/df/ce5 d1/d3/d62/c111 0 2024-04-25T13:47:14.751 INFO:tasks.workunit.client.0.smithi043.stdout:2/779: symlink d0/d26/lf3 0 2024-04-25T13:47:14.754 INFO:tasks.workunit.client.0.smithi043.stdout:4/871: dwrite d1/de/df/d117/d9e/d9d/d3a/f48 [4194304,4194304] 0 2024-04-25T13:47:14.754 INFO:tasks.workunit.client.0.smithi043.stdout:9/426: chown d0/d1d/d7/l17 2061618 1 2024-04-25T13:47:14.755 INFO:tasks.workunit.client.0.smithi043.stdout:6/965: write d0/d90/d48/fdb [4009269,11694] 0 2024-04-25T13:47:14.757 INFO:tasks.workunit.client.0.smithi043.stdout:1/910: fdatasync df/d31/d38/d43/d53/fe9 0 2024-04-25T13:47:14.758 INFO:tasks.workunit.client.0.smithi043.stdout:5/833: mkdir d1/d4/d42/d112 0 2024-04-25T13:47:14.759 INFO:tasks.workunit.client.0.smithi043.stdout:6/966: dread - d0/d76/fd8 zero size 2024-04-25T13:47:14.761 INFO:tasks.workunit.client.0.smithi043.stdout:9/427: readlink d0/le 0 2024-04-25T13:47:14.761 INFO:tasks.workunit.client.0.smithi043.stdout:3/833: getdents d0/d9 0 2024-04-25T13:47:14.762 INFO:tasks.workunit.client.0.smithi043.stdout:2/780: creat d0/d5/d2f/d8d/ff4 x:0 0 0 2024-04-25T13:47:14.764 INFO:tasks.workunit.client.0.smithi043.stdout:2/781: fsync d0/d34/faf 0 2024-04-25T13:47:14.765 INFO:tasks.workunit.client.0.smithi043.stdout:4/872: mkdir d1/de/df/d117/d53/d66/d94/d11f 0 2024-04-25T13:47:14.767 INFO:tasks.workunit.client.0.smithi043.stdout:6/967: chown d0/d76/de3/d64/da1/d13a 35031 1 2024-04-25T13:47:14.767 INFO:tasks.workunit.client.0.smithi043.stdout:9/428: dread - d0/d8b/d26/d47/d52/f80 zero size 2024-04-25T13:47:14.768 INFO:tasks.workunit.client.0.smithi043.stdout:0/931: dread db/d1b/d23/d27/d39/d4c/f77 [0,4194304] 0 2024-04-25T13:47:14.769 INFO:tasks.workunit.client.0.smithi043.stdout:6/968: stat d0/d90/f4e 0 2024-04-25T13:47:14.769 INFO:tasks.workunit.client.0.smithi043.stdout:3/834: creat d0/da/db9/df9/f125 x:0 0 0 2024-04-25T13:47:14.773 INFO:tasks.workunit.client.0.smithi043.stdout:1/911: link df/d10/d22/f5f df/d14/d3d/d114/d11b/f149 0 2024-04-25T13:47:14.774 INFO:tasks.workunit.client.0.smithi043.stdout:4/873: creat d1/d3/d54/d110/d33/f120 x:0 0 0 2024-04-25T13:47:14.775 INFO:tasks.workunit.client.0.smithi043.stdout:5/834: dwrite d1/d3/f81 [0,4194304] 0 2024-04-25T13:47:14.776 INFO:tasks.workunit.client.0.smithi043.stdout:9/429: symlink d0/d8b/d26/d47/la6 0 2024-04-25T13:47:14.777 INFO:tasks.workunit.client.0.smithi043.stdout:0/932: creat db/d1b/d23/d27/d39/d4c/dbb/dc8/f13b x:0 0 0 2024-04-25T13:47:14.779 INFO:tasks.workunit.client.0.smithi043.stdout:4/874: dread - d1/d3/d54/d62/dba/f106 zero size 2024-04-25T13:47:14.780 INFO:tasks.workunit.client.0.smithi043.stdout:8/969: rename db/dc/d21/db4/dbe/lea to db/d11/da1/l13a 0 2024-04-25T13:47:14.781 INFO:tasks.workunit.client.0.smithi043.stdout:5/835: mkdir d1/d4/d92/d95/d113 0 2024-04-25T13:47:14.782 INFO:tasks.workunit.client.0.smithi043.stdout:0/933: symlink db/d25/d2a/d93/l13c 0 2024-04-25T13:47:14.783 INFO:tasks.workunit.client.0.smithi043.stdout:6/969: dwrite d0/d76/de3/da7/fe8 [0,4194304] 0 2024-04-25T13:47:14.784 INFO:tasks.workunit.client.0.smithi043.stdout:1/912: creat df/d14/d3d/f14a x:0 0 0 2024-04-25T13:47:14.786 INFO:tasks.workunit.client.0.smithi043.stdout:4/875: symlink d1/de/df/d117/d9e/d9d/d3a/l121 0 2024-04-25T13:47:14.787 INFO:tasks.workunit.client.0.smithi043.stdout:8/970: write db/d11/d79/d81/f9a [1433473,27557] 0 2024-04-25T13:47:14.796 INFO:tasks.workunit.client.0.smithi043.stdout:5/836: dwrite d1/d3/d7/d8/da/d11/d52/f59 [0,4194304] 0 2024-04-25T13:47:14.796 INFO:tasks.workunit.client.0.smithi043.stdout:8/971: fsync db/dc/f2f 0 2024-04-25T13:47:14.797 INFO:tasks.workunit.client.0.smithi043.stdout:1/913: symlink df/d14/d63/d67/da7/l14b 0 2024-04-25T13:47:14.798 INFO:tasks.workunit.client.0.smithi043.stdout:9/430: getdents d0/d8b/d26/d47 0 2024-04-25T13:47:14.800 INFO:tasks.workunit.client.0.smithi043.stdout:1/914: creat df/d31/dc7/f14c x:0 0 0 2024-04-25T13:47:14.805 INFO:tasks.workunit.client.0.smithi043.stdout:9/431: mkdir d0/da7 0 2024-04-25T13:47:14.806 INFO:tasks.workunit.client.0.smithi043.stdout:8/972: truncate db/d7d/df2/fff 510957 0 2024-04-25T13:47:14.808 INFO:tasks.workunit.client.0.smithi043.stdout:1/915: read df/d31/d38/d43/d81/fe5 [688609,24835] 0 2024-04-25T13:47:14.810 INFO:tasks.workunit.client.0.smithi043.stdout:3/835: link d0/d9/cbf d0/d9/d6e/d38/d3f/dc7/c126 0 2024-04-25T13:47:14.811 INFO:tasks.workunit.client.0.smithi043.stdout:4/876: creat d1/de/df/d117/d9e/d9d/f122 x:0 0 0 2024-04-25T13:47:14.812 INFO:tasks.workunit.client.0.smithi043.stdout:5/837: getdents d1/d3/d7/d8/da/d11 0 2024-04-25T13:47:14.814 INFO:tasks.workunit.client.0.smithi043.stdout:0/934: getdents db/d25/d2a/d3f/d6a/dd3 0 2024-04-25T13:47:14.815 INFO:tasks.workunit.client.0.smithi043.stdout:9/432: dread d0/d1d/d22/f43 [0,4194304] 0 2024-04-25T13:47:14.817 INFO:tasks.workunit.client.0.smithi043.stdout:1/916: symlink df/d31/d34/l14d 0 2024-04-25T13:47:14.819 INFO:tasks.workunit.client.0.smithi043.stdout:4/877: mkdir d1/de/df/d117/d123 0 2024-04-25T13:47:14.821 INFO:tasks.workunit.client.0.smithi043.stdout:3/836: write d0/d13/d5a/f124 [800924,92490] 0 2024-04-25T13:47:14.821 INFO:tasks.workunit.client.0.smithi043.stdout:0/935: creat db/d1b/d23/d27/d98/de4/f13d x:0 0 0 2024-04-25T13:47:14.821 INFO:tasks.workunit.client.0.smithi043.stdout:1/917: mknod df/d10/d22/c14e 0 2024-04-25T13:47:14.822 INFO:tasks.workunit.client.0.smithi043.stdout:9/433: rmdir d0/d8b 39 2024-04-25T13:47:14.826 INFO:tasks.workunit.client.0.smithi043.stdout:5/838: dwrite d1/d3/d7/d8/da/d11/d52/f59 [0,4194304] 0 2024-04-25T13:47:14.827 INFO:tasks.workunit.client.0.smithi043.stdout:3/837: write d0/d9/f11c [263712,31915] 0 2024-04-25T13:47:14.827 INFO:tasks.workunit.client.0.smithi043.stdout:1/918: mknod df/d31/d38/dbb/c14f 0 2024-04-25T13:47:14.831 INFO:tasks.workunit.client.0.smithi043.stdout:1/919: mkdir df/d31/dc7/dc8/d150 0 2024-04-25T13:47:14.831 INFO:tasks.workunit.client.0.smithi043.stdout:5/839: read d1/d3/d7/d2f/d80/fcc [152589,8446] 0 2024-04-25T13:47:14.837 INFO:tasks.workunit.client.0.smithi043.stdout:8/973: dread db/d11/f15 [0,4194304] 0 2024-04-25T13:47:14.838 INFO:tasks.workunit.client.0.smithi043.stdout:3/838: creat d0/f127 x:0 0 0 2024-04-25T13:47:14.839 INFO:tasks.workunit.client.0.smithi043.stdout:0/936: truncate db/d1b/d23/d27/d39/d4c/f70 2329554 0 2024-04-25T13:47:14.839 INFO:tasks.workunit.client.0.smithi043.stdout:6/970: rename d0/d90/dd9/d101 to d0/d1b/d77/d13c 0 2024-04-25T13:47:14.841 INFO:tasks.workunit.client.0.smithi043.stdout:5/840: dwrite d1/d3/d7/d8/fc2 [0,4194304] 0 2024-04-25T13:47:14.844 INFO:tasks.workunit.client.0.smithi043.stdout:5/841: stat d1/d3/d26 0 2024-04-25T13:47:14.844 INFO:tasks.workunit.client.0.smithi043.stdout:8/974: unlink db/d38/de4/d59/d7c/lfe 0 2024-04-25T13:47:14.850 INFO:tasks.workunit.client.0.smithi043.stdout:8/975: mkdir db/d44/d13b 0 2024-04-25T13:47:14.855 INFO:tasks.workunit.client.0.smithi043.stdout:0/937: truncate db/fc 211663 0 2024-04-25T13:47:14.856 INFO:tasks.workunit.client.0.smithi043.stdout:5/842: creat d1/d3/d7/d8/df/dfe/de2/f114 x:0 0 0 2024-04-25T13:47:14.860 INFO:tasks.workunit.client.0.smithi043.stdout:3/839: stat d0/d9/d6e/d34/d36/d57/l115 0 2024-04-25T13:47:14.860 INFO:tasks.workunit.client.0.smithi043.stdout:1/920: mkdir df/d14/d63/d67/da7/d151 0 2024-04-25T13:47:14.861 INFO:tasks.workunit.client.0.smithi043.stdout:5/843: mkdir d1/d3/d7/de1/d115 0 2024-04-25T13:47:14.861 INFO:tasks.workunit.client.0.smithi043.stdout:3/840: chown d0/da/db9 1073326202 1 2024-04-25T13:47:14.863 INFO:tasks.workunit.client.0.smithi043.stdout:8/976: chown db/dc/d28/l117 17 1 2024-04-25T13:47:14.864 INFO:tasks.workunit.client.0.smithi043.stdout:1/921: fdatasync df/d10/fa6 0 2024-04-25T13:47:14.865 INFO:tasks.workunit.client.0.smithi043.stdout:5/844: mkdir d1/d3/d7/d2f/d67/d116 0 2024-04-25T13:47:14.871 INFO:tasks.workunit.client.0.smithi043.stdout:3/841: mknod d0/d9/d6e/d34/c128 0 2024-04-25T13:47:14.876 INFO:tasks.workunit.client.0.smithi043.stdout:4/878: rename d1/d3/d54/le6 to d1/de/df/d117/d53/d66/d94/d11f/l124 0 2024-04-25T13:47:14.878 INFO:tasks.workunit.client.0.smithi043.stdout:8/977: truncate db/d38/d77/f105 1651461 0 2024-04-25T13:47:14.878 INFO:tasks.workunit.client.0.smithi043.stdout:0/938: mkdir db/d1b/d23/d27/d39/d4b/d13e 0 2024-04-25T13:47:14.879 INFO:tasks.workunit.client.0.smithi043.stdout:9/434: rename d0/d1d/d7/d41/c6b to d0/d8b/d9b/da2/ca8 0 2024-04-25T13:47:14.879 INFO:tasks.workunit.client.0.smithi043.stdout:0/939: write db/d1b/d23/d27/f5c [3025841,119546] 0 2024-04-25T13:47:14.883 INFO:tasks.workunit.client.0.smithi043.stdout:0/940: dread db/d1b/d23/d27/d39/d4c/da9/d117/f128 [0,4194304] 0 2024-04-25T13:47:14.884 INFO:tasks.workunit.client.0.smithi043.stdout:9/435: creat d0/d8b/d26/d47/fa9 x:0 0 0 2024-04-25T13:47:14.885 INFO:tasks.workunit.client.0.smithi043.stdout:6/971: rename d0/d76/fd8 to d0/d3d/dc9/f13d 0 2024-04-25T13:47:14.891 INFO:tasks.workunit.client.0.smithi043.stdout:4/879: truncate d1/de/df/f41 319620 0 2024-04-25T13:47:14.896 INFO:tasks.workunit.client.0.smithi043.stdout:9/436: creat d0/d1d/d22/d67/faa x:0 0 0 2024-04-25T13:47:14.900 INFO:tasks.workunit.client.0.smithi043.stdout:3/842: mkdir d0/d13/d55/dd9/df5/d8e/d92/dc3/d129 0 2024-04-25T13:47:14.900 INFO:tasks.workunit.client.0.smithi043.stdout:8/978: read db/dc/d28/d104/f126 [213847,93103] 0 2024-04-25T13:47:14.901 INFO:tasks.workunit.client.0.smithi043.stdout:8/979: write db/d38/d3c/d71/d5d/fda [714540,14248] 0 2024-04-25T13:47:14.902 INFO:tasks.workunit.client.0.smithi043.stdout:0/941: mkdir db/d1b/d62/d72/d13f 0 2024-04-25T13:47:14.907 INFO:tasks.workunit.client.0.smithi043.stdout:5/845: rename d1/cc7 to d1/d4/d92/d95/c117 0 2024-04-25T13:47:14.908 INFO:tasks.workunit.client.0.smithi043.stdout:6/972: symlink d0/d1b/d112/d123/l13e 0 2024-04-25T13:47:14.909 INFO:tasks.workunit.client.0.smithi043.stdout:5/846: truncate d1/d3/d7/d8/df/f10a 539191 0 2024-04-25T13:47:14.914 INFO:tasks.workunit.client.0.smithi043.stdout:3/843: creat d0/d13/d5a/f12a x:0 0 0 2024-04-25T13:47:14.914 INFO:tasks.workunit.client.0.smithi043.stdout:4/880: truncate d1/de/df/d117/d9e/d9d/f37 8867228 0 2024-04-25T13:47:14.916 INFO:tasks.workunit.client.0.smithi043.stdout:9/437: creat d0/d8b/d26/d47/d52/fab x:0 0 0 2024-04-25T13:47:14.918 INFO:tasks.workunit.client.0.smithi043.stdout:3/844: creat d0/d8d/f12b x:0 0 0 2024-04-25T13:47:14.925 INFO:tasks.workunit.client.0.smithi043.stdout:6/973: truncate d0/d76/d5c/d10e/f80 133979 0 2024-04-25T13:47:14.926 INFO:tasks.workunit.client.0.smithi043.stdout:0/942: symlink db/d1b/d23/d27/d39/d4b/d13e/l140 0 2024-04-25T13:47:14.930 INFO:tasks.workunit.client.0.smithi043.stdout:6/974: fsync d0/d76/de3/fba 0 2024-04-25T13:47:15.001 INFO:tasks.workunit.client.0.smithi043.stdout:2/782: sync 2024-04-25T13:47:15.025 INFO:tasks.workunit.client.0.smithi043.stdout:8/980: dwrite db/d11/f20 [0,4194304] 0 2024-04-25T13:47:15.025 INFO:tasks.workunit.client.0.smithi043.stdout:5/847: truncate d1/d3/d7/d8/df/dfe/f74 4524342 0 2024-04-25T13:47:15.032 INFO:tasks.workunit.client.0.smithi043.stdout:2/783: chown d0/d34/d17/dc6/d5c/cb9 57 1 2024-04-25T13:47:15.034 INFO:tasks.workunit.client.0.smithi043.stdout:0/943: rename db/d1b/d23/d27/d98/de4/f11a to db/d1b/f141 0 2024-04-25T13:47:15.037 INFO:tasks.workunit.client.0.smithi043.stdout:8/981: chown db/d7d/df2/fff 5084728 1 2024-04-25T13:47:15.038 INFO:tasks.workunit.client.0.smithi043.stdout:3/845: dwrite d0/d61/fe3 [0,4194304] 0 2024-04-25T13:47:15.039 INFO:tasks.workunit.client.0.smithi043.stdout:9/438: dwrite d0/d8b/d26/d47/fa4 [0,4194304] 0 2024-04-25T13:47:15.040 INFO:tasks.workunit.client.0.smithi043.stdout:0/944: chown db/d1b/d62/feb 16178 1 2024-04-25T13:47:15.046 INFO:tasks.workunit.client.0.smithi043.stdout:5/848: dwrite d1/d8d/db8/fdf [0,4194304] 0 2024-04-25T13:47:15.047 INFO:tasks.workunit.client.0.smithi043.stdout:9/439: read - d0/d8b/d26/f6d zero size 2024-04-25T13:47:15.048 INFO:tasks.workunit.client.0.smithi043.stdout:5/849: stat d1/l3f 0 2024-04-25T13:47:15.050 INFO:tasks.workunit.client.0.smithi043.stdout:0/945: mknod db/d1b/d62/d72/d13f/c142 0 2024-04-25T13:47:15.051 INFO:tasks.workunit.client.0.smithi043.stdout:9/440: dread - d0/d1d/d22/f27 zero size 2024-04-25T13:47:15.052 INFO:tasks.workunit.client.0.smithi043.stdout:3/846: mkdir d0/d13/d55/dd9/df5/d8e/d12c 0 2024-04-25T13:47:15.053 INFO:tasks.workunit.client.0.smithi043.stdout:2/784: dwrite d0/d5/d1e/f9d [0,4194304] 0 2024-04-25T13:47:15.057 INFO:tasks.workunit.client.0.smithi043.stdout:0/946: creat db/d1b/d23/f143 x:0 0 0 2024-04-25T13:47:15.058 INFO:tasks.workunit.client.0.smithi043.stdout:5/850: creat d1/d3/d7/d8/df/d28/f118 x:0 0 0 2024-04-25T13:47:15.061 INFO:tasks.workunit.client.0.smithi043.stdout:5/851: stat d1/d3/d7/d8/da/f53 0 2024-04-25T13:47:15.061 INFO:tasks.workunit.client.0.smithi043.stdout:9/441: dread d0/d8b/d26/d39/f6f [0,4194304] 0 2024-04-25T13:47:15.063 INFO:tasks.workunit.client.0.smithi043.stdout:4/881: dread d1/d3/d54/d62/f90 [0,4194304] 0 2024-04-25T13:47:15.064 INFO:tasks.workunit.client.0.smithi043.stdout:2/785: dread d0/d5/d1e/f9d [0,4194304] 0 2024-04-25T13:47:15.066 INFO:tasks.workunit.client.0.smithi043.stdout:9/442: mkdir d0/da7/dac 0 2024-04-25T13:47:15.068 INFO:tasks.workunit.client.0.smithi043.stdout:2/786: mkdir d0/d34/d17/d5e/da9/dc3/df5 0 2024-04-25T13:47:15.072 INFO:tasks.workunit.client.0.smithi043.stdout:5/852: symlink d1/d3/d7/d2f/l119 0 2024-04-25T13:47:15.072 INFO:tasks.workunit.client.0.smithi043.stdout:6/975: link d0/d3d/dc9/c111 d0/d76/de3/d64/c13f 0 2024-04-25T13:47:15.076 INFO:tasks.workunit.client.0.smithi043.stdout:5/853: readlink d1/d3/d7/d2f/lfa 0 2024-04-25T13:47:15.077 INFO:tasks.workunit.client.0.smithi043.stdout:4/882: dwrite d1/de/df/d1a/f58 [0,4194304] 0 2024-04-25T13:47:15.079 INFO:tasks.workunit.client.0.smithi043.stdout:2/787: mkdir d0/d34/d17/dc6/d5c/def/df6 0 2024-04-25T13:47:15.079 INFO:tasks.workunit.client.0.smithi043.stdout:2/788: stat d0/d5/d1e/f9d 0 2024-04-25T13:47:15.085 INFO:tasks.workunit.client.0.smithi043.stdout:2/789: mknod d0/d8/d9b/ddb/dce/cf7 0 2024-04-25T13:47:15.086 INFO:tasks.workunit.client.0.smithi043.stdout:8/982: dread db/dc/d21/f4c [0,4194304] 0 2024-04-25T13:47:15.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:14 smithi161 ceph-mon[32696]: pgmap v82: 129 pgs: 129 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 153 MiB/s wr, 352 op/s 2024-04-25T13:47:15.123 INFO:tasks.workunit.client.0.smithi043.stdout:1/922: sync 2024-04-25T13:47:15.124 INFO:tasks.workunit.client.0.smithi043.stdout:6/976: getdents d0/d3d/d109/d3a 0 2024-04-25T13:47:15.125 INFO:tasks.workunit.client.0.smithi043.stdout:4/883: getdents d1/de/df/d1e 0 2024-04-25T13:47:15.128 INFO:tasks.workunit.client.0.smithi043.stdout:9/443: dread d0/d8b/d26/d39/d46/f5e [0,4194304] 0 2024-04-25T13:47:15.130 INFO:tasks.workunit.client.0.smithi043.stdout:1/923: creat df/d10/d22/d2f/f152 x:0 0 0 2024-04-25T13:47:15.131 INFO:tasks.workunit.client.0.smithi043.stdout:4/884: creat d1/d3/d54/d62/d77/dcd/f125 x:0 0 0 2024-04-25T13:47:15.132 INFO:tasks.workunit.client.0.smithi043.stdout:1/924: stat df/d14/d3d/f14a 0 2024-04-25T13:47:15.137 INFO:tasks.workunit.client.0.smithi043.stdout:9/444: mkdir d0/d8b/d26/d39/d46/d62/dad 0 2024-04-25T13:47:15.138 INFO:tasks.workunit.client.0.smithi043.stdout:2/790: write d0/d34/d3f/d7b/dd4/fc4 [684965,44881] 0 2024-04-25T13:47:15.140 INFO:tasks.workunit.client.0.smithi043.stdout:1/925: creat df/d31/d38/d43/d6e/dea/f153 x:0 0 0 2024-04-25T13:47:15.143 INFO:tasks.workunit.client.0.smithi043.stdout:9/445: stat d0/d1d/d7/f9c 0 2024-04-25T13:47:15.143 INFO:tasks.workunit.client.0.smithi043.stdout:8/983: dwrite db/d11/f2a [0,4194304] 0 2024-04-25T13:47:15.145 INFO:tasks.workunit.client.0.smithi043.stdout:6/977: write d0/d1b/d96/fa2 [3450181,35792] 0 2024-04-25T13:47:15.147 INFO:tasks.workunit.client.0.smithi043.stdout:2/791: write d0/d5/d2f/f45 [1846997,5673] 0 2024-04-25T13:47:15.150 INFO:tasks.workunit.client.0.smithi043.stdout:9/446: fdatasync d0/d1d/d7/f34 0 2024-04-25T13:47:15.151 INFO:tasks.workunit.client.0.smithi043.stdout:2/792: mknod d0/d4b/cf8 0 2024-04-25T13:47:15.152 INFO:tasks.workunit.client.0.smithi043.stdout:8/984: readlink db/dc/d28/l8d 0 2024-04-25T13:47:15.153 INFO:tasks.workunit.client.0.smithi043.stdout:9/447: mknod d0/d1d/d7/d41/cae 0 2024-04-25T13:47:15.157 INFO:tasks.workunit.client.0.smithi043.stdout:9/448: stat d0/d8b/d26/d39/d46/f93 0 2024-04-25T13:47:15.157 INFO:tasks.workunit.client.0.smithi043.stdout:2/793: creat d0/d34/d17/dc6/d5c/def/ff9 x:0 0 0 2024-04-25T13:47:15.158 INFO:tasks.workunit.client.0.smithi043.stdout:8/985: symlink db/d46/df9/l13c 0 2024-04-25T13:47:15.164 INFO:tasks.workunit.client.0.smithi043.stdout:1/926: dwrite df/d31/dc7/fdb [0,4194304] 0 2024-04-25T13:47:15.166 INFO:tasks.workunit.client.0.smithi043.stdout:8/986: chown db/d7d/fb0 149 1 2024-04-25T13:47:15.168 INFO:tasks.workunit.client.0.smithi043.stdout:9/449: write d0/f21 [703318,18796] 0 2024-04-25T13:47:15.171 INFO:tasks.workunit.client.0.smithi043.stdout:1/927: mkdir df/d31/d34/d91/d154 0 2024-04-25T13:47:15.175 INFO:tasks.workunit.client.0.smithi043.stdout:2/794: dwrite d0/d34/d17/d5e/d71/d81/fa8 [8388608,4194304] 0 2024-04-25T13:47:15.176 INFO:tasks.workunit.client.0.smithi043.stdout:6/978: creat d0/d76/de3/d64/f140 x:0 0 0 2024-04-25T13:47:15.177 INFO:tasks.workunit.client.0.smithi043.stdout:4/885: rename d1/de/df/d117/d9e/d9d to d1/d3/d54/d62/d77/d92/df6/d126 0 2024-04-25T13:47:15.179 INFO:tasks.workunit.client.0.smithi043.stdout:8/987: write db/d46/da8/d10e/d11c/fed [385286,15042] 0 2024-04-25T13:47:15.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:14 smithi175 ceph-mon[32649]: pgmap v82: 129 pgs: 129 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 153 MiB/s wr, 352 op/s 2024-04-25T13:47:15.181 INFO:tasks.workunit.client.0.smithi043.stdout:9/450: mknod d0/d1d/d7/d41/caf 0 2024-04-25T13:47:15.182 INFO:tasks.workunit.client.0.smithi043.stdout:4/886: stat d1/de/df/d117/d53/d66/d94/d11f 0 2024-04-25T13:47:15.183 INFO:tasks.workunit.client.0.smithi043.stdout:8/988: write db/d44/d8e/d27/f75 [1196670,40586] 0 2024-04-25T13:47:15.186 INFO:tasks.workunit.client.0.smithi043.stdout:8/989: write db/d38/de4/d8c/ff5 [378399,49821] 0 2024-04-25T13:47:15.187 INFO:tasks.workunit.client.0.smithi043.stdout:1/928: truncate df/d31/d38/d43/d53/d106/f7c 1022219 0 2024-04-25T13:47:15.188 INFO:tasks.workunit.client.0.smithi043.stdout:2/795: rmdir d0/d34/d17/dc6/d5c/def/df6 0 2024-04-25T13:47:15.192 INFO:tasks.workunit.client.0.smithi043.stdout:8/990: readlink db/d38/d40/l137 0 2024-04-25T13:47:15.195 INFO:tasks.workunit.client.0.smithi043.stdout:2/796: creat d0/d5/ffa x:0 0 0 2024-04-25T13:47:15.197 INFO:tasks.workunit.client.0.smithi043.stdout:9/451: dwrite d0/d1d/fa0 [0,4194304] 0 2024-04-25T13:47:15.203 INFO:tasks.workunit.client.0.smithi043.stdout:9/452: rmdir d0/d1d/d4a 39 2024-04-25T13:47:15.205 INFO:tasks.workunit.client.0.smithi043.stdout:1/929: dwrite df/d31/d38/d43/fe6 [0,4194304] 0 2024-04-25T13:47:15.212 INFO:tasks.workunit.client.0.smithi043.stdout:0/947: sync 2024-04-25T13:47:15.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:14 smithi043 ceph-mon[29195]: pgmap v82: 129 pgs: 129 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 153 MiB/s wr, 352 op/s 2024-04-25T13:47:15.214 INFO:tasks.workunit.client.0.smithi043.stdout:0/948: readlink db/d1b/d36/l12d 0 2024-04-25T13:47:15.215 INFO:tasks.workunit.client.0.smithi043.stdout:2/797: creat d0/d34/d17/da0/ffb x:0 0 0 2024-04-25T13:47:15.222 INFO:tasks.workunit.client.0.smithi043.stdout:8/991: dwrite db/d11/d79/f84 [0,4194304] 0 2024-04-25T13:47:15.225 INFO:tasks.workunit.client.0.smithi043.stdout:9/453: dwrite d0/d1d/d7/f16 [0,4194304] 0 2024-04-25T13:47:15.227 INFO:tasks.workunit.client.0.smithi043.stdout:4/887: dread d1/d3/d7b/f7f [0,4194304] 0 2024-04-25T13:47:15.227 INFO:tasks.workunit.client.0.smithi043.stdout:0/949: write db/d1b/d94/d68/f116 [259276,93812] 0 2024-04-25T13:47:15.230 INFO:tasks.workunit.client.0.smithi043.stdout:6/979: link d0/d76/de3/d64/dc7/c133 d0/d76/d5c/d10e/c141 0 2024-04-25T13:47:15.230 INFO:tasks.workunit.client.0.smithi043.stdout:2/798: dread d0/d34/d17/d5e/d71/fb7 [0,4194304] 0 2024-04-25T13:47:15.234 INFO:tasks.workunit.client.0.smithi043.stdout:0/950: read - db/d1b/d23/d27/d39/d4c/da9/d117/f138 zero size 2024-04-25T13:47:15.235 INFO:tasks.workunit.client.0.smithi043.stdout:0/951: readlink db/d1b/d36/l12d 0 2024-04-25T13:47:15.237 INFO:tasks.workunit.client.0.smithi043.stdout:5/854: sync 2024-04-25T13:47:15.239 INFO:tasks.workunit.client.0.smithi043.stdout:2/799: getdents d0/d34/d3f/d59 0 2024-04-25T13:47:15.241 INFO:tasks.workunit.client.0.smithi043.stdout:6/980: symlink d0/d76/de3/d64/da1/l142 0 2024-04-25T13:47:15.242 INFO:tasks.workunit.client.0.smithi043.stdout:5/855: rmdir d1/d4/d92 39 2024-04-25T13:47:15.242 INFO:tasks.workunit.client.0.smithi043.stdout:8/992: write db/d38/de4/f3e [1170772,35608] 0 2024-04-25T13:47:15.242 INFO:tasks.workunit.client.0.smithi043.stdout:9/454: write d0/d1d/d7/f10 [628486,26368] 0 2024-04-25T13:47:15.250 INFO:tasks.workunit.client.0.smithi043.stdout:0/952: write db/d25/d2a/fb6 [633496,28189] 0 2024-04-25T13:47:15.250 INFO:tasks.workunit.client.0.smithi043.stdout:9/455: write d0/d1d/d7/f66 [2667629,106534] 0 2024-04-25T13:47:15.255 INFO:tasks.workunit.client.0.smithi043.stdout:1/930: dread df/d14/d63/d67/d9f/fdc [0,4194304] 0 2024-04-25T13:47:15.255 INFO:tasks.workunit.client.0.smithi043.stdout:9/456: stat d0/d1d/c13 0 2024-04-25T13:47:15.258 INFO:tasks.workunit.client.0.smithi043.stdout:6/981: unlink d0/d76/de3/d64/fa8 0 2024-04-25T13:47:15.259 INFO:tasks.workunit.client.0.smithi043.stdout:9/457: symlink d0/d8b/d9b/lb0 0 2024-04-25T13:47:15.265 INFO:tasks.workunit.client.0.smithi043.stdout:2/800: dwrite d0/d34/d17/da0/fd1 [0,4194304] 0 2024-04-25T13:47:15.269 INFO:tasks.workunit.client.0.smithi043.stdout:6/982: write d0/d3d/d6e/f86 [258590,47975] 0 2024-04-25T13:47:15.271 INFO:tasks.workunit.client.0.smithi043.stdout:0/953: getdents db/d1b/d36/d41 0 2024-04-25T13:47:15.271 INFO:tasks.workunit.client.0.smithi043.stdout:8/993: link db/dc/d21/d4e/d62/fe6 db/d38/de4/d8c/f13d 0 2024-04-25T13:47:15.273 INFO:tasks.workunit.client.0.smithi043.stdout:2/801: symlink d0/d34/d3f/d7b/dd4/d55/lfc 0 2024-04-25T13:47:15.273 INFO:tasks.workunit.client.0.smithi043.stdout:5/856: dread d1/d3/d7/d8/da/f9d [0,4194304] 0 2024-04-25T13:47:15.273 INFO:tasks.workunit.client.0.smithi043.stdout:8/994: readlink db/dc/d80/l122 0 2024-04-25T13:47:15.276 INFO:tasks.workunit.client.0.smithi043.stdout:6/983: mknod d0/d90/d4c/d130/c143 0 2024-04-25T13:47:15.277 INFO:tasks.workunit.client.0.smithi043.stdout:5/857: chown d1/d3/d24/d7c/f86 90 1 2024-04-25T13:47:15.279 INFO:tasks.workunit.client.0.smithi043.stdout:0/954: creat db/d1b/d94/d68/dc0/d115/f144 x:0 0 0 2024-04-25T13:47:15.280 INFO:tasks.workunit.client.0.smithi043.stdout:1/931: rmdir df/d14/d63/d67/da7 39 2024-04-25T13:47:15.311 INFO:tasks.workunit.client.0.smithi043.stdout:3/847: dwrite d0/da/f2d [0,4194304] 0 2024-04-25T13:47:15.312 INFO:tasks.workunit.client.0.smithi043.stdout:0/955: rmdir db/d1b/d94/d68/dc0/d115 39 2024-04-25T13:47:15.312 INFO:tasks.workunit.client.0.smithi043.stdout:8/995: rename db/d38/de4/d59/d7c to db/d11/da1/d13e 0 2024-04-25T13:47:15.313 INFO:tasks.workunit.client.0.smithi043.stdout:2/802: dwrite d0/d34/d3f/d7b/dd4/d55/fcf [0,4194304] 0 2024-04-25T13:47:15.314 INFO:tasks.workunit.client.0.smithi043.stdout:9/458: link d0/d8b/d26/d47/f65 d0/d8b/d26/d39/d46/d62/dad/fb1 0 2024-04-25T13:47:15.316 INFO:tasks.workunit.client.0.smithi043.stdout:0/956: creat db/d1b/d23/f145 x:0 0 0 2024-04-25T13:47:15.320 INFO:tasks.workunit.client.0.smithi043.stdout:1/932: dwrite df/d10/d22/d2f/d9c/f85 [0,4194304] 0 2024-04-25T13:47:15.320 INFO:tasks.workunit.client.0.smithi043.stdout:0/957: symlink db/d1b/l146 0 2024-04-25T13:47:15.321 INFO:tasks.workunit.client.0.smithi043.stdout:9/459: getdents d0/da7 0 2024-04-25T13:47:15.322 INFO:tasks.workunit.client.0.smithi043.stdout:5/858: dread d1/d3/d7/d2f/d80/fbb [0,4194304] 0 2024-04-25T13:47:15.322 INFO:tasks.workunit.client.0.smithi043.stdout:8/996: getdents db/d11/da1/d13e 0 2024-04-25T13:47:15.322 INFO:tasks.workunit.client.0.smithi043.stdout:3/848: truncate d0/d9/d6e/d34/d36/d57/de5/fdf 4043081 0 2024-04-25T13:47:15.323 INFO:tasks.workunit.client.0.smithi043.stdout:0/958: mknod db/d25/c147 0 2024-04-25T13:47:15.324 INFO:tasks.workunit.client.0.smithi043.stdout:1/933: chown df/d31/d34/c128 7137691 1 2024-04-25T13:47:15.325 INFO:tasks.workunit.client.0.smithi043.stdout:3/849: dread - d0/d13/d55/dd9/df5/ff8 zero size 2024-04-25T13:47:15.328 INFO:tasks.workunit.client.0.smithi043.stdout:2/803: creat d0/d34/ffd x:0 0 0 2024-04-25T13:47:15.333 INFO:tasks.workunit.client.0.smithi043.stdout:2/804: chown d0/d26 1597157 1 2024-04-25T13:47:15.334 INFO:tasks.workunit.client.0.smithi043.stdout:9/460: unlink d0/d8b/d26/d39/f3b 0 2024-04-25T13:47:15.337 INFO:tasks.workunit.client.0.smithi043.stdout:1/934: creat df/d14/f155 x:0 0 0 2024-04-25T13:47:15.342 INFO:tasks.workunit.client.0.smithi043.stdout:5/859: dwrite d1/d3/d7/d2f/df6/f10f [0,4194304] 0 2024-04-25T13:47:15.348 INFO:tasks.workunit.client.0.smithi043.stdout:8/997: dread db/d44/d8e/d27/f75 [0,4194304] 0 2024-04-25T13:47:15.350 INFO:tasks.workunit.client.0.smithi043.stdout:9/461: truncate d0/d1d/d22/f63 3335357 0 2024-04-25T13:47:15.355 INFO:tasks.workunit.client.0.smithi043.stdout:9/462: chown d0/d8b/d26/d47/d52/l55 884 1 2024-04-25T13:47:15.356 INFO:tasks.workunit.client.0.smithi043.stdout:1/935: dwrite df/d31/d34/d91/d138/d8c/f13b [0,4194304] 0 2024-04-25T13:47:15.356 INFO:tasks.workunit.client.0.smithi043.stdout:0/959: dread db/d1b/d23/d27/fa0 [0,4194304] 0 2024-04-25T13:47:15.357 INFO:tasks.workunit.client.0.smithi043.stdout:8/998: rmdir db/d38 39 2024-04-25T13:47:15.359 INFO:tasks.workunit.client.0.smithi043.stdout:1/936: dread - df/d31/d38/d43/d6e/dea/f153 zero size 2024-04-25T13:47:15.360 INFO:tasks.workunit.client.0.smithi043.stdout:3/850: write d0/d9/d6e/f52 [9186106,87720] 0 2024-04-25T13:47:15.360 INFO:tasks.workunit.client.0.smithi043.stdout:9/463: mknod d0/d8b/cb2 0 2024-04-25T13:47:15.360 INFO:tasks.workunit.client.0.smithi043.stdout:8/999: chown db/d38/d3c/d71/f50 120969864 1 2024-04-25T13:47:15.361 INFO:tasks.workunit.client.0.smithi043.stdout:5/860: mknod d1/d3/d62/c11a 0 2024-04-25T13:47:15.363 INFO:tasks.workunit.client.0.smithi043.stdout:0/960: creat db/d1b/d23/d27/d39/d4c/f148 x:0 0 0 2024-04-25T13:47:15.365 INFO:tasks.workunit.client.0.smithi043.stdout:9/464: unlink d0/d1d/d7/d41/caf 0 2024-04-25T13:47:15.367 INFO:tasks.workunit.client.0.smithi043.stdout:0/961: symlink db/d1b/d23/d27/d39/d4c/dbb/dc8/df5/l149 0 2024-04-25T13:47:15.368 INFO:tasks.workunit.client.0.smithi043.stdout:5/861: dwrite d1/d3/d7/d8/da/fc6 [0,4194304] 0 2024-04-25T13:47:15.368 INFO:tasks.workunit.client.0.smithi043.stdout:9/465: creat d0/d77/fb3 x:0 0 0 2024-04-25T13:47:15.371 INFO:tasks.workunit.client.0.smithi043.stdout:0/962: creat db/d1b/d23/d27/d98/de4/f14a x:0 0 0 2024-04-25T13:47:15.372 INFO:tasks.workunit.client.0.smithi043.stdout:9/466: truncate d0/f1e 5194017 0 2024-04-25T13:47:15.372 INFO:tasks.workunit.client.0.smithi043.stdout:0/963: write db/f1d [123118,8529] 0 2024-04-25T13:47:15.382 INFO:tasks.workunit.client.0.smithi043.stdout:1/937: link df/d31/d38/fe7 df/d31/dc7/dc8/dd2/f156 0 2024-04-25T13:47:15.383 INFO:tasks.workunit.client.0.smithi043.stdout:1/938: fdatasync df/d31/d38/d43/d81/f11f 0 2024-04-25T13:47:15.385 INFO:tasks.workunit.client.0.smithi043.stdout:0/964: creat db/d25/d2a/d3f/d6a/dd3/f14b x:0 0 0 2024-04-25T13:47:15.386 INFO:tasks.workunit.client.0.smithi043.stdout:5/862: truncate d1/d3/d26/f27 2739769 0 2024-04-25T13:47:15.387 INFO:tasks.workunit.client.0.smithi043.stdout:3/851: mknod d0/d13/d55/dd9/df5/d8e/d92/dc3/c12d 0 2024-04-25T13:47:15.399 INFO:tasks.workunit.client.0.smithi043.stdout:9/467: dwrite d0/d1d/d7/f3f [0,4194304] 0 2024-04-25T13:47:15.405 INFO:tasks.workunit.client.0.smithi043.stdout:3/852: dwrite d0/d13/d55/dd9/df5/fd0 [0,4194304] 0 2024-04-25T13:47:15.406 INFO:tasks.workunit.client.0.smithi043.stdout:5/863: rename d1/d3/d7/d8/da/d11/d52/f8c to d1/d3/d7/de1/f11b 0 2024-04-25T13:47:15.407 INFO:tasks.workunit.client.0.smithi043.stdout:0/965: mknod db/d1b/d23/d27/d39/d4b/c14c 0 2024-04-25T13:47:15.408 INFO:tasks.workunit.client.0.smithi043.stdout:0/966: stat db/d1b/d94 0 2024-04-25T13:47:15.408 INFO:tasks.workunit.client.0.smithi043.stdout:5/864: mkdir d1/d3/d7/d8/df/d28/d11c 0 2024-04-25T13:47:15.413 INFO:tasks.workunit.client.0.smithi043.stdout:0/967: creat db/d1b/d23/d27/d39/f14d x:0 0 0 2024-04-25T13:47:15.414 INFO:tasks.workunit.client.0.smithi043.stdout:9/468: link d0/d1d/d22/l99 d0/d8b/d26/d47/lb4 0 2024-04-25T13:47:15.415 INFO:tasks.workunit.client.0.smithi043.stdout:9/469: chown d0 73346244 1 2024-04-25T13:47:15.424 INFO:tasks.workunit.client.0.smithi043.stdout:0/968: dwrite db/d25/d2a/f7a [0,4194304] 0 2024-04-25T13:47:15.426 INFO:tasks.workunit.client.0.smithi043.stdout:0/969: fdatasync db/d25/fa3 0 2024-04-25T13:47:15.427 INFO:tasks.workunit.client.0.smithi043.stdout:9/470: dwrite d0/d8b/d26/d47/d52/fab [0,4194304] 0 2024-04-25T13:47:15.429 INFO:tasks.workunit.client.0.smithi043.stdout:5/865: chown d1/d3/d7/de1/f11b 27609 1 2024-04-25T13:47:15.429 INFO:tasks.workunit.client.0.smithi043.stdout:3/853: write d0/d9/d6e/d34/f8b [1819122,14207] 0 2024-04-25T13:47:15.436 INFO:tasks.workunit.client.0.smithi043.stdout:5/866: getdents d1/d3/d7/d8/da/d11 0 2024-04-25T13:47:15.442 INFO:tasks.workunit.client.0.smithi043.stdout:5/867: mknod d1/d3/d7/d2f/d67/c11d 0 2024-04-25T13:47:15.443 INFO:tasks.workunit.client.0.smithi043.stdout:3/854: dwrite d0/da/fc [4194304,4194304] 0 2024-04-25T13:47:15.444 INFO:tasks.workunit.client.0.smithi043.stdout:0/970: readlink db/d1b/d94/d10d/l56 0 2024-04-25T13:47:15.446 INFO:tasks.workunit.client.0.smithi043.stdout:5/868: creat d1/d8d/f11e x:0 0 0 2024-04-25T13:47:15.450 INFO:tasks.workunit.client.0.smithi043.stdout:5/869: dread - d1/d3/d7/d8/da/d11/fd0 zero size 2024-04-25T13:47:15.450 INFO:tasks.workunit.client.0.smithi043.stdout:0/971: mkdir db/d1b/d23/d27/d98/d14e 0 2024-04-25T13:47:15.450 INFO:tasks.workunit.client.0.smithi043.stdout:9/471: dwrite d0/d1d/d4a/f89 [0,4194304] 0 2024-04-25T13:47:15.462 INFO:tasks.workunit.client.0.smithi043.stdout:0/972: dwrite db/d1b/d23/d27/d39/d4c/dbb/dc8/df5/f114 [0,4194304] 0 2024-04-25T13:47:15.464 INFO:tasks.workunit.client.0.smithi043.stdout:5/870: dread d1/d3/d24/d7c/f89 [0,4194304] 0 2024-04-25T13:47:15.466 INFO:tasks.workunit.client.0.smithi043.stdout:0/973: unlink db/d1b/d23/d27/d39/d4c/dbb/dc8/ld4 0 2024-04-25T13:47:15.467 INFO:tasks.workunit.client.0.smithi043.stdout:3/855: link d0/d13/fa5 d0/da/db9/df7/f12e 0 2024-04-25T13:47:15.468 INFO:tasks.workunit.client.0.smithi043.stdout:3/856: chown d0/d9/f20 8828017 1 2024-04-25T13:47:15.469 INFO:tasks.workunit.client.0.smithi043.stdout:0/974: mkdir db/d25/dfa/d14f 0 2024-04-25T13:47:15.474 INFO:tasks.workunit.client.0.smithi043.stdout:5/871: write d1/d3/d7/de1/f11b [2831524,82884] 0 2024-04-25T13:47:15.474 INFO:tasks.workunit.client.0.smithi043.stdout:0/975: chown db/d1b/d36/d41/daf/fc9 3828727 1 2024-04-25T13:47:15.479 INFO:tasks.workunit.client.0.smithi043.stdout:3/857: dwrite d0/da/db9/d9e/f107 [0,4194304] 0 2024-04-25T13:47:15.482 INFO:tasks.workunit.client.0.smithi043.stdout:0/976: unlink db/d1b/d23/d27/d39/d4c/dbb/dc8/df5/f114 0 2024-04-25T13:47:15.487 INFO:tasks.workunit.client.0.smithi043.stdout:0/977: creat db/d25/d2a/d3f/d6a/d86/f150 x:0 0 0 2024-04-25T13:47:15.490 INFO:tasks.workunit.client.0.smithi043.stdout:3/858: dwrite d0/da/db9/df9/f125 [0,4194304] 0 2024-04-25T13:47:15.493 INFO:tasks.workunit.client.0.smithi043.stdout:9/472: dread d0/f1e [0,4194304] 0 2024-04-25T13:47:15.495 INFO:tasks.workunit.client.0.smithi043.stdout:5/872: dwrite d1/d3/d7/d8/df/f6b [0,4194304] 0 2024-04-25T13:47:15.495 INFO:tasks.workunit.client.0.smithi043.stdout:3/859: chown d0/d9/d6e/dc5/ccf 68 1 2024-04-25T13:47:15.496 INFO:tasks.workunit.client.0.smithi043.stdout:3/860: dread - d0/da/db9/df7/f12e zero size 2024-04-25T13:47:15.496 INFO:tasks.workunit.client.0.smithi043.stdout:9/473: fdatasync d0/d1d/fa 0 2024-04-25T13:47:15.497 INFO:tasks.workunit.client.0.smithi043.stdout:4/888: sync 2024-04-25T13:47:15.502 INFO:tasks.workunit.client.0.smithi043.stdout:9/474: rename d0/d1d/d22/f78 to d0/d8b/fb5 0 2024-04-25T13:47:15.507 INFO:tasks.workunit.client.0.smithi043.stdout:3/861: dwrite d0/d13/f73 [0,4194304] 0 2024-04-25T13:47:15.508 INFO:tasks.workunit.client.0.smithi043.stdout:9/475: rename d0/d1d/f98 to d0/d1d/d22/fb6 0 2024-04-25T13:47:15.513 INFO:tasks.workunit.client.0.smithi043.stdout:9/476: creat d0/d1d/d7/fb7 x:0 0 0 2024-04-25T13:47:15.525 INFO:tasks.workunit.client.0.smithi043.stdout:5/873: rmdir d1/d3/d62/df3 39 2024-04-25T13:47:15.525 INFO:tasks.workunit.client.0.smithi043.stdout:3/862: dwrite d0/da/f48 [0,4194304] 0 2024-04-25T13:47:15.525 INFO:tasks.workunit.client.0.smithi043.stdout:4/889: dread d1/d3/d54/d62/d77/fdc [0,4194304] 0 2024-04-25T13:47:15.526 INFO:tasks.workunit.client.0.smithi043.stdout:3/863: write d0/d13/d2e/f76 [4332364,1826] 0 2024-04-25T13:47:15.528 INFO:tasks.workunit.client.0.smithi043.stdout:4/890: write d1/de/df/d1a/d49/fa7 [8327818,99199] 0 2024-04-25T13:47:15.530 INFO:tasks.workunit.client.0.smithi043.stdout:5/874: readlink d1/d3/d62/l8e 0 2024-04-25T13:47:15.531 INFO:tasks.workunit.client.0.smithi043.stdout:3/864: read d0/da/db9/fdb [4022476,29131] 0 2024-04-25T13:47:15.533 INFO:tasks.workunit.client.0.smithi043.stdout:4/891: chown d1/d3/d54/d110/fde 27 1 2024-04-25T13:47:15.537 INFO:tasks.workunit.client.0.smithi043.stdout:5/875: mknod d1/c11f 0 2024-04-25T13:47:15.539 INFO:tasks.workunit.client.0.smithi043.stdout:5/876: mkdir d1/d3/d7/d8/df/d120 0 2024-04-25T13:47:15.540 INFO:tasks.workunit.client.0.smithi043.stdout:4/892: getdents d1/d3/d54/d62/d77/d92 0 2024-04-25T13:47:15.541 INFO:tasks.workunit.client.0.smithi043.stdout:4/893: fsync d1/de/df/d1a/d49/fa7 0 2024-04-25T13:47:15.542 INFO:tasks.workunit.client.0.smithi043.stdout:9/477: rename d0/d1d/d22/l7e to d0/d8b/d26/d47/d52/lb8 0 2024-04-25T13:47:15.547 INFO:tasks.workunit.client.0.smithi043.stdout:5/877: dwrite d1/d3/d26/fde [0,4194304] 0 2024-04-25T13:47:15.550 INFO:tasks.workunit.client.0.smithi043.stdout:3/865: rename d0/d13/f27 to d0/d13/d55/dd9/df5/d8e/f12f 0 2024-04-25T13:47:15.551 INFO:tasks.workunit.client.0.smithi043.stdout:5/878: chown d1/d3/d7/f23 273474 1 2024-04-25T13:47:15.552 INFO:tasks.workunit.client.0.smithi043.stdout:5/879: chown d1/d3/d7/d8/df/d28 7 1 2024-04-25T13:47:15.554 INFO:tasks.workunit.client.0.smithi043.stdout:9/478: dwrite d0/d8b/fb5 [0,4194304] 0 2024-04-25T13:47:15.558 INFO:tasks.workunit.client.0.smithi043.stdout:5/880: creat d1/f121 x:0 0 0 2024-04-25T13:47:15.559 INFO:tasks.workunit.client.0.smithi043.stdout:5/881: stat d1/d8d/db8/le4 0 2024-04-25T13:47:15.560 INFO:tasks.workunit.client.0.smithi043.stdout:3/866: getdents d0/d13/d5a/d90 0 2024-04-25T13:47:15.561 INFO:tasks.workunit.client.0.smithi043.stdout:9/479: dread d0/d1d/d4a/f6a [0,4194304] 0 2024-04-25T13:47:15.561 INFO:tasks.workunit.client.0.smithi043.stdout:5/882: readlink d1/d3/d7/d2f/d80/db6/lcd 0 2024-04-25T13:47:15.562 INFO:tasks.workunit.client.0.smithi043.stdout:3/867: mkdir d0/da/dcc/d130 0 2024-04-25T13:47:15.567 INFO:tasks.workunit.client.0.smithi043.stdout:9/480: read d0/d1d/d22/fb6 [3727613,41877] 0 2024-04-25T13:47:15.567 INFO:tasks.workunit.client.0.smithi043.stdout:5/883: getdents d1/d3/d7/d8/df/dfe/d6e 0 2024-04-25T13:47:15.571 INFO:tasks.workunit.client.0.smithi043.stdout:5/884: write d1/d3/d7/d9/d2d/d36/f107 [501447,74944] 0 2024-04-25T13:47:15.572 INFO:tasks.workunit.client.0.smithi043.stdout:3/868: truncate d0/d9/d6e/d38/d3f/f42 158980 0 2024-04-25T13:47:15.574 INFO:tasks.workunit.client.0.smithi043.stdout:9/481: dwrite d0/d8b/d26/d39/f6e [0,4194304] 0 2024-04-25T13:47:15.577 INFO:tasks.workunit.client.0.smithi043.stdout:5/885: mknod d1/d3/d7/c122 0 2024-04-25T13:47:15.579 INFO:tasks.workunit.client.0.smithi043.stdout:3/869: unlink d0/d13/f73 0 2024-04-25T13:47:15.580 INFO:tasks.workunit.client.0.smithi043.stdout:5/886: symlink d1/d3/d7/d2f/d80/l123 0 2024-04-25T13:47:15.584 INFO:tasks.workunit.client.0.smithi043.stdout:9/482: dwrite d0/f21 [0,4194304] 0 2024-04-25T13:47:15.584 INFO:tasks.workunit.client.0.smithi043.stdout:5/887: symlink d1/d3/d7/d8/df/d28/dfc/l124 0 2024-04-25T13:47:15.586 INFO:tasks.workunit.client.0.smithi043.stdout:4/894: dread d1/ff0 [0,4194304] 0 2024-04-25T13:47:15.588 INFO:tasks.workunit.client.0.smithi043.stdout:9/483: truncate d0/f79 1020565 0 2024-04-25T13:47:15.589 INFO:tasks.workunit.client.0.smithi043.stdout:4/895: creat d1/d34/d83/f127 x:0 0 0 2024-04-25T13:47:15.589 INFO:tasks.workunit.client.0.smithi043.stdout:5/888: symlink d1/d3/d7/d8/l125 0 2024-04-25T13:47:15.591 INFO:tasks.workunit.client.0.smithi043.stdout:5/889: write d1/d3/f81 [2232755,37146] 0 2024-04-25T13:47:15.592 INFO:tasks.workunit.client.0.smithi043.stdout:4/896: read d1/d3/f3e [1088208,24827] 0 2024-04-25T13:47:15.596 INFO:tasks.workunit.client.0.smithi043.stdout:4/897: mkdir d1/d3/d54/d62/d77/d128 0 2024-04-25T13:47:15.597 INFO:tasks.workunit.client.0.smithi043.stdout:5/890: creat d1/d8d/f126 x:0 0 0 2024-04-25T13:47:15.603 INFO:tasks.workunit.client.0.smithi043.stdout:5/891: mkdir d1/d4/deb/d127 0 2024-04-25T13:47:15.607 INFO:tasks.workunit.client.0.smithi043.stdout:9/484: dwrite d0/d8b/f18 [0,4194304] 0 2024-04-25T13:47:15.608 INFO:tasks.workunit.client.0.smithi043.stdout:3/870: dread d0/d9/d6e/d38/fd8 [4194304,4194304] 0 2024-04-25T13:47:15.610 INFO:tasks.workunit.client.0.smithi043.stdout:9/485: readlink d0/d8b/d26/d39/l7c 0 2024-04-25T13:47:15.611 INFO:tasks.workunit.client.0.smithi043.stdout:9/486: write d0/d1d/fa0 [2871122,92346] 0 2024-04-25T13:47:15.611 INFO:tasks.workunit.client.0.smithi043.stdout:4/898: truncate d1/de/d1d/d20/f52 3329832 0 2024-04-25T13:47:15.614 INFO:tasks.workunit.client.0.smithi043.stdout:4/899: truncate d1/d3/d54/d62/d77/d92/df6/d126/f11e 995110 0 2024-04-25T13:47:15.615 INFO:tasks.workunit.client.0.smithi043.stdout:9/487: mkdir d0/d8b/d26/d39/d46/db9 0 2024-04-25T13:47:15.617 INFO:tasks.workunit.client.0.smithi043.stdout:5/892: rmdir d1/d3/d7/d9/d2d/d36 39 2024-04-25T13:47:15.619 INFO:tasks.workunit.client.0.smithi043.stdout:9/488: mkdir d0/d8b/d26/d39/d46/dba 0 2024-04-25T13:47:15.620 INFO:tasks.workunit.client.0.smithi043.stdout:5/893: dread - d1/d3/d7/d9/d2d/faa zero size 2024-04-25T13:47:15.626 INFO:tasks.workunit.client.0.smithi043.stdout:4/900: dwrite d1/de/df/d1a/f3c [0,4194304] 0 2024-04-25T13:47:15.630 INFO:tasks.workunit.client.0.smithi043.stdout:9/489: dwrite d0/d8b/d26/d47/fa4 [0,4194304] 0 2024-04-25T13:47:15.631 INFO:tasks.workunit.client.0.smithi043.stdout:4/901: mknod d1/de/df/d117/d53/c129 0 2024-04-25T13:47:15.632 INFO:tasks.workunit.client.0.smithi043.stdout:5/894: dwrite d1/d3/d7/d9/ff9 [0,4194304] 0 2024-04-25T13:47:15.633 INFO:tasks.workunit.client.0.smithi043.stdout:5/895: readlink d1/d3/d7/l78 0 2024-04-25T13:47:15.634 INFO:tasks.workunit.client.0.smithi043.stdout:4/902: symlink d1/d3/d8f/l12a 0 2024-04-25T13:47:15.635 INFO:tasks.workunit.client.0.smithi043.stdout:6/984: sync 2024-04-25T13:47:15.637 INFO:tasks.workunit.client.0.smithi043.stdout:5/896: mkdir d1/d3/d7/d8/df/dfe/d6e/da3/d128 0 2024-04-25T13:47:15.638 INFO:tasks.workunit.client.0.smithi043.stdout:5/897: fdatasync d1/d3/d7/d8/df/dfe/f10d 0 2024-04-25T13:47:15.640 INFO:tasks.workunit.client.0.smithi043.stdout:9/490: creat d0/d8b/d26/d47/d4d/fbb x:0 0 0 2024-04-25T13:47:15.642 INFO:tasks.workunit.client.0.smithi043.stdout:5/898: fdatasync d1/d4/d92/d95/fbc 0 2024-04-25T13:47:15.644 INFO:tasks.workunit.client.0.smithi043.stdout:5/899: chown d1/f121 192 1 2024-04-25T13:47:15.644 INFO:tasks.workunit.client.0.smithi043.stdout:9/491: write d0/d1d/d7/f95 [982102,36979] 0 2024-04-25T13:47:15.651 INFO:tasks.workunit.client.0.smithi043.stdout:5/900: rmdir d1/d4/d42/d112 0 2024-04-25T13:47:15.654 INFO:tasks.workunit.client.0.smithi043.stdout:5/901: mkdir d1/d3/d7/d8/df/d120/d129 0 2024-04-25T13:47:15.654 INFO:tasks.workunit.client.0.smithi043.stdout:6/985: creat d0/d76/de3/d64/da1/d13a/f144 x:0 0 0 2024-04-25T13:47:15.656 INFO:tasks.workunit.client.0.smithi043.stdout:6/986: mkdir d0/d90/d48/d9d/d145 0 2024-04-25T13:47:15.659 INFO:tasks.workunit.client.0.smithi043.stdout:9/492: truncate d0/d8b/fb5 2158209 0 2024-04-25T13:47:15.660 INFO:tasks.workunit.client.0.smithi043.stdout:6/987: symlink d0/d1b/d112/l146 0 2024-04-25T13:47:15.661 INFO:tasks.workunit.client.0.smithi043.stdout:5/902: dwrite d1/d3/d7/d8/fc2 [0,4194304] 0 2024-04-25T13:47:15.662 INFO:tasks.workunit.client.0.smithi043.stdout:9/493: creat d0/d1d/d4a/fbc x:0 0 0 2024-04-25T13:47:15.663 INFO:tasks.workunit.client.0.smithi043.stdout:9/494: chown d0/d8b/d26/d39/d46/l8a 161 1 2024-04-25T13:47:15.664 INFO:tasks.workunit.client.0.smithi043.stdout:5/903: getdents d1/d3/d7/de1/d115 0 2024-04-25T13:47:15.666 INFO:tasks.workunit.client.0.smithi043.stdout:9/495: symlink d0/d1d/lbd 0 2024-04-25T13:47:15.846 INFO:tasks.workunit.client.0.smithi043.stdout:9/496: stat d0/d1d/d7/d41/cae 0 2024-04-25T13:47:15.849 INFO:tasks.workunit.client.0.smithi043.stdout:5/904: dwrite d1/d3/d7/d2f/d80/fc4 [0,4194304] 0 2024-04-25T13:47:15.849 INFO:tasks.workunit.client.0.smithi043.stdout:9/497: creat d0/d8b/fbe x:0 0 0 2024-04-25T13:47:15.853 INFO:tasks.workunit.client.0.smithi043.stdout:5/905: write d1/d4/d92/d95/ffd [218545,126934] 0 2024-04-25T13:47:15.854 INFO:tasks.workunit.client.0.smithi043.stdout:9/498: chown d0/d1d/d4a/f61 5 1 2024-04-25T13:47:15.854 INFO:tasks.workunit.client.0.smithi043.stdout:9/499: write d0/d1d/d7/f95 [1509556,65146] 0 2024-04-25T13:47:15.854 INFO:tasks.workunit.client.0.smithi043.stdout:5/906: creat d1/d3/d26/f12a x:0 0 0 2024-04-25T13:47:15.856 INFO:tasks.workunit.client.0.smithi043.stdout:9/500: write d0/d8b/d26/d47/d4d/fbb [399015,105721] 0 2024-04-25T13:47:15.858 INFO:tasks.workunit.client.0.smithi043.stdout:5/907: truncate d1/d3/d7/f70 4062134 0 2024-04-25T13:47:15.859 INFO:tasks.workunit.client.0.smithi043.stdout:9/501: truncate d0/d8b/d26/d47/d4d/f70 547458 0 2024-04-25T13:47:15.865 INFO:tasks.workunit.client.0.smithi043.stdout:9/502: symlink d0/lbf 0 2024-04-25T13:47:15.866 INFO:tasks.workunit.client.0.smithi043.stdout:9/503: read d0/d1d/d22/d67/f71 [492468,1524] 0 2024-04-25T13:47:15.868 INFO:tasks.workunit.client.0.smithi043.stdout:6/988: rename d0/d3d/d6e/d71/d131 to d0/d76/de3/da7/dc3/d147 0 2024-04-25T13:47:15.868 INFO:tasks.workunit.client.0.smithi043.stdout:5/908: link d1/d3/d7/d8/df/d28/f118 d1/d3/d7/d2f/df6/f12b 0 2024-04-25T13:47:15.868 INFO:tasks.workunit.client.0.smithi043.stdout:9/504: write d0/d1d/d7/fb7 [776535,34009] 0 2024-04-25T13:47:15.870 INFO:tasks.workunit.client.0.smithi043.stdout:9/505: write d0/d77/fb3 [654906,39615] 0 2024-04-25T13:47:15.871 INFO:tasks.workunit.client.0.smithi043.stdout:6/989: chown d0/fb 580526 1 2024-04-25T13:47:15.876 INFO:tasks.workunit.client.0.smithi043.stdout:9/506: read d0/d8b/f1b [2899000,126518] 0 2024-04-25T13:47:15.878 INFO:tasks.workunit.client.0.smithi043.stdout:5/909: dwrite d1/d3/fd6 [0,4194304] 0 2024-04-25T13:47:15.881 INFO:tasks.workunit.client.0.smithi043.stdout:9/507: creat d0/d8b/d26/d39/d46/d62/dad/fc0 x:0 0 0 2024-04-25T13:47:15.881 INFO:tasks.workunit.client.0.smithi043.stdout:9/508: readlink d0/le 0 2024-04-25T13:47:15.883 INFO:tasks.workunit.client.0.smithi043.stdout:5/910: readlink d1/d3/d7/d9/d2d/d36/l85 0 2024-04-25T13:47:15.885 INFO:tasks.workunit.client.0.smithi043.stdout:9/509: creat d0/d8b/d26/d39/fc1 x:0 0 0 2024-04-25T13:47:15.886 INFO:tasks.workunit.client.0.smithi043.stdout:9/510: fdatasync d0/d8b/d9b/f56 0 2024-04-25T13:47:15.889 INFO:tasks.workunit.client.0.smithi043.stdout:5/911: write d1/d3/d7/d8/df/dfe/f74 [3203849,37609] 0 2024-04-25T13:47:15.892 INFO:tasks.workunit.client.0.smithi043.stdout:5/912: rmdir d1/d3/d7/d8 39 2024-04-25T13:47:15.895 INFO:tasks.workunit.client.0.smithi043.stdout:5/913: creat d1/d3/d7/d2f/f12c x:0 0 0 2024-04-25T13:47:15.897 INFO:tasks.workunit.client.0.smithi043.stdout:6/990: dread d0/d76/d5c/f7d [0,4194304] 0 2024-04-25T13:47:15.899 INFO:tasks.workunit.client.0.smithi043.stdout:6/991: chown d0/l85 3699 1 2024-04-25T13:47:15.900 INFO:tasks.workunit.client.0.smithi043.stdout:6/992: write d0/d90/f10d [2056948,63644] 0 2024-04-25T13:47:15.903 INFO:tasks.workunit.client.0.smithi043.stdout:6/993: write d0/d1c/fa6 [238688,63848] 0 2024-04-25T13:47:15.905 INFO:tasks.workunit.client.0.smithi043.stdout:5/914: dread d1/d3/d7/d8/df/d28/faf [0,4194304] 0 2024-04-25T13:47:15.906 INFO:tasks.workunit.client.0.smithi043.stdout:6/994: mkdir d0/d3d/d109/d3a/d148 0 2024-04-25T13:47:15.912 INFO:tasks.workunit.client.0.smithi043.stdout:6/995: link d0/d90/db0/c106 d0/d3d/d6e/d71/c149 0 2024-04-25T13:47:15.912 INFO:tasks.workunit.client.0.smithi043.stdout:5/915: write d1/d3/d7/d8/da/d11/f25 [1447617,114362] 0 2024-04-25T13:47:15.915 INFO:tasks.workunit.client.0.smithi043.stdout:9/511: dread d0/d8b/d26/d39/d46/f50 [0,4194304] 0 2024-04-25T13:47:15.916 INFO:tasks.workunit.client.0.smithi043.stdout:6/996: creat d0/d3d/f14a x:0 0 0 2024-04-25T13:47:15.917 INFO:tasks.workunit.client.0.smithi043.stdout:1/939: sync 2024-04-25T13:47:15.917 INFO:tasks.workunit.client.0.smithi043.stdout:0/978: sync 2024-04-25T13:47:15.917 INFO:tasks.workunit.client.0.smithi043.stdout:2/805: sync 2024-04-25T13:47:15.917 INFO:tasks.workunit.client.0.smithi043.stdout:5/916: creat d1/d3/d7/de1/d115/f12d x:0 0 0 2024-04-25T13:47:15.919 INFO:tasks.workunit.client.0.smithi043.stdout:5/917: chown d1/d3/d26/l9e 2 1 2024-04-25T13:47:15.921 INFO:tasks.workunit.client.0.smithi043.stdout:6/997: creat d0/d90/d48/d9d/f14b x:0 0 0 2024-04-25T13:47:15.921 INFO:tasks.workunit.client.0.smithi043.stdout:5/918: dread - d1/d8d/f11e zero size 2024-04-25T13:47:15.921 INFO:tasks.workunit.client.0.smithi043.stdout:1/940: rename df/d31/dc7/dc8/fed to df/d31/dc7/dc8/d141/f157 0 2024-04-25T13:47:15.923 INFO:tasks.workunit.client.0.smithi043.stdout:6/998: chown d0/f16 23 1 2024-04-25T13:47:15.923 INFO:tasks.workunit.client.0.smithi043.stdout:0/979: creat db/d1b/d94/d10d/f151 x:0 0 0 2024-04-25T13:47:15.925 INFO:tasks.workunit.client.0.smithi043.stdout:9/512: dwrite d0/d8b/d26/d39/d46/d62/f68 [0,4194304] 0 2024-04-25T13:47:15.928 INFO:tasks.workunit.client.0.smithi043.stdout:9/513: dread - d0/d8b/d26/f6d zero size 2024-04-25T13:47:15.931 INFO:tasks.workunit.client.0.smithi043.stdout:5/919: getdents d1/d3/d7/d2f/d80 0 2024-04-25T13:47:15.934 INFO:tasks.workunit.client.0.smithi043.stdout:9/514: write d0/d1d/d22/f8f [817281,48531] 0 2024-04-25T13:47:15.938 INFO:tasks.workunit.client.0.smithi043.stdout:2/806: getdents d0/d34/d3f/d59/dbc 0 2024-04-25T13:47:15.941 INFO:tasks.workunit.client.0.smithi043.stdout:6/999: dwrite d0/d90/f10d [0,4194304] 0 2024-04-25T13:47:15.943 INFO:tasks.workunit.client.0.smithi043.stdout:0/980: dwrite db/d1b/f29 [4194304,4194304] 0 2024-04-25T13:47:15.943 INFO:tasks.workunit.client.0.smithi043.stdout:9/515: creat d0/d1d/fc2 x:0 0 0 2024-04-25T13:47:15.944 INFO:tasks.workunit.client.0.smithi043.stdout:1/941: dread f3 [0,4194304] 0 2024-04-25T13:47:15.946 INFO:tasks.workunit.client.0.smithi043.stdout:9/516: chown d0/d1d/d7/l1c 1198 1 2024-04-25T13:47:15.949 INFO:tasks.workunit.client.0.smithi043.stdout:1/942: rename df/d31/l5e to df/d31/d34/d91/l158 0 2024-04-25T13:47:15.951 INFO:tasks.workunit.client.0.smithi043.stdout:2/807: creat d0/d34/d17/dc6/ffe x:0 0 0 2024-04-25T13:47:15.952 INFO:tasks.workunit.client.0.smithi043.stdout:1/943: rmdir df/d31/d34/d91/d138/d8c/d13e 39 2024-04-25T13:47:15.953 INFO:tasks.workunit.client.0.smithi043.stdout:9/517: getdents d0/d77 0 2024-04-25T13:47:15.956 INFO:tasks.workunit.client.0.smithi043.stdout:0/981: readlink db/d1b/d23/d27/d39/d4b/l99 0 2024-04-25T13:47:15.956 INFO:tasks.workunit.client.0.smithi043.stdout:3/871: sync 2024-04-25T13:47:15.958 INFO:tasks.workunit.client.0.smithi043.stdout:9/518: mkdir d0/d1d/d4a/dc3 0 2024-04-25T13:47:15.964 INFO:tasks.workunit.client.0.smithi043.stdout:5/920: dread d1/d3/d7/d2f/d80/fcc [0,4194304] 0 2024-04-25T13:47:15.964 INFO:tasks.workunit.client.0.smithi043.stdout:3/872: creat d0/d9/f131 x:0 0 0 2024-04-25T13:47:15.967 INFO:tasks.workunit.client.0.smithi043.stdout:5/921: creat d1/d3/d24/d7c/f12e x:0 0 0 2024-04-25T13:47:15.968 INFO:tasks.workunit.client.0.smithi043.stdout:9/519: write d0/d8b/f1b [1747649,28239] 0 2024-04-25T13:47:15.969 INFO:tasks.workunit.client.0.smithi043.stdout:0/982: dwrite db/d1b/d23/d27/d39/d4b/fa8 [0,4194304] 0 2024-04-25T13:47:15.970 INFO:tasks.workunit.client.0.smithi043.stdout:5/922: rmdir d1/d8d 39 2024-04-25T13:47:15.971 INFO:tasks.workunit.client.0.smithi043.stdout:9/520: read d0/d8b/d26/d47/f65 [1617086,66199] 0 2024-04-25T13:47:15.971 INFO:tasks.workunit.client.0.smithi043.stdout:5/923: chown d1/d3/d7/d2f/d80/fcc 1135 1 2024-04-25T13:47:16.019 INFO:tasks.workunit.client.0.smithi043.stdout:2/808: rename d0/d8/fa to d0/d34/d17/d5e/d71/fff 0 2024-04-25T13:47:16.019 INFO:tasks.workunit.client.0.smithi043.stdout:9/521: chown d0/d8b/d26/d47/d4d/f58 18 1 2024-04-25T13:47:16.019 INFO:tasks.workunit.client.0.smithi043.stdout:0/983: write db/d1b/d23/d27/d39/d4c/f139 [1588239,8380] 0 2024-04-25T13:47:16.021 INFO:tasks.workunit.client.0.smithi043.stdout:5/924: chown d1/d3/d7/d2f/lbe 1939803 1 2024-04-25T13:47:16.022 INFO:tasks.workunit.client.0.smithi043.stdout:1/944: rename df/d10/d22/c117 to df/d31/d38/d43/dbc/c159 0 2024-04-25T13:47:16.023 INFO:tasks.workunit.client.0.smithi043.stdout:0/984: readlink db/d1b/d23/d27/d39/d4c/dbb/dc8/le8 0 2024-04-25T13:47:16.025 INFO:tasks.workunit.client.0.smithi043.stdout:9/522: dread d0/f79 [0,4194304] 0 2024-04-25T13:47:16.025 INFO:tasks.workunit.client.0.smithi043.stdout:1/945: mknod df/d31/d34/d91/d138/d8c/d132/c15a 0 2024-04-25T13:47:16.026 INFO:tasks.workunit.client.0.smithi043.stdout:5/925: mkdir d1/d4/deb/d127/d12f 0 2024-04-25T13:47:16.027 INFO:tasks.workunit.client.0.smithi043.stdout:2/809: getdents d0/d34/d17/d5e 0 2024-04-25T13:47:16.027 INFO:tasks.workunit.client.0.smithi043.stdout:0/985: mkdir db/d1b/d23/d27/d39/d4c/dbb/dc8/df5/d152 0 2024-04-25T13:47:16.028 INFO:tasks.workunit.client.0.smithi043.stdout:9/523: mknod d0/d1d/d7/d41/cc4 0 2024-04-25T13:47:16.029 INFO:tasks.workunit.client.0.smithi043.stdout:0/986: dread - db/d1b/d23/d27/d39/d4c/dbb/dc8/f13b zero size 2024-04-25T13:47:16.030 INFO:tasks.workunit.client.0.smithi043.stdout:5/926: mknod d1/d3/d7/d9/c130 0 2024-04-25T13:47:16.030 INFO:tasks.workunit.client.0.smithi043.stdout:1/946: truncate df/d31/d34/f4a 1079574 0 2024-04-25T13:47:16.034 INFO:tasks.workunit.client.0.smithi043.stdout:0/987: creat db/d1b/d23/d27/d39/d4c/da9/d117/f153 x:0 0 0 2024-04-25T13:47:16.036 INFO:tasks.workunit.client.0.smithi043.stdout:9/524: dwrite d0/d1d/d4a/fbc [0,4194304] 0 2024-04-25T13:47:16.036 INFO:tasks.workunit.client.0.smithi043.stdout:5/927: mknod d1/d3/d7/d8/df/d28/d11c/c131 0 2024-04-25T13:47:16.039 INFO:tasks.workunit.client.0.smithi043.stdout:1/947: write df/d31/d34/f4a [1129338,44028] 0 2024-04-25T13:47:16.039 INFO:tasks.workunit.client.0.smithi043.stdout:0/988: mkdir db/d25/d2a/d154 0 2024-04-25T13:47:16.042 INFO:tasks.workunit.client.0.smithi043.stdout:5/928: unlink d1/d3/d26/fde 0 2024-04-25T13:47:16.042 INFO:tasks.workunit.client.0.smithi043.stdout:0/989: read db/d1b/d23/d27/fdf [621158,113935] 0 2024-04-25T13:47:16.043 INFO:tasks.workunit.client.0.smithi043.stdout:5/929: chown d1/d3/d7/d2f/d67/cee 7514 1 2024-04-25T13:47:16.046 INFO:tasks.workunit.client.0.smithi043.stdout:0/990: creat db/d25/dfa/f155 x:0 0 0 2024-04-25T13:47:16.052 INFO:tasks.workunit.client.0.smithi043.stdout:2/810: rename d0/d34/d17/da0/dd2/cdd to d0/d34/d17/dc6/d5c/def/c100 0 2024-04-25T13:47:16.057 INFO:tasks.workunit.client.0.smithi043.stdout:2/811: write d0/d34/d3f/d7b/dd4/d55/fb2 [2173892,62179] 0 2024-04-25T13:47:16.058 INFO:tasks.workunit.client.0.smithi043.stdout:9/525: truncate d0/d8b/d26/d39/d46/f5e 1234960 0 2024-04-25T13:47:16.058 INFO:tasks.workunit.client.0.smithi043.stdout:0/991: write db/d25/d2a/d3f/fec [141192,3627] 0 2024-04-25T13:47:16.063 INFO:tasks.workunit.client.0.smithi043.stdout:0/992: mknod db/d25/d2a/d3f/d6a/d86/c156 0 2024-04-25T13:47:16.063 INFO:tasks.workunit.client.0.smithi043.stdout:9/526: dread d0/f1e [0,4194304] 0 2024-04-25T13:47:16.064 INFO:tasks.workunit.client.0.smithi043.stdout:2/812: creat d0/d34/d77/deb/f101 x:0 0 0 2024-04-25T13:47:16.065 INFO:tasks.workunit.client.0.smithi043.stdout:1/948: dread df/d31/d38/d43/f65 [0,4194304] 0 2024-04-25T13:47:16.067 INFO:tasks.workunit.client.0.smithi043.stdout:1/949: chown df/d14/d3d/f55 3 1 2024-04-25T13:47:16.067 INFO:tasks.workunit.client.0.smithi043.stdout:9/527: mknod d0/d1d/d22/d67/cc5 0 2024-04-25T13:47:16.068 INFO:tasks.workunit.client.0.smithi043.stdout:0/993: symlink db/d1b/d23/d27/d39/d4c/d74/l157 0 2024-04-25T13:47:16.070 INFO:tasks.workunit.client.0.smithi043.stdout:9/528: unlink d0/d1d/d22/d67/faa 0 2024-04-25T13:47:16.072 INFO:tasks.workunit.client.0.smithi043.stdout:5/930: dread d1/d3/f81 [4194304,4194304] 0 2024-04-25T13:47:16.072 INFO:tasks.workunit.client.0.smithi043.stdout:0/994: mknod db/d1b/d23/d27/dcb/d107/c158 0 2024-04-25T13:47:16.075 INFO:tasks.workunit.client.0.smithi043.stdout:9/529: symlink d0/d8b/d26/d39/lc6 0 2024-04-25T13:47:16.075 INFO:tasks.workunit.client.0.smithi043.stdout:1/950: dwrite df/d14/f155 [0,4194304] 0 2024-04-25T13:47:16.076 INFO:tasks.workunit.client.0.smithi043.stdout:0/995: creat db/d25/d2a/d3f/d6a/d86/f159 x:0 0 0 2024-04-25T13:47:16.077 INFO:tasks.workunit.client.0.smithi043.stdout:5/931: mkdir d1/d3/d7/d8/da/d132 0 2024-04-25T13:47:16.079 INFO:tasks.workunit.client.0.smithi043.stdout:5/932: mknod d1/d4/deb/c133 0 2024-04-25T13:47:16.079 INFO:tasks.workunit.client.0.smithi043.stdout:5/933: write d1/d4/f7f [4233600,114302] 0 2024-04-25T13:47:16.081 INFO:tasks.workunit.client.0.smithi043.stdout:5/934: write d1/d3/d7/d8/df/dfe/f10d [715998,21587] 0 2024-04-25T13:47:16.090 INFO:tasks.workunit.client.0.smithi043.stdout:1/951: stat df/d14/d63/d67/d9f/fb5 0 2024-04-25T13:47:16.091 INFO:tasks.workunit.client.0.smithi043.stdout:4/903: sync 2024-04-25T13:47:16.092 INFO:tasks.workunit.client.0.smithi043.stdout:4/904: readlink d1/de/df/d1a/d49/lab 0 2024-04-25T13:47:16.094 INFO:tasks.workunit.client.0.smithi043.stdout:1/952: creat df/d31/d34/d91/d138/d8c/d132/f15b x:0 0 0 2024-04-25T13:47:16.096 INFO:tasks.workunit.client.0.smithi043.stdout:4/905: read - d1/de/df/d117/d53/d66/d94/f97 zero size 2024-04-25T13:47:16.097 INFO:tasks.workunit.client.0.smithi043.stdout:4/906: readlink d1/de/d1d/lf9 0 2024-04-25T13:47:16.098 INFO:tasks.workunit.client.0.smithi043.stdout:4/907: chown d1/de/df/d117/d53/fdf 954918 1 2024-04-25T13:47:16.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:15 smithi161 ceph-mon[32696]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:47:16.115 INFO:tasks.workunit.client.0.smithi043.stdout:1/953: dread df/d31/d38/d43/d81/fe5 [0,4194304] 0 2024-04-25T13:47:16.119 INFO:tasks.workunit.client.0.smithi043.stdout:2/813: rename d0/d34/d17/d5e/d86/fac to d0/d26/dd7/f102 0 2024-04-25T13:47:16.120 INFO:tasks.workunit.client.0.smithi043.stdout:2/814: stat d0/d34/d77/deb/f101 0 2024-04-25T13:47:16.121 INFO:tasks.workunit.client.0.smithi043.stdout:2/815: chown d0/d34/d17/d5e/d71/f85 4552 1 2024-04-25T13:47:16.123 INFO:tasks.workunit.client.0.smithi043.stdout:2/816: creat d0/d34/d3f/d59/f103 x:0 0 0 2024-04-25T13:47:16.125 INFO:tasks.workunit.client.0.smithi043.stdout:2/817: mkdir d0/d8/d9b/ddb/dda/d104 0 2024-04-25T13:47:16.132 INFO:tasks.workunit.client.0.smithi043.stdout:2/818: dwrite d0/d34/d3f/d7b/fd0 [0,4194304] 0 2024-04-25T13:47:16.134 INFO:tasks.workunit.client.0.smithi043.stdout:5/935: rename d1/d3/d62/fac to d1/d3/d7/de1/d115/f134 0 2024-04-25T13:47:16.135 INFO:tasks.workunit.client.0.smithi043.stdout:2/819: symlink d0/d34/d77/dc9/l105 0 2024-04-25T13:47:16.142 INFO:tasks.workunit.client.0.smithi043.stdout:2/820: creat d0/d34/d3f/d7b/dd4/f106 x:0 0 0 2024-04-25T13:47:16.144 INFO:tasks.workunit.client.0.smithi043.stdout:2/821: fdatasync d0/d34/d17/da0/dd2/fe0 0 2024-04-25T13:47:16.150 INFO:tasks.workunit.client.0.smithi043.stdout:4/908: rename d1/de/df to d1/d3/d12b 0 2024-04-25T13:47:16.151 INFO:tasks.workunit.client.0.smithi043.stdout:2/822: dwrite d0/d34/faf [4194304,4194304] 0 2024-04-25T13:47:16.154 INFO:tasks.workunit.client.0.smithi043.stdout:2/823: creat d0/d5/d1e/f107 x:0 0 0 2024-04-25T13:47:16.157 INFO:tasks.workunit.client.0.smithi043.stdout:5/936: link d1/d3/d7/d9/d2d/d36/fe8 d1/d3/d7/de1/f135 0 2024-04-25T13:47:16.158 INFO:tasks.workunit.client.0.smithi043.stdout:4/909: dwrite d1/d34/d83/f127 [0,4194304] 0 2024-04-25T13:47:16.159 INFO:tasks.workunit.client.0.smithi043.stdout:5/937: chown d1/d4/d92/d95/fbc 873785 1 2024-04-25T13:47:16.164 INFO:tasks.workunit.client.0.smithi043.stdout:1/954: rename df/d31/d34/d8b/d39 to df/d10/d22/d15c 0 2024-04-25T13:47:16.166 INFO:tasks.workunit.client.0.smithi043.stdout:1/955: rename df to df/d31/d38/d43/dbc/d148/d15d 22 2024-04-25T13:47:16.166 INFO:tasks.workunit.client.0.smithi043.stdout:4/910: mkdir d1/de/d1d/d12c 0 2024-04-25T13:47:16.166 INFO:tasks.workunit.client.0.smithi043.stdout:2/824: truncate d0/d5/d2f/f8a 75792 0 2024-04-25T13:47:16.167 INFO:tasks.workunit.client.0.smithi043.stdout:5/938: dwrite d1/d4/f7a [4194304,4194304] 0 2024-04-25T13:47:16.168 INFO:tasks.workunit.client.0.smithi043.stdout:4/911: chown d1/d3/d12b/d1e/l22 21 1 2024-04-25T13:47:16.174 INFO:tasks.workunit.client.0.smithi043.stdout:4/912: mknod d1/d34/d83/d11a/c12d 0 2024-04-25T13:47:16.175 INFO:tasks.workunit.client.0.smithi043.stdout:5/939: dwrite d1/d3/d7/d8/df/dfe/fa5 [0,4194304] 0 2024-04-25T13:47:16.176 INFO:tasks.workunit.client.0.smithi043.stdout:1/956: write df/d31/d34/d91/d138/fee [480341,106469] 0 2024-04-25T13:47:16.179 INFO:tasks.workunit.client.0.smithi043.stdout:2/825: write d0/d35/f48 [1714865,18277] 0 2024-04-25T13:47:16.179 INFO:tasks.workunit.client.0.smithi043.stdout:4/913: fsync d1/f14 0 2024-04-25T13:47:16.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:15 smithi175 ceph-mon[32649]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:47:16.184 INFO:tasks.workunit.client.0.smithi043.stdout:5/940: creat d1/d3/d7/d8/df/dfe/d6e/f136 x:0 0 0 2024-04-25T13:47:16.185 INFO:tasks.workunit.client.0.smithi043.stdout:1/957: rmdir df/d31/dc7 39 2024-04-25T13:47:16.192 INFO:tasks.workunit.client.0.smithi043.stdout:5/941: read d1/d8d/db8/fdb [732730,44711] 0 2024-04-25T13:47:16.193 INFO:tasks.workunit.client.0.smithi043.stdout:2/826: creat d0/d34/d3f/d7b/f108 x:0 0 0 2024-04-25T13:47:16.193 INFO:tasks.workunit.client.0.smithi043.stdout:5/942: readlink d1/d8d/la4 0 2024-04-25T13:47:16.195 INFO:tasks.workunit.client.0.smithi043.stdout:5/943: read - d1/d4/fa8 zero size 2024-04-25T13:47:16.197 INFO:tasks.workunit.client.0.smithi043.stdout:5/944: dread - d1/d3/d7/d2f/f12c zero size 2024-04-25T13:47:16.198 INFO:tasks.workunit.client.0.smithi043.stdout:2/827: dread d0/d5/d1e/d32/f96 [0,4194304] 0 2024-04-25T13:47:16.203 INFO:tasks.workunit.client.0.smithi043.stdout:2/828: creat d0/d34/d77/dc9/f109 x:0 0 0 2024-04-25T13:47:16.204 INFO:tasks.workunit.client.0.smithi043.stdout:1/958: dwrite f3 [0,4194304] 0 2024-04-25T13:47:16.207 INFO:tasks.workunit.client.0.smithi043.stdout:4/914: dwrite d1/d34/d83/d11a/f78 [0,4194304] 0 2024-04-25T13:47:16.209 INFO:tasks.workunit.client.0.smithi043.stdout:2/829: mkdir d0/d5/d2f/d10a 0 2024-04-25T13:47:16.212 INFO:tasks.workunit.client.0.smithi043.stdout:2/830: symlink d0/d26/dd7/l10b 0 2024-04-25T13:47:16.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:15 smithi043 ceph-mon[29195]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T13:47:16.213 INFO:tasks.workunit.client.0.smithi043.stdout:1/959: creat df/d31/d34/d91/d138/d8c/d13e/f15e x:0 0 0 2024-04-25T13:47:16.213 INFO:tasks.workunit.client.0.smithi043.stdout:2/831: readlink d0/d5/l44 0 2024-04-25T13:47:16.213 INFO:tasks.workunit.client.0.smithi043.stdout:5/945: dwrite d1/d3/d7/d9/d2d/d36/fe7 [0,4194304] 0 2024-04-25T13:47:16.216 INFO:tasks.workunit.client.0.smithi043.stdout:9/530: sync 2024-04-25T13:47:16.216 INFO:tasks.workunit.client.0.smithi043.stdout:0/996: sync 2024-04-25T13:47:16.216 INFO:tasks.workunit.client.0.smithi043.stdout:3/873: sync 2024-04-25T13:47:16.219 INFO:tasks.workunit.client.0.smithi043.stdout:5/946: mkdir d1/d3/d7/d8/df/d28/dfc/d103/d137 0 2024-04-25T13:47:16.220 INFO:tasks.workunit.client.0.smithi043.stdout:1/960: truncate df/f16 3710066 0 2024-04-25T13:47:16.226 INFO:tasks.workunit.client.0.smithi043.stdout:0/997: mknod db/d1b/d62/d72/c15a 0 2024-04-25T13:47:16.228 INFO:tasks.workunit.client.0.smithi043.stdout:9/531: mknod d0/d1d/d22/cc7 0 2024-04-25T13:47:16.232 INFO:tasks.workunit.client.0.smithi043.stdout:1/961: rmdir df/d31/dc7/dc8/d141 39 2024-04-25T13:47:16.233 INFO:tasks.workunit.client.0.smithi043.stdout:2/832: dwrite d0/d34/ffd [0,4194304] 0 2024-04-25T13:47:16.236 INFO:tasks.workunit.client.0.smithi043.stdout:0/998: write db/d1b/d23/d27/d39/d4b/f12b [272315,50112] 0 2024-04-25T13:47:16.238 INFO:tasks.workunit.client.0.smithi043.stdout:0/999: chown db/d1b/f22 6 1 2024-04-25T13:47:16.239 INFO:tasks.workunit.client.0.smithi043.stdout:5/947: dwrite d1/d3/d7/d9/d2d/d36/f107 [0,4194304] 0 2024-04-25T13:47:16.239 INFO:tasks.workunit.client.0.smithi043.stdout:5/948: chown d1/d8d/la4 59343071 1 2024-04-25T13:47:16.242 INFO:tasks.workunit.client.0.smithi043.stdout:3/874: truncate d0/d9/d6e/d34/f10f 2898356 0 2024-04-25T13:47:16.247 INFO:tasks.workunit.client.0.smithi043.stdout:5/949: unlink d1/d3/d7/d8/df/dfe/fc9 0 2024-04-25T13:47:16.250 INFO:tasks.workunit.client.0.smithi043.stdout:1/962: creat df/d31/dc7/dc8/dd2/df8/f15f x:0 0 0 2024-04-25T13:47:16.253 INFO:tasks.workunit.client.0.smithi043.stdout:3/875: dwrite d0/da/db9/df9/f125 [0,4194304] 0 2024-04-25T13:47:16.253 INFO:tasks.workunit.client.0.smithi043.stdout:4/915: dread d1/de/d1d/d20/f52 [0,4194304] 0 2024-04-25T13:47:16.254 INFO:tasks.workunit.client.0.smithi043.stdout:2/833: mkdir d0/d34/d17/dc6/d10c 0 2024-04-25T13:47:16.258 INFO:tasks.workunit.client.0.smithi043.stdout:1/963: write df/d31/d34/d91/d138/d8c/fc2 [739551,21382] 0 2024-04-25T13:47:16.262 INFO:tasks.workunit.client.0.smithi043.stdout:1/964: creat df/d10/d22/f160 x:0 0 0 2024-04-25T13:47:16.263 INFO:tasks.workunit.client.0.smithi043.stdout:1/965: chown df/d31/d34/d91/d138/c105 1 1 2024-04-25T13:47:16.264 INFO:tasks.workunit.client.0.smithi043.stdout:4/916: link d1/d3/d54/d62/d77/d92/fe7 d1/d3/d54/d62/dba/f12e 0 2024-04-25T13:47:16.265 INFO:tasks.workunit.client.0.smithi043.stdout:5/950: truncate d1/d8d/db8/fdb 814665 0 2024-04-25T13:47:16.268 INFO:tasks.workunit.client.0.smithi043.stdout:3/876: rmdir d0/da/db9 39 2024-04-25T13:47:16.268 INFO:tasks.workunit.client.0.smithi043.stdout:4/917: creat d1/d34/d83/f12f x:0 0 0 2024-04-25T13:47:16.269 INFO:tasks.workunit.client.0.smithi043.stdout:1/966: dwrite df/d31/d34/d91/d138/d8c/f13b [0,4194304] 0 2024-04-25T13:47:16.277 INFO:tasks.workunit.client.0.smithi043.stdout:3/877: dwrite d0/d9/d6e/d34/f8b [0,4194304] 0 2024-04-25T13:47:16.279 INFO:tasks.workunit.client.0.smithi043.stdout:4/918: write d1/d3/d12b/d1e/fa4 [366438,97927] 0 2024-04-25T13:47:16.280 INFO:tasks.workunit.client.0.smithi043.stdout:3/878: readlink d0/d13/d55/dd9/df5/d8e/d92/l24 0 2024-04-25T13:47:16.281 INFO:tasks.workunit.client.0.smithi043.stdout:9/532: link d0/d1d/d7/f49 d0/d8b/d26/d47/fc8 0 2024-04-25T13:47:16.286 INFO:tasks.workunit.client.0.smithi043.stdout:4/919: rmdir d1/d34/d83 39 2024-04-25T13:47:16.294 INFO:tasks.workunit.client.0.smithi043.stdout:2/834: rename d0/d5/ffa to d0/d34/d17/d5e/da9/dc3/f10d 0 2024-04-25T13:47:16.298 INFO:tasks.workunit.client.0.smithi043.stdout:3/879: dwrite d0/d9/f62 [0,4194304] 0 2024-04-25T13:47:16.300 INFO:tasks.workunit.client.0.smithi043.stdout:2/835: readlink d0/d34/d17/d5e/d71/d81/lcc 0 2024-04-25T13:47:16.301 INFO:tasks.workunit.client.0.smithi043.stdout:9/533: dwrite d0/d1d/d7/f5c [0,4194304] 0 2024-04-25T13:47:16.302 INFO:tasks.workunit.client.0.smithi043.stdout:5/951: link d1/d4/d42/c93 d1/d3/d62/c138 0 2024-04-25T13:47:16.304 INFO:tasks.workunit.client.0.smithi043.stdout:4/920: dwrite d1/ff0 [0,4194304] 0 2024-04-25T13:47:16.306 INFO:tasks.workunit.client.0.smithi043.stdout:2/836: symlink d0/d34/d17/d5e/l10e 0 2024-04-25T13:47:16.307 INFO:tasks.workunit.client.0.smithi043.stdout:3/880: read d0/d9/d6e/d34/f10f [483222,75011] 0 2024-04-25T13:47:16.310 INFO:tasks.workunit.client.0.smithi043.stdout:4/921: chown d1/d34/d83/d11a/fda 10585125 1 2024-04-25T13:47:16.311 INFO:tasks.workunit.client.0.smithi043.stdout:5/952: creat d1/d3/d7/d8/f139 x:0 0 0 2024-04-25T13:47:16.312 INFO:tasks.workunit.client.0.smithi043.stdout:9/534: symlink d0/d8b/d26/d47/d52/lc9 0 2024-04-25T13:47:16.312 INFO:tasks.workunit.client.0.smithi043.stdout:4/922: write d1/d3/f9 [5714954,61509] 0 2024-04-25T13:47:16.312 INFO:tasks.workunit.client.0.smithi043.stdout:2/837: read d0/d34/d17/d5e/d71/f85 [2299854,106802] 0 2024-04-25T13:47:16.314 INFO:tasks.workunit.client.0.smithi043.stdout:5/953: readlink d1/d8d/db8/le4 0 2024-04-25T13:47:16.315 INFO:tasks.workunit.client.0.smithi043.stdout:5/954: chown d1/d4/d92 1346638 1 2024-04-25T13:47:16.318 INFO:tasks.workunit.client.0.smithi043.stdout:5/955: chown d1/d3/d7/d8/df/l84 398658157 1 2024-04-25T13:47:16.320 INFO:tasks.workunit.client.0.smithi043.stdout:9/535: mknod d0/d8b/d26/d39/cca 0 2024-04-25T13:47:16.322 INFO:tasks.workunit.client.0.smithi043.stdout:3/881: truncate d0/d9/f20 4711936 0 2024-04-25T13:47:16.323 INFO:tasks.workunit.client.0.smithi043.stdout:9/536: chown d0/d8b/d26/c7d 1704726 1 2024-04-25T13:47:16.323 INFO:tasks.workunit.client.0.smithi043.stdout:2/838: rmdir d0/d34/d17/d5e/d71 39 2024-04-25T13:47:16.323 INFO:tasks.workunit.client.0.smithi043.stdout:4/923: write d1/d3/d12b/f40 [3000112,77824] 0 2024-04-25T13:47:16.324 INFO:tasks.workunit.client.0.smithi043.stdout:5/956: creat d1/d3/d7/d2f/df7/f13a x:0 0 0 2024-04-25T13:47:16.328 INFO:tasks.workunit.client.0.smithi043.stdout:2/839: creat d0/d5/d2f/f10f x:0 0 0 2024-04-25T13:47:16.330 INFO:tasks.workunit.client.0.smithi043.stdout:4/924: fdatasync d1/d3/f3e 0 2024-04-25T13:47:16.331 INFO:tasks.workunit.client.0.smithi043.stdout:9/537: unlink d0/d1d/d7/f34 0 2024-04-25T13:47:16.333 INFO:tasks.workunit.client.0.smithi043.stdout:4/925: chown d1/d3/d54/d62/d77/d92/dc5/l8b 287919715 1 2024-04-25T13:47:16.334 INFO:tasks.workunit.client.0.smithi043.stdout:1/967: rename df/d14/d63/d67/da7/fc0 to df/d10/d22/d15c/f161 0 2024-04-25T13:47:16.335 INFO:tasks.workunit.client.0.smithi043.stdout:5/957: symlink d1/d3/d7/d8/df/dfe/l13b 0 2024-04-25T13:47:16.337 INFO:tasks.workunit.client.0.smithi043.stdout:1/968: mkdir df/d14/d3d/d114/d162 0 2024-04-25T13:47:16.338 INFO:tasks.workunit.client.0.smithi043.stdout:9/538: rmdir d0/d77 39 2024-04-25T13:47:16.339 INFO:tasks.workunit.client.0.smithi043.stdout:9/539: write d0/d8b/f60 [582726,92636] 0 2024-04-25T13:47:16.342 INFO:tasks.workunit.client.0.smithi043.stdout:4/926: getdents d1/d3/d12b/d1a 0 2024-04-25T13:47:16.342 INFO:tasks.workunit.client.0.smithi043.stdout:2/840: dread d0/d5/d1e/f52 [0,4194304] 0 2024-04-25T13:47:16.343 INFO:tasks.workunit.client.0.smithi043.stdout:4/927: readlink d1/de/d1d/lf9 0 2024-04-25T13:47:16.344 INFO:tasks.workunit.client.0.smithi043.stdout:2/841: stat d0/d34/d17 0 2024-04-25T13:47:16.344 INFO:tasks.workunit.client.0.smithi043.stdout:1/969: link df/d14/c90 df/d31/d34/d91/d138/c163 0 2024-04-25T13:47:16.346 INFO:tasks.workunit.client.0.smithi043.stdout:4/928: dread - d1/d34/d83/f12f zero size 2024-04-25T13:47:16.349 INFO:tasks.workunit.client.0.smithi043.stdout:1/970: chown df/d31/d38/d43/d6e/df9 1405 1 2024-04-25T13:47:16.351 INFO:tasks.workunit.client.0.smithi043.stdout:9/540: dwrite d0/d1d/d7/f66 [4194304,4194304] 0 2024-04-25T13:47:16.352 INFO:tasks.workunit.client.0.smithi043.stdout:1/971: rmdir df/d31/d34/d8b/ddd 39 2024-04-25T13:47:16.354 INFO:tasks.workunit.client.0.smithi043.stdout:9/541: chown d0/d1d/d7/f10 4906 1 2024-04-25T13:47:16.354 INFO:tasks.workunit.client.0.smithi043.stdout:1/972: write df/fd3 [1963986,78688] 0 2024-04-25T13:47:16.355 INFO:tasks.workunit.client.0.smithi043.stdout:1/973: read df/d31/d38/d43/f65 [515000,1413] 0 2024-04-25T13:47:16.355 INFO:tasks.workunit.client.0.smithi043.stdout:3/882: rename d0/da/c69 to d0/d13/d5a/d90/c132 0 2024-04-25T13:47:16.360 INFO:tasks.workunit.client.0.smithi043.stdout:9/542: creat d0/d77/fcb x:0 0 0 2024-04-25T13:47:16.366 INFO:tasks.workunit.client.0.smithi043.stdout:9/543: symlink d0/d1d/d4a/dc3/lcc 0 2024-04-25T13:47:16.368 INFO:tasks.workunit.client.0.smithi043.stdout:3/883: rmdir d0/d61 39 2024-04-25T13:47:16.369 INFO:tasks.workunit.client.0.smithi043.stdout:4/929: link d1/d3/d54/d62/d77/d92/ceb d1/de/d1d/d20/de8/c130 0 2024-04-25T13:47:16.369 INFO:tasks.workunit.client.0.smithi043.stdout:5/958: rename d1/d3/d62/df3/cd5 to d1/d3/d7/d8/df/d120/d129/c13c 0 2024-04-25T13:47:16.371 INFO:tasks.workunit.client.0.smithi043.stdout:1/974: dread df/d10/d22/d2f/d9c/f42 [4194304,4194304] 0 2024-04-25T13:47:16.371 INFO:tasks.workunit.client.0.smithi043.stdout:9/544: mkdir d0/d8b/dcd 0 2024-04-25T13:47:16.373 INFO:tasks.workunit.client.0.smithi043.stdout:2/842: dread d0/d34/d17/d5e/d71/f85 [0,4194304] 0 2024-04-25T13:47:16.374 INFO:tasks.workunit.client.0.smithi043.stdout:5/959: creat d1/d3/d24/d7c/f13d x:0 0 0 2024-04-25T13:47:16.375 INFO:tasks.workunit.client.0.smithi043.stdout:1/975: chown df/d31/d38/d43/d53/l68 14213278 1 2024-04-25T13:47:16.376 INFO:tasks.workunit.client.0.smithi043.stdout:4/930: creat d1/d3/d12b/d1a/f131 x:0 0 0 2024-04-25T13:47:16.377 INFO:tasks.workunit.client.0.smithi043.stdout:1/976: dread - df/d31/d34/d91/f129 zero size 2024-04-25T13:47:16.377 INFO:tasks.workunit.client.0.smithi043.stdout:9/545: creat d0/da7/dac/fce x:0 0 0 2024-04-25T13:47:16.380 INFO:tasks.workunit.client.0.smithi043.stdout:3/884: read d0/d9/f45 [929005,486] 0 2024-04-25T13:47:16.380 INFO:tasks.workunit.client.0.smithi043.stdout:2/843: creat d0/d8/d9b/ddb/dda/d104/f110 x:0 0 0 2024-04-25T13:47:16.383 INFO:tasks.workunit.client.0.smithi043.stdout:3/885: stat d0/d9/d6e/d34/d36 0 2024-04-25T13:47:16.385 INFO:tasks.workunit.client.0.smithi043.stdout:5/960: dwrite d1/d3/d7/de1/d115/f12d [0,4194304] 0 2024-04-25T13:47:16.389 INFO:tasks.workunit.client.0.smithi043.stdout:1/977: link df/d31/d38/d43/d81/l12a df/d14/d3d/l164 0 2024-04-25T13:47:16.390 INFO:tasks.workunit.client.0.smithi043.stdout:5/961: write d1/d3/d24/d7c/f89 [1082195,112244] 0 2024-04-25T13:47:16.392 INFO:tasks.workunit.client.0.smithi043.stdout:4/931: write d1/d3/d54/d110/d33/fd3 [1404622,32800] 0 2024-04-25T13:47:16.393 INFO:tasks.workunit.client.0.smithi043.stdout:3/886: mkdir d0/d13/d55/dd9/df5/d8e/d92/d133 0 2024-04-25T13:47:16.401 INFO:tasks.workunit.client.0.smithi043.stdout:1/978: creat df/d31/d38/d43/f165 x:0 0 0 2024-04-25T13:47:16.406 INFO:tasks.workunit.client.0.smithi043.stdout:1/979: mknod df/d31/d34/d91/d138/d8c/d13e/c166 0 2024-04-25T13:47:16.407 INFO:tasks.workunit.client.0.smithi043.stdout:5/962: dwrite d1/d3/d7/d8/da/f88 [0,4194304] 0 2024-04-25T13:47:16.408 INFO:tasks.workunit.client.0.smithi043.stdout:9/546: dread d0/d8b/d26/d47/f65 [0,4194304] 0 2024-04-25T13:47:16.410 INFO:tasks.workunit.client.0.smithi043.stdout:3/887: fdatasync d0/d9/d6e/d34/d36/f9a 0 2024-04-25T13:47:16.414 INFO:tasks.workunit.client.0.smithi043.stdout:1/980: truncate df/d31/d38/d43/d53/d106/f7c 1993950 0 2024-04-25T13:47:16.417 INFO:tasks.workunit.client.0.smithi043.stdout:3/888: rmdir d0/d13 39 2024-04-25T13:47:16.419 INFO:tasks.workunit.client.0.smithi043.stdout:9/547: dwrite d0/d8b/d26/d39/d46/f75 [0,4194304] 0 2024-04-25T13:47:16.472 INFO:tasks.workunit.client.0.smithi043.stdout:4/932: getdents d1/d3/d12b/d1e 0 2024-04-25T13:47:16.477 INFO:tasks.workunit.client.0.smithi043.stdout:1/981: mknod df/d14/d3d/d114/d11b/c167 0 2024-04-25T13:47:16.480 INFO:tasks.workunit.client.0.smithi043.stdout:5/963: dwrite d1/d3/d7/d2f/df6/f12b [0,4194304] 0 2024-04-25T13:47:16.484 INFO:tasks.workunit.client.0.smithi043.stdout:1/982: creat df/d31/d38/d43/f168 x:0 0 0 2024-04-25T13:47:16.485 INFO:tasks.workunit.client.0.smithi043.stdout:4/933: rmdir d1/d3/d12b/d1e/dc8 39 2024-04-25T13:47:16.485 INFO:tasks.workunit.client.0.smithi043.stdout:3/889: dwrite d0/f2a [0,4194304] 0 2024-04-25T13:47:16.486 INFO:tasks.workunit.client.0.smithi043.stdout:1/983: dread - df/d31/d38/d43/fa0 zero size 2024-04-25T13:47:16.488 INFO:tasks.workunit.client.0.smithi043.stdout:5/964: truncate d1/d3/d24/f65 2911661 0 2024-04-25T13:47:16.489 INFO:tasks.workunit.client.0.smithi043.stdout:4/934: fsync d1/d3/d12b/d1e/d45/f9f 0 2024-04-25T13:47:16.491 INFO:tasks.workunit.client.0.smithi043.stdout:9/548: dread d0/d1d/d7/f49 [0,4194304] 0 2024-04-25T13:47:16.492 INFO:tasks.workunit.client.0.smithi043.stdout:4/935: chown d1/d3/d54/d62/dba/fdb 17491 1 2024-04-25T13:47:16.492 INFO:tasks.workunit.client.0.smithi043.stdout:3/890: chown d0/d9/d6e/d34/d36/d57/de5/lf1 13 1 2024-04-25T13:47:16.494 INFO:tasks.workunit.client.0.smithi043.stdout:1/984: symlink df/d14/d63/d67/d9f/l169 0 2024-04-25T13:47:16.495 INFO:tasks.workunit.client.0.smithi043.stdout:4/936: fdatasync d1/d3/d54/d110/d33/f120 0 2024-04-25T13:47:16.496 INFO:tasks.workunit.client.0.smithi043.stdout:9/549: chown d0/d8b/d26/d39/d46/dba 0 1 2024-04-25T13:47:16.496 INFO:tasks.workunit.client.0.smithi043.stdout:3/891: chown d0/d9/d6e/d34/d36/d57/l115 2532750 1 2024-04-25T13:47:16.497 INFO:tasks.workunit.client.0.smithi043.stdout:1/985: chown df/d31/d34/d91/d138/d8c/ca9 379828661 1 2024-04-25T13:47:16.499 INFO:tasks.workunit.client.0.smithi043.stdout:5/965: write d1/d3/d7/de1/f135 [115121,61064] 0 2024-04-25T13:47:16.501 INFO:tasks.workunit.client.0.smithi043.stdout:1/986: creat df/d31/dc7/dc8/d141/f16a x:0 0 0 2024-04-25T13:47:16.506 INFO:tasks.workunit.client.0.smithi043.stdout:9/550: getdents d0/d8b 0 2024-04-25T13:47:16.507 INFO:tasks.workunit.client.0.smithi043.stdout:5/966: getdents d1/d4/deb/d127 0 2024-04-25T13:47:16.508 INFO:tasks.workunit.client.0.smithi043.stdout:1/987: creat df/d31/dc7/dc8/dd2/df8/f16b x:0 0 0 2024-04-25T13:47:16.508 INFO:tasks.workunit.client.0.smithi043.stdout:9/551: write d0/d1d/fa0 [1941030,30174] 0 2024-04-25T13:47:16.509 INFO:tasks.workunit.client.0.smithi043.stdout:3/892: write d0/da/f43 [1551943,42026] 0 2024-04-25T13:47:16.510 INFO:tasks.workunit.client.0.smithi043.stdout:4/937: dwrite d1/d34/d35/f113 [0,4194304] 0 2024-04-25T13:47:16.513 INFO:tasks.workunit.client.0.smithi043.stdout:9/552: write d0/d8b/f5d [4352263,39225] 0 2024-04-25T13:47:16.515 INFO:tasks.workunit.client.0.smithi043.stdout:3/893: fsync d0/d13/d55/dd9/df5/ff8 0 2024-04-25T13:47:16.516 INFO:tasks.workunit.client.0.smithi043.stdout:1/988: mkdir df/d31/d38/d43/d6e/dea/d16c 0 2024-04-25T13:47:16.520 INFO:tasks.workunit.client.0.smithi043.stdout:4/938: fdatasync d1/d3/d12b/d1a/d49/ff1 0 2024-04-25T13:47:16.521 INFO:tasks.workunit.client.0.smithi043.stdout:1/989: creat df/d31/d38/d43/dbc/f16d x:0 0 0 2024-04-25T13:47:16.521 INFO:tasks.workunit.client.0.smithi043.stdout:4/939: readlink d1/d34/d35/l4f 0 2024-04-25T13:47:16.524 INFO:tasks.workunit.client.0.smithi043.stdout:1/990: symlink df/d31/dc7/dc8/dd2/df8/l16e 0 2024-04-25T13:47:16.525 INFO:tasks.workunit.client.0.smithi043.stdout:5/967: truncate d1/d3/d7/d2f/d80/fbb 755983 0 2024-04-25T13:47:16.525 INFO:tasks.workunit.client.0.smithi043.stdout:9/553: dwrite d0/d1d/d7/f16 [0,4194304] 0 2024-04-25T13:47:16.526 INFO:tasks.workunit.client.0.smithi043.stdout:4/940: creat d1/d3/d54/d62/d77/d92/f132 x:0 0 0 2024-04-25T13:47:16.529 INFO:tasks.workunit.client.0.smithi043.stdout:1/991: creat df/d31/dc7/dc8/f16f x:0 0 0 2024-04-25T13:47:16.529 INFO:tasks.workunit.client.0.smithi043.stdout:9/554: creat d0/d1d/d7/d81/fcf x:0 0 0 2024-04-25T13:47:16.531 INFO:tasks.workunit.client.0.smithi043.stdout:4/941: symlink d1/d3/d54/d62/d77/d92/df6/d126/d3a/d10a/l133 0 2024-04-25T13:47:16.533 INFO:tasks.workunit.client.0.smithi043.stdout:1/992: creat df/d31/d38/d43/dbc/f170 x:0 0 0 2024-04-25T13:47:16.534 INFO:tasks.workunit.client.0.smithi043.stdout:1/993: fdatasync df/d31/d38/d43/dbc/f16d 0 2024-04-25T13:47:16.535 INFO:tasks.workunit.client.0.smithi043.stdout:4/942: rename d1/d3/d12b/d1e/d45/ld9 to d1/d34/d35/l134 0 2024-04-25T13:47:16.538 INFO:tasks.workunit.client.0.smithi043.stdout:4/943: fsync d1/d3/d54/d110/d33/f74 0 2024-04-25T13:47:16.539 INFO:tasks.workunit.client.0.smithi043.stdout:1/994: creat df/d14/d3d/f171 x:0 0 0 2024-04-25T13:47:16.546 INFO:tasks.workunit.client.0.smithi043.stdout:4/944: getdents d1/d3/d12b/d117/d53/d66/d94 0 2024-04-25T13:47:16.546 INFO:tasks.workunit.client.0.smithi043.stdout:9/555: dwrite d0/d1d/d22/f43 [0,4194304] 0 2024-04-25T13:47:16.548 INFO:tasks.workunit.client.0.smithi043.stdout:1/995: write df/d10/fa6 [1475039,71035] 0 2024-04-25T13:47:16.549 INFO:tasks.workunit.client.0.smithi043.stdout:9/556: truncate d0/d8b/d26/d39/fc1 672914 0 2024-04-25T13:47:16.550 INFO:tasks.workunit.client.0.smithi043.stdout:1/996: readlink df/l119 0 2024-04-25T13:47:16.551 INFO:tasks.workunit.client.0.smithi043.stdout:9/557: write d0/d8b/d26/d39/d46/f5e [756324,48218] 0 2024-04-25T13:47:16.553 INFO:tasks.workunit.client.0.smithi043.stdout:4/945: getdents d1/d3/d54/d110/d33 0 2024-04-25T13:47:16.553 INFO:tasks.workunit.client.0.smithi043.stdout:9/558: fdatasync d0/d1d/d7/f49 0 2024-04-25T13:47:16.554 INFO:tasks.workunit.client.0.smithi043.stdout:4/946: chown d1/d3/d54/d62/d77/f10e 1711686180 1 2024-04-25T13:47:16.557 INFO:tasks.workunit.client.0.smithi043.stdout:9/559: creat d0/d8b/d26/d39/d46/dba/fd0 x:0 0 0 2024-04-25T13:47:16.560 INFO:tasks.workunit.client.0.smithi043.stdout:9/560: creat d0/d1d/d4a/dc3/fd1 x:0 0 0 2024-04-25T13:47:16.560 INFO:tasks.workunit.client.0.smithi043.stdout:4/947: dwrite d1/d3/f100 [0,4194304] 0 2024-04-25T13:47:16.561 INFO:tasks.workunit.client.0.smithi043.stdout:4/948: readlink d1/d3/d54/d62/d77/d92/df6/d126/d3a/l121 0 2024-04-25T13:47:16.562 INFO:tasks.workunit.client.0.smithi043.stdout:9/561: mkdir d0/da7/dd2 0 2024-04-25T13:47:16.570 INFO:tasks.workunit.client.0.smithi043.stdout:9/562: dwrite d0/d1d/d7/f5c [0,4194304] 0 2024-04-25T13:47:16.572 INFO:tasks.workunit.client.0.smithi043.stdout:9/563: write d0/d1d/d7/f16 [1873590,32786] 0 2024-04-25T13:47:16.573 INFO:tasks.workunit.client.0.smithi043.stdout:4/949: dread d1/d3/d54/d110/d33/f5d [0,4194304] 0 2024-04-25T13:47:16.581 INFO:tasks.workunit.client.0.smithi043.stdout:4/950: dwrite d1/d3/f68 [0,4194304] 0 2024-04-25T13:47:16.585 INFO:tasks.workunit.client.0.smithi043.stdout:9/564: truncate d0/d1d/d7/f10 517318 0 2024-04-25T13:47:16.589 INFO:tasks.workunit.client.0.smithi043.stdout:4/951: read d1/d3/d12b/d1e/fa4 [288049,64391] 0 2024-04-25T13:47:16.590 INFO:tasks.workunit.client.0.smithi043.stdout:4/952: truncate d1/de/d1d/f5c 1322943 0 2024-04-25T13:47:16.591 INFO:tasks.workunit.client.0.smithi043.stdout:4/953: chown d1/d3/d12b/d117/d9e 1665 1 2024-04-25T13:47:16.647 INFO:tasks.workunit.client.0.smithi043.stdout:2/844: sync 2024-04-25T13:47:16.654 INFO:tasks.workunit.client.0.smithi043.stdout:9/565: rename d0/d8b/d26/f6c to d0/d8b/d26/d47/d4d/fd3 0 2024-04-25T13:47:16.662 INFO:tasks.workunit.client.0.smithi043.stdout:4/954: truncate d1/d34/d83/f127 1796163 0 2024-04-25T13:47:16.664 INFO:tasks.workunit.client.0.smithi043.stdout:4/955: read d1/d3/d54/d110/d33/f74 [2530580,1358] 0 2024-04-25T13:47:16.682 INFO:tasks.workunit.client.0.smithi043.stdout:2/845: dread d0/d34/d17/dc6/f84 [0,4194304] 0 2024-04-25T13:47:16.683 INFO:tasks.workunit.client.0.smithi043.stdout:4/956: dread d1/d3/d12b/d1a/d49/fa7 [0,4194304] 0 2024-04-25T13:47:16.684 INFO:tasks.workunit.client.0.smithi043.stdout:4/957: fsync d1/d3/d54/d110/d33/f74 0 2024-04-25T13:47:16.691 INFO:tasks.workunit.client.0.smithi043.stdout:2/846: creat d0/d34/d3f/d7b/f111 x:0 0 0 2024-04-25T13:47:16.692 INFO:tasks.workunit.client.0.smithi043.stdout:2/847: write d0/d8/fcd [736052,103799] 0 2024-04-25T13:47:16.695 INFO:tasks.workunit.client.0.smithi043.stdout:2/848: mkdir d0/d34/d3f/d59/dbc/d112 0 2024-04-25T13:47:16.707 INFO:tasks.workunit.client.0.smithi043.stdout:4/958: rename d1/d3/d54/d62/d77/d92/df6/d126 to d1/de/d1d/d20/d135 0 2024-04-25T13:47:16.709 INFO:tasks.workunit.client.0.smithi043.stdout:2/849: rename d0/d5/d2f/ld5 to d0/d34/d17/dc6/d5c/def/l113 0 2024-04-25T13:47:16.709 INFO:tasks.workunit.client.0.smithi043.stdout:4/959: creat d1/d3/d54/d62/d77/d92/f136 x:0 0 0 2024-04-25T13:47:16.711 INFO:tasks.workunit.client.0.smithi043.stdout:4/960: write d1/d3/d12b/d1a/d49/fa7 [5759029,78557] 0 2024-04-25T13:47:16.714 INFO:tasks.workunit.client.0.smithi043.stdout:2/850: mkdir d0/d34/d3f/d114 0 2024-04-25T13:47:16.716 INFO:tasks.workunit.client.0.smithi043.stdout:2/851: dread - d0/d34/d17/d5e/da9/dc3/f10d zero size 2024-04-25T13:47:16.717 INFO:tasks.workunit.client.0.smithi043.stdout:2/852: stat d0/d34/faf 0 2024-04-25T13:47:16.717 INFO:tasks.workunit.client.0.smithi043.stdout:4/961: unlink d1/de/d1d/d20/c96 0 2024-04-25T13:47:16.721 INFO:tasks.workunit.client.0.smithi043.stdout:9/566: dread d0/d1d/f64 [0,4194304] 0 2024-04-25T13:47:16.724 INFO:tasks.workunit.client.0.smithi043.stdout:4/962: dwrite d1/d3/d54/d62/d77/fbf [0,4194304] 0 2024-04-25T13:47:16.726 INFO:tasks.workunit.client.0.smithi043.stdout:2/853: dwrite d0/d34/d17/d5e/d9f/fad [0,4194304] 0 2024-04-25T13:47:16.726 INFO:tasks.workunit.client.0.smithi043.stdout:4/963: fsync d1/d34/d83/f12f 0 2024-04-25T13:47:16.729 INFO:tasks.workunit.client.0.smithi043.stdout:4/964: mkdir d1/d3/d54/d62/dba/d137 0 2024-04-25T13:47:16.730 INFO:tasks.workunit.client.0.smithi043.stdout:9/567: stat d0/d8b/d26/d39/d46 0 2024-04-25T13:47:16.731 INFO:tasks.workunit.client.0.smithi043.stdout:4/965: stat d1/d34/l55 0 2024-04-25T13:47:16.733 INFO:tasks.workunit.client.0.smithi043.stdout:3/894: sync 2024-04-25T13:47:16.735 INFO:tasks.workunit.client.0.smithi043.stdout:2/854: symlink d0/d34/d3f/d59/dbc/l115 0 2024-04-25T13:47:16.739 INFO:tasks.workunit.client.0.smithi043.stdout:3/895: rmdir d0/d9 39 2024-04-25T13:47:16.740 INFO:tasks.workunit.client.0.smithi043.stdout:2/855: write d0/d5/d2f/f79 [2106638,35283] 0 2024-04-25T13:47:16.742 INFO:tasks.workunit.client.0.smithi043.stdout:9/568: dwrite d0/d8b/d26/d39/d46/f75 [0,4194304] 0 2024-04-25T13:47:16.745 INFO:tasks.workunit.client.0.smithi043.stdout:2/856: creat d0/d34/d77/deb/f116 x:0 0 0 2024-04-25T13:47:16.745 INFO:tasks.workunit.client.0.smithi043.stdout:4/966: dwrite d1/d3/d12b/d1e/dc8/f10c [0,4194304] 0 2024-04-25T13:47:16.747 INFO:tasks.workunit.client.0.smithi043.stdout:9/569: mknod d0/d8b/d26/d39/d46/db9/cd4 0 2024-04-25T13:47:16.750 INFO:tasks.workunit.client.0.smithi043.stdout:2/857: mknod d0/d34/d17/d5e/da9/dc3/df5/c117 0 2024-04-25T13:47:16.753 INFO:tasks.workunit.client.0.smithi043.stdout:4/967: creat d1/d3/d54/f138 x:0 0 0 2024-04-25T13:47:16.756 INFO:tasks.workunit.client.0.smithi043.stdout:9/570: rename d0/d8b/d26/d47/d4d/fbb to d0/d8b/d26/d47/d4d/fd5 0 2024-04-25T13:47:16.757 INFO:tasks.workunit.client.0.smithi043.stdout:3/896: dwrite d0/da/db9/fdb [0,4194304] 0 2024-04-25T13:47:16.760 INFO:tasks.workunit.client.0.smithi043.stdout:3/897: write d0/d9/d6e/d34/d36/f4e [5232441,103038] 0 2024-04-25T13:47:16.766 INFO:tasks.workunit.client.0.smithi043.stdout:1/997: sync 2024-04-25T13:47:16.766 INFO:tasks.workunit.client.0.smithi043.stdout:5/968: sync 2024-04-25T13:47:16.768 INFO:tasks.workunit.client.0.smithi043.stdout:5/969: dread - d1/d3/d7/d8/df/d28/fab zero size 2024-04-25T13:47:16.770 INFO:tasks.workunit.client.0.smithi043.stdout:4/968: stat d1/d3/d54/d62/d77/d79/fca 0 2024-04-25T13:47:16.770 INFO:tasks.workunit.client.0.smithi043.stdout:5/970: fdatasync d1/d3/d7/de1/f135 0 2024-04-25T13:47:16.771 INFO:tasks.workunit.client.0.smithi043.stdout:5/971: readlink d1/d4/d42/l45 0 2024-04-25T13:47:16.773 INFO:tasks.workunit.client.0.smithi043.stdout:5/972: symlink d1/d4/deb/l13e 0 2024-04-25T13:47:16.775 INFO:tasks.workunit.client.0.smithi043.stdout:4/969: write d1/f14 [1238399,55357] 0 2024-04-25T13:47:16.777 INFO:tasks.workunit.client.0.smithi043.stdout:5/973: symlink d1/d3/d7/d2f/l13f 0 2024-04-25T13:47:16.777 INFO:tasks.workunit.client.0.smithi043.stdout:1/998: dread - df/d14/d63/d67/da7/ff3 zero size 2024-04-25T13:47:16.781 INFO:tasks.workunit.client.0.smithi043.stdout:1/999: mkdir df/d31/dc7/dc8/d172 0 2024-04-25T13:47:16.782 INFO:tasks.workunit.client.0.smithi043.stdout:4/970: write d1/d34/d83/f127 [2335223,26479] 0 2024-04-25T13:47:16.782 INFO:tasks.workunit.client.0.smithi043.stdout:2/858: rename d0/d34/d77 to d0/d34/d17/dc6/d118 0 2024-04-25T13:47:16.785 INFO:tasks.workunit.client.0.smithi043.stdout:5/974: dwrite d1/d3/d7/d8/df/d28/fab [0,4194304] 0 2024-04-25T13:47:16.786 INFO:tasks.workunit.client.0.smithi043.stdout:2/859: creat d0/d5/d2f/d10a/f119 x:0 0 0 2024-04-25T13:47:16.788 INFO:tasks.workunit.client.0.smithi043.stdout:4/971: mkdir d1/d3/d54/d62/d77/d79/d114/d139 0 2024-04-25T13:47:16.793 INFO:tasks.workunit.client.0.smithi043.stdout:4/972: truncate d1/d3/d12b/f16 1933719 0 2024-04-25T13:47:16.794 INFO:tasks.workunit.client.0.smithi043.stdout:4/973: chown d1/d3/d12b/f41 7 1 2024-04-25T13:47:16.812 INFO:tasks.workunit.client.0.smithi043.stdout:9/571: rename d0/d1d/d7/l86 to d0/d8b/d26/d39/d46/d62/ld6 0 2024-04-25T13:47:16.814 INFO:tasks.workunit.client.0.smithi043.stdout:5/975: dread d1/d8d/db8/fda [0,4194304] 0 2024-04-25T13:47:16.814 INFO:tasks.workunit.client.0.smithi043.stdout:9/572: fsync d0/d8b/d26/d47/d52/f80 0 2024-04-25T13:47:16.817 INFO:tasks.workunit.client.0.smithi043.stdout:4/974: dread d1/d3/d54/d110/d33/f86 [0,4194304] 0 2024-04-25T13:47:16.817 INFO:tasks.workunit.client.0.smithi043.stdout:4/975: readlink d1/d34/d83/lfd 0 2024-04-25T13:47:16.818 INFO:tasks.workunit.client.0.smithi043.stdout:4/976: fdatasync d1/f14 0 2024-04-25T13:47:16.820 INFO:tasks.workunit.client.0.smithi043.stdout:5/976: creat d1/d3/d7/d8/da/d11/f140 x:0 0 0 2024-04-25T13:47:16.821 INFO:tasks.workunit.client.0.smithi043.stdout:4/977: fdatasync d1/d3/d12b/d1a/d49/ff1 0 2024-04-25T13:47:16.822 INFO:tasks.workunit.client.0.smithi043.stdout:9/573: mknod d0/d8b/d26/d47/cd7 0 2024-04-25T13:47:16.825 INFO:tasks.workunit.client.0.smithi043.stdout:5/977: symlink d1/d3/d7/d9/l141 0 2024-04-25T13:47:16.828 INFO:tasks.workunit.client.0.smithi043.stdout:5/978: fsync d1/d3/d7/d9/d2d/faa 0 2024-04-25T13:47:16.829 INFO:tasks.workunit.client.0.smithi043.stdout:5/979: stat d1/d3/d7/d8/df/dfe/f74 0 2024-04-25T13:47:16.830 INFO:tasks.workunit.client.0.smithi043.stdout:4/978: creat d1/de/d1d/f13a x:0 0 0 2024-04-25T13:47:16.830 INFO:tasks.workunit.client.0.smithi043.stdout:9/574: write d0/d1d/d4a/f6a [2853509,23946] 0 2024-04-25T13:47:16.833 INFO:tasks.workunit.client.0.smithi043.stdout:9/575: write d0/d8b/f60 [1675210,7893] 0 2024-04-25T13:47:16.833 INFO:tasks.workunit.client.0.smithi043.stdout:2/860: dread d0/d34/d3f/d7b/dd4/d55/fcf [0,4194304] 0 2024-04-25T13:47:16.836 INFO:tasks.workunit.client.0.smithi043.stdout:4/979: creat d1/d3/d12b/d117/d123/f13b x:0 0 0 2024-04-25T13:47:16.839 INFO:tasks.workunit.client.0.smithi043.stdout:5/980: creat d1/d3/d7/d2f/d67/f142 x:0 0 0 2024-04-25T13:47:16.841 INFO:tasks.workunit.client.0.smithi043.stdout:5/981: mkdir d1/d3/d7/d8/df/d28/d143 0 2024-04-25T13:47:16.843 INFO:tasks.workunit.client.0.smithi043.stdout:2/861: write d0/d26/dd7/f102 [732985,47900] 0 2024-04-25T13:47:16.849 INFO:tasks.workunit.client.0.smithi043.stdout:2/862: fsync d0/d26/f31 0 2024-04-25T13:47:16.850 INFO:tasks.workunit.client.0.smithi043.stdout:9/576: dwrite d0/f79 [0,4194304] 0 2024-04-25T13:47:16.850 INFO:tasks.workunit.client.0.smithi043.stdout:3/898: rename d0/d13/d55/dd9/df5/d8e/d92/d133 to d0/da/db9/d9e/d134 0 2024-04-25T13:47:16.852 INFO:tasks.workunit.client.0.smithi043.stdout:9/577: chown d0/d8b/d9b/da2 348885280 1 2024-04-25T13:47:16.853 INFO:tasks.workunit.client.0.smithi043.stdout:2/863: mknod d0/d8/d9b/c11a 0 2024-04-25T13:47:16.855 INFO:tasks.workunit.client.0.smithi043.stdout:5/982: dwrite d1/d3/fd6 [0,4194304] 0 2024-04-25T13:47:16.856 INFO:tasks.workunit.client.0.smithi043.stdout:3/899: unlink d0/d9/d6e/d34/d36/d57/de5/lf1 0 2024-04-25T13:47:16.857 INFO:tasks.workunit.client.0.smithi043.stdout:3/900: fdatasync d0/da/db9/f10c 0 2024-04-25T13:47:16.859 INFO:tasks.workunit.client.0.smithi043.stdout:9/578: link d0/f1e d0/d8b/dcd/fd8 0 2024-04-25T13:47:16.861 INFO:tasks.workunit.client.0.smithi043.stdout:9/579: readlink d0/d1d/d4a/l84 0 2024-04-25T13:47:16.867 INFO:tasks.workunit.client.0.smithi043.stdout:5/983: dwrite d1/d3/d7/d8/fc2 [0,4194304] 0 2024-04-25T13:47:16.867 INFO:tasks.workunit.client.0.smithi043.stdout:3/901: write d0/d61/d82/fc6 [4005968,99199] 0 2024-04-25T13:47:16.869 INFO:tasks.workunit.client.0.smithi043.stdout:5/984: chown d1/f19 439 1 2024-04-25T13:47:16.869 INFO:tasks.workunit.client.0.smithi043.stdout:2/864: rename d0/d8/d9b/ca6 to d0/d34/d17/dc6/d118/deb/c11b 0 2024-04-25T13:47:16.871 INFO:tasks.workunit.client.0.smithi043.stdout:2/865: readlink d0/d34/l7a 0 2024-04-25T13:47:16.874 INFO:tasks.workunit.client.0.smithi043.stdout:3/902: write d0/f96 [2070047,129083] 0 2024-04-25T13:47:16.874 INFO:tasks.workunit.client.0.smithi043.stdout:5/985: getdents d1/d3/d7/d9/d2d/d36 0 2024-04-25T13:47:16.875 INFO:tasks.workunit.client.0.smithi043.stdout:9/580: dread d0/d8b/d26/d39/d46/f5e [4194304,4194304] 0 2024-04-25T13:47:16.882 INFO:tasks.workunit.client.0.smithi043.stdout:5/986: mknod d1/d3/d7/de1/d115/c144 0 2024-04-25T13:47:16.882 INFO:tasks.workunit.client.0.smithi043.stdout:5/987: chown d1/d4/d92/d95/fd8 112764 1 2024-04-25T13:47:16.884 INFO:tasks.workunit.client.0.smithi043.stdout:5/988: write d1/d3/d7/d8/df/d28/faf [176677,32869] 0 2024-04-25T13:47:16.886 INFO:tasks.workunit.client.0.smithi043.stdout:9/581: getdents d0/d8b/d26/d39/d46 0 2024-04-25T13:47:16.890 INFO:tasks.workunit.client.0.smithi043.stdout:2/866: rmdir d0/d34/d17/dc6/d36 39 2024-04-25T13:47:16.891 INFO:tasks.workunit.client.0.smithi043.stdout:3/903: dread d0/da/f43 [0,4194304] 0 2024-04-25T13:47:16.893 INFO:tasks.workunit.client.0.smithi043.stdout:3/904: dread - d0/d13/d2e/db1/ff6 zero size 2024-04-25T13:47:16.895 INFO:tasks.workunit.client.0.smithi043.stdout:5/989: dread d1/d3/d7/d8/df/dfe/fb1 [0,4194304] 0 2024-04-25T13:47:16.896 INFO:tasks.workunit.client.0.smithi043.stdout:3/905: write d0/da/db9/d9e/f107 [3574292,121762] 0 2024-04-25T13:47:16.900 INFO:tasks.workunit.client.0.smithi043.stdout:3/906: mknod d0/d13/d55/dd9/df5/d8e/d12c/c135 0 2024-04-25T13:47:16.902 INFO:tasks.workunit.client.0.smithi043.stdout:3/907: stat d0/d13/d55/fa9 0 2024-04-25T13:47:16.904 INFO:tasks.workunit.client.0.smithi043.stdout:2/867: dwrite d0/d34/d17/dc6/d36/fb6 [4194304,4194304] 0 2024-04-25T13:47:16.905 INFO:tasks.workunit.client.0.smithi043.stdout:9/582: dread d0/d8b/d26/d39/d46/f50 [0,4194304] 0 2024-04-25T13:47:16.906 INFO:tasks.workunit.client.0.smithi043.stdout:2/868: write d0/d34/d3f/d59/f103 [54480,109616] 0 2024-04-25T13:47:16.912 INFO:tasks.workunit.client.0.smithi043.stdout:5/990: rename d1/d3/d24/l66 to d1/d3/d62/df3/l145 0 2024-04-25T13:47:16.913 INFO:tasks.workunit.client.0.smithi043.stdout:5/991: write d1/d8d/f126 [697040,82536] 0 2024-04-25T13:47:16.915 INFO:tasks.workunit.client.0.smithi043.stdout:2/869: dwrite d0/d34/d17/d5e/d71/d81/fa8 [12582912,4194304] 0 2024-04-25T13:47:16.915 INFO:tasks.workunit.client.0.smithi043.stdout:2/870: chown d0/d4b 1499646 1 2024-04-25T13:47:16.918 INFO:tasks.workunit.client.0.smithi043.stdout:2/871: mkdir d0/d5/d1e/d11c 0 2024-04-25T13:47:16.920 INFO:tasks.workunit.client.0.smithi043.stdout:2/872: chown d0/d34/d17/dc6/d118/ce6 4896 1 2024-04-25T13:47:16.921 INFO:tasks.workunit.client.0.smithi043.stdout:9/583: write d0/d1d/d7/f49 [4729472,118561] 0 2024-04-25T13:47:16.923 INFO:tasks.workunit.client.0.smithi043.stdout:2/873: rmdir d0/d34/d17/d5e 39 2024-04-25T13:47:16.924 INFO:tasks.workunit.client.0.smithi043.stdout:5/992: dwrite d1/d3/f81 [4194304,4194304] 0 2024-04-25T13:47:16.926 INFO:tasks.workunit.client.0.smithi043.stdout:2/874: chown d0/d5/d2f/d10a/f119 7891488 1 2024-04-25T13:47:16.931 INFO:tasks.workunit.client.0.smithi043.stdout:5/993: getdents d1/d3/d62 0 2024-04-25T13:47:16.931 INFO:tasks.workunit.client.0.smithi043.stdout:2/875: creat d0/d34/d17/dc6/d36/f11d x:0 0 0 2024-04-25T13:47:16.932 INFO:tasks.workunit.client.0.smithi043.stdout:9/584: dwrite d0/d1d/d7/f95 [0,4194304] 0 2024-04-25T13:47:16.936 INFO:tasks.workunit.client.0.smithi043.stdout:2/876: mknod d0/d34/d17/dc6/d118/dc9/c11e 0 2024-04-25T13:47:16.941 INFO:tasks.workunit.client.0.smithi043.stdout:5/994: unlink d1/d8d/db8/fdb 0 2024-04-25T13:47:16.942 INFO:tasks.workunit.client.0.smithi043.stdout:2/877: mknod d0/d34/d17/da0/dd2/c11f 0 2024-04-25T13:47:16.943 INFO:tasks.workunit.client.0.smithi043.stdout:9/585: rmdir d0/d8b/d26 39 2024-04-25T13:47:16.944 INFO:tasks.workunit.client.0.smithi043.stdout:2/878: stat d0/d34/d17/dc6/l54 0 2024-04-25T13:47:16.945 INFO:tasks.workunit.client.0.smithi043.stdout:2/879: dread - d0/d26/ff2 zero size 2024-04-25T13:47:16.947 INFO:tasks.workunit.client.0.smithi043.stdout:5/995: link d1/d3/d7/d8/da/f9d d1/d3/d7/de1/f146 0 2024-04-25T13:47:16.949 INFO:tasks.workunit.client.0.smithi043.stdout:2/880: symlink d0/d34/d17/d5e/da9/l120 0 2024-04-25T13:47:16.951 INFO:tasks.workunit.client.0.smithi043.stdout:5/996: unlink d1/d3/d7/d2f/d80/fbb 0 2024-04-25T13:47:16.951 INFO:tasks.workunit.client.0.smithi043.stdout:5/997: stat d1/d3/d7/d8/df/d98 0 2024-04-25T13:47:16.956 INFO:tasks.workunit.client.0.smithi043.stdout:5/998: truncate d1/d3/d7/d2f/fd1 2105313 0 2024-04-25T13:47:16.957 INFO:tasks.workunit.client.0.smithi043.stdout:2/881: mkdir d0/d34/d17/da0/d121 0 2024-04-25T13:47:16.959 INFO:tasks.workunit.client.0.smithi043.stdout:9/586: truncate d0/d1d/d22/f43 3270650 0 2024-04-25T13:47:16.962 INFO:tasks.workunit.client.0.smithi043.stdout:2/882: symlink d0/l122 0 2024-04-25T13:47:16.966 INFO:tasks.workunit.client.0.smithi043.stdout:5/999: write d1/d4/d42/fa9 [4373593,7176] 0 2024-04-25T13:47:16.967 INFO:tasks.workunit.client.0.smithi043.stdout:2/883: write d0/d34/d17/d5e/d9f/fad [4304256,107995] 0 2024-04-25T13:47:16.972 INFO:tasks.workunit.client.0.smithi043.stdout:2/884: unlink d0/d5/d1e/f6b 0 2024-04-25T13:47:16.973 INFO:tasks.workunit.client.0.smithi043.stdout:2/885: chown d0/d34/d3f/d7b/dd4 4 1 2024-04-25T13:47:16.983 INFO:tasks.workunit.client.0.smithi043.stdout:2/886: dwrite d0/d34/d17/da0/fd1 [0,4194304] 0 2024-04-25T13:47:16.986 INFO:tasks.workunit.client.0.smithi043.stdout:9/587: rename d0/d1d/d7/f2e to d0/d8b/d26/d39/d46/db9/fd9 0 2024-04-25T13:47:16.989 INFO:tasks.workunit.client.0.smithi043.stdout:9/588: mknod d0/d8b/d26/d39/d46/db9/cda 0 2024-04-25T13:47:16.991 INFO:tasks.workunit.client.0.smithi043.stdout:2/887: rmdir d0/d34/d17/dc6 39 2024-04-25T13:47:16.991 INFO:tasks.workunit.client.0.smithi043.stdout:9/589: truncate d0/d8b/d26/d39/d46/dba/fd0 996880 0 2024-04-25T13:47:16.991 INFO:tasks.workunit.client.0.smithi043.stdout:9/590: readlink d0/d1d/d4a/l84 0 2024-04-25T13:47:16.994 INFO:tasks.workunit.client.0.smithi043.stdout:2/888: stat d0/d34/d17/dc6/d5c 0 2024-04-25T13:47:16.997 INFO:tasks.workunit.client.0.smithi043.stdout:2/889: mknod d0/d34/d17/dc6/d10c/c123 0 2024-04-25T13:47:16.997 INFO:tasks.workunit.client.0.smithi043.stdout:9/591: mkdir d0/d8b/d26/ddb 0 2024-04-25T13:47:16.998 INFO:tasks.workunit.client.0.smithi043.stdout:2/890: chown d0/d34/faf 215948841 1 2024-04-25T13:47:17.000 INFO:tasks.workunit.client.0.smithi043.stdout:9/592: creat d0/da7/dd2/fdc x:0 0 0 2024-04-25T13:47:17.001 INFO:tasks.workunit.client.0.smithi043.stdout:9/593: write d0/d8b/f60 [951445,27557] 0 2024-04-25T13:47:17.003 INFO:tasks.workunit.client.0.smithi043.stdout:9/594: symlink d0/d1d/d4a/ldd 0 2024-04-25T13:47:17.007 INFO:tasks.workunit.client.0.smithi043.stdout:9/595: rename d0/d1d/l11 to d0/d8b/d9b/lde 0 2024-04-25T13:47:17.009 INFO:tasks.workunit.client.0.smithi043.stdout:9/596: mkdir d0/d1d/d7/d83/ddf 0 2024-04-25T13:47:17.010 INFO:tasks.workunit.client.0.smithi043.stdout:9/597: stat d0/d8b/c8e 0 2024-04-25T13:47:17.011 INFO:tasks.workunit.client.0.smithi043.stdout:9/598: dread - d0/d1d/f1a zero size 2024-04-25T13:47:17.012 INFO:tasks.workunit.client.0.smithi043.stdout:9/599: chown d0/d1d/d7/d83 1740060 1 2024-04-25T13:47:17.014 INFO:tasks.workunit.client.0.smithi043.stdout:9/600: symlink d0/d1d/le0 0 2024-04-25T13:47:17.014 INFO:tasks.workunit.client.0.smithi043.stdout:9/601: stat d0/d1d/d22 0 2024-04-25T13:47:17.015 INFO:tasks.workunit.client.0.smithi043.stdout:9/602: write d0/d1d/d7/f5a [261799,115930] 0 2024-04-25T13:47:17.028 INFO:tasks.workunit.client.0.smithi043.stdout:9/603: chown d0/d8b/d26/d47/d52/lb8 10 1 2024-04-25T13:47:17.029 INFO:tasks.workunit.client.0.smithi043.stdout:9/604: mknod d0/d8b/d9b/ce1 0 2024-04-25T13:47:17.038 INFO:tasks.workunit.client.0.smithi043.stdout:9/605: dwrite d0/d8b/f23 [4194304,4194304] 0 2024-04-25T13:47:17.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:16 smithi161 ceph-mon[32696]: pgmap v83: 129 pgs: 129 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 153 MiB/s wr, 352 op/s 2024-04-25T13:47:17.120 INFO:tasks.workunit.client.0.smithi043.stdout:4/980: sync 2024-04-25T13:47:17.120 INFO:tasks.workunit.client.0.smithi043.stdout:3/908: sync 2024-04-25T13:47:17.123 INFO:tasks.workunit.client.0.smithi043.stdout:4/981: read d1/d3/d12b/d1a/f4c [813021,26125] 0 2024-04-25T13:47:17.126 INFO:tasks.workunit.client.0.smithi043.stdout:3/909: link d0/da/db9/c117 d0/d9/d6e/d38/c136 0 2024-04-25T13:47:17.127 INFO:tasks.workunit.client.0.smithi043.stdout:3/910: fsync d0/d61/d82/fc6 0 2024-04-25T13:47:17.129 INFO:tasks.workunit.client.0.smithi043.stdout:3/911: chown d0/d9/d6e/d34/f7f 1813348 1 2024-04-25T13:47:17.131 INFO:tasks.workunit.client.0.smithi043.stdout:4/982: dread d1/d3/d12b/d1e/fec [0,4194304] 0 2024-04-25T13:47:17.131 INFO:tasks.workunit.client.0.smithi043.stdout:3/912: creat d0/d61/d82/f137 x:0 0 0 2024-04-25T13:47:17.134 INFO:tasks.workunit.client.0.smithi043.stdout:4/983: mknod d1/de/d1d/d20/c13c 0 2024-04-25T13:47:17.136 INFO:tasks.workunit.client.0.smithi043.stdout:4/984: rmdir d1/d6a 39 2024-04-25T13:47:17.136 INFO:tasks.workunit.client.0.smithi043.stdout:3/913: write d0/d9/d6e/d34/d36/fc9 [1683362,83376] 0 2024-04-25T13:47:17.138 INFO:tasks.workunit.client.0.smithi043.stdout:3/914: write d0/d9/f62 [1779535,324] 0 2024-04-25T13:47:17.138 INFO:tasks.workunit.client.0.smithi043.stdout:3/915: chown d0/da/f43 0 1 2024-04-25T13:47:17.139 INFO:tasks.workunit.client.0.smithi043.stdout:4/985: creat d1/d3/d12b/f13d x:0 0 0 2024-04-25T13:47:17.141 INFO:tasks.workunit.client.0.smithi043.stdout:3/916: write d0/da/db9/d9e/fed [1065659,106043] 0 2024-04-25T13:47:17.146 INFO:tasks.workunit.client.0.smithi043.stdout:3/917: getdents d0/da/db9/df9 0 2024-04-25T13:47:17.153 INFO:tasks.workunit.client.0.smithi043.stdout:4/986: write d1/d3/d7b/fa8 [4092926,42207] 0 2024-04-25T13:47:17.156 INFO:tasks.workunit.client.0.smithi043.stdout:3/918: creat d0/d13/d55/dd9/df5/d8e/d92/dc3/d129/f138 x:0 0 0 2024-04-25T13:47:17.157 INFO:tasks.workunit.client.0.smithi043.stdout:4/987: write d1/d3/d54/d62/d77/d92/dc5/fb2 [2401943,3677] 0 2024-04-25T13:47:17.157 INFO:tasks.workunit.client.0.smithi043.stdout:3/919: stat d0/d9/d6e/d34/d36/fc9 0 2024-04-25T13:47:17.162 INFO:tasks.workunit.client.0.smithi043.stdout:3/920: getdents d0 0 2024-04-25T13:47:17.164 INFO:tasks.workunit.client.0.smithi043.stdout:4/988: dwrite d1/d3/f100 [4194304,4194304] 0 2024-04-25T13:47:17.165 INFO:tasks.workunit.client.0.smithi043.stdout:4/989: read - d1/d3/d12b/d117/d123/f13b zero size 2024-04-25T13:47:17.167 INFO:tasks.workunit.client.0.smithi043.stdout:3/921: getdents d0/d9/d6e 0 2024-04-25T13:47:17.176 INFO:tasks.workunit.client.0.smithi043.stdout:3/922: dwrite d0/d13/d55/dd9/df5/fa1 [4194304,4194304] 0 2024-04-25T13:47:17.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:16 smithi175 ceph-mon[32649]: pgmap v83: 129 pgs: 129 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 153 MiB/s wr, 352 op/s 2024-04-25T13:47:17.184 INFO:tasks.workunit.client.0.smithi043.stdout:4/990: link d1/d34/d83/d11a/f78 d1/d3/d54/d62/d77/f13e 0 2024-04-25T13:47:17.185 INFO:tasks.workunit.client.0.smithi043.stdout:2/891: sync 2024-04-25T13:47:17.190 INFO:tasks.workunit.client.0.smithi043.stdout:2/892: mkdir d0/d34/d17/dc6/d5c/d124 0 2024-04-25T13:47:17.191 INFO:tasks.workunit.client.0.smithi043.stdout:2/893: chown d0/d34/d17/ced 30 1 2024-04-25T13:47:17.191 INFO:tasks.workunit.client.0.smithi043.stdout:4/991: getdents d1/de/d1d 0 2024-04-25T13:47:17.198 INFO:tasks.workunit.client.0.smithi043.stdout:4/992: dwrite d1/d34/d83/d11a/f51 [0,4194304] 0 2024-04-25T13:47:17.200 INFO:tasks.workunit.client.0.smithi043.stdout:3/923: rename d0/c51 to d0/da/db9/d9e/c139 0 2024-04-25T13:47:17.200 INFO:tasks.workunit.client.0.smithi043.stdout:2/894: write d0/d34/d17/dc6/d118/f95 [705731,39943] 0 2024-04-25T13:47:17.208 INFO:tasks.workunit.client.0.smithi043.stdout:3/924: chown d0/l37 403379581 1 2024-04-25T13:47:17.209 INFO:tasks.workunit.client.0.smithi043.stdout:4/993: dwrite d1/d3/d12b/d1e/d45/f88 [0,4194304] 0 2024-04-25T13:47:17.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:16 smithi043 ceph-mon[29195]: pgmap v83: 129 pgs: 129 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 153 MiB/s wr, 352 op/s 2024-04-25T13:47:17.212 INFO:tasks.workunit.client.0.smithi043.stdout:4/994: chown d1/d34/d83/d11a/fcb 50 1 2024-04-25T13:47:17.213 INFO:tasks.workunit.client.0.smithi043.stdout:4/995: chown d1/cc 79698 1 2024-04-25T13:47:17.214 INFO:tasks.workunit.client.0.smithi043.stdout:2/895: dwrite d0/d34/d17/d5e/da9/dc3/f10d [0,4194304] 0 2024-04-25T13:47:17.217 INFO:tasks.workunit.client.0.smithi043.stdout:4/996: readlink d1/de/d1d/d20/d135/d3a/l121 0 2024-04-25T13:47:17.217 INFO:tasks.workunit.client.0.smithi043.stdout:2/896: mknod d0/d34/d3f/d59/dbc/c125 0 2024-04-25T13:47:17.220 INFO:tasks.workunit.client.0.smithi043.stdout:4/997: symlink d1/d3/d54/d110/d33/l13f 0 2024-04-25T13:47:17.225 INFO:tasks.workunit.client.0.smithi043.stdout:4/998: symlink d1/d3/d54/l140 0 2024-04-25T13:47:17.226 INFO:tasks.workunit.client.0.smithi043.stdout:4/999: write d1/d34/d83/f12f [967383,119980] 0 2024-04-25T13:47:17.234 INFO:tasks.workunit.client.0.smithi043.stdout:9/606: sync 2024-04-25T13:47:17.236 INFO:tasks.workunit.client.0.smithi043.stdout:9/607: chown d0/d8b/d26/d47/la6 91 1 2024-04-25T13:47:17.237 INFO:tasks.workunit.client.0.smithi043.stdout:3/925: rename d0/d9/d6e/l2b to d0/d13/d55/dd9/df5/d8e/d92/l13a 0 2024-04-25T13:47:17.238 INFO:tasks.workunit.client.0.smithi043.stdout:3/926: chown d0/d61/cd4 128976287 1 2024-04-25T13:47:17.244 INFO:tasks.workunit.client.0.smithi043.stdout:3/927: dwrite d0/d13/d5a/f12a [0,4194304] 0 2024-04-25T13:47:17.245 INFO:tasks.workunit.client.0.smithi043.stdout:3/928: fsync d0/d13/d55/dd9/df5/d8e/d92/dc3/d129/f138 0 2024-04-25T13:47:17.247 INFO:tasks.workunit.client.0.smithi043.stdout:3/929: dread - d0/d13/d5a/d90/f11d zero size 2024-04-25T13:47:17.256 INFO:tasks.workunit.client.0.smithi043.stdout:3/930: read d0/d9/d6e/d38/fd8 [1693521,44951] 0 2024-04-25T13:47:17.770 INFO:tasks.workunit.client.0.smithi043.stdout:3/931: dread d0/d9/d6e/d34/d36/d57/f98 [0,4194304] 0 2024-04-25T13:47:17.774 INFO:tasks.workunit.client.0.smithi043.stdout:3/932: fdatasync d0/d9/f86 0 2024-04-25T13:47:17.777 INFO:tasks.workunit.client.0.smithi043.stdout:3/933: chown d0/d13/l6d 368 1 2024-04-25T13:47:17.786 INFO:tasks.workunit.client.0.smithi043.stdout:3/934: creat d0/d13/d5a/f13b x:0 0 0 2024-04-25T13:47:17.797 INFO:tasks.workunit.client.0.smithi043.stdout:3/935: getdents d0/da/db9/df7 0 2024-04-25T13:47:17.803 INFO:tasks.workunit.client.0.smithi043.stdout:3/936: getdents d0/d8d 0 2024-04-25T13:47:17.807 INFO:tasks.workunit.client.0.smithi043.stdout:3/937: symlink d0/d13/d55/dd9/df5/d8e/d92/dc3/d129/l13c 0 2024-04-25T13:47:17.811 INFO:tasks.workunit.client.0.smithi043.stdout:3/938: creat d0/d9/d6e/d34/d36/d105/f13d x:0 0 0 2024-04-25T13:47:17.811 INFO:tasks.workunit.client.0.smithi043.stdout:3/939: dread - d0/d9/f131 zero size 2024-04-25T13:47:17.846 INFO:tasks.workunit.client.0.smithi043.stdout:2/897: rename d0/d34/d17/f89 to d0/d34/d17/dc6/d5c/d124/f126 0 2024-04-25T13:47:17.847 INFO:tasks.workunit.client.0.smithi043.stdout:3/940: symlink d0/d13/d5a/d90/l13e 0 2024-04-25T13:47:17.848 INFO:tasks.workunit.client.0.smithi043.stdout:3/941: dread - d0/d13/d5a/f13b zero size 2024-04-25T13:47:17.852 INFO:tasks.workunit.client.0.smithi043.stdout:9/608: rename d0/d8b/f1b to d0/d1d/d7/d81/fe2 0 2024-04-25T13:47:17.853 INFO:tasks.workunit.client.0.smithi043.stdout:2/898: creat d0/d34/f127 x:0 0 0 2024-04-25T13:47:17.856 INFO:tasks.workunit.client.0.smithi043.stdout:3/942: creat d0/d13/d55/dd9/df5/d8e/d92/f13f x:0 0 0 2024-04-25T13:47:17.858 INFO:tasks.workunit.client.0.smithi043.stdout:3/943: fdatasync d0/da/db9/d9e/fc4 0 2024-04-25T13:47:17.860 INFO:tasks.workunit.client.0.smithi043.stdout:3/944: mknod d0/d13/d55/dd9/c140 0 2024-04-25T13:47:17.863 INFO:tasks.workunit.client.0.smithi043.stdout:2/899: fsync d0/d34/d17/d5e/d71/fff 0 2024-04-25T13:47:17.865 INFO:tasks.workunit.client.0.smithi043.stdout:2/900: truncate d0/d8/d9b/ddb/dda/d104/f110 979285 0 2024-04-25T13:47:17.865 INFO:tasks.workunit.client.0.smithi043.stdout:2/901: dread - d0/d34/f127 zero size 2024-04-25T13:47:17.867 INFO:tasks.workunit.client.0.smithi043.stdout:2/902: creat d0/d34/d17/dc6/d10c/f128 x:0 0 0 2024-04-25T13:47:17.868 INFO:tasks.workunit.client.0.smithi043.stdout:2/903: dread - d0/d34/d17/dc6/d10c/f128 zero size 2024-04-25T13:47:17.871 INFO:tasks.workunit.client.0.smithi043.stdout:2/904: creat d0/d34/d17/d5e/da9/dc3/df5/f129 x:0 0 0 2024-04-25T13:47:17.877 INFO:tasks.workunit.client.0.smithi043.stdout:2/905: dwrite d0/d5/d2f/d8d/fe2 [0,4194304] 0 2024-04-25T13:47:17.880 INFO:tasks.workunit.client.0.smithi043.stdout:2/906: truncate d0/d8/fd 4499249 0 2024-04-25T13:47:17.883 INFO:tasks.workunit.client.0.smithi043.stdout:2/907: fsync d0/d34/d17/dc6/fbe 0 2024-04-25T13:47:17.886 INFO:tasks.workunit.client.0.smithi043.stdout:2/908: mkdir d0/d34/d3f/d7b/dd4/d55/d12a 0 2024-04-25T13:47:17.889 INFO:tasks.workunit.client.0.smithi043.stdout:2/909: creat d0/d34/d17/da0/dd2/f12b x:0 0 0 2024-04-25T13:47:17.894 INFO:tasks.workunit.client.0.smithi043.stdout:2/910: unlink d0/d34/d17/dc6/d5c/def/l113 0 2024-04-25T13:47:17.896 INFO:tasks.workunit.client.0.smithi043.stdout:2/911: symlink d0/d5/d2f/d8d/l12c 0 2024-04-25T13:47:17.897 INFO:tasks.workunit.client.0.smithi043.stdout:2/912: dread - d0/d34/d3f/d7b/f111 zero size 2024-04-25T13:47:17.909 INFO:tasks.workunit.client.0.smithi043.stdout:2/913: rename d0/d34/d17/dc6/d36/l4f to d0/d34/d3f/d7b/dd4/d55/d12a/l12d 0 2024-04-25T13:47:17.924 INFO:tasks.workunit.client.0.smithi043.stdout:2/914: link d0/d34/d17/dc6/ffe d0/d34/d3f/d7b/dd4/f12e 0 2024-04-25T13:47:17.940 INFO:tasks.workunit.client.0.smithi043.stdout:2/915: link d0/d34/d17/dc6/d10c/f128 d0/d34/d3f/d7b/dd4/dee/f12f 0 2024-04-25T13:47:17.947 INFO:tasks.workunit.client.0.smithi043.stdout:2/916: link d0/d34/d17/d5e/d86/l9a d0/d5/d1e/d11c/l130 0 2024-04-25T13:47:17.948 INFO:tasks.workunit.client.0.smithi043.stdout:3/945: dwrite d0/da/f2d [4194304,4194304] 0 2024-04-25T13:47:17.952 INFO:tasks.workunit.client.0.smithi043.stdout:3/946: getdents d0/da/dcc 0 2024-04-25T13:47:17.955 INFO:tasks.workunit.client.0.smithi043.stdout:2/917: dwrite d0/d5/d2f/fd6 [0,4194304] 0 2024-04-25T13:47:17.956 INFO:tasks.workunit.client.0.smithi043.stdout:3/947: creat d0/d9/d6e/d34/d36/f141 x:0 0 0 2024-04-25T13:47:17.956 INFO:tasks.workunit.client.0.smithi043.stdout:3/948: readlink d0/l120 0 2024-04-25T13:47:17.958 INFO:tasks.workunit.client.0.smithi043.stdout:3/949: mkdir d0/d61/d142 0 2024-04-25T13:47:17.961 INFO:tasks.workunit.client.0.smithi043.stdout:2/918: rename d0/c16 to d0/d34/d17/dc6/d5c/c131 0 2024-04-25T13:47:17.962 INFO:tasks.workunit.client.0.smithi043.stdout:3/950: chown d0/da/f28 2 1 2024-04-25T13:47:17.964 INFO:tasks.workunit.client.0.smithi043.stdout:2/919: unlink d0/d35/l5f 0 2024-04-25T13:47:17.970 INFO:tasks.workunit.client.0.smithi043.stdout:2/920: dwrite d0/d34/d17/dc6/d118/deb/f101 [0,4194304] 0 2024-04-25T13:47:17.982 INFO:tasks.workunit.client.0.smithi043.stdout:2/921: read - d0/d34/d17/dc6/d36/fc1 zero size 2024-04-25T13:47:17.982 INFO:tasks.workunit.client.0.smithi043.stdout:2/922: readlink d0/d34/d17/d5e/d71/lae 0 2024-04-25T13:47:17.985 INFO:tasks.workunit.client.0.smithi043.stdout:2/923: symlink d0/d34/d3f/d59/l132 0 2024-04-25T13:47:17.987 INFO:tasks.workunit.client.0.smithi043.stdout:2/924: write d0/d8/d9b/ddb/dda/d104/f110 [608540,23361] 0 2024-04-25T13:47:17.989 INFO:tasks.workunit.client.0.smithi043.stdout:2/925: creat d0/d34/d17/dc6/d5c/d124/f133 x:0 0 0 2024-04-25T13:47:17.991 INFO:tasks.workunit.client.0.smithi043.stdout:2/926: dread - d0/d35/fc5 zero size 2024-04-25T13:47:17.994 INFO:tasks.workunit.client.0.smithi043.stdout:2/927: rmdir d0/d34/d17/dc6/d118/dc9 39 2024-04-25T13:47:17.995 INFO:tasks.workunit.client.0.smithi043.stdout:3/951: rename d0/da/db9/c117 to d0/d13/d5a/d90/c143 0 2024-04-25T13:47:17.996 INFO:tasks.workunit.client.0.smithi043.stdout:2/928: creat d0/d34/d17/d5e/d71/f134 x:0 0 0 2024-04-25T13:47:17.998 INFO:tasks.workunit.client.0.smithi043.stdout:3/952: creat d0/d13/d55/dd9/df5/d8e/d12c/f144 x:0 0 0 2024-04-25T13:47:18.000 INFO:tasks.workunit.client.0.smithi043.stdout:2/929: creat d0/d34/d17/dc6/d5c/f135 x:0 0 0 2024-04-25T13:47:18.003 INFO:tasks.workunit.client.0.smithi043.stdout:9/609: sync 2024-04-25T13:47:18.005 INFO:tasks.workunit.client.0.smithi043.stdout:2/930: write d0/d34/d17/f41 [2851847,78283] 0 2024-04-25T13:47:18.006 INFO:tasks.workunit.client.0.smithi043.stdout:2/931: read - d0/d5/d1e/f107 zero size 2024-04-25T13:47:18.007 INFO:tasks.workunit.client.0.smithi043.stdout:9/610: write d0/d1d/d22/d67/f71 [3829567,106946] 0 2024-04-25T13:47:18.009 INFO:tasks.workunit.client.0.smithi043.stdout:2/932: read d0/d26/f33 [2095788,127549] 0 2024-04-25T13:47:18.012 INFO:tasks.workunit.client.0.smithi043.stdout:3/953: mknod d0/da/db9/d9e/c145 0 2024-04-25T13:47:18.013 INFO:tasks.workunit.client.0.smithi043.stdout:9/611: creat d0/d8b/d9b/da2/fe3 x:0 0 0 2024-04-25T13:47:18.014 INFO:tasks.workunit.client.0.smithi043.stdout:3/954: dread - d0/d61/d82/fdd zero size 2024-04-25T13:47:18.018 INFO:tasks.workunit.client.0.smithi043.stdout:2/933: dwrite d0/d5/d2f/d10a/f119 [0,4194304] 0 2024-04-25T13:47:18.019 INFO:tasks.workunit.client.0.smithi043.stdout:9/612: symlink d0/d8b/d26/d39/d46/le4 0 2024-04-25T13:47:18.022 INFO:tasks.workunit.client.0.smithi043.stdout:2/934: unlink d0/d34/d17/da0/dd2/f12b 0 2024-04-25T13:47:18.023 INFO:tasks.workunit.client.0.smithi043.stdout:3/955: dwrite d0/d61/fe3 [0,4194304] 0 2024-04-25T13:47:18.024 INFO:tasks.workunit.client.0.smithi043.stdout:2/935: dread - d0/d34/d17/d5e/d71/f134 zero size 2024-04-25T13:47:18.041 INFO:tasks.workunit.client.0.smithi043.stdout:2/936: dwrite d0/d34/d3f/d7b/dd4/f12e [0,4194304] 0 2024-04-25T13:47:18.045 INFO:tasks.workunit.client.0.smithi043.stdout:3/956: rename d0/d13/d55/laf to d0/da/db9/d9e/l146 0 2024-04-25T13:47:18.046 INFO:tasks.workunit.client.0.smithi043.stdout:2/937: dread d0/d5/d2f/d8d/fe2 [0,4194304] 0 2024-04-25T13:47:18.047 INFO:tasks.workunit.client.0.smithi043.stdout:3/957: fsync d0/d13/ffb 0 2024-04-25T13:47:18.049 INFO:tasks.workunit.client.0.smithi043.stdout:3/958: fdatasync d0/f35 0 2024-04-25T13:47:18.049 INFO:tasks.workunit.client.0.smithi043.stdout:2/938: chown d0/d34/d3f/d7b/dd4/l6c 16 1 2024-04-25T13:47:18.055 INFO:tasks.workunit.client.0.smithi043.stdout:3/959: dwrite d0/d13/d5a/f124 [0,4194304] 0 2024-04-25T13:47:18.058 INFO:tasks.workunit.client.0.smithi043.stdout:3/960: read - d0/d13/d5a/d90/fe7 zero size 2024-04-25T13:47:18.063 INFO:tasks.workunit.client.0.smithi043.stdout:2/939: link d0/d34/d17/d5e/d71/fb7 d0/d34/d17/da0/d121/f136 0 2024-04-25T13:47:18.064 INFO:tasks.workunit.client.0.smithi043.stdout:3/961: dwrite d0/da/db9/df9/f125 [4194304,4194304] 0 2024-04-25T13:47:18.066 INFO:tasks.workunit.client.0.smithi043.stdout:2/940: symlink d0/d8/d9b/ddb/dda/l137 0 2024-04-25T13:47:18.070 INFO:tasks.workunit.client.0.smithi043.stdout:3/962: write d0/f9f [622901,47417] 0 2024-04-25T13:47:18.075 INFO:tasks.workunit.client.0.smithi043.stdout:3/963: write d0/d13/d55/dd9/df5/d8e/d92/fb0 [4346178,77029] 0 2024-04-25T13:47:18.083 INFO:tasks.workunit.client.0.smithi043.stdout:3/964: write d0/d13/d5a/d90/fe7 [623097,68767] 0 2024-04-25T13:47:18.086 INFO:tasks.workunit.client.0.smithi043.stdout:3/965: rmdir d0/d9/d6e/d34/d36 39 2024-04-25T13:47:18.089 INFO:tasks.workunit.client.0.smithi043.stdout:3/966: rmdir d0/da/dcc 39 2024-04-25T13:47:18.090 INFO:tasks.workunit.client.0.smithi043.stdout:3/967: fsync d0/d8d/fbc 0 2024-04-25T13:47:18.093 INFO:tasks.workunit.client.0.smithi043.stdout:2/941: dread d0/d34/ffd [0,4194304] 0 2024-04-25T13:47:18.093 INFO:tasks.workunit.client.0.smithi043.stdout:2/942: stat d0/d34/d17/d5e/d71/f90 0 2024-04-25T13:47:18.100 INFO:tasks.workunit.client.0.smithi043.stdout:2/943: dwrite d0/d34/d3f/d7b/dd4/f12e [0,4194304] 0 2024-04-25T13:47:18.101 INFO:tasks.workunit.client.0.smithi043.stdout:3/968: mkdir d0/d9/d6e/d34/d36/d57/de5/dc2/d147 0 2024-04-25T13:47:18.103 INFO:tasks.workunit.client.0.smithi043.stdout:3/969: fdatasync d0/d13/d55/dd9/df5/d8e/d92/fb0 0 2024-04-25T13:47:18.104 INFO:tasks.workunit.client.0.smithi043.stdout:3/970: chown d0/da/db9/df7/dfe 83057839 1 2024-04-25T13:47:18.106 INFO:tasks.workunit.client.0.smithi043.stdout:2/944: creat d0/d34/d17/dc6/f138 x:0 0 0 2024-04-25T13:47:18.107 INFO:tasks.workunit.client.0.smithi043.stdout:3/971: dread - d0/d9/f5d zero size 2024-04-25T13:47:18.110 INFO:tasks.workunit.client.0.smithi043.stdout:3/972: mknod d0/d13/dbe/dd7/c148 0 2024-04-25T13:47:18.112 INFO:tasks.workunit.client.0.smithi043.stdout:3/973: creat d0/d13/d2e/db1/f149 x:0 0 0 2024-04-25T13:47:18.118 INFO:tasks.workunit.client.0.smithi043.stdout:3/974: read d0/d13/ffb [167303,69368] 0 2024-04-25T13:47:18.119 INFO:tasks.workunit.client.0.smithi043.stdout:2/945: creat d0/d34/d17/dc6/d5c/def/f139 x:0 0 0 2024-04-25T13:47:18.120 INFO:tasks.workunit.client.0.smithi043.stdout:3/975: chown d0/da/f43 3 1 2024-04-25T13:47:18.122 INFO:tasks.workunit.client.0.smithi043.stdout:3/976: fsync d0/fab 0 2024-04-25T13:47:18.123 INFO:tasks.workunit.client.0.smithi043.stdout:3/977: chown d0/d9/d6e/d34/d36/cde 231619 1 2024-04-25T13:47:18.140 INFO:tasks.workunit.client.0.smithi043.stdout:3/978: write d0/da/f2d [3635213,128899] 0 2024-04-25T13:47:18.146 INFO:tasks.workunit.client.0.smithi043.stdout:3/979: dwrite d0/d61/d82/f137 [0,4194304] 0 2024-04-25T13:47:18.148 INFO:tasks.workunit.client.0.smithi043.stdout:3/980: symlink d0/d13/d55/dd9/df5/d8e/d12c/l14a 0 2024-04-25T13:47:18.154 INFO:tasks.workunit.client.0.smithi043.stdout:3/981: dwrite d0/d9/f131 [0,4194304] 0 2024-04-25T13:47:18.156 INFO:tasks.workunit.client.0.smithi043.stdout:3/982: fdatasync d0/fab 0 2024-04-25T13:47:18.173 INFO:tasks.workunit.client.0.smithi043.stdout:3/983: dread d0/d61/d82/fc6 [0,4194304] 0 2024-04-25T13:47:18.176 INFO:tasks.workunit.client.0.smithi043.stdout:3/984: fdatasync d0/d13/d55/dd9/df5/d8e/f12f 0 2024-04-25T13:47:18.182 INFO:tasks.workunit.client.0.smithi043.stdout:3/985: creat d0/d9/d6e/d34/d36/d57/de5/f14b x:0 0 0 2024-04-25T13:47:18.183 INFO:tasks.workunit.client.0.smithi043.stdout:3/986: fdatasync d0/da/db9/f10d 0 2024-04-25T13:47:18.186 INFO:tasks.workunit.client.0.smithi043.stdout:3/987: mkdir d0/da/db9/d14c 0 2024-04-25T13:47:18.190 INFO:tasks.workunit.client.0.smithi043.stdout:3/988: rename d0/da/l1b to d0/d13/d2e/db1/l14d 0 2024-04-25T13:47:18.191 INFO:tasks.workunit.client.0.smithi043.stdout:3/989: chown d0/d9/d6e/d34/d36/d57/fe8 991 1 2024-04-25T13:47:18.191 INFO:tasks.workunit.client.0.smithi043.stdout:9/613: sync 2024-04-25T13:47:18.195 INFO:tasks.workunit.client.0.smithi043.stdout:3/990: mkdir d0/d9/d6e/d38/d3f/dc7/d14e 0 2024-04-25T13:47:18.198 INFO:tasks.workunit.client.0.smithi043.stdout:9/614: dwrite d0/d1d/f96 [0,4194304] 0 2024-04-25T13:47:18.199 INFO:tasks.workunit.client.0.smithi043.stdout:9/615: write d0/d77/fb3 [989999,124580] 0 2024-04-25T13:47:18.208 INFO:tasks.workunit.client.0.smithi043.stdout:3/991: readlink d0/da/db9/le6 0 2024-04-25T13:47:18.218 INFO:tasks.workunit.client.0.smithi043.stdout:2/946: sync 2024-04-25T13:47:18.221 INFO:tasks.workunit.client.0.smithi043.stdout:2/947: mkdir d0/d34/d17/d5e/d86/d13a 0 2024-04-25T13:47:18.223 INFO:tasks.workunit.client.0.smithi043.stdout:3/992: dread d0/da/db9/d9e/fed [0,4194304] 0 2024-04-25T13:47:18.224 INFO:tasks.workunit.client.0.smithi043.stdout:9/616: dread d0/d8b/d26/d39/f6e [0,4194304] 0 2024-04-25T13:47:18.228 INFO:tasks.workunit.client.0.smithi043.stdout:3/993: dread d0/d9/f131 [0,4194304] 0 2024-04-25T13:47:18.229 INFO:tasks.workunit.client.0.smithi043.stdout:9/617: truncate d0/d8b/d9b/f56 698749 0 2024-04-25T13:47:18.230 INFO:tasks.workunit.client.0.smithi043.stdout:3/994: write d0/d9/d6e/d34/d36/fc9 [293768,80958] 0 2024-04-25T13:47:18.231 INFO:tasks.workunit.client.0.smithi043.stdout:9/618: rmdir d0/d1d/d7 39 2024-04-25T13:47:18.234 INFO:tasks.workunit.client.0.smithi043.stdout:9/619: write d0/d1d/d7/f5a [848848,10030] 0 2024-04-25T13:47:18.240 INFO:tasks.workunit.client.0.smithi043.stdout:9/620: dread d0/d8b/d26/d39/d46/f50 [0,4194304] 0 2024-04-25T13:47:18.241 INFO:tasks.workunit.client.0.smithi043.stdout:9/621: readlink d0/d1d/d7/d41/l51 0 2024-04-25T13:47:18.244 INFO:tasks.workunit.client.0.smithi043.stdout:9/622: mknod d0/d8b/d9b/da2/ce5 0 2024-04-25T13:47:18.245 INFO:tasks.workunit.client.0.smithi043.stdout:2/948: rename d0/c98 to d0/d34/d3f/d59/dbc/c13b 0 2024-04-25T13:47:18.246 INFO:tasks.workunit.client.0.smithi043.stdout:2/949: chown d0/d8/d9b/ddb/fca 98527215 1 2024-04-25T13:47:18.248 INFO:tasks.workunit.client.0.smithi043.stdout:3/995: dread d0/d13/d2e/f76 [0,4194304] 0 2024-04-25T13:47:18.250 INFO:tasks.workunit.client.0.smithi043.stdout:3/996: readlink d0/d13/d55/lfd 0 2024-04-25T13:47:18.251 INFO:tasks.workunit.client.0.smithi043.stdout:9/623: rename d0/d1d/d7/c9d to d0/d1d/ce6 0 2024-04-25T13:47:18.252 INFO:tasks.workunit.client.0.smithi043.stdout:3/997: chown d0/da/l5b 121711 1 2024-04-25T13:47:18.253 INFO:tasks.workunit.client.0.smithi043.stdout:9/624: creat d0/d1d/d7/d41/fe7 x:0 0 0 2024-04-25T13:47:18.258 INFO:tasks.workunit.client.0.smithi043.stdout:3/998: write d0/d9/f23 [18040,72842] 0 2024-04-25T13:47:18.259 INFO:tasks.workunit.client.0.smithi043.stdout:3/999: chown d0/d9/f62 4302 1 2024-04-25T13:47:18.267 INFO:tasks.workunit.client.0.smithi043.stdout:9/625: truncate d0/d8b/d26/d47/fc8 3758828 0 2024-04-25T13:47:18.268 INFO:tasks.workunit.client.0.smithi043.stdout:2/950: dread d0/d34/d17/dc6/d36/fb6 [0,4194304] 0 2024-04-25T13:47:18.270 INFO:tasks.workunit.client.0.smithi043.stdout:2/951: symlink d0/d8/d9b/ddb/dce/l13c 0 2024-04-25T13:47:18.274 INFO:tasks.workunit.client.0.smithi043.stdout:9/626: dwrite d0/d8b/d26/d39/d46/d62/f68 [0,4194304] 0 2024-04-25T13:47:18.277 INFO:tasks.workunit.client.0.smithi043.stdout:2/952: dread d0/d34/d17/dc6/d36/fb6 [0,4194304] 0 2024-04-25T13:47:18.279 INFO:tasks.workunit.client.0.smithi043.stdout:2/953: creat d0/d8/d9b/ddb/dda/d104/f13d x:0 0 0 2024-04-25T13:47:18.282 INFO:tasks.workunit.client.0.smithi043.stdout:2/954: mknod d0/d5/d1e/d11c/c13e 0 2024-04-25T13:47:18.285 INFO:tasks.workunit.client.0.smithi043.stdout:2/955: unlink d0/d35/fc5 0 2024-04-25T13:47:18.286 INFO:tasks.workunit.client.0.smithi043.stdout:9/627: truncate d0/d8b/d26/d39/f6f 1756405 0 2024-04-25T13:47:18.288 INFO:tasks.workunit.client.0.smithi043.stdout:9/628: write d0/d1d/d7/fb7 [1814718,47242] 0 2024-04-25T13:47:18.289 INFO:tasks.workunit.client.0.smithi043.stdout:2/956: chown d0/d34/d17/dc6/l54 217921 1 2024-04-25T13:47:18.289 INFO:tasks.workunit.client.0.smithi043.stdout:9/629: fdatasync d0/d1d/d7/f9c 0 2024-04-25T13:47:18.292 INFO:tasks.workunit.client.0.smithi043.stdout:9/630: symlink d0/d8b/d9b/le8 0 2024-04-25T13:47:18.296 INFO:tasks.workunit.client.0.smithi043.stdout:2/957: dwrite d0/d34/d17/dc6/d5c/f135 [0,4194304] 0 2024-04-25T13:47:18.296 INFO:tasks.workunit.client.0.smithi043.stdout:9/631: read d0/d8b/d9b/f56 [595576,130742] 0 2024-04-25T13:47:18.303 INFO:tasks.workunit.client.0.smithi043.stdout:2/958: creat d0/d34/d3f/d59/dbc/f13f x:0 0 0 2024-04-25T13:47:18.305 INFO:tasks.workunit.client.0.smithi043.stdout:9/632: dwrite d0/d8b/d26/d39/d46/d62/dad/fc0 [0,4194304] 0 2024-04-25T13:47:18.309 INFO:tasks.workunit.client.0.smithi043.stdout:2/959: fsync d0/d34/d17/dc6/d118/dc9/f109 0 2024-04-25T13:47:18.310 INFO:tasks.workunit.client.0.smithi043.stdout:2/960: chown d0/d34/le 18937604 1 2024-04-25T13:47:18.312 INFO:tasks.workunit.client.0.smithi043.stdout:2/961: readlink d0/d34/d17/dc6/d5c/l82 0 2024-04-25T13:47:18.313 INFO:tasks.workunit.client.0.smithi043.stdout:2/962: write d0/d26/f31 [1317885,51673] 0 2024-04-25T13:47:18.318 INFO:tasks.workunit.client.0.smithi043.stdout:2/963: fsync d0/d34/d17/d5e/fbf 0 2024-04-25T13:47:18.324 INFO:tasks.workunit.client.0.smithi043.stdout:2/964: creat d0/d34/d17/da0/f140 x:0 0 0 2024-04-25T13:47:18.325 INFO:tasks.workunit.client.0.smithi043.stdout:2/965: write d0/d34/d17/dc6/d5c/f135 [555970,129883] 0 2024-04-25T13:47:18.325 INFO:tasks.workunit.client.0.smithi043.stdout:2/966: chown d0/d34/d17/d5e/da9/lf0 912 1 2024-04-25T13:47:18.326 INFO:tasks.workunit.client.0.smithi043.stdout:2/967: chown d0/d34/d17/dc6/d36 138 1 2024-04-25T13:47:18.327 INFO:tasks.workunit.client.0.smithi043.stdout:2/968: dread - d0/d34/d3f/d7b/f108 zero size 2024-04-25T13:47:18.335 INFO:tasks.workunit.client.0.smithi043.stdout:2/969: dwrite d0/f63 [0,4194304] 0 2024-04-25T13:47:18.340 INFO:tasks.workunit.client.0.smithi043.stdout:2/970: truncate d0/d34/d17/dc6/f2b 4487224 0 2024-04-25T13:47:18.341 INFO:tasks.workunit.client.0.smithi043.stdout:2/971: mknod d0/d35/c141 0 2024-04-25T13:47:18.346 INFO:tasks.workunit.client.0.smithi043.stdout:2/972: write d0/d34/d17/dc6/fbe [204611,74163] 0 2024-04-25T13:47:18.349 INFO:tasks.workunit.client.0.smithi043.stdout:2/973: mknod d0/d34/d17/d5e/d71/d81/c142 0 2024-04-25T13:47:18.351 INFO:tasks.workunit.client.0.smithi043.stdout:2/974: symlink d0/d8/l143 0 2024-04-25T13:47:18.353 INFO:tasks.workunit.client.0.smithi043.stdout:2/975: mknod d0/d26/c144 0 2024-04-25T13:47:18.354 INFO:tasks.workunit.client.0.smithi043.stdout:2/976: fdatasync d0/d34/d17/dc6/d118/deb/f116 0 2024-04-25T13:47:18.357 INFO:tasks.workunit.client.0.smithi043.stdout:2/977: getdents d0/d34/d3f/d7b/dd4 0 2024-04-25T13:47:18.361 INFO:tasks.workunit.client.0.smithi043.stdout:2/978: symlink d0/d34/d17/dc6/d36/l145 0 2024-04-25T13:47:18.362 INFO:tasks.workunit.client.0.smithi043.stdout:2/979: fsync d0/d34/d3f/d7b/f108 0 2024-04-25T13:47:18.362 INFO:tasks.workunit.client.0.smithi043.stdout:2/980: chown d0/d8/c58 1547875522 1 2024-04-25T13:47:18.364 INFO:tasks.workunit.client.0.smithi043.stdout:2/981: symlink d0/d34/d17/dc6/d118/deb/l146 0 2024-04-25T13:47:18.366 INFO:tasks.workunit.client.0.smithi043.stdout:2/982: creat d0/d34/d17/d5e/da9/dc3/f147 x:0 0 0 2024-04-25T13:47:18.373 INFO:tasks.workunit.client.0.smithi043.stdout:2/983: dwrite d0/d34/d17/dc6/f138 [0,4194304] 0 2024-04-25T13:47:18.375 INFO:tasks.workunit.client.0.smithi043.stdout:2/984: symlink d0/d8/d9b/ddb/dda/l148 0 2024-04-25T13:47:18.377 INFO:tasks.workunit.client.0.smithi043.stdout:2/985: mknod d0/d8/d9b/c149 0 2024-04-25T13:47:18.378 INFO:tasks.workunit.client.0.smithi043.stdout:2/986: write d0/d26/f31 [5604435,33809] 0 2024-04-25T13:47:18.380 INFO:tasks.workunit.client.0.smithi043.stdout:2/987: chown d0/d34/d3f/d59/dbc/f13f 0 1 2024-04-25T13:47:18.384 INFO:tasks.workunit.client.0.smithi043.stdout:2/988: creat d0/d8/f14a x:0 0 0 2024-04-25T13:47:18.391 INFO:tasks.workunit.client.0.smithi043.stdout:2/989: chown d0/d34/d17/da0/f140 3 1 2024-04-25T13:47:18.394 INFO:tasks.workunit.client.0.smithi043.stdout:2/990: getdents d0/d34/d17/dc6/d5c/d124 0 2024-04-25T13:47:18.394 INFO:tasks.workunit.client.0.smithi043.stdout:2/991: chown d0/d34/d17/dc6 439 1 2024-04-25T13:47:18.408 INFO:tasks.workunit.client.0.smithi043.stdout:2/992: creat d0/d34/d17/dc6/d36/f14b x:0 0 0 2024-04-25T13:47:18.428 INFO:tasks.workunit.client.0.smithi043.stdout:2/993: symlink d0/d5/d2f/d10a/l14c 0 2024-04-25T13:47:18.430 INFO:tasks.workunit.client.0.smithi043.stdout:2/994: mkdir d0/d5/d1e/d11c/d14d 0 2024-04-25T13:47:18.431 INFO:tasks.workunit.client.0.smithi043.stdout:2/995: stat d0/d26 0 2024-04-25T13:47:18.431 INFO:tasks.workunit.client.0.smithi043.stdout:2/996: fdatasync d0/d34/d17/dc6/d5c/d124/f133 0 2024-04-25T13:47:18.434 INFO:tasks.workunit.client.0.smithi043.stdout:2/997: mknod d0/d34/d17/c14e 0 2024-04-25T13:47:18.435 INFO:tasks.workunit.client.0.smithi043.stdout:2/998: fsync d0/d34/d17/d5e/d9f/fad 0 2024-04-25T13:47:18.437 INFO:tasks.workunit.client.0.smithi043.stdout:2/999: mkdir d0/d34/d3f/d59/d14f 0 2024-04-25T13:47:18.561 INFO:tasks.workunit.client.0.smithi043.stdout:9/633: sync 2024-04-25T13:47:18.567 INFO:tasks.workunit.client.0.smithi043.stdout:9/634: dwrite d0/d1d/d4a/fbc [4194304,4194304] 0 2024-04-25T13:47:18.577 INFO:tasks.workunit.client.0.smithi043.stdout:9/635: dwrite d0/d8b/d26/d47/d4d/fd5 [0,4194304] 0 2024-04-25T13:47:18.580 INFO:tasks.workunit.client.0.smithi043.stdout:9/636: symlink d0/da7/dd2/le9 0 2024-04-25T13:47:18.583 INFO:tasks.workunit.client.0.smithi043.stdout:9/637: symlink d0/d1d/lea 0 2024-04-25T13:47:18.585 INFO:tasks.workunit.client.0.smithi043.stdout:9/638: mkdir d0/da7/dac/deb 0 2024-04-25T13:47:18.593 INFO:tasks.workunit.client.0.smithi043.stdout:9/639: write d0/d8b/d26/d47/fc8 [4274360,123477] 0 2024-04-25T13:47:18.595 INFO:tasks.workunit.client.0.smithi043.stdout:9/640: truncate d0/d1d/d7/d83/f9a 350753 0 2024-04-25T13:47:18.597 INFO:tasks.workunit.client.0.smithi043.stdout:9/641: fsync d0/d8b/d26/d47/d4d/fd3 0 2024-04-25T13:47:18.598 INFO:tasks.workunit.client.0.smithi043.stdout:9/642: dread - d0/d1d/d7/d81/fcf zero size 2024-04-25T13:47:18.687 INFO:tasks.workunit.client.0.smithi043.stdout:9/643: sync 2024-04-25T13:47:18.689 INFO:tasks.workunit.client.0.smithi043.stdout:9/644: symlink d0/da7/dac/lec 0 2024-04-25T13:47:18.691 INFO:tasks.workunit.client.0.smithi043.stdout:9/645: symlink d0/d1d/d4a/dc3/led 0 2024-04-25T13:47:18.691 INFO:tasks.workunit.client.0.smithi043.stdout:9/646: dread - d0/d1d/fc2 zero size 2024-04-25T13:47:18.695 INFO:tasks.workunit.client.0.smithi043.stdout:9/647: getdents d0/d1d/d4a 0 2024-04-25T13:47:18.704 INFO:tasks.workunit.client.0.smithi043.stdout:9/648: dwrite d0/d1d/f29 [0,4194304] 0 2024-04-25T13:47:18.707 INFO:tasks.workunit.client.0.smithi043.stdout:9/649: mkdir d0/d8b/d26/d39/d46/d62/dee 0 2024-04-25T13:47:18.711 INFO:tasks.workunit.client.0.smithi043.stdout:9/650: mknod d0/d8b/d26/d47/d52/cef 0 2024-04-25T13:47:18.711 INFO:tasks.workunit.client.0.smithi043.stdout:9/651: readlink d0/d1d/d4a/dc3/led 0 2024-04-25T13:47:18.713 INFO:tasks.workunit.client.0.smithi043.stdout:9/652: chown d0/da7/dac/deb 248 1 2024-04-25T13:47:18.721 INFO:tasks.workunit.client.0.smithi043.stdout:9/653: write d0/d8b/d26/f6d [886783,27535] 0 2024-04-25T13:47:18.726 INFO:tasks.workunit.client.0.smithi043.stdout:9/654: write d0/d8b/fb5 [334841,112933] 0 2024-04-25T13:47:18.727 INFO:tasks.workunit.client.0.smithi043.stdout:9/655: chown d0/d8b/d26/d39/d46/d62/dee 6548340 1 2024-04-25T13:47:18.729 INFO:tasks.workunit.client.0.smithi043.stdout:9/656: creat d0/d1d/d7/d41/ff0 x:0 0 0 2024-04-25T13:47:18.732 INFO:tasks.workunit.client.0.smithi043.stdout:9/657: symlink d0/d8b/d26/d39/d46/dba/lf1 0 2024-04-25T13:47:18.750 INFO:tasks.workunit.client.0.smithi043.stdout:9/658: dread d0/d1d/d7/f19 [0,4194304] 0 2024-04-25T13:47:18.756 INFO:tasks.workunit.client.0.smithi043.stdout:9/659: write d0/d8b/d26/d39/d46/f50 [1967016,37739] 0 2024-04-25T13:47:18.772 INFO:tasks.workunit.client.0.smithi043.stdout:9/660: rename d0/d1d/f29 to d0/d8b/d26/d47/ff2 0 2024-04-25T13:47:18.774 INFO:tasks.workunit.client.0.smithi043.stdout:9/661: creat d0/da7/dac/ff3 x:0 0 0 2024-04-25T13:47:18.781 INFO:tasks.workunit.client.0.smithi043.stdout:9/662: dwrite d0/d1d/fa [0,4194304] 0 2024-04-25T13:47:19.023 INFO:tasks.workunit.client.0.smithi043.stdout:9/663: dwrite d0/d8b/d26/d39/d46/f5e [0,4194304] 0 2024-04-25T13:47:19.026 INFO:tasks.workunit.client.0.smithi043.stdout:9/664: creat d0/d8b/d26/d39/d46/dba/ff4 x:0 0 0 2024-04-25T13:47:19.027 INFO:tasks.workunit.client.0.smithi043.stdout:9/665: dread - d0/d1d/d7/d41/fe7 zero size 2024-04-25T13:47:19.030 INFO:tasks.workunit.client.0.smithi043.stdout:9/666: getdents d0/d1d/d22/d67 0 2024-04-25T13:47:19.031 INFO:tasks.workunit.client.0.smithi043.stdout:9/667: write d0/da7/dd2/fdc [176924,68809] 0 2024-04-25T13:47:19.034 INFO:tasks.workunit.client.0.smithi043.stdout:9/668: rmdir d0/d8b/d26/d39/d46/db9 39 2024-04-25T13:47:19.037 INFO:tasks.workunit.client.0.smithi043.stdout:9/669: creat d0/d1d/d4a/ff5 x:0 0 0 2024-04-25T13:47:19.039 INFO:tasks.workunit.client.0.smithi043.stdout:9/670: chown d0/d8b/d26/d47/f65 3964 1 2024-04-25T13:47:19.041 INFO:tasks.workunit.client.0.smithi043.stdout:9/671: write d0/d8b/d26/d47/d4d/f58 [5088456,124550] 0 2024-04-25T13:47:19.042 INFO:tasks.workunit.client.0.smithi043.stdout:9/672: fsync d0/d77/f94 0 2024-04-25T13:47:19.042 INFO:tasks.workunit.client.0.smithi043.stdout:9/673: write d0/d1d/fc2 [292547,61089] 0 2024-04-25T13:47:19.044 INFO:tasks.workunit.client.0.smithi043.stdout:9/674: rmdir d0/da7/dd2 39 2024-04-25T13:47:19.048 INFO:tasks.workunit.client.0.smithi043.stdout:9/675: creat d0/d8b/d26/d47/d52/ff6 x:0 0 0 2024-04-25T13:47:19.049 INFO:tasks.workunit.client.0.smithi043.stdout:9/676: read - d0/d1d/f53 zero size 2024-04-25T13:47:19.050 INFO:tasks.workunit.client.0.smithi043.stdout:9/677: dread - d0/d1d/f53 zero size 2024-04-25T13:47:19.053 INFO:tasks.workunit.client.0.smithi043.stdout:9/678: fdatasync d0/d8b/dcd/fd8 0 2024-04-25T13:47:19.056 INFO:tasks.workunit.client.0.smithi043.stdout:9/679: symlink d0/da7/dd2/lf7 0 2024-04-25T13:47:19.057 INFO:tasks.workunit.client.0.smithi043.stdout:9/680: write d0/d1d/fa0 [3051413,91811] 0 2024-04-25T13:47:19.059 INFO:tasks.workunit.client.0.smithi043.stdout:9/681: creat d0/d1d/d22/ff8 x:0 0 0 2024-04-25T13:47:19.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:18 smithi161 ceph-mon[32696]: pgmap v84: 129 pgs: 129 active+clean; 2.3 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 225 MiB/s wr, 552 op/s 2024-04-25T13:47:19.137 INFO:tasks.workunit.client.0.smithi043.stdout:9/682: sync 2024-04-25T13:47:19.140 INFO:tasks.workunit.client.0.smithi043.stdout:9/683: rename d0/d1d/d22/c30 to d0/d77/cf9 0 2024-04-25T13:47:19.144 INFO:tasks.workunit.client.0.smithi043.stdout:9/684: dread d0/d1d/fa [0,4194304] 0 2024-04-25T13:47:19.159 INFO:tasks.workunit.client.0.smithi043.stdout:9/685: dread d0/d1d/d22/d67/f71 [0,4194304] 0 2024-04-25T13:47:19.162 INFO:tasks.workunit.client.0.smithi043.stdout:9/686: creat d0/d1d/d22/d67/ffa x:0 0 0 2024-04-25T13:47:19.166 INFO:tasks.workunit.client.0.smithi043.stdout:9/687: rename d0/d77/cf9 to d0/d8b/cfb 0 2024-04-25T13:47:19.170 INFO:tasks.workunit.client.0.smithi043.stdout:9/688: dread d0/d8b/d26/d39/d46/f50 [0,4194304] 0 2024-04-25T13:47:19.173 INFO:tasks.workunit.client.0.smithi043.stdout:9/689: mkdir d0/d8b/d26/d39/d46/dfc 0 2024-04-25T13:47:19.175 INFO:tasks.workunit.client.0.smithi043.stdout:9/690: creat d0/d8b/d26/d47/d4d/ffd x:0 0 0 2024-04-25T13:47:19.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:18 smithi175 ceph-mon[32649]: pgmap v84: 129 pgs: 129 active+clean; 2.3 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 225 MiB/s wr, 552 op/s 2024-04-25T13:47:19.191 INFO:tasks.workunit.client.0.smithi043.stdout:9/691: link d0/lbf d0/d8b/d26/d39/d46/lfe 0 2024-04-25T13:47:19.191 INFO:tasks.workunit.client.0.smithi043.stdout:9/692: dread - d0/da7/dac/fce zero size 2024-04-25T13:47:19.194 INFO:tasks.workunit.client.0.smithi043.stdout:9/693: creat d0/d8b/d26/d39/d46/d62/dee/fff x:0 0 0 2024-04-25T13:47:19.197 INFO:tasks.workunit.client.0.smithi043.stdout:9/694: creat d0/d8b/d26/d39/f100 x:0 0 0 2024-04-25T13:47:19.198 INFO:tasks.workunit.client.0.smithi043.stdout:9/695: fsync d0/d1d/d7/f95 0 2024-04-25T13:47:19.199 INFO:tasks.workunit.client.0.smithi043.stdout:9/696: read - d0/d8b/d26/d47/d4d/ffd zero size 2024-04-25T13:47:19.204 INFO:tasks.workunit.client.0.smithi043.stdout:9/697: dwrite d0/d1d/d22/f8f [0,4194304] 0 2024-04-25T13:47:19.207 INFO:tasks.workunit.client.0.smithi043.stdout:9/698: symlink d0/d1d/d22/l101 0 2024-04-25T13:47:19.211 INFO:tasks.workunit.client.0.smithi043.stdout:9/699: dread d0/d1d/d7/f95 [0,4194304] 0 2024-04-25T13:47:19.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:18 smithi043 ceph-mon[29195]: pgmap v84: 129 pgs: 129 active+clean; 2.3 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 225 MiB/s wr, 552 op/s 2024-04-25T13:47:19.212 INFO:tasks.workunit.client.0.smithi043.stdout:9/700: dread - d0/d1d/d7/d81/fcf zero size 2024-04-25T13:47:19.216 INFO:tasks.workunit.client.0.smithi043.stdout:9/701: creat d0/f102 x:0 0 0 2024-04-25T13:47:19.218 INFO:tasks.workunit.client.0.smithi043.stdout:9/702: mknod d0/d1d/d7/d83/c103 0 2024-04-25T13:47:19.220 INFO:tasks.workunit.client.0.smithi043.stdout:9/703: rmdir d0/d8b/d26/d39/d46/d62/dee 39 2024-04-25T13:47:19.222 INFO:tasks.workunit.client.0.smithi043.stdout:9/704: mknod d0/d77/c104 0 2024-04-25T13:47:19.222 INFO:tasks.workunit.client.0.smithi043.stdout:9/705: stat d0/d1d/d4a/dc3/fd1 0 2024-04-25T13:47:19.225 INFO:tasks.workunit.client.0.smithi043.stdout:9/706: dread d0/d1d/fa [0,4194304] 0 2024-04-25T13:47:19.229 INFO:tasks.workunit.client.0.smithi043.stdout:9/707: getdents d0/d8b/d26 0 2024-04-25T13:47:19.230 INFO:tasks.workunit.client.0.smithi043.stdout:9/708: truncate d0/d1d/f1a 1044623 0 2024-04-25T13:47:19.234 INFO:tasks.workunit.client.0.smithi043.stdout:9/709: dread d0/d8b/d26/d47/d4d/fd5 [0,4194304] 0 2024-04-25T13:47:19.235 INFO:tasks.workunit.client.0.smithi043.stdout:9/710: chown d0/d8b/d26/d47/d52/ff6 0 1 2024-04-25T13:47:19.240 INFO:tasks.workunit.client.0.smithi043.stdout:9/711: symlink d0/d1d/d7/d83/l105 0 2024-04-25T13:47:19.241 INFO:tasks.workunit.client.0.smithi043.stdout:9/712: chown d0/d1d/d22/l4f 1024444622 1 2024-04-25T13:47:19.241 INFO:tasks.workunit.client.0.smithi043.stdout:9/713: fdatasync d0/da7/dd2/fdc 0 2024-04-25T13:47:19.242 INFO:tasks.workunit.client.0.smithi043.stdout:9/714: chown d0/f82 22163729 1 2024-04-25T13:47:19.243 INFO:tasks.workunit.client.0.smithi043.stdout:9/715: write d0/d1d/d7/d41/ff0 [412498,126168] 0 2024-04-25T13:47:19.249 INFO:tasks.workunit.client.0.smithi043.stdout:9/716: dwrite d0/d1d/d22/d67/ffa [0,4194304] 0 2024-04-25T13:47:19.263 INFO:tasks.workunit.client.0.smithi043.stdout:9/717: rename d0/d1d/l9f to d0/d8b/d26/d39/d46/d62/dad/l106 0 2024-04-25T13:47:19.264 INFO:tasks.workunit.client.0.smithi043.stdout:9/718: write d0/d1d/fa [2125138,37140] 0 2024-04-25T13:47:19.268 INFO:tasks.workunit.client.0.smithi043.stdout:9/719: dread d0/d8b/d26/d47/ff2 [0,4194304] 0 2024-04-25T13:47:19.278 INFO:tasks.workunit.client.0.smithi043.stdout:9/720: rename d0/d1d/d22/ca5 to d0/da7/dac/deb/c107 0 2024-04-25T13:47:19.280 INFO:tasks.workunit.client.0.smithi043.stdout:9/721: mknod d0/d1d/d7/c108 0 2024-04-25T13:47:19.283 INFO:tasks.workunit.client.0.smithi043.stdout:9/722: mknod d0/d8b/d26/d39/c109 0 2024-04-25T13:47:19.283 INFO:tasks.workunit.client.0.smithi043.stdout:9/723: readlink d0/d1d/d4a/dc3/lcc 0 2024-04-25T13:47:19.381 INFO:tasks.workunit.client.0.smithi043.stdout:9/724: sync 2024-04-25T13:47:19.383 INFO:tasks.workunit.client.0.smithi043.stdout:9/725: mknod d0/d8b/d26/d47/d4d/c10a 0 2024-04-25T13:47:19.400 INFO:tasks.workunit.client.0.smithi043.stdout:9/726: rename d0/d1d/d4a/dc3/led to d0/d8b/d26/d39/d46/d62/l10b 0 2024-04-25T13:47:19.402 INFO:tasks.workunit.client.0.smithi043.stdout:9/727: fsync d0/d1d/d4a/f6a 0 2024-04-25T13:47:19.404 INFO:tasks.workunit.client.0.smithi043.stdout:9/728: symlink d0/d1d/d22/l10c 0 2024-04-25T13:47:19.412 INFO:tasks.workunit.client.0.smithi043.stdout:9/729: getdents d0/d8b/d26/d39/d46 0 2024-04-25T13:47:19.443 INFO:tasks.workunit.client.0.smithi043.stdout:9/730: mkdir d0/d1d/d22/d67/d10d 0 2024-04-25T13:47:19.445 INFO:tasks.workunit.client.0.smithi043.stdout:9/731: rmdir d0/d1d/d7/d41 39 2024-04-25T13:47:19.446 INFO:tasks.workunit.client.0.smithi043.stdout:9/732: read - d0/d8b/fbe zero size 2024-04-25T13:47:19.448 INFO:tasks.workunit.client.0.smithi043.stdout:9/733: symlink d0/d1d/d4a/l10e 0 2024-04-25T13:47:19.449 INFO:tasks.workunit.client.0.smithi043.stdout:9/734: fsync d0/d1d/f28 0 2024-04-25T13:47:19.453 INFO:tasks.workunit.client.0.smithi043.stdout:9/735: symlink d0/d8b/d26/l10f 0 2024-04-25T13:47:19.454 INFO:tasks.workunit.client.0.smithi043.stdout:9/736: fsync d0/d1d/d4a/f89 0 2024-04-25T13:47:19.490 INFO:tasks.workunit.client.0.smithi043.stdout:9/737: dread d0/d8b/d26/d47/fc8 [0,4194304] 0 2024-04-25T13:47:19.492 INFO:tasks.workunit.client.0.smithi043.stdout:9/738: write d0/d8b/d26/d39/d46/f50 [3966163,101899] 0 2024-04-25T13:47:19.495 INFO:tasks.workunit.client.0.smithi043.stdout:9/739: dread d0/d8b/d26/d39/d46/dba/fd0 [0,4194304] 0 2024-04-25T13:47:19.497 INFO:tasks.workunit.client.0.smithi043.stdout:9/740: read d0/d1d/d7/fb7 [1015765,58088] 0 2024-04-25T13:47:19.501 INFO:tasks.workunit.client.0.smithi043.stdout:9/741: unlink d0/d8b/d26/d39/d46/d62/dad/fc0 0 2024-04-25T13:47:19.503 INFO:tasks.workunit.client.0.smithi043.stdout:9/742: getdents d0/da7/dd2 0 2024-04-25T13:47:19.504 INFO:tasks.workunit.client.0.smithi043.stdout:9/743: write d0/d1d/d7/f16 [19311,2965] 0 2024-04-25T13:47:19.522 INFO:tasks.workunit.client.0.smithi043.stdout:9/744: dread d0/d8b/d26/d39/d46/f5e [4194304,4194304] 0 2024-04-25T13:47:19.525 INFO:tasks.workunit.client.0.smithi043.stdout:9/745: creat d0/d8b/d26/d39/d46/d62/f110 x:0 0 0 2024-04-25T13:47:19.533 INFO:tasks.workunit.client.0.smithi043.stdout:9/746: dwrite d0/d8b/d26/d39/fc1 [0,4194304] 0 2024-04-25T13:47:19.534 INFO:tasks.workunit.client.0.smithi043.stdout:9/747: mkdir d0/d8b/dcd/d111 0 2024-04-25T13:47:19.537 INFO:tasks.workunit.client.0.smithi043.stdout:9/748: unlink d0/d1d/d7/l1c 0 2024-04-25T13:47:19.539 INFO:tasks.workunit.client.0.smithi043.stdout:9/749: fsync d0/f20 0 2024-04-25T13:47:19.542 INFO:tasks.workunit.client.0.smithi043.stdout:9/750: creat d0/d1d/d4a/f112 x:0 0 0 2024-04-25T13:47:19.545 INFO:tasks.workunit.client.0.smithi043.stdout:9/751: mknod d0/d77/c113 0 2024-04-25T13:47:19.553 INFO:tasks.workunit.client.0.smithi043.stdout:9/752: dwrite d0/f20 [0,4194304] 0 2024-04-25T13:47:19.562 INFO:tasks.workunit.client.0.smithi043.stdout:9/753: dwrite d0/d1d/f53 [0,4194304] 0 2024-04-25T13:47:19.565 INFO:tasks.workunit.client.0.smithi043.stdout:9/754: mkdir d0/d8b/d26/d39/d46/d62/dad/d114 0 2024-04-25T13:47:19.568 INFO:tasks.workunit.client.0.smithi043.stdout:9/755: mkdir d0/d8b/d26/d47/d52/d115 0 2024-04-25T13:47:19.593 INFO:tasks.workunit.client.0.smithi043.stdout:9/756: dread d0/d8b/d26/d47/d52/fab [0,4194304] 0 2024-04-25T13:47:19.594 INFO:tasks.workunit.client.0.smithi043.stdout:9/757: fsync d0/d8b/d26/d39/d46/db9/fd9 0 2024-04-25T13:47:19.596 INFO:tasks.workunit.client.0.smithi043.stdout:9/758: symlink d0/d1d/d22/l116 0 2024-04-25T13:47:19.603 INFO:tasks.workunit.client.0.smithi043.stdout:9/759: dwrite d0/d8b/d26/d39/d46/dba/fd0 [0,4194304] 0 2024-04-25T13:47:19.610 INFO:tasks.workunit.client.0.smithi043.stdout:9/760: dwrite d0/d8b/f23 [4194304,4194304] 0 2024-04-25T13:47:19.625 INFO:tasks.workunit.client.0.smithi043.stdout:9/761: rename d0/d8b/d26/d39/d46/lfe to d0/d1d/d22/d67/l117 0 2024-04-25T13:47:19.632 INFO:tasks.workunit.client.0.smithi043.stdout:9/762: dwrite d0/d8b/d26/d47/fa9 [0,4194304] 0 2024-04-25T13:47:19.638 INFO:tasks.workunit.client.0.smithi043.stdout:9/763: symlink d0/d8b/d26/d39/d46/d62/dee/l118 0 2024-04-25T13:47:19.644 INFO:tasks.workunit.client.0.smithi043.stdout:9/764: rename d0/d1d/d7/f5c to d0/d8b/dcd/f119 0 2024-04-25T13:47:19.649 INFO:tasks.workunit.client.0.smithi043.stdout:9/765: rename d0/d1d/c3e to d0/d1d/d7/d41/c11a 0 2024-04-25T13:47:19.649 INFO:tasks.workunit.client.0.smithi043.stdout:9/766: readlink d0/d8b/d26/d39/d46/d62/dad/l106 0 2024-04-25T13:47:19.650 INFO:tasks.workunit.client.0.smithi043.stdout:9/767: dread - d0/da7/dac/ff3 zero size 2024-04-25T13:47:19.654 INFO:tasks.workunit.client.0.smithi043.stdout:9/768: dread d0/d1d/d22/d67/f71 [0,4194304] 0 2024-04-25T13:47:19.655 INFO:tasks.workunit.client.0.smithi043.stdout:9/769: mkdir d0/d77/d11b 0 2024-04-25T13:47:19.661 INFO:tasks.workunit.client.0.smithi043.stdout:9/770: unlink d0/d8b/d26/d39/d46/db9/cd4 0 2024-04-25T13:47:19.663 INFO:tasks.workunit.client.0.smithi043.stdout:9/771: mknod d0/d8b/d26/ddb/c11c 0 2024-04-25T13:47:19.665 INFO:tasks.workunit.client.0.smithi043.stdout:9/772: symlink d0/d1d/d7/d81/l11d 0 2024-04-25T13:47:19.667 INFO:tasks.workunit.client.0.smithi043.stdout:9/773: mkdir d0/d1d/d7/d81/d11e 0 2024-04-25T13:47:19.677 INFO:tasks.workunit.client.0.smithi043.stdout:9/774: dwrite d0/d1d/d7/d41/ff0 [0,4194304] 0 2024-04-25T13:47:19.678 INFO:tasks.workunit.client.0.smithi043.stdout:9/775: stat d0/d1d/d22/f8f 0 2024-04-25T13:47:19.678 INFO:tasks.workunit.client.0.smithi043.stdout:9/776: stat d0/d1d/d22/ff8 0 2024-04-25T13:47:19.679 INFO:tasks.workunit.client.0.smithi043.stdout:9/777: chown d0/lbf 31205251 1 2024-04-25T13:47:19.762 INFO:tasks.workunit.client.0.smithi043.stdout:9/778: sync 2024-04-25T13:47:19.765 INFO:tasks.workunit.client.0.smithi043.stdout:9/779: truncate d0/d8b/dcd/fd8 435765 0 2024-04-25T13:47:19.768 INFO:tasks.workunit.client.0.smithi043.stdout:9/780: creat d0/d8b/d26/d39/d46/dba/f11f x:0 0 0 2024-04-25T13:47:19.772 INFO:tasks.workunit.client.0.smithi043.stdout:9/781: mknod d0/d1d/d7/d83/ddf/c120 0 2024-04-25T13:47:19.790 INFO:tasks.workunit.client.0.smithi043.stdout:9/782: dread d0/d8b/f18 [0,4194304] 0 2024-04-25T13:47:19.807 INFO:tasks.workunit.client.0.smithi043.stdout:9/783: rename d0/d8b/d9b/lb0 to d0/d8b/d26/d47/d52/d115/l121 0 2024-04-25T13:47:19.817 INFO:tasks.workunit.client.0.smithi043.stdout:9/784: rename d0/d1d/d22/l99 to d0/d1d/d7/d81/d11e/l122 0 2024-04-25T13:47:19.819 INFO:tasks.workunit.client.0.smithi043.stdout:9/785: unlink d0/f20 0 2024-04-25T13:47:19.821 INFO:tasks.workunit.client.0.smithi043.stdout:9/786: fsync d0/d1d/d7/fb7 0 2024-04-25T13:47:19.837 INFO:tasks.workunit.client.0.smithi043.stdout:9/787: dread d0/f21 [0,4194304] 0 2024-04-25T13:47:19.840 INFO:tasks.workunit.client.0.smithi043.stdout:9/788: truncate d0/d8b/dcd/fd8 1304822 0 2024-04-25T13:47:19.846 INFO:tasks.workunit.client.0.smithi043.stdout:9/789: dwrite d0/d8b/d26/d47/d4d/f70 [0,4194304] 0 2024-04-25T13:47:19.846 INFO:tasks.workunit.client.0.smithi043.stdout:9/790: dread - d0/d77/f94 zero size 2024-04-25T13:47:19.861 INFO:tasks.workunit.client.0.smithi043.stdout:9/791: link d0/d8b/d26/d47/d4d/fd3 d0/da7/dd2/f123 0 2024-04-25T13:47:19.863 INFO:tasks.workunit.client.0.smithi043.stdout:9/792: creat d0/d8b/dcd/f124 x:0 0 0 2024-04-25T13:47:19.869 INFO:tasks.workunit.client.0.smithi043.stdout:9/793: dwrite d0/d8b/d26/d39/f100 [0,4194304] 0 2024-04-25T13:47:19.877 INFO:tasks.workunit.client.0.smithi043.stdout:9/794: dwrite d0/d8b/d9b/f56 [0,4194304] 0 2024-04-25T13:47:19.881 INFO:tasks.workunit.client.0.smithi043.stdout:9/795: mkdir d0/d1d/d7/d81/d125 0 2024-04-25T13:47:19.884 INFO:tasks.workunit.client.0.smithi043.stdout:9/796: creat d0/da7/f126 x:0 0 0 2024-04-25T13:47:19.888 INFO:tasks.workunit.client.0.smithi043.stdout:9/797: unlink d0/d1d/d22/d67/cc5 0 2024-04-25T13:47:21.086 INFO:tasks.workunit.client.0.smithi043.stdout:9/798: dread - d0/d8b/d26/d39/d46/db9/fd9 zero size 2024-04-25T13:47:21.089 INFO:tasks.workunit.client.0.smithi043.stdout:9/799: read d0/d1d/fa0 [2001153,100565] 0 2024-04-25T13:47:21.090 INFO:tasks.workunit.client.0.smithi043.stdout:9/800: fsync d0/f102 0 2024-04-25T13:47:21.093 INFO:tasks.workunit.client.0.smithi043.stdout:9/801: truncate d0/d1d/f28 4912318 0 2024-04-25T13:47:21.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:20 smithi161 ceph-mon[32696]: pgmap v85: 129 pgs: 129 active+clean; 2.3 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 134 MiB/s wr, 360 op/s 2024-04-25T13:47:21.131 INFO:tasks.workunit.client.0.smithi043.stdout:9/802: symlink d0/d1d/d7/d83/l127 0 2024-04-25T13:47:21.138 INFO:tasks.workunit.client.0.smithi043.stdout:9/803: truncate d0/d8b/d26/d39/d46/d62/dad/fb1 1457264 0 2024-04-25T13:47:21.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:20 smithi175 ceph-mon[32649]: pgmap v85: 129 pgs: 129 active+clean; 2.3 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 134 MiB/s wr, 360 op/s 2024-04-25T13:47:21.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:20 smithi043 ceph-mon[29195]: pgmap v85: 129 pgs: 129 active+clean; 2.3 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 134 MiB/s wr, 360 op/s 2024-04-25T13:47:21.255 INFO:tasks.workunit.client.0.smithi043.stdout:9/804: sync 2024-04-25T13:47:21.258 INFO:tasks.workunit.client.0.smithi043.stdout:9/805: mkdir d0/d8b/d9b/da2/d128 0 2024-04-25T13:47:21.260 INFO:tasks.workunit.client.0.smithi043.stdout:9/806: mkdir d0/d8b/d26/d39/d46/dba/d129 0 2024-04-25T13:47:21.262 INFO:tasks.workunit.client.0.smithi043.stdout:9/807: fsync d0/d1d/d22/f27 0 2024-04-25T13:47:21.277 INFO:tasks.workunit.client.0.smithi043.stdout:9/808: rename d0/d8b/d26/d47/d52/lb8 to d0/l12a 0 2024-04-25T13:47:21.280 INFO:tasks.workunit.client.0.smithi043.stdout:9/809: truncate d0/d1d/f1a 590567 0 2024-04-25T13:47:21.282 INFO:tasks.workunit.client.0.smithi043.stdout:9/810: creat d0/d8b/dcd/f12b x:0 0 0 2024-04-25T13:47:21.283 INFO:tasks.workunit.client.0.smithi043.stdout:9/811: chown d0/d8b/d26/d39/d46/d62/dee 474125128 1 2024-04-25T13:47:21.285 INFO:tasks.workunit.client.0.smithi043.stdout:9/812: truncate d0/d1d/f3d 143973 0 2024-04-25T13:47:21.303 INFO:tasks.workunit.client.0.smithi043.stdout:9/813: dread d0/d8b/f23 [0,4194304] 0 2024-04-25T13:47:21.303 INFO:tasks.workunit.client.0.smithi043.stdout:9/814: chown d0/d77/c113 671 1 2024-04-25T13:47:21.304 INFO:tasks.workunit.client.0.smithi043.stdout:9/815: write d0/d77/f94 [455499,129854] 0 2024-04-25T13:47:21.308 INFO:tasks.workunit.client.0.smithi043.stdout:9/816: rename d0/d1d/d7/la1 to d0/d1d/d7/d81/d125/l12c 0 2024-04-25T13:47:21.310 INFO:tasks.workunit.client.0.smithi043.stdout:9/817: dread - d0/d8b/d26/d39/d46/f93 zero size 2024-04-25T13:47:21.314 INFO:tasks.workunit.client.0.smithi043.stdout:9/818: mkdir d0/d8b/d26/d12d 0 2024-04-25T13:47:21.325 INFO:tasks.workunit.client.0.smithi043.stdout:9/819: rmdir d0/d8b/d26/d39/d46/d62/dee 39 2024-04-25T13:47:21.329 INFO:tasks.workunit.client.0.smithi043.stdout:9/820: symlink d0/d8b/d26/d47/d52/l12e 0 2024-04-25T13:47:21.336 INFO:tasks.workunit.client.0.smithi043.stdout:9/821: dwrite d0/f82 [0,4194304] 0 2024-04-25T13:47:21.346 INFO:tasks.workunit.client.0.smithi043.stdout:9/822: dwrite d0/d8b/d26/f6d [0,4194304] 0 2024-04-25T13:47:21.348 INFO:tasks.workunit.client.0.smithi043.stdout:9/823: write d0/d8b/d26/d39/d46/dba/ff4 [795761,2202] 0 2024-04-25T13:47:21.359 INFO:tasks.workunit.client.0.smithi043.stdout:9/824: dwrite d0/d8b/d26/d39/d46/f50 [0,4194304] 0 2024-04-25T13:47:21.368 INFO:tasks.workunit.client.0.smithi043.stdout:9/825: dwrite d0/d1d/fa0 [4194304,4194304] 0 2024-04-25T13:47:21.378 INFO:tasks.workunit.client.0.smithi043.stdout:9/826: write d0/d8b/d26/d47/f65 [998739,3741] 0 2024-04-25T13:47:21.380 INFO:tasks.workunit.client.0.smithi043.stdout:9/827: symlink d0/d1d/d7/l12f 0 2024-04-25T13:47:21.380 INFO:tasks.workunit.client.0.smithi043.stdout:9/828: read d0/d1d/d7/f95 [1861573,16896] 0 2024-04-25T13:47:21.385 INFO:tasks.workunit.client.0.smithi043.stdout:9/829: truncate d0/d8b/d26/d47/ff2 3834760 0 2024-04-25T13:47:21.389 INFO:tasks.workunit.client.0.smithi043.stdout:9/830: creat d0/d8b/d26/d39/d46/dfc/f130 x:0 0 0 2024-04-25T13:47:21.390 INFO:tasks.workunit.client.0.smithi043.stdout:9/831: mknod d0/d8b/d26/d12d/c131 0 2024-04-25T13:47:21.398 INFO:tasks.workunit.client.0.smithi043.stdout:9/832: dwrite d0/d8b/d26/d39/d46/d62/f110 [0,4194304] 0 2024-04-25T13:47:21.404 INFO:tasks.workunit.client.0.smithi043.stdout:9/833: dwrite d0/d1d/d7/fb7 [0,4194304] 0 2024-04-25T13:47:21.407 INFO:tasks.workunit.client.0.smithi043.stdout:9/834: chown d0/d8b/d9b/c88 1 1 2024-04-25T13:47:21.410 INFO:tasks.workunit.client.0.smithi043.stdout:9/835: write d0/d8b/d26/d47/f65 [627154,51567] 0 2024-04-25T13:47:21.413 INFO:tasks.workunit.client.0.smithi043.stdout:9/836: write d0/d8b/d26/d47/d4d/f70 [2785114,125829] 0 2024-04-25T13:47:21.414 INFO:tasks.workunit.client.0.smithi043.stdout:9/837: write d0/d8b/d9b/da2/fe3 [426525,25088] 0 2024-04-25T13:47:21.452 INFO:tasks.workunit.client.0.smithi043.stdout:9/838: link d0/d1d/d22/d67/l117 d0/d1d/d7/d81/d11e/l132 0 2024-04-25T13:47:21.453 INFO:tasks.workunit.client.0.smithi043.stdout:9/839: chown d0/d1d/c97 12 1 2024-04-25T13:47:21.479 INFO:tasks.workunit.client.0.smithi043.stdout:9/840: write d0/d1d/d7/f10 [395380,44787] 0 2024-04-25T13:47:21.484 INFO:tasks.workunit.client.0.smithi043.stdout:9/841: creat d0/d8b/d26/d39/d46/d62/dad/f133 x:0 0 0 2024-04-25T13:47:21.487 INFO:tasks.workunit.client.0.smithi043.stdout:9/842: getdents d0/d8b 0 2024-04-25T13:47:21.493 INFO:tasks.workunit.client.0.smithi043.stdout:9/843: dwrite d0/d8b/d26/d47/d4d/f58 [4194304,4194304] 0 2024-04-25T13:47:21.497 INFO:tasks.workunit.client.0.smithi043.stdout:9/844: unlink d0/d8b/d26/d47/d4d/f58 0 2024-04-25T13:47:21.499 INFO:tasks.workunit.client.0.smithi043.stdout:9/845: fsync d0/d8b/d26/d47/d4d/fd3 0 2024-04-25T13:47:21.501 INFO:tasks.workunit.client.0.smithi043.stdout:9/846: rmdir d0/da7/dac 39 2024-04-25T13:47:21.503 INFO:tasks.workunit.client.0.smithi043.stdout:9/847: mknod d0/d1d/d7/d81/c134 0 2024-04-25T13:47:21.505 INFO:tasks.workunit.client.0.smithi043.stdout:9/848: creat d0/d8b/d26/d47/d52/d115/f135 x:0 0 0 2024-04-25T13:47:21.512 INFO:tasks.workunit.client.0.smithi043.stdout:9/849: truncate d0/d8b/d26/d39/d46/dba/fd0 1302091 0 2024-04-25T13:47:21.513 INFO:tasks.workunit.client.0.smithi043.stdout:9/850: mkdir d0/d8b/d26/ddb/d136 0 2024-04-25T13:47:21.516 INFO:tasks.workunit.client.0.smithi043.stdout:9/851: symlink d0/d1d/d7/l137 0 2024-04-25T13:47:21.518 INFO:tasks.workunit.client.0.smithi043.stdout:9/852: truncate d0/d8b/d26/d39/d46/d62/dad/fb1 1980184 0 2024-04-25T13:47:21.521 INFO:tasks.workunit.client.0.smithi043.stdout:9/853: mkdir d0/d8b/d9b/da2/d128/d138 0 2024-04-25T13:47:21.522 INFO:tasks.workunit.client.0.smithi043.stdout:9/854: write d0/d1d/d7/d81/fcf [856696,60199] 0 2024-04-25T13:47:21.522 INFO:tasks.workunit.client.0.smithi043.stdout:9/855: readlink d0/d1d/d22/l10c 0 2024-04-25T13:47:21.525 INFO:tasks.workunit.client.0.smithi043.stdout:9/856: creat d0/d8b/d26/d39/d46/dba/d129/f139 x:0 0 0 2024-04-25T13:47:21.526 INFO:tasks.workunit.client.0.smithi043.stdout:9/857: write d0/d1d/d22/d67/f71 [4992786,68121] 0 2024-04-25T13:47:21.527 INFO:tasks.workunit.client.0.smithi043.stdout:9/858: write d0/d8b/d26/d47/d52/f80 [268095,48923] 0 2024-04-25T13:47:21.528 INFO:tasks.workunit.client.0.smithi043.stdout:9/859: chown d0/d1d/d7/d81/d125 728753677 1 2024-04-25T13:47:21.532 INFO:tasks.workunit.client.0.smithi043.stdout:9/860: dread d0/d1d/fa0 [4194304,4194304] 0 2024-04-25T13:47:21.534 INFO:tasks.workunit.client.0.smithi043.stdout:9/861: chown d0/d8b/d26/d39/d46/d62/dad/l106 169 1 2024-04-25T13:47:21.536 INFO:tasks.workunit.client.0.smithi043.stdout:9/862: readlink d0/d8b/d26/d39/d46/d62/dee/l118 0 2024-04-25T13:47:21.542 INFO:tasks.workunit.client.0.smithi043.stdout:9/863: dwrite d0/f21 [0,4194304] 0 2024-04-25T13:47:21.560 INFO:tasks.workunit.client.0.smithi043.stdout:9/864: link d0/d8b/d26/d47/fa9 d0/d1d/d4a/f13a 0 2024-04-25T13:47:21.561 INFO:tasks.workunit.client.0.smithi043.stdout:9/865: write d0/f82 [3924101,92664] 0 2024-04-25T13:47:21.567 INFO:tasks.workunit.client.0.smithi043.stdout:9/866: truncate d0/d8b/d26/d39/d46/d62/dad/fb1 1464094 0 2024-04-25T13:47:21.574 INFO:tasks.workunit.client.0.smithi043.stdout:9/867: creat d0/d1d/d7/d83/f13b x:0 0 0 2024-04-25T13:47:21.574 INFO:tasks.workunit.client.0.smithi043.stdout:9/868: dread - d0/d8b/d26/d39/d46/db9/fd9 zero size 2024-04-25T13:47:21.576 INFO:tasks.workunit.client.0.smithi043.stdout:9/869: symlink d0/d8b/d26/d39/d46/dfc/l13c 0 2024-04-25T13:47:21.576 INFO:tasks.workunit.client.0.smithi043.stdout:9/870: chown d0/d8b/d26/d47/d4d/fd3 1195 1 2024-04-25T13:47:21.578 INFO:tasks.workunit.client.0.smithi043.stdout:9/871: fdatasync d0/da7/dac/ff3 0 2024-04-25T13:47:21.594 INFO:tasks.workunit.client.0.smithi043.stdout:9/872: rename d0/d8b/d26/d47/d52/d115/l121 to d0/d8b/d9b/da2/d128/d138/l13d 0 2024-04-25T13:47:21.596 INFO:tasks.workunit.client.0.smithi043.stdout:9/873: creat d0/d8b/d26/d47/f13e x:0 0 0 2024-04-25T13:47:21.597 INFO:tasks.workunit.client.0.smithi043.stdout:9/874: chown d0/d1d/d7/f9c 84 1 2024-04-25T13:47:21.597 INFO:tasks.workunit.client.0.smithi043.stdout:9/875: dread - d0/f102 zero size 2024-04-25T13:47:21.599 INFO:tasks.workunit.client.0.smithi043.stdout:9/876: chown d0/d8b/d26/d39/d46/f5e 5 1 2024-04-25T13:47:21.604 INFO:tasks.workunit.client.0.smithi043.stdout:9/877: dwrite d0/da7/f126 [0,4194304] 0 2024-04-25T13:47:21.608 INFO:tasks.workunit.client.0.smithi043.stdout:9/878: creat d0/d1d/d22/d67/d10d/f13f x:0 0 0 2024-04-25T13:47:21.610 INFO:tasks.workunit.client.0.smithi043.stdout:9/879: symlink d0/d1d/d4a/dc3/l140 0 2024-04-25T13:47:21.747 INFO:tasks.workunit.client.0.smithi043.stdout:9/880: sync 2024-04-25T13:47:21.753 INFO:tasks.workunit.client.0.smithi043.stdout:9/881: write d0/d1d/d7/f66 [5954139,111764] 0 2024-04-25T13:47:21.757 INFO:tasks.workunit.client.0.smithi043.stdout:9/882: unlink d0/d8b/d26/d39/d46/f50 0 2024-04-25T13:47:21.758 INFO:tasks.workunit.client.0.smithi043.stdout:9/883: readlink d0/le 0 2024-04-25T13:47:21.765 INFO:tasks.workunit.client.0.smithi043.stdout:9/884: truncate d0/da7/dd2/f123 1447065 0 2024-04-25T13:47:21.765 INFO:tasks.workunit.client.0.smithi043.stdout:9/885: dread - d0/d1d/d4a/f61 zero size 2024-04-25T13:47:21.781 INFO:tasks.workunit.client.0.smithi043.stdout:9/886: dwrite d0/d8b/d26/d39/d46/d62/dad/fb1 [0,4194304] 0 2024-04-25T13:47:21.785 INFO:tasks.workunit.client.0.smithi043.stdout:9/887: creat d0/d1d/d7/d83/f141 x:0 0 0 2024-04-25T13:47:21.786 INFO:tasks.workunit.client.0.smithi043.stdout:9/888: dread - d0/d1d/d4a/ff5 zero size 2024-04-25T13:47:21.804 INFO:tasks.workunit.client.0.smithi043.stdout:9/889: write d0/d1d/d7/f5b [965305,39799] 0 2024-04-25T13:47:21.809 INFO:tasks.workunit.client.0.smithi043.stdout:9/890: getdents d0/d8b/d26/d47 0 2024-04-25T13:47:21.812 INFO:tasks.workunit.client.0.smithi043.stdout:9/891: creat d0/d8b/d26/d39/d46/dba/f142 x:0 0 0 2024-04-25T13:47:21.818 INFO:tasks.workunit.client.0.smithi043.stdout:9/892: dwrite d0/d8b/d26/d39/d46/d62/dad/fb1 [0,4194304] 0 2024-04-25T13:47:21.827 INFO:tasks.workunit.client.0.smithi043.stdout:9/893: unlink d0/d1d/d22/l4e 0 2024-04-25T13:47:21.828 INFO:tasks.workunit.client.0.smithi043.stdout:9/894: fsync d0/d8b/d26/d39/f100 0 2024-04-25T13:47:21.831 INFO:tasks.workunit.client.0.smithi043.stdout:9/895: write d0/d8b/d26/d39/d46/f75 [1036858,112967] 0 2024-04-25T13:47:21.838 INFO:tasks.workunit.client.0.smithi043.stdout:9/896: link d0/d8b/d26/d39/d46/dfc/f130 d0/d8b/d26/d47/d4d/f143 0 2024-04-25T13:47:21.841 INFO:tasks.workunit.client.0.smithi043.stdout:9/897: mkdir d0/d8b/d26/d39/d46/dfc/d144 0 2024-04-25T13:47:21.843 INFO:tasks.workunit.client.0.smithi043.stdout:9/898: symlink d0/d8b/d9b/da2/l145 0 2024-04-25T13:47:21.844 INFO:tasks.workunit.client.0.smithi043.stdout:9/899: fsync d0/d1d/d22/f63 0 2024-04-25T13:47:21.846 INFO:tasks.workunit.client.0.smithi043.stdout:9/900: mkdir d0/d8b/d26/d39/d46/dba/d129/d146 0 2024-04-25T13:47:21.847 INFO:tasks.workunit.client.0.smithi043.stdout:9/901: fdatasync d0/da7/f126 0 2024-04-25T13:47:21.848 INFO:tasks.workunit.client.0.smithi043.stdout:9/902: chown d0/d8b/f60 51 1 2024-04-25T13:47:21.853 INFO:tasks.workunit.client.0.smithi043.stdout:9/903: mknod d0/d1d/d7/d83/c147 0 2024-04-25T13:47:21.856 INFO:tasks.workunit.client.0.smithi043.stdout:9/904: creat d0/d8b/d9b/da2/d128/f148 x:0 0 0 2024-04-25T13:47:21.859 INFO:tasks.workunit.client.0.smithi043.stdout:9/905: mkdir d0/d1d/d7/d149 0 2024-04-25T13:47:21.860 INFO:tasks.workunit.client.0.smithi043.stdout:9/906: mknod d0/d8b/d26/ddb/c14a 0 2024-04-25T13:47:21.862 INFO:tasks.workunit.client.0.smithi043.stdout:9/907: mkdir d0/d8b/d9b/da2/d128/d14b 0 2024-04-25T13:47:21.864 INFO:tasks.workunit.client.0.smithi043.stdout:9/908: getdents d0/d8b/d9b/da2/d128/d14b 0 2024-04-25T13:47:21.869 INFO:tasks.workunit.client.0.smithi043.stdout:9/909: dwrite d0/d8b/d26/d39/d46/dba/d129/f139 [0,4194304] 0 2024-04-25T13:47:21.878 INFO:tasks.workunit.client.0.smithi043.stdout:9/910: dwrite d0/d8b/d26/d39/f6e [0,4194304] 0 2024-04-25T13:47:21.886 INFO:tasks.workunit.client.0.smithi043.stdout:9/911: getdents d0/d8b/d9b/da2/d128 0 2024-04-25T13:47:21.886 INFO:tasks.workunit.client.0.smithi043.stdout:9/912: chown d0/d77/fb3 89 1 2024-04-25T13:47:21.888 INFO:tasks.workunit.client.0.smithi043.stdout:9/913: creat d0/d8b/d9b/da2/d128/f14c x:0 0 0 2024-04-25T13:47:21.890 INFO:tasks.workunit.client.0.smithi043.stdout:9/914: dread - d0/d1d/d7/f9c zero size 2024-04-25T13:47:21.900 INFO:tasks.workunit.client.0.smithi043.stdout:9/915: dwrite d0/d8b/d26/d39/d46/dba/fd0 [0,4194304] 0 2024-04-25T13:47:21.901 INFO:tasks.workunit.client.0.smithi043.stdout:9/916: truncate d0/d1d/d4a/dc3/fd1 470855 0 2024-04-25T13:47:21.904 INFO:tasks.workunit.client.0.smithi043.stdout:9/917: creat d0/d8b/d9b/da2/d128/d138/f14d x:0 0 0 2024-04-25T13:47:21.907 INFO:tasks.workunit.client.0.smithi043.stdout:9/918: creat d0/d8b/d26/d47/d52/d115/f14e x:0 0 0 2024-04-25T13:47:22.022 INFO:tasks.workunit.client.0.smithi043.stdout:9/919: sync 2024-04-25T13:47:22.023 INFO:tasks.workunit.client.0.smithi043.stdout:9/920: truncate d0/d77/fb3 1681458 0 2024-04-25T13:47:22.024 INFO:tasks.workunit.client.0.smithi043.stdout:9/921: chown d0/d8b/d26/d47/d52 30 1 2024-04-25T13:47:22.024 INFO:tasks.workunit.client.0.smithi043.stdout:9/922: truncate d0/d8b/dcd/f12b 477315 0 2024-04-25T13:47:22.025 INFO:tasks.workunit.client.0.smithi043.stdout:9/923: dread - d0/d8b/d26/d47/d4d/ffd zero size 2024-04-25T13:47:22.031 INFO:tasks.workunit.client.0.smithi043.stdout:9/924: creat d0/d8b/d26/d39/d46/db9/f14f x:0 0 0 2024-04-25T13:47:22.031 INFO:tasks.workunit.client.0.smithi043.stdout:9/925: stat d0/d77/c113 0 2024-04-25T13:47:22.033 INFO:tasks.workunit.client.0.smithi043.stdout:9/926: readlink d0/d8b/d26/d47/d52/l55 0 2024-04-25T13:47:22.035 INFO:tasks.workunit.client.0.smithi043.stdout:9/927: creat d0/f150 x:0 0 0 2024-04-25T13:47:22.038 INFO:tasks.workunit.client.0.smithi043.stdout:9/928: rmdir d0/d1d/d7/d41 39 2024-04-25T13:47:22.040 INFO:tasks.workunit.client.0.smithi043.stdout:9/929: dread - d0/d8b/d26/d39/d46/dfc/f130 zero size 2024-04-25T13:47:22.041 INFO:tasks.workunit.client.0.smithi043.stdout:9/930: write d0/d8b/d9b/da2/d128/f148 [984204,88957] 0 2024-04-25T13:47:22.043 INFO:tasks.workunit.client.0.smithi043.stdout:9/931: creat d0/d8b/dcd/d111/f151 x:0 0 0 2024-04-25T13:47:22.045 INFO:tasks.workunit.client.0.smithi043.stdout:9/932: symlink d0/d8b/d9b/da2/l152 0 2024-04-25T13:47:22.047 INFO:tasks.workunit.client.0.smithi043.stdout:9/933: mknod d0/d8b/d26/d39/d46/c153 0 2024-04-25T13:47:22.050 INFO:tasks.workunit.client.0.smithi043.stdout:9/934: truncate d0/d1d/d7/d83/f13b 460389 0 2024-04-25T13:47:22.056 INFO:tasks.workunit.client.0.smithi043.stdout:9/935: dwrite d0/d1d/d7/f95 [0,4194304] 0 2024-04-25T13:47:22.063 INFO:tasks.workunit.client.0.smithi043.stdout:9/936: write d0/d8b/d26/d39/d46/db9/fd9 [444718,110239] 0 2024-04-25T13:47:22.067 INFO:tasks.workunit.client.0.smithi043.stdout:9/937: creat d0/d8b/d9b/da2/f154 x:0 0 0 2024-04-25T13:47:22.070 INFO:tasks.workunit.client.0.smithi043.stdout:9/938: symlink d0/d8b/d9b/da2/d128/d138/l155 0 2024-04-25T13:47:22.083 INFO:tasks.workunit.client.0.smithi043.stdout:9/939: link d0/d8b/c38 d0/d8b/d26/d39/d46/dba/d129/c156 0 2024-04-25T13:47:22.084 INFO:tasks.workunit.client.0.smithi043.stdout:9/940: write d0/d8b/dcd/d111/f151 [362949,15987] 0 2024-04-25T13:47:22.087 INFO:tasks.workunit.client.0.smithi043.stdout:9/941: rename d0/d8b/d9b/da2/d128/d138/l155 to d0/d8b/d9b/da2/d128/l157 0 2024-04-25T13:47:22.089 INFO:tasks.workunit.client.0.smithi043.stdout:9/942: mkdir d0/d8b/d26/ddb/d158 0 2024-04-25T13:47:22.092 INFO:tasks.workunit.client.0.smithi043.stdout:9/943: unlink d0/d1d/d7/f10 0 2024-04-25T13:47:22.093 INFO:tasks.workunit.client.0.smithi043.stdout:9/944: fdatasync d0/d8b/d26/d39/d46/db9/fd9 0 2024-04-25T13:47:22.098 INFO:tasks.workunit.client.0.smithi043.stdout:9/945: getdents d0/d8b/d26/d39/d46 0 2024-04-25T13:47:22.103 INFO:tasks.workunit.client.0.smithi043.stdout:9/946: dwrite d0/d8b/d26/d47/d4d/ffd [0,4194304] 0 2024-04-25T13:47:22.111 INFO:tasks.workunit.client.0.smithi043.stdout:9/947: truncate d0/d8b/d9b/f56 616449 0 2024-04-25T13:47:22.111 INFO:tasks.workunit.client.0.smithi043.stdout:9/948: readlink d0/d1d/lea 0 2024-04-25T13:47:22.121 INFO:tasks.workunit.client.0.smithi043.stdout:9/949: dwrite d0/d1d/d4a/f13a [0,4194304] 0 2024-04-25T13:47:22.124 INFO:tasks.workunit.client.0.smithi043.stdout:9/950: mkdir d0/d8b/d26/d39/d46/dfc/d159 0 2024-04-25T13:47:22.126 INFO:tasks.workunit.client.0.smithi043.stdout:9/951: creat d0/d8b/d26/ddb/d158/f15a x:0 0 0 2024-04-25T13:47:22.128 INFO:tasks.workunit.client.0.smithi043.stdout:9/952: write d0/d8b/d26/d47/d52/fab [1177173,92636] 0 2024-04-25T13:47:22.131 INFO:tasks.workunit.client.0.smithi043.stdout:9/953: creat d0/d8b/d26/d39/d46/dba/d129/f15b x:0 0 0 2024-04-25T13:47:22.133 INFO:tasks.workunit.client.0.smithi043.stdout:9/954: mknod d0/d8b/d26/ddb/d158/c15c 0 2024-04-25T13:47:22.137 INFO:tasks.workunit.client.0.smithi043.stdout:9/955: creat d0/d1d/d7/d83/ddf/f15d x:0 0 0 2024-04-25T13:47:22.143 INFO:tasks.workunit.client.0.smithi043.stdout:9/956: write d0/d1d/d22/f92 [623675,113903] 0 2024-04-25T13:47:22.146 INFO:tasks.workunit.client.0.smithi043.stdout:9/957: unlink d0/d8b/d26/d47/d52/l91 0 2024-04-25T13:47:22.147 INFO:tasks.workunit.client.0.smithi043.stdout:9/958: fdatasync d0/d8b/d26/d47/d52/f80 0 2024-04-25T13:47:22.149 INFO:tasks.workunit.client.0.smithi043.stdout:9/959: mkdir d0/d1d/d4a/d15e 0 2024-04-25T13:47:22.152 INFO:tasks.workunit.client.0.smithi043.stdout:9/960: creat d0/d1d/d7/d81/d11e/f15f x:0 0 0 2024-04-25T13:47:22.154 INFO:tasks.workunit.client.0.smithi043.stdout:9/961: mknod d0/d8b/d9b/da2/d128/d14b/c160 0 2024-04-25T13:47:22.156 INFO:tasks.workunit.client.0.smithi043.stdout:9/962: creat d0/d8b/d9b/da2/d128/f161 x:0 0 0 2024-04-25T13:47:22.158 INFO:tasks.workunit.client.0.smithi043.stdout:9/963: creat d0/d8b/dcd/d111/f162 x:0 0 0 2024-04-25T13:47:22.161 INFO:tasks.workunit.client.0.smithi043.stdout:9/964: link d0/d1d/d7/d83/c103 d0/d1d/d7/d83/ddf/c163 0 2024-04-25T13:47:22.162 INFO:tasks.workunit.client.0.smithi043.stdout:9/965: fdatasync d0/d8b/d26/d47/d52/d115/f135 0 2024-04-25T13:47:22.162 INFO:tasks.workunit.client.0.smithi043.stdout:9/966: dread - d0/d8b/d9b/da2/d128/f14c zero size 2024-04-25T13:47:22.164 INFO:tasks.workunit.client.0.smithi043.stdout:9/967: write d0/d1d/d22/fb6 [5755178,3639] 0 2024-04-25T13:47:22.165 INFO:tasks.workunit.client.0.smithi043.stdout:9/968: truncate d0/d8b/d9b/da2/d128/d138/f14d 536736 0 2024-04-25T13:47:22.167 INFO:tasks.workunit.client.0.smithi043.stdout:9/969: mkdir d0/d8b/d26/d39/d46/dba/d164 0 2024-04-25T13:47:22.170 INFO:tasks.workunit.client.0.smithi043.stdout:9/970: creat d0/d1d/d7/d83/ddf/f165 x:0 0 0 2024-04-25T13:47:22.172 INFO:tasks.workunit.client.0.smithi043.stdout:9/971: rmdir d0/d8b/d26/d12d 39 2024-04-25T13:47:22.175 INFO:tasks.workunit.client.0.smithi043.stdout:9/972: creat d0/d8b/d26/ddb/d136/f166 x:0 0 0 2024-04-25T13:47:22.176 INFO:tasks.workunit.client.0.smithi043.stdout:9/973: write d0/d8b/d26/d39/d46/d62/dee/fff [652415,26265] 0 2024-04-25T13:47:22.178 INFO:tasks.workunit.client.0.smithi043.stdout:9/974: chown d0/d1d/d7/la3 125122028 1 2024-04-25T13:47:22.181 INFO:tasks.workunit.client.0.smithi043.stdout:9/975: symlink d0/d8b/d26/d39/d46/dba/l167 0 2024-04-25T13:47:22.181 INFO:tasks.workunit.client.0.smithi043.stdout:9/976: chown d0/d8b/d26/d39/f100 1169627 1 2024-04-25T13:47:22.183 INFO:tasks.workunit.client.0.smithi043.stdout:9/977: symlink d0/d8b/d26/d39/d46/dba/d129/l168 0 2024-04-25T13:47:22.184 INFO:tasks.workunit.client.0.smithi043.stdout:9/978: readlink d0/d1d/d4a/dc3/l140 0 2024-04-25T13:47:22.185 INFO:tasks.workunit.client.0.smithi043.stdout:9/979: write d0/d1d/d22/ff8 [590651,87726] 0 2024-04-25T13:47:22.194 INFO:tasks.workunit.client.0.smithi043.stdout:9/980: truncate d0/d8b/d26/d39/d46/dba/fd0 3415133 0 2024-04-25T13:47:22.206 INFO:tasks.workunit.client.0.smithi043.stdout:9/981: dwrite d0/d1d/d22/f43 [0,4194304] 0 2024-04-25T13:47:22.212 INFO:tasks.workunit.client.0.smithi043.stdout:9/982: creat d0/da7/f169 x:0 0 0 2024-04-25T13:47:22.212 INFO:tasks.workunit.client.0.smithi043.stdout:9/983: stat d0/d1d/d4a/d15e 0 2024-04-25T13:47:22.215 INFO:tasks.workunit.client.0.smithi043.stdout:9/984: creat d0/d8b/d26/d39/d46/d62/dee/f16a x:0 0 0 2024-04-25T13:47:22.220 INFO:tasks.workunit.client.0.smithi043.stdout:9/985: dwrite d0/f21 [0,4194304] 0 2024-04-25T13:47:22.223 INFO:tasks.workunit.client.0.smithi043.stdout:9/986: symlink d0/d1d/d4a/dc3/l16b 0 2024-04-25T13:47:22.226 INFO:tasks.workunit.client.0.smithi043.stdout:9/987: symlink d0/d8b/d26/d47/d4d/l16c 0 2024-04-25T13:47:22.242 INFO:tasks.workunit.client.0.smithi043.stdout:9/988: link d0/d8b/d9b/le8 d0/d8b/d26/d39/d46/dba/d129/d146/l16d 0 2024-04-25T13:47:22.244 INFO:tasks.workunit.client.0.smithi043.stdout:9/989: symlink d0/d8b/d26/d39/d46/dba/d129/d146/l16e 0 2024-04-25T13:47:22.247 INFO:tasks.workunit.client.0.smithi043.stdout:9/990: mkdir d0/d8b/d26/d39/d46/d62/d16f 0 2024-04-25T13:47:22.249 INFO:tasks.workunit.client.0.smithi043.stdout:9/991: dread d0/d1d/d4a/dc3/fd1 [0,4194304] 0 2024-04-25T13:47:22.258 INFO:tasks.workunit.client.0.smithi043.stdout:9/992: truncate d0/d8b/d26/d39/d46/d62/dad/fb1 445442 0 2024-04-25T13:47:22.258 INFO:tasks.workunit.client.0.smithi043.stdout:9/993: stat d0/d1d/d7/d83/ddf/f165 0 2024-04-25T13:47:22.261 INFO:tasks.workunit.client.0.smithi043.stdout:9/994: mkdir d0/d8b/d26/d39/d46/dfc/d144/d170 0 2024-04-25T13:47:22.262 INFO:tasks.workunit.client.0.smithi043.stdout:9/995: stat d0/d8b/d26/d39/d46/dfc 0 2024-04-25T13:47:22.272 INFO:tasks.workunit.client.0.smithi043.stdout:9/996: dwrite d0/d8b/d26/d47/d4d/f143 [0,4194304] 0 2024-04-25T13:47:22.274 INFO:tasks.workunit.client.0.smithi043.stdout:9/997: rmdir d0/d8b/d26/d39/d46/dfc 39 2024-04-25T13:47:22.278 INFO:tasks.workunit.client.0.smithi043.stdout:9/998: dread d0/d8b/f18 [0,4194304] 0 2024-04-25T13:47:22.280 INFO:tasks.workunit.client.0.smithi043.stdout:9/999: creat d0/d8b/d9b/da2/d128/d138/f171 x:0 0 0 2024-04-25T13:47:22.283 INFO:tasks.workunit.client.0.smithi043.stderr:+ rm -rf -- ./tmp.lay3LAZZ2F 2024-04-25T13:47:23.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:22 smithi161 ceph-mon[32696]: pgmap v86: 129 pgs: 129 active+clean; 2.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s rd, 156 MiB/s wr, 432 op/s 2024-04-25T13:47:23.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:22 smithi175 ceph-mon[32649]: pgmap v86: 129 pgs: 129 active+clean; 2.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s rd, 156 MiB/s wr, 432 op/s 2024-04-25T13:47:23.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:22 smithi043 ceph-mon[29195]: pgmap v86: 129 pgs: 129 active+clean; 2.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s rd, 156 MiB/s wr, 432 op/s 2024-04-25T13:47:25.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:24 smithi161 ceph-mon[32696]: pgmap v87: 129 pgs: 129 active+clean; 2.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 95 MiB/s wr, 272 op/s 2024-04-25T13:47:25.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:24 smithi175 ceph-mon[32649]: pgmap v87: 129 pgs: 129 active+clean; 2.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 95 MiB/s wr, 272 op/s 2024-04-25T13:47:25.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:24 smithi043 ceph-mon[29195]: pgmap v87: 129 pgs: 129 active+clean; 2.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 95 MiB/s wr, 272 op/s 2024-04-25T13:47:27.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:26 smithi161 ceph-mon[32696]: pgmap v88: 129 pgs: 129 active+clean; 2.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 95 MiB/s wr, 272 op/s 2024-04-25T13:47:27.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:26 smithi175 ceph-mon[32649]: pgmap v88: 129 pgs: 129 active+clean; 2.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 95 MiB/s wr, 272 op/s 2024-04-25T13:47:27.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:26 smithi043 ceph-mon[29195]: pgmap v88: 129 pgs: 129 active+clean; 2.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 95 MiB/s wr, 272 op/s 2024-04-25T13:47:29.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:28 smithi161 ceph-mon[32696]: pgmap v89: 129 pgs: 129 active+clean; 2.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 MiB/s rd, 99 MiB/s wr, 337 op/s 2024-04-25T13:47:29.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:28 smithi175 ceph-mon[32649]: pgmap v89: 129 pgs: 129 active+clean; 2.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 MiB/s rd, 99 MiB/s wr, 337 op/s 2024-04-25T13:47:29.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:28 smithi043 ceph-mon[29195]: pgmap v89: 129 pgs: 129 active+clean; 2.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 MiB/s rd, 99 MiB/s wr, 337 op/s 2024-04-25T13:47:31.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:30 smithi161 ceph-mon[32696]: pgmap v90: 129 pgs: 129 active+clean; 2.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 26 MiB/s wr, 137 op/s 2024-04-25T13:47:31.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:30 smithi175 ceph-mon[32649]: pgmap v90: 129 pgs: 129 active+clean; 2.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 26 MiB/s wr, 137 op/s 2024-04-25T13:47:31.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:30 smithi043 ceph-mon[29195]: pgmap v90: 129 pgs: 129 active+clean; 2.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 26 MiB/s wr, 137 op/s 2024-04-25T13:47:33.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:32 smithi161 ceph-mon[32696]: pgmap v91: 129 pgs: 129 active+clean; 1.7 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 27 MiB/s wr, 201 op/s 2024-04-25T13:47:33.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:32 smithi175 ceph-mon[32649]: pgmap v91: 129 pgs: 129 active+clean; 1.7 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 27 MiB/s wr, 201 op/s 2024-04-25T13:47:33.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:32 smithi043 ceph-mon[29195]: pgmap v91: 129 pgs: 129 active+clean; 1.7 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 27 MiB/s wr, 201 op/s 2024-04-25T13:47:35.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:34 smithi161 ceph-mon[32696]: pgmap v92: 129 pgs: 129 active+clean; 1.7 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 4.5 MiB/s wr, 128 op/s 2024-04-25T13:47:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:34 smithi175 ceph-mon[32649]: pgmap v92: 129 pgs: 129 active+clean; 1.7 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 4.5 MiB/s wr, 128 op/s 2024-04-25T13:47:35.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:34 smithi043 ceph-mon[29195]: pgmap v92: 129 pgs: 129 active+clean; 1.7 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 4.5 MiB/s wr, 128 op/s 2024-04-25T13:47:37.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:36 smithi161 ceph-mon[32696]: pgmap v93: 129 pgs: 129 active+clean; 1.7 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 4.5 MiB/s wr, 128 op/s 2024-04-25T13:47:37.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:36 smithi175 ceph-mon[32649]: pgmap v93: 129 pgs: 129 active+clean; 1.7 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 4.5 MiB/s wr, 128 op/s 2024-04-25T13:47:37.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:36 smithi043 ceph-mon[29195]: pgmap v93: 129 pgs: 129 active+clean; 1.7 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 4.5 MiB/s wr, 128 op/s 2024-04-25T13:47:39.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:38 smithi161 ceph-mon[32696]: pgmap v94: 129 pgs: 129 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.8 MiB/s wr, 187 op/s 2024-04-25T13:47:39.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:38 smithi175 ceph-mon[32649]: pgmap v94: 129 pgs: 129 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.8 MiB/s wr, 187 op/s 2024-04-25T13:47:39.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:38 smithi043 ceph-mon[29195]: pgmap v94: 129 pgs: 129 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.8 MiB/s wr, 187 op/s 2024-04-25T13:47:40.802 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T13:47:40.803 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T13:47:41.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:40 smithi161 ceph-mon[32696]: pgmap v95: 129 pgs: 129 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 695 KiB/s wr, 122 op/s 2024-04-25T13:47:41.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:40 smithi175 ceph-mon[32649]: pgmap v95: 129 pgs: 129 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 695 KiB/s wr, 122 op/s 2024-04-25T13:47:41.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:40 smithi043 ceph-mon[29195]: pgmap v95: 129 pgs: 129 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 695 KiB/s wr, 122 op/s 2024-04-25T13:47:43.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:42 smithi161 ceph-mon[32696]: pgmap v96: 129 pgs: 129 active+clean; 800 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 179 op/s 2024-04-25T13:47:43.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:42 smithi175 ceph-mon[32649]: pgmap v96: 129 pgs: 129 active+clean; 800 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 179 op/s 2024-04-25T13:47:43.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:42 smithi043 ceph-mon[29195]: pgmap v96: 129 pgs: 129 active+clean; 800 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 179 op/s 2024-04-25T13:47:44.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:43 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:47:44.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:43 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:47:44.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:43 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:47:45.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:44 smithi161 ceph-mon[32696]: pgmap v97: 129 pgs: 129 active+clean; 800 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 691 KiB/s wr, 114 op/s 2024-04-25T13:47:45.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:44 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:47:45.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:44 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:47:45.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:44 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:47:45.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:44 smithi175 ceph-mon[32649]: pgmap v97: 129 pgs: 129 active+clean; 800 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 691 KiB/s wr, 114 op/s 2024-04-25T13:47:45.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:44 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:47:45.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:44 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:47:45.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:44 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:47:45.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:44 smithi043 ceph-mon[29195]: pgmap v97: 129 pgs: 129 active+clean; 800 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 691 KiB/s wr, 114 op/s 2024-04-25T13:47:45.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:44 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:47:45.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:44 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:47:45.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:44 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:47:47.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:46 smithi161 ceph-mon[32696]: pgmap v98: 129 pgs: 129 active+clean; 800 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 691 KiB/s wr, 114 op/s 2024-04-25T13:47:47.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:46 smithi175 ceph-mon[32649]: pgmap v98: 129 pgs: 129 active+clean; 800 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 691 KiB/s wr, 114 op/s 2024-04-25T13:47:47.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:46 smithi043 ceph-mon[29195]: pgmap v98: 129 pgs: 129 active+clean; 800 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 691 KiB/s wr, 114 op/s 2024-04-25T13:47:49.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:48 smithi161 ceph-mon[32696]: pgmap v99: 129 pgs: 129 active+clean; 629 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 202 op/s 2024-04-25T13:47:49.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:48 smithi175 ceph-mon[32649]: pgmap v99: 129 pgs: 129 active+clean; 629 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 202 op/s 2024-04-25T13:47:49.213 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:48 smithi043 ceph-mon[29195]: pgmap v99: 129 pgs: 129 active+clean; 629 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 202 op/s 2024-04-25T13:47:51.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:50 smithi175 ceph-mon[32649]: pgmap v100: 129 pgs: 129 active+clean; 629 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 907 KiB/s rd, 898 KiB/s wr, 144 op/s 2024-04-25T13:47:51.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:50 smithi043 ceph-mon[29195]: pgmap v100: 129 pgs: 129 active+clean; 629 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 907 KiB/s rd, 898 KiB/s wr, 144 op/s 2024-04-25T13:47:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:50 smithi161 ceph-mon[32696]: pgmap v100: 129 pgs: 129 active+clean; 629 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 907 KiB/s rd, 898 KiB/s wr, 144 op/s 2024-04-25T13:47:53.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:52 smithi175 ceph-mon[32649]: pgmap v101: 129 pgs: 129 active+clean; 635 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 249 op/s 2024-04-25T13:47:53.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:52 smithi043 ceph-mon[29195]: pgmap v101: 129 pgs: 129 active+clean; 635 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 249 op/s 2024-04-25T13:47:53.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:52 smithi161 ceph-mon[32696]: pgmap v101: 129 pgs: 129 active+clean; 635 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 249 op/s 2024-04-25T13:47:55.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:54 smithi175 ceph-mon[32649]: pgmap v102: 129 pgs: 129 active+clean; 635 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.1 MiB/s wr, 192 op/s 2024-04-25T13:47:55.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:54 smithi043 ceph-mon[29195]: pgmap v102: 129 pgs: 129 active+clean; 635 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.1 MiB/s wr, 192 op/s 2024-04-25T13:47:55.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:54 smithi161 ceph-mon[32696]: pgmap v102: 129 pgs: 129 active+clean; 635 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.1 MiB/s wr, 192 op/s 2024-04-25T13:47:57.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:56 smithi175 ceph-mon[32649]: pgmap v103: 129 pgs: 129 active+clean; 635 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.1 MiB/s wr, 192 op/s 2024-04-25T13:47:57.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:56 smithi043 ceph-mon[29195]: pgmap v103: 129 pgs: 129 active+clean; 635 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.1 MiB/s wr, 192 op/s 2024-04-25T13:47:57.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:56 smithi161 ceph-mon[32696]: pgmap v103: 129 pgs: 129 active+clean; 635 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.1 MiB/s wr, 192 op/s 2024-04-25T13:47:59.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:47:58 smithi175 ceph-mon[32649]: pgmap v104: 129 pgs: 129 active+clean; 642 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 287 op/s 2024-04-25T13:47:59.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:47:58 smithi043 ceph-mon[29195]: pgmap v104: 129 pgs: 129 active+clean; 642 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 287 op/s 2024-04-25T13:47:59.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:47:58 smithi161 ceph-mon[32696]: pgmap v104: 129 pgs: 129 active+clean; 642 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 287 op/s 2024-04-25T13:48:01.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:00 smithi175 ceph-mon[32649]: pgmap v105: 129 pgs: 129 active+clean; 642 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 199 op/s 2024-04-25T13:48:01.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:00 smithi043 ceph-mon[29195]: pgmap v105: 129 pgs: 129 active+clean; 642 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 199 op/s 2024-04-25T13:48:01.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:00 smithi161 ceph-mon[32696]: pgmap v105: 129 pgs: 129 active+clean; 642 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 199 op/s 2024-04-25T13:48:03.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:02 smithi175 ceph-mon[32649]: pgmap v106: 129 pgs: 129 active+clean; 648 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 330 op/s 2024-04-25T13:48:03.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:02 smithi043 ceph-mon[29195]: pgmap v106: 129 pgs: 129 active+clean; 648 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 330 op/s 2024-04-25T13:48:03.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:02 smithi161 ceph-mon[32696]: pgmap v106: 129 pgs: 129 active+clean; 648 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 330 op/s 2024-04-25T13:48:05.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:04 smithi175 ceph-mon[32649]: pgmap v107: 129 pgs: 129 active+clean; 648 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 225 op/s 2024-04-25T13:48:05.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:04 smithi043 ceph-mon[29195]: pgmap v107: 129 pgs: 129 active+clean; 648 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 225 op/s 2024-04-25T13:48:05.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:04 smithi161 ceph-mon[32696]: pgmap v107: 129 pgs: 129 active+clean; 648 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 225 op/s 2024-04-25T13:48:07.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:06 smithi175 ceph-mon[32649]: pgmap v108: 129 pgs: 129 active+clean; 648 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 225 op/s 2024-04-25T13:48:07.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:06 smithi043 ceph-mon[29195]: pgmap v108: 129 pgs: 129 active+clean; 648 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 225 op/s 2024-04-25T13:48:07.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:06 smithi161 ceph-mon[32696]: pgmap v108: 129 pgs: 129 active+clean; 648 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 225 op/s 2024-04-25T13:48:09.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:08 smithi175 ceph-mon[32649]: pgmap v109: 129 pgs: 129 active+clean; 656 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 332 op/s 2024-04-25T13:48:09.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:08 smithi043 ceph-mon[29195]: pgmap v109: 129 pgs: 129 active+clean; 656 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 332 op/s 2024-04-25T13:48:09.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:08 smithi161 ceph-mon[32696]: pgmap v109: 129 pgs: 129 active+clean; 656 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 332 op/s 2024-04-25T13:48:11.153 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:10 smithi161 ceph-mon[32696]: pgmap v110: 129 pgs: 129 active+clean; 656 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 237 op/s 2024-04-25T13:48:11.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:10 smithi175 ceph-mon[32649]: pgmap v110: 129 pgs: 129 active+clean; 656 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 237 op/s 2024-04-25T13:48:11.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:10 smithi043 ceph-mon[29195]: pgmap v110: 129 pgs: 129 active+clean; 656 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 237 op/s 2024-04-25T13:48:13.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:12 smithi175 ceph-mon[32649]: pgmap v111: 129 pgs: 129 active+clean; 663 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 363 op/s 2024-04-25T13:48:13.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:12 smithi043 ceph-mon[29195]: pgmap v111: 129 pgs: 129 active+clean; 663 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 363 op/s 2024-04-25T13:48:13.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:12 smithi161 ceph-mon[32696]: pgmap v111: 129 pgs: 129 active+clean; 663 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 363 op/s 2024-04-25T13:48:15.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:14 smithi175 ceph-mon[32649]: pgmap v112: 129 pgs: 129 active+clean; 663 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 232 op/s 2024-04-25T13:48:15.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:14 smithi043 ceph-mon[29195]: pgmap v112: 129 pgs: 129 active+clean; 663 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 232 op/s 2024-04-25T13:48:15.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:14 smithi161 ceph-mon[32696]: pgmap v112: 129 pgs: 129 active+clean; 663 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 232 op/s 2024-04-25T13:48:17.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:16 smithi175 ceph-mon[32649]: pgmap v113: 129 pgs: 129 active+clean; 663 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 232 op/s 2024-04-25T13:48:17.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:16 smithi043 ceph-mon[29195]: pgmap v113: 129 pgs: 129 active+clean; 663 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 232 op/s 2024-04-25T13:48:17.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:16 smithi161 ceph-mon[32696]: pgmap v113: 129 pgs: 129 active+clean; 663 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 232 op/s 2024-04-25T13:48:19.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:18 smithi175 ceph-mon[32649]: pgmap v114: 129 pgs: 129 active+clean; 668 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 334 op/s 2024-04-25T13:48:19.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:18 smithi043 ceph-mon[29195]: pgmap v114: 129 pgs: 129 active+clean; 668 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 334 op/s 2024-04-25T13:48:19.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:18 smithi161 ceph-mon[32696]: pgmap v114: 129 pgs: 129 active+clean; 668 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 334 op/s 2024-04-25T13:48:21.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:20 smithi175 ceph-mon[32649]: pgmap v115: 129 pgs: 129 active+clean; 668 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 227 op/s 2024-04-25T13:48:21.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:20 smithi043 ceph-mon[29195]: pgmap v115: 129 pgs: 129 active+clean; 668 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 227 op/s 2024-04-25T13:48:21.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:20 smithi161 ceph-mon[32696]: pgmap v115: 129 pgs: 129 active+clean; 668 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 227 op/s 2024-04-25T13:48:23.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:22 smithi175 ceph-mon[32649]: pgmap v116: 129 pgs: 129 active+clean; 674 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 322 op/s 2024-04-25T13:48:23.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:22 smithi043 ceph-mon[29195]: pgmap v116: 129 pgs: 129 active+clean; 674 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 322 op/s 2024-04-25T13:48:23.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:22 smithi161 ceph-mon[32696]: pgmap v116: 129 pgs: 129 active+clean; 674 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 322 op/s 2024-04-25T13:48:25.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:24 smithi175 ceph-mon[32649]: pgmap v117: 129 pgs: 129 active+clean; 674 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 980 KiB/s wr, 196 op/s 2024-04-25T13:48:25.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:24 smithi043 ceph-mon[29195]: pgmap v117: 129 pgs: 129 active+clean; 674 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 980 KiB/s wr, 196 op/s 2024-04-25T13:48:25.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:24 smithi161 ceph-mon[32696]: pgmap v117: 129 pgs: 129 active+clean; 674 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 980 KiB/s wr, 196 op/s 2024-04-25T13:48:27.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:26 smithi175 ceph-mon[32649]: pgmap v118: 129 pgs: 129 active+clean; 674 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 980 KiB/s wr, 196 op/s 2024-04-25T13:48:27.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:26 smithi043 ceph-mon[29195]: pgmap v118: 129 pgs: 129 active+clean; 674 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 980 KiB/s wr, 196 op/s 2024-04-25T13:48:27.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:26 smithi161 ceph-mon[32696]: pgmap v118: 129 pgs: 129 active+clean; 674 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 980 KiB/s wr, 196 op/s 2024-04-25T13:48:29.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:28 smithi175 ceph-mon[32649]: pgmap v119: 129 pgs: 129 active+clean; 680 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 304 op/s 2024-04-25T13:48:29.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:28 smithi043 ceph-mon[29195]: pgmap v119: 129 pgs: 129 active+clean; 680 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 304 op/s 2024-04-25T13:48:29.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:28 smithi161 ceph-mon[32696]: pgmap v119: 129 pgs: 129 active+clean; 680 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 304 op/s 2024-04-25T13:48:31.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:30 smithi175 ceph-mon[32649]: pgmap v120: 129 pgs: 129 active+clean; 680 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 1.1 MiB/s wr, 201 op/s 2024-04-25T13:48:31.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:30 smithi043 ceph-mon[29195]: pgmap v120: 129 pgs: 129 active+clean; 680 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 1.1 MiB/s wr, 201 op/s 2024-04-25T13:48:31.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:30 smithi161 ceph-mon[32696]: pgmap v120: 129 pgs: 129 active+clean; 680 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 1.1 MiB/s wr, 201 op/s 2024-04-25T13:48:33.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:32 smithi175 ceph-mon[32649]: pgmap v121: 129 pgs: 129 active+clean; 686 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 308 op/s 2024-04-25T13:48:33.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:32 smithi043 ceph-mon[29195]: pgmap v121: 129 pgs: 129 active+clean; 686 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 308 op/s 2024-04-25T13:48:33.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:32 smithi161 ceph-mon[32696]: pgmap v121: 129 pgs: 129 active+clean; 686 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 308 op/s 2024-04-25T13:48:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:34 smithi175 ceph-mon[32649]: pgmap v122: 129 pgs: 129 active+clean; 686 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.0 MiB/s wr, 214 op/s 2024-04-25T13:48:35.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:34 smithi043 ceph-mon[29195]: pgmap v122: 129 pgs: 129 active+clean; 686 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.0 MiB/s wr, 214 op/s 2024-04-25T13:48:35.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:34 smithi161 ceph-mon[32696]: pgmap v122: 129 pgs: 129 active+clean; 686 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.0 MiB/s wr, 214 op/s 2024-04-25T13:48:37.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:36 smithi175 ceph-mon[32649]: pgmap v123: 129 pgs: 129 active+clean; 686 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.0 MiB/s wr, 214 op/s 2024-04-25T13:48:37.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:36 smithi043 ceph-mon[29195]: pgmap v123: 129 pgs: 129 active+clean; 686 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.0 MiB/s wr, 214 op/s 2024-04-25T13:48:37.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:36 smithi161 ceph-mon[32696]: pgmap v123: 129 pgs: 129 active+clean; 686 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.0 MiB/s wr, 214 op/s 2024-04-25T13:48:37.908 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-25T13:48:37.908 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T13:48:38.255 DEBUG:teuthology.parallel:result is None 2024-04-25T13:48:38.255 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T13:48:38.292 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T13:48:38.293 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-04-25T13:48:38.304 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-04-25T13:48:38.304 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T13:48:38.304 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T13:48:38.304 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-04-25T13:48:38.358 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-04-25T13:48:39.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:38 smithi175 ceph-mon[32649]: pgmap v124: 129 pgs: 129 active+clean; 692 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 308 op/s 2024-04-25T13:48:39.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:38 smithi043 ceph-mon[29195]: pgmap v124: 129 pgs: 129 active+clean; 692 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 308 op/s 2024-04-25T13:48:39.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:38 smithi161 ceph-mon[32696]: pgmap v124: 129 pgs: 129 active+clean; 692 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 308 op/s 2024-04-25T13:48:41.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:40 smithi175 ceph-mon[32649]: pgmap v125: 129 pgs: 129 active+clean; 692 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 200 op/s 2024-04-25T13:48:41.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:40 smithi043 ceph-mon[29195]: pgmap v125: 129 pgs: 129 active+clean; 692 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 200 op/s 2024-04-25T13:48:41.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:40 smithi161 ceph-mon[32696]: pgmap v125: 129 pgs: 129 active+clean; 692 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 200 op/s 2024-04-25T13:48:43.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:42 smithi175 ceph-mon[32649]: pgmap v126: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 266 op/s 2024-04-25T13:48:43.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:42 smithi043 ceph-mon[29195]: pgmap v126: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 266 op/s 2024-04-25T13:48:43.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:42 smithi161 ceph-mon[32696]: pgmap v126: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 266 op/s 2024-04-25T13:48:45.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:44 smithi175 ceph-mon[32649]: pgmap v127: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 691 KiB/s wr, 159 op/s 2024-04-25T13:48:45.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:44 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:48:45.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:44 smithi043 ceph-mon[29195]: pgmap v127: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 691 KiB/s wr, 159 op/s 2024-04-25T13:48:45.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:44 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:48:45.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:44 smithi161 ceph-mon[32696]: pgmap v127: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 691 KiB/s wr, 159 op/s 2024-04-25T13:48:45.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:44 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:48:46.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:45 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:48:46.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:45 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:48:46.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:45 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:48:46.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:45 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:48:46.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:45 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:48:46.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:45 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:48:46.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:45 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:48:46.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:45 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:48:46.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:45 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:48:47.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:46 smithi043 ceph-mon[29195]: pgmap v128: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 691 KiB/s wr, 159 op/s 2024-04-25T13:48:47.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:46 smithi161 ceph-mon[32696]: pgmap v128: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 691 KiB/s wr, 159 op/s 2024-04-25T13:48:47.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:46 smithi175 ceph-mon[32649]: pgmap v128: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 691 KiB/s wr, 159 op/s 2024-04-25T13:48:49.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:48 smithi043 ceph-mon[29195]: pgmap v129: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 700 KiB/s wr, 164 op/s 2024-04-25T13:48:49.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:48 smithi161 ceph-mon[32696]: pgmap v129: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 700 KiB/s wr, 164 op/s 2024-04-25T13:48:49.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:48 smithi175 ceph-mon[32649]: pgmap v129: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 700 KiB/s wr, 164 op/s 2024-04-25T13:48:51.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:50 smithi043 ceph-mon[29195]: pgmap v130: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 182 KiB/s wr, 70 op/s 2024-04-25T13:48:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:50 smithi161 ceph-mon[32696]: pgmap v130: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 182 KiB/s wr, 70 op/s 2024-04-25T13:48:51.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:50 smithi175 ceph-mon[32649]: pgmap v130: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 182 KiB/s wr, 70 op/s 2024-04-25T13:48:53.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:52 smithi043 ceph-mon[29195]: pgmap v131: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 184 KiB/s wr, 73 op/s 2024-04-25T13:48:53.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:52 smithi161 ceph-mon[32696]: pgmap v131: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 184 KiB/s wr, 73 op/s 2024-04-25T13:48:53.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:52 smithi175 ceph-mon[32649]: pgmap v131: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 184 KiB/s wr, 73 op/s 2024-04-25T13:48:55.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:54 smithi043 ceph-mon[29195]: pgmap v132: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-25T13:48:55.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:54 smithi161 ceph-mon[32696]: pgmap v132: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-25T13:48:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:54 smithi175 ceph-mon[32649]: pgmap v132: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-25T13:48:57.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:56 smithi043 ceph-mon[29195]: pgmap v133: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-25T13:48:57.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:56 smithi161 ceph-mon[32696]: pgmap v133: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-25T13:48:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:56 smithi175 ceph-mon[32649]: pgmap v133: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-04-25T13:48:59.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:48:58 smithi043 ceph-mon[29195]: pgmap v134: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-04-25T13:48:59.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:48:58 smithi161 ceph-mon[32696]: pgmap v134: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-04-25T13:48:59.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:48:58 smithi175 ceph-mon[32649]: pgmap v134: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-04-25T13:49:01.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:00 smithi043 ceph-mon[29195]: pgmap v135: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.8 KiB/s wr, 5 op/s 2024-04-25T13:49:01.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:00 smithi161 ceph-mon[32696]: pgmap v135: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.8 KiB/s wr, 5 op/s 2024-04-25T13:49:01.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:00 smithi175 ceph-mon[32649]: pgmap v135: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.8 KiB/s wr, 5 op/s 2024-04-25T13:49:03.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:02 smithi043 ceph-mon[29195]: pgmap v136: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-04-25T13:49:03.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:02 smithi161 ceph-mon[32696]: pgmap v136: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-04-25T13:49:03.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:02 smithi175 ceph-mon[32649]: pgmap v136: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-04-25T13:49:05.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:04 smithi161 ceph-mon[32696]: pgmap v137: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-04-25T13:49:05.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:04 smithi175 ceph-mon[32649]: pgmap v137: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-04-25T13:49:05.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:04 smithi043 ceph-mon[29195]: pgmap v137: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-04-25T13:49:07.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:06 smithi161 ceph-mon[32696]: pgmap v138: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-04-25T13:49:07.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:06 smithi175 ceph-mon[32649]: pgmap v138: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-04-25T13:49:07.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:06 smithi043 ceph-mon[29195]: pgmap v138: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-04-25T13:49:09.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:08 smithi161 ceph-mon[32696]: pgmap v139: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-04-25T13:49:09.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:08 smithi175 ceph-mon[32649]: pgmap v139: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-04-25T13:49:09.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:08 smithi043 ceph-mon[29195]: pgmap v139: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-04-25T13:49:11.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:10 smithi161 ceph-mon[32696]: pgmap v140: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-04-25T13:49:11.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:10 smithi175 ceph-mon[32649]: pgmap v140: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-04-25T13:49:11.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:10 smithi043 ceph-mon[29195]: pgmap v140: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-04-25T13:49:13.232 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:12 smithi175 ceph-mon[32649]: pgmap v141: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-04-25T13:49:13.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:12 smithi161 ceph-mon[32696]: pgmap v141: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-04-25T13:49:13.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:12 smithi043 ceph-mon[29195]: pgmap v141: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-04-25T13:49:15.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:14 smithi161 ceph-mon[32696]: pgmap v142: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T13:49:15.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:14 smithi175 ceph-mon[32649]: pgmap v142: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T13:49:15.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:14 smithi043 ceph-mon[29195]: pgmap v142: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T13:49:17.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:16 smithi161 ceph-mon[32696]: pgmap v143: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T13:49:17.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:16 smithi175 ceph-mon[32649]: pgmap v143: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T13:49:17.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:16 smithi043 ceph-mon[29195]: pgmap v143: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T13:49:19.264 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:18 smithi043 ceph-mon[29195]: pgmap v144: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T13:49:19.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:18 smithi161 ceph-mon[32696]: pgmap v144: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T13:49:19.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:18 smithi175 ceph-mon[32649]: pgmap v144: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T13:49:21.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:20 smithi161 ceph-mon[32696]: pgmap v145: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T13:49:21.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:20 smithi175 ceph-mon[32649]: pgmap v145: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T13:49:21.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:20 smithi043 ceph-mon[29195]: pgmap v145: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T13:49:23.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:22 smithi161 ceph-mon[32696]: pgmap v146: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-25T13:49:23.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:22 smithi175 ceph-mon[32649]: pgmap v146: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-25T13:49:23.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:22 smithi043 ceph-mon[29195]: pgmap v146: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-25T13:49:25.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:24 smithi161 ceph-mon[32696]: pgmap v147: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:25.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:24 smithi175 ceph-mon[32649]: pgmap v147: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:25.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:24 smithi043 ceph-mon[29195]: pgmap v147: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:27.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:27 smithi161 ceph-mon[32696]: pgmap v148: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:27.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:27 smithi175 ceph-mon[32649]: pgmap v148: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:27.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:27 smithi043 ceph-mon[29195]: pgmap v148: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:29.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:29 smithi161 ceph-mon[32696]: pgmap v149: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:49:29.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:29 smithi175 ceph-mon[32649]: pgmap v149: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:49:29.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:29 smithi043 ceph-mon[29195]: pgmap v149: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:49:31.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:31 smithi161 ceph-mon[32696]: pgmap v150: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:31.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:31 smithi175 ceph-mon[32649]: pgmap v150: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:31.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:31 smithi043 ceph-mon[29195]: pgmap v150: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:33.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:33 smithi161 ceph-mon[32696]: pgmap v151: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:49:33.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:33 smithi175 ceph-mon[32649]: pgmap v151: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:49:33.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:33 smithi043 ceph-mon[29195]: pgmap v151: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:49:35.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:35 smithi161 ceph-mon[32696]: pgmap v152: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:35.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:35 smithi175 ceph-mon[32649]: pgmap v152: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:35.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:35 smithi043 ceph-mon[29195]: pgmap v152: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:37.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:37 smithi161 ceph-mon[32696]: pgmap v153: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:37.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:37 smithi175 ceph-mon[32649]: pgmap v153: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:37.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:37 smithi043 ceph-mon[29195]: pgmap v153: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:39.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:39 smithi161 ceph-mon[32696]: pgmap v154: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:49:39.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:39 smithi175 ceph-mon[32649]: pgmap v154: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:49:39.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:39 smithi043 ceph-mon[29195]: pgmap v154: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:49:41.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:41 smithi161 ceph-mon[32696]: pgmap v155: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T13:49:41.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:41 smithi175 ceph-mon[32649]: pgmap v155: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T13:49:41.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:41 smithi043 ceph-mon[29195]: pgmap v155: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T13:49:43.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:43 smithi161 ceph-mon[32696]: pgmap v156: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-25T13:49:43.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:43 smithi175 ceph-mon[32649]: pgmap v156: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-25T13:49:43.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:43 smithi043 ceph-mon[29195]: pgmap v156: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-25T13:49:45.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:45 smithi161 ceph-mon[32696]: pgmap v157: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-25T13:49:45.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:45 smithi175 ceph-mon[32649]: pgmap v157: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-25T13:49:45.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:45 smithi043 ceph-mon[29195]: pgmap v157: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-25T13:49:46.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:46 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:49:46.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:46 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:49:46.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:46 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:49:46.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:46 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:49:46.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:46 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:49:46.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:46 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:49:46.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:46 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:49:46.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:46 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:49:46.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:46 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:49:46.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:46 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:49:46.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:46 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:49:46.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:46 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:49:47.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:47 smithi161 ceph-mon[32696]: pgmap v158: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-25T13:49:47.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:47 smithi175 ceph-mon[32649]: pgmap v158: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-25T13:49:47.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:47 smithi043 ceph-mon[29195]: pgmap v158: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-25T13:49:49.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:49 smithi161 ceph-mon[32696]: pgmap v159: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-25T13:49:49.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:49 smithi175 ceph-mon[32649]: pgmap v159: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-25T13:49:49.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:49 smithi043 ceph-mon[29195]: pgmap v159: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-25T13:49:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:51 smithi161 ceph-mon[32696]: pgmap v160: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T13:49:51.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:51 smithi175 ceph-mon[32649]: pgmap v160: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T13:49:51.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:51 smithi043 ceph-mon[29195]: pgmap v160: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T13:49:53.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:53 smithi161 ceph-mon[32696]: pgmap v161: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:49:53.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:53 smithi175 ceph-mon[32649]: pgmap v161: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:49:53.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:53 smithi043 ceph-mon[29195]: pgmap v161: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:49:55.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:55 smithi161 ceph-mon[32696]: pgmap v162: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:55 smithi175 ceph-mon[32649]: pgmap v162: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:55.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:55 smithi043 ceph-mon[29195]: pgmap v162: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:57.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:57 smithi161 ceph-mon[32696]: pgmap v163: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:57 smithi175 ceph-mon[32649]: pgmap v163: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:57.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:57 smithi043 ceph-mon[29195]: pgmap v163: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:49:59.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:49:59 smithi161 ceph-mon[32696]: pgmap v164: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:49:59.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:49:59 smithi175 ceph-mon[32649]: pgmap v164: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:49:59.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:49:59 smithi043 ceph-mon[29195]: pgmap v164: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:00.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:00 smithi161 ceph-mon[32696]: overall HEALTH_OK 2024-04-25T13:50:00.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:00 smithi175 ceph-mon[32649]: overall HEALTH_OK 2024-04-25T13:50:00.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:00 smithi043 ceph-mon[29195]: overall HEALTH_OK 2024-04-25T13:50:01.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:01 smithi161 ceph-mon[32696]: pgmap v165: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:01.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:01 smithi175 ceph-mon[32649]: pgmap v165: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:01.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:01 smithi043 ceph-mon[29195]: pgmap v165: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:03.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:03 smithi161 ceph-mon[32696]: pgmap v166: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:50:03.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:03 smithi175 ceph-mon[32649]: pgmap v166: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:50:03.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:03 smithi043 ceph-mon[29195]: pgmap v166: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:50:05.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:05 smithi161 ceph-mon[32696]: pgmap v167: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T13:50:05.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:05 smithi175 ceph-mon[32649]: pgmap v167: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T13:50:05.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:05 smithi043 ceph-mon[29195]: pgmap v167: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T13:50:07.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:07 smithi161 ceph-mon[32696]: pgmap v168: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T13:50:07.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:07 smithi175 ceph-mon[32649]: pgmap v168: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T13:50:07.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:07 smithi043 ceph-mon[29195]: pgmap v168: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-04-25T13:50:09.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:09 smithi161 ceph-mon[32696]: pgmap v169: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:50:09.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:09 smithi175 ceph-mon[32649]: pgmap v169: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:50:09.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:09 smithi043 ceph-mon[29195]: pgmap v169: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:50:11.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:11 smithi161 ceph-mon[32696]: pgmap v170: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T13:50:11.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:11 smithi175 ceph-mon[32649]: pgmap v170: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T13:50:11.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:11 smithi043 ceph-mon[29195]: pgmap v170: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-25T13:50:13.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:13 smithi161 ceph-mon[32696]: pgmap v171: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:50:13.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:13 smithi175 ceph-mon[32649]: pgmap v171: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:50:13.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:13 smithi043 ceph-mon[29195]: pgmap v171: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-04-25T13:50:15.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:15 smithi161 ceph-mon[32696]: pgmap v172: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T13:50:15.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:15 smithi175 ceph-mon[32649]: pgmap v172: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T13:50:15.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:15 smithi043 ceph-mon[29195]: pgmap v172: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T13:50:17.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:17 smithi161 ceph-mon[32696]: pgmap v173: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T13:50:17.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:17 smithi175 ceph-mon[32649]: pgmap v173: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T13:50:17.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:17 smithi043 ceph-mon[29195]: pgmap v173: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T13:50:19.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:19 smithi161 ceph-mon[32696]: pgmap v174: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-25T13:50:19.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:19 smithi175 ceph-mon[32649]: pgmap v174: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-25T13:50:19.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:19 smithi043 ceph-mon[29195]: pgmap v174: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-25T13:50:21.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:21 smithi161 ceph-mon[32696]: pgmap v175: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T13:50:21.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:21 smithi175 ceph-mon[32649]: pgmap v175: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T13:50:21.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:21 smithi043 ceph-mon[29195]: pgmap v175: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T13:50:23.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:23 smithi161 ceph-mon[32696]: pgmap v176: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-25T13:50:23.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:23 smithi175 ceph-mon[32649]: pgmap v176: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-25T13:50:23.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:23 smithi043 ceph-mon[29195]: pgmap v176: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-25T13:50:25.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:25 smithi175 ceph-mon[32649]: pgmap v177: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:25.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:25 smithi043 ceph-mon[29195]: pgmap v177: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:25.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:25 smithi161 ceph-mon[32696]: pgmap v177: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:27.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:27 smithi175 ceph-mon[32649]: pgmap v178: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:27.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:27 smithi043 ceph-mon[29195]: pgmap v178: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:27.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:27 smithi161 ceph-mon[32696]: pgmap v178: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:29.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:29 smithi175 ceph-mon[32649]: pgmap v179: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:29.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:29 smithi043 ceph-mon[29195]: pgmap v179: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:29.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:29 smithi161 ceph-mon[32696]: pgmap v179: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:31.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:31 smithi175 ceph-mon[32649]: pgmap v180: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:31.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:31 smithi043 ceph-mon[29195]: pgmap v180: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:31.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:31 smithi161 ceph-mon[32696]: pgmap v180: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:33.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:33 smithi175 ceph-mon[32649]: pgmap v181: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:33.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:33 smithi043 ceph-mon[29195]: pgmap v181: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:33.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:33 smithi161 ceph-mon[32696]: pgmap v181: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:35.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:35 smithi175 ceph-mon[32649]: pgmap v182: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:35.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:35 smithi043 ceph-mon[29195]: pgmap v182: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:35.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:35 smithi161 ceph-mon[32696]: pgmap v182: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:37.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:37 smithi175 ceph-mon[32649]: pgmap v183: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:37.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:37 smithi043 ceph-mon[29195]: pgmap v183: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:37.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:37 smithi161 ceph-mon[32696]: pgmap v183: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:39.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:39 smithi175 ceph-mon[32649]: pgmap v184: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:39.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:39 smithi043 ceph-mon[29195]: pgmap v184: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:39.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:39 smithi161 ceph-mon[32696]: pgmap v184: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:41.404 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:41 smithi161 ceph-mon[32696]: pgmap v185: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:41.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:41 smithi175 ceph-mon[32649]: pgmap v185: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:41.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:41 smithi043 ceph-mon[29195]: pgmap v185: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:43.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:43 smithi175 ceph-mon[32649]: pgmap v186: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:43.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:43 smithi043 ceph-mon[29195]: pgmap v186: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:43.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:43 smithi161 ceph-mon[32696]: pgmap v186: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:45.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:45 smithi175 ceph-mon[32649]: pgmap v187: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:45.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:45 smithi043 ceph-mon[29195]: pgmap v187: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:45.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:45 smithi161 ceph-mon[32696]: pgmap v187: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:46.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:46 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:50:46.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:46 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:50:46.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:46 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:50:47.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:47 smithi175 ceph-mon[32649]: pgmap v188: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:47.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:47 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:50:47.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:47 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:50:47.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:47 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:50:47.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:47 smithi043 ceph-mon[29195]: pgmap v188: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:47.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:47 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:50:47.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:47 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:50:47.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:47 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:50:47.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:47 smithi161 ceph-mon[32696]: pgmap v188: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:47.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:47 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:50:47.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:47 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:50:47.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:47 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:50:49.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:49 smithi175 ceph-mon[32649]: pgmap v189: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:49.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:49 smithi043 ceph-mon[29195]: pgmap v189: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:49.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:49 smithi161 ceph-mon[32696]: pgmap v189: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:51.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:51 smithi175 ceph-mon[32649]: pgmap v190: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:51.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:51 smithi043 ceph-mon[29195]: pgmap v190: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:51.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:51 smithi161 ceph-mon[32696]: pgmap v190: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:53.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:53 smithi175 ceph-mon[32649]: pgmap v191: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:53.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:53 smithi043 ceph-mon[29195]: pgmap v191: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:53.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:53 smithi161 ceph-mon[32696]: pgmap v191: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:55 smithi175 ceph-mon[32649]: pgmap v192: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:55.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:55 smithi043 ceph-mon[29195]: pgmap v192: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:55.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:55 smithi161 ceph-mon[32696]: pgmap v192: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:57 smithi175 ceph-mon[32649]: pgmap v193: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:57.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:57 smithi043 ceph-mon[29195]: pgmap v193: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:57.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:57 smithi161 ceph-mon[32696]: pgmap v193: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:50:59.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:50:59 smithi175 ceph-mon[32649]: pgmap v194: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:59.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:50:59 smithi043 ceph-mon[29195]: pgmap v194: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:50:59.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:50:59 smithi161 ceph-mon[32696]: pgmap v194: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:01.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:01 smithi175 ceph-mon[32649]: pgmap v195: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:01.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:01 smithi043 ceph-mon[29195]: pgmap v195: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:01.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:01 smithi161 ceph-mon[32696]: pgmap v195: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:03.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:03 smithi175 ceph-mon[32649]: pgmap v196: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:51:03.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:03 smithi043 ceph-mon[29195]: pgmap v196: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:51:03.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:03 smithi161 ceph-mon[32696]: pgmap v196: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:51:05.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:05 smithi175 ceph-mon[32649]: pgmap v197: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:51:05.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:05 smithi043 ceph-mon[29195]: pgmap v197: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:51:05.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:05 smithi161 ceph-mon[32696]: pgmap v197: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:51:07.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:07 smithi175 ceph-mon[32649]: pgmap v198: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:51:07.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:07 smithi043 ceph-mon[29195]: pgmap v198: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:51:07.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:07 smithi161 ceph-mon[32696]: pgmap v198: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:51:09.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:09 smithi043 ceph-mon[29195]: pgmap v199: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:51:09.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:09 smithi043 ceph-mon[29195]: osdmap e86: 12 total, 12 up, 12 in 2024-04-25T13:51:09.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:09 smithi161 ceph-mon[32696]: pgmap v199: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:51:09.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:09 smithi161 ceph-mon[32696]: osdmap e86: 12 total, 12 up, 12 in 2024-04-25T13:51:09.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:09 smithi175 ceph-mon[32649]: pgmap v199: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:51:09.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:09 smithi175 ceph-mon[32649]: osdmap e86: 12 total, 12 up, 12 in 2024-04-25T13:51:11.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:11 smithi043 ceph-mon[29195]: pgmap v201: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T13:51:11.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:11 smithi161 ceph-mon[32696]: pgmap v201: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T13:51:11.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:11 smithi175 ceph-mon[32649]: pgmap v201: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T13:51:13.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:13 smithi043 ceph-mon[29195]: pgmap v202: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:51:13.482 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:13 smithi175 ceph-mon[32649]: pgmap v202: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:51:13.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:13 smithi161 ceph-mon[32696]: pgmap v202: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:51:15.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:15 smithi043 ceph-mon[29195]: pgmap v203: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:51:15.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:15 smithi161 ceph-mon[32696]: pgmap v203: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:51:15.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:15 smithi175 ceph-mon[32649]: pgmap v203: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:51:17.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:17 smithi043 ceph-mon[29195]: pgmap v204: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:51:17.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:17 smithi043 ceph-mon[29195]: osdmap e87: 12 total, 12 up, 12 in 2024-04-25T13:51:17.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:17 smithi161 ceph-mon[32696]: pgmap v204: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:51:17.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:17 smithi161 ceph-mon[32696]: osdmap e87: 12 total, 12 up, 12 in 2024-04-25T13:51:17.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:17 smithi175 ceph-mon[32649]: pgmap v204: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:51:17.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:17 smithi175 ceph-mon[32649]: osdmap e87: 12 total, 12 up, 12 in 2024-04-25T13:51:19.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:19 smithi043 ceph-mon[29195]: pgmap v206: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 213 B/s wr, 6 op/s 2024-04-25T13:51:19.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:19 smithi161 ceph-mon[32696]: pgmap v206: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 213 B/s wr, 6 op/s 2024-04-25T13:51:19.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:19 smithi175 ceph-mon[32649]: pgmap v206: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 213 B/s wr, 6 op/s 2024-04-25T13:51:21.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:21 smithi043 ceph-mon[29195]: pgmap v207: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:51:21.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:21 smithi161 ceph-mon[32696]: pgmap v207: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:51:21.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:21 smithi175 ceph-mon[32649]: pgmap v207: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:51:23.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:23 smithi043 ceph-mon[29195]: pgmap v208: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:51:23.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:23 smithi161 ceph-mon[32696]: pgmap v208: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:51:23.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:23 smithi175 ceph-mon[32649]: pgmap v208: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:51:25.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:25 smithi043 ceph-mon[29195]: pgmap v209: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:51:25.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:25 smithi161 ceph-mon[32696]: pgmap v209: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:51:25.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:25 smithi175 ceph-mon[32649]: pgmap v209: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:51:27.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:27 smithi043 ceph-mon[29195]: pgmap v210: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:51:27.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:27 smithi161 ceph-mon[32696]: pgmap v210: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:51:27.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:27 smithi175 ceph-mon[32649]: pgmap v210: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:51:29.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:29 smithi161 ceph-mon[32696]: pgmap v211: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-25T13:51:29.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:29 smithi175 ceph-mon[32649]: pgmap v211: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-25T13:51:29.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:29 smithi043 ceph-mon[29195]: pgmap v211: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-25T13:51:31.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:31 smithi161 ceph-mon[32696]: pgmap v212: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:31.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:31 smithi175 ceph-mon[32649]: pgmap v212: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:31.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:31 smithi043 ceph-mon[29195]: pgmap v212: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:33.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:33 smithi161 ceph-mon[32696]: pgmap v213: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:33.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:33 smithi175 ceph-mon[32649]: pgmap v213: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:33.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:33 smithi043 ceph-mon[29195]: pgmap v213: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:35.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:35 smithi161 ceph-mon[32696]: pgmap v214: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:35.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:35 smithi175 ceph-mon[32649]: pgmap v214: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:35.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:35 smithi043 ceph-mon[29195]: pgmap v214: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:37.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:37 smithi161 ceph-mon[32696]: pgmap v215: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:37.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:37 smithi175 ceph-mon[32649]: pgmap v215: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:37.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:37 smithi043 ceph-mon[29195]: pgmap v215: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:39.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:39 smithi161 ceph-mon[32696]: pgmap v216: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:39.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:39 smithi175 ceph-mon[32649]: pgmap v216: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:39.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:39 smithi043 ceph-mon[29195]: pgmap v216: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:41.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:41 smithi161 ceph-mon[32696]: pgmap v217: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:41.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:41 smithi175 ceph-mon[32649]: pgmap v217: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:41.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:41 smithi043 ceph-mon[29195]: pgmap v217: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:43.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:43 smithi161 ceph-mon[32696]: pgmap v218: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:43.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:43 smithi175 ceph-mon[32649]: pgmap v218: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:43.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:43 smithi043 ceph-mon[29195]: pgmap v218: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:45.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:45 smithi161 ceph-mon[32696]: pgmap v219: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:45.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:45 smithi175 ceph-mon[32649]: pgmap v219: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:45.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:45 smithi043 ceph-mon[29195]: pgmap v219: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:47.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:47 smithi161 ceph-mon[32696]: pgmap v220: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:47.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:47 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:51:47.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:47 smithi175 ceph-mon[32649]: pgmap v220: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:47.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:47 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:51:47.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:47 smithi043 ceph-mon[29195]: pgmap v220: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:47.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:47 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:51:48.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:48 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:51:48.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:48 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:51:48.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:48 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:51:48.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:48 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:51:48.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:48 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:51:48.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:48 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:51:48.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:48 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:51:48.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:48 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:51:48.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:48 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:51:49.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:49 smithi161 ceph-mon[32696]: pgmap v221: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:49.613 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:49 smithi043 ceph-mon[29195]: pgmap v221: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:49.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:49 smithi175 ceph-mon[32649]: pgmap v221: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:51.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:51 smithi161 ceph-mon[32696]: pgmap v222: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:51.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:51 smithi175 ceph-mon[32649]: pgmap v222: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:51.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:51 smithi043 ceph-mon[29195]: pgmap v222: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:53.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:53 smithi161 ceph-mon[32696]: pgmap v223: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:53.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:53 smithi175 ceph-mon[32649]: pgmap v223: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:53.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:53 smithi043 ceph-mon[29195]: pgmap v223: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:55.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:55 smithi161 ceph-mon[32696]: pgmap v224: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:55.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:55 smithi175 ceph-mon[32649]: pgmap v224: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:55.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:55 smithi043 ceph-mon[29195]: pgmap v224: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:57.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:57 smithi161 ceph-mon[32696]: pgmap v225: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:57.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:57 smithi175 ceph-mon[32649]: pgmap v225: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:57.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:57 smithi043 ceph-mon[29195]: pgmap v225: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:51:59.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:51:59 smithi161 ceph-mon[32696]: pgmap v226: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:59.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:51:59 smithi175 ceph-mon[32649]: pgmap v226: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:51:59.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:51:59 smithi043 ceph-mon[29195]: pgmap v226: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:01.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:01 smithi161 ceph-mon[32696]: pgmap v227: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:01.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:01 smithi175 ceph-mon[32649]: pgmap v227: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:01.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:01 smithi043 ceph-mon[29195]: pgmap v227: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:03.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:03 smithi161 ceph-mon[32696]: pgmap v228: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:52:03.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:03 smithi175 ceph-mon[32649]: pgmap v228: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:52:03.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:03 smithi043 ceph-mon[29195]: pgmap v228: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:52:05.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:05 smithi161 ceph-mon[32696]: pgmap v229: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:52:05.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:05 smithi175 ceph-mon[32649]: pgmap v229: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:52:05.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:05 smithi043 ceph-mon[29195]: pgmap v229: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:52:07.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:07 smithi161 ceph-mon[32696]: pgmap v230: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:52:07.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:07 smithi175 ceph-mon[32649]: pgmap v230: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:52:07.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:07 smithi043 ceph-mon[29195]: pgmap v230: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:52:09.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:09 smithi161 ceph-mon[32696]: pgmap v231: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:52:09.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:09 smithi161 ceph-mon[32696]: osdmap e88: 12 total, 12 up, 12 in 2024-04-25T13:52:09.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:09 smithi175 ceph-mon[32649]: pgmap v231: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:52:09.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:09 smithi175 ceph-mon[32649]: osdmap e88: 12 total, 12 up, 12 in 2024-04-25T13:52:09.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:09 smithi043 ceph-mon[29195]: pgmap v231: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:52:09.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:09 smithi043 ceph-mon[29195]: osdmap e88: 12 total, 12 up, 12 in 2024-04-25T13:52:11.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:11 smithi161 ceph-mon[32696]: pgmap v233: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T13:52:11.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:11 smithi175 ceph-mon[32649]: pgmap v233: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T13:52:11.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:11 smithi043 ceph-mon[29195]: pgmap v233: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T13:52:13.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:13 smithi161 ceph-mon[32696]: pgmap v234: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:52:13.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:13 smithi175 ceph-mon[32649]: pgmap v234: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:52:13.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:13 smithi043 ceph-mon[29195]: pgmap v234: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:52:15.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:15 smithi161 ceph-mon[32696]: pgmap v235: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:52:15.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:15 smithi175 ceph-mon[32649]: pgmap v235: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:52:15.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:15 smithi043 ceph-mon[29195]: pgmap v235: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:52:17.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:17 smithi161 ceph-mon[32696]: pgmap v236: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:52:17.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:17 smithi161 ceph-mon[32696]: osdmap e89: 12 total, 12 up, 12 in 2024-04-25T13:52:17.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:17 smithi175 ceph-mon[32649]: pgmap v236: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:52:17.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:17 smithi175 ceph-mon[32649]: osdmap e89: 12 total, 12 up, 12 in 2024-04-25T13:52:17.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:17 smithi043 ceph-mon[29195]: pgmap v236: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:52:17.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:17 smithi043 ceph-mon[29195]: osdmap e89: 12 total, 12 up, 12 in 2024-04-25T13:52:19.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:19 smithi161 ceph-mon[32696]: pgmap v238: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 215 B/s wr, 6 op/s 2024-04-25T13:52:19.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:19 smithi175 ceph-mon[32649]: pgmap v238: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 215 B/s wr, 6 op/s 2024-04-25T13:52:19.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:19 smithi043 ceph-mon[29195]: pgmap v238: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 215 B/s wr, 6 op/s 2024-04-25T13:52:21.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:21 smithi161 ceph-mon[32696]: pgmap v239: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:52:21.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:21 smithi175 ceph-mon[32649]: pgmap v239: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:52:21.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:21 smithi043 ceph-mon[29195]: pgmap v239: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:52:23.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:23 smithi161 ceph-mon[32696]: pgmap v240: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:52:23.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:23 smithi175 ceph-mon[32649]: pgmap v240: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:52:23.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:23 smithi043 ceph-mon[29195]: pgmap v240: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:52:24.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:24 smithi175 ceph-mon[32649]: pgmap v241: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:52:24.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:24 smithi043 ceph-mon[29195]: pgmap v241: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:52:24.852 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:24 smithi161 ceph-mon[32696]: pgmap v241: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:52:27.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:26 smithi175 ceph-mon[32649]: pgmap v242: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:52:27.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:26 smithi043 ceph-mon[29195]: pgmap v242: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:52:27.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:26 smithi161 ceph-mon[32696]: pgmap v242: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:52:29.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:28 smithi175 ceph-mon[32649]: pgmap v243: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-25T13:52:29.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:28 smithi043 ceph-mon[29195]: pgmap v243: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-25T13:52:29.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:28 smithi161 ceph-mon[32696]: pgmap v243: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-25T13:52:31.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:30 smithi175 ceph-mon[32649]: pgmap v244: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:31.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:30 smithi043 ceph-mon[29195]: pgmap v244: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:31.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:30 smithi161 ceph-mon[32696]: pgmap v244: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:33.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:32 smithi175 ceph-mon[32649]: pgmap v245: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:33.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:32 smithi043 ceph-mon[29195]: pgmap v245: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:33.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:32 smithi161 ceph-mon[32696]: pgmap v245: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:34 smithi175 ceph-mon[32649]: pgmap v246: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:35.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:34 smithi043 ceph-mon[29195]: pgmap v246: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:35.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:34 smithi161 ceph-mon[32696]: pgmap v246: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:37.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:36 smithi175 ceph-mon[32649]: pgmap v247: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:37.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:36 smithi043 ceph-mon[29195]: pgmap v247: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:37.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:36 smithi161 ceph-mon[32696]: pgmap v247: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:39.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:38 smithi175 ceph-mon[32649]: pgmap v248: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:39.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:38 smithi043 ceph-mon[29195]: pgmap v248: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:39.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:38 smithi161 ceph-mon[32696]: pgmap v248: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:41.154 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:40 smithi161 ceph-mon[32696]: pgmap v249: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:41.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:40 smithi175 ceph-mon[32649]: pgmap v249: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:41.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:40 smithi043 ceph-mon[29195]: pgmap v249: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:43.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:42 smithi175 ceph-mon[32649]: pgmap v250: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:43.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:42 smithi043 ceph-mon[29195]: pgmap v250: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:43.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:42 smithi161 ceph-mon[32696]: pgmap v250: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:45.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:44 smithi175 ceph-mon[32649]: pgmap v251: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:45.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:44 smithi043 ceph-mon[29195]: pgmap v251: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:45.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:44 smithi161 ceph-mon[32696]: pgmap v251: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:47.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:46 smithi175 ceph-mon[32649]: pgmap v252: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:47.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:46 smithi043 ceph-mon[29195]: pgmap v252: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:47.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:46 smithi161 ceph-mon[32696]: pgmap v252: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:48.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:47 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:52:48.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:47 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:52:48.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:47 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:52:49.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:48 smithi175 ceph-mon[32649]: pgmap v253: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:49.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:48 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:52:49.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:48 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:52:49.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:48 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:52:49.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:48 smithi043 ceph-mon[29195]: pgmap v253: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:49.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:48 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:52:49.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:48 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:52:49.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:48 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:52:49.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:48 smithi161 ceph-mon[32696]: pgmap v253: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:49.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:48 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:52:49.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:48 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:52:49.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:48 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:52:51.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:50 smithi175 ceph-mon[32649]: pgmap v254: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:51.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:50 smithi043 ceph-mon[29195]: pgmap v254: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:50 smithi161 ceph-mon[32696]: pgmap v254: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:53.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:52 smithi175 ceph-mon[32649]: pgmap v255: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:53.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:52 smithi043 ceph-mon[29195]: pgmap v255: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:53.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:52 smithi161 ceph-mon[32696]: pgmap v255: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:55.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:54 smithi175 ceph-mon[32649]: pgmap v256: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:55.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:54 smithi043 ceph-mon[29195]: pgmap v256: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:55.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:54 smithi161 ceph-mon[32696]: pgmap v256: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:57.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:56 smithi175 ceph-mon[32649]: pgmap v257: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:57.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:56 smithi043 ceph-mon[29195]: pgmap v257: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:57.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:56 smithi161 ceph-mon[32696]: pgmap v257: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:52:59.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:52:58 smithi175 ceph-mon[32649]: pgmap v258: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:59.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:52:58 smithi043 ceph-mon[29195]: pgmap v258: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:52:59.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:52:58 smithi161 ceph-mon[32696]: pgmap v258: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:53:01.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:00 smithi175 ceph-mon[32649]: pgmap v259: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:01.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:00 smithi043 ceph-mon[29195]: pgmap v259: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:01.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:00 smithi161 ceph-mon[32696]: pgmap v259: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:03.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:02 smithi043 ceph-mon[29195]: pgmap v260: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:53:03.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:02 smithi161 ceph-mon[32696]: pgmap v260: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:53:03.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:02 smithi175 ceph-mon[32649]: pgmap v260: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:53:05.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:04 smithi043 ceph-mon[29195]: pgmap v261: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:53:05.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:04 smithi161 ceph-mon[32696]: pgmap v261: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:53:05.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:04 smithi175 ceph-mon[32649]: pgmap v261: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:53:07.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:06 smithi043 ceph-mon[29195]: pgmap v262: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:53:07.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:06 smithi161 ceph-mon[32696]: pgmap v262: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:53:07.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:06 smithi175 ceph-mon[32649]: pgmap v262: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:53:09.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:08 smithi043 ceph-mon[29195]: pgmap v263: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:53:09.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:08 smithi043 ceph-mon[29195]: osdmap e90: 12 total, 12 up, 12 in 2024-04-25T13:53:09.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:08 smithi161 ceph-mon[32696]: pgmap v263: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:53:09.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:08 smithi161 ceph-mon[32696]: osdmap e90: 12 total, 12 up, 12 in 2024-04-25T13:53:09.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:08 smithi175 ceph-mon[32649]: pgmap v263: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:53:09.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:08 smithi175 ceph-mon[32649]: osdmap e90: 12 total, 12 up, 12 in 2024-04-25T13:53:11.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:10 smithi043 ceph-mon[29195]: pgmap v265: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T13:53:11.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:10 smithi161 ceph-mon[32696]: pgmap v265: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T13:53:11.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:10 smithi175 ceph-mon[32649]: pgmap v265: 129 pgs: 129 active+clean; 694 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T13:53:13.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:12 smithi043 ceph-mon[29195]: pgmap v266: 129 pgs: 13 active+clean+snaptrim, 90 active+clean, 26 active+clean+snaptrim_wait; 350 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:53:13.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:12 smithi161 ceph-mon[32696]: pgmap v266: 129 pgs: 13 active+clean+snaptrim, 90 active+clean, 26 active+clean+snaptrim_wait; 350 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:53:13.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:12 smithi175 ceph-mon[32649]: pgmap v266: 129 pgs: 13 active+clean+snaptrim, 90 active+clean, 26 active+clean+snaptrim_wait; 350 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:53:15.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:14 smithi043 ceph-mon[29195]: pgmap v267: 129 pgs: 13 active+clean+snaptrim, 90 active+clean, 26 active+clean+snaptrim_wait; 350 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:53:15.232 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:14 smithi175 ceph-mon[32649]: pgmap v267: 129 pgs: 13 active+clean+snaptrim, 90 active+clean, 26 active+clean+snaptrim_wait; 350 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:53:15.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:14 smithi161 ceph-mon[32696]: pgmap v267: 129 pgs: 13 active+clean+snaptrim, 90 active+clean, 26 active+clean+snaptrim_wait; 350 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:53:17.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:16 smithi043 ceph-mon[29195]: pgmap v268: 129 pgs: 13 active+clean+snaptrim, 90 active+clean, 26 active+clean+snaptrim_wait; 350 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:53:17.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:16 smithi161 ceph-mon[32696]: pgmap v268: 129 pgs: 13 active+clean+snaptrim, 90 active+clean, 26 active+clean+snaptrim_wait; 350 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:53:17.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:16 smithi175 ceph-mon[32649]: pgmap v268: 129 pgs: 13 active+clean+snaptrim, 90 active+clean, 26 active+clean+snaptrim_wait; 350 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:53:19.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:18 smithi161 ceph-mon[32696]: pgmap v269: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:53:19.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:18 smithi175 ceph-mon[32649]: pgmap v269: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:53:19.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:18 smithi043 ceph-mon[29195]: pgmap v269: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:53:21.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:20 smithi161 ceph-mon[32696]: pgmap v270: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 172 B/s wr, 5 op/s 2024-04-25T13:53:21.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:20 smithi175 ceph-mon[32649]: pgmap v270: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 172 B/s wr, 5 op/s 2024-04-25T13:53:21.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:20 smithi043 ceph-mon[29195]: pgmap v270: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 172 B/s wr, 5 op/s 2024-04-25T13:53:23.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:22 smithi175 ceph-mon[32649]: pgmap v271: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-25T13:53:23.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:22 smithi175 ceph-mon[32649]: osdmap e91: 12 total, 12 up, 12 in 2024-04-25T13:53:23.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:22 smithi043 ceph-mon[29195]: pgmap v271: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-25T13:53:23.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:22 smithi043 ceph-mon[29195]: osdmap e91: 12 total, 12 up, 12 in 2024-04-25T13:53:23.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:22 smithi161 ceph-mon[32696]: pgmap v271: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-25T13:53:23.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:22 smithi161 ceph-mon[32696]: osdmap e91: 12 total, 12 up, 12 in 2024-04-25T13:53:25.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:24 smithi175 ceph-mon[32649]: pgmap v273: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:53:25.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:24 smithi043 ceph-mon[29195]: pgmap v273: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:53:25.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:24 smithi161 ceph-mon[32696]: pgmap v273: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:53:27.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:26 smithi175 ceph-mon[32649]: pgmap v274: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:53:27.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:26 smithi043 ceph-mon[29195]: pgmap v274: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:53:27.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:26 smithi161 ceph-mon[32696]: pgmap v274: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:53:29.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:28 smithi175 ceph-mon[32649]: pgmap v275: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:53:29.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:28 smithi043 ceph-mon[29195]: pgmap v275: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:53:29.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:28 smithi161 ceph-mon[32696]: pgmap v275: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:53:31.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:30 smithi175 ceph-mon[32649]: pgmap v276: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:53:31.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:30 smithi043 ceph-mon[29195]: pgmap v276: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:53:31.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:30 smithi161 ceph-mon[32696]: pgmap v276: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:53:33.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:32 smithi175 ceph-mon[32649]: pgmap v277: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:53:33.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:32 smithi043 ceph-mon[29195]: pgmap v277: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:53:33.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:32 smithi161 ceph-mon[32696]: pgmap v277: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:53:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:34 smithi175 ceph-mon[32649]: pgmap v278: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:53:35.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:34 smithi043 ceph-mon[29195]: pgmap v278: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:53:35.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:34 smithi161 ceph-mon[32696]: pgmap v278: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:53:37.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:36 smithi175 ceph-mon[32649]: pgmap v279: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:37.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:36 smithi043 ceph-mon[29195]: pgmap v279: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:37.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:36 smithi161 ceph-mon[32696]: pgmap v279: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:39.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:38 smithi175 ceph-mon[32649]: pgmap v280: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:53:39.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:38 smithi043 ceph-mon[29195]: pgmap v280: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:53:39.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:38 smithi161 ceph-mon[32696]: pgmap v280: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:53:41.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:40 smithi175 ceph-mon[32649]: pgmap v281: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:41.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:40 smithi043 ceph-mon[29195]: pgmap v281: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:41.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:40 smithi161 ceph-mon[32696]: pgmap v281: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:43.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:42 smithi175 ceph-mon[32649]: pgmap v282: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:53:43.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:42 smithi043 ceph-mon[29195]: pgmap v282: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:53:43.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:42 smithi161 ceph-mon[32696]: pgmap v282: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:53:45.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:44 smithi175 ceph-mon[32649]: pgmap v283: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:45.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:44 smithi043 ceph-mon[29195]: pgmap v283: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:45.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:44 smithi161 ceph-mon[32696]: pgmap v283: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:47.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:46 smithi175 ceph-mon[32649]: pgmap v284: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:47.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:46 smithi043 ceph-mon[29195]: pgmap v284: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:47.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:46 smithi161 ceph-mon[32696]: pgmap v284: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:49.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:48 smithi175 ceph-mon[32649]: pgmap v285: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:53:49.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:48 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:53:49.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:48 smithi043 ceph-mon[29195]: pgmap v285: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:53:49.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:48 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:53:49.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:48 smithi161 ceph-mon[32696]: pgmap v285: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:53:49.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:48 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:53:50.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:49 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:53:50.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:49 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:53:50.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:49 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:53:50.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:49 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:53:50.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:49 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:53:50.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:49 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:53:50.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:49 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:53:50.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:49 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:53:50.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:49 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:53:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:50 smithi161 ceph-mon[32696]: pgmap v286: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:51.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:50 smithi175 ceph-mon[32649]: pgmap v286: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:51.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:50 smithi043 ceph-mon[29195]: pgmap v286: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:53.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:52 smithi161 ceph-mon[32696]: pgmap v287: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:53:53.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:52 smithi175 ceph-mon[32649]: pgmap v287: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:53:53.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:52 smithi043 ceph-mon[29195]: pgmap v287: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:53:55.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:54 smithi161 ceph-mon[32696]: pgmap v288: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:54 smithi175 ceph-mon[32649]: pgmap v288: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:55.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:54 smithi043 ceph-mon[29195]: pgmap v288: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:57.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:56 smithi161 ceph-mon[32696]: pgmap v289: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:56 smithi175 ceph-mon[32649]: pgmap v289: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:57.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:56 smithi043 ceph-mon[29195]: pgmap v289: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:53:59.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:53:58 smithi161 ceph-mon[32696]: pgmap v290: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:53:59.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:53:58 smithi175 ceph-mon[32649]: pgmap v290: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:53:59.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:53:58 smithi043 ceph-mon[29195]: pgmap v290: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:54:01.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:00 smithi161 ceph-mon[32696]: pgmap v291: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:54:01.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:00 smithi175 ceph-mon[32649]: pgmap v291: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:54:01.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:00 smithi043 ceph-mon[29195]: pgmap v291: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:54:03.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:02 smithi161 ceph-mon[32696]: pgmap v292: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:54:03.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:02 smithi175 ceph-mon[32649]: pgmap v292: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:54:03.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:02 smithi043 ceph-mon[29195]: pgmap v292: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:54:05.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:04 smithi161 ceph-mon[32696]: pgmap v293: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:54:05.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:04 smithi175 ceph-mon[32649]: pgmap v293: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:54:05.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:04 smithi043 ceph-mon[29195]: pgmap v293: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:54:07.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:06 smithi161 ceph-mon[32696]: pgmap v294: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:54:07.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:06 smithi175 ceph-mon[32649]: pgmap v294: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:54:07.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:06 smithi043 ceph-mon[29195]: pgmap v294: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:54:09.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:09 smithi161 ceph-mon[32696]: pgmap v295: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:54:09.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:09 smithi161 ceph-mon[32696]: osdmap e92: 12 total, 12 up, 12 in 2024-04-25T13:54:09.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:09 smithi175 ceph-mon[32649]: pgmap v295: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:54:09.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:09 smithi175 ceph-mon[32649]: osdmap e92: 12 total, 12 up, 12 in 2024-04-25T13:54:09.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:09 smithi043 ceph-mon[29195]: pgmap v295: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:54:09.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:09 smithi043 ceph-mon[29195]: osdmap e92: 12 total, 12 up, 12 in 2024-04-25T13:54:11.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:11 smithi161 ceph-mon[32696]: pgmap v297: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T13:54:11.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:11 smithi175 ceph-mon[32649]: pgmap v297: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T13:54:11.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:11 smithi043 ceph-mon[29195]: pgmap v297: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T13:54:13.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:13 smithi161 ceph-mon[32696]: pgmap v298: 129 pgs: 7 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 109 active+clean; 171 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:54:13.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:13 smithi175 ceph-mon[32649]: pgmap v298: 129 pgs: 7 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 109 active+clean; 171 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:54:13.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:13 smithi043 ceph-mon[29195]: pgmap v298: 129 pgs: 7 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 109 active+clean; 171 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:54:15.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:15 smithi161 ceph-mon[32696]: pgmap v299: 129 pgs: 7 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 109 active+clean; 171 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:54:15.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:15 smithi175 ceph-mon[32649]: pgmap v299: 129 pgs: 7 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 109 active+clean; 171 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:54:15.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:15 smithi043 ceph-mon[29195]: pgmap v299: 129 pgs: 7 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 109 active+clean; 171 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:54:17.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:17 smithi161 ceph-mon[32696]: pgmap v300: 129 pgs: 7 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 109 active+clean; 171 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:54:17.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:17 smithi175 ceph-mon[32649]: pgmap v300: 129 pgs: 7 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 109 active+clean; 171 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:54:17.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:17 smithi043 ceph-mon[29195]: pgmap v300: 129 pgs: 7 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 109 active+clean; 171 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:54:19.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:19 smithi161 ceph-mon[32696]: pgmap v301: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:54:19.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:19 smithi175 ceph-mon[32649]: pgmap v301: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:54:19.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:19 smithi043 ceph-mon[29195]: pgmap v301: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:54:21.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:21 smithi161 ceph-mon[32696]: pgmap v302: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 173 B/s wr, 5 op/s 2024-04-25T13:54:21.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:21 smithi175 ceph-mon[32649]: pgmap v302: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 173 B/s wr, 5 op/s 2024-04-25T13:54:21.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:21 smithi043 ceph-mon[29195]: pgmap v302: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 173 B/s wr, 5 op/s 2024-04-25T13:54:23.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:22 smithi175 ceph-mon[32649]: pgmap v303: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-25T13:54:23.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:22 smithi175 ceph-mon[32649]: osdmap e93: 12 total, 12 up, 12 in 2024-04-25T13:54:23.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:22 smithi043 ceph-mon[29195]: pgmap v303: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-25T13:54:23.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:22 smithi043 ceph-mon[29195]: osdmap e93: 12 total, 12 up, 12 in 2024-04-25T13:54:23.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:22 smithi161 ceph-mon[32696]: pgmap v303: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-25T13:54:23.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:22 smithi161 ceph-mon[32696]: osdmap e93: 12 total, 12 up, 12 in 2024-04-25T13:54:25.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:24 smithi175 ceph-mon[32649]: pgmap v305: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:54:25.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:24 smithi043 ceph-mon[29195]: pgmap v305: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:54:25.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:24 smithi161 ceph-mon[32696]: pgmap v305: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:54:27.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:26 smithi175 ceph-mon[32649]: pgmap v306: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:54:27.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:26 smithi043 ceph-mon[29195]: pgmap v306: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:54:27.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:26 smithi161 ceph-mon[32696]: pgmap v306: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:54:29.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:28 smithi175 ceph-mon[32649]: pgmap v307: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:54:29.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:28 smithi043 ceph-mon[29195]: pgmap v307: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:54:29.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:28 smithi161 ceph-mon[32696]: pgmap v307: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:54:31.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:30 smithi175 ceph-mon[32649]: pgmap v308: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:54:31.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:30 smithi043 ceph-mon[29195]: pgmap v308: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:54:31.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:30 smithi161 ceph-mon[32696]: pgmap v308: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:54:33.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:32 smithi175 ceph-mon[32649]: pgmap v309: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:54:33.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:32 smithi043 ceph-mon[29195]: pgmap v309: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:54:33.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:32 smithi161 ceph-mon[32696]: pgmap v309: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T13:54:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:34 smithi175 ceph-mon[32649]: pgmap v310: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:54:35.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:34 smithi043 ceph-mon[29195]: pgmap v310: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:54:35.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:34 smithi161 ceph-mon[32696]: pgmap v310: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T13:54:37.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:36 smithi175 ceph-mon[32649]: pgmap v311: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:54:37.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:36 smithi043 ceph-mon[29195]: pgmap v311: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:54:37.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:36 smithi161 ceph-mon[32696]: pgmap v311: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:54:39.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:38 smithi175 ceph-mon[32649]: pgmap v312: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:54:39.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:38 smithi043 ceph-mon[29195]: pgmap v312: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:54:39.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:38 smithi161 ceph-mon[32696]: pgmap v312: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:54:39.428 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-25T13:54:39.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.555+0000 7f582cc49640 1 -- 172.21.15.43:0/2407755985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f582810b6d0 msgr2=0x7f582810daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:39.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.555+0000 7f582cc49640 1 --2- 172.21.15.43:0/2407755985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f582810b6d0 0x7f582810daf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f581c009900 tx=0x7f581c02a410 comp rx=0 tx=0).stop 2024-04-25T13:54:39.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.555+0000 7f582cc49640 1 -- 172.21.15.43:0/2407755985 shutdown_connections 2024-04-25T13:54:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.555+0000 7f582cc49640 1 --2- 172.21.15.43:0/2407755985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582810e0c0 0x7f58281105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.555+0000 7f582cc49640 1 --2- 172.21.15.43:0/2407755985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f582810b6d0 0x7f582810daf0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.555+0000 7f582cc49640 1 --2- 172.21.15.43:0/2407755985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5828104c70 0x7f5828105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.555+0000 7f582cc49640 1 -- 172.21.15.43:0/2407755985 >> 172.21.15.43:0/2407755985 conn(0x7f58280781b0 msgr2=0x7f58280785f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:54:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.555+0000 7f582cc49640 1 -- 172.21.15.43:0/2407755985 shutdown_connections 2024-04-25T13:54:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.555+0000 7f582cc49640 1 -- 172.21.15.43:0/2407755985 wait complete. 2024-04-25T13:54:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.556+0000 7f582cc49640 1 Processor -- start 2024-04-25T13:54:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.556+0000 7f582cc49640 1 -- start start 2024-04-25T13:54:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.556+0000 7f582cc49640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5828104c70 0x7f582819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.556+0000 7f582cc49640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f582810b6d0 0x7f582819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.556+0000 7f582cc49640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582810e0c0 0x7f582819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.556+0000 7f582cc49640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5828113bd0 con 0x7f582810b6d0 2024-04-25T13:54:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.556+0000 7f582cc49640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f5828113a50 con 0x7f5828104c70 2024-04-25T13:54:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.556+0000 7f582cc49640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5828113d50 con 0x7f582810e0c0 2024-04-25T13:54:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.557+0000 7f5825d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f582810b6d0 0x7f582819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.557+0000 7f5825d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f582810b6d0 0x7f582819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58934/0 (socket says 172.21.15.43:58934) 2024-04-25T13:54:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.557+0000 7f5825d9b640 1 -- 172.21.15.43:0/599819377 learned_addr learned my addr 172.21.15.43:0/599819377 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:54:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.557+0000 7f582659c640 1 --2- 172.21.15.43:0/599819377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5828104c70 0x7f582819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.557+0000 7f5826d9d640 1 --2- 172.21.15.43:0/599819377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582810e0c0 0x7f582819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.557+0000 7f5825d9b640 1 -- 172.21.15.43:0/599819377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582810e0c0 msgr2=0x7f582819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.557+0000 7f5825d9b640 1 --2- 172.21.15.43:0/599819377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582810e0c0 0x7f582819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.557+0000 7f5825d9b640 1 -- 172.21.15.43:0/599819377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5828104c70 msgr2=0x7f582819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.557+0000 7f5825d9b640 1 --2- 172.21.15.43:0/599819377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5828104c70 0x7f582819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:39.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.557+0000 7f5825d9b640 1 -- 172.21.15.43:0/599819377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582819f530 con 0x7f582810b6d0 2024-04-25T13:54:39.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.557+0000 7f5825d9b640 1 --2- 172.21.15.43:0/599819377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f582810b6d0 0x7f582819ac30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f581c009230 tx=0x7f581c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:54:39.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.557+0000 7f58177fe640 1 -- 172.21.15.43:0/599819377 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581c03f030 con 0x7f582810b6d0 2024-04-25T13:54:39.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.558+0000 7f58177fe640 1 -- 172.21.15.43:0/599819377 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f581c003a80 con 0x7f582810b6d0 2024-04-25T13:54:39.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.558+0000 7f582cc49640 1 -- 172.21.15.43:0/599819377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f582819f7c0 con 0x7f582810b6d0 2024-04-25T13:54:39.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.558+0000 7f58177fe640 1 -- 172.21.15.43:0/599819377 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581c035070 con 0x7f582810b6d0 2024-04-25T13:54:39.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.558+0000 7f582cc49640 1 -- 172.21.15.43:0/599819377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f582819fd00 con 0x7f582810b6d0 2024-04-25T13:54:39.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.559+0000 7f582cc49640 1 -- 172.21.15.43:0/599819377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f582806a110 con 0x7f582810b6d0 2024-04-25T13:54:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.560+0000 7f58177fe640 1 -- 172.21.15.43:0/599819377 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7f581c042030 con 0x7f582810b6d0 2024-04-25T13:54:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.561+0000 7f58177fe640 1 --2- 172.21.15.43:0/599819377 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f58100afcd0 0x7f58100b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.561+0000 7f582659c640 1 --2- 172.21.15.43:0/599819377 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f58100afcd0 0x7f58100b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.561+0000 7f58177fe640 1 -- 172.21.15.43:0/599819377 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9467+0+0 (secure 0 0 0) 0x7f581c0fff90 con 0x7f582810b6d0 2024-04-25T13:54:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.561+0000 7f582659c640 1 --2- 172.21.15.43:0/599819377 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f58100afcd0 0x7f58100b21e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f581800bbe0 tx=0x7f581800b390 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:54:39.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.565+0000 7f58177fe640 1 -- 172.21.15.43:0/599819377 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f581c0c8420 con 0x7f582810b6d0 2024-04-25T13:54:39.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.773+0000 7f582cc49640 1 -- 172.21.15.43:0/599819377 --> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f58281018a0 con 0x7f58100afcd0 2024-04-25T13:54:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.781+0000 7f58177fe640 1 -- 172.21.15.43:0/599819377 <== mgr.15486 v2:172.21.15.43:6800/1964865924 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f58281018a0 con 0x7f58100afcd0 2024-04-25T13:54:39.781 INFO:teuthology.orchestra.run.smithi043.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-25T00:00:00", "created": "2024-04-25T13:44:37", "first": "2024-04-25T13:45:00", "last": "2024-04-25T13:54:00", "last_pruned": "2024-04-25T13:54:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-04-25T13:54:39.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.783+0000 7f582cc49640 1 -- 172.21.15.43:0/599819377 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f58100afcd0 msgr2=0x7f58100b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:39.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.783+0000 7f582cc49640 1 --2- 172.21.15.43:0/599819377 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f58100afcd0 0x7f58100b21e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f581800bbe0 tx=0x7f581800b390 comp rx=0 tx=0).stop 2024-04-25T13:54:39.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.783+0000 7f582cc49640 1 -- 172.21.15.43:0/599819377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f582810b6d0 msgr2=0x7f582819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:39.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.783+0000 7f582cc49640 1 --2- 172.21.15.43:0/599819377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f582810b6d0 0x7f582819ac30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f581c009230 tx=0x7f581c004270 comp rx=0 tx=0).stop 2024-04-25T13:54:39.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.783+0000 7f582cc49640 1 -- 172.21.15.43:0/599819377 shutdown_connections 2024-04-25T13:54:39.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.783+0000 7f582cc49640 1 --2- 172.21.15.43:0/599819377 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f58100afcd0 0x7f58100b21e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:39.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.783+0000 7f582cc49640 1 --2- 172.21.15.43:0/599819377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582810e0c0 0x7f582819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:39.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.783+0000 7f582cc49640 1 --2- 172.21.15.43:0/599819377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f582810b6d0 0x7f582819ac30 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:39.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.783+0000 7f582cc49640 1 --2- 172.21.15.43:0/599819377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5828104c70 0x7f582819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:39.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.783+0000 7f582cc49640 1 -- 172.21.15.43:0/599819377 >> 172.21.15.43:0/599819377 conn(0x7f58280781b0 msgr2=0x7f5828101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:54:39.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.783+0000 7f582cc49640 1 -- 172.21.15.43:0/599819377 shutdown_connections 2024-04-25T13:54:39.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.783+0000 7f582cc49640 1 -- 172.21.15.43:0/599819377 wait complete. 2024-04-25T13:54:39.793 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-25T13:54:39.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.907+0000 7f9a2a66e640 1 -- 172.21.15.43:0/2459943345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a24104cd0 msgr2=0x7f9a241050e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:39.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.907+0000 7f9a2a66e640 1 --2- 172.21.15.43:0/2459943345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a24104cd0 0x7f9a241050e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009900 tx=0x7f9a1402a510 comp rx=0 tx=0).stop 2024-04-25T13:54:39.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.907+0000 7f9a2a66e640 1 -- 172.21.15.43:0/2459943345 shutdown_connections 2024-04-25T13:54:39.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.907+0000 7f9a2a66e640 1 --2- 172.21.15.43:0/2459943345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a2410e0e0 0x7f9a241105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:39.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.907+0000 7f9a2a66e640 1 --2- 172.21.15.43:0/2459943345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a2410b730 0x7f9a2410db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.907+0000 7f9a2a66e640 1 --2- 172.21.15.43:0/2459943345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a24104cd0 0x7f9a241050e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.907+0000 7f9a2a66e640 1 -- 172.21.15.43:0/2459943345 >> 172.21.15.43:0/2459943345 conn(0x7f9a240781b0 msgr2=0x7f9a240785f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:54:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.907+0000 7f9a2a66e640 1 -- 172.21.15.43:0/2459943345 shutdown_connections 2024-04-25T13:54:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.907+0000 7f9a2a66e640 1 -- 172.21.15.43:0/2459943345 wait complete. 2024-04-25T13:54:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.908+0000 7f9a2a66e640 1 Processor -- start 2024-04-25T13:54:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.908+0000 7f9a2a66e640 1 -- start start 2024-04-25T13:54:39.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.908+0000 7f9a2a66e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a24104cd0 0x7f9a2419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:39.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.908+0000 7f9a2a66e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a2410b730 0x7f9a2419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:39.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.908+0000 7f9a2a66e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a2410e0e0 0x7f9a2419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:39.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.908+0000 7f9a2a66e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9a24113bf0 con 0x7f9a2410b730 2024-04-25T13:54:39.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.908+0000 7f9a2a66e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9a24113a70 con 0x7f9a2410e0e0 2024-04-25T13:54:39.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.908+0000 7f9a2a66e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9a24113d70 con 0x7f9a24104cd0 2024-04-25T13:54:39.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.908+0000 7f9a237fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a2410b730 0x7f9a2419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:39.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.908+0000 7f9a237fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a2410b730 0x7f9a2419abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59954/0 (socket says 172.21.15.43:59954) 2024-04-25T13:54:39.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.908+0000 7f9a237fe640 1 -- 172.21.15.43:0/1006298471 learned_addr learned my addr 172.21.15.43:0/1006298471 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:54:39.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.908+0000 7f9a23fff640 1 --2- 172.21.15.43:0/1006298471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a24104cd0 0x7f9a2419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:39.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.908+0000 7f9a28c0b640 1 --2- 172.21.15.43:0/1006298471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a2410e0e0 0x7f9a2419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:39.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.909+0000 7f9a237fe640 1 -- 172.21.15.43:0/1006298471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a24104cd0 msgr2=0x7f9a2419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:39.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.909+0000 7f9a237fe640 1 --2- 172.21.15.43:0/1006298471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a24104cd0 0x7f9a2419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:39.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.909+0000 7f9a237fe640 1 -- 172.21.15.43:0/1006298471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a2410e0e0 msgr2=0x7f9a2419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:39.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.909+0000 7f9a237fe640 1 --2- 172.21.15.43:0/1006298471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a2410e0e0 0x7f9a2419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:39.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.909+0000 7f9a237fe640 1 -- 172.21.15.43:0/1006298471 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a2419f4f0 con 0x7f9a2410b730 2024-04-25T13:54:39.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.909+0000 7f9a237fe640 1 --2- 172.21.15.43:0/1006298471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a2410b730 0x7f9a2419abf0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800d950 tx=0x7f9a1800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:54:39.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.909+0000 7f9a217fa640 1 -- 172.21.15.43:0/1006298471 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a18017070 con 0x7f9a2410b730 2024-04-25T13:54:39.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.909+0000 7f9a2a66e640 1 -- 172.21.15.43:0/1006298471 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a2419f7e0 con 0x7f9a2410b730 2024-04-25T13:54:39.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.909+0000 7f9a217fa640 1 -- 172.21.15.43:0/1006298471 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a18009c30 con 0x7f9a2410b730 2024-04-25T13:54:39.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.909+0000 7f9a217fa640 1 -- 172.21.15.43:0/1006298471 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1800f620 con 0x7f9a2410b730 2024-04-25T13:54:39.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.909+0000 7f9a2a66e640 1 -- 172.21.15.43:0/1006298471 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a241a7160 con 0x7f9a2410b730 2024-04-25T13:54:39.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.910+0000 7f9a2a66e640 1 -- 172.21.15.43:0/1006298471 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a2406a110 con 0x7f9a2410b730 2024-04-25T13:54:39.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.911+0000 7f9a217fa640 1 -- 172.21.15.43:0/1006298471 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7f9a18010460 con 0x7f9a2410b730 2024-04-25T13:54:39.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.912+0000 7f9a217fa640 1 --2- 172.21.15.43:0/1006298471 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9a0c0afc50 0x7f9a0c0b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:39.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.912+0000 7f9a217fa640 1 -- 172.21.15.43:0/1006298471 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9467+0+0 (secure 0 0 0) 0x7f9a180df000 con 0x7f9a2410b730 2024-04-25T13:54:39.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.912+0000 7f9a23fff640 1 --2- 172.21.15.43:0/1006298471 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9a0c0afc50 0x7f9a0c0b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:39.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.913+0000 7f9a23fff640 1 --2- 172.21.15.43:0/1006298471 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9a0c0afc50 0x7f9a0c0b2160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a140057c0 tx=0x7f9a140058d0 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:54:39.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:39.916+0000 7f9a217fa640 1 -- 172.21.15.43:0/1006298471 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9a180a74f0 con 0x7f9a2410b730 2024-04-25T13:54:40.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.126+0000 7f9a2a66e640 1 -- 172.21.15.43:0/1006298471 --> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f9a241018a0 con 0x7f9a0c0afc50 2024-04-25T13:54:40.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.134+0000 7f9a217fa640 1 -- 172.21.15.43:0/1006298471 <== mgr.15486 v2:172.21.15.43:6800/1964865924 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f9a241018a0 con 0x7f9a0c0afc50 2024-04-25T13:54:40.134 INFO:teuthology.orchestra.run.smithi043.stdout:/ 1m 6m3h 2024-04-25T13:54:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.135+0000 7f9a2a66e640 1 -- 172.21.15.43:0/1006298471 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9a0c0afc50 msgr2=0x7f9a0c0b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.135+0000 7f9a2a66e640 1 --2- 172.21.15.43:0/1006298471 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9a0c0afc50 0x7f9a0c0b2160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a140057c0 tx=0x7f9a140058d0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.136+0000 7f9a2a66e640 1 -- 172.21.15.43:0/1006298471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a2410b730 msgr2=0x7f9a2419abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.136+0000 7f9a2a66e640 1 --2- 172.21.15.43:0/1006298471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a2410b730 0x7f9a2419abf0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800d950 tx=0x7f9a1800de10 comp rx=0 tx=0).stop 2024-04-25T13:54:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.136+0000 7f9a2a66e640 1 -- 172.21.15.43:0/1006298471 shutdown_connections 2024-04-25T13:54:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.136+0000 7f9a2a66e640 1 --2- 172.21.15.43:0/1006298471 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9a0c0afc50 0x7f9a0c0b2160 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.136+0000 7f9a2a66e640 1 --2- 172.21.15.43:0/1006298471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a2410e0e0 0x7f9a2419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.136+0000 7f9a2a66e640 1 --2- 172.21.15.43:0/1006298471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a2410b730 0x7f9a2419abf0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.136+0000 7f9a2a66e640 1 --2- 172.21.15.43:0/1006298471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a24104cd0 0x7f9a2419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.136+0000 7f9a2a66e640 1 -- 172.21.15.43:0/1006298471 >> 172.21.15.43:0/1006298471 conn(0x7f9a240781b0 msgr2=0x7f9a24101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:54:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.136+0000 7f9a2a66e640 1 -- 172.21.15.43:0/1006298471 shutdown_connections 2024-04-25T13:54:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.136+0000 7f9a2a66e640 1 -- 172.21.15.43:0/1006298471 wait complete. 2024-04-25T13:54:40.146 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-25T13:54:40.164 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:54:40.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.276+0000 7f9ee3fe3640 1 -- 172.21.15.43:0/2337564269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9edc108a20 msgr2=0x7f9edc1025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:40.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.276+0000 7f9ee3fe3640 1 --2- 172.21.15.43:0/2337564269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9edc108a20 0x7f9edc1025b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4009900 tx=0x7f9ed402a410 comp rx=0 tx=0).stop 2024-04-25T13:54:40.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.276+0000 7f9ee3fe3640 1 -- 172.21.15.43:0/2337564269 shutdown_connections 2024-04-25T13:54:40.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.276+0000 7f9ee3fe3640 1 --2- 172.21.15.43:0/2337564269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9edc10d380 0x7f9edc10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.276+0000 7f9ee3fe3640 1 --2- 172.21.15.43:0/2337564269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc102af0 0x7f9edc102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.276+0000 7f9ee3fe3640 1 --2- 172.21.15.43:0/2337564269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9edc108a20 0x7f9edc1025b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.276+0000 7f9ee3fe3640 1 -- 172.21.15.43:0/2337564269 >> 172.21.15.43:0/2337564269 conn(0x7f9edc078110 msgr2=0x7f9edc078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:54:40.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.276+0000 7f9ee3fe3640 1 -- 172.21.15.43:0/2337564269 shutdown_connections 2024-04-25T13:54:40.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.276+0000 7f9ee3fe3640 1 -- 172.21.15.43:0/2337564269 wait complete. 2024-04-25T13:54:40.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.277+0000 7f9ee3fe3640 1 Processor -- start 2024-04-25T13:54:40.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.277+0000 7f9ee3fe3640 1 -- start start 2024-04-25T13:54:40.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.277+0000 7f9ee3fe3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9edc102af0 0x7f9edc0ff230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:40.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.277+0000 7f9ee3fe3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9edc108a20 0x7f9edc0ff770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:40.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.277+0000 7f9ee3fe3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc10d380 0x7f9edc0ffcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:40.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.277+0000 7f9ee3fe3640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc112a90 con 0x7f9edc102af0 2024-04-25T13:54:40.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.277+0000 7f9ee3fe3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc112910 con 0x7f9edc10d380 2024-04-25T13:54:40.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.277+0000 7f9ee3fe3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc112c10 con 0x7f9edc108a20 2024-04-25T13:54:40.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.277+0000 7f9ee1d7f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9edc102af0 0x7f9edc0ff230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:40.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.277+0000 7f9ee1d7f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9edc102af0 0x7f9edc0ff230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59964/0 (socket says 172.21.15.43:59964) 2024-04-25T13:54:40.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.277+0000 7f9ee1d7f640 1 -- 172.21.15.43:0/157387156 learned_addr learned my addr 172.21.15.43:0/157387156 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:54:40.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.277+0000 7f9ee157e640 1 --2- 172.21.15.43:0/157387156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9edc108a20 0x7f9edc0ff770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:40.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.277+0000 7f9ee2580640 1 --2- 172.21.15.43:0/157387156 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc10d380 0x7f9edc0ffcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:40.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.278+0000 7f9ee1d7f640 1 -- 172.21.15.43:0/157387156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9edc108a20 msgr2=0x7f9edc0ff770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:40.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.278+0000 7f9ee1d7f640 1 --2- 172.21.15.43:0/157387156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9edc108a20 0x7f9edc0ff770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.278+0000 7f9ee1d7f640 1 -- 172.21.15.43:0/157387156 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc10d380 msgr2=0x7f9edc0ffcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:40.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.278+0000 7f9ee1d7f640 1 --2- 172.21.15.43:0/157387156 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc10d380 0x7f9edc0ffcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.278+0000 7f9ee1d7f640 1 -- 172.21.15.43:0/157387156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc1a8920 con 0x7f9edc102af0 2024-04-25T13:54:40.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.278+0000 7f9ee1d7f640 1 --2- 172.21.15.43:0/157387156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9edc102af0 0x7f9edc0ff230 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4005940 tx=0x7f9ed4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:54:40.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.278+0000 7f9ed2ffd640 1 -- 172.21.15.43:0/157387156 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed403f030 con 0x7f9edc102af0 2024-04-25T13:54:40.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.278+0000 7f9ee3fe3640 1 -- 172.21.15.43:0/157387156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc1a8bb0 con 0x7f9edc102af0 2024-04-25T13:54:40.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.278+0000 7f9ed2ffd640 1 -- 172.21.15.43:0/157387156 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ed4004440 con 0x7f9edc102af0 2024-04-25T13:54:40.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.278+0000 7f9ed2ffd640 1 -- 172.21.15.43:0/157387156 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4035070 con 0x7f9edc102af0 2024-04-25T13:54:40.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.278+0000 7f9ee3fe3640 1 -- 172.21.15.43:0/157387156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc1a90f0 con 0x7f9edc102af0 2024-04-25T13:54:40.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.279+0000 7f9ee3fe3640 1 -- 172.21.15.43:0/157387156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc103cd0 con 0x7f9edc102af0 2024-04-25T13:54:40.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.281+0000 7f9ed2ffd640 1 -- 172.21.15.43:0/157387156 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7f9ed4042030 con 0x7f9edc102af0 2024-04-25T13:54:40.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.281+0000 7f9ed2ffd640 1 --2- 172.21.15.43:0/157387156 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9ec80afc60 0x7f9ec80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:40.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.281+0000 7f9ed2ffd640 1 -- 172.21.15.43:0/157387156 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9467+0+0 (secure 0 0 0) 0x7f9ed40ffbf0 con 0x7f9edc102af0 2024-04-25T13:54:40.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.281+0000 7f9ee157e640 1 --2- 172.21.15.43:0/157387156 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9ec80afc60 0x7f9ec80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:40.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.282+0000 7f9ee157e640 1 --2- 172.21.15.43:0/157387156 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9ec80afc60 0x7f9ec80b2170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9edc10fb80 tx=0x7f9ecc005f90 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:54:40.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.285+0000 7f9ed2ffd640 1 -- 172.21.15.43:0/157387156 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9ed40c7a90 con 0x7f9edc102af0 2024-04-25T13:54:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.470+0000 7f9ee3fe3640 1 -- 172.21.15.43:0/157387156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9edc1a92c0 con 0x7f9edc102af0 2024-04-25T13:54:40.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.472+0000 7f9ed2ffd640 1 -- 172.21.15.43:0/157387156 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+25250 (secure 0 0 0) 0x7f9ed40cbd90 con 0x7f9edc102af0 2024-04-25T13:54:40.472 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:54:40.472 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":93,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:54:21.889131+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":92,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":92,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/2028903966":"2024-04-26T13:44:35.638372+0000","172.21.15.43:0/21237256":"2024-04-26T13:44:35.638372+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1369825389":"2024-04-26T13:44:35.638372+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/2307776489":"2024-04-26T13:44:35.638372+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/2478639579":"2024-04-26T13:44:35.638372+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6800/2478639579":"2024-04-26T13:44:35.638372+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:54:40.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.474+0000 7f9ee3fe3640 1 -- 172.21.15.43:0/157387156 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9ec80afc60 msgr2=0x7f9ec80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:40.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.474+0000 7f9ee3fe3640 1 --2- 172.21.15.43:0/157387156 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9ec80afc60 0x7f9ec80b2170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9edc10fb80 tx=0x7f9ecc005f90 comp rx=0 tx=0).stop 2024-04-25T13:54:40.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.474+0000 7f9ee3fe3640 1 -- 172.21.15.43:0/157387156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9edc102af0 msgr2=0x7f9edc0ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:40.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.474+0000 7f9ee3fe3640 1 --2- 172.21.15.43:0/157387156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9edc102af0 0x7f9edc0ff230 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4005940 tx=0x7f9ed4004040 comp rx=0 tx=0).stop 2024-04-25T13:54:40.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.474+0000 7f9ee3fe3640 1 -- 172.21.15.43:0/157387156 shutdown_connections 2024-04-25T13:54:40.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.474+0000 7f9ee3fe3640 1 --2- 172.21.15.43:0/157387156 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9ec80afc60 0x7f9ec80b2170 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.474+0000 7f9ee3fe3640 1 --2- 172.21.15.43:0/157387156 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc10d380 0x7f9edc0ffcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.474+0000 7f9ee3fe3640 1 --2- 172.21.15.43:0/157387156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9edc108a20 0x7f9edc0ff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.474+0000 7f9ee3fe3640 1 --2- 172.21.15.43:0/157387156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9edc102af0 0x7f9edc0ff230 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.474+0000 7f9ee3fe3640 1 -- 172.21.15.43:0/157387156 >> 172.21.15.43:0/157387156 conn(0x7f9edc078110 msgr2=0x7f9edc069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:54:40.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.474+0000 7f9ee3fe3640 1 -- 172.21.15.43:0/157387156 shutdown_connections 2024-04-25T13:54:40.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.474+0000 7f9ee3fe3640 1 -- 172.21.15.43:0/157387156 wait complete. 2024-04-25T13:54:40.485 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:37:25.931659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:06.202688+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:07.348534+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 92, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:42:11.056739+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 92, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:54:40.486 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:54:40.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.602+0000 7fdb5460c640 1 -- 172.21.15.43:0/2637633750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb4c10d380 msgr2=0x7fdb4c10f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:40.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.602+0000 7fdb5460c640 1 --2- 172.21.15.43:0/2637633750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb4c10d380 0x7fdb4c10f7a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009ca0 tx=0x7fdb4402a8c0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.602+0000 7fdb5460c640 1 -- 172.21.15.43:0/2637633750 shutdown_connections 2024-04-25T13:54:40.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.602+0000 7fdb5460c640 1 --2- 172.21.15.43:0/2637633750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb4c10d380 0x7fdb4c10f7a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.602+0000 7fdb5460c640 1 --2- 172.21.15.43:0/2637633750 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb4c102af0 0x7fdb4c102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.602+0000 7fdb5460c640 1 --2- 172.21.15.43:0/2637633750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb4c108a20 0x7fdb4c1025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.602+0000 7fdb5460c640 1 -- 172.21.15.43:0/2637633750 >> 172.21.15.43:0/2637633750 conn(0x7fdb4c078100 msgr2=0x7fdb4c078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:54:40.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.602+0000 7fdb5460c640 1 -- 172.21.15.43:0/2637633750 shutdown_connections 2024-04-25T13:54:40.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.602+0000 7fdb5460c640 1 -- 172.21.15.43:0/2637633750 wait complete. 2024-04-25T13:54:40.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.603+0000 7fdb5460c640 1 Processor -- start 2024-04-25T13:54:40.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.603+0000 7fdb5460c640 1 -- start start 2024-04-25T13:54:40.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.603+0000 7fdb5460c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb4c102af0 0x7fdb4c0ff210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:40.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.603+0000 7fdb5460c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb4c108a20 0x7fdb4c0ff750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:40.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.603+0000 7fdb5460c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb4c10d380 0x7fdb4c0ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:40.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.603+0000 7fdb5460c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4c112b00 con 0x7fdb4c108a20 2024-04-25T13:54:40.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.603+0000 7fdb5460c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4c112980 con 0x7fdb4c102af0 2024-04-25T13:54:40.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.603+0000 7fdb5460c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4c112c80 con 0x7fdb4c10d380 2024-04-25T13:54:40.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.604+0000 7fdb51ba7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb4c108a20 0x7fdb4c0ff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:40.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.604+0000 7fdb51ba7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb4c108a20 0x7fdb4c0ff750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59982/0 (socket says 172.21.15.43:59982) 2024-04-25T13:54:40.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.604+0000 7fdb51ba7640 1 -- 172.21.15.43:0/407131071 learned_addr learned my addr 172.21.15.43:0/407131071 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:54:40.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.604+0000 7fdb523a8640 1 --2- 172.21.15.43:0/407131071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb4c102af0 0x7fdb4c0ff210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:40.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.604+0000 7fdb52ba9640 1 --2- 172.21.15.43:0/407131071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb4c10d380 0x7fdb4c0ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:40.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.604+0000 7fdb51ba7640 1 -- 172.21.15.43:0/407131071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb4c10d380 msgr2=0x7fdb4c0ffc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:40.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.604+0000 7fdb51ba7640 1 --2- 172.21.15.43:0/407131071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb4c10d380 0x7fdb4c0ffc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.604+0000 7fdb51ba7640 1 -- 172.21.15.43:0/407131071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb4c102af0 msgr2=0x7fdb4c0ff210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:40.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.604+0000 7fdb51ba7640 1 --2- 172.21.15.43:0/407131071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb4c102af0 0x7fdb4c0ff210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.604+0000 7fdb51ba7640 1 -- 172.21.15.43:0/407131071 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4c1a8940 con 0x7fdb4c108a20 2024-04-25T13:54:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.604+0000 7fdb51ba7640 1 --2- 172.21.15.43:0/407131071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb4c108a20 0x7fdb4c0ff750 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00d740 tx=0x7fdb3c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:54:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.604+0000 7fdb437fe640 1 -- 172.21.15.43:0/407131071 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c017070 con 0x7fdb4c108a20 2024-04-25T13:54:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.604+0000 7fdb437fe640 1 -- 172.21.15.43:0/407131071 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb3c00de50 con 0x7fdb4c108a20 2024-04-25T13:54:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.604+0000 7fdb5460c640 1 -- 172.21.15.43:0/407131071 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb4c1a8c30 con 0x7fdb4c108a20 2024-04-25T13:54:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.604+0000 7fdb437fe640 1 -- 172.21.15.43:0/407131071 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c003bb0 con 0x7fdb4c108a20 2024-04-25T13:54:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.604+0000 7fdb5460c640 1 -- 172.21.15.43:0/407131071 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb4c1a9180 con 0x7fdb4c108a20 2024-04-25T13:54:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.605+0000 7fdb5460c640 1 -- 172.21.15.43:0/407131071 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb4c06afa0 con 0x7fdb4c108a20 2024-04-25T13:54:40.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.607+0000 7fdb437fe640 1 -- 172.21.15.43:0/407131071 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7fdb3c003d50 con 0x7fdb4c108a20 2024-04-25T13:54:40.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.607+0000 7fdb437fe640 1 --2- 172.21.15.43:0/407131071 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdb380afc60 0x7fdb380b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:40.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.608+0000 7fdb523a8640 1 --2- 172.21.15.43:0/407131071 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdb380afc60 0x7fdb380b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:40.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.608+0000 7fdb437fe640 1 -- 172.21.15.43:0/407131071 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9467+0+0 (secure 0 0 0) 0x7fdb3c0df2b0 con 0x7fdb4c108a20 2024-04-25T13:54:40.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.608+0000 7fdb523a8640 1 --2- 172.21.15.43:0/407131071 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdb380afc60 0x7fdb380b2170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdb48005fd0 tx=0x7fdb4800b390 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:54:40.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.611+0000 7fdb437fe640 1 -- 172.21.15.43:0/407131071 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdb3c0a77a0 con 0x7fdb4c108a20 2024-04-25T13:54:40.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.797+0000 7fdb5460c640 1 -- 172.21.15.43:0/407131071 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdb4c1a93f0 con 0x7fdb4c108a20 2024-04-25T13:54:40.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.797+0000 7fdb437fe640 1 -- 172.21.15.43:0/407131071 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7fdb3c0a70a0 con 0x7fdb4c108a20 2024-04-25T13:54:40.797 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T13:54:40.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.799+0000 7fdb5460c640 1 -- 172.21.15.43:0/407131071 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdb380afc60 msgr2=0x7fdb380b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:40.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.799+0000 7fdb5460c640 1 --2- 172.21.15.43:0/407131071 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdb380afc60 0x7fdb380b2170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdb48005fd0 tx=0x7fdb4800b390 comp rx=0 tx=0).stop 2024-04-25T13:54:40.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.799+0000 7fdb5460c640 1 -- 172.21.15.43:0/407131071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb4c108a20 msgr2=0x7fdb4c0ff750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:40.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.799+0000 7fdb5460c640 1 --2- 172.21.15.43:0/407131071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb4c108a20 0x7fdb4c0ff750 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00d740 tx=0x7fdb3c00dc00 comp rx=0 tx=0).stop 2024-04-25T13:54:40.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.800+0000 7fdb5460c640 1 -- 172.21.15.43:0/407131071 shutdown_connections 2024-04-25T13:54:40.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.800+0000 7fdb5460c640 1 --2- 172.21.15.43:0/407131071 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdb380afc60 0x7fdb380b2170 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.800+0000 7fdb5460c640 1 --2- 172.21.15.43:0/407131071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb4c10d380 0x7fdb4c0ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.800+0000 7fdb5460c640 1 --2- 172.21.15.43:0/407131071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb4c108a20 0x7fdb4c0ff750 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.800+0000 7fdb5460c640 1 --2- 172.21.15.43:0/407131071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb4c102af0 0x7fdb4c0ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.800+0000 7fdb5460c640 1 -- 172.21.15.43:0/407131071 >> 172.21.15.43:0/407131071 conn(0x7fdb4c078100 msgr2=0x7fdb4c069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:54:40.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.800+0000 7fdb5460c640 1 -- 172.21.15.43:0/407131071 shutdown_connections 2024-04-25T13:54:40.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.800+0000 7fdb5460c640 1 -- 172.21.15.43:0/407131071 wait complete. 2024-04-25T13:54:40.810 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:54:40.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.926+0000 7f3731f8f640 1 -- 172.21.15.43:0/1748460283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f372c102b10 msgr2=0x7f372c102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:40.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.926+0000 7f3731f8f640 1 --2- 172.21.15.43:0/1748460283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f372c102b10 0x7f372c102f20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3720009900 tx=0x7f372002a410 comp rx=0 tx=0).stop 2024-04-25T13:54:40.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.926+0000 7f3731f8f640 1 -- 172.21.15.43:0/1748460283 shutdown_connections 2024-04-25T13:54:40.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.926+0000 7f3731f8f640 1 --2- 172.21.15.43:0/1748460283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f372c10d3a0 0x7f372c10f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.926+0000 7f3731f8f640 1 --2- 172.21.15.43:0/1748460283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f372c102b10 0x7f372c102f20 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.926+0000 7f3731f8f640 1 --2- 172.21.15.43:0/1748460283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f372c108a40 0x7f372c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.926+0000 7f3731f8f640 1 -- 172.21.15.43:0/1748460283 >> 172.21.15.43:0/1748460283 conn(0x7f372c078180 msgr2=0x7f372c0785c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:54:40.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.926+0000 7f3731f8f640 1 -- 172.21.15.43:0/1748460283 shutdown_connections 2024-04-25T13:54:40.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.926+0000 7f3731f8f640 1 -- 172.21.15.43:0/1748460283 wait complete. 2024-04-25T13:54:40.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.926+0000 7f3731f8f640 1 Processor -- start 2024-04-25T13:54:40.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f3731f8f640 1 -- start start 2024-04-25T13:54:40.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f3731f8f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f372c102b10 0x7f372c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:40.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f3731f8f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f372c108a40 0x7f372c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:40.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f3731f8f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f372c10d3a0 0x7f372c19ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:40.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f3731f8f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f372c112ab0 con 0x7f372c102b10 2024-04-25T13:54:40.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f3731f8f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f372c112930 con 0x7f372c10d3a0 2024-04-25T13:54:40.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f3731f8f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f372c112c30 con 0x7f372c108a40 2024-04-25T13:54:40.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f372b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f372c102b10 0x7f372c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:40.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f372b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f372c102b10 0x7f372c19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60012/0 (socket says 172.21.15.43:60012) 2024-04-25T13:54:40.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f372b7fe640 1 -- 172.21.15.43:0/4134723702 learned_addr learned my addr 172.21.15.43:0/4134723702 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:54:40.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f372affd640 1 --2- 172.21.15.43:0/4134723702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f372c108a40 0x7f372c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:40.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f372bfff640 1 --2- 172.21.15.43:0/4134723702 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f372c10d3a0 0x7f372c19ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:40.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f372b7fe640 1 -- 172.21.15.43:0/4134723702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f372c108a40 msgr2=0x7f372c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:40.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f372b7fe640 1 --2- 172.21.15.43:0/4134723702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f372c108a40 0x7f372c19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f372b7fe640 1 -- 172.21.15.43:0/4134723702 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f372c10d3a0 msgr2=0x7f372c19ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:40.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f372b7fe640 1 --2- 172.21.15.43:0/4134723702 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f372c10d3a0 0x7f372c19ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:40.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.927+0000 7f372b7fe640 1 -- 172.21.15.43:0/4134723702 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372c19f4a0 con 0x7f372c102b10 2024-04-25T13:54:40.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.928+0000 7f372b7fe640 1 --2- 172.21.15.43:0/4134723702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f372c102b10 0x7f372c19a640 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f371c00d770 tx=0x7f371c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:54:40.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.928+0000 7f3728ff9640 1 -- 172.21.15.43:0/4134723702 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c017070 con 0x7f372c102b10 2024-04-25T13:54:40.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.928+0000 7f3728ff9640 1 -- 172.21.15.43:0/4134723702 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f371c009c30 con 0x7f372c102b10 2024-04-25T13:54:40.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.928+0000 7f3731f8f640 1 -- 172.21.15.43:0/4134723702 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372c19f790 con 0x7f372c102b10 2024-04-25T13:54:40.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.928+0000 7f3728ff9640 1 -- 172.21.15.43:0/4134723702 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c00f620 con 0x7f372c102b10 2024-04-25T13:54:40.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.928+0000 7f3731f8f640 1 -- 172.21.15.43:0/4134723702 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f372c1a7110 con 0x7f372c102b10 2024-04-25T13:54:40.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.929+0000 7f3731f8f640 1 -- 172.21.15.43:0/4134723702 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f372c0692e0 con 0x7f372c102b10 2024-04-25T13:54:40.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.930+0000 7f3728ff9640 1 -- 172.21.15.43:0/4134723702 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7f371c01a070 con 0x7f372c102b10 2024-04-25T13:54:40.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.931+0000 7f3728ff9640 1 --2- 172.21.15.43:0/4134723702 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f37140afce0 0x7f37140b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:40.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.931+0000 7f372affd640 1 --2- 172.21.15.43:0/4134723702 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f37140afce0 0x7f37140b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:40.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.931+0000 7f3728ff9640 1 -- 172.21.15.43:0/4134723702 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9467+0+0 (secure 0 0 0) 0x7f371c0ded80 con 0x7f372c102b10 2024-04-25T13:54:40.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.932+0000 7f372affd640 1 --2- 172.21.15.43:0/4134723702 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f37140afce0 0x7f37140b21f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3720005940 tx=0x7f37200058d0 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:54:40.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:40.934+0000 7f3728ff9640 1 -- 172.21.15.43:0/4134723702 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f371c009de0 con 0x7f372c102b10 2024-04-25T13:54:41.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.124+0000 7f3731f8f640 1 -- 172.21.15.43:0/4134723702 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f372c1a72e0 con 0x7f372c102b10 2024-04-25T13:54:41.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.124+0000 7f3728ff9640 1 -- 172.21.15.43:0/4134723702 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7f371c0af370 con 0x7f372c102b10 2024-04-25T13:54:41.124 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:54:41.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.126+0000 7f3731f8f640 1 -- 172.21.15.43:0/4134723702 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f37140afce0 msgr2=0x7f37140b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:41.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.126+0000 7f3731f8f640 1 --2- 172.21.15.43:0/4134723702 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f37140afce0 0x7f37140b21f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3720005940 tx=0x7f37200058d0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.126+0000 7f3731f8f640 1 -- 172.21.15.43:0/4134723702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f372c102b10 msgr2=0x7f372c19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:41.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.126+0000 7f3731f8f640 1 --2- 172.21.15.43:0/4134723702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f372c102b10 0x7f372c19a640 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f371c00d770 tx=0x7f371c00dc30 comp rx=0 tx=0).stop 2024-04-25T13:54:41.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.126+0000 7f3731f8f640 1 -- 172.21.15.43:0/4134723702 shutdown_connections 2024-04-25T13:54:41.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.126+0000 7f3731f8f640 1 --2- 172.21.15.43:0/4134723702 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f37140afce0 0x7f37140b21f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.126+0000 7f3731f8f640 1 --2- 172.21.15.43:0/4134723702 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f372c10d3a0 0x7f372c19ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.126+0000 7f3731f8f640 1 --2- 172.21.15.43:0/4134723702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f372c108a40 0x7f372c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.126+0000 7f3731f8f640 1 --2- 172.21.15.43:0/4134723702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f372c102b10 0x7f372c19a640 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.126+0000 7f3731f8f640 1 -- 172.21.15.43:0/4134723702 >> 172.21.15.43:0/4134723702 conn(0x7f372c078180 msgr2=0x7f372c06b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:54:41.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.126+0000 7f3731f8f640 1 -- 172.21.15.43:0/4134723702 shutdown_connections 2024-04-25T13:54:41.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.126+0000 7f3731f8f640 1 -- 172.21.15.43:0/4134723702 wait complete. 2024-04-25T13:54:41.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:40 smithi043 ceph-mon[29195]: from='client.15606 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:54:41.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:40 smithi043 ceph-mon[29195]: pgmap v313: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:54:41.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:40 smithi043 ceph-mon[29195]: from='client.15612 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:54:41.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:40 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/157387156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:54:41.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:40 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/407131071' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:54:41.137 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:54:41.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:40 smithi175 ceph-mon[32649]: from='client.15606 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:54:41.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:40 smithi175 ceph-mon[32649]: pgmap v313: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:54:41.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:40 smithi175 ceph-mon[32649]: from='client.15612 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:54:41.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:40 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/157387156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:54:41.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:40 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/407131071' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:54:41.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.253+0000 7f74bb0f9640 1 -- 172.21.15.43:0/2575381260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b410b6b0 msgr2=0x7f74b410dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:41.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.253+0000 7f74bb0f9640 1 --2- 172.21.15.43:0/2575381260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b410b6b0 0x7f74b410dad0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009900 tx=0x7f74a802a510 comp rx=0 tx=0).stop 2024-04-25T13:54:41.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.253+0000 7f74bb0f9640 1 -- 172.21.15.43:0/2575381260 shutdown_connections 2024-04-25T13:54:41.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.253+0000 7f74bb0f9640 1 --2- 172.21.15.43:0/2575381260 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74b410e060 0x7f74b4110550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.253+0000 7f74bb0f9640 1 --2- 172.21.15.43:0/2575381260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b410b6b0 0x7f74b410dad0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.253+0000 7f74bb0f9640 1 --2- 172.21.15.43:0/2575381260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b4104c50 0x7f74b4105060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.253+0000 7f74bb0f9640 1 -- 172.21.15.43:0/2575381260 >> 172.21.15.43:0/2575381260 conn(0x7f74b4078100 msgr2=0x7f74b4078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:54:41.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.253+0000 7f74bb0f9640 1 -- 172.21.15.43:0/2575381260 shutdown_connections 2024-04-25T13:54:41.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.253+0000 7f74bb0f9640 1 -- 172.21.15.43:0/2575381260 wait complete. 2024-04-25T13:54:41.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74bb0f9640 1 Processor -- start 2024-04-25T13:54:41.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74bb0f9640 1 -- start start 2024-04-25T13:54:41.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74bb0f9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b4104c50 0x7f74b419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:41.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74bb0f9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b410b6b0 0x7f74b419ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:41.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74bb0f9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74b410e060 0x7f74b419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:41.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74bb0f9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4113b70 con 0x7f74b410b6b0 2024-04-25T13:54:41.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74bb0f9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f74b41139f0 con 0x7f74b410e060 2024-04-25T13:54:41.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74bb0f9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4113cf0 con 0x7f74b4104c50 2024-04-25T13:54:41.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74b3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b410b6b0 0x7f74b419ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:41.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74b3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b410b6b0 0x7f74b419ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60026/0 (socket says 172.21.15.43:60026) 2024-04-25T13:54:41.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74b3fff640 1 -- 172.21.15.43:0/2537816606 learned_addr learned my addr 172.21.15.43:0/2537816606 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:54:41.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74b9696640 1 --2- 172.21.15.43:0/2537816606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74b410e060 0x7f74b419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:41.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74b8e95640 1 --2- 172.21.15.43:0/2537816606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b4104c50 0x7f74b419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:41.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74b3fff640 1 -- 172.21.15.43:0/2537816606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b4104c50 msgr2=0x7f74b419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:41.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74b3fff640 1 --2- 172.21.15.43:0/2537816606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b4104c50 0x7f74b419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74b3fff640 1 -- 172.21.15.43:0/2537816606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74b410e060 msgr2=0x7f74b419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:41.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74b3fff640 1 --2- 172.21.15.43:0/2537816606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74b410e060 0x7f74b419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.254+0000 7f74b3fff640 1 -- 172.21.15.43:0/2537816606 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b419f510 con 0x7f74b410b6b0 2024-04-25T13:54:41.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.255+0000 7f74b3fff640 1 --2- 172.21.15.43:0/2537816606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b410b6b0 0x7f74b419ac10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009230 tx=0x7f74a8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:54:41.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.255+0000 7f74b1ffb640 1 -- 172.21.15.43:0/2537816606 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a803f030 con 0x7f74b410b6b0 2024-04-25T13:54:41.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.255+0000 7f74bb0f9640 1 -- 172.21.15.43:0/2537816606 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b419f7a0 con 0x7f74b410b6b0 2024-04-25T13:54:41.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.255+0000 7f74b1ffb640 1 -- 172.21.15.43:0/2537816606 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74a8003a80 con 0x7f74b410b6b0 2024-04-25T13:54:41.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.255+0000 7f74b1ffb640 1 -- 172.21.15.43:0/2537816606 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8035070 con 0x7f74b410b6b0 2024-04-25T13:54:41.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.255+0000 7f74bb0f9640 1 -- 172.21.15.43:0/2537816606 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b419fce0 con 0x7f74b410b6b0 2024-04-25T13:54:41.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.256+0000 7f74bb0f9640 1 -- 172.21.15.43:0/2537816606 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b406afa0 con 0x7f74b410b6b0 2024-04-25T13:54:41.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.257+0000 7f74b1ffb640 1 -- 172.21.15.43:0/2537816606 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7f74a8042030 con 0x7f74b410b6b0 2024-04-25T13:54:41.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.258+0000 7f74b1ffb640 1 --2- 172.21.15.43:0/2537816606 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f749c0afc60 0x7f749c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:41.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.258+0000 7f74b8e95640 1 --2- 172.21.15.43:0/2537816606 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f749c0afc60 0x7f749c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:41.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.258+0000 7f74b1ffb640 1 -- 172.21.15.43:0/2537816606 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9467+0+0 (secure 0 0 0) 0x7f74a80ffa50 con 0x7f74b410b6b0 2024-04-25T13:54:41.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.259+0000 7f74b8e95640 1 --2- 172.21.15.43:0/2537816606 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f749c0afc60 0x7f749c0b2170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009b60 tx=0x7f74a4005f90 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:54:41.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.263+0000 7f74b1ffb640 1 -- 172.21.15.43:0/2537816606 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f74a80c7ee0 con 0x7f74b410b6b0 2024-04-25T13:54:41.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:40 smithi161 ceph-mon[32696]: from='client.15606 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:54:41.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:40 smithi161 ceph-mon[32696]: pgmap v313: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:54:41.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:40 smithi161 ceph-mon[32696]: from='client.15612 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T13:54:41.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:40 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/157387156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:54:41.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:40 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/407131071' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:54:41.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.449+0000 7f74bb0f9640 1 -- 172.21.15.43:0/2537816606 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f74b41a72a0 con 0x7f74b410b6b0 2024-04-25T13:54:41.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.449+0000 7f74b1ffb640 1 -- 172.21.15.43:0/2537816606 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7f74a80c77e0 con 0x7f74b410b6b0 2024-04-25T13:54:41.450 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-25T13:54:41.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.451+0000 7f74bb0f9640 1 -- 172.21.15.43:0/2537816606 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f749c0afc60 msgr2=0x7f749c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:41.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.451+0000 7f74bb0f9640 1 --2- 172.21.15.43:0/2537816606 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f749c0afc60 0x7f749c0b2170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009b60 tx=0x7f74a4005f90 comp rx=0 tx=0).stop 2024-04-25T13:54:41.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.451+0000 7f74bb0f9640 1 -- 172.21.15.43:0/2537816606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b410b6b0 msgr2=0x7f74b419ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:41.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.451+0000 7f74bb0f9640 1 --2- 172.21.15.43:0/2537816606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b410b6b0 0x7f74b419ac10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009230 tx=0x7f74a8004270 comp rx=0 tx=0).stop 2024-04-25T13:54:41.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.452+0000 7f74bb0f9640 1 -- 172.21.15.43:0/2537816606 shutdown_connections 2024-04-25T13:54:41.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.452+0000 7f74bb0f9640 1 --2- 172.21.15.43:0/2537816606 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f749c0afc60 0x7f749c0b2170 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.452+0000 7f74bb0f9640 1 --2- 172.21.15.43:0/2537816606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74b410e060 0x7f74b419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.452+0000 7f74bb0f9640 1 --2- 172.21.15.43:0/2537816606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b410b6b0 0x7f74b419ac10 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.452+0000 7f74bb0f9640 1 --2- 172.21.15.43:0/2537816606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b4104c50 0x7f74b419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.452+0000 7f74bb0f9640 1 -- 172.21.15.43:0/2537816606 >> 172.21.15.43:0/2537816606 conn(0x7f74b4078100 msgr2=0x7f74b4101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:54:41.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.452+0000 7f74bb0f9640 1 -- 172.21.15.43:0/2537816606 shutdown_connections 2024-04-25T13:54:41.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.452+0000 7f74bb0f9640 1 -- 172.21.15.43:0/2537816606 wait complete. 2024-04-25T13:54:41.462 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:54:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.577+0000 7f28378e7640 1 -- 172.21.15.43:0/2874442516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2830109b10 msgr2=0x7f28301036b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.577+0000 7f28378e7640 1 --2- 172.21.15.43:0/2874442516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2830109b10 0x7f28301036b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f282c009900 tx=0x7f282c02a410 comp rx=0 tx=0).stop 2024-04-25T13:54:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.577+0000 7f28378e7640 1 -- 172.21.15.43:0/2874442516 shutdown_connections 2024-04-25T13:54:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.577+0000 7f28378e7640 1 --2- 172.21.15.43:0/2874442516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2830104260 0x7f2830110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.577+0000 7f28378e7640 1 --2- 172.21.15.43:0/2874442516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2830109fb0 0x7f2830103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.577+0000 7f28378e7640 1 --2- 172.21.15.43:0/2874442516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2830109b10 0x7f28301036b0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.577+0000 7f28378e7640 1 -- 172.21.15.43:0/2874442516 >> 172.21.15.43:0/2874442516 conn(0x7f28300ff1d0 msgr2=0x7f2830101620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:54:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.577+0000 7f28378e7640 1 -- 172.21.15.43:0/2874442516 shutdown_connections 2024-04-25T13:54:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.577+0000 7f28378e7640 1 -- 172.21.15.43:0/2874442516 wait complete. 2024-04-25T13:54:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f28378e7640 1 Processor -- start 2024-04-25T13:54:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f28378e7640 1 -- start start 2024-04-25T13:54:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f28378e7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2830104260 0x7f283019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f28378e7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2830109b10 0x7f283019ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f28378e7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2830109fb0 0x7f283019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f28378e7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2830113bb0 con 0x7f2830109fb0 2024-04-25T13:54:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f28378e7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2830113a30 con 0x7f2830109b10 2024-04-25T13:54:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f28378e7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2830113d30 con 0x7f2830104260 2024-04-25T13:54:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f2835e84640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2830109fb0 0x7f283019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:41.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f2835e84640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2830109fb0 0x7f283019eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60042/0 (socket says 172.21.15.43:60042) 2024-04-25T13:54:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f2835e84640 1 -- 172.21.15.43:0/3983168656 learned_addr learned my addr 172.21.15.43:0/3983168656 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:54:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f2835683640 1 --2- 172.21.15.43:0/3983168656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2830104260 0x7f283019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f2834e82640 1 --2- 172.21.15.43:0/3983168656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2830109b10 0x7f283019ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f2835e84640 1 -- 172.21.15.43:0/3983168656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2830104260 msgr2=0x7f283019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f2835e84640 1 --2- 172.21.15.43:0/3983168656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2830104260 0x7f283019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f2835e84640 1 -- 172.21.15.43:0/3983168656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2830109b10 msgr2=0x7f283019ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f2835e84640 1 --2- 172.21.15.43:0/3983168656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2830109b10 0x7f283019ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.578+0000 7f2835e84640 1 -- 172.21.15.43:0/3983168656 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283019f510 con 0x7f2830109fb0 2024-04-25T13:54:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.579+0000 7f2835e84640 1 --2- 172.21.15.43:0/3983168656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2830109fb0 0x7f283019eed0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f282800eaa0 tx=0x7f282800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:54:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.579+0000 7f28267fc640 1 -- 172.21.15.43:0/3983168656 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282800cdb0 con 0x7f2830109fb0 2024-04-25T13:54:41.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.579+0000 7f28267fc640 1 -- 172.21.15.43:0/3983168656 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2828005020 con 0x7f2830109fb0 2024-04-25T13:54:41.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.579+0000 7f28378e7640 1 -- 172.21.15.43:0/3983168656 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283019f800 con 0x7f2830109fb0 2024-04-25T13:54:41.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.579+0000 7f28267fc640 1 -- 172.21.15.43:0/3983168656 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28280116d0 con 0x7f2830109fb0 2024-04-25T13:54:41.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.579+0000 7f28378e7640 1 -- 172.21.15.43:0/3983168656 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f283019fd00 con 0x7f2830109fb0 2024-04-25T13:54:41.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.580+0000 7f28378e7640 1 -- 172.21.15.43:0/3983168656 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2830104df0 con 0x7f2830109fb0 2024-04-25T13:54:41.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.581+0000 7f28267fc640 1 -- 172.21.15.43:0/3983168656 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7f28280051d0 con 0x7f2830109fb0 2024-04-25T13:54:41.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.582+0000 7f28267fc640 1 --2- 172.21.15.43:0/3983168656 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f281c0afc60 0x7f281c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:41.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.582+0000 7f2835683640 1 --2- 172.21.15.43:0/3983168656 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f281c0afc60 0x7f281c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:41.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.582+0000 7f28267fc640 1 -- 172.21.15.43:0/3983168656 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9467+0+0 (secure 0 0 0) 0x7f28280dfa30 con 0x7f2830109fb0 2024-04-25T13:54:41.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.583+0000 7f2835683640 1 --2- 172.21.15.43:0/3983168656 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f281c0afc60 0x7f281c0b2170 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f282c004770 tx=0x7f282c0058d0 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:54:41.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.586+0000 7f28267fc640 1 -- 172.21.15.43:0/3983168656 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f283019fd00 con 0x7f2830109fb0 2024-04-25T13:54:41.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.772+0000 7f28378e7640 1 -- 172.21.15.43:0/3983168656 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f28301a7270 con 0x7f2830109fb0 2024-04-25T13:54:41.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.773+0000 7f28267fc640 1 -- 172.21.15.43:0/3983168656 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) ==== 103+0+11 (secure 0 0 0) 0x7f2828016030 con 0x7f2830109fb0 2024-04-25T13:54:41.773 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:54:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.775+0000 7f28378e7640 1 -- 172.21.15.43:0/3983168656 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f281c0afc60 msgr2=0x7f281c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.775+0000 7f28378e7640 1 --2- 172.21.15.43:0/3983168656 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f281c0afc60 0x7f281c0b2170 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f282c004770 tx=0x7f282c0058d0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.775+0000 7f28378e7640 1 -- 172.21.15.43:0/3983168656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2830109fb0 msgr2=0x7f283019eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.775+0000 7f28378e7640 1 --2- 172.21.15.43:0/3983168656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2830109fb0 0x7f283019eed0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f282800eaa0 tx=0x7f282800ef60 comp rx=0 tx=0).stop 2024-04-25T13:54:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.775+0000 7f28378e7640 1 -- 172.21.15.43:0/3983168656 shutdown_connections 2024-04-25T13:54:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.775+0000 7f28378e7640 1 --2- 172.21.15.43:0/3983168656 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f281c0afc60 0x7f281c0b2170 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.775+0000 7f28378e7640 1 --2- 172.21.15.43:0/3983168656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2830109fb0 0x7f283019eed0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.775+0000 7f28378e7640 1 --2- 172.21.15.43:0/3983168656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2830109b10 0x7f283019ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.775+0000 7f28378e7640 1 --2- 172.21.15.43:0/3983168656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2830104260 0x7f283019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.775+0000 7f28378e7640 1 -- 172.21.15.43:0/3983168656 >> 172.21.15.43:0/3983168656 conn(0x7f28300ff1d0 msgr2=0x7f28300ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:54:41.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.775+0000 7f28378e7640 1 -- 172.21.15.43:0/3983168656 shutdown_connections 2024-04-25T13:54:41.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.775+0000 7f28378e7640 1 -- 172.21.15.43:0/3983168656 wait complete. 2024-04-25T13:54:41.786 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-25T13:54:41.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.899+0000 7f2ec7225640 1 -- 172.21.15.43:0/3349166398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ec0108a20 msgr2=0x7f2ec01025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:41.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.899+0000 7f2ec7225640 1 --2- 172.21.15.43:0/3349166398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ec0108a20 0x7f2ec01025b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009ca0 tx=0x7f2eb002a8c0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.899+0000 7f2ec7225640 1 -- 172.21.15.43:0/3349166398 shutdown_connections 2024-04-25T13:54:41.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.899+0000 7f2ec7225640 1 --2- 172.21.15.43:0/3349166398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ec010d380 0x7f2ec010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.899+0000 7f2ec7225640 1 --2- 172.21.15.43:0/3349166398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ec0102af0 0x7f2ec0102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.899+0000 7f2ec7225640 1 --2- 172.21.15.43:0/3349166398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ec0108a20 0x7f2ec01025b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.899+0000 7f2ec7225640 1 -- 172.21.15.43:0/3349166398 >> 172.21.15.43:0/3349166398 conn(0x7f2ec0078110 msgr2=0x7f2ec0078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:54:41.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.899+0000 7f2ec7225640 1 -- 172.21.15.43:0/3349166398 shutdown_connections 2024-04-25T13:54:41.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.899+0000 7f2ec7225640 1 -- 172.21.15.43:0/3349166398 wait complete. 2024-04-25T13:54:41.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.900+0000 7f2ec7225640 1 Processor -- start 2024-04-25T13:54:41.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.900+0000 7f2ec7225640 1 -- start start 2024-04-25T13:54:41.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.900+0000 7f2ec7225640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ec0102af0 0x7f2ec01994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:41.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.900+0000 7f2ec7225640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ec0108a20 0x7f2ec0199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:41.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.900+0000 7f2ec7225640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ec010d380 0x7f2ec019dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:41.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.900+0000 7f2ec7225640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec0112ae0 con 0x7f2ec0108a20 2024-04-25T13:54:41.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.900+0000 7f2ec7225640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec0112960 con 0x7f2ec0102af0 2024-04-25T13:54:41.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.900+0000 7f2ec7225640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec0112c60 con 0x7f2ec010d380 2024-04-25T13:54:41.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.900+0000 7f2ebffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ec0108a20 0x7f2ec0199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:41.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.900+0000 7f2ebffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ec0108a20 0x7f2ec0199a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60064/0 (socket says 172.21.15.43:60064) 2024-04-25T13:54:41.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.900+0000 7f2ebffff640 1 -- 172.21.15.43:0/4201190198 learned_addr learned my addr 172.21.15.43:0/4201190198 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:54:41.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.900+0000 7f2ec4fc1640 1 --2- 172.21.15.43:0/4201190198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ec0102af0 0x7f2ec01994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:41.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.900+0000 7f2ec57c2640 1 --2- 172.21.15.43:0/4201190198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ec010d380 0x7f2ec019dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:41.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.901+0000 7f2ebffff640 1 -- 172.21.15.43:0/4201190198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ec010d380 msgr2=0x7f2ec019dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:41.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.901+0000 7f2ebffff640 1 --2- 172.21.15.43:0/4201190198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ec010d380 0x7f2ec019dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.901+0000 7f2ebffff640 1 -- 172.21.15.43:0/4201190198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ec0102af0 msgr2=0x7f2ec01994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:41.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.901+0000 7f2ebffff640 1 --2- 172.21.15.43:0/4201190198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ec0102af0 0x7f2ec01994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:41.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.901+0000 7f2ebffff640 1 -- 172.21.15.43:0/4201190198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec019e320 con 0x7f2ec0108a20 2024-04-25T13:54:41.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.901+0000 7f2ebffff640 1 --2- 172.21.15.43:0/4201190198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ec0108a20 0x7f2ec0199a20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400d740 tx=0x7f2eb400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:54:41.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.901+0000 7f2ebdffb640 1 -- 172.21.15.43:0/4201190198 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4017070 con 0x7f2ec0108a20 2024-04-25T13:54:41.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.901+0000 7f2ebdffb640 1 -- 172.21.15.43:0/4201190198 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2eb400de50 con 0x7f2ec0108a20 2024-04-25T13:54:41.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.901+0000 7f2ebdffb640 1 -- 172.21.15.43:0/4201190198 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4003bb0 con 0x7f2ec0108a20 2024-04-25T13:54:41.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.901+0000 7f2ec7225640 1 -- 172.21.15.43:0/4201190198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec019e610 con 0x7f2ec0108a20 2024-04-25T13:54:41.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.901+0000 7f2ec7225640 1 -- 172.21.15.43:0/4201190198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec01a5f90 con 0x7f2ec0108a20 2024-04-25T13:54:41.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.902+0000 7f2ec7225640 1 -- 172.21.15.43:0/4201190198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec0103cd0 con 0x7f2ec0108a20 2024-04-25T13:54:41.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.904+0000 7f2ebdffb640 1 -- 172.21.15.43:0/4201190198 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7f2eb4003d50 con 0x7f2ec0108a20 2024-04-25T13:54:41.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.904+0000 7f2ebdffb640 1 --2- 172.21.15.43:0/4201190198 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f2ea80afc60 0x7f2ea80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:54:41.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.905+0000 7f2ec4fc1640 1 --2- 172.21.15.43:0/4201190198 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f2ea80afc60 0x7f2ea80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:54:41.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.905+0000 7f2ebdffb640 1 -- 172.21.15.43:0/4201190198 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9467+0+0 (secure 0 0 0) 0x7f2eb40ded20 con 0x7f2ec0108a20 2024-04-25T13:54:41.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.905+0000 7f2ec4fc1640 1 --2- 172.21.15.43:0/4201190198 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f2ea80afc60 0x7f2ea80b2170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0006010 tx=0x7f2eb0031000 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:54:41.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:41.910+0000 7f2ebdffb640 1 -- 172.21.15.43:0/4201190198 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2eb40a6bc0 con 0x7f2ec0108a20 2024-04-25T13:54:42.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:42.150+0000 7f2ec7225640 1 -- 172.21.15.43:0/4201190198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f2ec006afa0 con 0x7f2ec0108a20 2024-04-25T13:54:42.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:42.159+0000 7f2ebdffb640 1 -- 172.21.15.43:0/4201190198 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+803657 (secure 0 0 0) 0x7f2eb40aaec0 con 0x7f2ec0108a20 2024-04-25T13:54:42.171 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:54:42.171 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T13:54:42.171 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 26, 2024-04-25T13:54:42.171 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.171 INFO:teuthology.orchestra.run.smithi043.stdout: "active_gid": 15486, 2024-04-25T13:54:42.171 INFO:teuthology.orchestra.run.smithi043.stdout: "active_name": "x", 2024-04-25T13:54:42.171 INFO:teuthology.orchestra.run.smithi043.stdout: "active_addrs": { 2024-04-25T13:54:42.171 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T13:54:42.171 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.171 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T13:54:42.172 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6800", 2024-04-25T13:54:42.172 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1964865924 2024-04-25T13:54:42.172 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.172 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.172 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T13:54:42.172 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6801", 2024-04-25T13:54:42.172 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1964865924 2024-04-25T13:54:42.172 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.172 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T13:54:42.172 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.172 INFO:teuthology.orchestra.run.smithi043.stdout: "active_addr": "172.21.15.43:6801/1964865924", 2024-04-25T13:54:42.172 INFO:teuthology.orchestra.run.smithi043.stdout: "active_change": "2024-04-25T13:44:35.638622+0000", 2024-04-25T13:54:42.172 INFO:teuthology.orchestra.run.smithi043.stdout: "active_mgr_features": 4540701547738038271, 2024-04-25T13:54:42.173 INFO:teuthology.orchestra.run.smithi043.stdout: "available": true, 2024-04-25T13:54:42.173 INFO:teuthology.orchestra.run.smithi043.stdout: "standbys": [ 2024-04-25T13:54:42.173 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.173 INFO:teuthology.orchestra.run.smithi043.stdout: "gid": 25153, 2024-04-25T13:54:42.173 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "z", 2024-04-25T13:54:42.173 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_features": 4540701547738038271, 2024-04-25T13:54:42.173 INFO:teuthology.orchestra.run.smithi043.stdout: "available_modules": [ 2024-04-25T13:54:42.173 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.173 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "alerts", 2024-04-25T13:54:42.173 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.173 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.173 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.173 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T13:54:42.173 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T13:54:42.174 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.174 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.174 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.174 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T13:54:42.174 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.174 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.174 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.174 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How frequently to reexamine health status", 2024-04-25T13:54:42.174 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.174 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.174 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.174 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.174 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.175 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.175 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.175 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.175 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.175 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.175 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.175 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.175 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.175 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.175 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.175 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.175 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.176 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.176 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.176 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.176 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.176 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.176 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.176 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.176 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.176 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.176 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.176 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.176 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.176 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.177 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.177 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.177 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.177 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.177 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.177 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.177 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.177 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.177 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.177 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.177 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.177 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.177 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.178 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.178 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.178 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.178 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.178 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.178 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.178 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.178 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.178 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.178 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.178 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.178 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.179 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.179 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.179 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.179 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.179 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.179 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.179 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.179 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.179 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.179 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.179 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.179 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.179 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.179 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.180 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.180 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.180 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.180 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.180 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.180 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_destination": { 2024-04-25T13:54:42.180 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_destination", 2024-04-25T13:54:42.180 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.180 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.180 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.180 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.180 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.180 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.181 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.181 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email address to send alerts to", 2024-04-25T13:54:42.181 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.181 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.181 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.181 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.181 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_from_name": { 2024-04-25T13:54:42.181 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_from_name", 2024-04-25T13:54:42.181 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.181 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.181 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.181 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "Ceph", 2024-04-25T13:54:42.181 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.181 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.182 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.182 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email From: name", 2024-04-25T13:54:42.182 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.182 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.182 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.182 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.182 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_host": { 2024-04-25T13:54:42.182 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_host", 2024-04-25T13:54:42.182 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.182 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.182 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.182 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.183 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.183 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.183 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.183 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP server", 2024-04-25T13:54:42.183 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.183 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.183 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.183 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.183 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_password": { 2024-04-25T13:54:42.183 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_password", 2024-04-25T13:54:42.183 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.183 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.184 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.184 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.184 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.184 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.184 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.184 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Password to authenticate with", 2024-04-25T13:54:42.184 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.184 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.184 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.184 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.184 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_port": { 2024-04-25T13:54:42.184 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_port", 2024-04-25T13:54:42.184 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.184 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.185 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.185 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "465", 2024-04-25T13:54:42.185 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.185 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.185 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.185 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP port", 2024-04-25T13:54:42.185 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.185 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.185 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.185 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.185 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_sender": { 2024-04-25T13:54:42.185 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_sender", 2024-04-25T13:54:42.185 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.186 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.186 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.186 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.186 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.186 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.186 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.186 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP envelope sender", 2024-04-25T13:54:42.186 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.186 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.186 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.186 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.186 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_ssl": { 2024-04-25T13:54:42.187 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_ssl", 2024-04-25T13:54:42.187 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.187 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.187 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.187 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.187 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.187 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.187 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.187 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-25T13:54:42.187 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.187 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.187 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.187 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.187 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_user": { 2024-04-25T13:54:42.187 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_user", 2024-04-25T13:54:42.188 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.188 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.188 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.188 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.188 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.188 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.188 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.188 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "User to authenticate as", 2024-04-25T13:54:42.188 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.188 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.188 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.188 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.188 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.188 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.188 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.189 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.189 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.189 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.189 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.189 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.189 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.189 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.189 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.189 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.189 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.189 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.189 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.189 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.189 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.190 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "balancer", 2024-04-25T13:54:42.190 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.190 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.190 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.190 INFO:teuthology.orchestra.run.smithi043.stdout: "active": { 2024-04-25T13:54:42.190 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "active", 2024-04-25T13:54:42.190 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.190 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.190 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.190 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.190 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.190 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.190 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.190 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically balance PGs across cluster", 2024-04-25T13:54:42.191 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.191 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.191 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.191 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.191 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_time": { 2024-04-25T13:54:42.191 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_time", 2024-04-25T13:54:42.191 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.191 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.191 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.191 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0000", 2024-04-25T13:54:42.191 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.191 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.191 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.191 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "beginning time of day to automatically balance", 2024-04-25T13:54:42.192 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T13:54:42.192 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.192 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.192 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.192 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_weekday": { 2024-04-25T13:54:42.192 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_weekday", 2024-04-25T13:54:42.192 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T13:54:42.192 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.192 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.192 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.192 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-04-25T13:54:42.192 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-04-25T13:54:42.192 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.192 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-25T13:54:42.193 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T13:54:42.193 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.193 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.193 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.193 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_max_iterations": { 2024-04-25T13:54:42.193 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_max_iterations", 2024-04-25T13:54:42.193 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T13:54:42.193 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.193 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.193 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "25", 2024-04-25T13:54:42.193 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T13:54:42.193 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "250", 2024-04-25T13:54:42.193 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.193 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-25T13:54:42.193 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.193 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.194 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.194 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.194 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_metrics": { 2024-04-25T13:54:42.194 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_metrics", 2024-04-25T13:54:42.194 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.194 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.194 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.194 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "pgs,objects,bytes", 2024-04-25T13:54:42.194 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.194 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.194 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.194 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-25T13:54:42.195 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-25T13:54:42.195 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.195 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.195 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.195 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_step": { 2024-04-25T13:54:42.195 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_step", 2024-04-25T13:54:42.195 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:42.195 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.195 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.195 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.5", 2024-04-25T13:54:42.195 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0.001", 2024-04-25T13:54:42.195 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "0.999", 2024-04-25T13:54:42.195 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.195 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "aggressiveness of optimization", 2024-04-25T13:54:42.195 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-25T13:54:42.196 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.196 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.196 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.196 INFO:teuthology.orchestra.run.smithi043.stdout: "end_time": { 2024-04-25T13:54:42.196 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_time", 2024-04-25T13:54:42.196 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.196 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.196 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.196 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2359", 2024-04-25T13:54:42.196 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.196 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.196 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.196 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ending time of day to automatically balance", 2024-04-25T13:54:42.196 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T13:54:42.196 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.197 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.197 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.197 INFO:teuthology.orchestra.run.smithi043.stdout: "end_weekday": { 2024-04-25T13:54:42.197 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_weekday", 2024-04-25T13:54:42.197 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T13:54:42.197 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.197 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.197 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.197 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-04-25T13:54:42.197 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-04-25T13:54:42.197 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.197 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-25T13:54:42.197 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T13:54:42.198 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.198 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.198 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.198 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.198 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.198 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.198 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.198 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.198 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.198 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.198 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.198 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.198 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.199 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.199 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.199 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.199 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.199 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.199 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.199 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.199 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.199 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.199 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.199 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.200 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.200 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.200 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.200 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.200 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.200 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.200 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.200 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.200 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.200 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.200 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.200 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.200 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.201 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.201 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.201 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.201 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.201 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.201 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.201 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.201 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.201 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.201 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.201 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.201 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.201 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.201 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.202 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.202 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.202 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.202 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.202 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.202 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.202 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.202 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.202 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.202 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.202 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.202 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.202 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.202 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.203 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.203 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.203 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.203 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.203 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.203 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.203 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.203 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.203 INFO:teuthology.orchestra.run.smithi043.stdout: "min_score": { 2024-04-25T13:54:42.203 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_score", 2024-04-25T13:54:42.203 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:42.203 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.203 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.203 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.203 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.204 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.204 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.204 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-25T13:54:42.204 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.204 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.204 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.204 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.204 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-04-25T13:54:42.204 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-04-25T13:54:42.204 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.204 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.204 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.204 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "upmap", 2024-04-25T13:54:42.205 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.205 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.205 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.205 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-compat", 2024-04-25T13:54:42.205 INFO:teuthology.orchestra.run.smithi043.stdout: "none", 2024-04-25T13:54:42.205 INFO:teuthology.orchestra.run.smithi043.stdout: "read", 2024-04-25T13:54:42.205 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap", 2024-04-25T13:54:42.205 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap-read" 2024-04-25T13:54:42.205 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.205 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Balancer mode", 2024-04-25T13:54:42.205 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.205 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.205 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.205 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.205 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_ids": { 2024-04-25T13:54:42.206 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_ids", 2024-04-25T13:54:42.206 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.206 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.206 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.206 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.206 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.206 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.206 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.206 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-25T13:54:42.206 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.206 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.206 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.206 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.206 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T13:54:42.206 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T13:54:42.207 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.207 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.207 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.207 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T13:54:42.207 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.207 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.207 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.207 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-25T13:54:42.207 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.207 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.207 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.207 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.207 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.207 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.207 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.207 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.208 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.208 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.208 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.208 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.208 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.208 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.208 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.208 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.208 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.208 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.208 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_deviation": { 2024-04-25T13:54:42.208 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_deviation", 2024-04-25T13:54:42.208 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.208 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.208 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.209 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T13:54:42.209 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T13:54:42.209 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.209 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.209 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-25T13:54:42.209 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-25T13:54:42.209 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.209 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.209 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.209 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_optimizations": { 2024-04-25T13:54:42.209 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_optimizations", 2024-04-25T13:54:42.209 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T13:54:42.209 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.209 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.210 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:42.210 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.210 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.210 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.210 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-25T13:54:42.210 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.210 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.210 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.210 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.210 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.210 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.210 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.210 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm", 2024-04-25T13:54:42.210 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.211 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.211 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.211 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_down_multiplier": { 2024-04-25T13:54:42.211 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_down_multiplier", 2024-04-25T13:54:42.211 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:42.211 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.211 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.211 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-04-25T13:54:42.211 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.211 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.211 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.211 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-25T13:54:42.211 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.211 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.211 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.212 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.212 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_refresh_rate": { 2024-04-25T13:54:42.212 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_refresh_rate", 2024-04-25T13:54:42.212 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.212 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.212 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.212 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "20", 2024-04-25T13:54:42.212 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.212 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.212 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.212 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-25T13:54:42.212 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.213 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.213 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.213 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.213 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_starting_port": { 2024-04-25T13:54:42.213 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_starting_port", 2024-04-25T13:54:42.213 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.213 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.213 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.213 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4721", 2024-04-25T13:54:42.214 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.214 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.214 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.214 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-25T13:54:42.214 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.214 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.214 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.214 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.214 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_ptrace": { 2024-04-25T13:54:42.215 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_ptrace", 2024-04-25T13:54:42.215 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.215 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.215 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.215 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.215 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.215 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.215 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.215 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-25T13:54:42.215 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-25T13:54:42.215 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.215 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.215 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.216 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_interval": { 2024-04-25T13:54:42.216 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_interval", 2024-04-25T13:54:42.216 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.216 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.216 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.216 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T13:54:42.216 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.216 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.216 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.216 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-25T13:54:42.216 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.216 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.216 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.217 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.217 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_memory_target_ratio": { 2024-04-25T13:54:42.217 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_memory_target_ratio", 2024-04-25T13:54:42.217 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:42.217 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.217 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.217 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.7", 2024-04-25T13:54:42.217 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.217 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.217 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.217 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-25T13:54:42.218 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.218 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.218 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.218 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.218 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm_log_destination": { 2024-04-25T13:54:42.218 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm_log_destination", 2024-04-25T13:54:42.218 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.218 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.218 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.218 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.218 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.219 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.219 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.219 INFO:teuthology.orchestra.run.smithi043.stdout: "file", 2024-04-25T13:54:42.219 INFO:teuthology.orchestra.run.smithi043.stdout: "file,syslog", 2024-04-25T13:54:42.219 INFO:teuthology.orchestra.run.smithi043.stdout: "syslog" 2024-04-25T13:54:42.219 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.219 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-25T13:54:42.219 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.219 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.219 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.219 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.219 INFO:teuthology.orchestra.run.smithi043.stdout: "cgroups_split": { 2024-04-25T13:54:42.219 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cgroups_split", 2024-04-25T13:54:42.220 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.220 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.220 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.220 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.220 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.220 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.220 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.220 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-25T13:54:42.220 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.220 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.220 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.220 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.220 INFO:teuthology.orchestra.run.smithi043.stdout: "config_checks_enabled": { 2024-04-25T13:54:42.221 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_checks_enabled", 2024-04-25T13:54:42.221 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.221 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.221 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.221 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.221 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.221 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.221 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.221 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-25T13:54:42.221 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.221 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.221 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.221 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.221 INFO:teuthology.orchestra.run.smithi043.stdout: "config_dashboard": { 2024-04-25T13:54:42.221 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_dashboard", 2024-04-25T13:54:42.222 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.222 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.222 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.222 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.222 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.222 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.222 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.222 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-25T13:54:42.222 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.222 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.222 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.222 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.222 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_alertmanager": { 2024-04-25T13:54:42.223 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_alertmanager", 2024-04-25T13:54:42.223 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.223 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.223 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.223 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-25T13:54:42.223 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.223 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.223 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.223 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T13:54:42.223 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.223 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.223 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.223 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.224 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_base": { 2024-04-25T13:54:42.224 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_base", 2024-04-25T13:54:42.224 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.224 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.224 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.224 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-25T13:54:42.224 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.224 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.224 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.224 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Container image name, without the tag", 2024-04-25T13:54:42.224 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.224 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.224 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.225 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.225 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_elasticsearch": { 2024-04-25T13:54:42.225 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_elasticsearch", 2024-04-25T13:54:42.225 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.225 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.225 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.225 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-25T13:54:42.225 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.225 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.225 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.225 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "elasticsearch container image", 2024-04-25T13:54:42.225 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.225 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.226 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.226 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.226 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_grafana": { 2024-04-25T13:54:42.226 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_grafana", 2024-04-25T13:54:42.226 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.226 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.226 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.226 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-25T13:54:42.226 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.226 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.226 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.226 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T13:54:42.226 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.227 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.227 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.227 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.227 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_haproxy": { 2024-04-25T13:54:42.227 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_haproxy", 2024-04-25T13:54:42.227 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.227 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.227 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.227 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-25T13:54:42.227 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.227 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.227 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.227 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "HAproxy container image", 2024-04-25T13:54:42.228 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.228 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.228 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.228 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.228 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_agent": { 2024-04-25T13:54:42.228 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_agent", 2024-04-25T13:54:42.228 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.228 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.228 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.228 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-25T13:54:42.228 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.228 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.228 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.229 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger agent container image", 2024-04-25T13:54:42.229 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.229 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.229 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.229 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.229 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_collector": { 2024-04-25T13:54:42.229 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_collector", 2024-04-25T13:54:42.229 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.229 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.229 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.229 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-25T13:54:42.229 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.229 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.230 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.230 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger collector container image", 2024-04-25T13:54:42.230 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.230 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.230 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.230 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.230 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_query": { 2024-04-25T13:54:42.230 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_query", 2024-04-25T13:54:42.230 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.230 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.230 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.230 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-25T13:54:42.230 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.231 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.231 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.231 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger query container image", 2024-04-25T13:54:42.231 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.231 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.231 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.231 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.231 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_keepalived": { 2024-04-25T13:54:42.231 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_keepalived", 2024-04-25T13:54:42.231 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.231 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.231 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.231 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-25T13:54:42.232 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.232 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.232 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.232 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Keepalived container image", 2024-04-25T13:54:42.232 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.232 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.232 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.232 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.232 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_loki": { 2024-04-25T13:54:42.232 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_loki", 2024-04-25T13:54:42.232 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.232 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.232 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.232 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-25T13:54:42.232 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.233 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.233 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.233 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Loki container image", 2024-04-25T13:54:42.233 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.233 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.233 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.233 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.233 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_node_exporter": { 2024-04-25T13:54:42.233 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_node_exporter", 2024-04-25T13:54:42.233 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.233 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.233 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.233 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-25T13:54:42.233 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.234 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.234 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.234 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T13:54:42.234 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.234 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.234 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.234 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.234 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_nvmeof": { 2024-04-25T13:54:42.234 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_nvmeof", 2024-04-25T13:54:42.234 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.234 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.234 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.235 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-25T13:54:42.235 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.235 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.235 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.235 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Nvme-of container image", 2024-04-25T13:54:42.235 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.235 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.235 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.235 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.235 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_prometheus": { 2024-04-25T13:54:42.235 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_prometheus", 2024-04-25T13:54:42.235 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.236 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.236 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.236 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-25T13:54:42.236 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.236 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.236 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.236 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T13:54:42.236 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.236 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.236 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.236 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.236 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_promtail": { 2024-04-25T13:54:42.236 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_promtail", 2024-04-25T13:54:42.236 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.237 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.237 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.237 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-25T13:54:42.237 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.237 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.237 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.237 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Promtail container image", 2024-04-25T13:54:42.237 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.237 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.237 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.237 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.237 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_samba": { 2024-04-25T13:54:42.237 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_samba", 2024-04-25T13:54:42.237 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.238 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.238 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.238 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-25T13:54:42.238 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.238 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.238 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.238 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Samba/SMB container image", 2024-04-25T13:54:42.238 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.238 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.238 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.238 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.238 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_snmp_gateway": { 2024-04-25T13:54:42.238 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_snmp_gateway", 2024-04-25T13:54:42.239 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.239 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.239 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.239 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-25T13:54:42.239 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.239 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.239 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.239 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SNMP Gateway container image", 2024-04-25T13:54:42.239 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.239 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.239 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.239 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.239 INFO:teuthology.orchestra.run.smithi043.stdout: "container_init": { 2024-04-25T13:54:42.239 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_init", 2024-04-25T13:54:42.239 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.240 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.240 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.240 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.240 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.240 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.240 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.240 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Run podman/docker with `--init`", 2024-04-25T13:54:42.240 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.240 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.240 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.240 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.240 INFO:teuthology.orchestra.run.smithi043.stdout: "daemon_cache_timeout": { 2024-04-25T13:54:42.240 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "daemon_cache_timeout", 2024-04-25T13:54:42.240 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.240 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.241 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.241 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T13:54:42.241 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.241 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.241 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.241 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-25T13:54:42.241 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.241 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.241 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.241 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.241 INFO:teuthology.orchestra.run.smithi043.stdout: "default_cephadm_command_timeout": { 2024-04-25T13:54:42.241 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_cephadm_command_timeout", 2024-04-25T13:54:42.241 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.241 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.241 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.242 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "900", 2024-04-25T13:54:42.242 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.242 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.242 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.242 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-25T13:54:42.242 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.242 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.242 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.242 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.242 INFO:teuthology.orchestra.run.smithi043.stdout: "default_registry": { 2024-04-25T13:54:42.242 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_registry", 2024-04-25T13:54:42.242 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.242 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.243 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.243 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io", 2024-04-25T13:54:42.243 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.243 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.243 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.243 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-25T13:54:42.243 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.243 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.243 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.243 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.243 INFO:teuthology.orchestra.run.smithi043.stdout: "device_cache_timeout": { 2024-04-25T13:54:42.243 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_cache_timeout", 2024-04-25T13:54:42.243 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.243 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.244 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.244 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1800", 2024-04-25T13:54:42.244 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.244 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.244 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.244 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache device inventory", 2024-04-25T13:54:42.244 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.244 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.244 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.244 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.244 INFO:teuthology.orchestra.run.smithi043.stdout: "device_enhanced_scan": { 2024-04-25T13:54:42.244 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_enhanced_scan", 2024-04-25T13:54:42.244 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.244 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.244 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.245 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.245 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.245 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.245 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.245 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-25T13:54:42.245 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.245 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.245 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.245 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.245 INFO:teuthology.orchestra.run.smithi043.stdout: "facts_cache_timeout": { 2024-04-25T13:54:42.245 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "facts_cache_timeout", 2024-04-25T13:54:42.245 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.245 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.245 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.246 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T13:54:42.246 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.246 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.246 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.246 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache host facts data", 2024-04-25T13:54:42.246 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.246 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.246 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.246 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.246 INFO:teuthology.orchestra.run.smithi043.stdout: "grafana_dashboards_path": { 2024-04-25T13:54:42.246 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "grafana_dashboards_path", 2024-04-25T13:54:42.246 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.246 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.246 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.246 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-25T13:54:42.247 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.247 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.247 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.247 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-25T13:54:42.247 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.247 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.247 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.247 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.247 INFO:teuthology.orchestra.run.smithi043.stdout: "host_check_interval": { 2024-04-25T13:54:42.247 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "host_check_interval", 2024-04-25T13:54:42.247 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.247 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.247 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.248 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T13:54:42.248 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.248 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.248 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.248 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to perform a host check", 2024-04-25T13:54:42.248 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.248 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.248 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.248 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.248 INFO:teuthology.orchestra.run.smithi043.stdout: "hw_monitoring": { 2024-04-25T13:54:42.248 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hw_monitoring", 2024-04-25T13:54:42.248 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.248 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.249 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.249 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.249 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.249 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.249 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.249 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-25T13:54:42.249 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.249 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.249 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.249 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.249 INFO:teuthology.orchestra.run.smithi043.stdout: "inventory_list_all": { 2024-04-25T13:54:42.249 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "inventory_list_all", 2024-04-25T13:54:42.249 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.250 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.250 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.250 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.250 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.250 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.250 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.250 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-25T13:54:42.250 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.250 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.250 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.250 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.250 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.250 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.251 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.251 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.251 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.251 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.251 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.251 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.251 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.251 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.251 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.251 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.251 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.251 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.252 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.252 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.252 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.252 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.252 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.252 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.252 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.252 INFO:teuthology.orchestra.run.smithi043.stdout: "log_refresh_metadata": { 2024-04-25T13:54:42.252 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_refresh_metadata", 2024-04-25T13:54:42.252 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.252 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.252 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.252 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.253 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.253 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.253 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.253 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-25T13:54:42.253 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.253 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.253 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.253 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.253 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.253 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.253 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.253 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.253 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.254 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.254 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.254 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.254 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.254 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-25T13:54:42.254 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.254 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.254 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.254 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.254 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.254 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.254 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.254 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.255 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.255 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.255 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.255 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.255 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.255 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.255 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.255 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.255 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.255 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.255 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.255 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.255 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.255 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.256 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.256 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.256 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.256 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.256 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.256 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.256 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.256 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.256 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.256 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.256 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.256 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.256 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.256 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.256 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.257 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.257 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.257 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-25T13:54:42.257 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-25T13:54:42.257 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.257 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.257 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.257 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.257 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.257 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.257 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.257 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-25T13:54:42.257 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.257 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.257 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.258 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.258 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-25T13:54:42.258 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-25T13:54:42.258 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.258 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.258 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.258 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "*", 2024-04-25T13:54:42.258 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.258 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.258 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.258 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-25T13:54:42.258 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.258 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.258 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.258 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.259 INFO:teuthology.orchestra.run.smithi043.stdout: "max_count_per_host": { 2024-04-25T13:54:42.259 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_count_per_host", 2024-04-25T13:54:42.259 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.259 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.259 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.259 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:42.259 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.259 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.259 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.259 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of daemons per service per host", 2024-04-25T13:54:42.259 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.259 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.259 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.259 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.259 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd_draining_count": { 2024-04-25T13:54:42.259 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_osd_draining_count", 2024-04-25T13:54:42.260 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.260 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.260 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.260 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:42.260 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.260 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.260 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.260 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-25T13:54:42.260 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.260 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.260 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.260 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.260 INFO:teuthology.orchestra.run.smithi043.stdout: "migration_current": { 2024-04-25T13:54:42.260 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "migration_current", 2024-04-25T13:54:42.260 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.261 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.261 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.261 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.261 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.261 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.261 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.261 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "internal - do not modify", 2024-04-25T13:54:42.261 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.261 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.261 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.261 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.261 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-04-25T13:54:42.261 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-04-25T13:54:42.261 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.262 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.262 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.262 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "root", 2024-04-25T13:54:42.262 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.262 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.262 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.262 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm-package", 2024-04-25T13:54:42.262 INFO:teuthology.orchestra.run.smithi043.stdout: "root" 2024-04-25T13:54:42.262 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.262 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "mode for remote execution of cephadm", 2024-04-25T13:54:42.262 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.262 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.262 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.262 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.263 INFO:teuthology.orchestra.run.smithi043.stdout: "oob_default_addr": { 2024-04-25T13:54:42.263 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "oob_default_addr", 2024-04-25T13:54:42.263 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.263 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.263 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.263 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "169.254.1.1", 2024-04-25T13:54:42.263 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.263 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.263 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.263 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-25T13:54:42.263 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.263 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.263 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.263 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.264 INFO:teuthology.orchestra.run.smithi043.stdout: "prometheus_alerts_path": { 2024-04-25T13:54:42.264 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus_alerts_path", 2024-04-25T13:54:42.264 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.264 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.264 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.264 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-25T13:54:42.264 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.264 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.264 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.264 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-25T13:54:42.264 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.264 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.264 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.265 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.265 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_insecure": { 2024-04-25T13:54:42.265 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_insecure", 2024-04-25T13:54:42.265 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.265 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.265 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.265 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.265 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.265 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.265 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.265 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-25T13:54:42.265 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.265 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.266 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.266 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.266 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_password": { 2024-04-25T13:54:42.266 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_password", 2024-04-25T13:54:42.266 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.266 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.266 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.266 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.266 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.266 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.266 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.266 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-25T13:54:42.266 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.266 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.266 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.267 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.267 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_url": { 2024-04-25T13:54:42.267 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_url", 2024-04-25T13:54:42.267 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.267 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.267 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.267 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.267 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.267 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.267 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.267 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-25T13:54:42.267 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.267 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.267 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.268 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.268 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_username": { 2024-04-25T13:54:42.268 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_username", 2024-04-25T13:54:42.268 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.268 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.268 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.268 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.268 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.268 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.268 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.268 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-25T13:54:42.268 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.268 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.268 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.268 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.269 INFO:teuthology.orchestra.run.smithi043.stdout: "secure_monitoring_stack": { 2024-04-25T13:54:42.269 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "secure_monitoring_stack", 2024-04-25T13:54:42.269 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.269 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.269 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.269 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.269 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.269 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.269 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.269 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-25T13:54:42.269 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.269 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.269 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.269 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.269 INFO:teuthology.orchestra.run.smithi043.stdout: "service_discovery_port": { 2024-04-25T13:54:42.269 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "service_discovery_port", 2024-04-25T13:54:42.270 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.270 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.270 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.270 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8765", 2024-04-25T13:54:42.270 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.270 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.270 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.270 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "cephadm service discovery port", 2024-04-25T13:54:42.270 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.270 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.270 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.270 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.270 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.270 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.271 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.271 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.271 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.271 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.271 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.271 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.271 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.271 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.271 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.271 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.271 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.271 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.271 INFO:teuthology.orchestra.run.smithi043.stdout: "ssh_config_file": { 2024-04-25T13:54:42.271 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssh_config_file", 2024-04-25T13:54:42.271 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.272 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.272 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.272 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.272 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.272 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.272 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.272 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-25T13:54:42.272 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.272 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.272 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.272 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.272 INFO:teuthology.orchestra.run.smithi043.stdout: "use_agent": { 2024-04-25T13:54:42.272 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_agent", 2024-04-25T13:54:42.272 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.272 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.273 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.273 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.273 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.273 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.273 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.273 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-25T13:54:42.273 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.273 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.273 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.273 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.273 INFO:teuthology.orchestra.run.smithi043.stdout: "use_repo_digest": { 2024-04-25T13:54:42.273 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_repo_digest", 2024-04-25T13:54:42.273 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.273 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.273 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.273 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.274 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.274 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.274 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.274 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-25T13:54:42.274 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.274 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.274 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.274 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.274 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_failed_host_check": { 2024-04-25T13:54:42.274 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_failed_host_check", 2024-04-25T13:54:42.274 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.274 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.274 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.274 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.274 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.275 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.275 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.275 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if the host check fails", 2024-04-25T13:54:42.275 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.275 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.275 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.275 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.275 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_daemons": { 2024-04-25T13:54:42.275 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_daemons", 2024-04-25T13:54:42.275 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.275 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.275 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.275 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.276 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.276 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.276 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.276 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-25T13:54:42.276 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.276 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.276 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.276 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.276 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_hosts": { 2024-04-25T13:54:42.276 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_hosts", 2024-04-25T13:54:42.276 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.276 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.276 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.276 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.276 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.276 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.277 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.277 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-25T13:54:42.277 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.277 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.277 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.277 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.277 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.277 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.277 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.277 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crash", 2024-04-25T13:54:42.277 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.277 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.278 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.278 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.278 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.278 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.278 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.278 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.278 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.278 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.278 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.278 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.278 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.279 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.279 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.279 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.279 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.279 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.279 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.279 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.279 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.279 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.279 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.279 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.279 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.280 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.280 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.280 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.280 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.280 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.280 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.280 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.280 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.280 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.280 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.280 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.280 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.280 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.281 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.281 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.281 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.281 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.281 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.281 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.281 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.281 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.281 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.281 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.281 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.281 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.281 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.282 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.282 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.282 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.282 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.282 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.282 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.282 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.282 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.282 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.282 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.282 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.282 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.282 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.283 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.283 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.283 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.283 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.283 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.283 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.283 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.283 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.283 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.283 INFO:teuthology.orchestra.run.smithi043.stdout: "retain_interval": { 2024-04-25T13:54:42.283 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retain_interval", 2024-04-25T13:54:42.283 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.283 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.283 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.284 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "31536000", 2024-04-25T13:54:42.284 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.284 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.284 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.284 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-25T13:54:42.284 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.284 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.284 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.284 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.284 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.284 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.284 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.284 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.285 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.285 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.285 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.285 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.285 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.285 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.285 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.285 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.285 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.285 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.285 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_recent_interval": { 2024-04-25T13:54:42.285 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_recent_interval", 2024-04-25T13:54:42.285 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.285 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.286 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.286 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1209600", 2024-04-25T13:54:42.286 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.286 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.286 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.286 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-25T13:54:42.286 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.286 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.286 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.286 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.286 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.286 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.286 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.286 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dashboard", 2024-04-25T13:54:42.287 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.287 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.287 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.287 INFO:teuthology.orchestra.run.smithi043.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-25T13:54:42.287 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-25T13:54:42.287 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.287 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.287 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.287 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:42.287 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.287 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.287 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.288 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.288 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.288 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.288 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.288 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.288 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_HOST": { 2024-04-25T13:54:42.288 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-25T13:54:42.288 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.288 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.288 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.288 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.288 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.288 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.288 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.288 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.289 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.289 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.289 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.289 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.289 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-25T13:54:42.289 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-25T13:54:42.289 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.289 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.289 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.289 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.289 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.289 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.289 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.289 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.290 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.290 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.290 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.290 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.290 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_ENABLED": { 2024-04-25T13:54:42.290 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_ENABLED", 2024-04-25T13:54:42.290 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.290 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.290 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.290 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.290 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.290 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.290 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.291 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.291 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.291 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.291 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.291 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.291 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-25T13:54:42.291 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-25T13:54:42.291 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.291 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.291 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.291 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.291 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.291 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.291 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.291 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.292 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.292 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.292 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.292 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.292 INFO:teuthology.orchestra.run.smithi043.stdout: "ENABLE_BROWSABLE_API": { 2024-04-25T13:54:42.292 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-25T13:54:42.292 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.292 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.292 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.292 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.292 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.292 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.292 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.292 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.292 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.293 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.293 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.293 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.293 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-25T13:54:42.293 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-25T13:54:42.293 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.293 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.293 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.293 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.293 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.293 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.293 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.293 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.293 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.293 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.293 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.294 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.294 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-25T13:54:42.294 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-25T13:54:42.294 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.294 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.294 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.294 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.294 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.294 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.294 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.294 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.294 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.295 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.295 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.295 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.295 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-25T13:54:42.295 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-25T13:54:42.295 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.295 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.295 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.295 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.295 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.295 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.295 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.295 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.296 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.296 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.296 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.296 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.296 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-25T13:54:42.296 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-25T13:54:42.296 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.296 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.296 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.296 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.296 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.296 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.296 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.296 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.297 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.297 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.297 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.297 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.297 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-25T13:54:42.297 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-25T13:54:42.297 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.297 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.297 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.297 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.297 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.297 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.297 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.297 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.297 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.297 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.298 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.298 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.298 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-25T13:54:42.298 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-25T13:54:42.298 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.298 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.298 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.298 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.298 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.298 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.298 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.298 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.298 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.298 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.299 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.299 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.299 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-25T13:54:42.299 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-25T13:54:42.299 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.299 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.299 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.299 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.299 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.299 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.299 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.299 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.299 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.299 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.299 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.299 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.300 INFO:teuthology.orchestra.run.smithi043.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-25T13:54:42.300 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-25T13:54:42.300 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.300 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.300 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.300 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.300 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.300 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.300 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.300 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.300 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.300 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.300 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.300 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.300 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_PASSWORD": { 2024-04-25T13:54:42.300 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-25T13:54:42.301 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.301 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.301 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.301 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T13:54:42.301 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.301 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.301 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.301 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.301 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.301 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.301 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.301 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.301 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-25T13:54:42.301 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-25T13:54:42.302 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.302 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.302 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.302 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.302 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.302 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.302 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.302 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.302 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.302 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.302 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.302 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.302 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_URL": { 2024-04-25T13:54:42.302 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_URL", 2024-04-25T13:54:42.303 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.303 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.303 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.303 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.303 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.303 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.303 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.303 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.303 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.303 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.303 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.303 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.303 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_USERNAME": { 2024-04-25T13:54:42.303 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-25T13:54:42.303 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.303 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.304 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.304 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T13:54:42.304 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.304 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.304 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.304 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.304 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.304 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.304 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.304 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.304 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-25T13:54:42.304 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-25T13:54:42.304 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.304 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.305 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.305 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.305 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.305 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.305 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.305 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.305 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.305 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.305 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.305 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.305 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-25T13:54:42.305 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-25T13:54:42.305 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.305 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.305 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.306 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.306 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.306 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.306 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.306 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.306 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.306 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.306 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.306 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.306 INFO:teuthology.orchestra.run.smithi043.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-25T13:54:42.306 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-25T13:54:42.306 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.307 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.307 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.307 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.307 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.307 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.307 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.307 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.307 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.307 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.307 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.307 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.307 INFO:teuthology.orchestra.run.smithi043.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-25T13:54:42.307 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-25T13:54:42.307 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.307 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.307 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.308 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.308 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.308 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.308 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.308 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.308 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.308 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.308 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.308 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.308 INFO:teuthology.orchestra.run.smithi043.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-25T13:54:42.308 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-25T13:54:42.308 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.308 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.308 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.308 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "[]", 2024-04-25T13:54:42.309 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.309 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.309 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.309 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.309 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.309 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.309 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.309 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.309 INFO:teuthology.orchestra.run.smithi043.stdout: "MULTICLUSTER_CONFIG": { 2024-04-25T13:54:42.309 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-25T13:54:42.309 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.309 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.309 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.309 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "{}", 2024-04-25T13:54:42.309 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.309 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.310 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.310 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.310 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.310 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.310 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.310 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.310 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_HOST": { 2024-04-25T13:54:42.310 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-25T13:54:42.310 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.310 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.310 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.310 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.310 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.310 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.311 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.311 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.311 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.311 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.311 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.311 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.311 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-25T13:54:42.311 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-25T13:54:42.311 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.311 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.311 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.311 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.311 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.311 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.311 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.312 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.312 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.312 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.312 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.312 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.312 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-25T13:54:42.312 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-25T13:54:42.312 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.312 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.312 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.312 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.312 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.312 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.312 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.312 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.312 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.313 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.313 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.313 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.313 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-25T13:54:42.313 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-25T13:54:42.313 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.313 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.313 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.313 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.313 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.313 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.313 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.313 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.314 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.314 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.314 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.314 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.314 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-25T13:54:42.314 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-25T13:54:42.314 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.314 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.314 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.314 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.315 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.315 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.315 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.315 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.315 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.315 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.315 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.315 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.315 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-25T13:54:42.315 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-25T13:54:42.315 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.315 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.315 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.315 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.315 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-25T13:54:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-25T13:54:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.317 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.317 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.317 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.317 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.317 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.317 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-25T13:54:42.317 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-25T13:54:42.317 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.317 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.317 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.317 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.317 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.317 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.317 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.317 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.318 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.318 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.318 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.318 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.318 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-25T13:54:42.318 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-25T13:54:42.318 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.318 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.318 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.318 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.318 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.318 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.318 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.319 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.319 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.319 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.319 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.319 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.319 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_ENABLED": { 2024-04-25T13:54:42.319 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-25T13:54:42.319 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.319 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.319 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.319 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.319 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.319 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.319 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.319 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.319 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.320 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.320 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.320 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.320 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-25T13:54:42.320 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-25T13:54:42.320 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.320 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.320 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.320 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-25T13:54:42.320 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.320 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.320 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.320 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.320 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.320 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.321 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.321 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.321 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-25T13:54:42.321 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-25T13:54:42.321 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.321 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.321 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.321 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:42.321 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.321 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.321 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.321 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.321 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.321 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.322 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.322 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.322 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-25T13:54:42.322 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-25T13:54:42.322 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.322 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.322 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.322 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8", 2024-04-25T13:54:42.322 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.322 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.322 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.322 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.322 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.323 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.323 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.323 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.323 INFO:teuthology.orchestra.run.smithi043.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-25T13:54:42.323 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-25T13:54:42.323 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.323 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.323 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.323 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "45", 2024-04-25T13:54:42.323 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.323 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.323 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.323 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.323 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.324 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.324 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.324 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.324 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ACCESS_KEY": { 2024-04-25T13:54:42.324 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-25T13:54:42.324 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.324 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.324 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.324 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.324 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.324 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.324 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.324 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.324 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.324 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.325 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.325 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.325 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-25T13:54:42.325 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-25T13:54:42.325 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.325 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.325 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.325 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T13:54:42.325 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.325 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.325 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.325 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.325 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.325 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.326 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.326 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.326 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SECRET_KEY": { 2024-04-25T13:54:42.326 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-25T13:54:42.326 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.326 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.326 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.326 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.326 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.326 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.326 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.326 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.326 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.326 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.327 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.327 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.327 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SSL_VERIFY": { 2024-04-25T13:54:42.327 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-25T13:54:42.327 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.327 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.327 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.327 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.327 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.327 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.327 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.327 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.327 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.328 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.328 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.328 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.328 INFO:teuthology.orchestra.run.smithi043.stdout: "UNSAFE_TLS_v1_2": { 2024-04-25T13:54:42.328 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-25T13:54:42.328 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.328 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.328 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.328 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.328 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.328 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.328 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.328 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.328 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.328 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.328 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.329 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.329 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-25T13:54:42.329 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-25T13:54:42.329 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.329 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.329 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.329 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.329 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.329 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.329 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.329 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.329 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.329 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.329 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.329 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.330 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-25T13:54:42.330 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-25T13:54:42.330 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.330 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.330 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.330 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:42.330 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.330 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.330 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.330 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.330 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.330 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.331 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.331 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.331 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-25T13:54:42.331 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-25T13:54:42.331 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.331 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.331 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.331 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T13:54:42.331 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.331 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.331 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.331 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.331 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.331 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.331 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.331 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.332 INFO:teuthology.orchestra.run.smithi043.stdout: "cross_origin_url": { 2024-04-25T13:54:42.332 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cross_origin_url", 2024-04-25T13:54:42.332 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.332 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.332 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.332 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.332 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.332 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.332 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.332 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.332 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.332 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.332 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.332 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.332 INFO:teuthology.orchestra.run.smithi043.stdout: "crt_file": { 2024-04-25T13:54:42.333 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crt_file", 2024-04-25T13:54:42.333 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.333 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.333 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.333 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.333 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.333 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.333 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.333 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.333 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.333 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.333 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.333 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.333 INFO:teuthology.orchestra.run.smithi043.stdout: "debug": { 2024-04-25T13:54:42.333 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "debug", 2024-04-25T13:54:42.334 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.334 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.334 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.334 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.334 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.334 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.334 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.334 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable/disable debug options", 2024-04-25T13:54:42.334 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.334 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.334 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.334 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.334 INFO:teuthology.orchestra.run.smithi043.stdout: "jwt_token_ttl": { 2024-04-25T13:54:42.335 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "jwt_token_ttl", 2024-04-25T13:54:42.335 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.335 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.335 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.335 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "28800", 2024-04-25T13:54:42.335 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.335 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.335 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.335 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.335 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.335 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.335 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.335 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.335 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-04-25T13:54:42.335 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-04-25T13:54:42.336 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.336 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.336 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.336 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.336 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.336 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.336 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.336 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.336 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.336 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.336 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.336 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.336 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.336 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.337 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.337 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.337 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.337 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.337 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.337 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.337 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.337 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.337 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.337 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.337 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.337 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.337 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.338 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.338 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.338 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.338 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.338 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.338 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.338 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.338 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.338 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.338 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.338 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.338 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.338 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.341 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.341 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.341 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.341 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.341 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.341 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.341 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.341 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.341 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.341 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.341 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.341 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.341 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.341 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.341 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.342 INFO:teuthology.orchestra.run.smithi043.stdout: "motd": { 2024-04-25T13:54:42.342 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "motd", 2024-04-25T13:54:42.342 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.342 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.342 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.342 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.342 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.342 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.342 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.342 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "The message of the day", 2024-04-25T13:54:42.342 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.342 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.342 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.342 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.343 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect_resolve_ip_addr": { 2024-04-25T13:54:42.343 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "redirect_resolve_ip_addr", 2024-04-25T13:54:42.343 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.343 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.343 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.343 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.343 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.343 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.343 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.343 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.343 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.343 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.343 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.343 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T13:54:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T13:54:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-04-25T13:54:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T13:54:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T13:54:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8080", 2024-04-25T13:54:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.346 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.346 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.346 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.346 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.346 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.346 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.346 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.346 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.346 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.346 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.346 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.346 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.347 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.347 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.347 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.347 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-04-25T13:54:42.347 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-04-25T13:54:42.347 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.347 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.347 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.347 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.347 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.347 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.347 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.347 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.347 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.347 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.347 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.348 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.348 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl_server_port": { 2024-04-25T13:54:42.348 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl_server_port", 2024-04-25T13:54:42.348 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.348 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.348 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.348 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8443", 2024-04-25T13:54:42.348 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.348 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.348 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.348 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.348 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.348 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.348 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.349 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.349 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-04-25T13:54:42.349 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-04-25T13:54:42.349 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.349 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.349 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.349 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "redirect", 2024-04-25T13:54:42.349 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.349 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.349 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.349 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.349 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect" 2024-04-25T13:54:42.349 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.350 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.350 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.350 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.350 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.350 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.350 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-04-25T13:54:42.350 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-04-25T13:54:42.350 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.350 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.350 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.350 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-04-25T13:54:42.350 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-04-25T13:54:42.350 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-04-25T13:54:42.350 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.350 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.351 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.351 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.351 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.351 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.351 INFO:teuthology.orchestra.run.smithi043.stdout: "url_prefix": { 2024-04-25T13:54:42.351 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url_prefix", 2024-04-25T13:54:42.351 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.351 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.351 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.351 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.351 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.351 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.351 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.351 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.351 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.352 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.352 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.352 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.352 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.352 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.352 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.352 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "devicehealth", 2024-04-25T13:54:42.352 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.352 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.352 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.352 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_monitoring": { 2024-04-25T13:54:42.352 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_monitoring", 2024-04-25T13:54:42.352 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.352 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.352 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.352 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.353 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.353 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.353 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.353 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "monitor device health metrics", 2024-04-25T13:54:42.353 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.353 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.353 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.353 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.353 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.353 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.353 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.353 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.353 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.353 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.354 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.354 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.354 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.354 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.354 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.354 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.354 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.354 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.354 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.354 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.354 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.354 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.354 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.355 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.355 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.355 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.355 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.355 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.355 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.355 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.355 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.355 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.355 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.355 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.355 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.355 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.355 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.355 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.356 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.356 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.356 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.356 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.356 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.356 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.356 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.356 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.356 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.356 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.356 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.356 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.356 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.356 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.356 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.357 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.357 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.357 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.357 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.357 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.357 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.357 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.357 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.357 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.357 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.357 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.357 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.357 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.357 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.358 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.358 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.358 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.358 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.358 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.358 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.358 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.358 INFO:teuthology.orchestra.run.smithi043.stdout: "mark_out_threshold": { 2024-04-25T13:54:42.358 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mark_out_threshold", 2024-04-25T13:54:42.358 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.358 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.358 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.358 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2419200", 2024-04-25T13:54:42.359 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.359 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.359 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.359 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-25T13:54:42.359 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.359 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.359 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.359 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.359 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": { 2024-04-25T13:54:42.359 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_name", 2024-04-25T13:54:42.359 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.359 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.359 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.359 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "device_health_metrics", 2024-04-25T13:54:42.359 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.360 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.360 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.360 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-25T13:54:42.360 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.360 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.360 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.360 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.360 INFO:teuthology.orchestra.run.smithi043.stdout: "retention_period": { 2024-04-25T13:54:42.360 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retention_period", 2024-04-25T13:54:42.360 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.360 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.360 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.360 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15552000", 2024-04-25T13:54:42.360 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.360 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.360 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.361 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain device health metrics", 2024-04-25T13:54:42.361 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.361 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.361 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.361 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.361 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_frequency": { 2024-04-25T13:54:42.361 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_frequency", 2024-04-25T13:54:42.361 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.361 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.361 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.361 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-04-25T13:54:42.361 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.361 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.361 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.361 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-25T13:54:42.361 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.362 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.362 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.362 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.362 INFO:teuthology.orchestra.run.smithi043.stdout: "self_heal": { 2024-04-25T13:54:42.362 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "self_heal", 2024-04-25T13:54:42.362 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.362 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.362 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.362 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.362 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.362 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.362 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.362 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-25T13:54:42.362 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.362 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T13:54:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T13:54:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T13:54:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and check device health", 2024-04-25T13:54:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.364 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.364 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.364 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.364 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.364 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.364 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.364 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.364 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.364 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.364 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.364 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.364 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.364 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.364 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.365 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_threshold": { 2024-04-25T13:54:42.365 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_threshold", 2024-04-25T13:54:42.365 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.365 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.365 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.365 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7257600", 2024-04-25T13:54:42.365 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.365 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.365 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.365 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-25T13:54:42.365 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.365 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.365 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.365 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.365 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.366 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.366 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.366 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "diskprediction_local", 2024-04-25T13:54:42.366 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.366 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.366 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.366 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.366 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.366 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.366 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.366 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.366 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.366 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.366 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.367 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.367 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.367 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.367 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.367 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.367 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.367 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.367 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.367 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.367 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.367 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.367 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.367 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.367 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.367 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.367 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.368 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.368 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.368 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.368 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.368 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.368 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.368 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.368 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.368 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.368 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.368 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.368 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.368 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.368 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.368 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.369 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.369 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.369 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.369 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.369 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.369 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.369 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.369 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.369 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.369 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.369 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.369 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.369 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.369 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.369 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.369 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.370 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.370 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.370 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.370 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.370 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.370 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.370 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.370 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.370 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.370 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.370 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.370 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.370 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.371 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.371 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.371 INFO:teuthology.orchestra.run.smithi043.stdout: "predict_interval": { 2024-04-25T13:54:42.371 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predict_interval", 2024-04-25T13:54:42.371 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.371 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.371 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.371 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-04-25T13:54:42.371 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.371 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.371 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.371 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.371 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.371 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.371 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.372 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.372 INFO:teuthology.orchestra.run.smithi043.stdout: "predictor_model": { 2024-04-25T13:54:42.372 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predictor_model", 2024-04-25T13:54:42.372 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.372 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.372 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.372 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "prophetstor", 2024-04-25T13:54:42.372 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.372 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.372 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.372 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.372 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.372 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.372 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.372 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.372 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T13:54:42.373 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T13:54:42.373 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.373 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.373 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.373 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T13:54:42.373 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.373 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.373 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.373 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.373 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.373 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.373 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.373 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.373 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.373 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.374 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.374 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.374 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.374 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.374 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.374 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.374 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.374 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.374 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.374 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.374 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.375 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.375 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.375 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.375 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.375 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "influx", 2024-04-25T13:54:42.375 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": false, 2024-04-25T13:54:42.375 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "influxdb python module not found", 2024-04-25T13:54:42.375 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.375 INFO:teuthology.orchestra.run.smithi043.stdout: "batch_size": { 2024-04-25T13:54:42.375 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "batch_size", 2024-04-25T13:54:42.375 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.375 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.375 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.376 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5000", 2024-04-25T13:54:42.376 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.376 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.376 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.376 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-25T13:54:42.376 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.376 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.376 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.376 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.376 INFO:teuthology.orchestra.run.smithi043.stdout: "database": { 2024-04-25T13:54:42.376 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "database", 2024-04-25T13:54:42.376 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.376 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.377 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.377 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "ceph", 2024-04-25T13:54:42.377 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.377 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.377 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.377 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-25T13:54:42.377 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.377 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.377 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.377 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.377 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": { 2024-04-25T13:54:42.377 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hostname", 2024-04-25T13:54:42.378 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.378 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.378 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.378 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.378 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.378 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.378 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.378 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server hostname", 2024-04-25T13:54:42.378 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.378 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.378 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.378 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.378 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T13:54:42.379 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T13:54:42.379 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.379 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.379 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.379 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "30", 2024-04-25T13:54:42.379 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "5", 2024-04-25T13:54:42.379 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.379 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.379 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-25T13:54:42.379 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.379 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.379 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.379 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.379 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.379 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.380 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.380 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.380 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.380 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.380 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.380 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.380 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.380 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.380 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.380 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.380 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.380 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.380 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.380 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.381 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.381 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.381 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.381 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.381 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.381 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.381 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.381 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.381 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.381 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.381 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.381 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.381 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.382 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.382 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.382 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.382 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.382 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.382 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.382 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.382 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.382 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.382 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.382 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.382 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.383 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.383 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.383 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.383 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.383 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.383 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.383 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.383 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.383 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.383 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.383 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.383 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.384 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.384 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.384 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.384 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.384 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.384 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.384 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.384 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.384 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.384 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.384 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.384 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.384 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.385 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.385 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.385 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.385 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.385 INFO:teuthology.orchestra.run.smithi043.stdout: "password": { 2024-04-25T13:54:42.385 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "password", 2024-04-25T13:54:42.385 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.385 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.385 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.385 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.385 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.385 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.385 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.385 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "password of InfluxDB server user", 2024-04-25T13:54:42.386 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.386 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.386 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.386 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.386 INFO:teuthology.orchestra.run.smithi043.stdout: "port": { 2024-04-25T13:54:42.386 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "port", 2024-04-25T13:54:42.386 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.386 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.386 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.386 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8086", 2024-04-25T13:54:42.386 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.386 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.386 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.387 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server port", 2024-04-25T13:54:42.387 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.387 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.387 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.387 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.387 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.387 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.387 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.387 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.387 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.387 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.387 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.387 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.387 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.388 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.388 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.388 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.388 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.388 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.388 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-04-25T13:54:42.388 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-04-25T13:54:42.388 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.388 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.388 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.388 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "false", 2024-04-25T13:54:42.388 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.388 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.389 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.389 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T13:54:42.389 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.389 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.389 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.389 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.389 INFO:teuthology.orchestra.run.smithi043.stdout: "threads": { 2024-04-25T13:54:42.389 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threads", 2024-04-25T13:54:42.389 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.389 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.389 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.389 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T13:54:42.389 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T13:54:42.389 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "32", 2024-04-25T13:54:42.390 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.390 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-25T13:54:42.390 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.390 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.390 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.390 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.390 INFO:teuthology.orchestra.run.smithi043.stdout: "username": { 2024-04-25T13:54:42.390 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "username", 2024-04-25T13:54:42.390 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.390 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.390 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.390 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.390 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.391 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.391 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.391 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "username of InfluxDB server user", 2024-04-25T13:54:42.391 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.391 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.391 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.391 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.391 INFO:teuthology.orchestra.run.smithi043.stdout: "verify_ssl": { 2024-04-25T13:54:42.391 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "verify_ssl", 2024-04-25T13:54:42.391 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.391 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.391 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.392 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "true", 2024-04-25T13:54:42.392 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.392 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.392 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.392 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T13:54:42.392 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.392 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.392 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.392 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.392 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.392 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.392 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.392 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "insights", 2024-04-25T13:54:42.392 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.392 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.393 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.393 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.393 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.393 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.393 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.393 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.393 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.393 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.393 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.393 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.393 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.394 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.394 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.394 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.394 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.394 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.394 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.394 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.394 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.394 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.394 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.394 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.394 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.394 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.394 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.395 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.395 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.395 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.395 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.395 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.395 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.395 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.395 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.395 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.395 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.395 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.395 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.395 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.395 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.396 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.396 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.396 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.396 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.396 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.396 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.396 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.396 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.396 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.396 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.396 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.396 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.396 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.396 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.396 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.396 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.397 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.397 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.397 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.397 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.397 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.397 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.397 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.397 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.397 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.397 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.397 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.397 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.397 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.397 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.397 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.398 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.398 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.398 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.398 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.398 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.398 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.398 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.398 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.398 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.398 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.398 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.398 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.398 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.398 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.398 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.399 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.399 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.399 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.399 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "iostat", 2024-04-25T13:54:42.399 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.399 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.399 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.399 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.399 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.399 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.399 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.399 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.399 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.399 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.399 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.399 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.400 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.400 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.400 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.400 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.400 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.400 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.400 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.400 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.400 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.400 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.400 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.400 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.401 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.401 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.401 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.401 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.401 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.401 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.401 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.401 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.401 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.401 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.401 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.401 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.401 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.401 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.401 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.402 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.402 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.402 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.402 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.402 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.402 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.402 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.402 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.402 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.402 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.402 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.402 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.402 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.402 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.403 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.403 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.403 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.403 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.403 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.403 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.403 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.403 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.403 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.403 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.403 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.403 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.403 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.403 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.403 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.404 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.404 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.404 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.404 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.404 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.404 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.404 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.404 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.404 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.404 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.404 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.404 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.404 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.405 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.405 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.405 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.405 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.405 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.405 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.405 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.405 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.405 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.405 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "k8sevents", 2024-04-25T13:54:42.405 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.405 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.405 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.405 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_event_retention_days": { 2024-04-25T13:54:42.405 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ceph_event_retention_days", 2024-04-25T13:54:42.406 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.406 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.406 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.406 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7", 2024-04-25T13:54:42.406 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.406 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.406 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.406 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-25T13:54:42.406 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.406 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.406 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.406 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.407 INFO:teuthology.orchestra.run.smithi043.stdout: "config_check_secs": { 2024-04-25T13:54:42.407 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_check_secs", 2024-04-25T13:54:42.407 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.407 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.407 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.407 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:42.407 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "10", 2024-04-25T13:54:42.407 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.407 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.407 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-25T13:54:42.407 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.407 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.407 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.407 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.408 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.408 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.408 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.408 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.408 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.408 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.408 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.408 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.408 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.408 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.408 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.408 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.408 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.408 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.408 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.409 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.409 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.409 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.409 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.409 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.409 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.409 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.409 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.409 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.409 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.409 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.409 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.409 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.409 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.410 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.410 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.410 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.410 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.410 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.410 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.410 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.410 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.410 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.410 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.410 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.410 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.410 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.410 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.411 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.411 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.411 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.411 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.411 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.411 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.411 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.411 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.411 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.411 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.411 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.411 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.411 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.412 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.412 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.412 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.412 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.412 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.412 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.412 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.412 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.412 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.412 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.412 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.412 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.412 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.412 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.413 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.413 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.413 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.413 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.413 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.413 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.413 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.413 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.413 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.413 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.413 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.413 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.413 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.414 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.414 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.414 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.414 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.414 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "localpool", 2024-04-25T13:54:42.414 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.414 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.414 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.414 INFO:teuthology.orchestra.run.smithi043.stdout: "failure_domain": { 2024-04-25T13:54:42.414 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "failure_domain", 2024-04-25T13:54:42.415 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.415 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.415 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.415 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "host", 2024-04-25T13:54:42.415 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.415 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.415 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.415 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "failure domain for any created local pool", 2024-04-25T13:54:42.415 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-25T13:54:42.415 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.415 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.415 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.415 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.415 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.416 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.416 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.416 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.416 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.416 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.416 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.416 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.416 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.416 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.416 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.416 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.416 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.416 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.416 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.416 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.417 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.417 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.417 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.417 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.417 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.417 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.417 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.417 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.417 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.417 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.417 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.418 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.418 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.418 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.418 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.418 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.418 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.418 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.418 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.418 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.418 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.418 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.418 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.418 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.418 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.419 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.419 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.419 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.419 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.419 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.419 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.419 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.419 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.419 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.419 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.419 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.419 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.419 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.419 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.420 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.420 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.420 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.420 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.420 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.420 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.420 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.420 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.420 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.420 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.420 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.420 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.420 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.420 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.420 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": { 2024-04-25T13:54:42.421 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_size", 2024-04-25T13:54:42.421 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.421 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.421 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.421 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.421 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.421 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.421 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.421 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default min_size for any created local pool", 2024-04-25T13:54:42.421 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-25T13:54:42.421 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.421 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.421 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.421 INFO:teuthology.orchestra.run.smithi043.stdout: "num_rep": { 2024-04-25T13:54:42.422 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "num_rep", 2024-04-25T13:54:42.422 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.422 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.422 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.422 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3", 2024-04-25T13:54:42.422 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.422 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.422 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.422 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default replica count for any created local pool", 2024-04-25T13:54:42.422 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.422 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.422 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.423 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.423 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": { 2024-04-25T13:54:42.423 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_num", 2024-04-25T13:54:42.423 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.423 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.423 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.423 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "128", 2024-04-25T13:54:42.423 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.423 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.423 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.423 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default pg_num for any created local pool", 2024-04-25T13:54:42.423 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.423 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.424 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.424 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.424 INFO:teuthology.orchestra.run.smithi043.stdout: "prefix": { 2024-04-25T13:54:42.424 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prefix", 2024-04-25T13:54:42.424 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.424 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.424 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.424 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.424 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.424 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.424 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.424 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name prefix for any created local pool", 2024-04-25T13:54:42.424 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.425 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.425 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.425 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.425 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.425 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.425 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.425 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.425 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.425 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.425 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.425 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.425 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.425 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.426 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.426 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.426 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.426 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.426 INFO:teuthology.orchestra.run.smithi043.stdout: "subtree": { 2024-04-25T13:54:42.426 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "subtree", 2024-04-25T13:54:42.426 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.426 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.426 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.426 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "rack", 2024-04-25T13:54:42.426 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.426 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.426 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.427 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-25T13:54:42.427 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-25T13:54:42.427 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.427 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.427 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.427 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.427 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.427 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.427 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mds_autoscaler", 2024-04-25T13:54:42.427 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.427 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.427 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.427 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.428 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.428 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.428 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.428 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.428 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.428 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.428 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.428 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.428 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.428 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.428 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.428 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.429 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.429 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.429 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.429 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.429 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.429 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.429 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.429 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.429 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.429 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.429 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.429 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.429 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.429 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.429 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.430 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.430 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.430 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.430 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.430 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.430 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.430 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.430 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.430 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.430 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.430 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.430 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.430 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.431 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.431 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.431 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.431 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.431 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.431 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.431 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.431 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.431 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.431 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.431 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.431 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.431 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.431 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.432 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.432 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.432 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.432 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.432 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.432 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.432 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.432 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.432 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.432 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.432 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.432 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.432 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.432 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.432 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.433 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.433 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.433 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.433 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.433 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.433 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.433 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.433 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.433 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.433 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.433 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.433 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.433 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.433 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.433 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.434 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.434 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.434 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirroring", 2024-04-25T13:54:42.434 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.434 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.434 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.434 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.434 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.434 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.434 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.434 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.434 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.434 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.434 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.435 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.435 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.435 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.435 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.435 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.435 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.435 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.435 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.435 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.435 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.435 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.435 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.435 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.436 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.436 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.436 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.436 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.436 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.436 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.436 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.436 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.436 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.436 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.436 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.436 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.436 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.436 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.437 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.437 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.437 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.437 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.437 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.437 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.437 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.437 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.437 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.437 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.437 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.437 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.437 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.437 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.437 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.438 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.438 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.438 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.438 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.438 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.438 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.438 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.438 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.438 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.438 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.438 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.438 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.438 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.438 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.439 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.439 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.439 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.439 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.439 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.439 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.439 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.439 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.439 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.439 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.439 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.439 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.439 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.439 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.439 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.439 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.440 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.440 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.440 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.440 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.440 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.440 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.440 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.440 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "nfs", 2024-04-25T13:54:42.440 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.440 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.440 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.440 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.440 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.440 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.441 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.441 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.441 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.441 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.441 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.441 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.441 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.441 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.441 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.441 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.441 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.441 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.441 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.442 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.442 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.442 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.442 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.442 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.442 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.442 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.442 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.442 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.442 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.442 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.442 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.442 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.442 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.443 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.443 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.443 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.443 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.443 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.443 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.443 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.443 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.443 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.443 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.443 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.443 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.443 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.443 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.444 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.444 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.444 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.444 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.444 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.444 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.444 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.444 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.444 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.444 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.444 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.444 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.445 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.445 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.445 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.445 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.445 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.445 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.445 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.445 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.445 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.445 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.445 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.445 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.445 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.445 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.446 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.446 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.446 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.446 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.446 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.446 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.446 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.446 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.446 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.446 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.446 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.446 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.446 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.446 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.447 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.447 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.447 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.447 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-04-25T13:54:42.447 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.447 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.447 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.447 INFO:teuthology.orchestra.run.smithi043.stdout: "fail_fs": { 2024-04-25T13:54:42.447 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "fail_fs", 2024-04-25T13:54:42.447 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.447 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.447 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.447 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.448 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.448 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.448 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.448 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-25T13:54:42.448 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.448 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.448 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.448 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.448 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.448 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.448 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.448 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.448 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.448 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.449 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.449 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.449 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.449 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.449 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.449 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.449 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.449 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.449 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.449 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.449 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.449 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.449 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.449 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.449 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.450 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.450 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.450 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.450 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.450 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.450 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.450 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.450 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.450 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.450 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.450 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.450 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.450 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.451 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.451 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.451 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.451 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.451 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.451 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.451 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.451 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.451 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.451 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.451 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.451 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.451 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.451 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.452 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.452 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.452 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.452 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.452 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.452 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.452 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.452 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.452 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.452 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.452 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.452 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.453 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.453 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.453 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.453 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.453 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.453 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.453 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.453 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.453 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.453 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.453 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator": { 2024-04-25T13:54:42.453 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-04-25T13:54:42.453 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.453 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.454 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.454 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.454 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.454 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.454 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.454 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm", 2024-04-25T13:54:42.454 INFO:teuthology.orchestra.run.smithi043.stdout: "rook", 2024-04-25T13:54:42.454 INFO:teuthology.orchestra.run.smithi043.stdout: "test_orchestrator" 2024-04-25T13:54:42.454 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.454 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Orchestrator backend", 2024-04-25T13:54:42.454 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.454 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.455 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.455 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.455 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.455 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.455 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.455 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.455 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.455 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.455 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.455 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.455 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.455 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.455 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.456 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.456 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.456 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.456 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.456 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.456 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.456 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_perf_query", 2024-04-25T13:54:42.456 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.456 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.456 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.456 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.456 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.456 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.456 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.457 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.457 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.457 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.457 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.457 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.457 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.457 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.457 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.457 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.457 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.457 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.457 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.457 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.458 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.458 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.458 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.458 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.458 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.458 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.458 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.458 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.458 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.458 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.458 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.458 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.459 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.459 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.459 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.459 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.459 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.459 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.459 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.459 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.459 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.459 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.459 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.459 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.459 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.460 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.460 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.460 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.460 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.460 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.460 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.460 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.460 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.460 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.460 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.460 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.460 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.460 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.460 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.461 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.461 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.461 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.461 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.461 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.461 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.461 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.461 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.461 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.461 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.461 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.461 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.461 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.462 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.462 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.462 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.462 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.462 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.462 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.462 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.462 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.462 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.462 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.462 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.462 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.463 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.463 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.463 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.463 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.463 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.463 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.463 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_support", 2024-04-25T13:54:42.463 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.463 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.463 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.463 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.463 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.463 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.463 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.464 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.464 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.464 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.464 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.464 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.464 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.464 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.464 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.464 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.464 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.464 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.464 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.464 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.464 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.465 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.465 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.465 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.465 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.465 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.465 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.465 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.465 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.465 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.465 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.465 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.465 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.466 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.466 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.466 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.466 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.466 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.466 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.466 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.466 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.466 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.466 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.466 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.466 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.466 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.467 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.467 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.467 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.467 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.467 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.467 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.467 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.467 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.467 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.467 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.467 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.467 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.467 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.468 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.468 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.468 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.468 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.468 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.468 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.468 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.468 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.468 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.468 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.468 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.468 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.469 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.469 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.469 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.469 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.469 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.469 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.469 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.469 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.469 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.469 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.469 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.469 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.469 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.469 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.470 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.470 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.470 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.470 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.470 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.470 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_autoscaler", 2024-04-25T13:54:42.470 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.470 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.470 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.470 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.470 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.470 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.470 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.470 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.471 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.471 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.471 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.471 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.471 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.471 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.471 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.471 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.471 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.471 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.471 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.471 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.471 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.471 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.471 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.472 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.472 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.472 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.472 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.472 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.472 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.472 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.472 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.472 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.472 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.472 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.472 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.472 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.472 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.472 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.472 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.473 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.473 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.473 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.473 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.473 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.473 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.473 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.473 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.473 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.473 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.473 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.473 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.473 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.473 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.474 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.474 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.474 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.474 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.474 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.474 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.474 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.474 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.474 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.474 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.474 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.474 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.474 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.475 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.475 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.475 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.475 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.475 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.475 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.475 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.475 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T13:54:42.475 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T13:54:42.475 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.475 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.475 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.475 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T13:54:42.475 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.476 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.476 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.476 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.476 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.476 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.476 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.476 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.476 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.476 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.476 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.476 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.476 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.476 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.476 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.476 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.477 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.477 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.477 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.477 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.477 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.477 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.477 INFO:teuthology.orchestra.run.smithi043.stdout: "threshold": { 2024-04-25T13:54:42.477 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threshold", 2024-04-25T13:54:42.477 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:42.477 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.477 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.477 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-04-25T13:54:42.477 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1.0", 2024-04-25T13:54:42.477 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.477 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.477 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "scaling threshold", 2024-04-25T13:54:42.478 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-25T13:54:42.478 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.478 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.478 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.478 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.478 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.478 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.478 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "progress", 2024-04-25T13:54:42.478 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.478 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.478 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.478 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_pg_recovery_event": { 2024-04-25T13:54:42.479 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_pg_recovery_event", 2024-04-25T13:54:42.479 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.479 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.479 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.479 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.479 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.479 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.479 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.479 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-25T13:54:42.479 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.479 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.479 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.479 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.479 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-04-25T13:54:42.480 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-04-25T13:54:42.480 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.480 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.480 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.480 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.480 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.480 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.480 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.480 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.480 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.480 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.480 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.480 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.480 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.480 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.480 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.481 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.481 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.481 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.481 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.481 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.481 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.481 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.481 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.481 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.481 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.481 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.481 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.481 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.481 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.481 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.482 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.482 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.482 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.482 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.482 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.482 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.482 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.482 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.482 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.482 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.482 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.482 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.482 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.484 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.484 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.484 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.484 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.484 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.484 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.484 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.484 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.484 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.484 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.484 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.484 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.484 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.485 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.485 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.485 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.485 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.485 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.485 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.485 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.485 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.485 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.485 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.485 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.485 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.485 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.485 INFO:teuthology.orchestra.run.smithi043.stdout: "max_completed_events": { 2024-04-25T13:54:42.486 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_completed_events", 2024-04-25T13:54:42.486 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.486 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.486 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.486 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "50", 2024-04-25T13:54:42.486 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.486 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.486 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.486 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "number of past completed events to remember", 2024-04-25T13:54:42.486 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.486 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.486 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.486 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.486 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T13:54:42.487 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T13:54:42.487 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.487 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.487 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.487 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T13:54:42.487 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.487 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.487 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.487 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long the module is going to sleep", 2024-04-25T13:54:42.487 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.487 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.487 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.487 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.487 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.488 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.488 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.488 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.488 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.488 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.488 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.488 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.488 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.488 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.488 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.488 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.488 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.488 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.488 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.488 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.489 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.489 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus", 2024-04-25T13:54:42.489 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.489 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.489 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.489 INFO:teuthology.orchestra.run.smithi043.stdout: "cache": { 2024-04-25T13:54:42.489 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cache", 2024-04-25T13:54:42.489 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.489 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.489 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.489 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.489 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.489 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.489 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.490 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.490 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.490 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.490 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.490 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.490 INFO:teuthology.orchestra.run.smithi043.stdout: "exclude_perf_counters": { 2024-04-25T13:54:42.490 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "exclude_perf_counters", 2024-04-25T13:54:42.490 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.490 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.490 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.490 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.490 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.490 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.490 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.491 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-25T13:54:42.491 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-25T13:54:42.491 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.491 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.491 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.491 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.491 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.491 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.491 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.491 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.491 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.491 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.491 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.491 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.492 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.492 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.492 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.492 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.492 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.492 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.492 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.492 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.492 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.493 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.493 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.493 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.493 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.493 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.493 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.493 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.493 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.493 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.493 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.493 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.493 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.493 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.493 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.494 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.494 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.494 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.494 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.494 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.494 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.494 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.494 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.494 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.494 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.494 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.494 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.494 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.495 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.495 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.495 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.495 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.495 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.495 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.495 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.495 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.495 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.495 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.495 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.495 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.495 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.496 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.496 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.496 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.496 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.496 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.496 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.496 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.496 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.496 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.496 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.496 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.496 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.496 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools": { 2024-04-25T13:54:42.497 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools", 2024-04-25T13:54:42.497 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.497 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.497 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.497 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.497 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.497 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.497 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.497 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.497 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.497 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.497 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.497 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.497 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-25T13:54:42.498 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-25T13:54:42.498 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.498 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.498 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.498 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "300", 2024-04-25T13:54:42.498 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.498 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.498 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.498 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.498 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.498 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.498 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.498 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.499 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_interval": { 2024-04-25T13:54:42.499 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_interval", 2024-04-25T13:54:42.499 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:42.499 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.499 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.499 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15.0", 2024-04-25T13:54:42.499 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.499 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.499 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.499 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.499 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.499 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.500 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.500 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.500 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T13:54:42.500 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T13:54:42.500 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.500 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.500 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.500 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-04-25T13:54:42.500 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.500 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.500 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.500 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-25T13:54:42.500 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.500 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.501 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.501 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.501 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T13:54:42.501 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T13:54:42.501 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.501 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.501 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.501 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "9283", 2024-04-25T13:54:42.501 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.501 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.501 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.501 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-25T13:54:42.501 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.501 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.501 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.502 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.502 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.502 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.502 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.502 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.502 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.502 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.502 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.502 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.502 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.502 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.502 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.502 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.503 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.503 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.503 INFO:teuthology.orchestra.run.smithi043.stdout: "stale_cache_strategy": { 2024-04-25T13:54:42.503 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stale_cache_strategy", 2024-04-25T13:54:42.503 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.503 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.503 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.503 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "log", 2024-04-25T13:54:42.503 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.503 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.503 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.503 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.503 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.503 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.504 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.504 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.504 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-04-25T13:54:42.504 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-04-25T13:54:42.504 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.504 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.504 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.504 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "default", 2024-04-25T13:54:42.504 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.504 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.504 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.504 INFO:teuthology.orchestra.run.smithi043.stdout: "default", 2024-04-25T13:54:42.504 INFO:teuthology.orchestra.run.smithi043.stdout: "error" 2024-04-25T13:54:42.504 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.505 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.505 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.505 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.505 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.505 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.505 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-04-25T13:54:42.505 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-04-25T13:54:42.505 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.505 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.505 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.505 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-04-25T13:54:42.505 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-04-25T13:54:42.505 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-04-25T13:54:42.505 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.506 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.506 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.506 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.506 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.506 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.506 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.506 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.506 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.506 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_support", 2024-04-25T13:54:42.506 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.506 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.506 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.506 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.507 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.507 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.507 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.507 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.507 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.507 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.507 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.507 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.507 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.507 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.507 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.507 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.507 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.508 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.508 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.508 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.508 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.508 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.508 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.508 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.508 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.508 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.508 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.508 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.508 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.508 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.509 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.509 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.509 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.509 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.509 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.509 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.509 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.509 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.509 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.509 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.509 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.509 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.509 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.509 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.510 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.510 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.510 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.510 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.510 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.510 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.510 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.510 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.510 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.510 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.510 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.510 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.511 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.511 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.511 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.511 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.511 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.511 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.511 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.511 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.511 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.511 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.511 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.511 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.511 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.512 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.512 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.512 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.512 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.512 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_snap_create": { 2024-04-25T13:54:42.512 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_snap_create", 2024-04-25T13:54:42.512 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.512 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.512 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.512 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:42.512 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.512 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.512 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.512 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.513 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.513 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.513 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.513 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.513 INFO:teuthology.orchestra.run.smithi043.stdout: "mirror_snapshot_schedule": { 2024-04-25T13:54:42.513 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirror_snapshot_schedule", 2024-04-25T13:54:42.513 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.513 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.513 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.513 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.513 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.513 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.513 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.513 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.514 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.514 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.514 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.514 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.514 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.514 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.514 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.514 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.514 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.514 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.515 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.515 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.515 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.515 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.515 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.515 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.515 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.515 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.515 INFO:teuthology.orchestra.run.smithi043.stdout: "trash_purge_schedule": { 2024-04-25T13:54:42.515 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "trash_purge_schedule", 2024-04-25T13:54:42.515 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.516 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.516 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.516 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.516 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.516 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.516 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.516 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.516 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.516 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.516 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.516 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.517 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.517 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.517 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.517 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "restful", 2024-04-25T13:54:42.517 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.517 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.517 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.517 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_auth": { 2024-04-25T13:54:42.517 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_auth", 2024-04-25T13:54:42.517 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.517 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.517 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.517 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.518 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.518 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.518 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.518 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.518 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.518 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.518 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.518 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.518 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-04-25T13:54:42.518 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-04-25T13:54:42.518 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.518 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.518 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.519 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.519 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.519 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.519 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.519 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.519 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.519 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.519 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.519 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.519 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.519 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.519 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.519 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.520 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.520 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.520 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.520 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.520 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.520 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.520 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.520 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.520 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.520 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.520 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.520 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.520 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.521 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.521 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.521 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.521 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.521 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.521 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.521 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.521 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.521 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.521 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.521 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.521 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.522 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.522 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.522 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.522 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.522 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.522 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.522 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.522 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.522 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.522 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.522 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.522 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.523 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.523 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.523 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.523 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.523 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.523 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.523 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.523 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.523 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.523 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.523 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.524 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.524 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.524 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.524 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.524 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.524 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.524 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.524 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.524 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.524 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.524 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.524 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.525 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.525 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.525 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.525 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.525 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.525 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.525 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T13:54:42.525 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T13:54:42.525 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.525 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.525 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.526 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.526 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.526 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.526 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.526 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.526 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.526 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.526 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.526 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.526 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T13:54:42.526 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T13:54:42.526 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.526 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.527 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.527 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.527 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.527 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.527 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.527 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.527 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.527 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.527 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.527 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.527 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.527 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.528 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.528 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.528 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.528 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.528 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.528 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.528 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.528 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.528 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.528 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.528 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.528 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.528 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.528 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.529 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.529 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rgw", 2024-04-25T13:54:42.529 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.529 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.529 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.529 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.529 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.529 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.529 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.529 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.529 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.529 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.530 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.530 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.530 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.530 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.530 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.530 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.530 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.530 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.530 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.530 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.530 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.531 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.531 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.531 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.531 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.531 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.531 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.531 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.531 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.531 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.531 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.531 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.531 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.531 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.531 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.532 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.532 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.532 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.532 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.532 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.532 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.532 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.532 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.532 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.532 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.532 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.532 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.532 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.532 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.533 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.533 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.533 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.533 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.533 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.533 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.533 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.533 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.533 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.533 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.533 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.533 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.533 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.534 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.534 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.534 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.534 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.534 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.534 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.534 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.534 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.534 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.534 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.534 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.534 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.534 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.534 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.535 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.535 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.535 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.535 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.535 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.535 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.535 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.535 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.535 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.535 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.535 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.535 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.535 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.536 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.536 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rook", 2024-04-25T13:54:42.536 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.536 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.536 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.536 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.536 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.536 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.536 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.536 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.536 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.536 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.536 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.536 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.536 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.536 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.537 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.537 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.537 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.537 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.537 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.537 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.537 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.537 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.537 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.537 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.537 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.537 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.537 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.537 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.538 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.538 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.538 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.538 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.538 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.538 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.538 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.538 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.538 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.538 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.538 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.538 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.539 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.539 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.539 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.539 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.539 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.539 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.539 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.539 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.539 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.539 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.539 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.539 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.539 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.540 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.540 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.540 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.540 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.540 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.540 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.540 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.540 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.540 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.540 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.540 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.540 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.540 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.540 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: "storage_class": { 2024-04-25T13:54:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "storage_class", 2024-04-25T13:54:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "local", 2024-04-25T13:54:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-25T13:54:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "selftest", 2024-04-25T13:54:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: "roption1": { 2024-04-25T13:54:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption1", 2024-04-25T13:54:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: "roption2": { 2024-04-25T13:54:42.550 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption2", 2024-04-25T13:54:42.550 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.550 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.550 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.550 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "xyz", 2024-04-25T13:54:42.550 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.550 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.550 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.550 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.550 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.550 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.551 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.551 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.551 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption1": { 2024-04-25T13:54:42.551 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption1", 2024-04-25T13:54:42.551 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.551 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.551 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.551 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.551 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.551 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.551 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.551 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.551 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption2": { 2024-04-25T13:54:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption2", 2024-04-25T13:54:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption3": { 2024-04-25T13:54:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption3", 2024-04-25T13:54:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption4": { 2024-04-25T13:54:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption4", 2024-04-25T13:54:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption5": { 2024-04-25T13:54:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption5", 2024-04-25T13:54:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption6": { 2024-04-25T13:54:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption6", 2024-04-25T13:54:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption7": { 2024-04-25T13:54:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption7", 2024-04-25T13:54:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T13:54:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "42", 2024-04-25T13:54:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: "testkey": { 2024-04-25T13:54:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testkey", 2024-04-25T13:54:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: "testlkey": { 2024-04-25T13:54:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testlkey", 2024-04-25T13:54:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.561 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.561 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.561 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.561 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.561 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.561 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.561 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.561 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.561 INFO:teuthology.orchestra.run.smithi043.stdout: "testnewline": { 2024-04-25T13:54:42.561 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testnewline", 2024-04-25T13:54:42.561 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.561 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.561 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.562 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.562 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.562 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.562 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.562 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.562 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.562 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.562 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.562 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.562 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.562 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.562 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-04-25T13:54:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_m_granularity": { 2024-04-25T13:54:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_m_granularity", 2024-04-25T13:54:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow minute scheduled snapshots", 2024-04-25T13:54:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: "dump_on_update": { 2024-04-25T13:54:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dump_on_update", 2024-04-25T13:54:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "dump database to debug log on update", 2024-04-25T13:54:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.566 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.566 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.566 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.566 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.566 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.566 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.566 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.566 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.566 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.566 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.566 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.566 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.570 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.570 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.570 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.570 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.570 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.570 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.570 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.570 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.570 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.570 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.570 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.570 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stats", 2024-04-25T13:54:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.572 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.572 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.572 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.572 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.572 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.572 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.572 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.572 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.572 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.572 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.572 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.572 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.572 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.573 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.573 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.573 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.573 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.573 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.573 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.573 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.573 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.573 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.573 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.573 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.573 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.573 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.574 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.574 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.574 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.574 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.574 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.574 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.574 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.574 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.574 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.574 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.574 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.574 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.577 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.577 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.577 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.577 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.577 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.577 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.577 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.577 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.577 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.577 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.577 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.577 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.577 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.577 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.577 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.578 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.578 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.578 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.578 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.578 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.578 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.578 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.578 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "status", 2024-04-25T13:54:42.578 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.578 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.578 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.578 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.578 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.578 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.579 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.579 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.579 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.579 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.579 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.579 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.579 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.579 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.579 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.579 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.579 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.579 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.579 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.580 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.580 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.580 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.580 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.580 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.580 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.580 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.580 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.580 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.580 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.580 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.580 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.581 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.581 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.581 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.581 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.581 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.581 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.581 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.581 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.581 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.581 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.581 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.581 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.581 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.581 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.581 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.582 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.582 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.582 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.582 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.582 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.582 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.582 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.582 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.582 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.582 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.582 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.582 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.583 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.583 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.583 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.583 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.583 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.583 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.583 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.583 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.583 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.583 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.583 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.583 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.583 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.583 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.584 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.584 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.584 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.584 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.584 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.584 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.584 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.584 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.584 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.584 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.584 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.584 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.584 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.585 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.585 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.585 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.585 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.585 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.585 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telegraf", 2024-04-25T13:54:42.585 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.585 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.585 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.585 INFO:teuthology.orchestra.run.smithi043.stdout: "address": { 2024-04-25T13:54:42.585 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "address", 2024-04-25T13:54:42.585 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.585 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.585 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.585 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-25T13:54:42.586 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.586 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.586 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.586 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.586 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.586 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.586 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.586 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.586 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T13:54:42.586 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T13:54:42.586 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.586 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.587 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.587 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15", 2024-04-25T13:54:42.587 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.587 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.587 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.587 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.587 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.587 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.587 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.587 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.587 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.587 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.588 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.588 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.588 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.588 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.588 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.588 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.588 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.588 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.588 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.588 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.588 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.588 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.588 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.589 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.589 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.589 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.589 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.589 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.589 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.589 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.589 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.589 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.589 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.589 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.589 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.590 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.590 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.590 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.590 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.590 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.590 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.590 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.590 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.590 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.590 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.590 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.590 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.590 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.591 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.591 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.591 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.591 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.591 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.591 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.591 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.591 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.591 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.591 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.591 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.591 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.591 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.591 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.592 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.592 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.592 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.592 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.592 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.592 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.592 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.592 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.592 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.592 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.592 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.592 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.593 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.593 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.593 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.593 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.593 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.593 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.593 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.593 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.593 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.593 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.593 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.593 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.593 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.594 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.594 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.594 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.594 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.594 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.594 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.594 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.594 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.594 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telemetry", 2024-04-25T13:54:42.594 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.594 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.594 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.594 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_basic": { 2024-04-25T13:54:42.595 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_basic", 2024-04-25T13:54:42.595 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.595 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.595 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.595 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.595 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.595 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.595 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.595 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-25T13:54:42.595 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.595 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.595 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.595 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.596 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_crash": { 2024-04-25T13:54:42.596 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_crash", 2024-04-25T13:54:42.596 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.596 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.596 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.596 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.596 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.596 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.596 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.596 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-25T13:54:42.596 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.596 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.596 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.597 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.597 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_device": { 2024-04-25T13:54:42.597 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_device", 2024-04-25T13:54:42.597 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.597 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.597 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.597 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.597 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.597 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.597 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.597 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-25T13:54:42.597 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.597 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.598 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.598 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.598 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_ident": { 2024-04-25T13:54:42.598 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_ident", 2024-04-25T13:54:42.598 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.598 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.598 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.598 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.598 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.598 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.598 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.598 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-25T13:54:42.598 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.599 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.599 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.599 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.599 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_perf": { 2024-04-25T13:54:42.599 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_perf", 2024-04-25T13:54:42.599 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.599 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.599 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.599 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.599 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.599 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.599 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.599 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-25T13:54:42.600 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.600 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.600 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.600 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.600 INFO:teuthology.orchestra.run.smithi043.stdout: "contact": { 2024-04-25T13:54:42.600 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "contact", 2024-04-25T13:54:42.600 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.600 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.600 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.600 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.600 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.600 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.600 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.600 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.601 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.601 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.601 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.601 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.601 INFO:teuthology.orchestra.run.smithi043.stdout: "description": { 2024-04-25T13:54:42.601 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "description", 2024-04-25T13:54:42.601 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.601 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.601 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.601 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.601 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.601 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.601 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.601 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.602 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.602 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.602 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.602 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.602 INFO:teuthology.orchestra.run.smithi043.stdout: "device_url": { 2024-04-25T13:54:42.602 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_url", 2024-04-25T13:54:42.602 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.602 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.602 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.602 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-25T13:54:42.602 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.602 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.602 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.603 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.603 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.603 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.603 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.603 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.603 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-04-25T13:54:42.603 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-04-25T13:54:42.603 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.603 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.603 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.603 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.603 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.603 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.604 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.604 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.604 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.604 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.604 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.604 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.604 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T13:54:42.604 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T13:54:42.604 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.604 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.604 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.604 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "24", 2024-04-25T13:54:42.604 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "8", 2024-04-25T13:54:42.604 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.604 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.605 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.605 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.605 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.605 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.605 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.605 INFO:teuthology.orchestra.run.smithi043.stdout: "last_opt_revision": { 2024-04-25T13:54:42.605 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "last_opt_revision", 2024-04-25T13:54:42.605 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.605 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.605 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.605 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1", 2024-04-25T13:54:42.605 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.605 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.605 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.606 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.606 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.606 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.606 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.606 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.606 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard": { 2024-04-25T13:54:42.606 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard", 2024-04-25T13:54:42.606 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.606 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.606 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.606 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.606 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.607 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.607 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.607 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.607 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.607 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.607 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.607 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.607 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard_description": { 2024-04-25T13:54:42.607 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard_description", 2024-04-25T13:54:42.607 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.607 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.607 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.607 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.607 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.607 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.607 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.608 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.609 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.609 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.609 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.609 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.609 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.609 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.609 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.609 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.609 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.609 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.609 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.609 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.609 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.609 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.609 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.610 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.610 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.610 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.610 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.610 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.610 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.610 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.610 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.610 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.610 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.610 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.610 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.610 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.610 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.611 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.611 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.611 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.611 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.611 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.611 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.611 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.611 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.611 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.611 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.611 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.611 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.611 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.611 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.613 INFO:teuthology.orchestra.run.smithi043.stdout: "organization": { 2024-04-25T13:54:42.613 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "organization", 2024-04-25T13:54:42.613 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.613 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.613 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.613 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.613 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.613 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.613 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.613 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.613 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.613 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.613 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.613 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.613 INFO:teuthology.orchestra.run.smithi043.stdout: "proxy": { 2024-04-25T13:54:42.613 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "proxy", 2024-04-25T13:54:42.614 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.614 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.614 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.614 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.614 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.614 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.614 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.614 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.614 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.614 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.614 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.614 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.615 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.615 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.615 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.615 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.615 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.615 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.615 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.615 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.615 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.615 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.615 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.615 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.615 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.616 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.616 INFO:teuthology.orchestra.run.smithi043.stdout: "url": { 2024-04-25T13:54:42.616 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url", 2024-04-25T13:54:42.616 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.616 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.616 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.616 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-25T13:54:42.616 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.616 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.616 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.616 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.616 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.616 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.616 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.616 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.616 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.617 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.617 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.617 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "test_orchestrator", 2024-04-25T13:54:42.617 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.617 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.617 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.617 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.617 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.617 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.617 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.617 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.617 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.617 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.617 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.618 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.618 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.618 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.618 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.618 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.618 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.618 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.618 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.618 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.618 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.618 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.618 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.618 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.618 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.618 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.619 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.619 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.619 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.619 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.619 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.619 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.619 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.619 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.619 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.619 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.619 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.619 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.619 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.619 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.620 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.620 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.620 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.620 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.620 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.620 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.620 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.620 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.620 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.620 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.620 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.621 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.621 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.621 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.621 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.621 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.621 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.621 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.621 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.621 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.621 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.621 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.621 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.621 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.622 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.622 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.622 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.622 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.622 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.622 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.622 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.622 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.622 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.622 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.622 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.622 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.623 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.623 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.623 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.623 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.623 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.623 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.623 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.623 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.623 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.623 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.623 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.623 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.623 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.624 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.624 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "volumes", 2024-04-25T13:54:42.624 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.624 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.624 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.624 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.624 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.624 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.624 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.624 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.624 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.624 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.624 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.625 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.625 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.625 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.625 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.625 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.625 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.625 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.625 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.625 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.625 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.625 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.625 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.625 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.626 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.626 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.626 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.626 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.626 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.626 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.626 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.626 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.626 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.626 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.626 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.626 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.626 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.626 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.626 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.626 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.627 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.627 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.627 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.627 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.627 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.627 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.627 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.627 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.627 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.627 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.627 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.627 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.627 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.627 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.627 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.628 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.628 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.628 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.628 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.628 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.628 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.628 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.628 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.628 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.628 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.628 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.628 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.628 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.628 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.628 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.629 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.629 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.629 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.629 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_clones": { 2024-04-25T13:54:42.629 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_clones", 2024-04-25T13:54:42.629 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.629 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.629 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.629 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4", 2024-04-25T13:54:42.629 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.629 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.629 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.629 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-25T13:54:42.630 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.630 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.630 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.630 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.630 INFO:teuthology.orchestra.run.smithi043.stdout: "periodic_async_work": { 2024-04-25T13:54:42.630 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "periodic_async_work", 2024-04-25T13:54:42.630 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.630 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.630 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.630 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.630 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.630 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.630 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.630 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Periodically check for async work", 2024-04-25T13:54:42.630 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.630 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.631 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.631 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.631 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_delay": { 2024-04-25T13:54:42.631 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_delay", 2024-04-25T13:54:42.631 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.631 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.631 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.631 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.631 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.631 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.631 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.631 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-25T13:54:42.631 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.631 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.631 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.632 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.632 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_no_wait": { 2024-04-25T13:54:42.632 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_no_wait", 2024-04-25T13:54:42.632 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.632 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.632 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.632 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.632 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.632 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.632 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.632 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-25T13:54:42.632 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.633 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.633 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.633 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.633 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.633 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.633 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.633 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.633 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.633 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.633 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.633 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.633 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.633 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.633 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.634 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.634 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.634 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.634 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.634 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.634 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.634 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix", 2024-04-25T13:54:42.634 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.634 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.634 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.634 INFO:teuthology.orchestra.run.smithi043.stdout: "discovery_interval": { 2024-04-25T13:54:42.634 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "discovery_interval", 2024-04-25T13:54:42.634 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T13:54:42.634 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.635 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.635 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "100", 2024-04-25T13:54:42.635 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.635 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.635 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.635 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.635 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.635 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.635 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.635 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.635 INFO:teuthology.orchestra.run.smithi043.stdout: "identifier": { 2024-04-25T13:54:42.635 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "identifier", 2024-04-25T13:54:42.635 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.635 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.635 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.636 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.636 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.636 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.636 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.636 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.636 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.636 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.636 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.636 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.636 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T13:54:42.636 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T13:54:42.636 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.637 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.637 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.637 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T13:54:42.637 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.637 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.637 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.637 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.637 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.637 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.637 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.637 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.637 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.637 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.637 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.638 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.638 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.638 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.638 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.638 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.638 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.638 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.638 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.638 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.638 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.638 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.638 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.638 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.638 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.638 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.639 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.639 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.639 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.639 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.639 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.639 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.639 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.639 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.639 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.639 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.639 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.639 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.639 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.639 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.640 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.640 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.640 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.640 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.640 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.640 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.640 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.640 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.640 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.640 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.640 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.640 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.640 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.640 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.640 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.641 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.641 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.641 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.641 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.641 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.641 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.641 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.641 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.641 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.641 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.641 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.641 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.641 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.642 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.642 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.642 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.642 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.642 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.642 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.642 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.642 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.642 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.642 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.642 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.642 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.642 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.643 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.643 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.643 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.643 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.643 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.643 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.643 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.643 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.643 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.643 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.643 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.643 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_host": { 2024-04-25T13:54:42.643 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_host", 2024-04-25T13:54:42.643 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.644 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.644 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.644 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.644 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.644 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.644 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.644 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.644 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.644 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.644 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.644 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.644 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_port": { 2024-04-25T13:54:42.644 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_port", 2024-04-25T13:54:42.644 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.644 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.645 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.645 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10051", 2024-04-25T13:54:42.645 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.645 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.645 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.645 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.645 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.645 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.645 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.645 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.645 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_sender": { 2024-04-25T13:54:42.645 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_sender", 2024-04-25T13:54:42.645 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.645 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.646 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.646 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-25T13:54:42.646 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.646 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.646 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.646 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.646 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.646 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.646 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.646 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.646 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.646 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.646 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T13:54:42.646 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.647 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.647 INFO:teuthology.orchestra.run.smithi043.stdout: "gid": 25178, 2024-04-25T13:54:42.647 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "y", 2024-04-25T13:54:42.647 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_features": 4540701547738038271, 2024-04-25T13:54:42.647 INFO:teuthology.orchestra.run.smithi043.stdout: "available_modules": [ 2024-04-25T13:54:42.647 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.647 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "alerts", 2024-04-25T13:54:42.647 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.647 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.647 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.647 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T13:54:42.647 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T13:54:42.647 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.647 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.647 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.648 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T13:54:42.648 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.648 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.648 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.648 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How frequently to reexamine health status", 2024-04-25T13:54:42.648 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.648 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.648 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.648 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.648 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.648 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.648 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.648 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.648 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.649 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.649 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.649 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.649 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.649 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.649 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.649 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.649 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.649 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.649 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.649 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.649 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.649 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.649 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.649 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.649 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.650 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.650 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.650 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.650 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.650 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.650 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.650 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.650 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.650 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.650 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.650 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.650 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.650 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.651 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.651 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.651 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.651 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.651 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.651 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.651 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.651 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.651 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.651 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.651 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.651 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.651 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.651 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.651 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.651 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.652 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.652 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.652 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.652 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.652 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.652 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.652 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.652 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.652 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.652 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.652 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.652 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.652 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.652 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.653 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.653 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.653 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.653 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.653 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.653 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.653 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_destination": { 2024-04-25T13:54:42.653 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_destination", 2024-04-25T13:54:42.653 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.653 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.653 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.653 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.653 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.653 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.654 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.654 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email address to send alerts to", 2024-04-25T13:54:42.654 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.654 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.654 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.654 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.654 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_from_name": { 2024-04-25T13:54:42.654 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_from_name", 2024-04-25T13:54:42.654 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.654 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.654 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.654 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "Ceph", 2024-04-25T13:54:42.654 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.654 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.655 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.655 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email From: name", 2024-04-25T13:54:42.655 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.655 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.655 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.655 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.655 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_host": { 2024-04-25T13:54:42.655 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_host", 2024-04-25T13:54:42.655 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.655 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.655 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.655 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.655 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.655 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.655 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.656 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP server", 2024-04-25T13:54:42.656 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.656 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.656 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.656 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.656 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_password": { 2024-04-25T13:54:42.656 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_password", 2024-04-25T13:54:42.656 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.656 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.656 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.656 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.656 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.656 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.656 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.656 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Password to authenticate with", 2024-04-25T13:54:42.657 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.657 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.657 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.657 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.657 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_port": { 2024-04-25T13:54:42.657 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_port", 2024-04-25T13:54:42.657 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.657 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.657 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.657 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "465", 2024-04-25T13:54:42.657 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.657 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.657 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.657 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP port", 2024-04-25T13:54:42.658 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.658 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.658 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.658 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.658 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_sender": { 2024-04-25T13:54:42.658 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_sender", 2024-04-25T13:54:42.658 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.658 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.658 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.658 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.658 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.658 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.658 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.658 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP envelope sender", 2024-04-25T13:54:42.658 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.659 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.659 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.659 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.659 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_ssl": { 2024-04-25T13:54:42.659 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_ssl", 2024-04-25T13:54:42.659 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.659 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.659 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.659 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.659 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.659 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.659 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.659 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-25T13:54:42.659 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.660 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.660 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.660 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.660 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_user": { 2024-04-25T13:54:42.660 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_user", 2024-04-25T13:54:42.660 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.660 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.660 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.660 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.660 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.660 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.660 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.660 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "User to authenticate as", 2024-04-25T13:54:42.660 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.660 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.661 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.661 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.661 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.661 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.661 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.661 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.661 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.661 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.661 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.661 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.661 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.661 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.661 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.661 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.661 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.661 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.662 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.662 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.662 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.662 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "balancer", 2024-04-25T13:54:42.662 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.662 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.662 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.662 INFO:teuthology.orchestra.run.smithi043.stdout: "active": { 2024-04-25T13:54:42.662 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "active", 2024-04-25T13:54:42.662 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.662 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.662 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.662 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.662 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.662 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.663 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.663 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically balance PGs across cluster", 2024-04-25T13:54:42.663 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.663 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.663 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.663 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.663 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_time": { 2024-04-25T13:54:42.663 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_time", 2024-04-25T13:54:42.663 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.663 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.663 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.663 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0000", 2024-04-25T13:54:42.663 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.663 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.664 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.664 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "beginning time of day to automatically balance", 2024-04-25T13:54:42.664 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T13:54:42.664 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.664 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.664 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.664 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_weekday": { 2024-04-25T13:54:42.664 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_weekday", 2024-04-25T13:54:42.664 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T13:54:42.664 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.664 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.664 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.664 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-04-25T13:54:42.665 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-04-25T13:54:42.665 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.665 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-25T13:54:42.665 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T13:54:42.665 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.665 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.665 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.665 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_max_iterations": { 2024-04-25T13:54:42.665 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_max_iterations", 2024-04-25T13:54:42.665 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T13:54:42.665 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.665 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.665 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "25", 2024-04-25T13:54:42.666 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T13:54:42.666 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "250", 2024-04-25T13:54:42.666 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.666 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-25T13:54:42.666 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.666 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.666 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.666 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.666 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_metrics": { 2024-04-25T13:54:42.666 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_metrics", 2024-04-25T13:54:42.666 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.666 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.666 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.666 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "pgs,objects,bytes", 2024-04-25T13:54:42.667 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.667 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.667 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.667 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-25T13:54:42.667 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-25T13:54:42.667 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.667 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.667 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.667 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_step": { 2024-04-25T13:54:42.667 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_step", 2024-04-25T13:54:42.667 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:42.667 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.667 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.668 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.5", 2024-04-25T13:54:42.668 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0.001", 2024-04-25T13:54:42.668 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "0.999", 2024-04-25T13:54:42.668 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.668 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "aggressiveness of optimization", 2024-04-25T13:54:42.668 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-25T13:54:42.668 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.668 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.668 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.668 INFO:teuthology.orchestra.run.smithi043.stdout: "end_time": { 2024-04-25T13:54:42.668 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_time", 2024-04-25T13:54:42.669 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.669 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.669 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.669 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2359", 2024-04-25T13:54:42.669 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.669 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.669 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.669 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ending time of day to automatically balance", 2024-04-25T13:54:42.669 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T13:54:42.669 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.669 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.669 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.669 INFO:teuthology.orchestra.run.smithi043.stdout: "end_weekday": { 2024-04-25T13:54:42.670 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_weekday", 2024-04-25T13:54:42.670 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T13:54:42.670 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.670 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.670 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.670 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-04-25T13:54:42.670 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-04-25T13:54:42.670 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.670 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-25T13:54:42.670 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T13:54:42.670 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.670 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.670 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.671 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.671 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.671 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.671 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.671 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.671 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.671 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.671 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.671 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.671 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.671 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.671 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.672 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.672 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.672 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.672 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.672 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.672 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.672 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.672 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.672 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.672 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.672 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.672 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.672 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.672 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.672 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.673 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.673 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.673 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.673 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.673 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.673 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.673 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.673 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.673 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.673 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.673 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.673 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.673 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.673 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.673 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.674 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.674 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.674 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.674 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.674 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.674 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.674 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.674 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.674 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.674 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.674 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.674 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.674 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.675 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.675 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.675 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.675 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.675 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.675 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.675 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.675 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.675 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.675 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.675 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.675 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.675 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.675 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.676 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.676 INFO:teuthology.orchestra.run.smithi043.stdout: "min_score": { 2024-04-25T13:54:42.676 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_score", 2024-04-25T13:54:42.676 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:42.676 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.676 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.676 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.676 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.676 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.676 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.677 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-25T13:54:42.677 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.677 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.677 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.677 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.677 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-04-25T13:54:42.677 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-04-25T13:54:42.677 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.677 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.677 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.677 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "upmap", 2024-04-25T13:54:42.677 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.677 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.678 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.678 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-compat", 2024-04-25T13:54:42.678 INFO:teuthology.orchestra.run.smithi043.stdout: "none", 2024-04-25T13:54:42.678 INFO:teuthology.orchestra.run.smithi043.stdout: "read", 2024-04-25T13:54:42.678 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap", 2024-04-25T13:54:42.678 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap-read" 2024-04-25T13:54:42.678 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.678 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Balancer mode", 2024-04-25T13:54:42.678 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.678 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.678 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.678 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.679 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_ids": { 2024-04-25T13:54:42.679 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_ids", 2024-04-25T13:54:42.679 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.679 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.679 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.679 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.679 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.679 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.679 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.679 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-25T13:54:42.679 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.679 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.679 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.679 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.680 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T13:54:42.680 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T13:54:42.680 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.680 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.680 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.680 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T13:54:42.680 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.680 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.680 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.680 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-25T13:54:42.680 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.680 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.681 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.681 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.681 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.681 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.681 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.681 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.681 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.681 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.681 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.681 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.681 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.681 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.681 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.682 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.682 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.682 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.682 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_deviation": { 2024-04-25T13:54:42.682 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_deviation", 2024-04-25T13:54:42.682 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.682 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.682 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.682 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T13:54:42.682 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T13:54:42.682 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.682 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.682 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-25T13:54:42.682 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-25T13:54:42.682 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.683 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.683 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.683 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_optimizations": { 2024-04-25T13:54:42.683 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_optimizations", 2024-04-25T13:54:42.683 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T13:54:42.683 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.683 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.683 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:42.683 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.683 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.683 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.683 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-25T13:54:42.683 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.683 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.684 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.684 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.684 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.684 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.684 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.684 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm", 2024-04-25T13:54:42.684 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.684 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.684 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.684 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_down_multiplier": { 2024-04-25T13:54:42.684 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_down_multiplier", 2024-04-25T13:54:42.684 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:42.685 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.685 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.685 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-04-25T13:54:42.685 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.685 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.685 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.685 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-25T13:54:42.685 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.685 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.685 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.685 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.685 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_refresh_rate": { 2024-04-25T13:54:42.685 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_refresh_rate", 2024-04-25T13:54:42.686 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.686 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.686 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.686 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "20", 2024-04-25T13:54:42.686 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.686 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.686 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.686 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-25T13:54:42.686 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.686 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.686 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.686 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.686 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_starting_port": { 2024-04-25T13:54:42.687 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_starting_port", 2024-04-25T13:54:42.687 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.687 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.687 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.687 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4721", 2024-04-25T13:54:42.687 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.687 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.687 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.687 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-25T13:54:42.687 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.687 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.687 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.687 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.688 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_ptrace": { 2024-04-25T13:54:42.688 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_ptrace", 2024-04-25T13:54:42.688 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.688 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.688 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.688 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.688 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.688 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.688 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.688 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-25T13:54:42.688 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-25T13:54:42.688 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.688 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.689 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.689 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_interval": { 2024-04-25T13:54:42.689 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_interval", 2024-04-25T13:54:42.689 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.689 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.689 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.689 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T13:54:42.689 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.689 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.689 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.689 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-25T13:54:42.689 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.689 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.689 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.690 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.690 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_memory_target_ratio": { 2024-04-25T13:54:42.690 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_memory_target_ratio", 2024-04-25T13:54:42.690 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:42.690 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.690 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.690 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.7", 2024-04-25T13:54:42.690 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.690 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.690 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.690 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-25T13:54:42.690 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.691 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.691 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.691 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.691 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm_log_destination": { 2024-04-25T13:54:42.691 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm_log_destination", 2024-04-25T13:54:42.691 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.691 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.691 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.691 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.691 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.691 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.691 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.692 INFO:teuthology.orchestra.run.smithi043.stdout: "file", 2024-04-25T13:54:42.692 INFO:teuthology.orchestra.run.smithi043.stdout: "file,syslog", 2024-04-25T13:54:42.692 INFO:teuthology.orchestra.run.smithi043.stdout: "syslog" 2024-04-25T13:54:42.692 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.692 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-25T13:54:42.692 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.692 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.692 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.692 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.692 INFO:teuthology.orchestra.run.smithi043.stdout: "cgroups_split": { 2024-04-25T13:54:42.692 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cgroups_split", 2024-04-25T13:54:42.692 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.692 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.692 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.693 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.693 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.693 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.693 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.693 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-25T13:54:42.693 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.693 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.693 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.693 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.693 INFO:teuthology.orchestra.run.smithi043.stdout: "config_checks_enabled": { 2024-04-25T13:54:42.693 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_checks_enabled", 2024-04-25T13:54:42.693 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.693 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.694 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.694 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.694 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.694 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.694 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.694 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-25T13:54:42.694 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.694 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.694 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.694 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.694 INFO:teuthology.orchestra.run.smithi043.stdout: "config_dashboard": { 2024-04-25T13:54:42.694 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_dashboard", 2024-04-25T13:54:42.695 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.695 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.695 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.695 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.695 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.695 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.695 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.695 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-25T13:54:42.695 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.695 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.695 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.695 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.695 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_alertmanager": { 2024-04-25T13:54:42.695 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_alertmanager", 2024-04-25T13:54:42.696 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.696 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.696 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.696 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-25T13:54:42.696 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.696 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.696 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.696 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T13:54:42.696 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.696 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.696 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.696 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.696 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_base": { 2024-04-25T13:54:42.696 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_base", 2024-04-25T13:54:42.696 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.697 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.697 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.697 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-25T13:54:42.697 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.697 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.697 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.697 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Container image name, without the tag", 2024-04-25T13:54:42.697 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.697 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.697 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.697 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.697 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_elasticsearch": { 2024-04-25T13:54:42.697 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_elasticsearch", 2024-04-25T13:54:42.697 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.697 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.697 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.698 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-25T13:54:42.698 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.698 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.698 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.698 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "elasticsearch container image", 2024-04-25T13:54:42.698 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.698 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.698 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.698 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.698 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_grafana": { 2024-04-25T13:54:42.698 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_grafana", 2024-04-25T13:54:42.698 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.698 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.699 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.699 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-25T13:54:42.699 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.699 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.699 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.699 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T13:54:42.699 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.699 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.699 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.699 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.699 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_haproxy": { 2024-04-25T13:54:42.699 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_haproxy", 2024-04-25T13:54:42.699 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.700 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.700 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.700 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-25T13:54:42.700 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.700 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.700 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.700 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "HAproxy container image", 2024-04-25T13:54:42.700 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.700 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.700 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.700 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.700 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_agent": { 2024-04-25T13:54:42.700 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_agent", 2024-04-25T13:54:42.700 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.700 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.701 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.701 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-25T13:54:42.701 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.701 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.701 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.701 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger agent container image", 2024-04-25T13:54:42.701 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.701 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.701 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.701 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.701 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_collector": { 2024-04-25T13:54:42.701 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_collector", 2024-04-25T13:54:42.701 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.701 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.701 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.702 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-25T13:54:42.702 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.702 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.702 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.702 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger collector container image", 2024-04-25T13:54:42.702 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.702 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.702 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.702 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.702 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_query": { 2024-04-25T13:54:42.702 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_query", 2024-04-25T13:54:42.703 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.703 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.703 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.703 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-25T13:54:42.703 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.703 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.703 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.703 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger query container image", 2024-04-25T13:54:42.703 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.703 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.703 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.703 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.703 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_keepalived": { 2024-04-25T13:54:42.703 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_keepalived", 2024-04-25T13:54:42.703 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.704 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.704 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.704 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-25T13:54:42.704 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.704 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.704 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.704 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Keepalived container image", 2024-04-25T13:54:42.704 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.704 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.704 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.704 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.704 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_loki": { 2024-04-25T13:54:42.704 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_loki", 2024-04-25T13:54:42.705 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.705 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.705 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.705 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-25T13:54:42.705 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.705 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.705 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.705 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Loki container image", 2024-04-25T13:54:42.705 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.705 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.705 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.705 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.705 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_node_exporter": { 2024-04-25T13:54:42.706 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_node_exporter", 2024-04-25T13:54:42.706 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.706 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.706 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.706 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-25T13:54:42.706 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.706 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.706 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.706 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T13:54:42.706 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.706 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.706 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.706 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.707 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_nvmeof": { 2024-04-25T13:54:42.707 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_nvmeof", 2024-04-25T13:54:42.707 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.707 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.707 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.707 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-25T13:54:42.707 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.707 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.707 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.707 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Nvme-of container image", 2024-04-25T13:54:42.707 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.707 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.707 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.707 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.707 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_prometheus": { 2024-04-25T13:54:42.708 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_prometheus", 2024-04-25T13:54:42.708 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.708 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.708 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.708 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-25T13:54:42.708 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.708 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.708 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.708 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T13:54:42.708 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.708 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.708 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.708 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.708 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_promtail": { 2024-04-25T13:54:42.709 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_promtail", 2024-04-25T13:54:42.709 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.709 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.709 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.709 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-25T13:54:42.709 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.709 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.709 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.709 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Promtail container image", 2024-04-25T13:54:42.709 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.709 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.709 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.709 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.709 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_samba": { 2024-04-25T13:54:42.710 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_samba", 2024-04-25T13:54:42.710 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.710 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.710 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.710 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-25T13:54:42.710 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.710 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.710 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.710 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Samba/SMB container image", 2024-04-25T13:54:42.710 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.710 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.710 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.710 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.710 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_snmp_gateway": { 2024-04-25T13:54:42.711 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_snmp_gateway", 2024-04-25T13:54:42.711 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.711 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.711 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.711 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-25T13:54:42.711 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.711 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.711 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.711 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SNMP Gateway container image", 2024-04-25T13:54:42.711 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.711 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.711 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.711 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.712 INFO:teuthology.orchestra.run.smithi043.stdout: "container_init": { 2024-04-25T13:54:42.712 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_init", 2024-04-25T13:54:42.712 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.712 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.712 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.712 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.712 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.712 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.712 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.712 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Run podman/docker with `--init`", 2024-04-25T13:54:42.712 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.712 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.712 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.712 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.712 INFO:teuthology.orchestra.run.smithi043.stdout: "daemon_cache_timeout": { 2024-04-25T13:54:42.713 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "daemon_cache_timeout", 2024-04-25T13:54:42.713 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.713 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.713 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.713 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T13:54:42.713 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.713 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.713 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.713 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-25T13:54:42.713 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.713 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.713 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.713 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.713 INFO:teuthology.orchestra.run.smithi043.stdout: "default_cephadm_command_timeout": { 2024-04-25T13:54:42.713 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_cephadm_command_timeout", 2024-04-25T13:54:42.713 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.714 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.714 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.714 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "900", 2024-04-25T13:54:42.714 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.714 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.714 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.714 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-25T13:54:42.714 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.714 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.714 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.714 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.714 INFO:teuthology.orchestra.run.smithi043.stdout: "default_registry": { 2024-04-25T13:54:42.715 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_registry", 2024-04-25T13:54:42.715 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.715 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.715 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.715 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io", 2024-04-25T13:54:42.715 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.715 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.715 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.715 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-25T13:54:42.715 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.715 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.716 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.716 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.716 INFO:teuthology.orchestra.run.smithi043.stdout: "device_cache_timeout": { 2024-04-25T13:54:42.716 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_cache_timeout", 2024-04-25T13:54:42.716 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.716 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.716 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.716 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1800", 2024-04-25T13:54:42.716 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.716 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.716 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.716 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache device inventory", 2024-04-25T13:54:42.716 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.717 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.717 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.717 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.717 INFO:teuthology.orchestra.run.smithi043.stdout: "device_enhanced_scan": { 2024-04-25T13:54:42.717 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_enhanced_scan", 2024-04-25T13:54:42.717 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.717 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.717 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.717 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.717 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.717 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.717 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.717 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-25T13:54:42.717 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.717 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.718 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.718 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.718 INFO:teuthology.orchestra.run.smithi043.stdout: "facts_cache_timeout": { 2024-04-25T13:54:42.718 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "facts_cache_timeout", 2024-04-25T13:54:42.718 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.718 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.718 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.718 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T13:54:42.718 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.718 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.718 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.718 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache host facts data", 2024-04-25T13:54:42.718 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.719 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.719 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.719 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.719 INFO:teuthology.orchestra.run.smithi043.stdout: "grafana_dashboards_path": { 2024-04-25T13:54:42.719 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "grafana_dashboards_path", 2024-04-25T13:54:42.719 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.719 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.719 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.719 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-25T13:54:42.719 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.719 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.719 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.719 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-25T13:54:42.719 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.720 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.720 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.720 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.720 INFO:teuthology.orchestra.run.smithi043.stdout: "host_check_interval": { 2024-04-25T13:54:42.720 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "host_check_interval", 2024-04-25T13:54:42.720 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.720 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.720 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.720 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T13:54:42.720 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.720 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.720 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.720 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to perform a host check", 2024-04-25T13:54:42.720 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.720 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.721 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.721 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.721 INFO:teuthology.orchestra.run.smithi043.stdout: "hw_monitoring": { 2024-04-25T13:54:42.721 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hw_monitoring", 2024-04-25T13:54:42.721 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.721 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.721 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.721 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.721 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.721 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.721 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.721 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-25T13:54:42.721 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.721 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.722 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.722 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.722 INFO:teuthology.orchestra.run.smithi043.stdout: "inventory_list_all": { 2024-04-25T13:54:42.722 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "inventory_list_all", 2024-04-25T13:54:42.722 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.722 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.722 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.722 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.722 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.722 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.722 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.722 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-25T13:54:42.722 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.723 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.723 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.723 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.723 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.723 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.723 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.723 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.723 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.723 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.723 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.723 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.723 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.724 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.724 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.724 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.724 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.724 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.724 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.724 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.724 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.724 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.724 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.724 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.724 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.724 INFO:teuthology.orchestra.run.smithi043.stdout: "log_refresh_metadata": { 2024-04-25T13:54:42.724 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_refresh_metadata", 2024-04-25T13:54:42.725 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.725 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.725 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.725 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.725 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.725 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.725 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.725 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-25T13:54:42.725 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.725 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.725 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.725 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.725 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.726 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.726 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.726 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.726 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.726 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.726 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.726 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.726 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.726 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-25T13:54:42.726 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.726 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.726 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.726 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.727 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.727 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.727 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.727 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.727 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.727 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.727 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.727 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.727 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.727 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.727 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.727 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.727 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.728 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.728 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.728 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.728 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.728 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.728 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.728 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.728 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.728 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.728 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.728 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.728 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.728 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.728 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.728 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.729 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.729 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.729 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.729 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.729 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.729 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.729 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.729 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-25T13:54:42.729 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-25T13:54:42.729 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.729 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.729 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.729 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.729 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.730 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.730 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.730 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-25T13:54:42.730 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.730 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.730 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.730 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.730 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-25T13:54:42.730 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-25T13:54:42.730 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.730 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.730 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.730 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "*", 2024-04-25T13:54:42.730 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.731 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.731 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.731 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-25T13:54:42.731 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.731 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.731 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.731 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.731 INFO:teuthology.orchestra.run.smithi043.stdout: "max_count_per_host": { 2024-04-25T13:54:42.731 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_count_per_host", 2024-04-25T13:54:42.731 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.731 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.731 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.731 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:42.731 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.731 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.732 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.732 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of daemons per service per host", 2024-04-25T13:54:42.732 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.732 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.732 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.732 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.732 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd_draining_count": { 2024-04-25T13:54:42.732 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_osd_draining_count", 2024-04-25T13:54:42.732 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.732 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.732 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.732 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:42.732 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.733 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.733 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.733 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-25T13:54:42.733 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.733 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.733 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.733 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.733 INFO:teuthology.orchestra.run.smithi043.stdout: "migration_current": { 2024-04-25T13:54:42.733 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "migration_current", 2024-04-25T13:54:42.733 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.733 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.733 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.733 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.733 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.733 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.734 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.734 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "internal - do not modify", 2024-04-25T13:54:42.734 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.734 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.734 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.734 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.734 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-04-25T13:54:42.734 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-04-25T13:54:42.734 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.734 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.734 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.735 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "root", 2024-04-25T13:54:42.735 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.735 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.735 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.735 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm-package", 2024-04-25T13:54:42.735 INFO:teuthology.orchestra.run.smithi043.stdout: "root" 2024-04-25T13:54:42.735 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.735 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "mode for remote execution of cephadm", 2024-04-25T13:54:42.735 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.735 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.735 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.735 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.735 INFO:teuthology.orchestra.run.smithi043.stdout: "oob_default_addr": { 2024-04-25T13:54:42.736 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "oob_default_addr", 2024-04-25T13:54:42.736 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.736 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.736 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.736 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "169.254.1.1", 2024-04-25T13:54:42.736 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.736 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.736 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.736 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-25T13:54:42.736 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.736 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.736 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.736 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.737 INFO:teuthology.orchestra.run.smithi043.stdout: "prometheus_alerts_path": { 2024-04-25T13:54:42.737 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus_alerts_path", 2024-04-25T13:54:42.737 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.737 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.737 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.737 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-25T13:54:42.737 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.737 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.737 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.737 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-25T13:54:42.737 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.737 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.738 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.738 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.738 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_insecure": { 2024-04-25T13:54:42.738 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_insecure", 2024-04-25T13:54:42.738 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.738 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.738 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.738 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.738 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.738 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.738 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.738 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-25T13:54:42.738 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.739 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.739 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.739 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.739 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_password": { 2024-04-25T13:54:42.739 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_password", 2024-04-25T13:54:42.739 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.739 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.739 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.739 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.739 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.739 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.739 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.739 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-25T13:54:42.739 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.739 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.740 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.740 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.740 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_url": { 2024-04-25T13:54:42.740 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_url", 2024-04-25T13:54:42.740 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.740 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.740 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.740 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.740 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.740 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.740 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.740 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-25T13:54:42.741 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.741 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.741 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.741 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.741 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_username": { 2024-04-25T13:54:42.741 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_username", 2024-04-25T13:54:42.741 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.741 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.741 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.741 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.741 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.741 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.741 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.741 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-25T13:54:42.742 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.742 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.742 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.742 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.742 INFO:teuthology.orchestra.run.smithi043.stdout: "secure_monitoring_stack": { 2024-04-25T13:54:42.742 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "secure_monitoring_stack", 2024-04-25T13:54:42.742 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.742 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.742 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.742 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.742 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.742 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.743 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.743 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-25T13:54:42.743 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.743 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.743 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.743 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.743 INFO:teuthology.orchestra.run.smithi043.stdout: "service_discovery_port": { 2024-04-25T13:54:42.743 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "service_discovery_port", 2024-04-25T13:54:42.743 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.743 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.743 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.743 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8765", 2024-04-25T13:54:42.743 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.743 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.743 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.743 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "cephadm service discovery port", 2024-04-25T13:54:42.744 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.744 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.744 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.744 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.744 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.744 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.744 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.744 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.744 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.744 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.744 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.744 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.744 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.744 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.745 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.745 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.745 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.745 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.745 INFO:teuthology.orchestra.run.smithi043.stdout: "ssh_config_file": { 2024-04-25T13:54:42.745 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssh_config_file", 2024-04-25T13:54:42.745 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.745 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.745 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.745 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.745 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.745 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.745 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.746 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-25T13:54:42.746 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.746 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.746 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.746 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.746 INFO:teuthology.orchestra.run.smithi043.stdout: "use_agent": { 2024-04-25T13:54:42.746 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_agent", 2024-04-25T13:54:42.746 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.746 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.746 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.746 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.746 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.747 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.747 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.747 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-25T13:54:42.747 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.747 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.747 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.747 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.747 INFO:teuthology.orchestra.run.smithi043.stdout: "use_repo_digest": { 2024-04-25T13:54:42.747 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_repo_digest", 2024-04-25T13:54:42.747 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.747 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.747 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.747 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.747 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.747 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.748 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.748 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-25T13:54:42.748 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.748 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.748 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.748 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.748 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_failed_host_check": { 2024-04-25T13:54:42.748 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_failed_host_check", 2024-04-25T13:54:42.748 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.748 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.748 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.748 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.748 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.748 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.749 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.749 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if the host check fails", 2024-04-25T13:54:42.749 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.749 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.749 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.749 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.749 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_daemons": { 2024-04-25T13:54:42.749 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_daemons", 2024-04-25T13:54:42.749 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.749 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.749 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.749 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.749 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.750 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.750 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.750 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-25T13:54:42.750 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.750 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.750 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.750 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.750 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_hosts": { 2024-04-25T13:54:42.750 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_hosts", 2024-04-25T13:54:42.750 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.750 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.750 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.751 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.751 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.751 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.751 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.751 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-25T13:54:42.751 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.751 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.751 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.751 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.751 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.751 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.751 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.751 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crash", 2024-04-25T13:54:42.751 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.752 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.752 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.752 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.752 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.752 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.752 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.752 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.752 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.752 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.752 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.752 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.752 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.752 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.752 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.752 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.752 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.753 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.753 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.753 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.753 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.753 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.753 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.753 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.753 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.753 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.753 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.753 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.753 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.753 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.753 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.754 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.754 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.754 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.754 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.754 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.754 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.754 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.754 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.754 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.754 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.754 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.754 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.754 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.755 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.755 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.755 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.755 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.755 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.755 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.755 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.755 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.755 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.755 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.755 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.755 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.755 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.756 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.756 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.756 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.756 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.756 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.756 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.756 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.756 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.756 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.756 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.756 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.756 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.756 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.756 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.757 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.757 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.757 INFO:teuthology.orchestra.run.smithi043.stdout: "retain_interval": { 2024-04-25T13:54:42.757 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retain_interval", 2024-04-25T13:54:42.757 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.757 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.757 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.757 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "31536000", 2024-04-25T13:54:42.757 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.757 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.757 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.757 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-25T13:54:42.757 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.758 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.758 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.758 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.758 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.758 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.758 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.758 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.758 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.758 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.758 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.758 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.758 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.758 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.758 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.759 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.759 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.759 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.759 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_recent_interval": { 2024-04-25T13:54:42.759 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_recent_interval", 2024-04-25T13:54:42.759 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.759 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.759 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.759 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1209600", 2024-04-25T13:54:42.759 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.759 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.759 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.759 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-25T13:54:42.759 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.760 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.760 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.760 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.760 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.760 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.760 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.760 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dashboard", 2024-04-25T13:54:42.760 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.760 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.760 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.760 INFO:teuthology.orchestra.run.smithi043.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-25T13:54:42.760 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-25T13:54:42.760 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.760 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.761 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.761 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:42.761 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.761 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.761 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.761 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.761 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.761 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.761 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.761 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.761 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_HOST": { 2024-04-25T13:54:42.761 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-25T13:54:42.761 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.761 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.761 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.762 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.762 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.762 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.762 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.762 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.762 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.762 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.762 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.762 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.762 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-25T13:54:42.762 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-25T13:54:42.762 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.762 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.763 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.763 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.763 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.763 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.763 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.763 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.763 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.763 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.763 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.763 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.763 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_ENABLED": { 2024-04-25T13:54:42.763 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_ENABLED", 2024-04-25T13:54:42.764 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.764 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.764 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.764 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.764 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.764 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.764 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.764 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.764 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.764 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.764 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.764 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.764 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-25T13:54:42.764 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-25T13:54:42.765 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.765 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.765 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.765 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.765 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.765 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.765 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.765 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.765 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.765 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.765 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.765 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.765 INFO:teuthology.orchestra.run.smithi043.stdout: "ENABLE_BROWSABLE_API": { 2024-04-25T13:54:42.765 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-25T13:54:42.766 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.766 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.766 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.766 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.766 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.766 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.766 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.766 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.766 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.766 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.766 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.766 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.766 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-25T13:54:42.766 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-25T13:54:42.767 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.767 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.767 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.767 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.767 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.767 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.767 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.767 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.767 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.767 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.767 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.767 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.767 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-25T13:54:42.767 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-25T13:54:42.768 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.768 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.768 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.768 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.768 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.768 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.768 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.768 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.768 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.768 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.768 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.768 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.768 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-25T13:54:42.768 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-25T13:54:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-25T13:54:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-25T13:54:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.770 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.770 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.770 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.770 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.770 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.770 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.770 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.770 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.770 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.770 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.770 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-25T13:54:42.770 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-25T13:54:42.770 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.770 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.771 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.771 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.771 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.771 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.771 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.771 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.771 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.771 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.771 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.771 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.771 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-25T13:54:42.772 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-25T13:54:42.772 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.772 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.772 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.772 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.772 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.772 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.772 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.772 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.772 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.772 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.772 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.772 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.772 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-25T13:54:42.773 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-25T13:54:42.773 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.773 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.773 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.773 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.773 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.773 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.773 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.773 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.773 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.773 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.773 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.773 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.774 INFO:teuthology.orchestra.run.smithi043.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-25T13:54:42.774 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-25T13:54:42.774 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.774 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.774 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.774 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.774 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.774 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.774 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.774 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.774 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.774 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.774 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.775 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.775 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_PASSWORD": { 2024-04-25T13:54:42.775 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-25T13:54:42.775 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.775 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.775 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.775 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T13:54:42.775 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.775 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.775 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.775 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.775 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.776 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.776 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.776 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.776 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-25T13:54:42.776 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-25T13:54:42.776 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.776 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.776 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.776 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.776 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.776 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.776 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.776 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.776 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.777 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.777 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.777 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.777 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_URL": { 2024-04-25T13:54:42.777 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_URL", 2024-04-25T13:54:42.777 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.777 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.777 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.777 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.777 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.777 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.777 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.777 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.777 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.778 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.778 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.778 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.778 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_USERNAME": { 2024-04-25T13:54:42.778 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-25T13:54:42.778 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.778 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.778 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.778 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T13:54:42.778 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.778 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.778 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.778 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.779 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.779 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.779 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.779 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.779 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-25T13:54:42.779 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-25T13:54:42.779 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.779 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.779 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.779 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.779 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.779 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.779 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.779 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.780 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.780 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.780 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.780 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.780 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-25T13:54:42.780 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-25T13:54:42.780 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.780 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.780 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.780 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.780 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.780 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.781 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.781 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.781 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.781 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.781 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.781 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.781 INFO:teuthology.orchestra.run.smithi043.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-25T13:54:42.781 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-25T13:54:42.781 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.781 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.781 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.781 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.781 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.781 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.782 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.782 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.782 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.782 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.782 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.782 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.782 INFO:teuthology.orchestra.run.smithi043.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-25T13:54:42.782 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-25T13:54:42.782 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.782 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.782 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.782 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.782 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.782 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.782 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.782 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.783 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.783 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.783 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.783 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.783 INFO:teuthology.orchestra.run.smithi043.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-25T13:54:42.783 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-25T13:54:42.783 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.783 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.783 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.783 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "[]", 2024-04-25T13:54:42.783 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.783 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.783 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.783 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.784 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.784 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.784 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.784 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.784 INFO:teuthology.orchestra.run.smithi043.stdout: "MULTICLUSTER_CONFIG": { 2024-04-25T13:54:42.784 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-25T13:54:42.784 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.784 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.784 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.784 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "{}", 2024-04-25T13:54:42.784 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.784 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.784 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.785 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.785 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.785 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.785 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.785 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.785 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_HOST": { 2024-04-25T13:54:42.785 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-25T13:54:42.785 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.785 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.785 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.785 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.785 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.786 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.786 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.786 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.786 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.786 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.786 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.786 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.786 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-25T13:54:42.786 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-25T13:54:42.786 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.786 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.786 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.786 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.786 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.787 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.787 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.787 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.787 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.787 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.787 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.787 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.787 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-25T13:54:42.787 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-25T13:54:42.787 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.787 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.787 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.787 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.788 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.788 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.788 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.788 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.788 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.788 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.788 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.788 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.788 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-25T13:54:42.788 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-25T13:54:42.788 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.788 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.788 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.788 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.788 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.789 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.789 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.789 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.789 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.789 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.789 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.789 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.789 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-25T13:54:42.789 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-25T13:54:42.789 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.789 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.789 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.789 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.789 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.789 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.790 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.790 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.790 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.790 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.790 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.790 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.790 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-25T13:54:42.790 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-25T13:54:42.790 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.790 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.790 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.790 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.790 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.790 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.790 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.791 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.791 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.791 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.791 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.791 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.791 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-25T13:54:42.791 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-25T13:54:42.791 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.791 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.791 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.791 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.791 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.791 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.792 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.792 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.792 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.792 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.792 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.792 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.792 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-25T13:54:42.792 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-25T13:54:42.792 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.792 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.792 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.792 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.792 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.792 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.792 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.793 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.793 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.793 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.793 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.793 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.793 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-25T13:54:42.793 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-25T13:54:42.793 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.793 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.793 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.793 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.793 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.793 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.794 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.794 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.794 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.794 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.794 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.794 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.794 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_ENABLED": { 2024-04-25T13:54:42.794 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-25T13:54:42.794 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.794 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.794 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.794 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.795 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.795 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.795 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.795 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.795 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.795 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.795 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.795 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.795 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-25T13:54:42.795 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-25T13:54:42.795 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.795 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.795 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.796 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-25T13:54:42.796 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.796 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.796 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.796 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.796 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.796 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.796 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.796 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.796 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-25T13:54:42.796 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-25T13:54:42.796 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.796 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.796 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.797 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:42.797 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.797 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.797 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.797 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.797 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.797 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.797 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.797 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.797 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-25T13:54:42.797 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-25T13:54:42.797 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.797 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.797 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.797 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8", 2024-04-25T13:54:42.797 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.798 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.798 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.798 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.798 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.798 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.798 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.798 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.798 INFO:teuthology.orchestra.run.smithi043.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-25T13:54:42.798 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-25T13:54:42.798 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.798 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.798 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.799 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "45", 2024-04-25T13:54:42.799 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.799 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.799 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.799 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.799 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.799 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.799 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.799 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.799 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ACCESS_KEY": { 2024-04-25T13:54:42.799 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-25T13:54:42.799 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.799 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.799 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.799 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.800 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.800 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.800 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.800 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.800 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.800 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.800 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.800 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.800 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-25T13:54:42.800 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-25T13:54:42.800 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.800 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.800 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.800 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T13:54:42.800 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.801 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.801 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.801 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.801 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.801 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.801 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.801 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.801 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SECRET_KEY": { 2024-04-25T13:54:42.801 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-25T13:54:42.801 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.801 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.801 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.801 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.801 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.801 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.802 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.802 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.802 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.802 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.802 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.802 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.802 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SSL_VERIFY": { 2024-04-25T13:54:42.802 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-25T13:54:42.802 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.802 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.802 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.802 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.802 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.802 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.803 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.803 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.803 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.803 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.803 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.803 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.803 INFO:teuthology.orchestra.run.smithi043.stdout: "UNSAFE_TLS_v1_2": { 2024-04-25T13:54:42.803 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-25T13:54:42.803 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.803 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.803 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.803 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.803 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.803 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.803 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.804 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.804 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.804 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.804 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.804 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.804 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-25T13:54:42.804 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-25T13:54:42.804 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.804 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.804 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.804 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.804 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.804 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.804 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.805 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.805 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.805 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.805 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.805 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.805 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-25T13:54:42.805 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-25T13:54:42.805 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.805 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.805 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.805 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:42.805 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.805 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.805 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.806 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.806 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.806 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.806 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.806 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.806 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-25T13:54:42.806 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-25T13:54:42.806 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.806 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.806 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.806 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T13:54:42.807 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.807 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.807 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.807 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.807 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.807 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.807 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.807 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.807 INFO:teuthology.orchestra.run.smithi043.stdout: "cross_origin_url": { 2024-04-25T13:54:42.807 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cross_origin_url", 2024-04-25T13:54:42.807 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.808 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.808 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.808 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.808 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.808 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.808 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.808 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.808 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.808 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.808 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.808 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.808 INFO:teuthology.orchestra.run.smithi043.stdout: "crt_file": { 2024-04-25T13:54:42.809 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crt_file", 2024-04-25T13:54:42.809 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.809 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.809 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.809 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.809 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.809 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.809 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.809 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.809 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.809 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.809 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.809 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.809 INFO:teuthology.orchestra.run.smithi043.stdout: "debug": { 2024-04-25T13:54:42.810 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "debug", 2024-04-25T13:54:42.810 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.810 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.810 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.810 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.810 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.810 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.810 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.810 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable/disable debug options", 2024-04-25T13:54:42.810 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.810 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.810 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.811 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.811 INFO:teuthology.orchestra.run.smithi043.stdout: "jwt_token_ttl": { 2024-04-25T13:54:42.811 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "jwt_token_ttl", 2024-04-25T13:54:42.811 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.811 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.811 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.811 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "28800", 2024-04-25T13:54:42.811 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.811 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.811 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.811 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.811 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.811 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.811 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.811 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.812 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-04-25T13:54:42.812 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-04-25T13:54:42.812 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.812 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.812 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.812 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.812 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.812 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.812 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.812 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.812 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.812 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.812 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.812 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.812 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.813 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.813 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.813 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.813 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.813 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.813 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.813 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.813 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.813 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.813 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.813 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.813 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.813 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.813 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.813 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.814 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.814 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.814 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.814 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.814 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.814 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.814 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.814 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.814 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.814 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.814 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.814 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.815 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.815 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.815 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.815 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.815 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.815 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.815 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.815 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.815 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.815 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.816 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.816 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.816 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.816 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.816 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.816 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.816 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.816 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.816 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.816 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.816 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.816 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.816 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.816 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.816 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.817 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.817 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.817 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.817 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.817 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.817 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.817 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.817 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.817 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.817 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.817 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.817 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.817 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.817 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.817 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.818 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.818 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.818 INFO:teuthology.orchestra.run.smithi043.stdout: "motd": { 2024-04-25T13:54:42.818 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "motd", 2024-04-25T13:54:42.818 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.818 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.818 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.818 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.818 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.818 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.818 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.818 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "The message of the day", 2024-04-25T13:54:42.818 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.818 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.818 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.818 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.819 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect_resolve_ip_addr": { 2024-04-25T13:54:42.819 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "redirect_resolve_ip_addr", 2024-04-25T13:54:42.819 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.819 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.819 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.819 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.819 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.819 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.819 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.819 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.819 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.819 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.819 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.819 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.819 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T13:54:42.819 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T13:54:42.820 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.820 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.820 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.820 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-04-25T13:54:42.820 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.820 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.820 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.820 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.820 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.820 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.820 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.820 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.820 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T13:54:42.820 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T13:54:42.820 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.820 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.821 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.821 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8080", 2024-04-25T13:54:42.821 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.821 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.821 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.821 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.821 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.821 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.821 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.821 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.821 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.821 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.822 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.822 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.822 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.822 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.822 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.822 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.822 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.822 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.822 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.822 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.822 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.822 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.822 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-04-25T13:54:42.822 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-04-25T13:54:42.823 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.823 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.823 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.823 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.823 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.823 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.823 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.823 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.823 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.823 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.823 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.823 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.823 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl_server_port": { 2024-04-25T13:54:42.823 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl_server_port", 2024-04-25T13:54:42.823 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.824 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.824 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.824 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8443", 2024-04-25T13:54:42.824 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.824 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.824 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.824 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.824 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.824 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.824 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.824 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.824 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-04-25T13:54:42.824 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-04-25T13:54:42.825 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.825 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.825 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.825 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "redirect", 2024-04-25T13:54:42.825 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.825 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.825 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.825 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.825 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect" 2024-04-25T13:54:42.825 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.825 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.825 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.825 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.825 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.825 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.826 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-04-25T13:54:42.826 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-04-25T13:54:42.826 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.826 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.826 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.826 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-04-25T13:54:42.826 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-04-25T13:54:42.826 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-04-25T13:54:42.826 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.826 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.826 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.826 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.826 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.826 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.826 INFO:teuthology.orchestra.run.smithi043.stdout: "url_prefix": { 2024-04-25T13:54:42.827 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url_prefix", 2024-04-25T13:54:42.827 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.827 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.827 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.827 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.827 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.827 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.827 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.827 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.827 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.827 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.827 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.827 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.827 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.827 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.827 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.828 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "devicehealth", 2024-04-25T13:54:42.828 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.828 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.828 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.828 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_monitoring": { 2024-04-25T13:54:42.828 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_monitoring", 2024-04-25T13:54:42.828 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.828 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.828 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.828 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.828 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.828 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.828 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.828 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "monitor device health metrics", 2024-04-25T13:54:42.829 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.829 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.829 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.829 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.829 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.829 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.829 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.829 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.829 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.829 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.829 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.829 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.829 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.829 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.830 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.830 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.830 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.830 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.830 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.830 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.830 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.830 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.830 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.830 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.830 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.830 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.830 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.830 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.830 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.831 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.831 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.831 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.831 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.831 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.831 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.831 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.831 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.831 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.831 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.831 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.831 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.831 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.831 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.831 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.831 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.832 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.832 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.832 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.832 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.832 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.832 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.832 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.832 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.832 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.832 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.832 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.832 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.832 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.832 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.832 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.833 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.833 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.833 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.833 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.833 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.833 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.833 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.833 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.833 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.833 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.833 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.833 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.833 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.833 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.833 INFO:teuthology.orchestra.run.smithi043.stdout: "mark_out_threshold": { 2024-04-25T13:54:42.834 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mark_out_threshold", 2024-04-25T13:54:42.834 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.834 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.834 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.834 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2419200", 2024-04-25T13:54:42.834 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.834 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.834 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.834 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-25T13:54:42.834 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.834 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.834 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.834 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.834 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": { 2024-04-25T13:54:42.835 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_name", 2024-04-25T13:54:42.835 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.835 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.835 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.835 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "device_health_metrics", 2024-04-25T13:54:42.835 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.835 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.835 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.835 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-25T13:54:42.835 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.835 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.835 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.835 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.835 INFO:teuthology.orchestra.run.smithi043.stdout: "retention_period": { 2024-04-25T13:54:42.836 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retention_period", 2024-04-25T13:54:42.836 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.836 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.836 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.836 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15552000", 2024-04-25T13:54:42.836 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.836 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.836 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.836 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain device health metrics", 2024-04-25T13:54:42.836 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.836 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.836 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.837 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.837 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_frequency": { 2024-04-25T13:54:42.837 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_frequency", 2024-04-25T13:54:42.837 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.837 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.837 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.837 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-04-25T13:54:42.837 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.837 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.837 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.837 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-25T13:54:42.837 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.838 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.838 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.838 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.838 INFO:teuthology.orchestra.run.smithi043.stdout: "self_heal": { 2024-04-25T13:54:42.838 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "self_heal", 2024-04-25T13:54:42.838 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.838 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.838 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.838 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.838 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.838 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.838 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.838 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-25T13:54:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T13:54:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T13:54:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T13:54:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and check device health", 2024-04-25T13:54:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.840 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.840 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.840 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.840 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.840 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.840 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.840 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.840 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.840 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.840 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.840 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.840 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.840 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.840 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.840 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.841 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.841 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.841 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_threshold": { 2024-04-25T13:54:42.841 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_threshold", 2024-04-25T13:54:42.841 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.841 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.841 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.841 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7257600", 2024-04-25T13:54:42.841 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.841 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.841 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.841 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-25T13:54:42.841 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.842 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.842 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.842 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.842 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.842 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.842 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.842 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "diskprediction_local", 2024-04-25T13:54:42.842 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.842 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.842 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.842 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.842 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.842 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.842 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.843 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.843 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.843 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.843 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.843 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.843 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.843 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.843 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.843 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.843 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.843 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.843 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.843 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.844 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.844 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.844 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.844 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.844 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.844 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.844 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.844 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.844 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.844 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.844 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.844 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.844 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.844 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.844 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.845 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.845 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.845 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.845 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.845 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.845 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.845 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.845 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.845 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.845 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.845 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.845 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.845 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.846 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.846 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.846 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.846 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.846 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.846 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.846 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.846 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.846 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.846 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.846 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.846 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.846 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.846 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.847 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.847 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.847 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.847 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.847 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.847 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.847 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.847 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.847 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.847 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.847 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.847 INFO:teuthology.orchestra.run.smithi043.stdout: "predict_interval": { 2024-04-25T13:54:42.847 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predict_interval", 2024-04-25T13:54:42.848 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.848 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.848 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.848 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-04-25T13:54:42.848 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.848 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.848 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.848 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.848 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.848 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.848 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.849 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.849 INFO:teuthology.orchestra.run.smithi043.stdout: "predictor_model": { 2024-04-25T13:54:42.849 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predictor_model", 2024-04-25T13:54:42.849 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.849 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.849 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.849 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "prophetstor", 2024-04-25T13:54:42.849 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.849 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.849 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.849 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.849 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.849 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.849 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.849 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.850 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T13:54:42.850 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T13:54:42.850 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.850 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.850 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.850 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T13:54:42.850 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.850 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.850 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.850 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.850 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.850 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.851 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.851 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.851 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.851 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.851 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.851 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.851 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.851 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.851 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.851 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.851 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.851 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.851 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.851 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.852 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.852 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.852 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.852 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.852 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.852 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "influx", 2024-04-25T13:54:42.852 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": false, 2024-04-25T13:54:42.852 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "influxdb python module not found", 2024-04-25T13:54:42.852 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.852 INFO:teuthology.orchestra.run.smithi043.stdout: "batch_size": { 2024-04-25T13:54:42.852 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "batch_size", 2024-04-25T13:54:42.852 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.852 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.852 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.852 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5000", 2024-04-25T13:54:42.853 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.853 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.853 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.853 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-25T13:54:42.853 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.853 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.853 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.853 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.853 INFO:teuthology.orchestra.run.smithi043.stdout: "database": { 2024-04-25T13:54:42.853 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "database", 2024-04-25T13:54:42.853 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.853 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.854 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.854 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "ceph", 2024-04-25T13:54:42.854 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.854 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.854 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.854 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-25T13:54:42.854 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.854 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.854 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.854 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.854 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": { 2024-04-25T13:54:42.854 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hostname", 2024-04-25T13:54:42.855 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.855 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.855 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.855 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.855 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.855 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.855 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.855 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server hostname", 2024-04-25T13:54:42.855 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.855 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.855 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.855 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.856 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T13:54:42.856 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T13:54:42.856 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.856 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.856 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.856 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "30", 2024-04-25T13:54:42.856 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "5", 2024-04-25T13:54:42.856 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.856 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.856 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-25T13:54:42.856 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.856 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.856 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.856 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.857 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.857 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.857 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.857 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.857 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.857 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.857 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.857 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.857 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.857 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.857 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.857 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.857 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.857 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.858 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.858 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.858 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.858 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.858 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.858 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.858 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.858 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.858 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.858 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.858 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.858 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.858 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.858 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.859 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.859 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.859 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.859 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.859 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.859 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.859 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.859 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.859 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.859 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.859 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.859 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.859 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.859 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.861 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.861 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.861 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.861 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.861 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.861 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.861 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.861 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.861 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.861 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.861 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.861 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.861 INFO:teuthology.orchestra.run.smithi043.stdout: "password": { 2024-04-25T13:54:42.862 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "password", 2024-04-25T13:54:42.862 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.862 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.862 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.862 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.862 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.862 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.862 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.862 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "password of InfluxDB server user", 2024-04-25T13:54:42.862 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.862 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.862 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.863 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.863 INFO:teuthology.orchestra.run.smithi043.stdout: "port": { 2024-04-25T13:54:42.863 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "port", 2024-04-25T13:54:42.863 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.863 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.863 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.863 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8086", 2024-04-25T13:54:42.863 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.863 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.863 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.863 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server port", 2024-04-25T13:54:42.863 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.863 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.864 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.864 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.864 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.864 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.864 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.864 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.864 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.864 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.864 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.864 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.864 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.864 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.864 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.864 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.865 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.865 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.865 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-04-25T13:54:42.865 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-04-25T13:54:42.865 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.865 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.865 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.865 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "false", 2024-04-25T13:54:42.865 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.865 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.865 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.865 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T13:54:42.866 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.866 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.866 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.866 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.866 INFO:teuthology.orchestra.run.smithi043.stdout: "threads": { 2024-04-25T13:54:42.866 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threads", 2024-04-25T13:54:42.866 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.866 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.866 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.866 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T13:54:42.866 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T13:54:42.866 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "32", 2024-04-25T13:54:42.866 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.867 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-25T13:54:42.867 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.867 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.867 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.867 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.867 INFO:teuthology.orchestra.run.smithi043.stdout: "username": { 2024-04-25T13:54:42.867 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "username", 2024-04-25T13:54:42.867 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.867 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.867 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.867 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.867 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.868 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.868 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.868 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "username of InfluxDB server user", 2024-04-25T13:54:42.868 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.868 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.868 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.868 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.868 INFO:teuthology.orchestra.run.smithi043.stdout: "verify_ssl": { 2024-04-25T13:54:42.868 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "verify_ssl", 2024-04-25T13:54:42.868 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.868 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.868 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.868 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "true", 2024-04-25T13:54:42.869 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.869 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.869 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.869 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T13:54:42.869 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.869 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.869 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.869 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.869 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.869 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.869 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.869 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "insights", 2024-04-25T13:54:42.869 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.869 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.869 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.870 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.870 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.870 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.870 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.870 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.870 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.870 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.870 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.870 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.870 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.870 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.870 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.870 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.870 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.870 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.871 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.871 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.871 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.871 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.871 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.871 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.871 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.871 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.871 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.871 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.871 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.871 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.871 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.871 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.871 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.872 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.872 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.872 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.872 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.872 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.872 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.872 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.872 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.872 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.872 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.872 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.872 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.872 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.872 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.872 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.872 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.873 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.873 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.873 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.873 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.873 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.873 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.873 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.873 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.873 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.873 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.873 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.873 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.873 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.873 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.873 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.874 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.874 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.874 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.874 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.874 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.874 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.874 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.874 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.874 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.874 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.874 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.874 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.874 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.875 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.875 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.875 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.875 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.875 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.875 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.875 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.875 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.875 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.875 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.875 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.875 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.876 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.876 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "iostat", 2024-04-25T13:54:42.876 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.876 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.876 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.876 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.876 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.876 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.876 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.876 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.876 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.876 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.876 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.876 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.876 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.877 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.877 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.877 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.877 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.877 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.877 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.877 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.877 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.877 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.877 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.877 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.877 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.877 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.878 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.878 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.878 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.878 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.878 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.878 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.878 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.878 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.878 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.878 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.878 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.878 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.878 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.879 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.879 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.879 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.879 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.879 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.879 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.879 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.879 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.879 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.879 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.879 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.879 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.879 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.880 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.880 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.880 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.880 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.880 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.880 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.880 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.880 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.880 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.880 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.880 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.880 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.880 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.880 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.881 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.881 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.881 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.881 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.881 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.881 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.881 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.881 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.881 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.881 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.881 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.881 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.881 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.881 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.881 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.882 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.882 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.882 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.882 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.882 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.882 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.882 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.882 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.882 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.882 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "k8sevents", 2024-04-25T13:54:42.882 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.882 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.882 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.882 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_event_retention_days": { 2024-04-25T13:54:42.883 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ceph_event_retention_days", 2024-04-25T13:54:42.883 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.883 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.883 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.883 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7", 2024-04-25T13:54:42.883 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.883 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.883 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.883 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-25T13:54:42.883 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.883 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.883 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.883 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.883 INFO:teuthology.orchestra.run.smithi043.stdout: "config_check_secs": { 2024-04-25T13:54:42.883 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_check_secs", 2024-04-25T13:54:42.883 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.884 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.884 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.884 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:42.884 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "10", 2024-04-25T13:54:42.884 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.884 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.884 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-25T13:54:42.884 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.884 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.884 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.884 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.884 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.884 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.884 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.885 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.885 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.885 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.885 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.885 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.885 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.885 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.885 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.885 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.885 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.885 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.885 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.885 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.885 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.886 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.886 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.886 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.886 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.886 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.886 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.886 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.886 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.886 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.886 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.886 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.886 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.886 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.886 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.886 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.887 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.887 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.887 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.887 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.887 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.887 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.887 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.887 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.887 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.887 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.887 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.887 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.887 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.887 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.887 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.887 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.888 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.888 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.888 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.888 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.888 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.888 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.888 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.888 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.888 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.888 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.888 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.888 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.888 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.888 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.889 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.889 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.889 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.889 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.889 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.889 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.889 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.889 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.889 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.889 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.889 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.889 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.889 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.889 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.889 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.890 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.890 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.890 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.890 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.890 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.890 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.890 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.890 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.890 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.890 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.890 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "localpool", 2024-04-25T13:54:42.890 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.890 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.890 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: "failure_domain": { 2024-04-25T13:54:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "failure_domain", 2024-04-25T13:54:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "host", 2024-04-25T13:54:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "failure domain for any created local pool", 2024-04-25T13:54:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-25T13:54:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.891 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.892 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.892 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.892 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.892 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.892 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.892 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.892 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.892 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.892 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.892 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.892 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.892 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.892 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.892 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.892 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": { 2024-04-25T13:54:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_size", 2024-04-25T13:54:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default min_size for any created local pool", 2024-04-25T13:54:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-25T13:54:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: "num_rep": { 2024-04-25T13:54:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "num_rep", 2024-04-25T13:54:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3", 2024-04-25T13:54:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default replica count for any created local pool", 2024-04-25T13:54:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": { 2024-04-25T13:54:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_num", 2024-04-25T13:54:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "128", 2024-04-25T13:54:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default pg_num for any created local pool", 2024-04-25T13:54:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: "prefix": { 2024-04-25T13:54:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prefix", 2024-04-25T13:54:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name prefix for any created local pool", 2024-04-25T13:54:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: "subtree": { 2024-04-25T13:54:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "subtree", 2024-04-25T13:54:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "rack", 2024-04-25T13:54:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-25T13:54:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-25T13:54:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mds_autoscaler", 2024-04-25T13:54:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.906 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.906 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.906 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.906 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.906 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.906 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.906 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.906 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.906 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.906 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.906 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.906 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.906 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.906 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.907 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.907 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.907 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.907 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.907 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.907 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.907 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.907 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.907 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.907 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.907 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.907 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.907 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.908 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.908 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.908 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.908 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.908 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.908 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.908 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.908 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.908 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.908 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.908 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.908 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.908 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.908 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.909 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.909 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.909 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.909 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.909 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.909 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.909 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.909 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.909 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.909 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.909 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.909 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.909 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.909 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.910 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.910 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.910 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.910 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.910 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirroring", 2024-04-25T13:54:42.910 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.910 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.910 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.910 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.910 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.910 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.910 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.911 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.911 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.911 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.911 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.911 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.911 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.911 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.911 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.911 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.911 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.911 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.911 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.911 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.911 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.912 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.912 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.912 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.912 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.912 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.912 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.912 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.912 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.912 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.912 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.912 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.912 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.912 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.912 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.912 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.913 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.913 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.913 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.913 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.913 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.913 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.913 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.913 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.913 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.913 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.913 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.913 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.913 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.913 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.914 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.914 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.914 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.914 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.914 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.914 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.914 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.914 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.914 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.914 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.914 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.914 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.915 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.915 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.915 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.915 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.915 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.915 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.915 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.915 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.915 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.915 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.915 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.916 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.916 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.916 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.916 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.916 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.916 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.916 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.916 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.916 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.916 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.916 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.916 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.916 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.916 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.916 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.917 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.917 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.917 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "nfs", 2024-04-25T13:54:42.917 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.917 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.917 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.917 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.917 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.917 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.917 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.917 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.917 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.917 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.917 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.917 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.918 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.919 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.919 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.919 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.919 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.919 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.919 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.919 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.919 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.919 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.919 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.919 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.919 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.919 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.919 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.920 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.920 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.920 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.920 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.920 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.920 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.920 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.920 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.920 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.920 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.920 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.920 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.921 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.921 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.921 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.921 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.921 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.921 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.921 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.921 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.921 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.921 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.921 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.921 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.921 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.922 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.922 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.922 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.922 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.922 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.922 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.922 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.922 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.922 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.922 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.922 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.922 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.923 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.923 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.923 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.923 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.923 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.923 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.923 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.923 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.923 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.923 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.923 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.923 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.923 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.923 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-04-25T13:54:42.924 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.924 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.924 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.924 INFO:teuthology.orchestra.run.smithi043.stdout: "fail_fs": { 2024-04-25T13:54:42.924 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "fail_fs", 2024-04-25T13:54:42.924 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.924 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.924 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.924 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.924 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.924 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.924 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.924 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-25T13:54:42.924 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.924 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.925 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.925 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.925 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.925 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.925 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.925 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.925 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.925 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.925 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.925 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.925 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.925 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.925 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.925 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.925 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.926 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.926 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.926 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.926 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.926 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.926 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.926 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.926 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.926 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.926 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.926 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.926 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.927 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.927 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.927 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.927 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.927 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.927 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.927 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.927 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.927 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.927 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.927 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.927 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.927 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.927 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.927 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.927 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.928 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.928 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.928 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.928 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.928 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.928 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.928 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.928 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.928 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.928 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.928 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.928 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.928 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.929 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.929 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.929 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.929 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.929 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.929 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.929 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.929 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.929 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.929 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.929 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.929 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.929 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.929 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.930 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.930 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.930 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator": { 2024-04-25T13:54:42.930 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-04-25T13:54:42.930 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.930 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.930 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.930 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.930 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.930 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.930 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.930 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm", 2024-04-25T13:54:42.930 INFO:teuthology.orchestra.run.smithi043.stdout: "rook", 2024-04-25T13:54:42.930 INFO:teuthology.orchestra.run.smithi043.stdout: "test_orchestrator" 2024-04-25T13:54:42.931 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.931 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Orchestrator backend", 2024-04-25T13:54:42.931 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.931 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.931 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.931 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.931 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.931 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.931 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.931 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.931 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.931 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.931 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.932 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.932 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.932 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.932 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.932 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.932 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.932 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.932 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.932 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.932 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.932 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_perf_query", 2024-04-25T13:54:42.932 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.932 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.932 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.933 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.933 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.933 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.933 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.933 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.933 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.933 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.933 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.933 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.933 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.933 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.933 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.933 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.933 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.934 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.934 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.934 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.934 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.934 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.934 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.934 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.934 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.934 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.934 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.934 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.934 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.935 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.935 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.935 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.935 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.935 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.935 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.935 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.935 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.935 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.935 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.935 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.935 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.935 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.935 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.935 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.936 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.936 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.936 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.936 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.936 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.936 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.936 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.936 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.936 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.936 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.936 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.936 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.936 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.937 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.937 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.937 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.937 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.937 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.937 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.937 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.937 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.937 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.937 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.937 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.937 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.937 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.938 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.938 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.938 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.938 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.938 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.938 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.938 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.938 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.938 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.938 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.938 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.938 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.938 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.939 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.939 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.939 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.939 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.939 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.939 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.939 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.939 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_support", 2024-04-25T13:54:42.939 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.939 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.939 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.940 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.940 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.940 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.940 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.940 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.940 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.940 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.940 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.940 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.940 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.941 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.941 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.941 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.941 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.941 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.941 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.941 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.941 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.941 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.941 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.941 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.941 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.941 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.941 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.944 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.944 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.944 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.944 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.944 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.944 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.944 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.944 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.944 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.944 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.944 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.944 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.945 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.945 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.945 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.945 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.945 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.945 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.945 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.945 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.945 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.945 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.946 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.946 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.946 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.946 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.946 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.946 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.946 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.946 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.946 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.946 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.946 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.947 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.947 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.947 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.947 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.947 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.947 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_autoscaler", 2024-04-25T13:54:42.947 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.947 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.947 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.947 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.948 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.948 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.948 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.948 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.948 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.948 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.948 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.948 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.948 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.948 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.948 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.948 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.949 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.949 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.949 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.949 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.949 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.949 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.949 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.949 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.949 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.949 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.949 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.949 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.950 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.950 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.950 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.950 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.950 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.950 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.950 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.950 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.950 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.950 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.950 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.950 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.950 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.951 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.951 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.951 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.951 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.951 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.951 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.951 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.951 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.951 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.951 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.951 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.951 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.952 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.952 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.952 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.952 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.952 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.952 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.952 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.952 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.952 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.952 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.952 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.952 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.953 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.953 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.953 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.953 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.953 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.953 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.953 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.953 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.953 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T13:54:42.953 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T13:54:42.953 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.953 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.953 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.954 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T13:54:42.954 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.954 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.954 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.954 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.954 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.954 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.954 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.954 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.954 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.954 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.954 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.954 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.955 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.955 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.955 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.955 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.955 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.955 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.955 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.955 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.955 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.955 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.955 INFO:teuthology.orchestra.run.smithi043.stdout: "threshold": { 2024-04-25T13:54:42.955 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threshold", 2024-04-25T13:54:42.955 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:42.955 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.956 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.956 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-04-25T13:54:42.956 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1.0", 2024-04-25T13:54:42.956 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.956 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.956 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "scaling threshold", 2024-04-25T13:54:42.956 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-25T13:54:42.956 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.956 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.956 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.956 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.956 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.956 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.956 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "progress", 2024-04-25T13:54:42.956 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.957 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.957 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.957 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_pg_recovery_event": { 2024-04-25T13:54:42.957 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_pg_recovery_event", 2024-04-25T13:54:42.957 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.957 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.957 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.957 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.957 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.957 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.957 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.957 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-25T13:54:42.957 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.958 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.958 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.958 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.958 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-04-25T13:54:42.958 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-04-25T13:54:42.958 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.958 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.958 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.958 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.958 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.958 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.958 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.958 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.959 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.959 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.959 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.959 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.959 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.959 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.959 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.959 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.959 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.959 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.959 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.959 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.960 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.960 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.960 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.960 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.960 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.960 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.960 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.960 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.960 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.960 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.960 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.960 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.960 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.960 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.960 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.961 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.961 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.961 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.961 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.961 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.961 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.961 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.961 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.961 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.961 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.961 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.961 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.961 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.961 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.962 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.962 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.962 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.962 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.962 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.962 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.962 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.962 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.962 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.962 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.962 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.963 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.963 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.963 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.963 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.963 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.963 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.963 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.963 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.963 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.963 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.963 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.963 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.964 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.964 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.964 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.964 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.964 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.964 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.964 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.964 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.964 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.964 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.964 INFO:teuthology.orchestra.run.smithi043.stdout: "max_completed_events": { 2024-04-25T13:54:42.964 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_completed_events", 2024-04-25T13:54:42.964 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.965 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.965 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.965 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "50", 2024-04-25T13:54:42.965 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.965 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.965 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.965 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "number of past completed events to remember", 2024-04-25T13:54:42.965 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.965 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.965 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.965 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.965 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T13:54:42.965 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T13:54:42.965 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:42.966 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.966 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.966 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T13:54:42.966 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.966 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.966 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.966 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long the module is going to sleep", 2024-04-25T13:54:42.966 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.966 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.966 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.966 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.966 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.967 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.967 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.967 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.967 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.967 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.967 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.967 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.967 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.967 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.967 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.967 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.967 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.967 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.967 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.968 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.968 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.968 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus", 2024-04-25T13:54:42.968 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.968 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.968 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.968 INFO:teuthology.orchestra.run.smithi043.stdout: "cache": { 2024-04-25T13:54:42.968 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cache", 2024-04-25T13:54:42.968 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.968 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.968 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.968 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.968 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.968 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.969 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.969 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.969 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.969 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.969 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.969 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.969 INFO:teuthology.orchestra.run.smithi043.stdout: "exclude_perf_counters": { 2024-04-25T13:54:42.969 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "exclude_perf_counters", 2024-04-25T13:54:42.969 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.969 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.969 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.969 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.969 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.969 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.969 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.970 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-25T13:54:42.970 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-25T13:54:42.970 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.970 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.970 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.970 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.970 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.970 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.970 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.970 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.970 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.970 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.971 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.971 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.971 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.971 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.971 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.971 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.971 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.971 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.971 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.971 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.971 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.971 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.971 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.971 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.972 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.972 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.972 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.972 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.972 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.972 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.972 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.972 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.972 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.972 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.972 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.972 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.972 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.973 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.973 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.973 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.973 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.973 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.973 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.973 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.973 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.973 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.973 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.973 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.973 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.973 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.973 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.974 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.974 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.974 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.974 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.974 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.974 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.974 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.974 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.974 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.974 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.974 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.974 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.974 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.975 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.975 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.975 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.975 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.975 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.975 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.975 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.975 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.975 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.975 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools": { 2024-04-25T13:54:42.975 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools", 2024-04-25T13:54:42.975 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.975 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.975 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.975 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.975 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.976 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.976 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.976 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.976 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.976 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.976 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.976 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.976 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-25T13:54:42.976 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-25T13:54:42.976 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.976 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.976 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.976 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "300", 2024-04-25T13:54:42.976 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.977 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.977 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.977 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.977 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.977 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.977 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.977 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.977 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_interval": { 2024-04-25T13:54:42.977 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_interval", 2024-04-25T13:54:42.977 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:42.977 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.977 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.977 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15.0", 2024-04-25T13:54:42.977 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.978 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.978 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.978 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.978 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.978 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.978 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.978 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.978 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T13:54:42.978 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T13:54:42.978 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.978 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.978 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.978 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-04-25T13:54:42.979 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.979 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.979 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.979 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-25T13:54:42.979 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.979 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.979 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.979 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.979 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T13:54:42.979 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T13:54:42.979 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.979 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.979 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.979 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "9283", 2024-04-25T13:54:42.979 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.980 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.980 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.980 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-25T13:54:42.980 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.980 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.980 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.980 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.980 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.980 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.980 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.980 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.980 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.980 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.980 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.980 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: "stale_cache_strategy": { 2024-04-25T13:54:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stale_cache_strategy", 2024-04-25T13:54:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "log", 2024-04-25T13:54:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.981 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.982 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.982 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.982 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.982 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.982 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-04-25T13:54:42.982 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-04-25T13:54:42.982 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.982 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.982 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.982 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "default", 2024-04-25T13:54:42.982 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.982 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.982 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.982 INFO:teuthology.orchestra.run.smithi043.stdout: "default", 2024-04-25T13:54:42.983 INFO:teuthology.orchestra.run.smithi043.stdout: "error" 2024-04-25T13:54:42.983 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.983 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.983 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.983 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.983 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.983 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.983 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-04-25T13:54:42.983 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-04-25T13:54:42.983 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.983 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.983 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.983 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-04-25T13:54:42.983 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-04-25T13:54:42.983 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-04-25T13:54:42.984 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.984 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.984 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.984 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.984 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.984 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.984 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.984 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.984 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.984 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_support", 2024-04-25T13:54:42.984 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.984 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.985 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.985 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.985 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.985 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.985 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.985 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.985 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.985 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.985 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.985 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.985 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.985 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.985 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.985 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.985 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.986 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.986 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.986 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.986 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.986 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.986 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.986 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.986 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.986 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.986 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.986 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.986 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.986 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.987 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.987 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.987 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.987 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.987 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.987 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.987 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.987 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.987 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.987 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.987 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.987 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.987 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.987 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:42.987 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.988 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.988 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.988 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.988 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.988 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.988 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.988 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.988 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.988 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.988 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.988 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.988 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.988 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.988 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.988 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:42.989 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:42.989 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.989 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.989 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.989 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.989 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.989 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.989 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.989 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.989 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.990 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.990 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.990 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.990 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_snap_create": { 2024-04-25T13:54:42.990 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_snap_create", 2024-04-25T13:54:42.990 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.990 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.990 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.990 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:42.990 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.990 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.990 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.990 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.991 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.991 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.991 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.991 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.991 INFO:teuthology.orchestra.run.smithi043.stdout: "mirror_snapshot_schedule": { 2024-04-25T13:54:42.991 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirror_snapshot_schedule", 2024-04-25T13:54:42.991 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.991 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.991 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.991 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.991 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.991 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.992 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.992 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.992 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.992 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.992 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.992 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.992 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:42.992 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:42.992 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:42.992 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:42.992 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.992 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:42.992 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.992 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.992 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.993 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.993 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.993 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.993 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.993 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.993 INFO:teuthology.orchestra.run.smithi043.stdout: "trash_purge_schedule": { 2024-04-25T13:54:42.993 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "trash_purge_schedule", 2024-04-25T13:54:42.993 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.993 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.993 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.993 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.993 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.993 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.993 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.994 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.994 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.994 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.994 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.994 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.994 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:42.994 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.994 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:42.994 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "restful", 2024-04-25T13:54:42.994 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:42.994 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:42.994 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:42.995 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_auth": { 2024-04-25T13:54:42.995 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_auth", 2024-04-25T13:54:42.995 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.995 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.995 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.995 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:42.995 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.995 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.995 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.995 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.995 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.995 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.995 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.996 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.996 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-04-25T13:54:42.996 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-04-25T13:54:42.996 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.996 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.996 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:42.996 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.996 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.996 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.996 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.996 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.996 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.996 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.996 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.997 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.997 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:42.997 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:42.997 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.997 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.997 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.997 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:42.997 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.997 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.997 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:42.997 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:42.997 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:42.997 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:42.997 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:42.997 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:42.998 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:42.998 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:42.998 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.998 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.998 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.998 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.998 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.998 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:42.998 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:42.998 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:42.998 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.998 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.998 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:42.998 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:42.999 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:42.999 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:42.999 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:42.999 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:42.999 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:42.999 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:42.999 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:42.999 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:42.999 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:42.999 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:42.999 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:42.999 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:42.999 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.000 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.000 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.000 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.000 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.000 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.000 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.000 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.000 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.000 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.000 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.000 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.000 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.000 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.001 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.001 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.001 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.001 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.001 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.001 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.001 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.001 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.001 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.001 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.001 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.001 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.001 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.001 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.001 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.002 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.002 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T13:54:43.002 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T13:54:43.002 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.002 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.002 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.002 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.002 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.002 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.002 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.002 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.002 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.002 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.003 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.003 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.003 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T13:54:43.003 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T13:54:43.003 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.003 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.003 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.003 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.003 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.003 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.003 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.003 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.003 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.004 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.004 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.004 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.004 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.004 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.004 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.004 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.004 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.004 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.004 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.004 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.004 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.004 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.004 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.005 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.005 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.005 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.005 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.005 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.005 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.005 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rgw", 2024-04-25T13:54:43.005 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.005 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.005 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.005 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.005 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.005 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.006 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.006 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.006 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.006 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.006 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.006 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.006 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.006 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.006 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.006 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.006 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.006 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.006 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.007 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.007 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.007 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.007 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.007 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.007 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.007 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.007 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.007 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.007 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.007 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.007 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.007 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.007 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.008 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.008 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.008 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.008 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.008 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.008 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.008 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.008 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.008 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.008 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.008 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.008 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.008 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.008 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.009 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.009 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.009 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.009 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.009 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.009 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.009 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.009 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.009 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.009 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.009 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.009 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.009 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.009 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.009 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.010 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.010 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.010 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.010 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.010 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.010 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.010 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.010 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.010 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.010 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.010 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.010 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.010 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.011 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.011 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.011 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.011 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.011 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.011 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.011 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.011 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.011 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.011 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.011 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.011 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.011 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.011 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.012 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.012 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rook", 2024-04-25T13:54:43.012 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.012 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.012 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.012 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.012 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.012 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.012 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.012 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.012 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.012 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.012 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.012 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.013 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.013 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.013 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.013 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.013 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.013 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.013 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.013 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.013 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.013 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.013 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.013 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.014 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.014 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.014 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.014 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.014 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.014 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.014 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.014 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.014 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.014 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.014 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.014 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.014 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.015 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.015 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.015 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.015 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.015 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.015 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.015 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.015 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.015 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.015 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.015 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.016 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.016 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.016 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.016 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.016 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.016 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.016 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.016 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.016 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.016 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.016 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.016 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.016 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.016 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.017 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.017 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.017 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.017 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.017 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.017 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.017 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.017 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.017 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.017 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.017 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.017 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.018 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.018 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.018 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.018 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.018 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.018 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.018 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.018 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.018 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.018 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.018 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.018 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.019 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.019 INFO:teuthology.orchestra.run.smithi043.stdout: "storage_class": { 2024-04-25T13:54:43.019 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "storage_class", 2024-04-25T13:54:43.019 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.019 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.019 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.019 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "local", 2024-04-25T13:54:43.019 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.019 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.019 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.020 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-25T13:54:43.020 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.020 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.020 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.020 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.020 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.020 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.020 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.020 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "selftest", 2024-04-25T13:54:43.020 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.020 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.020 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.021 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.021 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.021 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.021 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.021 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.021 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.021 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.021 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.021 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.021 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.021 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.022 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.022 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.022 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.022 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.022 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.022 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.022 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.022 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.022 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.022 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.022 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.023 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.023 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.023 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.023 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.023 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.023 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.023 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.023 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.023 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.023 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.023 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.023 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.023 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.024 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.024 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.024 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.024 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.024 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.024 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.024 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.024 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.024 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.024 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.024 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.024 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.024 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.025 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.025 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.025 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.025 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.025 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.025 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.025 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.025 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.025 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.025 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.025 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.025 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.026 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.026 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.026 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.026 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.026 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.026 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.026 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.026 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.026 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.026 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.026 INFO:teuthology.orchestra.run.smithi043.stdout: "roption1": { 2024-04-25T13:54:43.027 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption1", 2024-04-25T13:54:43.027 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.027 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.027 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.027 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.027 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.027 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.027 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.027 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.027 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.027 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.027 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.027 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.028 INFO:teuthology.orchestra.run.smithi043.stdout: "roption2": { 2024-04-25T13:54:43.028 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption2", 2024-04-25T13:54:43.028 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.028 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.028 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.028 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "xyz", 2024-04-25T13:54:43.028 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.028 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.028 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.028 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.028 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.028 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.028 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.028 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.029 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption1": { 2024-04-25T13:54:43.029 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption1", 2024-04-25T13:54:43.029 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.029 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.029 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.029 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.029 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.029 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.029 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.029 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.030 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.030 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.030 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.030 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.030 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption2": { 2024-04-25T13:54:43.030 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption2", 2024-04-25T13:54:43.030 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.031 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.031 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.031 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.031 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.031 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.031 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.031 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.031 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.031 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.032 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.032 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.032 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption3": { 2024-04-25T13:54:43.032 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption3", 2024-04-25T13:54:43.032 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:43.032 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.032 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.032 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.032 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.032 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.032 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.032 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.032 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.033 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.033 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.033 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.033 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption4": { 2024-04-25T13:54:43.033 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption4", 2024-04-25T13:54:43.033 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.033 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.033 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.033 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.033 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.033 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.033 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.033 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.033 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.033 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.034 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.034 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.034 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption5": { 2024-04-25T13:54:43.034 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption5", 2024-04-25T13:54:43.034 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.034 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.034 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.034 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.034 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.034 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.034 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.034 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.034 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.035 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.035 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.035 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.035 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption6": { 2024-04-25T13:54:43.035 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption6", 2024-04-25T13:54:43.035 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.035 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.035 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.035 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.035 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.035 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.035 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.035 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.035 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.036 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.036 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.036 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.036 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption7": { 2024-04-25T13:54:43.036 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption7", 2024-04-25T13:54:43.036 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.036 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.036 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.036 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.036 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T13:54:43.036 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "42", 2024-04-25T13:54:43.036 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.036 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.037 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.037 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.037 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.037 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.037 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.037 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.037 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.037 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.037 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.037 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.037 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.037 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.037 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.037 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.038 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.038 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.038 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.038 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.038 INFO:teuthology.orchestra.run.smithi043.stdout: "testkey": { 2024-04-25T13:54:43.038 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testkey", 2024-04-25T13:54:43.038 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.038 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.038 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.038 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.038 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.038 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.038 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.039 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.039 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.039 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.039 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.039 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.039 INFO:teuthology.orchestra.run.smithi043.stdout: "testlkey": { 2024-04-25T13:54:43.039 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testlkey", 2024-04-25T13:54:43.039 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.039 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.039 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.039 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.039 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.039 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.039 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.040 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.040 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.040 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.040 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.040 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.040 INFO:teuthology.orchestra.run.smithi043.stdout: "testnewline": { 2024-04-25T13:54:43.040 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testnewline", 2024-04-25T13:54:43.040 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.040 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.040 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.040 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.040 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.040 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.040 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.041 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.041 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.041 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.041 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.041 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.041 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.041 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.041 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.041 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-04-25T13:54:43.041 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.041 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.041 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.041 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_m_granularity": { 2024-04-25T13:54:43.041 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_m_granularity", 2024-04-25T13:54:43.042 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.042 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.042 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.042 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.042 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.042 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.042 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.042 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow minute scheduled snapshots", 2024-04-25T13:54:43.042 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.042 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.042 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.042 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.042 INFO:teuthology.orchestra.run.smithi043.stdout: "dump_on_update": { 2024-04-25T13:54:43.043 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dump_on_update", 2024-04-25T13:54:43.043 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.043 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.043 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.043 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.043 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.043 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.043 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.043 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "dump database to debug log on update", 2024-04-25T13:54:43.043 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.043 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.043 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.043 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.044 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.044 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.044 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.044 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.044 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.044 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.044 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.044 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.044 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.044 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.044 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.044 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.044 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.045 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.045 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.045 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.045 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.045 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.045 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.045 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.045 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.045 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.045 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.045 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.045 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.045 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.046 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.046 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.046 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.046 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.046 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.046 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.046 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.046 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.046 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.046 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.046 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.046 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.046 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.047 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.047 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.047 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.047 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.047 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.047 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.047 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.047 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.047 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.047 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.047 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.047 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.047 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.048 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.048 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.048 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.048 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.048 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.048 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.048 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.048 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.048 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.048 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.048 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.048 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.048 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.048 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.049 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.049 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.049 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.049 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.049 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.049 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.049 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.049 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.049 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.049 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.049 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.049 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.049 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.050 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.050 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.050 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.050 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.050 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.050 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.050 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.050 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.050 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stats", 2024-04-25T13:54:43.050 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.050 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.050 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.050 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.050 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.051 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.051 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.051 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.051 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.051 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.051 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.051 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.051 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.051 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.051 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.051 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.051 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.051 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.051 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.052 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.052 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.052 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.052 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.052 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.052 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.052 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.052 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.052 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.052 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.052 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.052 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.052 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.053 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.053 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.053 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.053 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.053 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.053 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.053 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.053 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.053 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.053 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.053 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.053 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.053 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.054 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.054 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.054 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.054 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.054 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.054 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.054 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.054 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.054 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.054 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.054 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.054 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.054 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.055 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.055 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.055 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.055 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.055 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.055 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.055 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.055 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.055 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.055 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.055 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.055 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.055 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.055 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.056 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.056 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.056 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.056 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.056 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.056 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.056 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.056 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.056 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.056 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.056 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.056 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.056 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.056 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.057 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.057 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.057 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.057 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.057 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "status", 2024-04-25T13:54:43.057 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.057 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.057 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.057 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.057 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.057 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.057 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.057 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.057 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.057 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.058 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.058 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.058 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.058 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.058 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.058 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.058 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.058 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.058 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.058 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.058 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.058 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.058 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.059 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.059 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.059 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.059 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.059 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.059 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.059 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.059 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.059 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.059 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.059 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.059 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.059 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.060 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.060 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.060 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.060 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.060 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.060 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.060 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.060 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.060 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.060 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.060 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.060 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.060 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.060 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.060 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.060 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.061 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.061 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.061 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.061 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.061 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.061 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.061 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.061 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.061 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.061 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.061 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.061 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.061 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.061 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.062 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.062 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.062 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.062 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.062 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.062 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.062 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.062 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.062 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.062 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.062 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.062 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.062 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.063 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.063 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.063 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.063 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.063 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.063 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.063 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.063 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.063 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.063 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.063 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.063 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telegraf", 2024-04-25T13:54:43.064 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.064 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.064 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.064 INFO:teuthology.orchestra.run.smithi043.stdout: "address": { 2024-04-25T13:54:43.064 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "address", 2024-04-25T13:54:43.064 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.064 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.064 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.064 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-25T13:54:43.064 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.064 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.064 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.065 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.065 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.065 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.065 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.065 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.065 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T13:54:43.065 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T13:54:43.065 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.065 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.065 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.065 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15", 2024-04-25T13:54:43.065 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.065 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.066 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.066 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.066 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.066 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.066 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.066 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.066 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.066 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.066 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.066 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.066 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.066 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.066 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.067 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.067 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.067 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.067 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.067 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.067 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.067 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.067 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.067 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.067 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.067 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.067 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.067 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.067 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.067 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.068 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.068 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.068 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.068 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.068 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.068 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.068 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.068 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.068 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.068 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.068 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.068 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.068 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.069 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.069 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.069 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.069 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.069 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.069 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.069 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.069 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.069 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.069 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.069 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.069 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.069 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.069 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.070 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.070 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.070 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.070 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.070 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.070 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.070 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.070 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.070 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.070 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.070 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.070 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.070 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.071 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.071 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.071 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.071 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.071 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.071 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.071 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.071 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.071 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.071 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.071 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.071 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.071 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.071 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telemetry", 2024-04-25T13:54:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.073 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_basic": { 2024-04-25T13:54:43.073 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_basic", 2024-04-25T13:54:43.073 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.073 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.073 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.073 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.073 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.073 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.073 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.073 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-25T13:54:43.073 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.073 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.073 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.073 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.073 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_crash": { 2024-04-25T13:54:43.074 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_crash", 2024-04-25T13:54:43.074 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.074 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.074 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.074 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.074 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.074 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.074 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.074 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-25T13:54:43.074 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.074 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.074 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.074 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.074 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_device": { 2024-04-25T13:54:43.075 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_device", 2024-04-25T13:54:43.075 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.075 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.075 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.075 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.075 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.075 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.075 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.075 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-25T13:54:43.075 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.075 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.075 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.075 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.076 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_ident": { 2024-04-25T13:54:43.076 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_ident", 2024-04-25T13:54:43.076 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.076 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.076 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.076 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.076 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.076 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.076 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.076 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-25T13:54:43.076 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.077 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.077 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.077 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.077 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_perf": { 2024-04-25T13:54:43.077 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_perf", 2024-04-25T13:54:43.077 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.077 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.077 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.077 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.078 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.078 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.078 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.078 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-25T13:54:43.078 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.079 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.079 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.079 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.079 INFO:teuthology.orchestra.run.smithi043.stdout: "contact": { 2024-04-25T13:54:43.079 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "contact", 2024-04-25T13:54:43.080 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.080 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.080 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.080 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.080 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.080 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.080 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.080 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.080 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.080 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.080 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.080 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.081 INFO:teuthology.orchestra.run.smithi043.stdout: "description": { 2024-04-25T13:54:43.081 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "description", 2024-04-25T13:54:43.081 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.081 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.081 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.081 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.081 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.081 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.081 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.081 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.081 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.081 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.081 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.082 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.082 INFO:teuthology.orchestra.run.smithi043.stdout: "device_url": { 2024-04-25T13:54:43.082 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_url", 2024-04-25T13:54:43.082 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.082 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.082 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.083 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-25T13:54:43.083 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.083 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.083 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.083 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.083 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.083 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.083 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.084 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.084 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-04-25T13:54:43.084 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-04-25T13:54:43.084 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.084 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.084 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.084 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.084 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.084 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.084 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.085 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.085 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.085 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.085 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.085 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.085 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T13:54:43.085 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T13:54:43.085 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.085 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.086 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.086 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "24", 2024-04-25T13:54:43.086 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "8", 2024-04-25T13:54:43.086 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.086 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.086 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.086 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.086 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.086 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.086 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.087 INFO:teuthology.orchestra.run.smithi043.stdout: "last_opt_revision": { 2024-04-25T13:54:43.087 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "last_opt_revision", 2024-04-25T13:54:43.087 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.087 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.087 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.087 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1", 2024-04-25T13:54:43.088 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.088 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.088 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.088 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.088 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.088 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.088 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.088 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.088 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard": { 2024-04-25T13:54:43.088 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard", 2024-04-25T13:54:43.089 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.089 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.089 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.089 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.089 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.089 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.089 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.090 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.090 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.090 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.090 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.090 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.090 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard_description": { 2024-04-25T13:54:43.090 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard_description", 2024-04-25T13:54:43.090 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.090 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.091 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.091 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.091 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.091 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.091 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.091 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.091 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.091 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.091 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.091 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.091 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.092 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.092 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.092 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.092 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.092 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.092 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.092 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.092 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.092 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.092 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.092 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.092 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.092 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.092 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.093 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.093 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.093 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.093 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.093 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.093 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.093 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.093 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.093 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.093 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.093 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.093 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.093 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.093 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.094 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.094 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.094 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.094 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.094 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.094 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.094 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.094 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.094 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.094 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.094 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.094 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.094 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.095 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.095 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.095 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.095 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.095 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.095 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.095 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.095 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.095 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.095 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.095 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.095 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.095 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.095 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.096 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.096 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.096 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.096 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.096 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.096 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.096 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.096 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.096 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.096 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.096 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.096 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.096 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.096 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.097 INFO:teuthology.orchestra.run.smithi043.stdout: "organization": { 2024-04-25T13:54:43.097 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "organization", 2024-04-25T13:54:43.097 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.097 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.097 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.097 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.097 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.097 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.097 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.097 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.097 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.097 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.097 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.098 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.098 INFO:teuthology.orchestra.run.smithi043.stdout: "proxy": { 2024-04-25T13:54:43.098 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "proxy", 2024-04-25T13:54:43.098 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.098 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.098 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.098 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.098 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.098 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.098 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.098 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.098 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.098 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.099 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.099 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.099 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.099 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.099 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.099 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.099 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.099 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.099 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.099 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.099 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.099 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.099 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.100 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.100 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.100 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.100 INFO:teuthology.orchestra.run.smithi043.stdout: "url": { 2024-04-25T13:54:43.100 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url", 2024-04-25T13:54:43.100 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.100 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.100 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.100 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-25T13:54:43.100 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.100 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.100 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.100 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.100 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.101 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.101 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.101 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.101 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.101 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.101 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.101 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "test_orchestrator", 2024-04-25T13:54:43.101 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.101 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.101 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.101 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.101 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.101 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.102 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.102 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.102 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.102 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.102 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.102 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.102 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.102 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.102 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.102 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.102 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.102 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.103 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.103 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.103 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.103 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.103 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.103 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.103 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.103 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.103 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.103 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.103 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.103 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.103 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.104 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.104 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.104 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.104 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.104 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.104 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.104 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.104 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.104 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.104 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.104 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.104 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.104 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.105 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.105 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.105 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.105 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.105 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.105 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.105 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.105 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.105 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.105 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.105 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.105 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.105 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.106 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.106 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.106 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.106 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.106 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.106 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.106 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.106 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.106 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.106 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.106 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.106 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.106 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.107 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.107 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.107 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.107 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.107 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.107 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.107 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.107 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.107 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.107 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.107 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.107 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.107 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.107 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.108 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.108 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.108 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.108 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.108 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.108 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.108 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "volumes", 2024-04-25T13:54:43.108 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.108 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.108 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.108 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.108 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.108 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.108 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.109 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.109 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.109 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.109 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.109 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.109 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.109 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.109 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.109 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.109 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.109 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.109 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.109 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.109 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.110 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.110 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.110 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.110 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.110 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.110 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.110 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.110 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.110 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.110 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.110 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.110 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.110 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.111 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.111 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.111 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.111 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.111 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.111 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.111 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.111 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.111 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.111 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.111 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.111 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.111 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.111 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.112 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.112 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.112 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.112 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.112 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.112 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.112 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.112 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.112 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.112 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.112 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.112 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.112 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.112 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.113 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.113 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.113 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.113 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.113 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.113 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.113 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.113 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.113 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.113 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.113 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.113 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_clones": { 2024-04-25T13:54:43.113 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_clones", 2024-04-25T13:54:43.113 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.114 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.114 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.114 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4", 2024-04-25T13:54:43.114 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.114 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.114 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.114 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-25T13:54:43.114 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.114 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.114 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.114 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.114 INFO:teuthology.orchestra.run.smithi043.stdout: "periodic_async_work": { 2024-04-25T13:54:43.114 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "periodic_async_work", 2024-04-25T13:54:43.115 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.115 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.115 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.115 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.115 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.115 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.115 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.115 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Periodically check for async work", 2024-04-25T13:54:43.115 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.115 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.115 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.115 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.115 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_delay": { 2024-04-25T13:54:43.116 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_delay", 2024-04-25T13:54:43.116 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.116 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.116 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.116 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.116 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.116 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.116 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.116 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-25T13:54:43.116 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.116 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.117 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.117 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.117 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_no_wait": { 2024-04-25T13:54:43.117 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_no_wait", 2024-04-25T13:54:43.117 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.117 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.117 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.117 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.117 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.117 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.117 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.117 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-25T13:54:43.117 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.117 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.117 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.118 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.118 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.118 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.118 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.118 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.118 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.118 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.118 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.118 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.118 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.118 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.118 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.118 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.119 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.119 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.119 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.119 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.119 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.119 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix", 2024-04-25T13:54:43.119 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.119 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.119 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.119 INFO:teuthology.orchestra.run.smithi043.stdout: "discovery_interval": { 2024-04-25T13:54:43.119 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "discovery_interval", 2024-04-25T13:54:43.119 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T13:54:43.119 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.119 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.119 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "100", 2024-04-25T13:54:43.120 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.120 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.120 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.120 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.120 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.120 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.120 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.120 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.120 INFO:teuthology.orchestra.run.smithi043.stdout: "identifier": { 2024-04-25T13:54:43.120 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "identifier", 2024-04-25T13:54:43.120 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.120 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.120 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.120 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.121 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.121 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.121 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.121 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.121 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.121 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.121 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.121 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.121 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T13:54:43.121 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T13:54:43.121 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.121 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.121 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.122 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T13:54:43.122 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.122 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.122 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.122 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.122 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.122 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.122 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.122 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.122 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.122 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.122 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.122 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.122 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.122 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.123 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.123 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.123 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.123 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.123 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.123 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.123 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.123 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.123 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.123 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.123 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.123 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.123 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.124 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.124 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.124 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.124 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.124 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.124 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.124 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.124 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.124 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.124 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.124 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.124 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.124 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.125 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.125 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.125 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.125 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.125 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.125 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.125 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.125 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.125 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.125 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.125 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.125 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.125 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.125 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.126 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.126 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.126 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.126 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.126 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.126 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.126 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.126 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.126 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.126 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.126 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.126 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.126 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.127 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.127 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.127 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.127 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.127 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.127 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.127 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.127 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.127 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.127 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.127 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.127 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.127 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.128 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.128 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.128 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.128 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.128 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.128 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.128 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.128 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.128 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.128 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.128 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.128 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.128 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_host": { 2024-04-25T13:54:43.129 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_host", 2024-04-25T13:54:43.129 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.129 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.129 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.129 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.129 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.129 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.129 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.129 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.129 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.129 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.129 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.129 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.130 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_port": { 2024-04-25T13:54:43.130 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_port", 2024-04-25T13:54:43.130 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.130 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.130 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.130 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10051", 2024-04-25T13:54:43.130 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.130 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.130 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.130 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.130 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.130 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.130 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.131 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.131 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_sender": { 2024-04-25T13:54:43.131 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_sender", 2024-04-25T13:54:43.131 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.131 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.131 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.131 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-25T13:54:43.131 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.131 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.131 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.131 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.131 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.131 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.131 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.132 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.132 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.132 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.132 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T13:54:43.132 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.132 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.132 INFO:teuthology.orchestra.run.smithi043.stdout: "modules": [ 2024-04-25T13:54:43.132 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm", 2024-04-25T13:54:43.132 INFO:teuthology.orchestra.run.smithi043.stdout: "dashboard", 2024-04-25T13:54:43.132 INFO:teuthology.orchestra.run.smithi043.stdout: "iostat", 2024-04-25T13:54:43.132 INFO:teuthology.orchestra.run.smithi043.stdout: "nfs", 2024-04-25T13:54:43.132 INFO:teuthology.orchestra.run.smithi043.stdout: "restful", 2024-04-25T13:54:43.132 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_schedule" 2024-04-25T13:54:43.132 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.133 INFO:teuthology.orchestra.run.smithi043.stdout: "available_modules": [ 2024-04-25T13:54:43.133 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.133 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "alerts", 2024-04-25T13:54:43.133 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.133 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.133 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.133 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T13:54:43.133 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T13:54:43.133 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.133 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.133 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.133 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T13:54:43.133 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.133 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.134 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.134 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How frequently to reexamine health status", 2024-04-25T13:54:43.134 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.134 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.134 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.134 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.134 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.134 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.134 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.134 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.134 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.134 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.134 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.135 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.135 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.135 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.135 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.135 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.135 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.135 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.135 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.135 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.135 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.135 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.135 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.135 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.136 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.136 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.136 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.136 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.136 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.136 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.136 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.136 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.136 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.136 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.136 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.136 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.137 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.137 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.137 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.137 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.137 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.137 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.137 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.137 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.137 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.137 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.137 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.137 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.137 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.138 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.138 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.138 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.138 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.138 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.138 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.138 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.138 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.138 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.138 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.139 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.139 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.139 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.139 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.139 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.139 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.139 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.139 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.139 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.139 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.139 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.139 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.140 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.140 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.140 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.140 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_destination": { 2024-04-25T13:54:43.140 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_destination", 2024-04-25T13:54:43.140 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.140 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.140 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.140 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.140 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.140 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.140 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.141 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email address to send alerts to", 2024-04-25T13:54:43.141 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.141 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.141 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.141 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.141 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_from_name": { 2024-04-25T13:54:43.141 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_from_name", 2024-04-25T13:54:43.141 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.141 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.141 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.141 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "Ceph", 2024-04-25T13:54:43.141 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.141 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.141 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.142 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email From: name", 2024-04-25T13:54:43.142 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.142 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.142 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.142 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.142 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_host": { 2024-04-25T13:54:43.142 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_host", 2024-04-25T13:54:43.142 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.142 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.142 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.142 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.142 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.142 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.143 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.143 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP server", 2024-04-25T13:54:43.143 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.143 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.143 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.143 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.143 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_password": { 2024-04-25T13:54:43.143 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_password", 2024-04-25T13:54:43.143 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.143 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.143 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.143 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.143 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.144 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.144 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.144 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Password to authenticate with", 2024-04-25T13:54:43.144 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.144 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.144 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.144 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.144 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_port": { 2024-04-25T13:54:43.144 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_port", 2024-04-25T13:54:43.144 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.144 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.144 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.144 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "465", 2024-04-25T13:54:43.145 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.145 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.145 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.145 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP port", 2024-04-25T13:54:43.145 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.145 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.145 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.145 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.145 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_sender": { 2024-04-25T13:54:43.145 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_sender", 2024-04-25T13:54:43.145 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.145 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.145 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.145 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.146 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.146 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.146 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.146 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP envelope sender", 2024-04-25T13:54:43.146 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.146 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.146 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.146 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.146 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_ssl": { 2024-04-25T13:54:43.146 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_ssl", 2024-04-25T13:54:43.146 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.146 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.147 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.147 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.147 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.147 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.147 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.147 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-25T13:54:43.147 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.147 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.147 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.147 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.147 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_user": { 2024-04-25T13:54:43.147 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_user", 2024-04-25T13:54:43.147 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.148 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.148 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.148 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.148 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.148 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.148 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.148 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "User to authenticate as", 2024-04-25T13:54:43.148 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.148 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.148 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.148 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.148 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.148 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.148 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.149 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.149 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.149 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.149 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.149 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.149 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.149 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.149 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.149 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.149 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.149 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.149 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.150 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.150 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.150 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "balancer", 2024-04-25T13:54:43.150 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.150 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.150 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.150 INFO:teuthology.orchestra.run.smithi043.stdout: "active": { 2024-04-25T13:54:43.150 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "active", 2024-04-25T13:54:43.150 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.150 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.150 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.150 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.150 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.151 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.151 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.151 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically balance PGs across cluster", 2024-04-25T13:54:43.151 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.151 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.151 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.151 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.151 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_time": { 2024-04-25T13:54:43.151 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_time", 2024-04-25T13:54:43.151 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.151 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.151 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.151 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0000", 2024-04-25T13:54:43.152 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.152 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.152 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.152 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "beginning time of day to automatically balance", 2024-04-25T13:54:43.152 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T13:54:43.152 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.152 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.152 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.152 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_weekday": { 2024-04-25T13:54:43.152 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_weekday", 2024-04-25T13:54:43.152 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T13:54:43.152 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.152 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.152 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.153 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-04-25T13:54:43.153 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-04-25T13:54:43.153 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.153 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-25T13:54:43.153 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T13:54:43.153 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.153 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.153 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.153 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_max_iterations": { 2024-04-25T13:54:43.153 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_max_iterations", 2024-04-25T13:54:43.153 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T13:54:43.153 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.153 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.154 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "25", 2024-04-25T13:54:43.154 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T13:54:43.154 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "250", 2024-04-25T13:54:43.154 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.154 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-25T13:54:43.154 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.154 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.154 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.154 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.154 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_metrics": { 2024-04-25T13:54:43.154 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_metrics", 2024-04-25T13:54:43.154 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.155 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.155 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.155 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "pgs,objects,bytes", 2024-04-25T13:54:43.155 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.155 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.155 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.155 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-25T13:54:43.155 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-25T13:54:43.155 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.155 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.155 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.155 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_step": { 2024-04-25T13:54:43.155 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_step", 2024-04-25T13:54:43.155 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:43.156 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.156 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.156 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.5", 2024-04-25T13:54:43.156 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0.001", 2024-04-25T13:54:43.156 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "0.999", 2024-04-25T13:54:43.156 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.156 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "aggressiveness of optimization", 2024-04-25T13:54:43.156 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-25T13:54:43.156 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.156 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.156 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.156 INFO:teuthology.orchestra.run.smithi043.stdout: "end_time": { 2024-04-25T13:54:43.156 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_time", 2024-04-25T13:54:43.157 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.157 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.157 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.157 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2359", 2024-04-25T13:54:43.157 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.157 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.157 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.157 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ending time of day to automatically balance", 2024-04-25T13:54:43.157 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T13:54:43.157 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.157 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.157 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.157 INFO:teuthology.orchestra.run.smithi043.stdout: "end_weekday": { 2024-04-25T13:54:43.158 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_weekday", 2024-04-25T13:54:43.158 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T13:54:43.158 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.158 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.158 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.158 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-04-25T13:54:43.158 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-04-25T13:54:43.158 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.158 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-25T13:54:43.158 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T13:54:43.158 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.158 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.158 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.159 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.159 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.159 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.159 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.159 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.159 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.159 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.159 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.159 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.159 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.159 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.159 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.159 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.159 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.160 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.160 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.160 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.160 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.160 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.160 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.160 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.160 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.160 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.160 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.160 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.160 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.160 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.160 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.161 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.161 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.161 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.161 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.161 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.161 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.161 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.161 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.161 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.161 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.161 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.161 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.161 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.161 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.161 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.162 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.162 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.162 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.162 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.162 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.162 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.162 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.162 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.162 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.162 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.162 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.162 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.162 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.163 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.163 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.163 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.163 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.163 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.163 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.163 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.163 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.163 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.163 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.163 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.163 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.163 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.163 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.163 INFO:teuthology.orchestra.run.smithi043.stdout: "min_score": { 2024-04-25T13:54:43.164 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_score", 2024-04-25T13:54:43.164 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:43.164 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.164 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.164 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.164 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.164 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.164 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.164 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-25T13:54:43.164 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.164 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.164 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.164 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.164 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-04-25T13:54:43.164 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-04-25T13:54:43.165 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.165 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.165 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.165 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "upmap", 2024-04-25T13:54:43.165 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.165 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.165 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.165 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-compat", 2024-04-25T13:54:43.165 INFO:teuthology.orchestra.run.smithi043.stdout: "none", 2024-04-25T13:54:43.165 INFO:teuthology.orchestra.run.smithi043.stdout: "read", 2024-04-25T13:54:43.165 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap", 2024-04-25T13:54:43.165 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap-read" 2024-04-25T13:54:43.165 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.166 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Balancer mode", 2024-04-25T13:54:43.166 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.166 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.166 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.166 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.166 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_ids": { 2024-04-25T13:54:43.166 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_ids", 2024-04-25T13:54:43.166 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.166 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.166 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.166 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.166 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.166 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.166 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.167 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-25T13:54:43.167 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.167 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.167 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.167 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.167 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T13:54:43.167 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T13:54:43.167 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.167 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.167 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.167 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T13:54:43.167 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.167 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.167 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.167 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-25T13:54:43.168 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.168 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.168 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.168 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.168 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.168 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.168 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.168 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.168 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.168 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.168 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.168 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.168 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.168 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.169 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.169 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.169 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.169 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.169 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_deviation": { 2024-04-25T13:54:43.169 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_deviation", 2024-04-25T13:54:43.169 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.169 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.169 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.169 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T13:54:43.169 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T13:54:43.169 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.169 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.169 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-25T13:54:43.170 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-25T13:54:43.170 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.170 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.170 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.170 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_optimizations": { 2024-04-25T13:54:43.170 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_optimizations", 2024-04-25T13:54:43.170 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T13:54:43.170 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.170 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.170 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:43.170 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.170 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.170 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.171 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-25T13:54:43.171 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.171 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.171 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.171 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.171 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.171 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.171 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.171 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm", 2024-04-25T13:54:43.171 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.171 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.171 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.172 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_down_multiplier": { 2024-04-25T13:54:43.172 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_down_multiplier", 2024-04-25T13:54:43.172 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:43.172 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.172 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.172 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-04-25T13:54:43.172 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.172 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.172 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.172 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-25T13:54:43.172 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.172 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.172 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.172 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.173 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_refresh_rate": { 2024-04-25T13:54:43.173 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_refresh_rate", 2024-04-25T13:54:43.173 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.173 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.173 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.173 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "20", 2024-04-25T13:54:43.173 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.173 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.173 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.173 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-25T13:54:43.173 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.173 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.173 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.174 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.174 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_starting_port": { 2024-04-25T13:54:43.174 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_starting_port", 2024-04-25T13:54:43.174 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.174 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.174 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.174 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4721", 2024-04-25T13:54:43.174 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.174 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.174 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.174 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-25T13:54:43.174 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.174 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.175 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.175 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.175 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_ptrace": { 2024-04-25T13:54:43.175 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_ptrace", 2024-04-25T13:54:43.175 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.175 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.175 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.175 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.175 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.175 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.175 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.175 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-25T13:54:43.175 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-25T13:54:43.176 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.176 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.176 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.176 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_interval": { 2024-04-25T13:54:43.176 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_interval", 2024-04-25T13:54:43.176 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.176 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.176 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.176 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T13:54:43.176 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.176 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.176 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.177 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-25T13:54:43.177 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.177 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.177 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.177 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.177 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_memory_target_ratio": { 2024-04-25T13:54:43.177 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_memory_target_ratio", 2024-04-25T13:54:43.177 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:43.177 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.177 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.177 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.7", 2024-04-25T13:54:43.177 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.177 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.177 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.178 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-25T13:54:43.178 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.178 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.178 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.178 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.178 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm_log_destination": { 2024-04-25T13:54:43.178 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm_log_destination", 2024-04-25T13:54:43.178 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.178 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.178 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.178 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.178 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.178 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.179 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.179 INFO:teuthology.orchestra.run.smithi043.stdout: "file", 2024-04-25T13:54:43.179 INFO:teuthology.orchestra.run.smithi043.stdout: "file,syslog", 2024-04-25T13:54:43.179 INFO:teuthology.orchestra.run.smithi043.stdout: "syslog" 2024-04-25T13:54:43.179 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.179 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-25T13:54:43.179 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.179 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.179 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.179 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.179 INFO:teuthology.orchestra.run.smithi043.stdout: "cgroups_split": { 2024-04-25T13:54:43.179 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cgroups_split", 2024-04-25T13:54:43.179 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.180 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.180 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.180 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.180 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.180 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.180 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.180 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-25T13:54:43.180 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.180 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.180 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.180 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.180 INFO:teuthology.orchestra.run.smithi043.stdout: "config_checks_enabled": { 2024-04-25T13:54:43.180 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_checks_enabled", 2024-04-25T13:54:43.180 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.180 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.181 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.181 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.181 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.181 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.181 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.181 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-25T13:54:43.181 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.181 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.181 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.181 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.181 INFO:teuthology.orchestra.run.smithi043.stdout: "config_dashboard": { 2024-04-25T13:54:43.181 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_dashboard", 2024-04-25T13:54:43.181 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.182 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.182 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.182 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.182 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.182 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.182 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.182 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-25T13:54:43.182 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.182 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.182 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.182 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.182 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_alertmanager": { 2024-04-25T13:54:43.182 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_alertmanager", 2024-04-25T13:54:43.182 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.183 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.183 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.183 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-25T13:54:43.183 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.183 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.183 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.183 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T13:54:43.183 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.183 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.183 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.183 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.183 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_base": { 2024-04-25T13:54:43.183 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_base", 2024-04-25T13:54:43.183 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.183 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.184 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.184 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-25T13:54:43.184 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.184 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.184 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.184 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Container image name, without the tag", 2024-04-25T13:54:43.184 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.184 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.184 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.184 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.184 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_elasticsearch": { 2024-04-25T13:54:43.184 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_elasticsearch", 2024-04-25T13:54:43.184 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.184 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.184 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.185 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-25T13:54:43.185 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.185 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.185 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.185 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "elasticsearch container image", 2024-04-25T13:54:43.185 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.185 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.185 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.185 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.185 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_grafana": { 2024-04-25T13:54:43.185 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_grafana", 2024-04-25T13:54:43.185 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.185 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.185 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.185 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-25T13:54:43.186 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.186 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.186 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.186 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T13:54:43.186 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.186 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.186 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.186 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.186 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_haproxy": { 2024-04-25T13:54:43.186 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_haproxy", 2024-04-25T13:54:43.186 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.186 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.186 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.186 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-25T13:54:43.186 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.187 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.187 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.187 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "HAproxy container image", 2024-04-25T13:54:43.187 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.187 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.187 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.187 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.187 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_agent": { 2024-04-25T13:54:43.187 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_agent", 2024-04-25T13:54:43.187 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.187 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.187 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.187 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-25T13:54:43.187 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.187 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.188 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.188 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger agent container image", 2024-04-25T13:54:43.188 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.188 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.188 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.188 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.188 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_collector": { 2024-04-25T13:54:43.188 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_collector", 2024-04-25T13:54:43.188 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.188 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.188 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.188 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-25T13:54:43.188 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.188 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.188 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.189 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger collector container image", 2024-04-25T13:54:43.189 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.189 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.189 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.189 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.189 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_query": { 2024-04-25T13:54:43.189 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_query", 2024-04-25T13:54:43.189 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.189 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.189 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.189 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-25T13:54:43.189 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.189 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.189 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.190 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger query container image", 2024-04-25T13:54:43.190 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.190 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.190 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.190 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.190 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_keepalived": { 2024-04-25T13:54:43.190 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_keepalived", 2024-04-25T13:54:43.190 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.190 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.190 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.190 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-25T13:54:43.190 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.191 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.191 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.191 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Keepalived container image", 2024-04-25T13:54:43.191 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.191 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.191 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.191 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.191 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_loki": { 2024-04-25T13:54:43.191 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_loki", 2024-04-25T13:54:43.191 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.191 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.191 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.191 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-25T13:54:43.191 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.192 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.192 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.192 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Loki container image", 2024-04-25T13:54:43.192 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.192 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.192 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.192 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.192 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_node_exporter": { 2024-04-25T13:54:43.192 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_node_exporter", 2024-04-25T13:54:43.192 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.192 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.192 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.192 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-25T13:54:43.193 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.193 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.193 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.193 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T13:54:43.193 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.193 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.193 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.193 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.193 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_nvmeof": { 2024-04-25T13:54:43.193 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_nvmeof", 2024-04-25T13:54:43.193 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.193 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.193 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.193 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-25T13:54:43.194 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.194 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.194 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.194 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Nvme-of container image", 2024-04-25T13:54:43.194 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.194 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.194 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.194 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.194 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_prometheus": { 2024-04-25T13:54:43.194 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_prometheus", 2024-04-25T13:54:43.194 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.194 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.194 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.195 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-25T13:54:43.195 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.195 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.195 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.195 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T13:54:43.195 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.195 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.195 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.195 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.195 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_promtail": { 2024-04-25T13:54:43.195 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_promtail", 2024-04-25T13:54:43.195 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.195 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.196 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.196 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-25T13:54:43.196 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.196 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.196 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.196 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Promtail container image", 2024-04-25T13:54:43.196 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.196 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.196 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.196 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.196 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_samba": { 2024-04-25T13:54:43.196 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_samba", 2024-04-25T13:54:43.196 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.197 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.197 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.197 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-25T13:54:43.197 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.197 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.197 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.197 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Samba/SMB container image", 2024-04-25T13:54:43.197 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.197 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.197 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.197 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.197 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_snmp_gateway": { 2024-04-25T13:54:43.197 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_snmp_gateway", 2024-04-25T13:54:43.197 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.197 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.198 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.198 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-25T13:54:43.198 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.198 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.198 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.198 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SNMP Gateway container image", 2024-04-25T13:54:43.198 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.198 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.198 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.198 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.198 INFO:teuthology.orchestra.run.smithi043.stdout: "container_init": { 2024-04-25T13:54:43.198 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_init", 2024-04-25T13:54:43.198 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.198 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.199 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.199 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.199 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.199 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.199 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.199 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Run podman/docker with `--init`", 2024-04-25T13:54:43.199 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.199 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.199 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.199 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.199 INFO:teuthology.orchestra.run.smithi043.stdout: "daemon_cache_timeout": { 2024-04-25T13:54:43.199 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "daemon_cache_timeout", 2024-04-25T13:54:43.200 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.200 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.200 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.200 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T13:54:43.200 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.200 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.200 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.200 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-25T13:54:43.200 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.200 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.200 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.200 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.200 INFO:teuthology.orchestra.run.smithi043.stdout: "default_cephadm_command_timeout": { 2024-04-25T13:54:43.200 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_cephadm_command_timeout", 2024-04-25T13:54:43.200 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.201 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.201 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.201 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "900", 2024-04-25T13:54:43.201 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.201 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.201 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.201 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-25T13:54:43.201 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.201 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.201 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.201 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.201 INFO:teuthology.orchestra.run.smithi043.stdout: "default_registry": { 2024-04-25T13:54:43.201 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_registry", 2024-04-25T13:54:43.201 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.202 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.202 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.202 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io", 2024-04-25T13:54:43.202 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.202 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.202 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.202 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-25T13:54:43.202 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.202 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.202 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.202 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.202 INFO:teuthology.orchestra.run.smithi043.stdout: "device_cache_timeout": { 2024-04-25T13:54:43.202 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_cache_timeout", 2024-04-25T13:54:43.202 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.202 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.203 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.203 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1800", 2024-04-25T13:54:43.203 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.203 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.203 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.203 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache device inventory", 2024-04-25T13:54:43.203 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.203 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.203 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.203 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.203 INFO:teuthology.orchestra.run.smithi043.stdout: "device_enhanced_scan": { 2024-04-25T13:54:43.203 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_enhanced_scan", 2024-04-25T13:54:43.203 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.203 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.203 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.204 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.204 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.204 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.204 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.204 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-25T13:54:43.204 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.204 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.204 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.204 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.204 INFO:teuthology.orchestra.run.smithi043.stdout: "facts_cache_timeout": { 2024-04-25T13:54:43.204 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "facts_cache_timeout", 2024-04-25T13:54:43.204 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.204 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.205 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.205 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T13:54:43.205 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.205 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.205 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.205 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache host facts data", 2024-04-25T13:54:43.205 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.205 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.205 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.205 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.205 INFO:teuthology.orchestra.run.smithi043.stdout: "grafana_dashboards_path": { 2024-04-25T13:54:43.205 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "grafana_dashboards_path", 2024-04-25T13:54:43.205 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.206 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.206 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.206 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-25T13:54:43.206 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.206 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.206 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.206 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-25T13:54:43.206 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.206 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.206 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.206 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.206 INFO:teuthology.orchestra.run.smithi043.stdout: "host_check_interval": { 2024-04-25T13:54:43.206 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "host_check_interval", 2024-04-25T13:54:43.207 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.207 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.207 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.207 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T13:54:43.207 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.207 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.207 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.207 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to perform a host check", 2024-04-25T13:54:43.207 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.207 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.207 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.207 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.207 INFO:teuthology.orchestra.run.smithi043.stdout: "hw_monitoring": { 2024-04-25T13:54:43.208 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hw_monitoring", 2024-04-25T13:54:43.208 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.208 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.208 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.208 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.208 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.208 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.208 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.208 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-25T13:54:43.208 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.208 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.208 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.209 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.209 INFO:teuthology.orchestra.run.smithi043.stdout: "inventory_list_all": { 2024-04-25T13:54:43.209 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "inventory_list_all", 2024-04-25T13:54:43.209 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.209 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.209 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.209 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.209 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.209 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.209 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.209 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-25T13:54:43.209 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.209 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.209 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.209 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.210 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.210 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.210 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.210 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.210 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.210 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.210 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.210 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.210 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.210 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.210 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.210 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.210 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.211 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.211 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.211 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.211 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.211 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.211 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.211 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.211 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.211 INFO:teuthology.orchestra.run.smithi043.stdout: "log_refresh_metadata": { 2024-04-25T13:54:43.211 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_refresh_metadata", 2024-04-25T13:54:43.211 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.211 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.211 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.211 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.212 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.212 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.212 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.212 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-25T13:54:43.212 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.212 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.212 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.212 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.212 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.212 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.212 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.212 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.212 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.212 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.213 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.213 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.213 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.213 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-25T13:54:43.213 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.213 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.213 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.213 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.213 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.213 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.213 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.213 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.213 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.213 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.214 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.214 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.214 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.214 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.214 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.214 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.214 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.214 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.214 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.214 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.214 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.214 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.214 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.215 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.215 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.215 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.215 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.215 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.215 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.215 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.215 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.215 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.215 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.215 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.215 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.215 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.215 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.216 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.216 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.216 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-25T13:54:43.216 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-25T13:54:43.216 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.216 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.216 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.216 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.216 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.216 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.217 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.217 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-25T13:54:43.217 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.217 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.217 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.217 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.217 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-25T13:54:43.217 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-25T13:54:43.217 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.217 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.217 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.217 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "*", 2024-04-25T13:54:43.217 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.217 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.218 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.218 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-25T13:54:43.218 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.218 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.218 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.218 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.218 INFO:teuthology.orchestra.run.smithi043.stdout: "max_count_per_host": { 2024-04-25T13:54:43.218 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_count_per_host", 2024-04-25T13:54:43.218 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.218 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.218 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.219 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:43.219 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.219 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.219 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.219 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of daemons per service per host", 2024-04-25T13:54:43.219 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.219 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.219 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.219 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.219 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd_draining_count": { 2024-04-25T13:54:43.219 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_osd_draining_count", 2024-04-25T13:54:43.220 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.220 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.220 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.220 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:43.220 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.220 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.220 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.220 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-25T13:54:43.220 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.220 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.221 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.221 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.221 INFO:teuthology.orchestra.run.smithi043.stdout: "migration_current": { 2024-04-25T13:54:43.221 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "migration_current", 2024-04-25T13:54:43.221 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.221 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.222 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.223 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.223 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.224 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.224 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.225 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "internal - do not modify", 2024-04-25T13:54:43.225 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.225 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.225 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.226 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.227 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-04-25T13:54:43.227 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-04-25T13:54:43.227 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.227 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.228 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.228 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "root", 2024-04-25T13:54:43.228 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.228 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.229 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.229 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm-package", 2024-04-25T13:54:43.230 INFO:teuthology.orchestra.run.smithi043.stdout: "root" 2024-04-25T13:54:43.230 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.230 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "mode for remote execution of cephadm", 2024-04-25T13:54:43.230 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.230 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.230 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.231 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.231 INFO:teuthology.orchestra.run.smithi043.stdout: "oob_default_addr": { 2024-04-25T13:54:43.231 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "oob_default_addr", 2024-04-25T13:54:43.231 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.231 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.232 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.232 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "169.254.1.1", 2024-04-25T13:54:43.232 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.232 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.232 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.232 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-25T13:54:43.232 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.232 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.232 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.232 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.232 INFO:teuthology.orchestra.run.smithi043.stdout: "prometheus_alerts_path": { 2024-04-25T13:54:43.232 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus_alerts_path", 2024-04-25T13:54:43.232 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.232 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.233 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.233 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-25T13:54:43.233 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.233 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.233 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.233 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-25T13:54:43.233 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.233 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.233 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.233 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.233 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_insecure": { 2024-04-25T13:54:43.233 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_insecure", 2024-04-25T13:54:43.233 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.233 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.234 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.234 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.234 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.234 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.234 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.234 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-25T13:54:43.234 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.234 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.234 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.234 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.234 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_password": { 2024-04-25T13:54:43.234 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_password", 2024-04-25T13:54:43.234 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.235 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.235 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.235 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.235 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.235 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.235 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.235 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-25T13:54:43.235 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.235 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.235 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.235 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.235 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_url": { 2024-04-25T13:54:43.235 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_url", 2024-04-25T13:54:43.235 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.236 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.236 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.236 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.236 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.236 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.236 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.236 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-25T13:54:43.236 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.236 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.236 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.236 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.236 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_username": { 2024-04-25T13:54:43.236 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_username", 2024-04-25T13:54:43.237 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.237 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.237 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.237 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.237 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.237 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.237 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.237 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-25T13:54:43.237 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.237 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.237 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.237 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.237 INFO:teuthology.orchestra.run.smithi043.stdout: "secure_monitoring_stack": { 2024-04-25T13:54:43.237 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "secure_monitoring_stack", 2024-04-25T13:54:43.237 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.238 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.238 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.238 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.238 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.238 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.238 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.238 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-25T13:54:43.238 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.238 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.238 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.238 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.238 INFO:teuthology.orchestra.run.smithi043.stdout: "service_discovery_port": { 2024-04-25T13:54:43.238 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "service_discovery_port", 2024-04-25T13:54:43.239 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.239 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.239 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.239 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8765", 2024-04-25T13:54:43.239 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.239 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.239 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.239 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "cephadm service discovery port", 2024-04-25T13:54:43.239 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.239 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.239 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.239 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.239 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.239 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.240 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.240 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.240 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.240 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.240 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.240 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.240 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.240 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.240 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.240 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.240 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.240 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.240 INFO:teuthology.orchestra.run.smithi043.stdout: "ssh_config_file": { 2024-04-25T13:54:43.240 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssh_config_file", 2024-04-25T13:54:43.241 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.241 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.241 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.241 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.241 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.241 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.241 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.241 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-25T13:54:43.241 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.241 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.241 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.241 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.241 INFO:teuthology.orchestra.run.smithi043.stdout: "use_agent": { 2024-04-25T13:54:43.241 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_agent", 2024-04-25T13:54:43.242 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.242 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.242 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.242 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.242 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.242 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.242 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.242 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-25T13:54:43.242 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.242 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.242 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.242 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.243 INFO:teuthology.orchestra.run.smithi043.stdout: "use_repo_digest": { 2024-04-25T13:54:43.243 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_repo_digest", 2024-04-25T13:54:43.243 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.243 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.243 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.243 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.243 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.243 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.243 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.243 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-25T13:54:43.243 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.243 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.243 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.244 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.244 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_failed_host_check": { 2024-04-25T13:54:43.244 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_failed_host_check", 2024-04-25T13:54:43.244 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.244 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.244 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.244 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.244 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.244 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.244 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.244 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if the host check fails", 2024-04-25T13:54:43.244 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.244 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.245 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.245 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.245 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_daemons": { 2024-04-25T13:54:43.245 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_daemons", 2024-04-25T13:54:43.245 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.245 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.245 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.245 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.245 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.246 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.246 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.246 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-25T13:54:43.246 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.246 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.246 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.246 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.246 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_hosts": { 2024-04-25T13:54:43.246 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_hosts", 2024-04-25T13:54:43.246 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.246 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.246 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.246 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.247 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.247 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.247 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.247 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-25T13:54:43.247 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.247 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.247 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.247 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.247 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.247 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.247 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.247 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crash", 2024-04-25T13:54:43.247 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.248 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.248 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.248 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.248 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.248 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.248 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.248 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.248 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.248 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.248 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.248 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.248 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.248 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.249 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.249 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.249 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.249 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.249 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.249 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.249 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.249 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.249 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.249 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.249 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.249 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.249 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.250 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.250 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.250 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.250 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.250 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.250 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.250 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.250 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.250 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.250 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.250 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.250 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.250 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.251 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.251 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.251 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.251 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.251 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.251 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.251 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.251 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.251 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.251 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.251 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.251 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.251 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.252 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.252 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.252 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.252 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.252 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.252 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.252 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.252 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.252 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.252 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.252 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.252 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.252 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.252 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.253 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.253 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.253 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.253 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.253 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.253 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.253 INFO:teuthology.orchestra.run.smithi043.stdout: "retain_interval": { 2024-04-25T13:54:43.253 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retain_interval", 2024-04-25T13:54:43.253 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.253 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.253 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.253 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "31536000", 2024-04-25T13:54:43.253 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.253 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.254 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.254 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-25T13:54:43.254 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.254 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.254 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.254 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.254 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.254 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.254 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.254 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.254 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.254 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.254 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.255 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.255 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.255 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.255 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.255 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.255 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.255 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.255 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_recent_interval": { 2024-04-25T13:54:43.255 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_recent_interval", 2024-04-25T13:54:43.255 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.255 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.255 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.255 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1209600", 2024-04-25T13:54:43.255 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.256 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.256 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.256 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-25T13:54:43.256 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.256 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.256 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.256 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.256 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.256 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.256 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.256 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dashboard", 2024-04-25T13:54:43.256 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.256 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.256 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.256 INFO:teuthology.orchestra.run.smithi043.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-25T13:54:43.257 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-25T13:54:43.257 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.257 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.257 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.257 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:43.257 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.257 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.257 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.257 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.257 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.257 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.257 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.257 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.258 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_HOST": { 2024-04-25T13:54:43.258 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-25T13:54:43.258 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.258 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.258 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.258 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.258 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.258 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.258 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.258 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.258 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.258 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.258 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.258 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.259 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-25T13:54:43.259 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-25T13:54:43.259 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.259 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.259 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.259 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.259 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.259 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.259 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.259 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.259 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.259 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.259 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.259 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.260 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_ENABLED": { 2024-04-25T13:54:43.260 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_ENABLED", 2024-04-25T13:54:43.260 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.260 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.260 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.260 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.260 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.260 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.260 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.260 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.260 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.260 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.261 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.261 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.261 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-25T13:54:43.261 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-25T13:54:43.261 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.261 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.261 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.261 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.261 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.261 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.261 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.261 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.261 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.261 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.262 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.262 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.262 INFO:teuthology.orchestra.run.smithi043.stdout: "ENABLE_BROWSABLE_API": { 2024-04-25T13:54:43.262 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-25T13:54:43.262 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.262 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.262 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.262 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.262 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.262 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.262 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.262 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.263 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.263 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.263 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.263 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.263 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-25T13:54:43.263 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-25T13:54:43.263 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.263 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.263 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.263 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.263 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.263 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.263 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.263 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.264 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.264 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.264 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.264 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.264 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-25T13:54:43.264 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-25T13:54:43.264 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.264 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.264 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.264 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.264 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.264 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.264 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.265 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.265 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.265 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.265 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.265 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.265 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-25T13:54:43.265 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-25T13:54:43.265 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.265 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.265 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.265 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.265 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.265 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.266 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.266 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.266 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.266 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.266 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.266 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.266 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-25T13:54:43.266 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-25T13:54:43.266 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.266 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.266 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.266 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.266 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.267 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.267 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.267 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.267 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.267 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.267 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.267 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.267 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-25T13:54:43.267 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-25T13:54:43.267 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.267 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.267 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.267 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.268 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.268 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.268 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.268 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.268 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.268 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.268 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.268 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.268 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-25T13:54:43.268 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-25T13:54:43.268 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.268 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.268 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.268 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.269 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.269 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.269 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.269 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.269 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.269 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.269 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.269 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.269 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-25T13:54:43.269 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-25T13:54:43.269 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.269 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.269 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.269 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.269 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.270 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.270 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.270 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.270 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.270 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.270 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.270 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.270 INFO:teuthology.orchestra.run.smithi043.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-25T13:54:43.270 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-25T13:54:43.270 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.270 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.270 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.270 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.271 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.271 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.271 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.271 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.271 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.271 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.271 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.271 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.271 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_PASSWORD": { 2024-04-25T13:54:43.271 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-25T13:54:43.271 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.271 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.272 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.272 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T13:54:43.272 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.272 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.272 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.272 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.272 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.272 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.272 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.272 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.272 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-25T13:54:43.272 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-25T13:54:43.272 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.272 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.272 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.273 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.273 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.273 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.273 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.273 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.273 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.273 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.273 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.273 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.273 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_URL": { 2024-04-25T13:54:43.273 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_URL", 2024-04-25T13:54:43.273 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.273 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.273 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.273 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.274 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.274 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.274 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.274 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.274 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.274 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.274 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.274 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.274 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_USERNAME": { 2024-04-25T13:54:43.274 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-25T13:54:43.274 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.274 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.274 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.274 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T13:54:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-25T13:54:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-25T13:54:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.276 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.276 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.276 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.276 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.276 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.276 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.276 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.276 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.276 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.276 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-25T13:54:43.276 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-25T13:54:43.276 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.276 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.276 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.276 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.277 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.277 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.277 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.277 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.277 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.277 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.277 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.277 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.277 INFO:teuthology.orchestra.run.smithi043.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-25T13:54:43.277 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-25T13:54:43.277 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.277 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.278 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.278 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.278 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.278 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.278 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.278 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.278 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.278 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.278 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.278 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.278 INFO:teuthology.orchestra.run.smithi043.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-25T13:54:43.278 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-25T13:54:43.278 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.279 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.279 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.279 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.279 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.279 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.279 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.279 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.279 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.279 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.279 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.279 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.279 INFO:teuthology.orchestra.run.smithi043.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-25T13:54:43.280 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-25T13:54:43.280 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.280 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.280 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.280 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "[]", 2024-04-25T13:54:43.280 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.280 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.280 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.280 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.280 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.280 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.280 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.280 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.281 INFO:teuthology.orchestra.run.smithi043.stdout: "MULTICLUSTER_CONFIG": { 2024-04-25T13:54:43.281 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-25T13:54:43.281 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.281 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.281 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.281 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "{}", 2024-04-25T13:54:43.281 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.281 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.281 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.281 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.281 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.281 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.281 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.281 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.281 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_HOST": { 2024-04-25T13:54:43.282 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-25T13:54:43.282 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.282 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.282 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.282 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.282 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.282 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.282 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.282 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.282 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.282 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.282 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.282 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.283 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-25T13:54:43.283 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-25T13:54:43.283 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.283 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.283 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.283 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.283 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.283 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.283 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.283 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.283 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.283 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.283 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.283 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.283 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-25T13:54:43.284 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-25T13:54:43.284 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.284 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.284 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.284 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.284 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.284 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.284 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.284 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.284 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.284 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.284 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.285 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.285 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-25T13:54:43.285 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-25T13:54:43.285 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.285 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.285 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.285 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.285 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.285 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.285 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.285 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.285 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.286 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.286 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.286 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.286 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-25T13:54:43.286 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-25T13:54:43.286 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.286 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.286 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.286 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.286 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.286 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.286 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.286 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.286 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.287 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.287 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.287 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.287 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-25T13:54:43.287 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-25T13:54:43.287 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.287 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.287 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.287 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.287 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.287 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.287 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.287 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.287 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.287 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-25T13:54:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-25T13:54:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.288 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.289 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-25T13:54:43.289 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-25T13:54:43.289 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.289 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.289 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.289 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.289 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.289 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.289 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.289 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.289 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.289 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.289 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.289 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.289 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-25T13:54:43.290 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-25T13:54:43.290 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.290 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.290 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.290 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.290 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.290 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.290 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.290 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.290 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.290 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.290 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.290 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.291 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_ENABLED": { 2024-04-25T13:54:43.291 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-25T13:54:43.291 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.291 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.291 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.291 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.291 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.291 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.291 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.291 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.291 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.291 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.291 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.291 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.291 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-25T13:54:43.292 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-25T13:54:43.292 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.292 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.292 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.292 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-25T13:54:43.292 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.292 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.292 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.292 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.292 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.292 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.292 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.292 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.292 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-25T13:54:43.292 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-25T13:54:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-25T13:54:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-25T13:54:43.294 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.294 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.294 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.294 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8", 2024-04-25T13:54:43.294 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.294 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.294 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.294 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.294 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.294 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.294 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.294 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.294 INFO:teuthology.orchestra.run.smithi043.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-25T13:54:43.295 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-25T13:54:43.295 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.295 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.295 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.295 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "45", 2024-04-25T13:54:43.295 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.295 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.295 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.295 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.295 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.295 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.295 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.295 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.296 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ACCESS_KEY": { 2024-04-25T13:54:43.296 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-25T13:54:43.296 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.296 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.296 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.296 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.296 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.296 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.296 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.296 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.296 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.296 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.296 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.297 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.297 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-25T13:54:43.297 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-25T13:54:43.297 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.297 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.297 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.297 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T13:54:43.297 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.297 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.297 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.297 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.297 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.297 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.297 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.298 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.298 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SECRET_KEY": { 2024-04-25T13:54:43.298 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-25T13:54:43.298 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.298 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.298 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.298 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.298 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.298 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.298 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.298 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.298 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.299 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.299 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.299 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.299 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SSL_VERIFY": { 2024-04-25T13:54:43.299 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-25T13:54:43.299 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.299 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.299 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.299 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.299 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.299 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.299 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.299 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.299 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.300 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.300 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.300 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.300 INFO:teuthology.orchestra.run.smithi043.stdout: "UNSAFE_TLS_v1_2": { 2024-04-25T13:54:43.300 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-25T13:54:43.300 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.300 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.300 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.300 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.300 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.300 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.300 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.300 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.301 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.301 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.301 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.301 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.301 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-25T13:54:43.301 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-25T13:54:43.301 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.301 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.301 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.301 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.301 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.301 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.301 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.301 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.302 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.302 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.302 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.302 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.302 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-25T13:54:43.302 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-25T13:54:43.302 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.302 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.302 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.302 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:43.302 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.302 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.302 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.302 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.303 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.303 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.303 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.303 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.303 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-25T13:54:43.303 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-25T13:54:43.303 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.303 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.303 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.303 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T13:54:43.303 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.303 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.303 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.303 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.303 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.303 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.304 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.304 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.304 INFO:teuthology.orchestra.run.smithi043.stdout: "cross_origin_url": { 2024-04-25T13:54:43.304 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cross_origin_url", 2024-04-25T13:54:43.304 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.304 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.304 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.304 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.304 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.304 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.304 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.305 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.305 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.305 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.305 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.305 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.305 INFO:teuthology.orchestra.run.smithi043.stdout: "crt_file": { 2024-04-25T13:54:43.305 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crt_file", 2024-04-25T13:54:43.305 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.305 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.305 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.305 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.305 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.305 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.306 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.306 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.306 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.306 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.306 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.306 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.306 INFO:teuthology.orchestra.run.smithi043.stdout: "debug": { 2024-04-25T13:54:43.306 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "debug", 2024-04-25T13:54:43.306 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.306 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.306 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.306 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.307 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.307 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.307 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.307 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable/disable debug options", 2024-04-25T13:54:43.307 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.307 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.307 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.307 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.307 INFO:teuthology.orchestra.run.smithi043.stdout: "jwt_token_ttl": { 2024-04-25T13:54:43.307 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "jwt_token_ttl", 2024-04-25T13:54:43.307 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.308 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.308 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.308 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "28800", 2024-04-25T13:54:43.308 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.308 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.308 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.308 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.308 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.308 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.308 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.308 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.308 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-04-25T13:54:43.308 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-04-25T13:54:43.308 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.309 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.309 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.309 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.309 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.309 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.309 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.309 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.309 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.309 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.309 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.309 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.309 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.309 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.309 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.309 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.309 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.310 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.310 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.310 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.310 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.310 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.310 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.310 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.310 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.310 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.310 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.310 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.310 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.311 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.311 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.311 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.311 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.311 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.311 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.311 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.311 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.311 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.311 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.311 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.311 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.312 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.312 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.312 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.312 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.312 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.312 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.312 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.312 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.312 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.312 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.312 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.313 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.313 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.313 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.313 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.313 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.313 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.313 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.313 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.313 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.313 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.313 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.313 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.314 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.314 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.314 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.314 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.314 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.314 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.314 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.314 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.314 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.314 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.314 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.315 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.315 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.315 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.315 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.315 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.315 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.315 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.315 INFO:teuthology.orchestra.run.smithi043.stdout: "motd": { 2024-04-25T13:54:43.315 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "motd", 2024-04-25T13:54:43.315 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.315 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.315 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.315 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.316 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.316 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.316 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.316 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "The message of the day", 2024-04-25T13:54:43.316 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.316 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.316 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.316 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.316 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect_resolve_ip_addr": { 2024-04-25T13:54:43.317 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "redirect_resolve_ip_addr", 2024-04-25T13:54:43.317 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.317 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.317 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.317 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.317 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.317 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.317 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.317 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.317 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.317 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.318 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.318 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.318 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T13:54:43.318 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T13:54:43.318 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.318 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.318 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.318 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-04-25T13:54:43.318 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.318 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.318 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.318 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.318 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.319 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.319 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.319 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.319 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T13:54:43.319 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T13:54:43.319 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.319 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.319 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.319 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8080", 2024-04-25T13:54:43.319 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.319 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.319 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.319 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.319 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.320 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.320 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.320 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.320 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.320 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.320 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.320 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.320 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.320 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.320 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.320 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.320 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.321 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.321 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.321 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.321 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.321 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.321 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-04-25T13:54:43.321 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-04-25T13:54:43.321 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.321 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.321 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.321 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.321 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.321 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.321 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.322 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.322 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.322 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.322 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.322 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.322 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl_server_port": { 2024-04-25T13:54:43.322 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl_server_port", 2024-04-25T13:54:43.322 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.322 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.322 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.322 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8443", 2024-04-25T13:54:43.322 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.323 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.323 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.323 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.323 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.323 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.323 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.323 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.323 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-04-25T13:54:43.323 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-04-25T13:54:43.323 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.323 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.323 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.323 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "redirect", 2024-04-25T13:54:43.323 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.323 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.324 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.324 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.324 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect" 2024-04-25T13:54:43.324 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.324 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.324 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.324 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.324 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.324 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.324 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-04-25T13:54:43.324 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-04-25T13:54:43.324 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.324 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.325 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.325 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-04-25T13:54:43.325 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-04-25T13:54:43.325 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-04-25T13:54:43.325 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.325 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.325 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.325 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.325 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.325 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.325 INFO:teuthology.orchestra.run.smithi043.stdout: "url_prefix": { 2024-04-25T13:54:43.325 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url_prefix", 2024-04-25T13:54:43.325 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.325 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.325 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.326 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.326 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.326 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.326 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.326 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.326 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.326 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.326 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.326 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.326 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.326 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.326 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.326 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "devicehealth", 2024-04-25T13:54:43.326 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.327 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.327 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.327 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_monitoring": { 2024-04-25T13:54:43.327 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_monitoring", 2024-04-25T13:54:43.327 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.327 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.327 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.327 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.327 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.327 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.327 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.327 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "monitor device health metrics", 2024-04-25T13:54:43.327 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.327 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.327 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.328 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.328 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.328 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.328 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.328 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.328 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.328 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.328 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.328 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.328 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.328 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.328 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.328 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.328 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.329 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.329 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.329 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.329 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.329 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.329 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.329 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.329 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.329 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.329 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.329 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.329 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.329 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.329 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.329 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.330 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.330 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.330 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.330 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.330 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.330 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.330 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.330 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.330 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.330 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.330 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.330 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.331 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.331 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.331 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.331 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.331 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.331 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.331 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.331 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.331 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.331 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.331 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.331 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.331 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.332 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.332 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.332 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.332 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.332 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.332 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.332 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.332 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.332 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.332 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.332 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.332 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.332 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.332 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.333 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.333 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.333 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.333 INFO:teuthology.orchestra.run.smithi043.stdout: "mark_out_threshold": { 2024-04-25T13:54:43.333 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mark_out_threshold", 2024-04-25T13:54:43.333 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.333 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.333 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.333 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2419200", 2024-04-25T13:54:43.333 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.333 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.333 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.333 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-25T13:54:43.333 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.334 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.334 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.334 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.334 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": { 2024-04-25T13:54:43.334 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_name", 2024-04-25T13:54:43.334 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.334 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.334 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.334 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "device_health_metrics", 2024-04-25T13:54:43.334 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.334 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.335 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.335 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-25T13:54:43.335 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.335 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.335 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.335 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.335 INFO:teuthology.orchestra.run.smithi043.stdout: "retention_period": { 2024-04-25T13:54:43.335 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retention_period", 2024-04-25T13:54:43.335 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.335 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.335 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.335 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15552000", 2024-04-25T13:54:43.335 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.336 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.336 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.336 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain device health metrics", 2024-04-25T13:54:43.336 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.336 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.336 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.336 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.336 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_frequency": { 2024-04-25T13:54:43.336 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_frequency", 2024-04-25T13:54:43.336 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.336 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.336 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.336 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-04-25T13:54:43.337 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.337 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.337 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.337 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-25T13:54:43.337 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.337 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.337 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.337 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.337 INFO:teuthology.orchestra.run.smithi043.stdout: "self_heal": { 2024-04-25T13:54:43.337 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "self_heal", 2024-04-25T13:54:43.337 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.337 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.337 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.337 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.337 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.338 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.338 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.338 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-25T13:54:43.338 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.338 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.338 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.338 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.338 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T13:54:43.338 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T13:54:43.338 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.338 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.338 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.338 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T13:54:43.338 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.339 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.339 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.339 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and check device health", 2024-04-25T13:54:43.339 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.339 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.339 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.339 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.339 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.339 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.339 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.339 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.339 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.339 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.339 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.340 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.340 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.340 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.340 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.340 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.340 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.340 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.340 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_threshold": { 2024-04-25T13:54:43.340 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_threshold", 2024-04-25T13:54:43.340 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.340 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.340 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.340 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7257600", 2024-04-25T13:54:43.340 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.341 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.341 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.341 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-25T13:54:43.341 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.341 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.341 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.341 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.341 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.341 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.341 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.341 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "diskprediction_local", 2024-04-25T13:54:43.341 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.341 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.341 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.342 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.342 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.342 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.342 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.342 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.342 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.342 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.342 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.342 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.342 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.342 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.342 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.342 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.342 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.343 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.343 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.343 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.343 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.343 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.343 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.343 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.343 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.343 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.343 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.343 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.343 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.343 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.343 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.344 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.344 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.344 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.344 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.344 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.344 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.344 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.344 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.344 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.344 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.344 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.344 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.344 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.344 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.345 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.345 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.345 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.345 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.345 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.345 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.345 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.345 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.345 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.345 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.345 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.345 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.345 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.345 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.346 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.346 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.346 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.346 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.346 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.346 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.346 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.346 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.346 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.346 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.346 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.347 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.347 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.347 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.347 INFO:teuthology.orchestra.run.smithi043.stdout: "predict_interval": { 2024-04-25T13:54:43.347 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predict_interval", 2024-04-25T13:54:43.347 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.347 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.347 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.347 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-04-25T13:54:43.347 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.347 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.348 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.348 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.348 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.348 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.348 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.348 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.348 INFO:teuthology.orchestra.run.smithi043.stdout: "predictor_model": { 2024-04-25T13:54:43.348 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predictor_model", 2024-04-25T13:54:43.348 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.348 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.348 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.348 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "prophetstor", 2024-04-25T13:54:43.348 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.348 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.349 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.349 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.349 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.349 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.349 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.349 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.349 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T13:54:43.349 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T13:54:43.349 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.349 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.349 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.350 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T13:54:43.350 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.350 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.350 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.350 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.350 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.350 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.350 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.350 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.351 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.351 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.351 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.351 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.351 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.351 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.351 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.351 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.351 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.352 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.352 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.352 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.352 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.352 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.352 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.352 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.352 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.352 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "influx", 2024-04-25T13:54:43.352 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": false, 2024-04-25T13:54:43.353 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "influxdb python module not found", 2024-04-25T13:54:43.353 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.353 INFO:teuthology.orchestra.run.smithi043.stdout: "batch_size": { 2024-04-25T13:54:43.353 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "batch_size", 2024-04-25T13:54:43.353 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.353 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.353 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.353 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5000", 2024-04-25T13:54:43.353 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.353 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.354 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.354 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-25T13:54:43.354 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.354 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.354 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.354 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.354 INFO:teuthology.orchestra.run.smithi043.stdout: "database": { 2024-04-25T13:54:43.354 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "database", 2024-04-25T13:54:43.355 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.355 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.355 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.355 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "ceph", 2024-04-25T13:54:43.355 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.355 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.355 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.356 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-25T13:54:43.356 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.356 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.356 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.356 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.356 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": { 2024-04-25T13:54:43.356 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hostname", 2024-04-25T13:54:43.356 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.357 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.357 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.357 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.357 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.357 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.357 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.357 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server hostname", 2024-04-25T13:54:43.357 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.357 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.357 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.357 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.358 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T13:54:43.358 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T13:54:43.358 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.358 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.358 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.358 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "30", 2024-04-25T13:54:43.358 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "5", 2024-04-25T13:54:43.358 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.358 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.358 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-25T13:54:43.358 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.358 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.358 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.359 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.359 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.359 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.359 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.359 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.359 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.359 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.359 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.359 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.359 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.359 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.359 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.359 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.359 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.360 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.360 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.360 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.360 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.360 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.360 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.360 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.360 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.360 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.360 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.360 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.360 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.361 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.361 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.361 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.361 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.361 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.361 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.361 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.361 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.361 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.361 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.361 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.361 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.361 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.361 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.362 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.362 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.362 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.362 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.362 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.362 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.362 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.362 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.362 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.362 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.362 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.362 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.362 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.362 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.363 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.363 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.363 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.363 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.363 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.363 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.363 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.363 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.363 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.363 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.363 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.363 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.363 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.363 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.364 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.364 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.364 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.364 INFO:teuthology.orchestra.run.smithi043.stdout: "password": { 2024-04-25T13:54:43.364 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "password", 2024-04-25T13:54:43.364 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.364 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.364 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.364 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.364 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.364 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.364 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.365 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "password of InfluxDB server user", 2024-04-25T13:54:43.365 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.365 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.365 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.365 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.365 INFO:teuthology.orchestra.run.smithi043.stdout: "port": { 2024-04-25T13:54:43.365 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "port", 2024-04-25T13:54:43.365 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.365 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.365 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.365 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8086", 2024-04-25T13:54:43.365 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.365 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.366 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.366 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server port", 2024-04-25T13:54:43.366 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.366 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.366 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.366 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.366 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.366 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.366 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.366 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.366 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.366 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.367 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.367 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.367 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.367 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.367 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.367 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.367 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.367 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.367 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-04-25T13:54:43.367 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-04-25T13:54:43.367 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.367 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.367 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.368 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "false", 2024-04-25T13:54:43.368 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.368 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.368 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.368 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T13:54:43.368 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.368 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.368 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.368 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.368 INFO:teuthology.orchestra.run.smithi043.stdout: "threads": { 2024-04-25T13:54:43.368 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threads", 2024-04-25T13:54:43.368 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.368 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.369 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.369 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T13:54:43.369 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T13:54:43.369 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "32", 2024-04-25T13:54:43.369 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.369 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-25T13:54:43.369 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.369 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.369 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.369 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.369 INFO:teuthology.orchestra.run.smithi043.stdout: "username": { 2024-04-25T13:54:43.369 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "username", 2024-04-25T13:54:43.369 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.369 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.370 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.370 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.370 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.370 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.370 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.370 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "username of InfluxDB server user", 2024-04-25T13:54:43.370 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.370 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.370 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.370 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.370 INFO:teuthology.orchestra.run.smithi043.stdout: "verify_ssl": { 2024-04-25T13:54:43.370 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "verify_ssl", 2024-04-25T13:54:43.370 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.371 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.371 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.371 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "true", 2024-04-25T13:54:43.371 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.371 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.371 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.371 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T13:54:43.371 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.371 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.371 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.371 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.371 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.371 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.371 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.372 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "insights", 2024-04-25T13:54:43.372 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.372 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.372 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.372 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.372 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.372 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.372 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.372 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.372 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.372 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.372 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.372 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.372 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.373 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.373 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.373 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.373 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.373 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.373 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.373 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.373 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.373 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.373 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.373 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.373 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.373 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.373 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.374 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.374 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.374 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.374 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.374 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.374 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.374 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.374 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.374 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.374 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.374 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.374 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.374 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.374 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.375 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.375 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.375 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.375 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.375 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.375 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.375 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.375 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.375 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.375 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.375 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.375 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.375 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.376 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.376 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.376 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.376 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.376 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.376 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.376 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.376 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.376 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.376 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.376 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.376 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.376 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.376 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.377 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.377 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.377 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.377 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.377 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.377 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.377 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.377 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.377 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.377 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.377 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.377 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.377 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.377 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.378 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.378 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.378 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.378 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.378 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.378 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.378 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.378 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.378 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "iostat", 2024-04-25T13:54:43.378 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.378 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.378 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.378 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.378 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.379 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.379 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.379 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.379 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.379 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.379 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.379 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.379 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.379 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.379 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.379 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.379 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.379 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.379 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.380 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.380 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.380 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.380 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.380 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.380 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.380 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.380 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.380 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.380 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.380 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.380 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.380 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.381 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.382 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.382 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.382 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.382 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.382 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.382 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.382 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.382 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.382 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.382 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.382 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.382 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.382 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.383 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.383 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.383 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.383 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.383 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.383 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.383 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.383 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.383 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.383 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.383 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.383 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.383 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.384 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.384 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.384 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.384 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.384 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.384 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.384 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.384 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.384 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.384 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.384 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.384 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.384 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.384 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.384 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.385 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.385 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.385 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.385 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.385 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "k8sevents", 2024-04-25T13:54:43.385 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.385 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.385 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.385 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_event_retention_days": { 2024-04-25T13:54:43.385 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ceph_event_retention_days", 2024-04-25T13:54:43.385 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.385 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.385 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.386 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7", 2024-04-25T13:54:43.386 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.386 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.386 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.386 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-25T13:54:43.386 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.386 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.386 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.386 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.386 INFO:teuthology.orchestra.run.smithi043.stdout: "config_check_secs": { 2024-04-25T13:54:43.386 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_check_secs", 2024-04-25T13:54:43.386 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.387 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.387 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.387 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:43.387 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "10", 2024-04-25T13:54:43.387 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.387 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.387 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-25T13:54:43.387 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.387 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.387 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.387 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.387 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.387 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.388 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.388 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.388 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.388 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.388 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.388 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.388 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.388 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.388 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.388 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.388 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.388 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.388 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.388 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.388 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.389 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.389 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.389 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.389 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.389 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.389 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.389 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.389 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.389 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.389 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.389 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.389 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.389 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.389 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.389 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.390 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.390 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.390 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.390 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.390 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.390 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.390 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.390 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.390 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.390 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.390 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.390 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.390 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.391 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.391 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.391 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.391 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.391 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.391 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.391 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.391 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.391 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.391 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.391 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.391 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.391 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.391 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.392 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.392 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.392 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.392 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.392 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.392 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.392 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.392 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.392 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.392 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.392 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.392 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.392 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.393 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.393 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.393 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.393 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.393 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.393 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.393 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.393 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.393 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.393 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.393 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.394 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.394 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.394 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.394 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.394 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "localpool", 2024-04-25T13:54:43.394 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.394 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.394 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.394 INFO:teuthology.orchestra.run.smithi043.stdout: "failure_domain": { 2024-04-25T13:54:43.394 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "failure_domain", 2024-04-25T13:54:43.394 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.394 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.394 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.395 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "host", 2024-04-25T13:54:43.395 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.395 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.395 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.395 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "failure domain for any created local pool", 2024-04-25T13:54:43.395 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-25T13:54:43.395 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.395 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.395 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.395 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.395 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.395 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.395 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.395 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.396 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.396 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.396 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.396 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.396 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.396 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.396 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.396 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.396 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.396 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.396 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.396 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.396 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.396 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.397 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.397 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.397 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.397 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.397 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.397 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.397 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.397 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.397 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.397 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.397 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.397 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.397 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.398 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.398 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.398 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.398 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.398 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.398 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.398 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.398 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.398 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.398 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.398 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.398 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.398 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.398 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.399 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.399 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.399 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.399 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.399 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.399 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.399 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.399 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.399 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.399 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.399 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.399 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.399 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.400 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.400 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.400 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.400 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.400 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.400 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.400 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.400 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.400 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.400 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.400 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.400 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": { 2024-04-25T13:54:43.400 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_size", 2024-04-25T13:54:43.401 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.401 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.401 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.401 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.401 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.401 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.401 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.401 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default min_size for any created local pool", 2024-04-25T13:54:43.401 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-25T13:54:43.401 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.401 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.401 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.401 INFO:teuthology.orchestra.run.smithi043.stdout: "num_rep": { 2024-04-25T13:54:43.401 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "num_rep", 2024-04-25T13:54:43.402 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.402 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.402 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.402 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3", 2024-04-25T13:54:43.402 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.402 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.402 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.402 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default replica count for any created local pool", 2024-04-25T13:54:43.402 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.402 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.402 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.402 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.402 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": { 2024-04-25T13:54:43.403 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_num", 2024-04-25T13:54:43.403 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.403 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.403 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.403 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "128", 2024-04-25T13:54:43.403 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.403 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.403 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.403 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default pg_num for any created local pool", 2024-04-25T13:54:43.403 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.403 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.403 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.403 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.403 INFO:teuthology.orchestra.run.smithi043.stdout: "prefix": { 2024-04-25T13:54:43.403 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prefix", 2024-04-25T13:54:43.404 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.404 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.404 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.404 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.404 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.404 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.404 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.404 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name prefix for any created local pool", 2024-04-25T13:54:43.404 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.404 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.404 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.404 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.404 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.405 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.405 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.405 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.405 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.405 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.405 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.405 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.405 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.405 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.405 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.405 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.405 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.405 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.405 INFO:teuthology.orchestra.run.smithi043.stdout: "subtree": { 2024-04-25T13:54:43.406 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "subtree", 2024-04-25T13:54:43.406 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.406 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.406 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.406 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "rack", 2024-04-25T13:54:43.406 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.406 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.406 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.406 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-25T13:54:43.406 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-25T13:54:43.406 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.406 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.406 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.407 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.407 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.407 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.407 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mds_autoscaler", 2024-04-25T13:54:43.407 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.407 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.407 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.407 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.407 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.407 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.407 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.407 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.407 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.408 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.408 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.408 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.408 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.408 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.408 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.408 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.408 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.408 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.408 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.408 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.408 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.408 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.408 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.409 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.409 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.409 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.409 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.409 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.409 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.409 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.409 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.409 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.409 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.409 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.409 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.409 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.410 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.410 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.410 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.410 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.410 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.410 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.410 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.410 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.410 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.410 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.410 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.410 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.410 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.410 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.411 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.411 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.411 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.411 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.411 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.411 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.411 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.411 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.411 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.411 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.411 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.411 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.411 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.411 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.412 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.412 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.412 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.412 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.412 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.412 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.412 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.412 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.412 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.412 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.412 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.412 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.412 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.412 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.413 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.413 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.413 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.413 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.413 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.413 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.413 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.413 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.413 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.413 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.413 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.413 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.413 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirroring", 2024-04-25T13:54:43.413 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.414 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.414 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.414 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.414 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.414 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.414 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.414 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.414 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.414 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.414 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.414 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.414 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.414 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.414 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.415 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.415 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.415 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.415 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.415 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.415 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.415 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.415 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.415 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.415 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.415 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.415 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.416 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.416 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.416 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.416 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.416 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.416 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.416 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.416 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.416 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.416 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.417 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.417 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.417 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.417 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.417 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.417 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.417 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.417 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.417 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.417 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.417 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.417 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.417 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.418 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.418 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.418 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.418 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.418 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.418 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.418 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.418 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.418 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.418 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.418 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.418 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.418 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.418 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.419 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.419 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.419 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.419 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.419 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.419 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.419 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.419 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.419 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.419 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.419 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.419 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.419 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.419 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.420 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.420 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.420 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.420 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.420 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.420 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.420 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.420 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.420 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.420 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.420 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.420 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.420 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "nfs", 2024-04-25T13:54:43.421 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.421 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.421 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.421 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.421 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.421 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.421 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.421 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.421 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.421 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.421 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.421 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.421 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.421 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.423 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.423 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.423 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.423 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.423 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.423 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.423 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.423 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.423 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.423 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.423 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.423 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.423 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.424 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.424 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.424 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.424 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.424 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.424 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.424 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.424 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.424 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.424 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.424 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.424 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.424 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.424 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.425 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.425 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.425 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.425 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.425 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.425 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.425 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.425 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.425 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.425 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.425 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.425 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.425 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.426 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.426 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.426 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.426 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.426 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.426 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.426 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.426 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.426 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.426 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.426 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.426 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.426 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.427 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.427 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.427 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.427 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.427 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.427 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.427 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.427 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.427 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.427 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-04-25T13:54:43.427 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.427 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.427 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.427 INFO:teuthology.orchestra.run.smithi043.stdout: "fail_fs": { 2024-04-25T13:54:43.428 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "fail_fs", 2024-04-25T13:54:43.428 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.428 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.428 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.428 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.428 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.428 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.428 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.428 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-25T13:54:43.428 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.428 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.428 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.429 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.429 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.429 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.429 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.429 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.429 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.429 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.429 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.429 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.429 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.429 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.429 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.429 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.429 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.430 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.430 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.430 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.430 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.430 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.430 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.430 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.430 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.430 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.430 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.430 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.430 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.430 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.430 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.431 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.431 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.431 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.431 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.431 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.431 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.431 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.431 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.431 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.431 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.431 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.431 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.431 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.431 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.432 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.432 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.432 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.432 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.432 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.432 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.432 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.432 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.432 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.432 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.432 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.432 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.432 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.432 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.432 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.433 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.433 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.433 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.433 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.433 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.433 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.433 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.433 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.433 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.433 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.433 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.433 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.433 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.433 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.434 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator": { 2024-04-25T13:54:43.434 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-04-25T13:54:43.434 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.434 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.434 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.434 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.434 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.434 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.434 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.434 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm", 2024-04-25T13:54:43.434 INFO:teuthology.orchestra.run.smithi043.stdout: "rook", 2024-04-25T13:54:43.434 INFO:teuthology.orchestra.run.smithi043.stdout: "test_orchestrator" 2024-04-25T13:54:43.434 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.435 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Orchestrator backend", 2024-04-25T13:54:43.435 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.435 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.435 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.435 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.435 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.435 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.435 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.435 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.435 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.435 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.435 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.435 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.435 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.436 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.436 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.436 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.436 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.436 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.436 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.436 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.436 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.436 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_perf_query", 2024-04-25T13:54:43.436 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.436 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.436 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.436 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.436 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.437 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.437 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.437 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.437 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.437 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.437 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.437 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.437 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.437 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.437 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.437 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.437 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.437 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.437 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.438 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.438 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.438 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.438 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.438 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.438 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.438 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.438 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.438 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.438 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.438 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.438 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.439 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.439 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.439 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.439 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.439 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.439 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.439 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.439 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.439 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.439 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.439 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.439 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.439 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.439 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.439 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.440 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.440 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.440 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.440 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.440 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.440 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.440 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.440 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.440 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.440 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.440 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.440 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.440 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.441 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.441 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.441 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.441 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.441 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.441 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.441 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.441 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.441 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.441 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.441 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.441 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.441 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.442 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.442 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.442 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.442 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.442 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.442 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.442 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.442 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.442 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.442 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.442 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.442 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.442 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.442 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.443 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.443 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.443 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.443 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.443 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_support", 2024-04-25T13:54:43.443 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.443 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.443 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.443 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.443 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.443 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.443 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.443 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.444 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.444 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.444 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.444 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.444 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.444 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.444 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.444 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.444 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.444 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.444 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.444 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.444 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.444 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.444 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.445 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.445 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.445 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.445 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.445 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.445 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.445 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.445 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.445 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.445 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.445 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.445 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.445 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.446 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.446 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.446 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.446 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.446 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.446 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.446 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.446 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.446 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.446 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.446 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.446 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.446 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.447 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.447 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.447 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.447 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.447 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.447 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.447 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.447 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.447 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.447 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.447 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.447 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.447 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.447 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.447 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.448 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.448 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.448 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.448 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.448 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.448 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.448 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.448 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.448 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.448 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.448 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.448 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.448 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.448 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.448 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.449 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.449 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.449 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.449 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.449 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.449 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.449 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.449 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.449 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.449 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.449 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.449 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_autoscaler", 2024-04-25T13:54:43.449 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.449 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.450 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.450 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.450 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.450 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.450 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.450 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.450 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.450 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.450 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.450 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.450 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.450 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.450 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.451 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.451 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.451 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.451 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.451 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.451 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.451 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.451 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.451 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.451 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.451 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.451 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.451 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.451 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.452 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.452 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.452 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.452 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.452 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.452 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.452 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.452 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.452 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.452 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.452 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.452 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.452 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.453 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.453 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.453 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.453 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.453 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.453 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.453 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.453 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.453 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.453 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.453 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.453 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.453 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.454 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.454 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.454 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.454 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.454 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.454 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.454 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.454 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.454 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.454 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.454 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.454 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.454 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.454 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.455 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.455 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.455 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.455 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.455 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T13:54:43.455 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T13:54:43.455 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.455 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.455 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.455 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T13:54:43.455 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.455 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.455 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.456 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.456 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.456 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.456 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.456 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.456 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.456 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.456 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.456 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.456 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.456 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.456 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.456 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.456 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.456 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.457 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.457 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.457 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.457 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.457 INFO:teuthology.orchestra.run.smithi043.stdout: "threshold": { 2024-04-25T13:54:43.457 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threshold", 2024-04-25T13:54:43.457 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:43.457 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.457 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.457 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-04-25T13:54:43.457 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1.0", 2024-04-25T13:54:43.457 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.457 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.457 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "scaling threshold", 2024-04-25T13:54:43.458 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-25T13:54:43.458 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.458 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.458 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.458 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.458 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.458 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.458 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "progress", 2024-04-25T13:54:43.458 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.458 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.458 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.458 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_pg_recovery_event": { 2024-04-25T13:54:43.458 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_pg_recovery_event", 2024-04-25T13:54:43.459 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.459 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.459 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.459 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.459 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.459 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.459 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.459 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-25T13:54:43.459 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.459 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.459 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.459 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.459 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-04-25T13:54:43.460 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-04-25T13:54:43.460 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.460 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.460 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.460 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.460 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.460 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.460 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.460 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.460 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.460 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.460 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.460 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.461 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.461 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.461 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.461 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.461 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.461 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.461 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.461 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.461 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.461 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.461 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.461 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.461 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.461 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.462 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.462 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.462 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.462 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.462 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.462 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.462 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.462 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.462 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.462 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.462 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.463 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.463 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.463 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.463 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.463 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.463 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.463 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.463 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.463 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.463 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.463 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.463 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.463 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.464 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.464 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.464 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.464 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.464 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.464 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.464 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.464 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.464 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.464 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.464 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.464 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.464 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.465 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.465 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.465 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.465 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.465 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.465 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.465 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.465 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.465 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.465 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.465 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.465 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.466 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.466 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.466 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.466 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.466 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.466 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.466 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.466 INFO:teuthology.orchestra.run.smithi043.stdout: "max_completed_events": { 2024-04-25T13:54:43.466 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_completed_events", 2024-04-25T13:54:43.466 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.466 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.466 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.466 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "50", 2024-04-25T13:54:43.467 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.467 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.467 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.467 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "number of past completed events to remember", 2024-04-25T13:54:43.467 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.467 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.467 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.467 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.467 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T13:54:43.467 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T13:54:43.467 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.467 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.467 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.468 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T13:54:43.468 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.468 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.468 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.468 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long the module is going to sleep", 2024-04-25T13:54:43.468 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.468 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.468 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.468 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.468 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.468 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.468 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.468 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.468 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.469 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.469 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.469 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.469 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.469 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.469 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.469 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.469 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.469 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.469 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.469 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.469 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.469 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus", 2024-04-25T13:54:43.469 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.470 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.470 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.470 INFO:teuthology.orchestra.run.smithi043.stdout: "cache": { 2024-04-25T13:54:43.470 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cache", 2024-04-25T13:54:43.470 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.470 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.470 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.470 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.470 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.470 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.470 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.470 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.470 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.471 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.471 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.471 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.471 INFO:teuthology.orchestra.run.smithi043.stdout: "exclude_perf_counters": { 2024-04-25T13:54:43.471 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "exclude_perf_counters", 2024-04-25T13:54:43.471 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.471 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.471 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.471 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.471 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.471 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.471 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.472 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-25T13:54:43.472 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-25T13:54:43.472 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.472 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.472 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.472 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.472 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.472 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.472 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.472 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.472 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.472 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.472 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.473 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.473 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.473 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.473 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.473 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.473 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.473 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.473 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.473 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.473 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.473 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.473 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.474 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.474 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.474 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.474 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.474 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.474 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.474 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.474 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.474 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.474 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.474 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.474 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.475 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.475 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.475 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.475 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.475 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.475 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.475 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.475 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.475 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.475 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.475 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.475 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.475 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.475 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.477 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.477 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.478 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.478 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.478 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.478 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.478 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.478 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.478 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.478 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.478 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.478 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.478 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.478 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.478 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools": { 2024-04-25T13:54:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools", 2024-04-25T13:54:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.480 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.480 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.480 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.480 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.480 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.480 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.480 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.480 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.480 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.480 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-25T13:54:43.480 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-25T13:54:43.480 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.480 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.480 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.481 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "300", 2024-04-25T13:54:43.481 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.481 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.481 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.481 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.481 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.481 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.481 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.481 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.481 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_interval": { 2024-04-25T13:54:43.481 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_interval", 2024-04-25T13:54:43.481 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:43.481 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.482 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.482 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15.0", 2024-04-25T13:54:43.482 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.482 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.482 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.482 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.482 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.482 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.482 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.482 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.482 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T13:54:43.482 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T13:54:43.483 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.483 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.483 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.483 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-04-25T13:54:43.483 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.483 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.483 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.483 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-25T13:54:43.483 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.483 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.483 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.483 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.483 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T13:54:43.483 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T13:54:43.483 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.484 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.484 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.484 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "9283", 2024-04-25T13:54:43.484 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.484 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.484 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.484 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-25T13:54:43.484 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.484 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.484 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.484 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.484 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.485 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.485 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.485 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.485 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.485 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.485 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.485 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.485 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.485 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.485 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.485 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.485 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.485 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.485 INFO:teuthology.orchestra.run.smithi043.stdout: "stale_cache_strategy": { 2024-04-25T13:54:43.486 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stale_cache_strategy", 2024-04-25T13:54:43.486 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.486 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.486 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.486 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "log", 2024-04-25T13:54:43.486 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.486 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.486 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.486 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.486 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.486 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.486 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.486 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.486 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-04-25T13:54:43.487 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-04-25T13:54:43.487 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.487 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.487 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.487 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "default", 2024-04-25T13:54:43.487 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.487 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.487 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.487 INFO:teuthology.orchestra.run.smithi043.stdout: "default", 2024-04-25T13:54:43.487 INFO:teuthology.orchestra.run.smithi043.stdout: "error" 2024-04-25T13:54:43.487 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.487 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.487 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.488 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.488 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.488 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.488 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-04-25T13:54:43.488 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-04-25T13:54:43.488 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.488 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.488 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.488 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-04-25T13:54:43.488 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-04-25T13:54:43.488 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-04-25T13:54:43.488 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.488 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.489 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.489 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.489 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.489 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.489 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.489 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.489 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.489 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_support", 2024-04-25T13:54:43.489 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.489 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.489 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.489 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.489 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.489 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.489 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.490 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.490 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.490 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.490 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.490 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.490 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.490 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.490 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.490 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.490 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.490 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.490 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.490 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.490 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.491 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.491 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.491 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.491 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.491 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.491 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.491 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.491 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.491 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.491 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.491 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.491 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.491 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.492 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.492 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.492 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.492 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.492 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.492 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.492 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.492 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.492 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.492 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.492 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.492 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.492 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.493 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.493 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.493 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.493 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.493 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.493 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.493 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.493 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.493 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.493 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.493 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.493 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.493 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.494 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.494 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.494 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.494 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.494 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.494 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.494 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.494 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.494 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.494 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.494 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.494 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.495 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.495 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_snap_create": { 2024-04-25T13:54:43.495 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_snap_create", 2024-04-25T13:54:43.495 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.495 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.495 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.495 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T13:54:43.495 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.495 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.495 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.495 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.496 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.496 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.496 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.496 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.496 INFO:teuthology.orchestra.run.smithi043.stdout: "mirror_snapshot_schedule": { 2024-04-25T13:54:43.496 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirror_snapshot_schedule", 2024-04-25T13:54:43.496 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.496 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.496 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.496 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.496 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.496 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.496 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.496 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.497 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.497 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.497 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.497 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.497 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.497 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.497 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.497 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.497 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.497 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.497 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.497 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.497 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.498 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.498 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.498 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.498 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.498 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.498 INFO:teuthology.orchestra.run.smithi043.stdout: "trash_purge_schedule": { 2024-04-25T13:54:43.498 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "trash_purge_schedule", 2024-04-25T13:54:43.498 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.498 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.498 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.498 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.498 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.498 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.499 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.499 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.499 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.499 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.499 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.499 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.499 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.499 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.499 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.499 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "restful", 2024-04-25T13:54:43.499 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.499 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.499 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.500 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_auth": { 2024-04-25T13:54:43.500 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_auth", 2024-04-25T13:54:43.500 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.500 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.500 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.500 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.500 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.500 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.500 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.500 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.500 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.500 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.500 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.501 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.501 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-04-25T13:54:43.501 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-04-25T13:54:43.501 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.501 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.501 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.501 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.501 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.501 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.501 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.501 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.501 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.501 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.502 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.502 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.502 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.502 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.502 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.502 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.502 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.502 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.502 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.502 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.502 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.502 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.502 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.502 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.503 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.503 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.503 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.503 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.503 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.503 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.503 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.503 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.503 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.503 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.503 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.503 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.503 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.504 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.504 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.504 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.504 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.504 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.504 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.504 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.504 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.504 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.504 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.504 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.504 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.504 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.504 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.505 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.505 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.505 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.505 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.505 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.505 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.505 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.505 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.505 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.505 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.505 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.505 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.505 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.506 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.506 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.506 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.506 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.506 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.506 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.506 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.506 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.506 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.506 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.506 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.507 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.507 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.507 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.507 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.507 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.507 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.507 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.507 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T13:54:43.507 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T13:54:43.507 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.507 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.507 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.507 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.508 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.508 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.508 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.508 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.508 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.508 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.508 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.508 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.508 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T13:54:43.508 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T13:54:43.508 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.508 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.508 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.508 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.509 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.509 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.509 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.509 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.509 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.509 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.509 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.509 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.509 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.509 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.509 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.509 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.509 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.509 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.510 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.510 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.510 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.510 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.510 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.510 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.510 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.510 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.510 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.510 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.510 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.510 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rgw", 2024-04-25T13:54:43.510 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.510 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.511 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.511 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.511 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.511 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.511 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.511 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.511 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.511 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.511 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.511 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.511 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.511 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.511 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.512 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.512 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.512 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.512 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.512 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.512 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.512 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.512 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.512 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.512 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.512 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.512 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.512 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.512 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.513 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.513 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.513 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.513 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.513 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.513 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.513 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.513 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.514 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.514 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.514 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.514 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.514 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.514 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.514 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.514 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.514 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.514 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.514 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.514 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.514 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.515 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.515 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.515 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.515 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.515 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.515 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.515 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.515 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.516 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.516 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.516 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.516 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.516 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.516 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.516 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.516 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.516 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.516 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.516 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.516 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.517 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.517 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.517 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.517 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.517 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.517 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.517 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.517 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.517 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.517 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.517 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.518 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.518 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.518 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.518 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.518 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.518 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.518 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.518 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.518 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.518 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rook", 2024-04-25T13:54:43.518 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.518 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.519 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.519 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.519 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.519 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.519 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.519 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.519 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.519 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.519 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.519 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.520 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.520 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.520 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.520 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.520 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.520 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.520 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.520 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.520 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.520 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.520 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.520 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.520 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.521 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.521 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.521 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.521 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.521 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.521 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.521 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.521 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.521 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.521 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.521 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.521 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.521 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.521 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.522 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.522 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.522 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.522 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.522 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.522 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.522 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.522 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.522 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.522 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.522 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.522 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.522 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.522 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.523 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.523 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.523 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.523 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.523 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.523 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.523 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.523 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.523 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.523 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.523 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.523 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.523 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.523 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.523 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.524 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.524 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.524 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.524 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.524 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.524 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.524 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.524 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.524 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.524 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.524 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.524 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.524 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.525 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.525 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.525 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.525 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.525 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.525 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.525 INFO:teuthology.orchestra.run.smithi043.stdout: "storage_class": { 2024-04-25T13:54:43.525 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "storage_class", 2024-04-25T13:54:43.525 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.525 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.525 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.525 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "local", 2024-04-25T13:54:43.526 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.526 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.526 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.526 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-25T13:54:43.526 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.526 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.526 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.526 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.526 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.526 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.526 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.527 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "selftest", 2024-04-25T13:54:43.527 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.527 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.527 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.527 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.527 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.527 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.527 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.527 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.527 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.527 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.527 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.527 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.527 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.528 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.528 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.528 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.528 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.528 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.528 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.528 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.528 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.528 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.528 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.528 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.528 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.528 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.528 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.528 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.529 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.529 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.529 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.529 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.529 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.529 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.529 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.529 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.529 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.529 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.529 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.529 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.529 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.529 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.529 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.530 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.530 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.530 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.530 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.530 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.530 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.530 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.530 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.530 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.530 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.530 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.530 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.531 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.531 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.531 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.531 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.531 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.531 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.531 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.531 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.531 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.531 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.531 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.531 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.531 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.531 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.531 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.532 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.532 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.532 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.532 INFO:teuthology.orchestra.run.smithi043.stdout: "roption1": { 2024-04-25T13:54:43.532 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption1", 2024-04-25T13:54:43.532 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.532 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.532 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.532 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.532 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.532 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.532 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.532 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.533 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.533 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.533 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.533 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.533 INFO:teuthology.orchestra.run.smithi043.stdout: "roption2": { 2024-04-25T13:54:43.533 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption2", 2024-04-25T13:54:43.533 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.533 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.533 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.533 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "xyz", 2024-04-25T13:54:43.533 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.533 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.533 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.533 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.534 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.534 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.534 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.534 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.534 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption1": { 2024-04-25T13:54:43.534 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption1", 2024-04-25T13:54:43.534 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.534 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.534 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.534 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.534 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.534 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.534 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.535 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.535 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.535 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.535 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.535 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.535 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption2": { 2024-04-25T13:54:43.535 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption2", 2024-04-25T13:54:43.535 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.535 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.535 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.535 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.535 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.535 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.535 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.535 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.536 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.536 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.536 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.536 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.536 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption3": { 2024-04-25T13:54:43.536 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption3", 2024-04-25T13:54:43.536 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T13:54:43.536 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.536 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.536 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.537 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.537 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.537 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.537 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.537 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.537 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.537 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.537 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.537 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption4": { 2024-04-25T13:54:43.537 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption4", 2024-04-25T13:54:43.537 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.537 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.537 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.538 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.538 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.538 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.538 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.538 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.538 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.538 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.538 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.538 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.538 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption5": { 2024-04-25T13:54:43.539 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption5", 2024-04-25T13:54:43.539 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.539 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.539 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.539 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.539 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.539 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.539 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.539 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.539 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.539 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.539 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.539 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.539 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption6": { 2024-04-25T13:54:43.540 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption6", 2024-04-25T13:54:43.540 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.540 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.540 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.540 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.540 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.540 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.540 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.540 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.540 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.540 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.540 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.540 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.541 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption7": { 2024-04-25T13:54:43.541 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption7", 2024-04-25T13:54:43.541 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.541 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.541 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.541 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.541 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T13:54:43.541 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "42", 2024-04-25T13:54:43.541 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.541 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.541 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.541 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.541 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.541 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.542 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.542 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.542 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.542 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.542 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.542 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.542 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.542 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.542 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.542 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.542 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.542 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.542 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.542 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.543 INFO:teuthology.orchestra.run.smithi043.stdout: "testkey": { 2024-04-25T13:54:43.543 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testkey", 2024-04-25T13:54:43.543 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.543 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.543 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.543 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.543 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.543 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.543 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.543 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.543 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.543 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.543 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.544 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.544 INFO:teuthology.orchestra.run.smithi043.stdout: "testlkey": { 2024-04-25T13:54:43.544 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testlkey", 2024-04-25T13:54:43.544 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.544 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.544 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.544 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.544 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.544 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.544 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.544 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.544 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.544 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.544 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.544 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.544 INFO:teuthology.orchestra.run.smithi043.stdout: "testnewline": { 2024-04-25T13:54:43.545 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testnewline", 2024-04-25T13:54:43.545 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.545 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.545 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.545 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.545 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.545 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.545 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.545 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.545 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.545 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.545 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.545 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.545 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.546 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.546 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.546 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-04-25T13:54:43.546 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.546 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.546 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.546 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_m_granularity": { 2024-04-25T13:54:43.546 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_m_granularity", 2024-04-25T13:54:43.546 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.546 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.546 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.547 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.547 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.547 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.547 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.547 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow minute scheduled snapshots", 2024-04-25T13:54:43.547 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.547 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.547 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.547 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.547 INFO:teuthology.orchestra.run.smithi043.stdout: "dump_on_update": { 2024-04-25T13:54:43.547 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dump_on_update", 2024-04-25T13:54:43.547 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.548 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.548 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.548 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.548 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.548 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.548 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.548 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "dump database to debug log on update", 2024-04-25T13:54:43.548 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.548 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.548 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.548 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.548 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.548 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.548 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.548 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.549 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.549 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.549 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.549 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.549 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.549 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.549 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.549 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.549 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.549 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.549 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.549 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.549 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.549 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.549 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.550 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.550 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.550 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.550 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.550 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.550 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.550 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.550 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.550 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.550 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.550 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.550 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.551 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.551 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.551 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.551 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.551 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.551 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.551 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.551 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.551 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.551 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.551 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.551 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.551 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.552 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.552 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.552 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.552 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.552 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.552 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.552 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.552 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.552 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.552 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.552 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.552 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.552 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.552 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.553 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.553 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.553 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.553 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.553 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.553 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.553 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.553 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.553 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.553 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.553 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.553 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.553 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.553 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.553 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.554 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.554 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.554 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.554 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.554 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.554 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.554 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.554 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.554 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.554 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.554 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.554 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.555 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.555 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.555 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stats", 2024-04-25T13:54:43.555 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.555 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.555 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.555 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.555 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.555 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.555 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.555 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.555 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.555 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.556 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.556 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.556 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.556 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.556 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.556 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.556 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.556 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.556 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.556 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.556 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.556 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.556 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.556 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.556 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.557 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.557 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.557 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.557 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.557 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.557 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.557 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.557 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.557 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.558 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.558 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.558 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.558 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.558 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.558 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.558 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.558 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.558 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.558 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.558 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.558 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.559 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.559 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.559 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.559 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.559 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.559 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.559 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.559 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.559 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.559 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.559 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.559 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.559 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.559 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.559 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.560 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.560 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.560 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.560 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.560 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.560 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.560 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.560 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.560 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.560 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.560 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.560 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.560 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.561 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.561 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.561 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.561 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.561 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.561 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.561 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.561 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.561 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.561 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.561 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.561 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.561 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.561 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.562 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.562 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.562 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "status", 2024-04-25T13:54:43.562 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.562 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.562 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.562 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.562 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.562 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.562 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.562 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.562 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.562 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.563 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.563 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.563 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.563 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.563 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.563 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.563 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.563 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.563 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.563 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.563 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.563 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.563 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.564 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.564 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.564 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.564 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.564 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.564 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.564 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.564 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.564 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.564 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.564 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.564 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.564 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.564 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.565 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.565 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.565 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.565 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.565 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.565 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.565 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.565 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.565 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.565 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.565 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.565 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.565 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.568 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.568 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.568 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.568 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.568 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.568 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.568 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.568 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.568 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.568 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.569 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.569 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.569 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.569 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.569 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telegraf", 2024-04-25T13:54:43.569 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.569 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.569 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.569 INFO:teuthology.orchestra.run.smithi043.stdout: "address": { 2024-04-25T13:54:43.569 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "address", 2024-04-25T13:54:43.569 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.569 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.569 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.569 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-25T13:54:43.570 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.570 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.570 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.570 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.570 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.570 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.570 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.570 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.570 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T13:54:43.570 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T13:54:43.570 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.570 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.570 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.571 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15", 2024-04-25T13:54:43.571 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.571 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.571 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.571 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.571 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.571 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.571 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.571 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.571 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.571 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.571 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.571 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.572 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.572 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.572 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.572 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.572 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.572 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.572 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.572 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.572 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.572 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.572 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.572 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.572 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.572 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.573 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.573 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.573 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.573 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.573 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.573 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.573 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.573 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.573 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.573 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.573 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.573 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.573 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.573 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.574 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.574 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.574 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.574 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.574 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.574 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.574 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.574 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.574 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.574 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.575 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.575 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.575 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.575 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.575 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.575 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.575 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.575 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.575 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.575 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.575 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.576 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.576 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.576 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.576 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.576 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.576 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.576 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.576 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.576 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.576 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.576 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.576 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.576 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.576 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.577 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.577 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.577 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.577 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.577 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.577 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.577 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.577 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.577 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.577 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.577 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.577 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.577 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.577 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.577 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.578 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.578 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.578 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.578 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.578 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.578 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telemetry", 2024-04-25T13:54:43.578 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.579 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.579 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.579 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_basic": { 2024-04-25T13:54:43.579 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_basic", 2024-04-25T13:54:43.579 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.579 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.579 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.579 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.579 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.579 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.579 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.579 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-25T13:54:43.580 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.580 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.580 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.580 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.580 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_crash": { 2024-04-25T13:54:43.580 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_crash", 2024-04-25T13:54:43.580 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.580 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.580 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.580 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.580 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.580 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.580 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.580 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-25T13:54:43.580 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.581 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.581 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.581 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.581 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_device": { 2024-04-25T13:54:43.581 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_device", 2024-04-25T13:54:43.581 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.581 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.581 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.581 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.581 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.581 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.581 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.581 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-25T13:54:43.581 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.581 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_ident": { 2024-04-25T13:54:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_ident", 2024-04-25T13:54:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-25T13:54:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_perf": { 2024-04-25T13:54:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_perf", 2024-04-25T13:54:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-25T13:54:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: "contact": { 2024-04-25T13:54:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "contact", 2024-04-25T13:54:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: "description": { 2024-04-25T13:54:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "description", 2024-04-25T13:54:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: "device_url": { 2024-04-25T13:54:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_url", 2024-04-25T13:54:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-25T13:54:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-04-25T13:54:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-04-25T13:54:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T13:54:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T13:54:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "24", 2024-04-25T13:54:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "8", 2024-04-25T13:54:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: "last_opt_revision": { 2024-04-25T13:54:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "last_opt_revision", 2024-04-25T13:54:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1", 2024-04-25T13:54:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard": { 2024-04-25T13:54:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard", 2024-04-25T13:54:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard_description": { 2024-04-25T13:54:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard_description", 2024-04-25T13:54:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.594 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.595 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.596 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.597 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: "organization": { 2024-04-25T13:54:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "organization", 2024-04-25T13:54:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.598 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "proxy": { 2024-04-25T13:54:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "proxy", 2024-04-25T13:54:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.600 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "url": { 2024-04-25T13:54:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url", 2024-04-25T13:54:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-25T13:54:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.601 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "test_orchestrator", 2024-04-25T13:54:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.602 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.603 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.604 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.605 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.606 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.607 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.608 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "volumes", 2024-04-25T13:54:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.609 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.610 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.611 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.612 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.613 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_clones": { 2024-04-25T13:54:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_clones", 2024-04-25T13:54:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4", 2024-04-25T13:54:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-25T13:54:43.614 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "periodic_async_work": { 2024-04-25T13:54:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "periodic_async_work", 2024-04-25T13:54:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Periodically check for async work", 2024-04-25T13:54:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.615 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_delay": { 2024-04-25T13:54:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_delay", 2024-04-25T13:54:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-25T13:54:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.616 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_no_wait": { 2024-04-25T13:54:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_no_wait", 2024-04-25T13:54:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T13:54:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-25T13:54:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.617 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix", 2024-04-25T13:54:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T13:54:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T13:54:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T13:54:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "discovery_interval": { 2024-04-25T13:54:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "discovery_interval", 2024-04-25T13:54:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T13:54:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "100", 2024-04-25T13:54:43.619 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "identifier": { 2024-04-25T13:54:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "identifier", 2024-04-25T13:54:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.620 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T13:54:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T13:54:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T13:54:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T13:54:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.621 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.622 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.622 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.622 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.622 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.622 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.622 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T13:54:43.622 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T13:54:43.622 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.622 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.622 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.622 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.622 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.622 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.623 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T13:54:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T13:54:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.624 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T13:54:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T13:54:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T13:54:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T13:54:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T13:54:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T13:54:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T13:54:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T13:54:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T13:54:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T13:54:43.625 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T13:54:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T13:54:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T13:54:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T13:54:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.626 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "sqlite3_killpoint": { 2024-04-25T13:54:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sqlite3_killpoint", 2024-04-25T13:54:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "dev", 2024-04-25T13:54:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T13:54:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T13:54:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.627 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_host": { 2024-04-25T13:54:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_host", 2024-04-25T13:54:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T13:54:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.628 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_port": { 2024-04-25T13:54:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_port", 2024-04-25T13:54:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T13:54:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10051", 2024-04-25T13:54:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.629 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_sender": { 2024-04-25T13:54:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_sender", 2024-04-25T13:54:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T13:54:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T13:54:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T13:54:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-25T13:54:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T13:54:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T13:54:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T13:54:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T13:54:43.630 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T13:54:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T13:54:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T13:54:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "services": { 2024-04-25T13:54:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "dashboard": "https://172.21.15.43:8443/" 2024-04-25T13:54:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "always_on_modules": { 2024-04-25T13:54:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus": [ 2024-04-25T13:54:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-04-25T13:54:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-04-25T13:54:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-04-25T13:54:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-04-25T13:54:43.631 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-04-25T13:54:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-04-25T13:54:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-04-25T13:54:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-04-25T13:54:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-04-25T13:54:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-04-25T13:54:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific": [ 2024-04-25T13:54:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-04-25T13:54:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-04-25T13:54:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-04-25T13:54:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-04-25T13:54:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-04-25T13:54:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-04-25T13:54:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-04-25T13:54:43.632 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-04-25T13:54:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-04-25T13:54:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-04-25T13:54:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy": [ 2024-04-25T13:54:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-04-25T13:54:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-04-25T13:54:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-04-25T13:54:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-04-25T13:54:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-04-25T13:54:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-04-25T13:54:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-04-25T13:54:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-04-25T13:54:43.633 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-04-25T13:54:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-04-25T13:54:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "reef": [ 2024-04-25T13:54:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-04-25T13:54:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-04-25T13:54:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-04-25T13:54:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-04-25T13:54:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-04-25T13:54:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-04-25T13:54:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-04-25T13:54:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-04-25T13:54:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-04-25T13:54:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-04-25T13:54:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T13:54:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: "squid": [ 2024-04-25T13:54:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-04-25T13:54:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-04-25T13:54:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-04-25T13:54:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-04-25T13:54:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-04-25T13:54:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-04-25T13:54:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-04-25T13:54:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-04-25T13:54:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-04-25T13:54:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-04-25T13:54:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T13:54:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "last_failure_osd_epoch": 85, 2024-04-25T13:54:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "active_clients": [ 2024-04-25T13:54:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.635 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "devicehealth", 2024-04-25T13:54:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T13:54:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T13:54:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-04-25T13:54:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 875391343 2024-04-25T13:54:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T13:54:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "libcephsqlite", 2024-04-25T13:54:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T13:54:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T13:54:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-04-25T13:54:43.636 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1660519292 2024-04-25T13:54:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T13:54:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_support", 2024-04-25T13:54:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T13:54:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T13:54:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-04-25T13:54:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3543059444 2024-04-25T13:54:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T13:54:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.637 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-04-25T13:54:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T13:54:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T13:54:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-04-25T13:54:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 391840900 2024-04-25T13:54:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T13:54:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-04-25T13:54:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T13:54:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.638 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T13:54:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-04-25T13:54:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1029468036 2024-04-25T13:54:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T13:54:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "volumes", 2024-04-25T13:54:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T13:54:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T13:54:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T13:54:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-04-25T13:54:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1158074980 2024-04-25T13:54:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T13:54:43.639 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:43.640 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T13:54:43.640 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T13:54:43.641 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:41 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/4134723702' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:54:43.641 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:41 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2537816606' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:54:43.641 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:41 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3983168656' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:54:43.641 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:42 smithi161 ceph-mon[32696]: pgmap v314: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T13:54:43.641 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:42 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/4201190198' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-25T13:54:43.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:41 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/4134723702' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:54:43.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:41 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2537816606' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:54:43.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:41 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3983168656' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:54:43.641 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:42 smithi175 ceph-mon[32649]: pgmap v314: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T13:54:43.642 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:42 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/4201190198' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-25T13:54:43.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:42.165+0000 7f2ec7225640 1 -- 172.21.15.43:0/4201190198 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f2ea80afc60 msgr2=0x7f2ea80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:43.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:42.165+0000 7f2ec7225640 1 --2- 172.21.15.43:0/4201190198 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f2ea80afc60 0x7f2ea80b2170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0006010 tx=0x7f2eb0031000 comp rx=0 tx=0).stop 2024-04-25T13:54:43.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:42.165+0000 7f2ec7225640 1 -- 172.21.15.43:0/4201190198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ec0108a20 msgr2=0x7f2ec0199a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:54:43.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:42.165+0000 7f2ec7225640 1 --2- 172.21.15.43:0/4201190198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ec0108a20 0x7f2ec0199a20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400d740 tx=0x7f2eb400dc00 comp rx=0 tx=0).stop 2024-04-25T13:54:43.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:42.165+0000 7f2ec7225640 1 -- 172.21.15.43:0/4201190198 shutdown_connections 2024-04-25T13:54:43.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:42.165+0000 7f2ec7225640 1 --2- 172.21.15.43:0/4201190198 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f2ea80afc60 0x7f2ea80b2170 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:43.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:42.165+0000 7f2ec7225640 1 --2- 172.21.15.43:0/4201190198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ec010d380 0x7f2ec019dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:43.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:42.165+0000 7f2ec7225640 1 --2- 172.21.15.43:0/4201190198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ec0108a20 0x7f2ec0199a20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:43.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:42.165+0000 7f2ec7225640 1 --2- 172.21.15.43:0/4201190198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ec0102af0 0x7f2ec01994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:54:43.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:42.165+0000 7f2ec7225640 1 -- 172.21.15.43:0/4201190198 >> 172.21.15.43:0/4201190198 conn(0x7f2ec0078110 msgr2=0x7f2ec01040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:54:43.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:42.165+0000 7f2ec7225640 1 -- 172.21.15.43:0/4201190198 shutdown_connections 2024-04-25T13:54:43.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:54:42.165+0000 7f2ec7225640 1 -- 172.21.15.43:0/4201190198 wait complete. 2024-04-25T13:54:43.643 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:41 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/4134723702' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:54:43.643 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:41 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2537816606' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:54:43.643 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:41 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3983168656' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:54:43.650 DEBUG:tasks.check_counter:Getting stats from a 2024-04-25T13:54:43.650 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph daemon mds.a perf dump 2024-04-25T13:54:43.651 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:42 smithi043 ceph-mon[29195]: pgmap v314: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T13:54:43.651 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:42 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/4201190198' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-25T13:54:43.911 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:54:45.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:44 smithi175 ceph-mon[32649]: pgmap v315: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T13:54:45.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:44 smithi043 ceph-mon[29195]: pgmap v315: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T13:54:45.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:44 smithi161 ceph-mon[32696]: pgmap v315: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T13:54:45.688 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T13:54:45.688 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T13:54:45.688 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 0, 2024-04-25T13:54:45.689 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 2, 2024-04-25T13:54:45.689 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 0, 2024-04-25T13:54:45.689 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 0, 2024-04-25T13:54:45.689 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 4, 2024-04-25T13:54:45.689 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 0, 2024-04-25T13:54:45.689 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.001468534, 2024-04-25T13:54:45.689 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.000000000, 2024-04-25T13:54:45.689 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.000303467, 2024-04-25T13:54:45.689 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T13:54:45.689 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:54:45.689 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:45.689 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:45.689 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:45.690 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:45.690 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:54:45.690 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:45.690 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:45.690 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:45.690 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:45.690 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T13:54:45.690 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T13:54:45.690 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:45.690 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T13:54:45.690 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 221, 2024-04-25T13:54:45.690 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 208, 2024-04-25T13:54:45.690 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 1689120, 2024-04-25T13:54:45.691 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 127072, 2024-04-25T13:54:45.691 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 2, 2024-04-25T13:54:45.691 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 1, 2024-04-25T13:54:45.691 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.044800333, 2024-04-25T13:54:45.691 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.013084900, 2024-04-25T13:54:45.691 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.038786459, 2024-04-25T13:54:45.691 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.004622888, 2024-04-25T13:54:45.691 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:54:45.691 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 208, 2024-04-25T13:54:45.691 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.011169478, 2024-04-25T13:54:45.691 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000053699 2024-04-25T13:54:45.691 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:45.691 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:54:45.691 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:45.691 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:45.691 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:45.692 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:45.692 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 1689120, 2024-04-25T13:54:45.692 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 127072 2024-04-25T13:54:45.692 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:45.692 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T13:54:45.692 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 2, 2024-04-25T13:54:45.692 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 157, 2024-04-25T13:54:45.692 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 320, 2024-04-25T13:54:45.692 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 184736, 2024-04-25T13:54:45.692 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 5, 2024-04-25T13:54:45.692 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 3, 2024-04-25T13:54:45.692 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.013900165, 2024-04-25T13:54:45.692 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.009156836, 2024-04-25T13:54:45.692 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.002099622, 2024-04-25T13:54:45.692 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T13:54:45.693 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:54:45.693 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 154, 2024-04-25T13:54:45.693 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.016537081, 2024-04-25T13:54:45.693 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000107383 2024-04-25T13:54:45.693 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:45.693 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:54:45.693 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:45.693 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:45.693 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:45.693 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:45.693 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T13:54:45.693 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 184736 2024-04-25T13:54:45.693 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:45.693 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-04-25T13:54:45.693 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 0, 2024-04-25T13:54:45.694 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-04-25T13:54:45.694 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:45.694 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-04-25T13:54:45.694 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-04-25T13:54:45.694 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-04-25T13:54:45.694 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T13:54:45.694 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-04-25T13:54:45.694 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T13:54:45.694 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-04-25T13:54:45.694 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T13:54:45.694 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T13:54:45.694 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T13:54:45.695 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T13:54:45.695 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T13:54:45.695 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-04-25T13:54:45.695 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T13:54:45.695 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T13:54:45.695 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-04-25T13:54:45.695 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-04-25T13:54:45.695 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-04-25T13:54:45.695 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-04-25T13:54:45.695 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T13:54:45.695 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T13:54:45.695 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T13:54:45.695 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T13:54:45.695 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T13:54:45.695 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-04-25T13:54:45.696 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-04-25T13:54:45.696 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-04-25T13:54:45.696 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T13:54:45.696 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T13:54:45.696 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-04-25T13:54:45.696 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-04-25T13:54:45.696 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-04-25T13:54:45.696 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-04-25T13:54:45.696 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T13:54:45.696 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-04-25T13:54:45.696 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T13:54:45.696 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-04-25T13:54:45.696 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 149034, 2024-04-25T13:54:45.697 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 32, 2024-04-25T13:54:45.697 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-04-25T13:54:45.697 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-04-25T13:54:45.697 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-04-25T13:54:45.697 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-04-25T13:54:45.697 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-04-25T13:54:45.697 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-04-25T13:54:45.697 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-04-25T13:54:45.697 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-04-25T13:54:45.697 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 0, 2024-04-25T13:54:45.697 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 0, 2024-04-25T13:54:45.697 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T13:54:45.697 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-04-25T13:54:45.697 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-04-25T13:54:45.698 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-04-25T13:54:45.698 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 928, 2024-04-25T13:54:45.698 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 2, 2024-04-25T13:54:45.698 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-04-25T13:54:45.698 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-04-25T13:54:45.698 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-04-25T13:54:45.698 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-04-25T13:54:45.698 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:45.698 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T13:54:45.698 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-25T13:54:45.698 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-04-25T13:54:45.698 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-25T13:54:45.698 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 219, 2024-04-25T13:54:45.699 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 1655529, 2024-04-25T13:54:45.699 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-25T13:54:45.699 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 219, 2024-04-25T13:54:45.699 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-04-25T13:54:45.699 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-04-25T13:54:45.699 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 219, 2024-04-25T13:54:45.699 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 1655529, 2024-04-25T13:54:45.699 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-25T13:54:45.699 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:45.699 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:45.699 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:45.699 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:45.699 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:45.700 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T13:54:46.518 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-04-25T13:54:46.518 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-04-25T13:54:46.518 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-04-25T13:54:46.518 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-04-25T13:54:46.518 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-04-25T13:54:46.518 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-04-25T13:54:46.518 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-04-25T13:54:46.519 DEBUG:tasks.check_counter:Getting stats from d 2024-04-25T13:54:46.519 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph daemon mds.d perf dump 2024-04-25T13:54:46.772 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:54:47.207 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:46 smithi043 ceph-mon[29195]: pgmap v316: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T13:54:47.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:46 smithi161 ceph-mon[32696]: pgmap v316: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T13:54:47.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:46 smithi175 ceph-mon[32649]: pgmap v316: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T13:54:48.475 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T13:54:48.475 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T13:54:48.475 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 4, 2024-04-25T13:54:48.475 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 4, 2024-04-25T13:54:48.475 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 2992, 2024-04-25T13:54:48.475 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 448, 2024-04-25T13:54:48.475 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 4, 2024-04-25T13:54:48.475 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 0, 2024-04-25T13:54:48.475 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.001737224, 2024-04-25T13:54:48.475 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.000043623, 2024-04-25T13:54:48.475 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.000728768, 2024-04-25T13:54:48.476 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T13:54:48.476 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:54:48.476 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 3, 2024-04-25T13:54:48.476 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000863480, 2024-04-25T13:54:48.476 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000287826 2024-04-25T13:54:48.476 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:48.476 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:54:48.476 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:48.476 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:48.476 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:48.476 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:48.476 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-25T13:54:48.476 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 448 2024-04-25T13:54:48.476 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:48.476 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T13:54:48.477 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 224, 2024-04-25T13:54:48.477 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 213, 2024-04-25T13:54:48.477 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 1688096, 2024-04-25T13:54:48.477 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 130624, 2024-04-25T13:54:48.477 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 2, 2024-04-25T13:54:48.477 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 1, 2024-04-25T13:54:48.477 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.048804258, 2024-04-25T13:54:48.477 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.013723403, 2024-04-25T13:54:48.477 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.043323973, 2024-04-25T13:54:48.477 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.004636790, 2024-04-25T13:54:48.477 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:54:48.477 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 212, 2024-04-25T13:54:48.477 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.010972817, 2024-04-25T13:54:48.477 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000051758 2024-04-25T13:54:48.478 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:48.478 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:54:48.478 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:48.478 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:48.478 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:48.478 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:48.478 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 1688096, 2024-04-25T13:54:48.478 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 130624 2024-04-25T13:54:48.478 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:48.478 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T13:54:48.478 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 2, 2024-04-25T13:54:48.478 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 162, 2024-04-25T13:54:48.478 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 320, 2024-04-25T13:54:48.478 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 185616, 2024-04-25T13:54:48.479 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 5, 2024-04-25T13:54:48.479 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 3, 2024-04-25T13:54:48.479 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.015138891, 2024-04-25T13:54:48.479 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.009889811, 2024-04-25T13:54:48.479 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.002465193, 2024-04-25T13:54:48.479 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T13:54:48.479 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:54:48.479 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 159, 2024-04-25T13:54:48.479 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.010413238, 2024-04-25T13:54:48.479 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000065492 2024-04-25T13:54:48.479 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:48.479 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:54:48.479 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:48.479 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:48.480 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:48.480 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:48.480 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T13:54:48.480 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 185616 2024-04-25T13:54:48.480 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:48.480 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-04-25T13:54:48.480 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 0, 2024-04-25T13:54:48.480 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-04-25T13:54:48.480 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:48.480 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-04-25T13:54:48.480 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-04-25T13:54:48.480 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-04-25T13:54:48.480 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T13:54:48.480 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-04-25T13:54:48.480 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T13:54:48.481 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-04-25T13:54:48.481 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T13:54:48.481 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T13:54:48.481 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T13:54:48.481 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T13:54:48.481 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T13:54:48.481 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-04-25T13:54:48.481 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T13:54:48.481 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T13:54:48.481 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-04-25T13:54:48.481 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-04-25T13:54:48.481 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-04-25T13:54:48.481 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-04-25T13:54:48.481 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T13:54:48.481 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T13:54:48.482 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T13:54:48.482 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T13:54:48.482 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T13:54:48.482 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-04-25T13:54:48.482 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-04-25T13:54:48.482 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-04-25T13:54:48.482 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T13:54:48.482 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T13:54:48.482 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-04-25T13:54:48.482 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-04-25T13:54:48.482 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-04-25T13:54:48.482 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-04-25T13:54:48.482 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T13:54:48.482 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-04-25T13:54:48.483 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T13:54:48.483 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-04-25T13:54:48.483 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 149034, 2024-04-25T13:54:48.483 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 32, 2024-04-25T13:54:48.483 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-04-25T13:54:48.483 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-04-25T13:54:48.483 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-04-25T13:54:48.483 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-04-25T13:54:48.483 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-04-25T13:54:48.483 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-04-25T13:54:48.483 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-04-25T13:54:48.483 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-04-25T13:54:48.483 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 0, 2024-04-25T13:54:48.483 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 0, 2024-04-25T13:54:48.483 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T13:54:48.484 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-04-25T13:54:48.484 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-04-25T13:54:48.484 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-04-25T13:54:48.484 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 928, 2024-04-25T13:54:48.484 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 2, 2024-04-25T13:54:48.484 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-04-25T13:54:48.484 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-04-25T13:54:48.484 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-04-25T13:54:48.484 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-04-25T13:54:48.484 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:48.484 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T13:54:48.484 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-25T13:54:48.484 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-04-25T13:54:48.484 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-25T13:54:48.484 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 226, 2024-04-25T13:54:48.485 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 1656503, 2024-04-25T13:54:48.485 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-25T13:54:48.485 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 226, 2024-04-25T13:54:48.485 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-04-25T13:54:48.485 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-04-25T13:54:48.485 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 226, 2024-04-25T13:54:48.485 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 1656503, 2024-04-25T13:54:48.485 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-25T13:54:48.485 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:48.485 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:48.485 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:48.485 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:48.485 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:48.485 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T13:54:49.194 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:48 smithi043 ceph-mon[29195]: pgmap v317: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T13:54:49.196 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-04-25T13:54:49.196 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-04-25T13:54:49.196 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-04-25T13:54:49.196 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-04-25T13:54:49.196 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-04-25T13:54:49.196 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-04-25T13:54:49.196 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-04-25T13:54:49.196 DEBUG:tasks.check_counter:Getting stats from g 2024-04-25T13:54:49.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph daemon mds.g perf dump 2024-04-25T13:54:49.232 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:48 smithi175 ceph-mon[32649]: pgmap v317: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T13:54:49.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:48 smithi161 ceph-mon[32696]: pgmap v317: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T13:54:49.447 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:54:50.206 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:49 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:54:50.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:49 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:54:50.235 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:49 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T13:54:51.033 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:50 smithi043 ceph-mon[29195]: pgmap v318: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T13:54:51.033 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:50 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:51.033 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:50 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:51.033 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:50 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:51.033 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:50 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:50 smithi161 ceph-mon[32696]: pgmap v318: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T13:54:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:50 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:50 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:50 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:51.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:50 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:51.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:50 smithi175 ceph-mon[32649]: pgmap v318: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T13:54:51.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:50 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:51.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:50 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:51.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:50 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:51.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:50 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:51.567 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T13:54:51.567 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T13:54:51.567 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 0, 2024-04-25T13:54:51.567 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 2, 2024-04-25T13:54:51.567 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 0, 2024-04-25T13:54:51.567 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 0, 2024-04-25T13:54:51.568 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 4, 2024-04-25T13:54:51.568 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 0, 2024-04-25T13:54:51.568 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.001333855, 2024-04-25T13:54:51.568 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.000000000, 2024-04-25T13:54:51.568 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.000207754, 2024-04-25T13:54:51.568 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T13:54:51.568 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:54:51.568 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:51.568 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:51.568 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:51.568 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:51.568 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:54:51.568 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:51.568 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:51.568 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:51.569 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:51.569 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T13:54:51.569 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T13:54:51.569 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:51.569 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T13:54:51.569 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 2, 2024-04-25T13:54:51.569 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 159, 2024-04-25T13:54:51.569 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 320, 2024-04-25T13:54:51.569 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 185088, 2024-04-25T13:54:51.569 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 5, 2024-04-25T13:54:51.569 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 3, 2024-04-25T13:54:51.569 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.013670621, 2024-04-25T13:54:51.569 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.009313909, 2024-04-25T13:54:51.570 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.002011734, 2024-04-25T13:54:51.570 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T13:54:51.570 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:54:51.570 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 156, 2024-04-25T13:54:51.570 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.018313958, 2024-04-25T13:54:51.570 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000117397 2024-04-25T13:54:51.570 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:51.570 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:54:51.570 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:51.570 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:51.570 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:51.570 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:51.570 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T13:54:51.570 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 185088 2024-04-25T13:54:51.570 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:51.571 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T13:54:51.571 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 224, 2024-04-25T13:54:51.571 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 211, 2024-04-25T13:54:51.571 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 1690000, 2024-04-25T13:54:51.571 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 128512, 2024-04-25T13:54:51.571 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 2, 2024-04-25T13:54:51.571 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 1, 2024-04-25T13:54:51.571 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.049983644, 2024-04-25T13:54:51.571 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.014135599, 2024-04-25T13:54:51.571 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.045012406, 2024-04-25T13:54:51.571 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.004525359, 2024-04-25T13:54:51.571 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:54:51.571 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 211, 2024-04-25T13:54:51.571 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.011331102, 2024-04-25T13:54:51.571 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000053701 2024-04-25T13:54:51.572 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:51.572 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:54:51.572 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:51.572 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:51.572 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:51.572 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:51.572 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 1690000, 2024-04-25T13:54:51.572 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 128512 2024-04-25T13:54:51.572 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:51.572 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-04-25T13:54:51.572 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 0, 2024-04-25T13:54:51.572 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-04-25T13:54:51.572 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:51.572 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-04-25T13:54:51.572 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-04-25T13:54:51.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-04-25T13:54:51.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T13:54:51.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-04-25T13:54:51.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T13:54:51.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-04-25T13:54:51.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T13:54:51.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T13:54:51.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T13:54:51.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T13:54:51.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T13:54:51.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-04-25T13:54:51.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T13:54:51.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T13:54:51.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-04-25T13:54:51.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-04-25T13:54:51.574 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-04-25T13:54:51.574 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-04-25T13:54:51.574 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T13:54:51.574 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T13:54:51.574 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T13:54:51.574 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T13:54:51.574 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T13:54:51.574 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-04-25T13:54:51.574 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-04-25T13:54:51.574 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-04-25T13:54:51.574 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T13:54:51.574 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T13:54:51.574 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-04-25T13:54:51.574 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-04-25T13:54:51.574 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-04-25T13:54:51.575 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-04-25T13:54:51.575 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T13:54:51.575 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-04-25T13:54:51.575 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T13:54:51.575 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-04-25T13:54:51.575 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 149057, 2024-04-25T13:54:51.575 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 32, 2024-04-25T13:54:51.575 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-04-25T13:54:51.575 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-04-25T13:54:51.575 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-04-25T13:54:51.575 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-04-25T13:54:51.575 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-04-25T13:54:51.575 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-04-25T13:54:51.575 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-04-25T13:54:51.575 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-04-25T13:54:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 0, 2024-04-25T13:54:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 0, 2024-04-25T13:54:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T13:54:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-04-25T13:54:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-04-25T13:54:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-04-25T13:54:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 928, 2024-04-25T13:54:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 2, 2024-04-25T13:54:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-04-25T13:54:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-04-25T13:54:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-04-25T13:54:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-04-25T13:54:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T13:54:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-25T13:54:51.576 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-04-25T13:54:51.577 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-25T13:54:51.577 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 222, 2024-04-25T13:54:51.577 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 1655983, 2024-04-25T13:54:51.577 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-25T13:54:51.577 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 222, 2024-04-25T13:54:51.577 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-04-25T13:54:51.577 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-04-25T13:54:51.577 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 222, 2024-04-25T13:54:51.577 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 1655983, 2024-04-25T13:54:51.577 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-25T13:54:51.577 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:51.577 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:51.577 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:51.577 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:51.577 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:51.577 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T13:54:52.205 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:51 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.205 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:51 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.205 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:51 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.205 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:51 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.205 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:51 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.205 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:51 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.206 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:51 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.206 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:51 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.294 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-04-25T13:54:52.294 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-04-25T13:54:52.294 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-04-25T13:54:52.294 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-04-25T13:54:52.294 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-04-25T13:54:52.294 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-04-25T13:54:52.294 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-04-25T13:54:52.294 DEBUG:tasks.check_counter:Getting stats from j 2024-04-25T13:54:52.295 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph daemon mds.j perf dump 2024-04-25T13:54:52.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:51 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:51 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:51 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:51 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:51 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:51 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:51 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:51 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:51 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:51 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:51 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:51 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:51 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:51 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:51 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:51 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:52.785 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T13:54:53.183 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:52 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi175 to 176.2M 2024-04-25T13:54:53.183 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:52 smithi043 ceph-mon[29195]: Unable to set osd_memory_target on smithi175 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-25T13:54:53.183 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:52 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi161 to 176.2M 2024-04-25T13:54:53.183 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:52 smithi043 ceph-mon[29195]: Unable to set osd_memory_target on smithi161 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-04-25T13:54:53.183 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:52 smithi043 ceph-mon[29195]: pgmap v319: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T13:54:53.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:52 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi175 to 176.2M 2024-04-25T13:54:53.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:52 smithi161 ceph-mon[32696]: Unable to set osd_memory_target on smithi175 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-25T13:54:53.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:52 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi161 to 176.2M 2024-04-25T13:54:53.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:52 smithi161 ceph-mon[32696]: Unable to set osd_memory_target on smithi161 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-04-25T13:54:53.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:52 smithi161 ceph-mon[32696]: pgmap v319: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T13:54:53.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:52 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi175 to 176.2M 2024-04-25T13:54:53.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:52 smithi175 ceph-mon[32649]: Unable to set osd_memory_target on smithi175 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-04-25T13:54:53.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:52 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi161 to 176.2M 2024-04-25T13:54:53.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:52 smithi175 ceph-mon[32649]: Unable to set osd_memory_target on smithi161 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-04-25T13:54:53.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:52 smithi175 ceph-mon[32649]: pgmap v319: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T13:54:54.582 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T13:54:54.582 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T13:54:54.582 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 0, 2024-04-25T13:54:54.582 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 2, 2024-04-25T13:54:54.583 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 0, 2024-04-25T13:54:54.583 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 0, 2024-04-25T13:54:54.583 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 4, 2024-04-25T13:54:54.583 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 0, 2024-04-25T13:54:54.583 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.001486341, 2024-04-25T13:54:54.583 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.000000000, 2024-04-25T13:54:54.583 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.000342883, 2024-04-25T13:54:54.583 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T13:54:54.583 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:54:54.583 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:54.583 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:54.583 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:54.583 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:54.583 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:54:54.584 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:54.584 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:54.584 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:54.584 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:54.584 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T13:54:54.584 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T13:54:54.584 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:54.584 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T13:54:54.584 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 6, 2024-04-25T13:54:54.584 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 166, 2024-04-25T13:54:54.584 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 3312, 2024-04-25T13:54:54.584 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 186416, 2024-04-25T13:54:54.584 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 5, 2024-04-25T13:54:54.584 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 3, 2024-04-25T13:54:54.584 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.016094785, 2024-04-25T13:54:54.585 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.011040268, 2024-04-25T13:54:54.585 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.002263964, 2024-04-25T13:54:54.585 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T13:54:54.585 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:54:54.585 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 164, 2024-04-25T13:54:54.585 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.011131285, 2024-04-25T13:54:54.585 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000067873 2024-04-25T13:54:54.585 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:54.585 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:54:54.585 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:54.585 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:54.585 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:54.585 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:54.585 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-25T13:54:54.586 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 186416 2024-04-25T13:54:54.586 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:54.586 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T13:54:54.586 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 226, 2024-04-25T13:54:54.586 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 215, 2024-04-25T13:54:54.586 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 1688640, 2024-04-25T13:54:54.586 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 131888, 2024-04-25T13:54:54.586 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 2, 2024-04-25T13:54:54.586 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 1, 2024-04-25T13:54:54.586 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.052478596, 2024-04-25T13:54:54.586 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.014414388, 2024-04-25T13:54:54.586 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.046588632, 2024-04-25T13:54:54.586 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.004511645, 2024-04-25T13:54:54.587 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:54:54.587 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 214, 2024-04-25T13:54:54.587 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.010419573, 2024-04-25T13:54:54.587 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000048689 2024-04-25T13:54:54.587 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:54.587 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:54:54.587 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:54.587 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:54.587 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:54.587 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:54.587 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 1688640, 2024-04-25T13:54:54.587 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 131888 2024-04-25T13:54:54.587 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:54.587 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-04-25T13:54:54.587 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 0, 2024-04-25T13:54:54.588 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-04-25T13:54:54.588 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:54.588 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-04-25T13:54:54.588 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-04-25T13:54:54.588 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-04-25T13:54:54.588 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T13:54:54.588 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-04-25T13:54:54.588 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T13:54:54.588 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-04-25T13:54:54.588 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T13:54:54.588 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T13:54:54.588 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T13:54:54.588 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T13:54:54.588 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T13:54:54.588 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-04-25T13:54:54.589 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T13:54:54.589 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T13:54:54.589 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-04-25T13:54:54.589 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-04-25T13:54:54.589 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-04-25T13:54:54.589 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-04-25T13:54:54.589 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T13:54:54.589 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T13:54:54.589 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T13:54:54.589 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T13:54:54.589 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T13:54:54.589 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-04-25T13:54:54.589 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-04-25T13:54:54.589 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-04-25T13:54:54.589 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T13:54:54.589 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T13:54:54.590 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-04-25T13:54:54.590 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-04-25T13:54:54.590 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-04-25T13:54:54.590 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-04-25T13:54:54.590 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T13:54:54.590 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-04-25T13:54:54.590 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T13:54:54.590 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-04-25T13:54:54.590 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 148704, 2024-04-25T13:54:54.590 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 29, 2024-04-25T13:54:54.590 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-04-25T13:54:54.590 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-04-25T13:54:54.590 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-04-25T13:54:54.590 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-04-25T13:54:54.591 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-04-25T13:54:54.591 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-04-25T13:54:54.591 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-04-25T13:54:54.591 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-04-25T13:54:54.591 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 0, 2024-04-25T13:54:54.591 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 0, 2024-04-25T13:54:54.591 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T13:54:54.591 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-04-25T13:54:54.591 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-04-25T13:54:54.591 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-04-25T13:54:54.591 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 928, 2024-04-25T13:54:54.591 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 2, 2024-04-25T13:54:54.591 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-04-25T13:54:54.592 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-04-25T13:54:54.592 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-04-25T13:54:54.592 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-04-25T13:54:54.592 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T13:54:54.592 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T13:54:54.592 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-25T13:54:54.592 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-04-25T13:54:54.592 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-25T13:54:54.592 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 228, 2024-04-25T13:54:54.592 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 1656763, 2024-04-25T13:54:54.592 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-25T13:54:54.592 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 228, 2024-04-25T13:54:54.592 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-04-25T13:54:54.592 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-04-25T13:54:54.592 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 228, 2024-04-25T13:54:54.593 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 1656763, 2024-04-25T13:54:54.593 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-25T13:54:54.593 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T13:54:54.593 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T13:54:54.593 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T13:54:54.593 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:54.593 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T13:54:54.593 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T13:54:55.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:54 smithi043 ceph-mon[29195]: pgmap v320: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:54:55.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:54 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:55.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:54 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:55.303 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-04-25T13:54:55.303 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-04-25T13:54:55.303 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-04-25T13:54:55.303 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-04-25T13:54:55.303 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-04-25T13:54:55.303 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-04-25T13:54:55.303 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-04-25T13:54:55.303 DEBUG:tasks.check_counter:Getting stats from b 2024-04-25T13:54:55.304 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph daemon mds.b perf dump 2024-04-25T13:54:55.331 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:54 smithi161 ceph-mon[32696]: pgmap v320: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:54:55.331 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:54 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:55.331 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:54 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:54 smithi175 ceph-mon[32649]: pgmap v320: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:54:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:54 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:55.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:54 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:55.554 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T13:54:56.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:55 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:56.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:55 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:56.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:55 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:56.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:55 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:56.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:55 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:54:56.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:55 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:54:56.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:55 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:56.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:55 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:56.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:55 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:56.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:55 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:56.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:55 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:56.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:55 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:54:56.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:55 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:54:56.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:55 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:56.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:55 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:56.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:55 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:56.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:55 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:56.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:55 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T13:54:56.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:55 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T13:54:56.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:55 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T13:54:56.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:55 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' 2024-04-25T13:54:57.189 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:56 smithi161 ceph-mon[32696]: Adjusting osd_memory_target on smithi043 to 177.2M 2024-04-25T13:54:57.189 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:56 smithi161 ceph-mon[32696]: Unable to set osd_memory_target on smithi043 to 185894912: error parsing value: Value '185894912' is below minimum 939524096 2024-04-25T13:54:57.189 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:56 smithi161 ceph-mon[32696]: pgmap v321: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:54:57.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:56 smithi043 ceph-mon[29195]: Adjusting osd_memory_target on smithi043 to 177.2M 2024-04-25T13:54:57.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:56 smithi043 ceph-mon[29195]: Unable to set osd_memory_target on smithi043 to 185894912: error parsing value: Value '185894912' is below minimum 939524096 2024-04-25T13:54:57.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:56 smithi043 ceph-mon[29195]: pgmap v321: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:54:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:56 smithi175 ceph-mon[32649]: Adjusting osd_memory_target on smithi043 to 177.2M 2024-04-25T13:54:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:56 smithi175 ceph-mon[32649]: Unable to set osd_memory_target on smithi043 to 185894912: error parsing value: Value '185894912' is below minimum 939524096 2024-04-25T13:54:57.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:56 smithi175 ceph-mon[32649]: pgmap v321: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:54:57.504 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-04-25T13:54:57.504 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T13:54:57.504 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 87493, 2024-04-25T13:54:57.504 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 82812, 2024-04-25T13:54:57.504 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 21777938, 2024-04-25T13:54:57.504 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 108667460, 2024-04-25T13:54:57.504 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 11, 2024-04-25T13:54:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 5, 2024-04-25T13:54:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 5.713199276, 2024-04-25T13:54:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 2.760551389, 2024-04-25T13:54:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 3.325591420, 2024-04-25T13:54:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.411087904, 2024-04-25T13:54:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:54:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 82814, 2024-04-25T13:54:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 3.137631566, 2024-04-25T13:54:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000037887 2024-04-25T13:54:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:54:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 143104, 2024-04-25T13:54:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.026897395, 2024-04-25T13:54:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000187 2024-04-25T13:54:57.505 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 357888, 2024-04-25T13:54:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 87424 2024-04-25T13:54:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T13:54:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 81682, 2024-04-25T13:54:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 80537, 2024-04-25T13:54:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 21145709, 2024-04-25T13:54:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 72835112, 2024-04-25T13:54:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 11, 2024-04-25T13:54:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 5, 2024-04-25T13:54:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 4.109515601, 2024-04-25T13:54:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 1.620625077, 2024-04-25T13:54:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 2.727692429, 2024-04-25T13:54:57.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.387958148, 2024-04-25T13:54:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:54:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 80537, 2024-04-25T13:54:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 3.508767321, 2024-04-25T13:54:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000043567 2024-04-25T13:54:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:54:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 135449, 2024-04-25T13:54:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.024179185, 2024-04-25T13:54:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000178 2024-04-25T13:54:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 42848, 2024-04-25T13:54:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 454928 2024-04-25T13:54:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T13:54:57.507 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 74790, 2024-04-25T13:54:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 129999, 2024-04-25T13:54:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 27013602, 2024-04-25T13:54:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 86252945, 2024-04-25T13:54:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 18, 2024-04-25T13:54:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 8, 2024-04-25T13:54:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 5.352033516, 2024-04-25T13:54:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 2.272016029, 2024-04-25T13:54:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 3.024419124, 2024-04-25T13:54:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.398110943, 2024-04-25T13:54:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:54:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 129992, 2024-04-25T13:54:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 3.829704945, 2024-04-25T13:54:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000029461 2024-04-25T13:54:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:54:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 172754, 2024-04-25T13:54:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.030143718, 2024-04-25T13:54:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000174 2024-04-25T13:54:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 1856960, 2024-04-25T13:54:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 174512 2024-04-25T13:54:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: "cct": { 2024-04-25T13:54:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: "total_workers": 1, 2024-04-25T13:54:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: "unhealthy_workers": 0 2024-04-25T13:54:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: "finisher-MDSRank": { 2024-04-25T13:54:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: "queue_len": 0, 2024-04-25T13:54:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: "complete_latency": { 2024-04-25T13:54:57.509 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 9328, 2024-04-25T13:54:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 34.690714838, 2024-04-25T13:54:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.003718987 2024-04-25T13:54:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:54:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: "finisher-PurgeQueue": { 2024-04-25T13:54:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: "queue_len": 0, 2024-04-25T13:54:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: "complete_latency": { 2024-04-25T13:54:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 18606, 2024-04-25T13:54:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 3.421541380, 2024-04-25T13:54:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000183894 2024-04-25T13:54:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:54:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": { 2024-04-25T13:54:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: "request": 42555, 2024-04-25T13:54:57.510 INFO:teuthology.orchestra.run.smithi161.stdout: "reply": 41218, 2024-04-25T13:54:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: "reply_latency": { 2024-04-25T13:54:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 41218, 2024-04-25T13:54:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 114.986580567, 2024-04-25T13:54:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.002789717 2024-04-25T13:54:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: "slow_reply": 0, 2024-04-25T13:54:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: "forward": 1337, 2024-04-25T13:54:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_fetch_complete": 0, 2024-04-25T13:54:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_fetch_keys": 0, 2024-04-25T13:54:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_commit": 115, 2024-04-25T13:54:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_split": 12, 2024-04-25T13:54:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_merge": 0, 2024-04-25T13:54:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes": 24324, 2024-04-25T13:54:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_top": 65, 2024-04-25T13:54:57.511 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_bottom": 23818, 2024-04-25T13:54:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_pin_tail": 441, 2024-04-25T13:54:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_pinned": 24231, 2024-04-25T13:54:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_expired": 2379, 2024-04-25T13:54:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_with_caps": 3, 2024-04-25T13:54:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": 3, 2024-04-25T13:54:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: "subtrees": 165, 2024-04-25T13:54:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse": 60505, 2024-04-25T13:54:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_hit": 53422, 2024-04-25T13:54:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_forward": 1125, 2024-04-25T13:54:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_discover": 373, 2024-04-25T13:54:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_dir_fetch": 0, 2024-04-25T13:54:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_remote_ino": 0, 2024-04-25T13:54:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_lock": 37, 2024-04-25T13:54:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: "load_cent": 0, 2024-04-25T13:54:57.512 INFO:teuthology.orchestra.run.smithi161.stdout: "q": 0, 2024-04-25T13:54:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: "exported": 139, 2024-04-25T13:54:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: "exported_inodes": 1657, 2024-04-25T13:54:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: "imported": 4, 2024-04-25T13:54:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: "imported_inodes": 6, 2024-04-25T13:54:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_dir_fetch": 0, 2024-04-25T13:54:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_backtrace_fetch": 0, 2024-04-25T13:54:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_peer_discover": 0, 2024-04-25T13:54:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rfiles": 4, 2024-04-25T13:54:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rbytes": 234, 2024-04-25T13:54:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rsnaps": 6, 2024-04-25T13:54:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T13:54:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_set_tag": 0, 2024-04-25T13:54:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T13:54:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_inotable_repaired": 0, 2024-04-25T13:54:57.513 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dir_inodes": 0, 2024-04-25T13:54:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T13:54:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T13:54:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_file_inodes": 0, 2024-04-25T13:54:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_inode_file_caps": 158, 2024-04-25T13:54:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_revoke": 8364, 2024-04-25T13:54:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_grant": 27982, 2024-04-25T13:54:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_trunc": 198, 2024-04-25T13:54:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T13:54:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T13:54:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_caps": 21886, 2024-04-25T13:54:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_caps_dirty": 12987, 2024-04-25T13:54:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_cap_release": 160, 2024-04-25T13:54:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: "process_request_cap_release": 40260 2024-04-25T13:54:57.514 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_cache": { 2024-04-25T13:54:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_update": 2759, 2024-04-25T13:54:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_update_receipt": 554, 2024-04-25T13:54:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_try_discover": 368, 2024-04-25T13:54:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_send_discover": 572, 2024-04-25T13:54:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_handle_discover": 6050, 2024-04-25T13:54:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays": 1377, 2024-04-25T13:54:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays_delayed": 0, 2024-04-25T13:54:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays_enqueuing": 0, 2024-04-25T13:54:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_created": 12262, 2024-04-25T13:54:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_enqueued": 10816, 2024-04-25T13:54:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_reintegrated": 69, 2024-04-25T13:54:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_migrated": 28, 2024-04-25T13:54:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_processing": 0, 2024-04-25T13:54:57.515 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_enqueued": 0, 2024-04-25T13:54:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_prioritized": 0, 2024-04-25T13:54:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: "recovery_started": 0, 2024-04-25T13:54:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: "recovery_completed": 0, 2024-04-25T13:54:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_quiesce_path": 0, 2024-04-25T13:54:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_quiesce_inode": 0, 2024-04-25T13:54:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T13:54:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_exportdir": 143, 2024-04-25T13:54:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_flush": 0, 2024-04-25T13:54:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_fragmentdir": 12, 2024-04-25T13:54:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_fragstats": 0, 2024-04-25T13:54:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_inodestats": 0 2024-04-25T13:54:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_log": { 2024-04-25T13:54:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: "evlrg": 0, 2024-04-25T13:54:57.516 INFO:teuthology.orchestra.run.smithi161.stdout: "evadd": 55084, 2024-04-25T13:54:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: "evex": 0, 2024-04-25T13:54:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: "evtrm": 0, 2024-04-25T13:54:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: "ev": 55084, 2024-04-25T13:54:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: "evexg": 0, 2024-04-25T13:54:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: "evexd": 0, 2024-04-25T13:54:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: "segadd": 78, 2024-04-25T13:54:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: "segex": 0, 2024-04-25T13:54:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: "segtrm": 0, 2024-04-25T13:54:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: "seg": 78, 2024-04-25T13:54:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: "segmjr": 6, 2024-04-25T13:54:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: "segexg": 0, 2024-04-25T13:54:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: "segexd": 0, 2024-04-25T13:54:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: "expos": 4194304, 2024-04-25T13:54:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: "wrpos": 149251593, 2024-04-25T13:54:57.517 INFO:teuthology.orchestra.run.smithi161.stdout: "rdpos": 0, 2024-04-25T13:54:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: "jlat": { 2024-04-25T13:54:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 5646, 2024-04-25T13:54:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 128.518828590, 2024-04-25T13:54:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.022762810 2024-04-25T13:54:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: "replayed": 0 2024-04-25T13:54:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_mem": { 2024-04-25T13:54:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: "ino": 10949, 2024-04-25T13:54:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: "ino+": 23670, 2024-04-25T13:54:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: "ino-": 12721, 2024-04-25T13:54:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: "dir": 1479, 2024-04-25T13:54:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: "dir+": 2070, 2024-04-25T13:54:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: "dir-": 591, 2024-04-25T13:54:57.518 INFO:teuthology.orchestra.run.smithi161.stdout: "dn": 24341, 2024-04-25T13:54:57.519 INFO:teuthology.orchestra.run.smithi161.stdout: "dn+": 38324, 2024-04-25T13:54:57.519 INFO:teuthology.orchestra.run.smithi161.stdout: "dn-": 13983, 2024-04-25T13:54:57.519 INFO:teuthology.orchestra.run.smithi161.stdout: "cap": 3, 2024-04-25T13:54:57.519 INFO:teuthology.orchestra.run.smithi161.stdout: "cap+": 14019, 2024-04-25T13:54:57.519 INFO:teuthology.orchestra.run.smithi161.stdout: "cap-": 14016, 2024-04-25T13:54:57.519 INFO:teuthology.orchestra.run.smithi161.stdout: "rss": 259308, 2024-04-25T13:54:57.519 INFO:teuthology.orchestra.run.smithi161.stdout: "heap": 231824 2024-04-25T13:54:57.519 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.519 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_server": { 2024-04-25T13:54:57.519 INFO:teuthology.orchestra.run.smithi161.stdout: "dispatch_client_request": 59796, 2024-04-25T13:54:57.519 INFO:teuthology.orchestra.run.smithi161.stdout: "dispatch_server_request": 48652, 2024-04-25T13:54:57.519 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_request": 42555, 2024-04-25T13:54:57.519 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_session": 268, 2024-04-25T13:54:57.519 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_peer_request": 104335, 2024-04-25T13:54:57.519 INFO:teuthology.orchestra.run.smithi161.stdout: "req_create_latency": { 2024-04-25T13:54:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 11405, 2024-04-25T13:54:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 23.272398606, 2024-04-25T13:54:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.002040543 2024-04-25T13:54:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getattr_latency": { 2024-04-25T13:54:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 8129, 2024-04-25T13:54:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 3.424763616, 2024-04-25T13:54:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000421301 2024-04-25T13:54:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getfilelock_latency": { 2024-04-25T13:54:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: "req_link_latency": { 2024-04-25T13:54:57.520 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 186, 2024-04-25T13:54:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 1.390824669, 2024-04-25T13:54:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.007477551 2024-04-25T13:54:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookup_latency": { 2024-04-25T13:54:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 3436, 2024-04-25T13:54:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 23.157451247, 2024-04-25T13:54:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.006739654 2024-04-25T13:54:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookuphash_latency": { 2024-04-25T13:54:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupino_latency": { 2024-04-25T13:54:57.521 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.522 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.522 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.522 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.522 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupname_latency": { 2024-04-25T13:54:57.522 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.522 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.522 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.522 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.522 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupparent_latency": { 2024-04-25T13:54:57.522 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.522 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.522 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.522 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.522 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupsnap_latency": { 2024-04-25T13:54:57.522 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.523 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.523 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.523 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.523 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lssnap_latency": { 2024-04-25T13:54:57.523 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 10, 2024-04-25T13:54:57.523 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.001679464, 2024-04-25T13:54:57.523 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000167946 2024-04-25T13:54:57.523 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mkdir_latency": { 2024-04-25T13:54:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 1708, 2024-04-25T13:54:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 3.752512725, 2024-04-25T13:54:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.002197021 2024-04-25T13:54:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mknod_latency": { 2024-04-25T13:54:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 368, 2024-04-25T13:54:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 1.041865819, 2024-04-25T13:54:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.002831157 2024-04-25T13:54:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mksnap_latency": { 2024-04-25T13:54:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 10, 2024-04-25T13:54:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.079660913, 2024-04-25T13:54:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.007966091 2024-04-25T13:54:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.524 INFO:teuthology.orchestra.run.smithi161.stdout: "req_open_latency": { 2024-04-25T13:54:57.525 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 748, 2024-04-25T13:54:57.525 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 1.639240436, 2024-04-25T13:54:57.525 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.002191497 2024-04-25T13:54:57.525 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.525 INFO:teuthology.orchestra.run.smithi161.stdout: "req_readdir_latency": { 2024-04-25T13:54:57.525 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 1637, 2024-04-25T13:54:57.525 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 3.293255417, 2024-04-25T13:54:57.525 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.002011762 2024-04-25T13:54:57.525 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.525 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rename_latency": { 2024-04-25T13:54:57.525 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 446, 2024-04-25T13:54:57.525 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 7.560592364, 2024-04-25T13:54:57.525 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.016952000 2024-04-25T13:54:57.525 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.525 INFO:teuthology.orchestra.run.smithi161.stdout: "req_renamesnap_latency": { 2024-04-25T13:54:57.525 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.526 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.526 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.526 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.526 INFO:teuthology.orchestra.run.smithi161.stdout: "req_snapdiff_latency": { 2024-04-25T13:54:57.526 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.526 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.526 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.526 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.526 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmdir_latency": { 2024-04-25T13:54:57.526 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 1739, 2024-04-25T13:54:57.526 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 23.585984482, 2024-04-25T13:54:57.526 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.013562958 2024-04-25T13:54:57.526 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.526 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmsnap_latency": { 2024-04-25T13:54:57.526 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 4, 2024-04-25T13:54:57.527 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.019163477, 2024-04-25T13:54:57.527 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.004790869 2024-04-25T13:54:57.527 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.527 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmxattr_latency": { 2024-04-25T13:54:57.527 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.527 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.527 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.527 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.527 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setattr_latency": { 2024-04-25T13:54:57.527 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 229, 2024-04-25T13:54:57.527 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 2.306139721, 2024-04-25T13:54:57.527 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.010070479 2024-04-25T13:54:57.527 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.527 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setdirlayout_latency": { 2024-04-25T13:54:57.527 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.528 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.528 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.528 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.528 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setfilelock_latency": { 2024-04-25T13:54:57.528 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.528 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.528 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.528 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.528 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setlayout_latency": { 2024-04-25T13:54:57.528 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.528 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.528 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.528 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.528 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setxattr_latency": { 2024-04-25T13:54:57.528 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 9, 2024-04-25T13:54:57.528 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.022641597, 2024-04-25T13:54:57.529 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.002515733 2024-04-25T13:54:57.529 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.529 INFO:teuthology.orchestra.run.smithi161.stdout: "req_symlink_latency": { 2024-04-25T13:54:57.529 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 354, 2024-04-25T13:54:57.529 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 1.119713424, 2024-04-25T13:54:57.529 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.003163032 2024-04-25T13:54:57.529 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.529 INFO:teuthology.orchestra.run.smithi161.stdout: "req_unlink_latency": { 2024-04-25T13:54:57.529 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 10800, 2024-04-25T13:54:57.529 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 19.318692590, 2024-04-25T13:54:57.529 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.001788767 2024-04-25T13:54:57.529 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.529 INFO:teuthology.orchestra.run.smithi161.stdout: "cap_revoke_eviction": 0, 2024-04-25T13:54:57.529 INFO:teuthology.orchestra.run.smithi161.stdout: "cap_acquisition_throttle": 0, 2024-04-25T13:54:57.529 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getvxattr_latency": { 2024-04-25T13:54:57.529 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.530 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.530 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.530 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:54:57.530 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.530 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_sessions": { 2024-04-25T13:54:57.530 INFO:teuthology.orchestra.run.smithi161.stdout: "session_count": 2, 2024-04-25T13:54:57.530 INFO:teuthology.orchestra.run.smithi161.stdout: "session_add": 7, 2024-04-25T13:54:57.530 INFO:teuthology.orchestra.run.smithi161.stdout: "session_remove": 5, 2024-04-25T13:54:57.530 INFO:teuthology.orchestra.run.smithi161.stdout: "sessions_open": 2, 2024-04-25T13:54:57.530 INFO:teuthology.orchestra.run.smithi161.stdout: "sessions_stale": 0, 2024-04-25T13:54:57.530 INFO:teuthology.orchestra.run.smithi161.stdout: "total_load": 515, 2024-04-25T13:54:57.530 INFO:teuthology.orchestra.run.smithi161.stdout: "average_load": 257, 2024-04-25T13:54:57.530 INFO:teuthology.orchestra.run.smithi161.stdout: "avg_session_uptime": 606, 2024-04-25T13:54:57.531 INFO:teuthology.orchestra.run.smithi161.stdout: "mdthresh_evicted": 0 2024-04-25T13:54:57.531 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.531 INFO:teuthology.orchestra.run.smithi161.stdout: "mempool": { 2024-04-25T13:54:57.531 INFO:teuthology.orchestra.run.smithi161.stdout: "bloom_filter_bytes": 0, 2024-04-25T13:54:57.531 INFO:teuthology.orchestra.run.smithi161.stdout: "bloom_filter_items": 0, 2024-04-25T13:54:57.531 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T13:54:57.531 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_alloc_items": 0, 2024-04-25T13:54:57.531 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T13:54:57.531 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_data_items": 0, 2024-04-25T13:54:57.531 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T13:54:57.531 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T13:54:57.531 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T13:54:57.531 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T13:54:57.531 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T13:54:57.532 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_other_items": 0, 2024-04-25T13:54:57.532 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T13:54:57.532 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T13:54:57.532 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_extent_bytes": 0, 2024-04-25T13:54:57.532 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_extent_items": 0, 2024-04-25T13:54:57.532 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_blob_bytes": 0, 2024-04-25T13:54:57.532 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_blob_items": 0, 2024-04-25T13:54:57.532 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T13:54:57.532 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T13:54:57.532 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T13:54:57.532 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T13:54:57.532 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T13:54:57.532 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_fsck_items": 0, 2024-04-25T13:54:57.532 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_txc_bytes": 0, 2024-04-25T13:54:57.532 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_txc_items": 0, 2024-04-25T13:54:57.532 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T13:54:57.533 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T13:54:57.533 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_bytes": 0, 2024-04-25T13:54:57.533 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_items": 0, 2024-04-25T13:54:57.533 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_bytes": 0, 2024-04-25T13:54:57.533 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_items": 0, 2024-04-25T13:54:57.533 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T13:54:57.533 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_reader_items": 0, 2024-04-25T13:54:57.533 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T13:54:57.533 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_writer_items": 0, 2024-04-25T13:54:57.533 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_anon_bytes": 11064948, 2024-04-25T13:54:57.533 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_anon_items": 2803, 2024-04-25T13:54:57.533 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_meta_bytes": 0, 2024-04-25T13:54:57.533 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_meta_items": 0, 2024-04-25T13:54:57.533 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_bytes": 0, 2024-04-25T13:54:57.533 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_items": 0, 2024-04-25T13:54:57.534 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_mapbl_bytes": 0, 2024-04-25T13:54:57.534 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_mapbl_items": 0, 2024-04-25T13:54:57.534 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_pglog_bytes": 0, 2024-04-25T13:54:57.534 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_pglog_items": 0, 2024-04-25T13:54:57.534 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_bytes": 9416, 2024-04-25T13:54:57.534 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_items": 180, 2024-04-25T13:54:57.534 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T13:54:57.534 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_mapping_items": 0, 2024-04-25T13:54:57.534 INFO:teuthology.orchestra.run.smithi161.stdout: "pgmap_bytes": 0, 2024-04-25T13:54:57.534 INFO:teuthology.orchestra.run.smithi161.stdout: "pgmap_items": 0, 2024-04-25T13:54:57.534 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_co_bytes": 44682186, 2024-04-25T13:54:57.534 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_co_items": 695063, 2024-04-25T13:54:57.534 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_1_bytes": 0, 2024-04-25T13:54:57.534 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_1_items": 0, 2024-04-25T13:54:57.534 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_2_bytes": 0, 2024-04-25T13:54:57.535 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_2_items": 0 2024-04-25T13:54:57.535 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.535 INFO:teuthology.orchestra.run.smithi161.stdout: "objecter": { 2024-04-25T13:54:57.535 INFO:teuthology.orchestra.run.smithi161.stdout: "op_active": 0, 2024-04-25T13:54:57.535 INFO:teuthology.orchestra.run.smithi161.stdout: "op_laggy": 0, 2024-04-25T13:54:57.535 INFO:teuthology.orchestra.run.smithi161.stdout: "op_send": 28311, 2024-04-25T13:54:57.535 INFO:teuthology.orchestra.run.smithi161.stdout: "op_send_bytes": 149797514, 2024-04-25T13:54:57.535 INFO:teuthology.orchestra.run.smithi161.stdout: "op_resend": 37, 2024-04-25T13:54:57.535 INFO:teuthology.orchestra.run.smithi161.stdout: "op_reply": 28311, 2024-04-25T13:54:57.535 INFO:teuthology.orchestra.run.smithi161.stdout: "op_latency": { 2024-04-25T13:54:57.535 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 28311, 2024-04-25T13:54:57.535 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 161.568537064, 2024-04-25T13:54:57.535 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.005706917 2024-04-25T13:54:57.535 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.535 INFO:teuthology.orchestra.run.smithi161.stdout: "op_inflight": 0, 2024-04-25T13:54:57.535 INFO:teuthology.orchestra.run.smithi161.stdout: "oplen_avg": { 2024-04-25T13:54:57.536 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 28311, 2024-04-25T13:54:57.536 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 28757 2024-04-25T13:54:57.536 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.536 INFO:teuthology.orchestra.run.smithi161.stdout: "op": 28311, 2024-04-25T13:54:57.536 INFO:teuthology.orchestra.run.smithi161.stdout: "op_r": 276, 2024-04-25T13:54:57.536 INFO:teuthology.orchestra.run.smithi161.stdout: "op_w": 28035, 2024-04-25T13:54:57.536 INFO:teuthology.orchestra.run.smithi161.stdout: "op_rmw": 0, 2024-04-25T13:54:57.536 INFO:teuthology.orchestra.run.smithi161.stdout: "op_pg": 0, 2024-04-25T13:54:57.536 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_stat": 0, 2024-04-25T13:54:57.536 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_create": 11, 2024-04-25T13:54:57.536 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_read": 276, 2024-04-25T13:54:57.536 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_write": 5922, 2024-04-25T13:54:57.536 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_writefull": 141, 2024-04-25T13:54:57.536 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_writesame": 0, 2024-04-25T13:54:57.536 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_append": 0, 2024-04-25T13:54:57.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_zero": 11, 2024-04-25T13:54:57.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_truncate": 12, 2024-04-25T13:54:57.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_delete": 21415, 2024-04-25T13:54:57.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_mapext": 0, 2024-04-25T13:54:57.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_sparse_read": 0, 2024-04-25T13:54:57.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_clonerange": 0, 2024-04-25T13:54:57.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_getxattr": 0, 2024-04-25T13:54:57.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_setxattr": 22, 2024-04-25T13:54:57.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_cmpxattr": 0, 2024-04-25T13:54:57.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_rmxattr": 0, 2024-04-25T13:54:57.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_resetxattrs": 0, 2024-04-25T13:54:57.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_call": 0, 2024-04-25T13:54:57.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_watch": 0, 2024-04-25T13:54:57.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_notify": 0, 2024-04-25T13:54:57.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T13:54:57.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_pgls": 0, 2024-04-25T13:54:57.538 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_pgls_filter": 0, 2024-04-25T13:54:57.538 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_other": 241, 2024-04-25T13:54:57.538 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_active": 0, 2024-04-25T13:54:57.538 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_send": 0, 2024-04-25T13:54:57.538 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_resend": 0, 2024-04-25T13:54:57.538 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_ping": 0, 2024-04-25T13:54:57.538 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_active": 0, 2024-04-25T13:54:57.538 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_send": 0, 2024-04-25T13:54:57.538 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_resend": 0, 2024-04-25T13:54:57.538 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_active": 0, 2024-04-25T13:54:57.538 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_send": 0, 2024-04-25T13:54:57.538 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_resend": 0, 2024-04-25T13:54:57.538 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_active": 0, 2024-04-25T13:54:57.538 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_send": 0, 2024-04-25T13:54:57.538 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_resend": 0, 2024-04-25T13:54:57.539 INFO:teuthology.orchestra.run.smithi161.stdout: "command_active": 0, 2024-04-25T13:54:57.539 INFO:teuthology.orchestra.run.smithi161.stdout: "command_send": 0, 2024-04-25T13:54:57.539 INFO:teuthology.orchestra.run.smithi161.stdout: "command_resend": 0, 2024-04-25T13:54:57.539 INFO:teuthology.orchestra.run.smithi161.stdout: "map_epoch": 93, 2024-04-25T13:54:57.539 INFO:teuthology.orchestra.run.smithi161.stdout: "map_full": 0, 2024-04-25T13:54:57.539 INFO:teuthology.orchestra.run.smithi161.stdout: "map_inc": 18, 2024-04-25T13:54:57.539 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_sessions": 12, 2024-04-25T13:54:57.539 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_session_open": 12, 2024-04-25T13:54:57.539 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_session_close": 0, 2024-04-25T13:54:57.539 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_laggy": 0, 2024-04-25T13:54:57.539 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_wr": 543, 2024-04-25T13:54:57.539 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_rd": 0, 2024-04-25T13:54:57.539 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_del": 163 2024-04-25T13:54:57.539 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.539 INFO:teuthology.orchestra.run.smithi161.stdout: "oft": { 2024-04-25T13:54:57.540 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_objs": 1, 2024-04-25T13:54:57.540 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_kv_pairs": 0, 2024-04-25T13:54:57.540 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_updates": 0, 2024-04-25T13:54:57.540 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_removes": 0 2024-04-25T13:54:57.540 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.540 INFO:teuthology.orchestra.run.smithi161.stdout: "osd-slow-ops": { 2024-04-25T13:54:57.540 INFO:teuthology.orchestra.run.smithi161.stdout: "slow_ops_count": 0 2024-04-25T13:54:57.540 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.540 INFO:teuthology.orchestra.run.smithi161.stdout: "purge_queue": { 2024-04-25T13:54:57.540 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_ops": 0, 2024-04-25T13:54:57.540 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_ops_high_water": 20, 2024-04-25T13:54:57.540 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing": 0, 2024-04-25T13:54:57.540 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_high_water": 16, 2024-04-25T13:54:57.540 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executed_ops": 20880, 2024-04-25T13:54:57.540 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executed": 10816, 2024-04-25T13:54:57.540 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_item_in_journal": 0 2024-04-25T13:54:57.541 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.541 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T13:54:57.541 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2024-04-25T13:54:57.541 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 104857600, 2024-04-25T13:54:57.541 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2024-04-25T13:54:57.541 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 243961, 2024-04-25T13:54:57.541 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 47911265, 2024-04-25T13:54:57.541 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2024-04-25T13:54:57.541 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 243961, 2024-04-25T13:54:57.541 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2024-04-25T13:54:57.541 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2024-04-25T13:54:57.541 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 243961, 2024-04-25T13:54:57.541 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 47911265, 2024-04-25T13:54:57.541 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2024-04-25T13:54:57.541 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.541 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.542 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.542 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:54:57.542 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.542 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-objecter_bytes": { 2024-04-25T13:54:57.542 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2024-04-25T13:54:57.542 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 104857600, 2024-04-25T13:54:57.542 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2024-04-25T13:54:57.542 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2024-04-25T13:54:57.542 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2024-04-25T13:54:57.542 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2024-04-25T13:54:57.542 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2024-04-25T13:54:57.542 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 28311, 2024-04-25T13:54:57.542 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 151091914, 2024-04-25T13:54:57.542 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 28311, 2024-04-25T13:54:57.542 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 151091914, 2024-04-25T13:54:57.543 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2024-04-25T13:54:57.543 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.543 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.543 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.543 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:54:57.543 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.543 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-objecter_ops": { 2024-04-25T13:54:57.543 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2024-04-25T13:54:57.543 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 1024, 2024-04-25T13:54:57.543 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2024-04-25T13:54:57.543 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2024-04-25T13:54:57.543 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2024-04-25T13:54:57.543 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2024-04-25T13:54:57.543 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2024-04-25T13:54:57.543 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 28311, 2024-04-25T13:54:57.543 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 28311, 2024-04-25T13:54:57.544 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 28311, 2024-04-25T13:54:57.544 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 28311, 2024-04-25T13:54:57.544 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2024-04-25T13:54:57.544 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.544 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.544 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.544 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:54:57.544 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.544 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-write_buf_throttle": { 2024-04-25T13:54:57.544 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2024-04-25T13:54:57.544 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 3758096384, 2024-04-25T13:54:57.544 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2024-04-25T13:54:57.544 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 10816, 2024-04-25T13:54:57.544 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 1294400, 2024-04-25T13:54:57.544 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2024-04-25T13:54:57.544 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 10816, 2024-04-25T13:54:57.545 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2024-04-25T13:54:57.545 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2024-04-25T13:54:57.545 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 276, 2024-04-25T13:54:57.545 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 1294400, 2024-04-25T13:54:57.545 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2024-04-25T13:54:57.545 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.545 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.545 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.545 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:54:57.545 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:54:57.545 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-write_buf_throttle-0x55a5941c0750": { 2024-04-25T13:54:57.545 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2024-04-25T13:54:57.545 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 3758096384, 2024-04-25T13:54:57.545 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2024-04-25T13:54:57.545 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 55084, 2024-04-25T13:54:57.546 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 145057289, 2024-04-25T13:54:57.546 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2024-04-25T13:54:57.546 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 55084, 2024-04-25T13:54:57.546 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2024-04-25T13:54:57.546 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2024-04-25T13:54:57.546 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 5646, 2024-04-25T13:54:57.546 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 145057289, 2024-04-25T13:54:57.546 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2024-04-25T13:54:57.546 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:54:57.546 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:54:57.546 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:54:57.546 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:54:57.546 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:54:57.546 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-04-25T13:54:58.377 INFO:tasks.check_counter:Daemon mds.b mds.exported=139 2024-04-25T13:54:58.377 INFO:tasks.check_counter:Daemon mds.b mds.imported=4 2024-04-25T13:54:58.377 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=2759 2024-04-25T13:54:58.377 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=554 2024-04-25T13:54:58.377 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-04-25T13:54:58.377 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-04-25T13:54:58.377 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-04-25T13:54:58.377 DEBUG:tasks.check_counter:Getting stats from e 2024-04-25T13:54:58.377 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph daemon mds.e perf dump 2024-04-25T13:54:58.652 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T13:54:59.073 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:54:58 smithi161 ceph-mon[32696]: pgmap v322: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:54:59.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:54:58 smithi043 ceph-mon[29195]: pgmap v322: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:54:59.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:54:58 smithi175 ceph-mon[32649]: pgmap v322: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T13:55:00.503 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-04-25T13:55:00.504 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T13:55:00.504 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 996, 2024-04-25T13:55:00.504 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 978, 2024-04-25T13:55:00.504 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 1986960, 2024-04-25T13:55:00.504 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 371746, 2024-04-25T13:55:00.504 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 5, 2024-04-25T13:55:00.504 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 1, 2024-04-25T13:55:00.504 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 0.134840817, 2024-04-25T13:55:00.504 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 0.047323607, 2024-04-25T13:55:00.504 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 0.063814869, 2024-04-25T13:55:00.504 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.029002903, 2024-04-25T13:55:00.504 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:00.504 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 978, 2024-04-25T13:55:00.504 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.052049524, 2024-04-25T13:55:00.505 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000053220 2024-04-25T13:55:00.505 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.505 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:00.505 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.505 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.505 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.505 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.505 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 1737312, 2024-04-25T13:55:00.505 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 135472 2024-04-25T13:55:00.505 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.505 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T13:55:00.505 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 469, 2024-04-25T13:55:00.505 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 631, 2024-04-25T13:55:00.505 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 2386787, 2024-04-25T13:55:00.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 592264, 2024-04-25T13:55:00.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 7, 2024-04-25T13:55:00.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 5, 2024-04-25T13:55:00.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 0.051255960, 2024-04-25T13:55:00.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 0.018349544, 2024-04-25T13:55:00.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 0.014689713, 2024-04-25T13:55:00.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.012789494, 2024-04-25T13:55:00.506 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:00.506 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 628, 2024-04-25T13:55:00.506 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.025125121, 2024-04-25T13:55:00.506 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000040008 2024-04-25T13:55:00.506 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.507 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:00.507 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.507 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.507 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.507 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.507 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T13:55:00.507 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 443696 2024-04-25T13:55:00.507 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.507 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T13:55:00.507 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 1054, 2024-04-25T13:55:00.507 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 1055, 2024-04-25T13:55:00.507 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 12848869, 2024-04-25T13:55:00.507 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 334861, 2024-04-25T13:55:00.507 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 4, 2024-04-25T13:55:00.507 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 3, 2024-04-25T13:55:00.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 0.090595213, 2024-04-25T13:55:00.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 0.020353851, 2024-04-25T13:55:00.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 0.031967062, 2024-04-25T13:55:00.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.032387480, 2024-04-25T13:55:00.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:00.508 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 1053, 2024-04-25T13:55:00.508 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.027450050, 2024-04-25T13:55:00.508 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000026068 2024-04-25T13:55:00.508 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:00.508 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.508 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.508 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.508 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.508 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T13:55:00.509 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T13:55:00.509 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.509 INFO:teuthology.orchestra.run.smithi161.stdout: "cct": { 2024-04-25T13:55:00.509 INFO:teuthology.orchestra.run.smithi161.stdout: "total_workers": 1, 2024-04-25T13:55:00.509 INFO:teuthology.orchestra.run.smithi161.stdout: "unhealthy_workers": 0 2024-04-25T13:55:00.509 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.509 INFO:teuthology.orchestra.run.smithi161.stdout: "finisher-MDSRank": { 2024-04-25T13:55:00.509 INFO:teuthology.orchestra.run.smithi161.stdout: "queue_len": 0, 2024-04-25T13:55:00.509 INFO:teuthology.orchestra.run.smithi161.stdout: "complete_latency": { 2024-04-25T13:55:00.509 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 3820, 2024-04-25T13:55:00.509 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.107494576, 2024-04-25T13:55:00.509 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000028139 2024-04-25T13:55:00.509 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:00.509 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.509 INFO:teuthology.orchestra.run.smithi161.stdout: "finisher-PurgeQueue": { 2024-04-25T13:55:00.509 INFO:teuthology.orchestra.run.smithi161.stdout: "queue_len": 0, 2024-04-25T13:55:00.510 INFO:teuthology.orchestra.run.smithi161.stdout: "complete_latency": { 2024-04-25T13:55:00.510 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.510 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.510 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.510 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:00.510 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.510 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": { 2024-04-25T13:55:00.510 INFO:teuthology.orchestra.run.smithi161.stdout: "request": 0, 2024-04-25T13:55:00.510 INFO:teuthology.orchestra.run.smithi161.stdout: "reply": 0, 2024-04-25T13:55:00.510 INFO:teuthology.orchestra.run.smithi161.stdout: "reply_latency": { 2024-04-25T13:55:00.510 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.510 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.511 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.511 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.511 INFO:teuthology.orchestra.run.smithi161.stdout: "slow_reply": 0, 2024-04-25T13:55:00.511 INFO:teuthology.orchestra.run.smithi161.stdout: "forward": 0, 2024-04-25T13:55:00.511 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_fetch_complete": 0, 2024-04-25T13:55:00.511 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_fetch_keys": 0, 2024-04-25T13:55:00.511 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_commit": 0, 2024-04-25T13:55:00.511 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_split": 0, 2024-04-25T13:55:00.511 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_merge": 0, 2024-04-25T13:55:00.511 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes": 3743, 2024-04-25T13:55:00.511 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_top": 0, 2024-04-25T13:55:00.511 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_bottom": 3743, 2024-04-25T13:55:00.511 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_pin_tail": 0, 2024-04-25T13:55:00.511 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_pinned": 3743, 2024-04-25T13:55:00.512 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_expired": 0, 2024-04-25T13:55:00.512 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_with_caps": 0, 2024-04-25T13:55:00.512 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": 0, 2024-04-25T13:55:00.512 INFO:teuthology.orchestra.run.smithi161.stdout: "subtrees": 79, 2024-04-25T13:55:00.512 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse": 0, 2024-04-25T13:55:00.512 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_hit": 0, 2024-04-25T13:55:00.512 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_forward": 0, 2024-04-25T13:55:00.512 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_discover": 0, 2024-04-25T13:55:00.512 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_dir_fetch": 0, 2024-04-25T13:55:00.512 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_remote_ino": 0, 2024-04-25T13:55:00.512 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_lock": 0, 2024-04-25T13:55:00.512 INFO:teuthology.orchestra.run.smithi161.stdout: "load_cent": 0, 2024-04-25T13:55:00.513 INFO:teuthology.orchestra.run.smithi161.stdout: "q": 0, 2024-04-25T13:55:00.514 INFO:teuthology.orchestra.run.smithi161.stdout: "exported": 0, 2024-04-25T13:55:00.514 INFO:teuthology.orchestra.run.smithi161.stdout: "exported_inodes": 0, 2024-04-25T13:55:00.514 INFO:teuthology.orchestra.run.smithi161.stdout: "imported": 0, 2024-04-25T13:55:00.514 INFO:teuthology.orchestra.run.smithi161.stdout: "imported_inodes": 0, 2024-04-25T13:55:00.514 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_dir_fetch": 0, 2024-04-25T13:55:00.514 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_backtrace_fetch": 0, 2024-04-25T13:55:00.514 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_peer_discover": 0, 2024-04-25T13:55:00.514 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rfiles": 0, 2024-04-25T13:55:00.514 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rbytes": 0, 2024-04-25T13:55:00.514 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rsnaps": 0, 2024-04-25T13:55:00.514 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T13:55:00.514 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_set_tag": 0, 2024-04-25T13:55:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T13:55:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_inotable_repaired": 0, 2024-04-25T13:55:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dir_inodes": 0, 2024-04-25T13:55:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T13:55:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T13:55:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_file_inodes": 0, 2024-04-25T13:55:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_inode_file_caps": 0, 2024-04-25T13:55:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_revoke": 0, 2024-04-25T13:55:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_grant": 0, 2024-04-25T13:55:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T13:55:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T13:55:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T13:55:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_caps": 0, 2024-04-25T13:55:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_caps_dirty": 0, 2024-04-25T13:55:00.515 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_cap_release": 0, 2024-04-25T13:55:00.516 INFO:teuthology.orchestra.run.smithi161.stdout: "process_request_cap_release": 0 2024-04-25T13:55:00.516 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.516 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_cache": { 2024-04-25T13:55:00.516 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_update": 0, 2024-04-25T13:55:00.516 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_update_receipt": 0, 2024-04-25T13:55:00.516 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_try_discover": 0, 2024-04-25T13:55:00.516 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_send_discover": 0, 2024-04-25T13:55:00.516 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_handle_discover": 0, 2024-04-25T13:55:00.516 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays": 0, 2024-04-25T13:55:00.516 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays_delayed": 0, 2024-04-25T13:55:00.516 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays_enqueuing": 0, 2024-04-25T13:55:00.516 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_created": 0, 2024-04-25T13:55:00.516 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_enqueued": 0, 2024-04-25T13:55:00.517 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_reintegrated": 0, 2024-04-25T13:55:00.517 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_migrated": 0, 2024-04-25T13:55:00.517 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_processing": 0, 2024-04-25T13:55:00.517 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_enqueued": 0, 2024-04-25T13:55:00.517 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_prioritized": 0, 2024-04-25T13:55:00.517 INFO:teuthology.orchestra.run.smithi161.stdout: "recovery_started": 0, 2024-04-25T13:55:00.517 INFO:teuthology.orchestra.run.smithi161.stdout: "recovery_completed": 0, 2024-04-25T13:55:00.517 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_quiesce_path": 0, 2024-04-25T13:55:00.517 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_quiesce_inode": 0, 2024-04-25T13:55:00.517 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T13:55:00.517 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_exportdir": 0, 2024-04-25T13:55:00.517 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_flush": 0, 2024-04-25T13:55:00.517 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_fragmentdir": 0, 2024-04-25T13:55:00.517 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_fragstats": 0, 2024-04-25T13:55:00.517 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_inodestats": 0 2024-04-25T13:55:00.518 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.518 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_log": { 2024-04-25T13:55:00.518 INFO:teuthology.orchestra.run.smithi161.stdout: "evlrg": 0, 2024-04-25T13:55:00.518 INFO:teuthology.orchestra.run.smithi161.stdout: "evadd": 0, 2024-04-25T13:55:00.518 INFO:teuthology.orchestra.run.smithi161.stdout: "evex": 0, 2024-04-25T13:55:00.518 INFO:teuthology.orchestra.run.smithi161.stdout: "evtrm": 0, 2024-04-25T13:55:00.518 INFO:teuthology.orchestra.run.smithi161.stdout: "ev": 6108, 2024-04-25T13:55:00.518 INFO:teuthology.orchestra.run.smithi161.stdout: "evexg": 0, 2024-04-25T13:55:00.518 INFO:teuthology.orchestra.run.smithi161.stdout: "evexd": 0, 2024-04-25T13:55:00.518 INFO:teuthology.orchestra.run.smithi161.stdout: "segadd": 0, 2024-04-25T13:55:00.518 INFO:teuthology.orchestra.run.smithi161.stdout: "segex": 0, 2024-04-25T13:55:00.518 INFO:teuthology.orchestra.run.smithi161.stdout: "segtrm": 0, 2024-04-25T13:55:00.518 INFO:teuthology.orchestra.run.smithi161.stdout: "seg": 8, 2024-04-25T13:55:00.519 INFO:teuthology.orchestra.run.smithi161.stdout: "segmjr": 2, 2024-04-25T13:55:00.519 INFO:teuthology.orchestra.run.smithi161.stdout: "segexg": 0, 2024-04-25T13:55:00.519 INFO:teuthology.orchestra.run.smithi161.stdout: "segexd": 0, 2024-04-25T13:55:00.519 INFO:teuthology.orchestra.run.smithi161.stdout: "expos": 4194304, 2024-04-25T13:55:00.519 INFO:teuthology.orchestra.run.smithi161.stdout: "wrpos": 19042273, 2024-04-25T13:55:00.519 INFO:teuthology.orchestra.run.smithi161.stdout: "rdpos": 19040185, 2024-04-25T13:55:00.519 INFO:teuthology.orchestra.run.smithi161.stdout: "jlat": { 2024-04-25T13:55:00.519 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.519 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.519 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.519 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.519 INFO:teuthology.orchestra.run.smithi161.stdout: "replayed": 6108 2024-04-25T13:55:00.519 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.519 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_mem": { 2024-04-25T13:55:00.519 INFO:teuthology.orchestra.run.smithi161.stdout: "ino": 1022, 2024-04-25T13:55:00.520 INFO:teuthology.orchestra.run.smithi161.stdout: "ino+": 2438, 2024-04-25T13:55:00.520 INFO:teuthology.orchestra.run.smithi161.stdout: "ino-": 1416, 2024-04-25T13:55:00.520 INFO:teuthology.orchestra.run.smithi161.stdout: "dir": 230, 2024-04-25T13:55:00.520 INFO:teuthology.orchestra.run.smithi161.stdout: "dir+": 431, 2024-04-25T13:55:00.520 INFO:teuthology.orchestra.run.smithi161.stdout: "dir-": 201, 2024-04-25T13:55:00.520 INFO:teuthology.orchestra.run.smithi161.stdout: "dn": 3803, 2024-04-25T13:55:00.520 INFO:teuthology.orchestra.run.smithi161.stdout: "dn+": 4140, 2024-04-25T13:55:00.520 INFO:teuthology.orchestra.run.smithi161.stdout: "dn-": 337, 2024-04-25T13:55:00.520 INFO:teuthology.orchestra.run.smithi161.stdout: "cap": 0, 2024-04-25T13:55:00.520 INFO:teuthology.orchestra.run.smithi161.stdout: "cap+": 0, 2024-04-25T13:55:00.520 INFO:teuthology.orchestra.run.smithi161.stdout: "cap-": 0, 2024-04-25T13:55:00.520 INFO:teuthology.orchestra.run.smithi161.stdout: "rss": 130916, 2024-04-25T13:55:00.520 INFO:teuthology.orchestra.run.smithi161.stdout: "heap": 215440 2024-04-25T13:55:00.520 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.520 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_server": { 2024-04-25T13:55:00.521 INFO:teuthology.orchestra.run.smithi161.stdout: "dispatch_client_request": 0, 2024-04-25T13:55:00.521 INFO:teuthology.orchestra.run.smithi161.stdout: "dispatch_server_request": 0, 2024-04-25T13:55:00.521 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_request": 0, 2024-04-25T13:55:00.521 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_session": 0, 2024-04-25T13:55:00.521 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_peer_request": 0, 2024-04-25T13:55:00.521 INFO:teuthology.orchestra.run.smithi161.stdout: "req_create_latency": { 2024-04-25T13:55:00.521 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.521 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.521 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.521 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.521 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getattr_latency": { 2024-04-25T13:55:00.521 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.521 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.521 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.522 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.522 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getfilelock_latency": { 2024-04-25T13:55:00.522 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.522 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.522 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.522 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.522 INFO:teuthology.orchestra.run.smithi161.stdout: "req_link_latency": { 2024-04-25T13:55:00.522 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.522 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.522 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.522 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.522 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookup_latency": { 2024-04-25T13:55:00.522 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.522 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.523 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.523 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.523 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookuphash_latency": { 2024-04-25T13:55:00.523 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.523 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.523 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.523 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.523 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupino_latency": { 2024-04-25T13:55:00.523 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.523 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.523 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.523 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.523 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupname_latency": { 2024-04-25T13:55:00.523 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.524 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.524 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.524 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.524 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupparent_latency": { 2024-04-25T13:55:00.524 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.524 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.524 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.524 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.524 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupsnap_latency": { 2024-04-25T13:55:00.524 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.524 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.524 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.524 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.524 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lssnap_latency": { 2024-04-25T13:55:00.525 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.525 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.525 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.525 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.525 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mkdir_latency": { 2024-04-25T13:55:00.526 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.526 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.526 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.526 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.526 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mknod_latency": { 2024-04-25T13:55:00.526 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.526 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.526 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.526 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.526 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mksnap_latency": { 2024-04-25T13:55:00.526 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.527 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.527 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.527 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.527 INFO:teuthology.orchestra.run.smithi161.stdout: "req_open_latency": { 2024-04-25T13:55:00.527 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.527 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.527 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.527 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.527 INFO:teuthology.orchestra.run.smithi161.stdout: "req_readdir_latency": { 2024-04-25T13:55:00.527 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.527 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.527 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.528 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.528 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rename_latency": { 2024-04-25T13:55:00.528 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.528 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.528 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.528 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.528 INFO:teuthology.orchestra.run.smithi161.stdout: "req_renamesnap_latency": { 2024-04-25T13:55:00.528 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.528 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.528 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.528 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.528 INFO:teuthology.orchestra.run.smithi161.stdout: "req_snapdiff_latency": { 2024-04-25T13:55:00.528 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.528 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.528 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.529 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.529 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmdir_latency": { 2024-04-25T13:55:00.529 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.529 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.529 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.529 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.529 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmsnap_latency": { 2024-04-25T13:55:00.529 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.529 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.529 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.529 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.529 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmxattr_latency": { 2024-04-25T13:55:00.529 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.529 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.530 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.530 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.530 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setattr_latency": { 2024-04-25T13:55:00.530 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.530 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.530 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.530 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.530 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setdirlayout_latency": { 2024-04-25T13:55:00.530 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.530 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.530 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.530 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.530 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setfilelock_latency": { 2024-04-25T13:55:00.531 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.531 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.531 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.531 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.531 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setlayout_latency": { 2024-04-25T13:55:00.531 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.531 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.531 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.531 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.531 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setxattr_latency": { 2024-04-25T13:55:00.531 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.531 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.531 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.531 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.532 INFO:teuthology.orchestra.run.smithi161.stdout: "req_symlink_latency": { 2024-04-25T13:55:00.532 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.532 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.532 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.532 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.532 INFO:teuthology.orchestra.run.smithi161.stdout: "req_unlink_latency": { 2024-04-25T13:55:00.532 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.532 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.532 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.532 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.532 INFO:teuthology.orchestra.run.smithi161.stdout: "cap_revoke_eviction": 0, 2024-04-25T13:55:00.532 INFO:teuthology.orchestra.run.smithi161.stdout: "cap_acquisition_throttle": 0, 2024-04-25T13:55:00.532 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getvxattr_latency": { 2024-04-25T13:55:00.532 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.533 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.533 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.533 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:00.533 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.533 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_sessions": { 2024-04-25T13:55:00.533 INFO:teuthology.orchestra.run.smithi161.stdout: "session_count": 1, 2024-04-25T13:55:00.533 INFO:teuthology.orchestra.run.smithi161.stdout: "session_add": 3, 2024-04-25T13:55:00.533 INFO:teuthology.orchestra.run.smithi161.stdout: "session_remove": 2, 2024-04-25T13:55:00.533 INFO:teuthology.orchestra.run.smithi161.stdout: "sessions_open": 2, 2024-04-25T13:55:00.533 INFO:teuthology.orchestra.run.smithi161.stdout: "sessions_stale": 0, 2024-04-25T13:55:00.533 INFO:teuthology.orchestra.run.smithi161.stdout: "total_load": 0, 2024-04-25T13:55:00.533 INFO:teuthology.orchestra.run.smithi161.stdout: "average_load": 0, 2024-04-25T13:55:00.533 INFO:teuthology.orchestra.run.smithi161.stdout: "avg_session_uptime": 2926, 2024-04-25T13:55:00.533 INFO:teuthology.orchestra.run.smithi161.stdout: "mdthresh_evicted": 0 2024-04-25T13:55:00.534 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.534 INFO:teuthology.orchestra.run.smithi161.stdout: "mempool": { 2024-04-25T13:55:00.534 INFO:teuthology.orchestra.run.smithi161.stdout: "bloom_filter_bytes": 0, 2024-04-25T13:55:00.534 INFO:teuthology.orchestra.run.smithi161.stdout: "bloom_filter_items": 0, 2024-04-25T13:55:00.534 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T13:55:00.534 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_alloc_items": 0, 2024-04-25T13:55:00.534 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T13:55:00.534 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_data_items": 0, 2024-04-25T13:55:00.534 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T13:55:00.534 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T13:55:00.534 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T13:55:00.534 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T13:55:00.534 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T13:55:00.534 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_other_items": 0, 2024-04-25T13:55:00.535 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T13:55:00.535 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T13:55:00.535 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_extent_bytes": 0, 2024-04-25T13:55:00.535 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_extent_items": 0, 2024-04-25T13:55:00.535 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_blob_bytes": 0, 2024-04-25T13:55:00.535 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_blob_items": 0, 2024-04-25T13:55:00.535 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T13:55:00.535 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T13:55:00.535 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T13:55:00.535 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T13:55:00.535 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T13:55:00.535 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_fsck_items": 0, 2024-04-25T13:55:00.535 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_txc_bytes": 0, 2024-04-25T13:55:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_txc_items": 0, 2024-04-25T13:55:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T13:55:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T13:55:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_bytes": 0, 2024-04-25T13:55:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_items": 0, 2024-04-25T13:55:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_bytes": 0, 2024-04-25T13:55:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_items": 0, 2024-04-25T13:55:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T13:55:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_reader_items": 0, 2024-04-25T13:55:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T13:55:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_writer_items": 0, 2024-04-25T13:55:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_anon_bytes": 190177, 2024-04-25T13:55:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_anon_items": 53, 2024-04-25T13:55:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_meta_bytes": 0, 2024-04-25T13:55:00.536 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_meta_items": 0, 2024-04-25T13:55:00.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_bytes": 0, 2024-04-25T13:55:00.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_items": 0, 2024-04-25T13:55:00.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_mapbl_bytes": 0, 2024-04-25T13:55:00.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_mapbl_items": 0, 2024-04-25T13:55:00.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_pglog_bytes": 0, 2024-04-25T13:55:00.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_pglog_items": 0, 2024-04-25T13:55:00.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_bytes": 9416, 2024-04-25T13:55:00.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_items": 180, 2024-04-25T13:55:00.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T13:55:00.537 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_mapping_items": 0, 2024-04-25T13:55:00.537 INFO:teuthology.orchestra.run.smithi161.stdout: "pgmap_bytes": 0, 2024-04-25T13:55:00.537 INFO:teuthology.orchestra.run.smithi161.stdout: "pgmap_items": 0, 2024-04-25T13:55:00.537 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_co_bytes": 5325332, 2024-04-25T13:55:00.537 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_co_items": 83126, 2024-04-25T13:55:00.537 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_1_bytes": 0, 2024-04-25T13:55:00.538 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_1_items": 0, 2024-04-25T13:55:00.538 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_2_bytes": 0, 2024-04-25T13:55:00.538 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_2_items": 0 2024-04-25T13:55:00.538 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.538 INFO:teuthology.orchestra.run.smithi161.stdout: "objecter": { 2024-04-25T13:55:00.538 INFO:teuthology.orchestra.run.smithi161.stdout: "op_active": 0, 2024-04-25T13:55:00.538 INFO:teuthology.orchestra.run.smithi161.stdout: "op_laggy": 0, 2024-04-25T13:55:00.538 INFO:teuthology.orchestra.run.smithi161.stdout: "op_send": 2263, 2024-04-25T13:55:00.538 INFO:teuthology.orchestra.run.smithi161.stdout: "op_send_bytes": 21, 2024-04-25T13:55:00.538 INFO:teuthology.orchestra.run.smithi161.stdout: "op_resend": 3, 2024-04-25T13:55:00.538 INFO:teuthology.orchestra.run.smithi161.stdout: "op_reply": 2263, 2024-04-25T13:55:00.538 INFO:teuthology.orchestra.run.smithi161.stdout: "op_latency": { 2024-04-25T13:55:00.538 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 2263, 2024-04-25T13:55:00.538 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 1.301972184, 2024-04-25T13:55:00.539 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000575330 2024-04-25T13:55:00.539 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.539 INFO:teuthology.orchestra.run.smithi161.stdout: "op_inflight": 0, 2024-04-25T13:55:00.539 INFO:teuthology.orchestra.run.smithi161.stdout: "oplen_avg": { 2024-04-25T13:55:00.539 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 2263, 2024-04-25T13:55:00.539 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 2264 2024-04-25T13:55:00.539 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.539 INFO:teuthology.orchestra.run.smithi161.stdout: "op": 2263, 2024-04-25T13:55:00.539 INFO:teuthology.orchestra.run.smithi161.stdout: "op_r": 2263, 2024-04-25T13:55:00.539 INFO:teuthology.orchestra.run.smithi161.stdout: "op_w": 0, 2024-04-25T13:55:00.539 INFO:teuthology.orchestra.run.smithi161.stdout: "op_rmw": 0, 2024-04-25T13:55:00.539 INFO:teuthology.orchestra.run.smithi161.stdout: "op_pg": 0, 2024-04-25T13:55:00.539 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_stat": 1404, 2024-04-25T13:55:00.540 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_create": 0, 2024-04-25T13:55:00.540 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_read": 857, 2024-04-25T13:55:00.540 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_write": 0, 2024-04-25T13:55:00.540 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_writefull": 0, 2024-04-25T13:55:00.540 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_writesame": 0, 2024-04-25T13:55:00.540 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_append": 0, 2024-04-25T13:55:00.540 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_zero": 0, 2024-04-25T13:55:00.540 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_truncate": 0, 2024-04-25T13:55:00.540 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_delete": 0, 2024-04-25T13:55:00.540 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_mapext": 0, 2024-04-25T13:55:00.540 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_sparse_read": 0, 2024-04-25T13:55:00.540 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_clonerange": 0, 2024-04-25T13:55:00.540 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_getxattr": 1, 2024-04-25T13:55:00.540 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_setxattr": 0, 2024-04-25T13:55:00.541 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_cmpxattr": 0, 2024-04-25T13:55:00.541 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_rmxattr": 0, 2024-04-25T13:55:00.541 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_resetxattrs": 0, 2024-04-25T13:55:00.541 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_call": 0, 2024-04-25T13:55:00.541 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_watch": 0, 2024-04-25T13:55:00.541 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_notify": 0, 2024-04-25T13:55:00.541 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T13:55:00.541 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_pgls": 0, 2024-04-25T13:55:00.541 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_pgls_filter": 0, 2024-04-25T13:55:00.541 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_other": 0, 2024-04-25T13:55:00.541 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_active": 0, 2024-04-25T13:55:00.541 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_send": 0, 2024-04-25T13:55:00.541 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_resend": 0, 2024-04-25T13:55:00.541 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_ping": 0, 2024-04-25T13:55:00.542 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_active": 0, 2024-04-25T13:55:00.542 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_send": 0, 2024-04-25T13:55:00.542 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_resend": 0, 2024-04-25T13:55:00.542 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_active": 0, 2024-04-25T13:55:00.542 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_send": 0, 2024-04-25T13:55:00.542 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_resend": 0, 2024-04-25T13:55:00.542 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_active": 0, 2024-04-25T13:55:00.542 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_send": 0, 2024-04-25T13:55:00.542 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_resend": 0, 2024-04-25T13:55:00.542 INFO:teuthology.orchestra.run.smithi161.stdout: "command_active": 0, 2024-04-25T13:55:00.542 INFO:teuthology.orchestra.run.smithi161.stdout: "command_send": 0, 2024-04-25T13:55:00.542 INFO:teuthology.orchestra.run.smithi161.stdout: "command_resend": 0, 2024-04-25T13:55:00.542 INFO:teuthology.orchestra.run.smithi161.stdout: "map_epoch": 93, 2024-04-25T13:55:00.542 INFO:teuthology.orchestra.run.smithi161.stdout: "map_full": 0, 2024-04-25T13:55:00.542 INFO:teuthology.orchestra.run.smithi161.stdout: "map_inc": 13, 2024-04-25T13:55:00.543 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_sessions": 5, 2024-04-25T13:55:00.543 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_session_open": 5, 2024-04-25T13:55:00.543 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_session_close": 0, 2024-04-25T13:55:00.543 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_laggy": 0, 2024-04-25T13:55:00.543 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_wr": 0, 2024-04-25T13:55:00.543 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_rd": 2, 2024-04-25T13:55:00.543 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_del": 0 2024-04-25T13:55:00.543 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.543 INFO:teuthology.orchestra.run.smithi161.stdout: "oft": { 2024-04-25T13:55:00.543 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_objs": 0, 2024-04-25T13:55:00.543 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_kv_pairs": 0, 2024-04-25T13:55:00.543 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_updates": 0, 2024-04-25T13:55:00.543 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_removes": 0 2024-04-25T13:55:00.543 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.543 INFO:teuthology.orchestra.run.smithi161.stdout: "osd-slow-ops": { 2024-04-25T13:55:00.544 INFO:teuthology.orchestra.run.smithi161.stdout: "slow_ops_count": 0 2024-04-25T13:55:00.544 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.544 INFO:teuthology.orchestra.run.smithi161.stdout: "purge_queue": { 2024-04-25T13:55:00.544 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_ops": 0, 2024-04-25T13:55:00.544 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_ops_high_water": 0, 2024-04-25T13:55:00.544 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing": 0, 2024-04-25T13:55:00.544 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_high_water": 0, 2024-04-25T13:55:00.544 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executed_ops": 0, 2024-04-25T13:55:00.544 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executed": 0, 2024-04-25T13:55:00.544 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_item_in_journal": 0 2024-04-25T13:55:00.544 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.544 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T13:55:00.544 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2024-04-25T13:55:00.544 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 104857600, 2024-04-25T13:55:00.545 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2024-04-25T13:55:00.545 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 2515, 2024-04-25T13:55:00.545 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 16980496, 2024-04-25T13:55:00.545 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:00.545 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 2515, 2024-04-25T13:55:00.545 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2024-04-25T13:55:00.545 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2024-04-25T13:55:00.545 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 2515, 2024-04-25T13:55:00.545 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 16980496, 2024-04-25T13:55:00.545 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2024-04-25T13:55:00.545 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.545 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.545 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.545 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:00.545 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.546 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-objecter_bytes": { 2024-04-25T13:55:00.546 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2024-04-25T13:55:00.546 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 104857600, 2024-04-25T13:55:00.546 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2024-04-25T13:55:00.546 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2024-04-25T13:55:00.546 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2024-04-25T13:55:00.546 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:00.546 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2024-04-25T13:55:00.546 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 2263, 2024-04-25T13:55:00.546 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 14847974, 2024-04-25T13:55:00.546 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 2263, 2024-04-25T13:55:00.546 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 14847974, 2024-04-25T13:55:00.546 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2024-04-25T13:55:00.546 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.547 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.547 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.547 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:00.547 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.547 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-objecter_ops": { 2024-04-25T13:55:00.547 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2024-04-25T13:55:00.547 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 1024, 2024-04-25T13:55:00.547 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2024-04-25T13:55:00.547 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2024-04-25T13:55:00.547 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2024-04-25T13:55:00.547 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:00.547 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2024-04-25T13:55:00.547 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 2263, 2024-04-25T13:55:00.547 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 2263, 2024-04-25T13:55:00.547 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 2263, 2024-04-25T13:55:00.547 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 2263, 2024-04-25T13:55:00.548 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2024-04-25T13:55:00.548 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.548 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.548 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.548 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:00.548 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.548 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-write_buf_throttle": { 2024-04-25T13:55:00.548 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2024-04-25T13:55:00.548 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 3758096384, 2024-04-25T13:55:00.548 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2024-04-25T13:55:00.548 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2024-04-25T13:55:00.548 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2024-04-25T13:55:00.548 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:00.548 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2024-04-25T13:55:00.548 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2024-04-25T13:55:00.548 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2024-04-25T13:55:00.549 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 0, 2024-04-25T13:55:00.549 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 0, 2024-04-25T13:55:00.549 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2024-04-25T13:55:00.549 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.549 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.549 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.549 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:00.549 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:00.549 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-write_buf_throttle-0x55f36dbf08f0": { 2024-04-25T13:55:00.549 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2024-04-25T13:55:00.549 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 3758096384, 2024-04-25T13:55:00.549 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2024-04-25T13:55:00.549 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2024-04-25T13:55:00.549 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2024-04-25T13:55:00.549 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:00.549 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2024-04-25T13:55:00.550 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2024-04-25T13:55:00.550 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2024-04-25T13:55:00.550 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 0, 2024-04-25T13:55:00.550 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 0, 2024-04-25T13:55:00.550 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2024-04-25T13:55:00.550 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:00.550 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:00.550 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:00.550 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:00.550 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:00.550 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-04-25T13:55:01.212 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:00 smithi043 ceph-mon[29195]: pgmap v323: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:55:01.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:00 smithi161 ceph-mon[32696]: pgmap v323: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:55:01.391 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-04-25T13:55:01.391 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-04-25T13:55:01.391 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-04-25T13:55:01.391 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-04-25T13:55:01.391 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-04-25T13:55:01.391 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-04-25T13:55:01.391 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T13:55:01.391 DEBUG:tasks.check_counter:Getting stats from h 2024-04-25T13:55:01.392 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph daemon mds.h perf dump 2024-04-25T13:55:01.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:00 smithi175 ceph-mon[32649]: pgmap v323: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T13:55:01.630 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T13:55:03.102 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:02 smithi161 ceph-mon[32696]: pgmap v324: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:55:03.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:02 smithi175 ceph-mon[32649]: pgmap v324: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:55:03.439 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-04-25T13:55:03.439 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T13:55:03.440 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 75051, 2024-04-25T13:55:03.440 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 79366, 2024-04-25T13:55:03.440 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 29135552, 2024-04-25T13:55:03.440 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 32062435, 2024-04-25T13:55:03.440 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 9, 2024-04-25T13:55:03.440 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 4, 2024-04-25T13:55:03.440 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 4.496153456, 2024-04-25T13:55:03.440 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 2.099009082, 2024-04-25T13:55:03.440 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 2.966151626, 2024-04-25T13:55:03.440 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.077888643, 2024-04-25T13:55:03.440 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:03.440 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 79364, 2024-04-25T13:55:03.440 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 2.179523234, 2024-04-25T13:55:03.440 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000027462 2024-04-25T13:55:03.441 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:03.441 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 145106, 2024-04-25T13:55:03.441 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.040519091, 2024-04-25T13:55:03.441 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000279 2024-04-25T13:55:03.441 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T13:55:03.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T13:55:03.441 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.441 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T13:55:03.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 22266, 2024-04-25T13:55:03.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 26350, 2024-04-25T13:55:03.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 6584761, 2024-04-25T13:55:03.442 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 11694851, 2024-04-25T13:55:03.442 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 17, 2024-04-25T13:55:03.442 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 5, 2024-04-25T13:55:03.442 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 1.281240385, 2024-04-25T13:55:03.442 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 0.530343772, 2024-04-25T13:55:03.442 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 0.889922062, 2024-04-25T13:55:03.442 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.025383133, 2024-04-25T13:55:03.442 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:03.442 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 26347, 2024-04-25T13:55:03.442 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.708041212, 2024-04-25T13:55:03.442 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000026873 2024-04-25T13:55:03.442 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.442 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:03.443 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 44726, 2024-04-25T13:55:03.443 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.008938754, 2024-04-25T13:55:03.443 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000199 2024-04-25T13:55:03.443 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.443 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 3600, 2024-04-25T13:55:03.443 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 135856 2024-04-25T13:55:03.443 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.443 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T13:55:03.443 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 1683, 2024-04-25T13:55:03.443 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 1789, 2024-04-25T13:55:03.443 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 2259519, 2024-04-25T13:55:03.443 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 3097438, 2024-04-25T13:55:03.443 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 7, 2024-04-25T13:55:03.443 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 6, 2024-04-25T13:55:03.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 0.168125700, 2024-04-25T13:55:03.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 0.053112072, 2024-04-25T13:55:03.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 0.073389017, 2024-04-25T13:55:03.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.046895608, 2024-04-25T13:55:03.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:03.444 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 1789, 2024-04-25T13:55:03.444 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.151606711, 2024-04-25T13:55:03.444 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000084743 2024-04-25T13:55:03.444 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:03.444 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.444 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.444 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.444 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.445 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 1751200, 2024-04-25T13:55:03.445 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 454048 2024-04-25T13:55:03.445 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.445 INFO:teuthology.orchestra.run.smithi161.stdout: "cct": { 2024-04-25T13:55:03.445 INFO:teuthology.orchestra.run.smithi161.stdout: "total_workers": 1, 2024-04-25T13:55:03.445 INFO:teuthology.orchestra.run.smithi161.stdout: "unhealthy_workers": 0 2024-04-25T13:55:03.445 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.445 INFO:teuthology.orchestra.run.smithi161.stdout: "finisher-MDSRank": { 2024-04-25T13:55:03.445 INFO:teuthology.orchestra.run.smithi161.stdout: "queue_len": 0, 2024-04-25T13:55:03.445 INFO:teuthology.orchestra.run.smithi161.stdout: "complete_latency": { 2024-04-25T13:55:03.445 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 2718, 2024-04-25T13:55:03.445 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 2.893859987, 2024-04-25T13:55:03.445 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.001064701 2024-04-25T13:55:03.446 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:03.446 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.446 INFO:teuthology.orchestra.run.smithi161.stdout: "finisher-PurgeQueue": { 2024-04-25T13:55:03.446 INFO:teuthology.orchestra.run.smithi161.stdout: "queue_len": 0, 2024-04-25T13:55:03.446 INFO:teuthology.orchestra.run.smithi161.stdout: "complete_latency": { 2024-04-25T13:55:03.446 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 2441, 2024-04-25T13:55:03.446 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.507752979, 2024-04-25T13:55:03.446 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000208010 2024-04-25T13:55:03.446 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:03.446 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.446 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": { 2024-04-25T13:55:03.446 INFO:teuthology.orchestra.run.smithi161.stdout: "request": 5280, 2024-04-25T13:55:03.446 INFO:teuthology.orchestra.run.smithi161.stdout: "reply": 4872, 2024-04-25T13:55:03.446 INFO:teuthology.orchestra.run.smithi161.stdout: "reply_latency": { 2024-04-25T13:55:03.446 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 4872, 2024-04-25T13:55:03.447 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 11.061614669, 2024-04-25T13:55:03.447 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.002270446 2024-04-25T13:55:03.447 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.447 INFO:teuthology.orchestra.run.smithi161.stdout: "slow_reply": 0, 2024-04-25T13:55:03.447 INFO:teuthology.orchestra.run.smithi161.stdout: "forward": 408, 2024-04-25T13:55:03.447 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_fetch_complete": 0, 2024-04-25T13:55:03.447 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_fetch_keys": 0, 2024-04-25T13:55:03.447 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_commit": 20, 2024-04-25T13:55:03.447 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_split": 1, 2024-04-25T13:55:03.447 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_merge": 0, 2024-04-25T13:55:03.447 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes": 2273, 2024-04-25T13:55:03.447 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_top": 58, 2024-04-25T13:55:03.447 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_bottom": 2205, 2024-04-25T13:55:03.447 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_pin_tail": 10, 2024-04-25T13:55:03.447 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_pinned": 2189, 2024-04-25T13:55:03.448 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_expired": 3309, 2024-04-25T13:55:03.448 INFO:teuthology.orchestra.run.smithi161.stdout: "inodes_with_caps": 3, 2024-04-25T13:55:03.448 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": 3, 2024-04-25T13:55:03.448 INFO:teuthology.orchestra.run.smithi161.stdout: "subtrees": 81, 2024-04-25T13:55:03.448 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse": 13300, 2024-04-25T13:55:03.448 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_hit": 9372, 2024-04-25T13:55:03.448 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_forward": 376, 2024-04-25T13:55:03.448 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_discover": 1656, 2024-04-25T13:55:03.448 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_dir_fetch": 0, 2024-04-25T13:55:03.448 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_remote_ino": 6, 2024-04-25T13:55:03.448 INFO:teuthology.orchestra.run.smithi161.stdout: "traverse_lock": 25, 2024-04-25T13:55:03.448 INFO:teuthology.orchestra.run.smithi161.stdout: "load_cent": 0, 2024-04-25T13:55:03.448 INFO:teuthology.orchestra.run.smithi161.stdout: "q": 0, 2024-04-25T13:55:03.449 INFO:teuthology.orchestra.run.smithi161.stdout: "exported": 8, 2024-04-25T13:55:03.449 INFO:teuthology.orchestra.run.smithi161.stdout: "exported_inodes": 12, 2024-04-25T13:55:03.449 INFO:teuthology.orchestra.run.smithi161.stdout: "imported": 76, 2024-04-25T13:55:03.449 INFO:teuthology.orchestra.run.smithi161.stdout: "imported_inodes": 935, 2024-04-25T13:55:03.449 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_dir_fetch": 0, 2024-04-25T13:55:03.449 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_backtrace_fetch": 0, 2024-04-25T13:55:03.449 INFO:teuthology.orchestra.run.smithi161.stdout: "openino_peer_discover": 13, 2024-04-25T13:55:03.449 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rfiles": 11799, 2024-04-25T13:55:03.449 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rbytes": 1261521663, 2024-04-25T13:55:03.449 INFO:teuthology.orchestra.run.smithi161.stdout: "root_rsnaps": 3, 2024-04-25T13:55:03.449 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T13:55:03.449 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_set_tag": 0, 2024-04-25T13:55:03.449 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T13:55:03.449 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_inotable_repaired": 0, 2024-04-25T13:55:03.450 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dir_inodes": 0, 2024-04-25T13:55:03.450 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T13:55:03.450 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T13:55:03.450 INFO:teuthology.orchestra.run.smithi161.stdout: "scrub_file_inodes": 0, 2024-04-25T13:55:03.450 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_inode_file_caps": 76, 2024-04-25T13:55:03.450 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_revoke": 1301, 2024-04-25T13:55:03.450 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_grant": 2312, 2024-04-25T13:55:03.450 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_trunc": 30, 2024-04-25T13:55:03.450 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T13:55:03.450 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T13:55:03.450 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_caps": 2661, 2024-04-25T13:55:03.450 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_caps_dirty": 1106, 2024-04-25T13:55:03.450 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_cap_release": 91, 2024-04-25T13:55:03.450 INFO:teuthology.orchestra.run.smithi161.stdout: "process_request_cap_release": 3780 2024-04-25T13:55:03.450 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.451 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_cache": { 2024-04-25T13:55:03.451 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_update": 336, 2024-04-25T13:55:03.451 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_update_receipt": 4371, 2024-04-25T13:55:03.451 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_try_discover": 2903, 2024-04-25T13:55:03.451 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_send_discover": 3208, 2024-04-25T13:55:03.451 INFO:teuthology.orchestra.run.smithi161.stdout: "dir_handle_discover": 755, 2024-04-25T13:55:03.451 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays": 134, 2024-04-25T13:55:03.451 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays_delayed": 0, 2024-04-25T13:55:03.451 INFO:teuthology.orchestra.run.smithi161.stdout: "num_strays_enqueuing": 0, 2024-04-25T13:55:03.451 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_created": 1446, 2024-04-25T13:55:03.451 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_enqueued": 1288, 2024-04-25T13:55:03.451 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_reintegrated": 36, 2024-04-25T13:55:03.451 INFO:teuthology.orchestra.run.smithi161.stdout: "strays_migrated": 6, 2024-04-25T13:55:03.451 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_processing": 0, 2024-04-25T13:55:03.451 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_enqueued": 0, 2024-04-25T13:55:03.452 INFO:teuthology.orchestra.run.smithi161.stdout: "num_recovering_prioritized": 0, 2024-04-25T13:55:03.452 INFO:teuthology.orchestra.run.smithi161.stdout: "recovery_started": 0, 2024-04-25T13:55:03.452 INFO:teuthology.orchestra.run.smithi161.stdout: "recovery_completed": 0, 2024-04-25T13:55:03.452 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_quiesce_path": 0, 2024-04-25T13:55:03.452 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_quiesce_inode": 0, 2024-04-25T13:55:03.452 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T13:55:03.452 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_exportdir": 8, 2024-04-25T13:55:03.452 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_flush": 0, 2024-04-25T13:55:03.452 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_fragmentdir": 1, 2024-04-25T13:55:03.452 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_fragstats": 0, 2024-04-25T13:55:03.452 INFO:teuthology.orchestra.run.smithi161.stdout: "ireq_inodestats": 0 2024-04-25T13:55:03.452 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.452 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_log": { 2024-04-25T13:55:03.452 INFO:teuthology.orchestra.run.smithi161.stdout: "evlrg": 0, 2024-04-25T13:55:03.452 INFO:teuthology.orchestra.run.smithi161.stdout: "evadd": 6108, 2024-04-25T13:55:03.453 INFO:teuthology.orchestra.run.smithi161.stdout: "evex": 0, 2024-04-25T13:55:03.453 INFO:teuthology.orchestra.run.smithi161.stdout: "evtrm": 0, 2024-04-25T13:55:03.453 INFO:teuthology.orchestra.run.smithi161.stdout: "ev": 6108, 2024-04-25T13:55:03.453 INFO:teuthology.orchestra.run.smithi161.stdout: "evexg": 0, 2024-04-25T13:55:03.453 INFO:teuthology.orchestra.run.smithi161.stdout: "evexd": 0, 2024-04-25T13:55:03.453 INFO:teuthology.orchestra.run.smithi161.stdout: "segadd": 8, 2024-04-25T13:55:03.453 INFO:teuthology.orchestra.run.smithi161.stdout: "segex": 0, 2024-04-25T13:55:03.453 INFO:teuthology.orchestra.run.smithi161.stdout: "segtrm": 0, 2024-04-25T13:55:03.453 INFO:teuthology.orchestra.run.smithi161.stdout: "seg": 8, 2024-04-25T13:55:03.453 INFO:teuthology.orchestra.run.smithi161.stdout: "segmjr": 2, 2024-04-25T13:55:03.453 INFO:teuthology.orchestra.run.smithi161.stdout: "segexg": 0, 2024-04-25T13:55:03.453 INFO:teuthology.orchestra.run.smithi161.stdout: "segexd": 0, 2024-04-25T13:55:03.453 INFO:teuthology.orchestra.run.smithi161.stdout: "expos": 4194304, 2024-04-25T13:55:03.454 INFO:teuthology.orchestra.run.smithi161.stdout: "wrpos": 19042273, 2024-04-25T13:55:03.454 INFO:teuthology.orchestra.run.smithi161.stdout: "rdpos": 0, 2024-04-25T13:55:03.454 INFO:teuthology.orchestra.run.smithi161.stdout: "jlat": { 2024-04-25T13:55:03.454 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 1349, 2024-04-25T13:55:03.454 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 3.548727561, 2024-04-25T13:55:03.454 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.002630635 2024-04-25T13:55:03.454 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.454 INFO:teuthology.orchestra.run.smithi161.stdout: "replayed": 0 2024-04-25T13:55:03.454 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.454 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_mem": { 2024-04-25T13:55:03.454 INFO:teuthology.orchestra.run.smithi161.stdout: "ino": 1031, 2024-04-25T13:55:03.454 INFO:teuthology.orchestra.run.smithi161.stdout: "ino+": 3880, 2024-04-25T13:55:03.454 INFO:teuthology.orchestra.run.smithi161.stdout: "ino-": 2849, 2024-04-25T13:55:03.455 INFO:teuthology.orchestra.run.smithi161.stdout: "dir": 258, 2024-04-25T13:55:03.455 INFO:teuthology.orchestra.run.smithi161.stdout: "dir+": 1926, 2024-04-25T13:55:03.455 INFO:teuthology.orchestra.run.smithi161.stdout: "dir-": 1668, 2024-04-25T13:55:03.455 INFO:teuthology.orchestra.run.smithi161.stdout: "dn": 2333, 2024-04-25T13:55:03.455 INFO:teuthology.orchestra.run.smithi161.stdout: "dn+": 7294, 2024-04-25T13:55:03.455 INFO:teuthology.orchestra.run.smithi161.stdout: "dn-": 4961, 2024-04-25T13:55:03.455 INFO:teuthology.orchestra.run.smithi161.stdout: "cap": 3, 2024-04-25T13:55:03.455 INFO:teuthology.orchestra.run.smithi161.stdout: "cap+": 1577, 2024-04-25T13:55:03.455 INFO:teuthology.orchestra.run.smithi161.stdout: "cap-": 1574, 2024-04-25T13:55:03.455 INFO:teuthology.orchestra.run.smithi161.stdout: "rss": 171136, 2024-04-25T13:55:03.455 INFO:teuthology.orchestra.run.smithi161.stdout: "heap": 223632 2024-04-25T13:55:03.456 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.456 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_server": { 2024-04-25T13:55:03.456 INFO:teuthology.orchestra.run.smithi161.stdout: "dispatch_client_request": 9081, 2024-04-25T13:55:03.456 INFO:teuthology.orchestra.run.smithi161.stdout: "dispatch_server_request": 8167, 2024-04-25T13:55:03.456 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_request": 5280, 2024-04-25T13:55:03.456 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_client_session": 48, 2024-04-25T13:55:03.456 INFO:teuthology.orchestra.run.smithi161.stdout: "handle_peer_request": 41690, 2024-04-25T13:55:03.456 INFO:teuthology.orchestra.run.smithi161.stdout: "req_create_latency": { 2024-04-25T13:55:03.456 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 198, 2024-04-25T13:55:03.456 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.415494935, 2024-04-25T13:55:03.456 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.002098459 2024-04-25T13:55:03.456 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.456 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getattr_latency": { 2024-04-25T13:55:03.457 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 936, 2024-04-25T13:55:03.457 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.298828454, 2024-04-25T13:55:03.457 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000319261 2024-04-25T13:55:03.457 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.457 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getfilelock_latency": { 2024-04-25T13:55:03.457 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.457 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.457 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.457 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.457 INFO:teuthology.orchestra.run.smithi161.stdout: "req_link_latency": { 2024-04-25T13:55:03.457 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 51, 2024-04-25T13:55:03.457 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.532700632, 2024-04-25T13:55:03.457 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.010445110 2024-04-25T13:55:03.458 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.458 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookup_latency": { 2024-04-25T13:55:03.458 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 1275, 2024-04-25T13:55:03.458 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 1.452966359, 2024-04-25T13:55:03.458 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.001139581 2024-04-25T13:55:03.458 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.458 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookuphash_latency": { 2024-04-25T13:55:03.458 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.458 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.458 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.458 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.458 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupino_latency": { 2024-04-25T13:55:03.459 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.459 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.459 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.459 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.459 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupname_latency": { 2024-04-25T13:55:03.459 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.459 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.459 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.459 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.459 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupparent_latency": { 2024-04-25T13:55:03.459 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.459 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.459 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.459 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.459 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lookupsnap_latency": { 2024-04-25T13:55:03.460 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.460 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.460 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.460 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.460 INFO:teuthology.orchestra.run.smithi161.stdout: "req_lssnap_latency": { 2024-04-25T13:55:03.460 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.460 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.461 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.461 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.461 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mkdir_latency": { 2024-04-25T13:55:03.461 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 103, 2024-04-25T13:55:03.461 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.183743759, 2024-04-25T13:55:03.461 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.001783919 2024-04-25T13:55:03.461 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.461 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mknod_latency": { 2024-04-25T13:55:03.461 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 86, 2024-04-25T13:55:03.461 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.172344680, 2024-04-25T13:55:03.461 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.002004007 2024-04-25T13:55:03.461 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.461 INFO:teuthology.orchestra.run.smithi161.stdout: "req_mksnap_latency": { 2024-04-25T13:55:03.462 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.462 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.462 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.462 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.462 INFO:teuthology.orchestra.run.smithi161.stdout: "req_open_latency": { 2024-04-25T13:55:03.462 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 152, 2024-04-25T13:55:03.462 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.127544609, 2024-04-25T13:55:03.462 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000839109 2024-04-25T13:55:03.462 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.462 INFO:teuthology.orchestra.run.smithi161.stdout: "req_readdir_latency": { 2024-04-25T13:55:03.462 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 266, 2024-04-25T13:55:03.462 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.346686071, 2024-04-25T13:55:03.462 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.001303331 2024-04-25T13:55:03.462 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.463 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rename_latency": { 2024-04-25T13:55:03.463 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 147, 2024-04-25T13:55:03.463 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 2.264242591, 2024-04-25T13:55:03.463 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.015403010 2024-04-25T13:55:03.463 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.463 INFO:teuthology.orchestra.run.smithi161.stdout: "req_renamesnap_latency": { 2024-04-25T13:55:03.463 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.463 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.463 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.463 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.463 INFO:teuthology.orchestra.run.smithi161.stdout: "req_snapdiff_latency": { 2024-04-25T13:55:03.463 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.463 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.463 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.464 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.464 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmdir_latency": { 2024-04-25T13:55:03.464 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 236, 2024-04-25T13:55:03.464 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 2.323604202, 2024-04-25T13:55:03.464 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.009845780 2024-04-25T13:55:03.464 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.464 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmsnap_latency": { 2024-04-25T13:55:03.464 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.464 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.464 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.464 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.464 INFO:teuthology.orchestra.run.smithi161.stdout: "req_rmxattr_latency": { 2024-04-25T13:55:03.464 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.464 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.465 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.465 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.465 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setattr_latency": { 2024-04-25T13:55:03.465 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 41, 2024-04-25T13:55:03.465 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.185029966, 2024-04-25T13:55:03.465 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.004512926 2024-04-25T13:55:03.465 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.465 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setdirlayout_latency": { 2024-04-25T13:55:03.465 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.465 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.465 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.465 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.465 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setfilelock_latency": { 2024-04-25T13:55:03.465 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.466 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.466 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.466 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.466 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setlayout_latency": { 2024-04-25T13:55:03.466 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.466 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.466 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.466 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.466 INFO:teuthology.orchestra.run.smithi161.stdout: "req_setxattr_latency": { 2024-04-25T13:55:03.466 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.466 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.466 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.466 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.466 INFO:teuthology.orchestra.run.smithi161.stdout: "req_symlink_latency": { 2024-04-25T13:55:03.467 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 104, 2024-04-25T13:55:03.467 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.167236263, 2024-04-25T13:55:03.467 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.001608040 2024-04-25T13:55:03.467 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.467 INFO:teuthology.orchestra.run.smithi161.stdout: "req_unlink_latency": { 2024-04-25T13:55:03.467 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 1277, 2024-04-25T13:55:03.467 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 2.591192148, 2024-04-25T13:55:03.467 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.002029124 2024-04-25T13:55:03.467 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.467 INFO:teuthology.orchestra.run.smithi161.stdout: "cap_revoke_eviction": 0, 2024-04-25T13:55:03.467 INFO:teuthology.orchestra.run.smithi161.stdout: "cap_acquisition_throttle": 0, 2024-04-25T13:55:03.467 INFO:teuthology.orchestra.run.smithi161.stdout: "req_getvxattr_latency": { 2024-04-25T13:55:03.467 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.467 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.467 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.468 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:03.468 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.468 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_sessions": { 2024-04-25T13:55:03.468 INFO:teuthology.orchestra.run.smithi161.stdout: "session_count": 1, 2024-04-25T13:55:03.468 INFO:teuthology.orchestra.run.smithi161.stdout: "session_add": 3, 2024-04-25T13:55:03.468 INFO:teuthology.orchestra.run.smithi161.stdout: "session_remove": 2, 2024-04-25T13:55:03.468 INFO:teuthology.orchestra.run.smithi161.stdout: "sessions_open": 1, 2024-04-25T13:55:03.468 INFO:teuthology.orchestra.run.smithi161.stdout: "sessions_stale": 0, 2024-04-25T13:55:03.468 INFO:teuthology.orchestra.run.smithi161.stdout: "total_load": 2529, 2024-04-25T13:55:03.468 INFO:teuthology.orchestra.run.smithi161.stdout: "average_load": 2529, 2024-04-25T13:55:03.468 INFO:teuthology.orchestra.run.smithi161.stdout: "avg_session_uptime": 628, 2024-04-25T13:55:03.468 INFO:teuthology.orchestra.run.smithi161.stdout: "mdthresh_evicted": 0 2024-04-25T13:55:03.468 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.468 INFO:teuthology.orchestra.run.smithi161.stdout: "mempool": { 2024-04-25T13:55:03.469 INFO:teuthology.orchestra.run.smithi161.stdout: "bloom_filter_bytes": 0, 2024-04-25T13:55:03.469 INFO:teuthology.orchestra.run.smithi161.stdout: "bloom_filter_items": 0, 2024-04-25T13:55:03.469 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T13:55:03.469 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_alloc_items": 0, 2024-04-25T13:55:03.469 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T13:55:03.469 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_data_items": 0, 2024-04-25T13:55:03.469 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T13:55:03.469 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T13:55:03.469 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T13:55:03.469 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T13:55:03.469 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T13:55:03.469 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_other_items": 0, 2024-04-25T13:55:03.469 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T13:55:03.469 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T13:55:03.469 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_extent_bytes": 0, 2024-04-25T13:55:03.470 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_extent_items": 0, 2024-04-25T13:55:03.470 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_blob_bytes": 0, 2024-04-25T13:55:03.470 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_blob_items": 0, 2024-04-25T13:55:03.470 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T13:55:03.470 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T13:55:03.470 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T13:55:03.470 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T13:55:03.470 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T13:55:03.470 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_fsck_items": 0, 2024-04-25T13:55:03.470 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_txc_bytes": 0, 2024-04-25T13:55:03.470 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_txc_items": 0, 2024-04-25T13:55:03.470 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T13:55:03.470 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T13:55:03.470 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_bytes": 0, 2024-04-25T13:55:03.471 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_items": 0, 2024-04-25T13:55:03.471 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_bytes": 0, 2024-04-25T13:55:03.471 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_items": 0, 2024-04-25T13:55:03.471 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T13:55:03.471 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_reader_items": 0, 2024-04-25T13:55:03.471 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T13:55:03.471 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_writer_items": 0, 2024-04-25T13:55:03.471 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_anon_bytes": 1111123, 2024-04-25T13:55:03.471 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_anon_items": 314, 2024-04-25T13:55:03.471 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_meta_bytes": 0, 2024-04-25T13:55:03.471 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_meta_items": 0, 2024-04-25T13:55:03.471 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_bytes": 0, 2024-04-25T13:55:03.471 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_items": 0, 2024-04-25T13:55:03.472 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_mapbl_bytes": 0, 2024-04-25T13:55:03.472 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_mapbl_items": 0, 2024-04-25T13:55:03.472 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_pglog_bytes": 0, 2024-04-25T13:55:03.472 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_pglog_items": 0, 2024-04-25T13:55:03.472 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_bytes": 9416, 2024-04-25T13:55:03.472 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_items": 180, 2024-04-25T13:55:03.472 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T13:55:03.472 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_mapping_items": 0, 2024-04-25T13:55:03.472 INFO:teuthology.orchestra.run.smithi161.stdout: "pgmap_bytes": 0, 2024-04-25T13:55:03.472 INFO:teuthology.orchestra.run.smithi161.stdout: "pgmap_items": 0, 2024-04-25T13:55:03.472 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_co_bytes": 4465180, 2024-04-25T13:55:03.472 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_co_items": 89838, 2024-04-25T13:55:03.472 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_1_bytes": 0, 2024-04-25T13:55:03.472 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_1_items": 0, 2024-04-25T13:55:03.473 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_2_bytes": 0, 2024-04-25T13:55:03.473 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_2_items": 0 2024-04-25T13:55:03.473 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.473 INFO:teuthology.orchestra.run.smithi161.stdout: "objecter": { 2024-04-25T13:55:03.473 INFO:teuthology.orchestra.run.smithi161.stdout: "op_active": 0, 2024-04-25T13:55:03.473 INFO:teuthology.orchestra.run.smithi161.stdout: "op_laggy": 0, 2024-04-25T13:55:03.473 INFO:teuthology.orchestra.run.smithi161.stdout: "op_send": 4223, 2024-04-25T13:55:03.473 INFO:teuthology.orchestra.run.smithi161.stdout: "op_send_bytes": 15266992, 2024-04-25T13:55:03.473 INFO:teuthology.orchestra.run.smithi161.stdout: "op_resend": 33, 2024-04-25T13:55:03.473 INFO:teuthology.orchestra.run.smithi161.stdout: "op_reply": 4223, 2024-04-25T13:55:03.473 INFO:teuthology.orchestra.run.smithi161.stdout: "op_latency": { 2024-04-25T13:55:03.473 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 4223, 2024-04-25T13:55:03.473 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 18.528603572, 2024-04-25T13:55:03.473 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.004387545 2024-04-25T13:55:03.474 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.474 INFO:teuthology.orchestra.run.smithi161.stdout: "op_inflight": 0, 2024-04-25T13:55:03.474 INFO:teuthology.orchestra.run.smithi161.stdout: "oplen_avg": { 2024-04-25T13:55:03.474 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 4223, 2024-04-25T13:55:03.474 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 4441 2024-04-25T13:55:03.474 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.474 INFO:teuthology.orchestra.run.smithi161.stdout: "op": 4223, 2024-04-25T13:55:03.474 INFO:teuthology.orchestra.run.smithi161.stdout: "op_r": 130, 2024-04-25T13:55:03.474 INFO:teuthology.orchestra.run.smithi161.stdout: "op_w": 4093, 2024-04-25T13:55:03.474 INFO:teuthology.orchestra.run.smithi161.stdout: "op_rmw": 0, 2024-04-25T13:55:03.474 INFO:teuthology.orchestra.run.smithi161.stdout: "op_pg": 0, 2024-04-25T13:55:03.474 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_stat": 0, 2024-04-25T13:55:03.474 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_create": 10, 2024-04-25T13:55:03.475 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_read": 130, 2024-04-25T13:55:03.475 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_write": 1479, 2024-04-25T13:55:03.475 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_writefull": 85, 2024-04-25T13:55:03.475 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_writesame": 0, 2024-04-25T13:55:03.475 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_append": 0, 2024-04-25T13:55:03.475 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_zero": 2, 2024-04-25T13:55:03.475 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_truncate": 1, 2024-04-25T13:55:03.475 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_delete": 2347, 2024-04-25T13:55:03.475 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_mapext": 0, 2024-04-25T13:55:03.475 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_sparse_read": 0, 2024-04-25T13:55:03.475 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_clonerange": 0, 2024-04-25T13:55:03.475 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_getxattr": 0, 2024-04-25T13:55:03.475 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_setxattr": 20, 2024-04-25T13:55:03.475 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_cmpxattr": 0, 2024-04-25T13:55:03.476 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_rmxattr": 0, 2024-04-25T13:55:03.476 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_resetxattrs": 0, 2024-04-25T13:55:03.476 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_call": 0, 2024-04-25T13:55:03.476 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_watch": 0, 2024-04-25T13:55:03.476 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_notify": 0, 2024-04-25T13:55:03.476 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T13:55:03.476 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_pgls": 0, 2024-04-25T13:55:03.476 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_pgls_filter": 0, 2024-04-25T13:55:03.476 INFO:teuthology.orchestra.run.smithi161.stdout: "osdop_other": 32, 2024-04-25T13:55:03.476 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_active": 0, 2024-04-25T13:55:03.476 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_send": 0, 2024-04-25T13:55:03.476 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_resend": 0, 2024-04-25T13:55:03.476 INFO:teuthology.orchestra.run.smithi161.stdout: "linger_ping": 0, 2024-04-25T13:55:03.476 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_active": 0, 2024-04-25T13:55:03.476 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_send": 0, 2024-04-25T13:55:03.477 INFO:teuthology.orchestra.run.smithi161.stdout: "poolop_resend": 0, 2024-04-25T13:55:03.477 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_active": 0, 2024-04-25T13:55:03.477 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_send": 0, 2024-04-25T13:55:03.477 INFO:teuthology.orchestra.run.smithi161.stdout: "poolstat_resend": 0, 2024-04-25T13:55:03.477 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_active": 0, 2024-04-25T13:55:03.477 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_send": 0, 2024-04-25T13:55:03.477 INFO:teuthology.orchestra.run.smithi161.stdout: "statfs_resend": 0, 2024-04-25T13:55:03.477 INFO:teuthology.orchestra.run.smithi161.stdout: "command_active": 0, 2024-04-25T13:55:03.477 INFO:teuthology.orchestra.run.smithi161.stdout: "command_send": 0, 2024-04-25T13:55:03.477 INFO:teuthology.orchestra.run.smithi161.stdout: "command_resend": 0, 2024-04-25T13:55:03.477 INFO:teuthology.orchestra.run.smithi161.stdout: "map_epoch": 93, 2024-04-25T13:55:03.477 INFO:teuthology.orchestra.run.smithi161.stdout: "map_full": 0, 2024-04-25T13:55:03.477 INFO:teuthology.orchestra.run.smithi161.stdout: "map_inc": 13, 2024-04-25T13:55:03.477 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_sessions": 12, 2024-04-25T13:55:03.477 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_session_open": 12, 2024-04-25T13:55:03.478 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_session_close": 0, 2024-04-25T13:55:03.478 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_laggy": 0, 2024-04-25T13:55:03.478 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_wr": 230, 2024-04-25T13:55:03.478 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_rd": 0, 2024-04-25T13:55:03.478 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_del": 105 2024-04-25T13:55:03.478 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.478 INFO:teuthology.orchestra.run.smithi161.stdout: "oft": { 2024-04-25T13:55:03.478 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_objs": 1, 2024-04-25T13:55:03.478 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_kv_pairs": 0, 2024-04-25T13:55:03.478 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_updates": 0, 2024-04-25T13:55:03.478 INFO:teuthology.orchestra.run.smithi161.stdout: "omap_total_removes": 0 2024-04-25T13:55:03.478 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.478 INFO:teuthology.orchestra.run.smithi161.stdout: "osd-slow-ops": { 2024-04-25T13:55:03.478 INFO:teuthology.orchestra.run.smithi161.stdout: "slow_ops_count": 0 2024-04-25T13:55:03.479 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.479 INFO:teuthology.orchestra.run.smithi161.stdout: "purge_queue": { 2024-04-25T13:55:03.479 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_ops": 0, 2024-04-25T13:55:03.479 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_ops_high_water": 20, 2024-04-25T13:55:03.479 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing": 0, 2024-04-25T13:55:03.479 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executing_high_water": 13, 2024-04-25T13:55:03.479 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executed_ops": 2334, 2024-04-25T13:55:03.479 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_executed": 1288, 2024-04-25T13:55:03.479 INFO:teuthology.orchestra.run.smithi161.stdout: "pq_item_in_journal": 0 2024-04-25T13:55:03.479 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.479 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T13:55:03.479 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2024-04-25T13:55:03.479 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 104857600, 2024-04-25T13:55:03.479 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2024-04-25T13:55:03.479 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 98996, 2024-04-25T13:55:03.480 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 29052337, 2024-04-25T13:55:03.480 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:03.480 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 98996, 2024-04-25T13:55:03.480 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2024-04-25T13:55:03.480 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2024-04-25T13:55:03.480 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 98996, 2024-04-25T13:55:03.480 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 29052337, 2024-04-25T13:55:03.480 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2024-04-25T13:55:03.480 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.480 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.480 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.480 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:03.480 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.480 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-objecter_bytes": { 2024-04-25T13:55:03.481 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2024-04-25T13:55:03.481 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 104857600, 2024-04-25T13:55:03.481 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2024-04-25T13:55:03.481 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2024-04-25T13:55:03.481 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2024-04-25T13:55:03.481 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:03.481 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2024-04-25T13:55:03.481 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 4223, 2024-04-25T13:55:03.481 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 15415976, 2024-04-25T13:55:03.481 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 4223, 2024-04-25T13:55:03.481 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 15415976, 2024-04-25T13:55:03.481 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2024-04-25T13:55:03.481 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.481 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.481 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.482 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:03.482 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.482 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-objecter_ops": { 2024-04-25T13:55:03.482 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2024-04-25T13:55:03.482 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 1024, 2024-04-25T13:55:03.482 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2024-04-25T13:55:03.482 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 0, 2024-04-25T13:55:03.482 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 0, 2024-04-25T13:55:03.482 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:03.482 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 0, 2024-04-25T13:55:03.482 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 4223, 2024-04-25T13:55:03.482 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 4223, 2024-04-25T13:55:03.482 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 4223, 2024-04-25T13:55:03.482 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 4223, 2024-04-25T13:55:03.482 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2024-04-25T13:55:03.483 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.483 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.483 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.483 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:03.483 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.483 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-write_buf_throttle": { 2024-04-25T13:55:03.483 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2024-04-25T13:55:03.483 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 3758096384, 2024-04-25T13:55:03.483 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2024-04-25T13:55:03.483 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 1288, 2024-04-25T13:55:03.483 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 148984, 2024-04-25T13:55:03.483 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:03.483 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 1288, 2024-04-25T13:55:03.483 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2024-04-25T13:55:03.483 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2024-04-25T13:55:03.483 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 130, 2024-04-25T13:55:03.484 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 148984, 2024-04-25T13:55:03.484 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2024-04-25T13:55:03.484 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.484 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.484 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.484 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:03.484 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:03.484 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-write_buf_throttle-0x55ba57cf8680": { 2024-04-25T13:55:03.484 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2024-04-25T13:55:03.484 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 3758096384, 2024-04-25T13:55:03.484 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2024-04-25T13:55:03.484 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 6108, 2024-04-25T13:55:03.484 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 14847969, 2024-04-25T13:55:03.484 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:03.484 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 6108, 2024-04-25T13:55:03.485 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2024-04-25T13:55:03.485 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2024-04-25T13:55:03.485 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 1349, 2024-04-25T13:55:03.485 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 14847969, 2024-04-25T13:55:03.485 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2024-04-25T13:55:03.485 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:03.485 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:03.485 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:03.485 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:03.485 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:03.485 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-04-25T13:55:03.486 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:02 smithi043 ceph-mon[29195]: pgmap v324: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:55:04.435 INFO:tasks.check_counter:Daemon mds.h mds.exported=8 2024-04-25T13:55:04.435 INFO:tasks.check_counter:Daemon mds.h mds.imported=76 2024-04-25T13:55:04.435 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=336 2024-04-25T13:55:04.435 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=4371 2024-04-25T13:55:04.435 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=3 2024-04-25T13:55:04.435 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-04-25T13:55:04.436 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T13:55:04.436 DEBUG:tasks.check_counter:Getting stats from k 2024-04-25T13:55:04.436 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph daemon mds.k perf dump 2024-04-25T13:55:04.675 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T13:55:05.085 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:04 smithi161 ceph-mon[32696]: pgmap v325: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:55:05.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:04 smithi175 ceph-mon[32649]: pgmap v325: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:55:05.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:04 smithi043 ceph-mon[29195]: pgmap v325: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:55:06.440 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-04-25T13:55:06.440 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T13:55:06.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 0, 2024-04-25T13:55:06.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 2, 2024-04-25T13:55:06.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 0, 2024-04-25T13:55:06.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 0, 2024-04-25T13:55:06.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 4, 2024-04-25T13:55:06.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 0, 2024-04-25T13:55:06.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 0.001153553, 2024-04-25T13:55:06.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 0.000000000, 2024-04-25T13:55:06.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 0.000293288, 2024-04-25T13:55:06.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T13:55:06.441 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:06.441 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:06.441 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:06.441 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:06.442 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:06.442 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:06.442 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:06.442 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:06.442 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:06.442 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:06.442 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T13:55:06.442 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T13:55:06.442 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:06.442 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T13:55:06.442 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 230, 2024-04-25T13:55:06.442 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 219, 2024-04-25T13:55:06.442 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 1689728, 2024-04-25T13:55:06.442 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 134464, 2024-04-25T13:55:06.443 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 2, 2024-04-25T13:55:06.443 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 1, 2024-04-25T13:55:06.443 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 0.050274751, 2024-04-25T13:55:06.443 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 0.013833065, 2024-04-25T13:55:06.443 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 0.044568077, 2024-04-25T13:55:06.443 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.005431943, 2024-04-25T13:55:06.443 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:06.443 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 218, 2024-04-25T13:55:06.443 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.010691794, 2024-04-25T13:55:06.443 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000049044 2024-04-25T13:55:06.443 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:06.443 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:06.443 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:06.443 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:06.443 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 1689728, 2024-04-25T13:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 134464 2024-04-25T13:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T13:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_messages": 6, 2024-04-25T13:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages": 168, 2024-04-25T13:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_bytes": 3312, 2024-04-25T13:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_bytes": 186768, 2024-04-25T13:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_created_connections": 5, 2024-04-25T13:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_active_connections": 3, 2024-04-25T13:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_total_time": 0.012110512, 2024-04-25T13:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_send_time": 0.007628907, 2024-04-25T13:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_recv_time": 0.002203928, 2024-04-25T13:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T13:55:06.444 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 166, 2024-04-25T13:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.015293254, 2024-04-25T13:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000092128 2024-04-25T13:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-25T13:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout: "msgr_send_encrypted_bytes": 186768 2024-04-25T13:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout: "cct": { 2024-04-25T13:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout: "total_workers": 0, 2024-04-25T13:55:06.445 INFO:teuthology.orchestra.run.smithi161.stdout: "unhealthy_workers": 0 2024-04-25T13:55:06.446 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:06.446 INFO:teuthology.orchestra.run.smithi161.stdout: "mempool": { 2024-04-25T13:55:06.446 INFO:teuthology.orchestra.run.smithi161.stdout: "bloom_filter_bytes": 0, 2024-04-25T13:55:06.446 INFO:teuthology.orchestra.run.smithi161.stdout: "bloom_filter_items": 0, 2024-04-25T13:55:06.446 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T13:55:06.446 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_alloc_items": 0, 2024-04-25T13:55:06.446 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T13:55:06.446 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_data_items": 0, 2024-04-25T13:55:06.446 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T13:55:06.446 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T13:55:06.446 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T13:55:06.446 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T13:55:06.446 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T13:55:06.447 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_other_items": 0, 2024-04-25T13:55:06.447 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T13:55:06.447 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T13:55:06.447 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_extent_bytes": 0, 2024-04-25T13:55:06.447 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_extent_items": 0, 2024-04-25T13:55:06.447 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_blob_bytes": 0, 2024-04-25T13:55:06.447 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_blob_items": 0, 2024-04-25T13:55:06.447 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T13:55:06.447 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T13:55:06.447 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T13:55:06.447 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T13:55:06.447 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T13:55:06.447 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_fsck_items": 0, 2024-04-25T13:55:06.447 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_txc_bytes": 0, 2024-04-25T13:55:06.447 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_txc_items": 0, 2024-04-25T13:55:06.448 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T13:55:06.448 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T13:55:06.448 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_bytes": 0, 2024-04-25T13:55:06.448 INFO:teuthology.orchestra.run.smithi161.stdout: "bluestore_writing_items": 0, 2024-04-25T13:55:06.448 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_bytes": 0, 2024-04-25T13:55:06.448 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_items": 0, 2024-04-25T13:55:06.448 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T13:55:06.448 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_reader_items": 0, 2024-04-25T13:55:06.448 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T13:55:06.448 INFO:teuthology.orchestra.run.smithi161.stdout: "bluefs_file_writer_items": 0, 2024-04-25T13:55:06.448 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_anon_bytes": 148771, 2024-04-25T13:55:06.448 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_anon_items": 32, 2024-04-25T13:55:06.448 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_meta_bytes": 0, 2024-04-25T13:55:06.449 INFO:teuthology.orchestra.run.smithi161.stdout: "buffer_meta_items": 0, 2024-04-25T13:55:06.449 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_bytes": 0, 2024-04-25T13:55:06.449 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_items": 0, 2024-04-25T13:55:06.449 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_mapbl_bytes": 0, 2024-04-25T13:55:06.449 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_mapbl_items": 0, 2024-04-25T13:55:06.449 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_pglog_bytes": 0, 2024-04-25T13:55:06.449 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_pglog_items": 0, 2024-04-25T13:55:06.449 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_bytes": 0, 2024-04-25T13:55:06.449 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_items": 0, 2024-04-25T13:55:06.449 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T13:55:06.449 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_mapping_items": 0, 2024-04-25T13:55:06.449 INFO:teuthology.orchestra.run.smithi161.stdout: "pgmap_bytes": 0, 2024-04-25T13:55:06.449 INFO:teuthology.orchestra.run.smithi161.stdout: "pgmap_items": 0, 2024-04-25T13:55:06.449 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_co_bytes": 928, 2024-04-25T13:55:06.449 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_co_items": 2, 2024-04-25T13:55:06.450 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_1_bytes": 0, 2024-04-25T13:55:06.450 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_1_items": 0, 2024-04-25T13:55:06.450 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_2_bytes": 0, 2024-04-25T13:55:06.450 INFO:teuthology.orchestra.run.smithi161.stdout: "unittest_2_items": 0 2024-04-25T13:55:06.450 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-04-25T13:55:06.450 INFO:teuthology.orchestra.run.smithi161.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T13:55:06.450 INFO:teuthology.orchestra.run.smithi161.stdout: "val": 0, 2024-04-25T13:55:06.450 INFO:teuthology.orchestra.run.smithi161.stdout: "max": 104857600, 2024-04-25T13:55:06.450 INFO:teuthology.orchestra.run.smithi161.stdout: "get_started": 0, 2024-04-25T13:55:06.450 INFO:teuthology.orchestra.run.smithi161.stdout: "get": 232, 2024-04-25T13:55:06.450 INFO:teuthology.orchestra.run.smithi161.stdout: "get_sum": 1657283, 2024-04-25T13:55:06.451 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:06.451 INFO:teuthology.orchestra.run.smithi161.stdout: "get_or_fail_success": 232, 2024-04-25T13:55:06.451 INFO:teuthology.orchestra.run.smithi161.stdout: "take": 0, 2024-04-25T13:55:06.451 INFO:teuthology.orchestra.run.smithi161.stdout: "take_sum": 0, 2024-04-25T13:55:06.451 INFO:teuthology.orchestra.run.smithi161.stdout: "put": 232, 2024-04-25T13:55:06.451 INFO:teuthology.orchestra.run.smithi161.stdout: "put_sum": 1657283, 2024-04-25T13:55:06.451 INFO:teuthology.orchestra.run.smithi161.stdout: "wait": { 2024-04-25T13:55:06.451 INFO:teuthology.orchestra.run.smithi161.stdout: "avgcount": 0, 2024-04-25T13:55:06.451 INFO:teuthology.orchestra.run.smithi161.stdout: "sum": 0.000000000, 2024-04-25T13:55:06.451 INFO:teuthology.orchestra.run.smithi161.stdout: "avgtime": 0.000000000 2024-04-25T13:55:06.451 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:06.451 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-04-25T13:55:06.451 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-04-25T13:55:07.274 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:06 smithi161 ceph-mon[32696]: pgmap v326: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:55:07.303 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-04-25T13:55:07.303 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-04-25T13:55:07.303 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-04-25T13:55:07.303 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-04-25T13:55:07.303 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-04-25T13:55:07.303 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-04-25T13:55:07.303 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-04-25T13:55:07.303 DEBUG:tasks.check_counter:Getting stats from c 2024-04-25T13:55:07.304 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph daemon mds.c perf dump 2024-04-25T13:55:07.330 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:06 smithi175 ceph-mon[32649]: pgmap v326: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:55:07.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:06 smithi043 ceph-mon[29195]: pgmap v326: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-04-25T13:55:07.552 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T13:55:09.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:08 smithi175 ceph-mon[32649]: pgmap v327: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:55:09.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:08 smithi175 ceph-mon[32649]: osdmap e94: 12 total, 12 up, 12 in 2024-04-25T13:55:09.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:08 smithi161 ceph-mon[32696]: pgmap v327: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:55:09.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:08 smithi161 ceph-mon[32696]: osdmap e94: 12 total, 12 up, 12 in 2024-04-25T13:55:09.436 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T13:55:09.436 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T13:55:09.436 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 1451, 2024-04-25T13:55:09.436 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 1434, 2024-04-25T13:55:09.437 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 60831303, 2024-04-25T13:55:09.437 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 516968, 2024-04-25T13:55:09.437 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 7, 2024-04-25T13:55:09.437 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 3, 2024-04-25T13:55:09.437 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.205975392, 2024-04-25T13:55:09.437 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.052692205, 2024-04-25T13:55:09.437 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.107850216, 2024-04-25T13:55:09.437 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.046293465, 2024-04-25T13:55:09.437 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:09.437 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1433, 2024-04-25T13:55:09.437 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.064700700, 2024-04-25T13:55:09.437 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000045150 2024-04-25T13:55:09.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.437 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:09.438 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.438 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.438 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.438 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1736064, 2024-04-25T13:55:09.438 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 136000 2024-04-25T13:55:09.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.438 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T13:55:09.438 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 543, 2024-04-25T13:55:09.438 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 705, 2024-04-25T13:55:09.438 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 37885781, 2024-04-25T13:55:09.438 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 617416, 2024-04-25T13:55:09.439 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 9, 2024-04-25T13:55:09.439 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 7, 2024-04-25T13:55:09.439 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.076743775, 2024-04-25T13:55:09.439 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.021343807, 2024-04-25T13:55:09.439 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.028902807, 2024-04-25T13:55:09.439 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.020300946, 2024-04-25T13:55:09.439 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:09.439 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 702, 2024-04-25T13:55:09.439 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.033551209, 2024-04-25T13:55:09.439 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000047793 2024-04-25T13:55:09.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.439 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:09.439 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.439 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.439 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.440 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T13:55:09.440 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 445312 2024-04-25T13:55:09.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.440 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T13:55:09.440 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 877, 2024-04-25T13:55:09.440 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 877, 2024-04-25T13:55:09.440 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 48820525, 2024-04-25T13:55:09.440 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 278069, 2024-04-25T13:55:09.440 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 6, 2024-04-25T13:55:09.440 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-04-25T13:55:09.440 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.101215274, 2024-04-25T13:55:09.440 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.026548955, 2024-04-25T13:55:09.440 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.041645948, 2024-04-25T13:55:09.441 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.025661793, 2024-04-25T13:55:09.441 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:09.441 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 876, 2024-04-25T13:55:09.441 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.033520241, 2024-04-25T13:55:09.441 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000038265 2024-04-25T13:55:09.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.441 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:09.441 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.441 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.441 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.441 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-25T13:55:09.441 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 448 2024-04-25T13:55:09.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.442 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-04-25T13:55:09.442 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-04-25T13:55:09.442 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-04-25T13:55:09.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.442 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-04-25T13:55:09.442 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-04-25T13:55:09.442 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-04-25T13:55:09.442 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4228, 2024-04-25T13:55:09.442 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.130487418, 2024-04-25T13:55:09.442 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000030862 2024-04-25T13:55:09.442 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:09.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.442 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-04-25T13:55:09.442 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-04-25T13:55:09.442 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-04-25T13:55:09.443 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.443 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.443 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.443 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:09.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.443 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-04-25T13:55:09.443 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 0, 2024-04-25T13:55:09.443 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 0, 2024-04-25T13:55:09.443 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-04-25T13:55:09.443 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.443 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.443 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.443 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-04-25T13:55:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 0, 2024-04-25T13:55:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-04-25T13:55:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-04-25T13:55:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 0, 2024-04-25T13:55:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-04-25T13:55:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-04-25T13:55:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 35210, 2024-04-25T13:55:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2024-04-25T13:55:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 35210, 2024-04-25T13:55:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-04-25T13:55:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 35210, 2024-04-25T13:55:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 0, 2024-04-25T13:55:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2024-04-25T13:55:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2024-04-25T13:55:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 132, 2024-04-25T13:55:09.444 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 0, 2024-04-25T13:55:09.445 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 0, 2024-04-25T13:55:09.445 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2024-04-25T13:55:09.445 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 0, 2024-04-25T13:55:09.445 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-04-25T13:55:09.445 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-04-25T13:55:09.445 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-04-25T13:55:09.445 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-04-25T13:55:09.445 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-04-25T13:55:09.445 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-04-25T13:55:09.445 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-04-25T13:55:09.445 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-04-25T13:55:09.445 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-04-25T13:55:09.445 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-04-25T13:55:09.445 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-04-25T13:55:09.445 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-04-25T13:55:09.445 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 4, 2024-04-25T13:55:09.446 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 234, 2024-04-25T13:55:09.446 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 6, 2024-04-25T13:55:09.446 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T13:55:09.446 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-04-25T13:55:09.446 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T13:55:09.446 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-04-25T13:55:09.446 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-04-25T13:55:09.446 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T13:55:09.446 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T13:55:09.446 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-04-25T13:55:09.446 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-04-25T13:55:09.446 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 0, 2024-04-25T13:55:09.446 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2024-04-25T13:55:09.446 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T13:55:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T13:55:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T13:55:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 0, 2024-04-25T13:55:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-04-25T13:55:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-04-25T13:55:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 0 2024-04-25T13:55:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-04-25T13:55:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-04-25T13:55:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-04-25T13:55:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-04-25T13:55:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 0, 2024-04-25T13:55:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-04-25T13:55:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-04-25T13:55:09.448 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-04-25T13:55:09.448 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-04-25T13:55:09.448 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-04-25T13:55:09.448 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-04-25T13:55:09.448 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-04-25T13:55:09.448 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-04-25T13:55:09.448 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-04-25T13:55:09.448 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-04-25T13:55:09.448 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-04-25T13:55:09.448 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-04-25T13:55:09.448 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-04-25T13:55:09.448 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-04-25T13:55:09.448 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-04-25T13:55:09.448 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T13:55:09.449 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-04-25T13:55:09.449 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-04-25T13:55:09.449 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-04-25T13:55:09.449 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-04-25T13:55:09.449 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-04-25T13:55:09.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.449 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-04-25T13:55:09.449 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-04-25T13:55:09.449 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 0, 2024-04-25T13:55:09.449 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-04-25T13:55:09.449 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-04-25T13:55:09.449 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 55092, 2024-04-25T13:55:09.449 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-04-25T13:55:09.449 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-04-25T13:55:09.449 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 0, 2024-04-25T13:55:09.449 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-04-25T13:55:09.450 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-04-25T13:55:09.450 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 78, 2024-04-25T13:55:09.450 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 6, 2024-04-25T13:55:09.450 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-04-25T13:55:09.450 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-04-25T13:55:09.450 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-04-25T13:55:09.450 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 149254851, 2024-04-25T13:55:09.450 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 149254791, 2024-04-25T13:55:09.450 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-04-25T13:55:09.450 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.450 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.450 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.451 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 55092 2024-04-25T13:55:09.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.451 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-04-25T13:55:09.451 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 10945, 2024-04-25T13:55:09.451 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 23461, 2024-04-25T13:55:09.451 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 12516, 2024-04-25T13:55:09.451 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 1475, 2024-04-25T13:55:09.451 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 1850, 2024-04-25T13:55:09.451 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 375, 2024-04-25T13:55:09.451 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 35227, 2024-04-25T13:55:09.451 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 37616, 2024-04-25T13:55:09.451 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 2389, 2024-04-25T13:55:09.451 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2024-04-25T13:55:09.451 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 0, 2024-04-25T13:55:09.451 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 0, 2024-04-25T13:55:09.451 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 190888, 2024-04-25T13:55:09.452 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 215440 2024-04-25T13:55:09.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.452 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-04-25T13:55:09.452 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 0, 2024-04-25T13:55:09.452 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-04-25T13:55:09.452 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 0, 2024-04-25T13:55:09.452 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 0, 2024-04-25T13:55:09.452 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 0, 2024-04-25T13:55:09.452 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-04-25T13:55:09.452 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.452 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.452 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.452 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-04-25T13:55:09.452 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.452 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-04-25T13:55:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-04-25T13:55:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-04-25T13:55:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.454 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-04-25T13:55:09.454 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.454 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.454 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.454 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-04-25T13:55:09.454 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.454 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.454 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.454 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-04-25T13:55:09.454 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.454 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.455 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.455 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-04-25T13:55:09.455 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.455 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.455 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.455 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-04-25T13:55:09.455 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.455 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.455 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.455 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-04-25T13:55:09.455 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.455 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.455 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.456 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-04-25T13:55:09.456 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.456 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.456 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.456 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-04-25T13:55:09.457 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.457 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.457 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.457 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-04-25T13:55:09.457 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.457 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.457 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.457 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-04-25T13:55:09.457 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.457 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.457 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.458 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-04-25T13:55:09.458 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.458 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.458 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.458 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-04-25T13:55:09.458 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.458 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.458 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.458 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-04-25T13:55:09.458 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.458 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.459 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.459 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-04-25T13:55:09.459 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.459 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.459 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.459 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-04-25T13:55:09.459 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.459 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.459 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.459 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-04-25T13:55:09.459 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.459 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.460 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.460 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-04-25T13:55:09.460 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.460 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.460 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.460 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-04-25T13:55:09.460 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.460 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.460 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.461 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-04-25T13:55:09.461 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.461 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.461 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.461 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-04-25T13:55:09.461 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.461 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.461 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.461 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-04-25T13:55:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-04-25T13:55:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-04-25T13:55:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-04-25T13:55:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-04-25T13:55:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-04-25T13:55:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-04-25T13:55:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-04-25T13:55:09.464 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 2, 2024-04-25T13:55:09.464 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 7, 2024-04-25T13:55:09.464 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 5, 2024-04-25T13:55:09.464 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 5, 2024-04-25T13:55:09.464 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-04-25T13:55:09.464 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 0, 2024-04-25T13:55:09.464 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2024-04-25T13:55:09.464 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 3806, 2024-04-25T13:55:09.464 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-04-25T13:55:09.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.464 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-04-25T13:55:09.464 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-04-25T13:55:09.464 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-04-25T13:55:09.464 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T13:55:09.464 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-04-25T13:55:09.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T13:55:09.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-04-25T13:55:09.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T13:55:09.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T13:55:09.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T13:55:09.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T13:55:09.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T13:55:09.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-04-25T13:55:09.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T13:55:09.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T13:55:09.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-04-25T13:55:09.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-04-25T13:55:09.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-04-25T13:55:09.465 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-04-25T13:55:09.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T13:55:09.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T13:55:09.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T13:55:09.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T13:55:09.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T13:55:09.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-04-25T13:55:09.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-04-25T13:55:09.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-04-25T13:55:09.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T13:55:09.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T13:55:09.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-04-25T13:55:09.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-04-25T13:55:09.466 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-04-25T13:55:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-04-25T13:55:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T13:55:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-04-25T13:55:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T13:55:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-04-25T13:55:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 239431, 2024-04-25T13:55:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 78, 2024-04-25T13:55:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-04-25T13:55:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-04-25T13:55:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-04-25T13:55:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-04-25T13:55:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-04-25T13:55:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-04-25T13:55:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-04-25T13:55:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-04-25T13:55:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 9656, 2024-04-25T13:55:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 186, 2024-04-25T13:55:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T13:55:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-04-25T13:55:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-04-25T13:55:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-04-25T13:55:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 51528369, 2024-04-25T13:55:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 641668, 2024-04-25T13:55:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-04-25T13:55:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-04-25T13:55:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-04-25T13:55:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-04-25T13:55:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-04-25T13:55:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-04-25T13:55:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-04-25T13:55:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 2612, 2024-04-25T13:55:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 26, 2024-04-25T13:55:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 4, 2024-04-25T13:55:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 2612, 2024-04-25T13:55:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-04-25T13:55:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2612, 2024-04-25T13:55:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.891969541, 2024-04-25T13:55:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000724337 2024-04-25T13:55:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-04-25T13:55:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-04-25T13:55:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2612, 2024-04-25T13:55:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2613 2024-04-25T13:55:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 2612, 2024-04-25T13:55:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 2612, 2024-04-25T13:55:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 0, 2024-04-25T13:55:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-04-25T13:55:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-04-25T13:55:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 1636, 2024-04-25T13:55:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 0, 2024-04-25T13:55:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 973, 2024-04-25T13:55:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 0, 2024-04-25T13:55:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 0, 2024-04-25T13:55:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-04-25T13:55:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-04-25T13:55:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-04-25T13:55:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-04-25T13:55:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 0, 2024-04-25T13:55:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-04-25T13:55:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-04-25T13:55:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-04-25T13:55:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 2, 2024-04-25T13:55:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 0, 2024-04-25T13:55:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-04-25T13:55:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-04-25T13:55:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-04-25T13:55:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-04-25T13:55:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-04-25T13:55:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-04-25T13:55:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T13:55:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-04-25T13:55:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-04-25T13:55:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-04-25T13:55:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-04-25T13:55:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-04-25T13:55:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-04-25T13:55:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-04-25T13:55:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-04-25T13:55:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-04-25T13:55:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-04-25T13:55:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-04-25T13:55:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-04-25T13:55:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-04-25T13:55:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-04-25T13:55:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-04-25T13:55:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-04-25T13:55:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-04-25T13:55:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-04-25T13:55:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-04-25T13:55:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 94, 2024-04-25T13:55:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-04-25T13:55:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 14, 2024-04-25T13:55:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 11, 2024-04-25T13:55:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 11, 2024-04-25T13:55:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-04-25T13:55:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-04-25T13:55:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 0, 2024-04-25T13:55:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 2, 2024-04-25T13:55:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 0 2024-04-25T13:55:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-04-25T13:55:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 0, 2024-04-25T13:55:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-04-25T13:55:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-04-25T13:55:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-04-25T13:55:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2024-04-25T13:55:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-04-25T13:55:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-04-25T13:55:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-04-25T13:55:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-04-25T13:55:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-04-25T13:55:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-04-25T13:55:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-04-25T13:55:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-04-25T13:55:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-04-25T13:55:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T13:55:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-04-25T13:55:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-04-25T13:55:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-04-25T13:55:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 2867, 2024-04-25T13:55:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 147263661, 2024-04-25T13:55:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 2867, 2024-04-25T13:55:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-04-25T13:55:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-04-25T13:55:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2867, 2024-04-25T13:55:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 147263661, 2024-04-25T13:55:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-04-25T13:55:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-04-25T13:55:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-04-25T13:55:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-04-25T13:55:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-04-25T13:55:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-04-25T13:55:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-04-25T13:55:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-04-25T13:55:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 2612, 2024-04-25T13:55:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 145070539, 2024-04-25T13:55:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2612, 2024-04-25T13:55:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 145070539, 2024-04-25T13:55:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-04-25T13:55:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-04-25T13:55:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-04-25T13:55:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-04-25T13:55:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-04-25T13:55:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-04-25T13:55:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-04-25T13:55:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-04-25T13:55:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 2612, 2024-04-25T13:55:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 2612, 2024-04-25T13:55:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2612, 2024-04-25T13:55:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 2612, 2024-04-25T13:55:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-04-25T13:55:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-04-25T13:55:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-04-25T13:55:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-04-25T13:55:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-04-25T13:55:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-04-25T13:55:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-04-25T13:55:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-04-25T13:55:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-04-25T13:55:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-04-25T13:55:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-04-25T13:55:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-04-25T13:55:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-04-25T13:55:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x564334682c30": { 2024-04-25T13:55:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-04-25T13:55:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-04-25T13:55:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-04-25T13:55:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-04-25T13:55:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-04-25T13:55:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-04-25T13:55:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-04-25T13:55:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-04-25T13:55:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-04-25T13:55:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-04-25T13:55:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-04-25T13:55:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:09.481 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:09.481 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T13:55:09.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:08 smithi043 ceph-mon[29195]: pgmap v327: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-04-25T13:55:09.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:08 smithi043 ceph-mon[29195]: osdmap e94: 12 total, 12 up, 12 in 2024-04-25T13:55:10.177 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-04-25T13:55:10.177 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-04-25T13:55:10.177 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-04-25T13:55:10.177 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-04-25T13:55:10.177 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-04-25T13:55:10.177 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-04-25T13:55:10.177 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T13:55:10.177 DEBUG:tasks.check_counter:Getting stats from f 2024-04-25T13:55:10.178 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph daemon mds.f perf dump 2024-04-25T13:55:10.460 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T13:55:11.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:10 smithi175 ceph-mon[32649]: pgmap v329: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T13:55:11.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:10 smithi161 ceph-mon[32696]: pgmap v329: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T13:55:11.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:10 smithi043 ceph-mon[29195]: pgmap v329: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-04-25T13:55:12.269 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T13:55:12.269 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T13:55:12.269 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 675, 2024-04-25T13:55:12.269 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 657, 2024-04-25T13:55:12.269 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1842830, 2024-04-25T13:55:12.269 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 270176, 2024-04-25T13:55:12.269 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 6, 2024-04-25T13:55:12.269 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 2, 2024-04-25T13:55:12.270 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.096681074, 2024-04-25T13:55:12.270 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.029118890, 2024-04-25T13:55:12.270 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.056262383, 2024-04-25T13:55:12.270 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.020251191, 2024-04-25T13:55:12.270 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:12.270 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 657, 2024-04-25T13:55:12.270 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.030424460, 2024-04-25T13:55:12.270 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000046308 2024-04-25T13:55:12.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.270 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:12.270 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.270 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.270 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1739168, 2024-04-25T13:55:12.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 136928 2024-04-25T13:55:12.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.271 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T13:55:12.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 261, 2024-04-25T13:55:12.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 425, 2024-04-25T13:55:12.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 4259304, 2024-04-25T13:55:12.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 529647, 2024-04-25T13:55:12.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 7, 2024-04-25T13:55:12.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-04-25T13:55:12.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.034770283, 2024-04-25T13:55:12.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.012244727, 2024-04-25T13:55:12.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.010436960, 2024-04-25T13:55:12.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.008214063, 2024-04-25T13:55:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 422, 2024-04-25T13:55:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.023424282, 2024-04-25T13:55:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000055507 2024-04-25T13:55:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T13:55:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 447280 2024-04-25T13:55:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T13:55:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 1576, 2024-04-25T13:55:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 1578, 2024-04-25T13:55:12.273 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 6053921, 2024-04-25T13:55:12.273 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 501226, 2024-04-25T13:55:12.273 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 5, 2024-04-25T13:55:12.273 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2024-04-25T13:55:12.273 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.167648882, 2024-04-25T13:55:12.273 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.050211537, 2024-04-25T13:55:12.273 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.049226084, 2024-04-25T13:55:12.273 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.053536318, 2024-04-25T13:55:12.273 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:12.273 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1576, 2024-04-25T13:55:12.273 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.064069333, 2024-04-25T13:55:12.273 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000040653 2024-04-25T13:55:12.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.273 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:12.273 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.274 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.274 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.274 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T13:55:12.274 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T13:55:12.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.274 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-04-25T13:55:12.274 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-04-25T13:55:12.274 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-04-25T13:55:12.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.274 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-04-25T13:55:12.274 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-04-25T13:55:12.275 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-04-25T13:55:12.275 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3817, 2024-04-25T13:55:12.275 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.121924961, 2024-04-25T13:55:12.275 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000031942 2024-04-25T13:55:12.275 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:12.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.275 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-04-25T13:55:12.275 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-04-25T13:55:12.275 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-04-25T13:55:12.275 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.275 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.275 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.276 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:12.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.276 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-04-25T13:55:12.276 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 0, 2024-04-25T13:55:12.276 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 0, 2024-04-25T13:55:12.276 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-04-25T13:55:12.276 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.276 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.276 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.276 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-04-25T13:55:12.276 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 0, 2024-04-25T13:55:12.277 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-04-25T13:55:12.277 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-04-25T13:55:12.277 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 0, 2024-04-25T13:55:12.277 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-04-25T13:55:12.277 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-04-25T13:55:12.277 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 2662, 2024-04-25T13:55:12.277 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2024-04-25T13:55:12.277 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 2662, 2024-04-25T13:55:12.277 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-04-25T13:55:12.277 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 2662, 2024-04-25T13:55:12.277 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 1, 2024-04-25T13:55:12.277 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2024-04-25T13:55:12.278 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2024-04-25T13:55:12.278 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 77, 2024-04-25T13:55:12.278 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 0, 2024-04-25T13:55:12.278 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 0, 2024-04-25T13:55:12.278 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2024-04-25T13:55:12.278 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 0, 2024-04-25T13:55:12.278 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-04-25T13:55:12.278 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-04-25T13:55:12.278 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-04-25T13:55:12.278 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-04-25T13:55:12.279 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-04-25T13:55:12.279 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-04-25T13:55:12.279 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-04-25T13:55:12.279 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-04-25T13:55:12.279 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-04-25T13:55:12.279 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-04-25T13:55:12.279 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-04-25T13:55:12.279 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-04-25T13:55:12.279 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 0, 2024-04-25T13:55:12.279 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 0, 2024-04-25T13:55:12.279 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2024-04-25T13:55:12.279 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T13:55:12.280 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-04-25T13:55:12.280 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T13:55:12.280 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-04-25T13:55:12.280 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-04-25T13:55:12.280 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T13:55:12.280 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T13:55:12.280 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-04-25T13:55:12.280 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-04-25T13:55:12.280 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 0, 2024-04-25T13:55:12.280 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2024-04-25T13:55:12.280 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T13:55:12.280 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T13:55:12.281 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T13:55:12.281 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 0, 2024-04-25T13:55:12.281 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-04-25T13:55:12.281 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-04-25T13:55:12.281 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 0 2024-04-25T13:55:12.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.281 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-04-25T13:55:12.281 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-04-25T13:55:12.281 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-04-25T13:55:12.281 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-04-25T13:55:12.281 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 0, 2024-04-25T13:55:12.281 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-04-25T13:55:12.282 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-04-25T13:55:12.282 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-04-25T13:55:12.282 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-04-25T13:55:12.282 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-04-25T13:55:12.282 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-04-25T13:55:12.282 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-04-25T13:55:12.282 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-04-25T13:55:12.282 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-04-25T13:55:12.282 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-04-25T13:55:12.282 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-04-25T13:55:12.282 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-04-25T13:55:12.283 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-04-25T13:55:12.283 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-04-25T13:55:12.283 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-04-25T13:55:12.283 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T13:55:12.283 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-04-25T13:55:12.283 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-04-25T13:55:12.283 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-04-25T13:55:12.283 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-04-25T13:55:12.283 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-04-25T13:55:12.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.283 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-04-25T13:55:12.283 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-04-25T13:55:12.283 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 0, 2024-04-25T13:55:12.284 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-04-25T13:55:12.284 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-04-25T13:55:12.284 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 4335, 2024-04-25T13:55:12.284 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-04-25T13:55:12.284 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-04-25T13:55:12.284 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 0, 2024-04-25T13:55:12.284 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-04-25T13:55:12.284 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-04-25T13:55:12.284 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 6, 2024-04-25T13:55:12.284 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-04-25T13:55:12.284 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-04-25T13:55:12.284 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-04-25T13:55:12.284 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-04-25T13:55:12.285 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 13975392, 2024-04-25T13:55:12.285 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 13974818, 2024-04-25T13:55:12.285 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-04-25T13:55:12.285 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.285 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.285 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.285 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 4335 2024-04-25T13:55:12.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.285 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-04-25T13:55:12.285 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 800, 2024-04-25T13:55:12.285 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 1813, 2024-04-25T13:55:12.286 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 1013, 2024-04-25T13:55:12.286 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 158, 2024-04-25T13:55:12.286 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 320, 2024-04-25T13:55:12.286 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 162, 2024-04-25T13:55:12.286 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 2724, 2024-04-25T13:55:12.286 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 2957, 2024-04-25T13:55:12.286 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 233, 2024-04-25T13:55:12.286 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2024-04-25T13:55:12.286 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 0, 2024-04-25T13:55:12.286 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 0, 2024-04-25T13:55:12.286 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 126892, 2024-04-25T13:55:12.286 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 215440 2024-04-25T13:55:12.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.287 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-04-25T13:55:12.287 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 0, 2024-04-25T13:55:12.287 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-04-25T13:55:12.287 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 0, 2024-04-25T13:55:12.287 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 0, 2024-04-25T13:55:12.287 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 0, 2024-04-25T13:55:12.287 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-04-25T13:55:12.287 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.287 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.287 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.287 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-04-25T13:55:12.288 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.288 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.288 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.288 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-04-25T13:55:12.288 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.288 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.288 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.288 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-04-25T13:55:12.288 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.288 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.288 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.289 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-04-25T13:55:12.289 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.289 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.289 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.289 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-04-25T13:55:12.289 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.289 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.289 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.289 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-04-25T13:55:12.289 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.290 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.290 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.290 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-04-25T13:55:12.290 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.290 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.290 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.290 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-04-25T13:55:12.290 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.290 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.290 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.291 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-04-25T13:55:12.291 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.291 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.291 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.291 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-04-25T13:55:12.291 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.291 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.291 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.291 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-04-25T13:55:12.292 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.292 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.292 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.292 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-04-25T13:55:12.292 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.293 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.293 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.293 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-04-25T13:55:12.293 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.293 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.293 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.293 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-04-25T13:55:12.293 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.293 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.293 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.294 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-04-25T13:55:12.294 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.294 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.294 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.294 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-04-25T13:55:12.294 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.294 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.294 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.294 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-04-25T13:55:12.294 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.294 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.295 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.295 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-04-25T13:55:12.295 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.295 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.295 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.295 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-04-25T13:55:12.295 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.295 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.295 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.295 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-04-25T13:55:12.295 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.296 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.296 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.296 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-04-25T13:55:12.296 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.296 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.296 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.296 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-04-25T13:55:12.296 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.296 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.296 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.297 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-04-25T13:55:12.297 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.297 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.297 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.297 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-04-25T13:55:12.297 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.297 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.297 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.297 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-04-25T13:55:12.297 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.297 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.298 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.298 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-04-25T13:55:12.298 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.298 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.298 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.298 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-04-25T13:55:12.298 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.298 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.298 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.298 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-04-25T13:55:12.299 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.299 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.299 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.299 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-04-25T13:55:12.299 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-04-25T13:55:12.299 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-04-25T13:55:12.299 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.299 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.299 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.299 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:12.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.299 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-04-25T13:55:12.299 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 2, 2024-04-25T13:55:12.299 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 5, 2024-04-25T13:55:12.300 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 3, 2024-04-25T13:55:12.300 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 5, 2024-04-25T13:55:12.300 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-04-25T13:55:12.300 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 0, 2024-04-25T13:55:12.300 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2024-04-25T13:55:12.300 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 3808, 2024-04-25T13:55:12.300 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-04-25T13:55:12.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.300 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-04-25T13:55:12.300 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-04-25T13:55:12.300 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-04-25T13:55:12.300 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T13:55:12.300 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-04-25T13:55:12.300 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T13:55:12.300 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-04-25T13:55:12.300 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T13:55:12.301 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T13:55:12.301 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T13:55:12.301 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T13:55:12.301 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T13:55:12.301 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-04-25T13:55:12.301 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T13:55:12.301 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T13:55:12.301 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-04-25T13:55:12.301 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-04-25T13:55:12.301 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-04-25T13:55:12.301 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-04-25T13:55:12.301 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T13:55:12.301 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T13:55:12.301 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T13:55:12.302 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T13:55:12.302 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T13:55:12.302 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-04-25T13:55:12.302 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-04-25T13:55:12.302 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-04-25T13:55:12.302 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T13:55:12.302 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T13:55:12.302 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-04-25T13:55:12.302 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-04-25T13:55:12.302 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-04-25T13:55:12.302 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-04-25T13:55:12.302 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T13:55:12.302 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-04-25T13:55:12.302 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T13:55:12.303 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-04-25T13:55:12.303 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 207128, 2024-04-25T13:55:12.303 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 63, 2024-04-25T13:55:12.303 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-04-25T13:55:12.303 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-04-25T13:55:12.303 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-04-25T13:55:12.303 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-04-25T13:55:12.303 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-04-25T13:55:12.303 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-04-25T13:55:12.303 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-04-25T13:55:12.303 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-04-25T13:55:12.303 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 9656, 2024-04-25T13:55:12.303 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 186, 2024-04-25T13:55:12.303 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T13:55:12.304 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-04-25T13:55:12.304 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-04-25T13:55:12.304 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-04-25T13:55:12.304 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 3941930, 2024-04-25T13:55:12.304 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 58562, 2024-04-25T13:55:12.304 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-04-25T13:55:12.304 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-04-25T13:55:12.304 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-04-25T13:55:12.304 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-04-25T13:55:12.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.304 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-04-25T13:55:12.304 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-04-25T13:55:12.304 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-04-25T13:55:12.304 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 2254, 2024-04-25T13:55:12.304 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 21, 2024-04-25T13:55:12.305 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 3, 2024-04-25T13:55:12.305 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 2254, 2024-04-25T13:55:12.305 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-04-25T13:55:12.305 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2254, 2024-04-25T13:55:12.305 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.254979799, 2024-04-25T13:55:12.305 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000556778 2024-04-25T13:55:12.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.305 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-04-25T13:55:12.305 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-04-25T13:55:12.305 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2254, 2024-04-25T13:55:12.305 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2255 2024-04-25T13:55:12.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.305 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 2254, 2024-04-25T13:55:12.305 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 2254, 2024-04-25T13:55:12.305 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 0, 2024-04-25T13:55:12.306 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-04-25T13:55:12.306 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-04-25T13:55:12.306 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 1393, 2024-04-25T13:55:12.306 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 0, 2024-04-25T13:55:12.306 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 859, 2024-04-25T13:55:12.306 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 0, 2024-04-25T13:55:12.306 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 0, 2024-04-25T13:55:12.306 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-04-25T13:55:12.306 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-04-25T13:55:12.306 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-04-25T13:55:12.306 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-04-25T13:55:12.306 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 0, 2024-04-25T13:55:12.306 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-04-25T13:55:12.306 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-04-25T13:55:12.307 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-04-25T13:55:12.307 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 1, 2024-04-25T13:55:12.307 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 0, 2024-04-25T13:55:12.307 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-04-25T13:55:12.307 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-04-25T13:55:12.307 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-04-25T13:55:12.307 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-04-25T13:55:12.307 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-04-25T13:55:12.307 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-04-25T13:55:12.307 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T13:55:12.307 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-04-25T13:55:12.307 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-04-25T13:55:12.307 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-04-25T13:55:12.307 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-04-25T13:55:12.308 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-04-25T13:55:12.308 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-04-25T13:55:12.308 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-04-25T13:55:12.308 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-04-25T13:55:12.308 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-04-25T13:55:12.308 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-04-25T13:55:12.308 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-04-25T13:55:12.308 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-04-25T13:55:12.308 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-04-25T13:55:12.308 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-04-25T13:55:12.308 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-04-25T13:55:12.308 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-04-25T13:55:12.308 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-04-25T13:55:12.308 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-04-25T13:55:12.308 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-04-25T13:55:12.309 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 94, 2024-04-25T13:55:12.309 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-04-25T13:55:12.309 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 14, 2024-04-25T13:55:12.309 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 7, 2024-04-25T13:55:12.309 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 7, 2024-04-25T13:55:12.309 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-04-25T13:55:12.309 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-04-25T13:55:12.309 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 0, 2024-04-25T13:55:12.309 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 2, 2024-04-25T13:55:12.309 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 0 2024-04-25T13:55:12.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.309 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-04-25T13:55:12.309 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 0, 2024-04-25T13:55:12.310 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-04-25T13:55:12.310 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-04-25T13:55:12.310 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-04-25T13:55:12.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.310 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2024-04-25T13:55:12.310 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-04-25T13:55:12.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.310 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-04-25T13:55:12.310 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-04-25T13:55:12.310 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-04-25T13:55:12.310 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-04-25T13:55:12.310 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-04-25T13:55:12.310 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-04-25T13:55:12.310 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-04-25T13:55:12.311 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-04-25T13:55:12.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.311 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T13:55:12.311 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-04-25T13:55:12.311 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-04-25T13:55:12.311 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-04-25T13:55:12.311 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 2508, 2024-04-25T13:55:12.311 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 11914411, 2024-04-25T13:55:12.311 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:12.311 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 2508, 2024-04-25T13:55:12.311 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-04-25T13:55:12.311 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-04-25T13:55:12.311 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2508, 2024-04-25T13:55:12.312 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 11914411, 2024-04-25T13:55:12.312 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-04-25T13:55:12.312 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.312 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.312 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.312 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:12.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.312 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-04-25T13:55:12.312 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-04-25T13:55:12.312 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-04-25T13:55:12.312 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-04-25T13:55:12.312 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-04-25T13:55:12.312 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-04-25T13:55:12.312 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:12.312 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-04-25T13:55:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 2254, 2024-04-25T13:55:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 9781093, 2024-04-25T13:55:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2254, 2024-04-25T13:55:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 9781093, 2024-04-25T13:55:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-04-25T13:55:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-04-25T13:55:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-04-25T13:55:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-04-25T13:55:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-04-25T13:55:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-04-25T13:55:12.313 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-04-25T13:55:12.314 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:12.314 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-04-25T13:55:12.314 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 2254, 2024-04-25T13:55:12.314 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 2254, 2024-04-25T13:55:12.314 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2254, 2024-04-25T13:55:12.314 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 2254, 2024-04-25T13:55:12.314 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-04-25T13:55:12.314 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.314 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.314 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.314 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:12.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.314 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-04-25T13:55:12.315 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-04-25T13:55:12.315 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-04-25T13:55:12.315 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-04-25T13:55:12.315 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-04-25T13:55:12.315 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-04-25T13:55:12.315 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:12.315 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-04-25T13:55:12.315 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-04-25T13:55:12.315 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-04-25T13:55:12.315 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-04-25T13:55:12.315 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-04-25T13:55:12.315 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-04-25T13:55:12.315 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.315 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.315 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.315 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:12.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:12.316 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x559a0ba2e8f0": { 2024-04-25T13:55:12.316 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-04-25T13:55:12.316 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-04-25T13:55:12.316 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-04-25T13:55:12.316 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-04-25T13:55:12.316 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-04-25T13:55:12.316 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:12.316 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-04-25T13:55:12.316 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-04-25T13:55:12.316 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-04-25T13:55:12.316 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-04-25T13:55:12.316 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-04-25T13:55:12.316 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-04-25T13:55:12.316 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:12.317 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:12.317 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:12.317 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:12.317 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:12.317 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T13:55:13.129 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:12 smithi175 ceph-mon[32649]: pgmap v330: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:55:13.130 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-04-25T13:55:13.130 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-04-25T13:55:13.130 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-04-25T13:55:13.130 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-04-25T13:55:13.131 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-04-25T13:55:13.131 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-04-25T13:55:13.131 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T13:55:13.131 DEBUG:tasks.check_counter:Getting stats from i 2024-04-25T13:55:13.131 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph daemon mds.i perf dump 2024-04-25T13:55:13.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:12 smithi161 ceph-mon[32696]: pgmap v330: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:55:13.373 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T13:55:13.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:12 smithi043 ceph-mon[29195]: pgmap v330: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:55:15.162 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:14 smithi175 ceph-mon[32649]: pgmap v331: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:55:15.163 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T13:55:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T13:55:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 73835, 2024-04-25T13:55:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 75872, 2024-04-25T13:55:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 28608212, 2024-04-25T13:55:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 22490890, 2024-04-25T13:55:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 11, 2024-04-25T13:55:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-04-25T13:55:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 3.487718843, 2024-04-25T13:55:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 1.434064174, 2024-04-25T13:55:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 2.664872473, 2024-04-25T13:55:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.049516807, 2024-04-25T13:55:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 75870, 2024-04-25T13:55:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2.763221656, 2024-04-25T13:55:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000036420 2024-04-25T13:55:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 140914, 2024-04-25T13:55:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.032748350, 2024-04-25T13:55:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000232 2024-04-25T13:55:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 928, 2024-04-25T13:55:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 1216 2024-04-25T13:55:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T13:55:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 1466, 2024-04-25T13:55:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 1481, 2024-04-25T13:55:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 2051990, 2024-04-25T13:55:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 4697559, 2024-04-25T13:55:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 8, 2024-04-25T13:55:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 7, 2024-04-25T13:55:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.147679246, 2024-04-25T13:55:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.049033312, 2024-04-25T13:55:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.069040144, 2024-04-25T13:55:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.036850470, 2024-04-25T13:55:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1481, 2024-04-25T13:55:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.090158673, 2024-04-25T13:55:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000060876 2024-04-25T13:55:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 66, 2024-04-25T13:55:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000013922, 2024-04-25T13:55:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000210 2024-04-25T13:55:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1752336, 2024-04-25T13:55:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 153872 2024-04-25T13:55:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T13:55:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 18747, 2024-04-25T13:55:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 23404, 2024-04-25T13:55:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 6078307, 2024-04-25T13:55:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 10674629, 2024-04-25T13:55:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 16, 2024-04-25T13:55:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2024-04-25T13:55:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 1.129418332, 2024-04-25T13:55:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.464682558, 2024-04-25T13:55:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.785216341, 2024-04-25T13:55:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.024757745, 2024-04-25T13:55:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 23401, 2024-04-25T13:55:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.629420024, 2024-04-25T13:55:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000026897 2024-04-25T13:55:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 38534, 2024-04-25T13:55:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.007229998, 2024-04-25T13:55:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000187 2024-04-25T13:55:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 2160, 2024-04-25T13:55:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 450272 2024-04-25T13:55:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-04-25T13:55:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-04-25T13:55:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-04-25T13:55:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-04-25T13:55:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-04-25T13:55:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-04-25T13:55:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2184, 2024-04-25T13:55:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.658993937, 2024-04-25T13:55:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000759612 2024-04-25T13:55:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-04-25T13:55:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-04-25T13:55:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-04-25T13:55:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1824, 2024-04-25T13:55:15.170 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.415265528, 2024-04-25T13:55:15.170 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000227667 2024-04-25T13:55:15.170 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:15.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.170 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-04-25T13:55:15.170 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 3526, 2024-04-25T13:55:15.170 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 3248, 2024-04-25T13:55:15.170 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-04-25T13:55:15.170 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3248, 2024-04-25T13:55:15.170 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 8.068799395, 2024-04-25T13:55:15.170 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002484236 2024-04-25T13:55:15.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.170 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-04-25T13:55:15.170 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 278, 2024-04-25T13:55:15.170 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-04-25T13:55:15.171 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-04-25T13:55:15.171 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 11, 2024-04-25T13:55:15.171 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-04-25T13:55:15.171 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-04-25T13:55:15.171 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 1709, 2024-04-25T13:55:15.171 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 26, 2024-04-25T13:55:15.171 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 1683, 2024-04-25T13:55:15.171 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-04-25T13:55:15.171 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 1670, 2024-04-25T13:55:15.171 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 3488, 2024-04-25T13:55:15.171 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 1, 2024-04-25T13:55:15.171 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 1, 2024-04-25T13:55:15.171 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 81, 2024-04-25T13:55:15.171 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 10894, 2024-04-25T13:55:15.172 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 7162, 2024-04-25T13:55:15.172 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 255, 2024-04-25T13:55:15.172 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 1747, 2024-04-25T13:55:15.172 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-04-25T13:55:15.172 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 7, 2024-04-25T13:55:15.172 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 23, 2024-04-25T13:55:15.172 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-04-25T13:55:15.172 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-04-25T13:55:15.172 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 2, 2024-04-25T13:55:15.172 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 2, 2024-04-25T13:55:15.172 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 69, 2024-04-25T13:55:15.172 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 730, 2024-04-25T13:55:15.172 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-04-25T13:55:15.172 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-04-25T13:55:15.173 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 10, 2024-04-25T13:55:15.173 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 11799, 2024-04-25T13:55:15.173 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 1261521663, 2024-04-25T13:55:15.173 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 3, 2024-04-25T13:55:15.173 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T13:55:15.173 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-04-25T13:55:15.173 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T13:55:15.173 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-04-25T13:55:15.173 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-04-25T13:55:15.173 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T13:55:15.173 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T13:55:15.173 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-04-25T13:55:15.173 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 82, 2024-04-25T13:55:15.173 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 842, 2024-04-25T13:55:15.173 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 1447, 2024-04-25T13:55:15.174 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 19, 2024-04-25T13:55:15.174 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T13:55:15.174 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T13:55:15.174 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 1847, 2024-04-25T13:55:15.174 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 835, 2024-04-25T13:55:15.174 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 75, 2024-04-25T13:55:15.174 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 2397 2024-04-25T13:55:15.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.174 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-04-25T13:55:15.174 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 152, 2024-04-25T13:55:15.174 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 4700, 2024-04-25T13:55:15.174 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 3118, 2024-04-25T13:55:15.174 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 3409, 2024-04-25T13:55:15.175 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 392, 2024-04-25T13:55:15.175 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 72, 2024-04-25T13:55:15.175 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-04-25T13:55:15.175 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-04-25T13:55:15.175 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 961, 2024-04-25T13:55:15.175 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 886, 2024-04-25T13:55:15.175 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 16, 2024-04-25T13:55:15.175 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 6, 2024-04-25T13:55:15.175 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-04-25T13:55:15.175 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-04-25T13:55:15.175 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-04-25T13:55:15.175 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-04-25T13:55:15.175 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-04-25T13:55:15.175 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-04-25T13:55:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-04-25T13:55:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T13:55:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 2, 2024-04-25T13:55:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-04-25T13:55:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-04-25T13:55:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-04-25T13:55:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-04-25T13:55:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-04-25T13:55:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-04-25T13:55:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 4335, 2024-04-25T13:55:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-04-25T13:55:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-04-25T13:55:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 4335, 2024-04-25T13:55:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-04-25T13:55:15.177 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-04-25T13:55:15.177 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 6, 2024-04-25T13:55:15.177 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-04-25T13:55:15.178 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-04-25T13:55:15.178 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 6, 2024-04-25T13:55:15.178 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-04-25T13:55:15.178 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-04-25T13:55:15.178 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-04-25T13:55:15.178 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-04-25T13:55:15.178 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 13975392, 2024-04-25T13:55:15.178 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-04-25T13:55:15.178 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-04-25T13:55:15.178 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1036, 2024-04-25T13:55:15.178 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2.559189948, 2024-04-25T13:55:15.178 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002470260 2024-04-25T13:55:15.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.179 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-04-25T13:55:15.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.179 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-04-25T13:55:15.179 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 811, 2024-04-25T13:55:15.179 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 3348, 2024-04-25T13:55:15.179 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 2537, 2024-04-25T13:55:15.179 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 188, 2024-04-25T13:55:15.179 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 1913, 2024-04-25T13:55:15.179 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 1725, 2024-04-25T13:55:15.179 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 1771, 2024-04-25T13:55:15.179 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 6305, 2024-04-25T13:55:15.179 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 4534, 2024-04-25T13:55:15.179 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 1, 2024-04-25T13:55:15.179 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 1109, 2024-04-25T13:55:15.180 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 1108, 2024-04-25T13:55:15.180 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 158524, 2024-04-25T13:55:15.180 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 223632 2024-04-25T13:55:15.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.180 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-04-25T13:55:15.180 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 6303, 2024-04-25T13:55:15.180 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 6614, 2024-04-25T13:55:15.180 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 3526, 2024-04-25T13:55:15.180 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 65, 2024-04-25T13:55:15.180 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 40474, 2024-04-25T13:55:15.180 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-04-25T13:55:15.180 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 93, 2024-04-25T13:55:15.180 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.242431306, 2024-04-25T13:55:15.180 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002606788 2024-04-25T13:55:15.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.181 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-04-25T13:55:15.181 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 405, 2024-04-25T13:55:15.181 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.160101109, 2024-04-25T13:55:15.181 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000395311 2024-04-25T13:55:15.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.181 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-04-25T13:55:15.181 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.181 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.181 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.181 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-04-25T13:55:15.181 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 27, 2024-04-25T13:55:15.181 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.462136291, 2024-04-25T13:55:15.182 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.017116158 2024-04-25T13:55:15.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.182 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-04-25T13:55:15.182 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1200, 2024-04-25T13:55:15.182 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.301879344, 2024-04-25T13:55:15.182 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001084899 2024-04-25T13:55:15.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.182 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-04-25T13:55:15.182 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.182 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.182 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.182 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-04-25T13:55:15.183 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.183 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.183 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.183 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-04-25T13:55:15.183 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.183 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.183 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.183 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-04-25T13:55:15.183 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.183 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.183 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.184 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-04-25T13:55:15.184 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.184 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.184 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.185 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-04-25T13:55:15.185 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.185 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.185 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.185 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-04-25T13:55:15.185 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 39, 2024-04-25T13:55:15.185 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.099371118, 2024-04-25T13:55:15.185 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002547977 2024-04-25T13:55:15.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.186 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-04-25T13:55:15.186 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 56, 2024-04-25T13:55:15.186 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.137580164, 2024-04-25T13:55:15.186 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002456788 2024-04-25T13:55:15.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.186 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-04-25T13:55:15.186 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.186 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.186 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.186 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-04-25T13:55:15.186 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 110, 2024-04-25T13:55:15.186 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.072083982, 2024-04-25T13:55:15.187 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000655308 2024-04-25T13:55:15.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.187 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-04-25T13:55:15.187 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 150, 2024-04-25T13:55:15.187 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.141712494, 2024-04-25T13:55:15.187 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000944749 2024-04-25T13:55:15.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.187 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-04-25T13:55:15.187 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 87, 2024-04-25T13:55:15.187 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2.109153074, 2024-04-25T13:55:15.187 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.024243138 2024-04-25T13:55:15.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.187 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-04-25T13:55:15.188 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.188 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.188 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.188 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-04-25T13:55:15.188 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.188 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.188 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.188 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-04-25T13:55:15.188 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 110, 2024-04-25T13:55:15.188 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.124156319, 2024-04-25T13:55:15.188 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.010219602 2024-04-25T13:55:15.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.189 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-04-25T13:55:15.189 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.189 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.189 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.189 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-04-25T13:55:15.189 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.189 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.189 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.189 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-04-25T13:55:15.189 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 26, 2024-04-25T13:55:15.189 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.113560734, 2024-04-25T13:55:15.189 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.004367720 2024-04-25T13:55:15.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.190 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-04-25T13:55:15.190 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.190 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.190 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.190 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-04-25T13:55:15.190 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.190 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.190 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.190 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-04-25T13:55:15.190 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.191 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.191 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.191 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-04-25T13:55:15.191 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.191 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.191 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.191 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-04-25T13:55:15.191 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 49, 2024-04-25T13:55:15.191 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.140833098, 2024-04-25T13:55:15.191 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002874144 2024-04-25T13:55:15.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.191 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-04-25T13:55:15.192 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 896, 2024-04-25T13:55:15.192 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.963800362, 2024-04-25T13:55:15.192 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002191741 2024-04-25T13:55:15.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.192 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-04-25T13:55:15.192 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-04-25T13:55:15.192 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-04-25T13:55:15.192 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.192 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.192 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.192 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:15.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.192 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-04-25T13:55:15.192 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 2, 2024-04-25T13:55:15.193 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 5, 2024-04-25T13:55:15.193 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 3, 2024-04-25T13:55:15.193 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 2, 2024-04-25T13:55:15.193 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-04-25T13:55:15.193 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 1681, 2024-04-25T13:55:15.193 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 840, 2024-04-25T13:55:15.193 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 627, 2024-04-25T13:55:15.193 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-04-25T13:55:15.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.193 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-04-25T13:55:15.193 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-04-25T13:55:15.193 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-04-25T13:55:15.193 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T13:55:15.193 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-04-25T13:55:15.194 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T13:55:15.194 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-04-25T13:55:15.194 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T13:55:15.194 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T13:55:15.194 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T13:55:15.194 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T13:55:15.194 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T13:55:15.194 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-04-25T13:55:15.194 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T13:55:15.194 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T13:55:15.194 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-04-25T13:55:15.194 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-04-25T13:55:15.194 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-04-25T13:55:15.195 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-04-25T13:55:15.195 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T13:55:15.195 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T13:55:15.195 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T13:55:15.195 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T13:55:15.195 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T13:55:15.195 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-04-25T13:55:15.195 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-04-25T13:55:15.195 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-04-25T13:55:15.195 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T13:55:15.195 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T13:55:15.195 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-04-25T13:55:15.195 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-04-25T13:55:15.195 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-04-25T13:55:15.196 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-04-25T13:55:15.196 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T13:55:15.196 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-04-25T13:55:15.196 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T13:55:15.196 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-04-25T13:55:15.196 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 756812, 2024-04-25T13:55:15.196 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 234, 2024-04-25T13:55:15.196 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-04-25T13:55:15.196 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-04-25T13:55:15.196 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-04-25T13:55:15.196 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-04-25T13:55:15.196 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-04-25T13:55:15.196 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-04-25T13:55:15.197 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-04-25T13:55:15.197 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-04-25T13:55:15.197 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 9656, 2024-04-25T13:55:15.197 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 186, 2024-04-25T13:55:15.197 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T13:55:15.197 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-04-25T13:55:15.197 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-04-25T13:55:15.197 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-04-25T13:55:15.197 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 3420937, 2024-04-25T13:55:15.197 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 64076, 2024-04-25T13:55:15.197 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-04-25T13:55:15.197 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-04-25T13:55:15.197 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-04-25T13:55:15.197 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-04-25T13:55:15.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.198 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-04-25T13:55:15.198 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-04-25T13:55:15.198 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-04-25T13:55:15.198 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 3136, 2024-04-25T13:55:15.198 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 9981613, 2024-04-25T13:55:15.198 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 28, 2024-04-25T13:55:15.198 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 3136, 2024-04-25T13:55:15.198 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-04-25T13:55:15.198 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3136, 2024-04-25T13:55:15.198 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 14.206769970, 2024-04-25T13:55:15.198 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.004530220 2024-04-25T13:55:15.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.199 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-04-25T13:55:15.199 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-04-25T13:55:15.199 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3136, 2024-04-25T13:55:15.199 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 3336 2024-04-25T13:55:15.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.199 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 3136, 2024-04-25T13:55:15.199 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 106, 2024-04-25T13:55:15.199 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 3030, 2024-04-25T13:55:15.199 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-04-25T13:55:15.199 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-04-25T13:55:15.199 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-04-25T13:55:15.199 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-04-25T13:55:15.199 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 106, 2024-04-25T13:55:15.200 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 1142, 2024-04-25T13:55:15.200 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 73, 2024-04-25T13:55:15.200 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-04-25T13:55:15.200 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-04-25T13:55:15.200 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 7, 2024-04-25T13:55:15.200 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-04-25T13:55:15.200 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 1649, 2024-04-25T13:55:15.200 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-04-25T13:55:15.200 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-04-25T13:55:15.200 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-04-25T13:55:15.200 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 0, 2024-04-25T13:55:15.200 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-04-25T13:55:15.200 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-04-25T13:55:15.200 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-04-25T13:55:15.201 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-04-25T13:55:15.201 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-04-25T13:55:15.201 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-04-25T13:55:15.201 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-04-25T13:55:15.201 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T13:55:15.201 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-04-25T13:55:15.201 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-04-25T13:55:15.201 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 21, 2024-04-25T13:55:15.201 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-04-25T13:55:15.201 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-04-25T13:55:15.201 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-04-25T13:55:15.201 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-04-25T13:55:15.201 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-04-25T13:55:15.202 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-04-25T13:55:15.202 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-04-25T13:55:15.202 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-04-25T13:55:15.202 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-04-25T13:55:15.202 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-04-25T13:55:15.202 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-04-25T13:55:15.202 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-04-25T13:55:15.202 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-04-25T13:55:15.202 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-04-25T13:55:15.202 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-04-25T13:55:15.202 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-04-25T13:55:15.202 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 94, 2024-04-25T13:55:15.202 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-04-25T13:55:15.202 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 14, 2024-04-25T13:55:15.203 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 12, 2024-04-25T13:55:15.203 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 12, 2024-04-25T13:55:15.203 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-04-25T13:55:15.203 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-04-25T13:55:15.203 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 205, 2024-04-25T13:55:15.203 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 0, 2024-04-25T13:55:15.203 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 103 2024-04-25T13:55:15.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.203 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-04-25T13:55:15.203 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-04-25T13:55:15.203 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-04-25T13:55:15.203 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-04-25T13:55:15.203 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-04-25T13:55:15.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.204 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2024-04-25T13:55:15.204 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-04-25T13:55:15.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.204 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-04-25T13:55:15.204 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-04-25T13:55:15.204 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 19, 2024-04-25T13:55:15.204 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-04-25T13:55:15.204 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 12, 2024-04-25T13:55:15.204 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 1642, 2024-04-25T13:55:15.204 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 886, 2024-04-25T13:55:15.204 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-04-25T13:55:15.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.204 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T13:55:15.204 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-04-25T13:55:15.205 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-04-25T13:55:15.205 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-04-25T13:55:15.205 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 94044, 2024-04-25T13:55:15.205 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 28256174, 2024-04-25T13:55:15.205 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:15.205 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 94044, 2024-04-25T13:55:15.205 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-04-25T13:55:15.205 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-04-25T13:55:15.205 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 94044, 2024-04-25T13:55:15.205 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 28256174, 2024-04-25T13:55:15.205 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-04-25T13:55:15.205 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.205 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.205 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.206 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:15.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.206 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-04-25T13:55:15.206 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-04-25T13:55:15.206 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-04-25T13:55:15.206 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-04-25T13:55:15.206 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-04-25T13:55:15.206 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-04-25T13:55:15.206 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:15.206 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-04-25T13:55:15.206 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 3136, 2024-04-25T13:55:15.206 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 10085323, 2024-04-25T13:55:15.206 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 3136, 2024-04-25T13:55:15.207 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 10085323, 2024-04-25T13:55:15.207 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-04-25T13:55:15.207 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.207 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.207 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.207 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:15.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.207 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-04-25T13:55:15.207 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-04-25T13:55:15.207 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-04-25T13:55:15.207 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-04-25T13:55:15.207 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-04-25T13:55:15.207 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-04-25T13:55:15.207 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:15.207 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-04-25T13:55:15.208 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 3136, 2024-04-25T13:55:15.208 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 3136, 2024-04-25T13:55:15.208 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 3136, 2024-04-25T13:55:15.208 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 3136, 2024-04-25T13:55:15.208 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-04-25T13:55:15.208 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.208 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.208 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.208 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:15.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.208 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-04-25T13:55:15.208 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-04-25T13:55:15.208 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-04-25T13:55:15.208 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-04-25T13:55:15.209 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 886, 2024-04-25T13:55:15.209 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 103710, 2024-04-25T13:55:15.209 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:15.209 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 886, 2024-04-25T13:55:15.209 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-04-25T13:55:15.209 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-04-25T13:55:15.209 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 106, 2024-04-25T13:55:15.209 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 103710, 2024-04-25T13:55:15.209 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-04-25T13:55:15.209 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.209 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.209 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.209 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:15.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:15.210 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x55d548500750": { 2024-04-25T13:55:15.210 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-04-25T13:55:15.210 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-04-25T13:55:15.210 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-04-25T13:55:15.210 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 4335, 2024-04-25T13:55:15.210 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 9781088, 2024-04-25T13:55:15.210 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:15.210 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 4335, 2024-04-25T13:55:15.210 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-04-25T13:55:15.210 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-04-25T13:55:15.210 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 1036, 2024-04-25T13:55:15.210 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 9781088, 2024-04-25T13:55:15.210 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-04-25T13:55:15.211 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:15.211 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:15.211 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:15.211 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:15.211 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:15.211 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T13:55:15.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:14 smithi161 ceph-mon[32696]: pgmap v331: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:55:15.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:14 smithi043 ceph-mon[29195]: pgmap v331: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:55:16.076 INFO:tasks.check_counter:Daemon mds.i mds.exported=2 2024-04-25T13:55:16.077 INFO:tasks.check_counter:Daemon mds.i mds.imported=69 2024-04-25T13:55:16.077 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=152 2024-04-25T13:55:16.077 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=4700 2024-04-25T13:55:16.077 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=3 2024-04-25T13:55:16.077 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-04-25T13:55:16.077 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T13:55:16.077 DEBUG:tasks.check_counter:Getting stats from l 2024-04-25T13:55:16.077 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 shell --fsid 394efb6c-0308-11ef-bc93-c7b262605968 -- ceph daemon mds.l perf dump 2024-04-25T13:55:16.315 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T13:55:17.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:16 smithi175 ceph-mon[32649]: pgmap v332: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:55:17.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:16 smithi175 ceph-mon[32649]: osdmap e95: 12 total, 12 up, 12 in 2024-04-25T13:55:17.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:16 smithi161 ceph-mon[32696]: pgmap v332: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:55:17.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:16 smithi161 ceph-mon[32696]: osdmap e95: 12 total, 12 up, 12 in 2024-04-25T13:55:17.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:16 smithi043 ceph-mon[29195]: pgmap v332: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:55:17.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:16 smithi043 ceph-mon[29195]: osdmap e95: 12 total, 12 up, 12 in 2024-04-25T13:55:18.144 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T13:55:18.145 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T13:55:18.145 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 233, 2024-04-25T13:55:18.145 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 222, 2024-04-25T13:55:18.145 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1690544, 2024-04-25T13:55:18.145 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 136384, 2024-04-25T13:55:18.145 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 4, 2024-04-25T13:55:18.145 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 0, 2024-04-25T13:55:18.145 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.054603626, 2024-04-25T13:55:18.145 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.013929043, 2024-04-25T13:55:18.145 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.047490804, 2024-04-25T13:55:18.145 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.005557765, 2024-04-25T13:55:18.145 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:18.145 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 221, 2024-04-25T13:55:18.145 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.012578405, 2024-04-25T13:55:18.145 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000056915 2024-04-25T13:55:18.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:18.146 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:18.146 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:18.146 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:18.146 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:18.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:18.146 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1690544, 2024-04-25T13:55:18.146 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 136384 2024-04-25T13:55:18.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:18.146 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T13:55:18.146 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 2, 2024-04-25T13:55:18.146 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 170, 2024-04-25T13:55:18.147 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 320, 2024-04-25T13:55:18.147 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 187024, 2024-04-25T13:55:18.147 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 5, 2024-04-25T13:55:18.147 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 3, 2024-04-25T13:55:18.147 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.012247842, 2024-04-25T13:55:18.147 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.008286089, 2024-04-25T13:55:18.147 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.001545539, 2024-04-25T13:55:18.147 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T13:55:18.147 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:18.147 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 167, 2024-04-25T13:55:18.147 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.013803465, 2024-04-25T13:55:18.147 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000082655 2024-04-25T13:55:18.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:18.147 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:18.148 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:18.148 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:18.148 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:18.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:18.148 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T13:55:18.148 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 187024 2024-04-25T13:55:18.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:18.148 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T13:55:18.148 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 4, 2024-04-25T13:55:18.148 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 4, 2024-04-25T13:55:18.148 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 2992, 2024-04-25T13:55:18.148 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 448, 2024-04-25T13:55:18.148 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 2, 2024-04-25T13:55:18.148 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 1, 2024-04-25T13:55:18.148 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.000702370, 2024-04-25T13:55:18.148 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.000038135, 2024-04-25T13:55:18.149 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.000668680, 2024-04-25T13:55:18.149 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T13:55:18.149 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T13:55:18.149 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3, 2024-04-25T13:55:18.149 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000783770, 2024-04-25T13:55:18.149 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000261256 2024-04-25T13:55:18.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:18.149 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-04-25T13:55:18.149 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:18.149 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:18.149 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:18.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:18.149 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-25T13:55:18.149 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 448 2024-04-25T13:55:18.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:18.150 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-04-25T13:55:18.150 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 0, 2024-04-25T13:55:18.150 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-04-25T13:55:18.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:18.150 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-04-25T13:55:18.150 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-04-25T13:55:18.150 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-04-25T13:55:18.150 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T13:55:18.150 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-04-25T13:55:18.150 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T13:55:18.150 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-04-25T13:55:18.150 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T13:55:18.150 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T13:55:18.150 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T13:55:18.151 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T13:55:18.151 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T13:55:18.151 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-04-25T13:55:18.151 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T13:55:18.151 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T13:55:18.151 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-04-25T13:55:18.151 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-04-25T13:55:18.151 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-04-25T13:55:18.151 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-04-25T13:55:18.151 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T13:55:18.151 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T13:55:18.151 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T13:55:18.151 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T13:55:18.151 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T13:55:18.151 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-04-25T13:55:18.152 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-04-25T13:55:18.152 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-04-25T13:55:18.152 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T13:55:18.152 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T13:55:18.152 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-04-25T13:55:18.152 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-04-25T13:55:18.152 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-04-25T13:55:18.152 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-04-25T13:55:18.152 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T13:55:18.152 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-04-25T13:55:18.152 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T13:55:18.152 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-04-25T13:55:18.153 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 148744, 2024-04-25T13:55:18.153 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 30, 2024-04-25T13:55:18.153 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-04-25T13:55:18.153 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-04-25T13:55:18.153 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-04-25T13:55:18.153 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-04-25T13:55:18.153 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-04-25T13:55:18.153 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-04-25T13:55:18.153 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-04-25T13:55:18.153 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-04-25T13:55:18.153 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 0, 2024-04-25T13:55:18.153 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 0, 2024-04-25T13:55:18.153 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T13:55:18.153 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-04-25T13:55:18.153 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-04-25T13:55:18.154 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-04-25T13:55:18.154 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 928, 2024-04-25T13:55:18.154 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 2, 2024-04-25T13:55:18.154 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-04-25T13:55:18.154 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-04-25T13:55:18.154 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-04-25T13:55:18.154 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-04-25T13:55:18.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T13:55:18.154 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T13:55:18.154 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-04-25T13:55:18.154 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-04-25T13:55:18.154 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-04-25T13:55:18.154 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 235, 2024-04-25T13:55:18.155 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 1657673, 2024-04-25T13:55:18.155 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-04-25T13:55:18.155 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 235, 2024-04-25T13:55:18.155 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-04-25T13:55:18.155 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-04-25T13:55:18.155 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 235, 2024-04-25T13:55:18.155 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1657673, 2024-04-25T13:55:18.155 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-04-25T13:55:18.155 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-04-25T13:55:18.155 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-04-25T13:55:18.155 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-04-25T13:55:18.155 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:18.155 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T13:55:18.155 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T13:55:18.916 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-04-25T13:55:18.916 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-04-25T13:55:18.917 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-04-25T13:55:18.917 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-04-25T13:55:18.917 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-04-25T13:55:18.917 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-04-25T13:55:18.917 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-04-25T13:55:18.917 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T13:55:18.926 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T13:55:18.927 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:55:18.927 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:55:18.947 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:55:18.947 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:55:19.007 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:55:19.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.176+0000 7fe7f4314640 1 -- 172.21.15.43:0/1887274588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ec108a40 msgr2=0x7fe7ec102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:19.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.176+0000 7fe7f4314640 1 --2- 172.21.15.43:0/1887274588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ec108a40 0x7fe7ec102ca0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8009900 tx=0x7fe7e802a480 comp rx=0 tx=0).stop 2024-04-25T13:55:19.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.176+0000 7fe7f4314640 1 -- 172.21.15.43:0/1887274588 shutdown_connections 2024-04-25T13:55:19.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.176+0000 7fe7f4314640 1 --2- 172.21.15.43:0/1887274588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7ec103890 0x7fe7ec10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.176+0000 7fe7f4314640 1 --2- 172.21.15.43:0/1887274588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7ec108e50 0x7fe7ec103200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.176+0000 7fe7f4314640 1 --2- 172.21.15.43:0/1887274588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ec108a40 0x7fe7ec102ca0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.176+0000 7fe7f4314640 1 -- 172.21.15.43:0/1887274588 >> 172.21.15.43:0/1887274588 conn(0x7fe7ec0fd840 msgr2=0x7fe7ec0ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:19.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.176+0000 7fe7f4314640 1 -- 172.21.15.43:0/1887274588 shutdown_connections 2024-04-25T13:55:19.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.176+0000 7fe7f4314640 1 -- 172.21.15.43:0/1887274588 wait complete. 2024-04-25T13:55:19.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f4314640 1 Processor -- start 2024-04-25T13:55:19.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f4314640 1 -- start start 2024-04-25T13:55:19.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f4314640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7ec108a40 0x7fe7ec0fdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:19.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f4314640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7ec108e50 0x7fe7ec0fe260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:19.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f4314640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ec0fe7a0 0x7fe7ec1a8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:19.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f4314640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec112ab0 con 0x7fe7ec0fe7a0 2024-04-25T13:55:19.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f4314640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec112930 con 0x7fe7ec108a40 2024-04-25T13:55:19.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f4314640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec112c30 con 0x7fe7ec108e50 2024-04-25T13:55:19.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f28b1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ec0fe7a0 0x7fe7ec1a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:19.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f28b1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ec0fe7a0 0x7fe7ec1a8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51882/0 (socket says 172.21.15.43:51882) 2024-04-25T13:55:19.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f28b1640 1 -- 172.21.15.43:0/3918255821 learned_addr learned my addr 172.21.15.43:0/3918255821 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:19.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f20b0640 1 --2- 172.21.15.43:0/3918255821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7ec108a40 0x7fe7ec0fdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:19.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f18af640 1 --2- 172.21.15.43:0/3918255821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7ec108e50 0x7fe7ec0fe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:19.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f28b1640 1 -- 172.21.15.43:0/3918255821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7ec108e50 msgr2=0x7fe7ec0fe260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:19.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f28b1640 1 --2- 172.21.15.43:0/3918255821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7ec108e50 0x7fe7ec0fe260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f28b1640 1 -- 172.21.15.43:0/3918255821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7ec108a40 msgr2=0x7fe7ec0fdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:19.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.177+0000 7fe7f28b1640 1 --2- 172.21.15.43:0/3918255821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7ec108a40 0x7fe7ec0fdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.178+0000 7fe7f28b1640 1 -- 172.21.15.43:0/3918255821 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ec1a8a30 con 0x7fe7ec0fe7a0 2024-04-25T13:55:19.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.178+0000 7fe7f28b1640 1 --2- 172.21.15.43:0/3918255821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ec0fe7a0 0x7fe7ec1a8470 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400eb10 tx=0x7fe7e400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:19.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.178+0000 7fe7e37fe640 1 -- 172.21.15.43:0/3918255821 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4004b20 con 0x7fe7ec0fe7a0 2024-04-25T13:55:19.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.178+0000 7fe7e37fe640 1 -- 172.21.15.43:0/3918255821 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7e4004cc0 con 0x7fe7ec0fe7a0 2024-04-25T13:55:19.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.178+0000 7fe7f4314640 1 -- 172.21.15.43:0/3918255821 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ec1a8d20 con 0x7fe7ec0fe7a0 2024-04-25T13:55:19.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.178+0000 7fe7e37fe640 1 -- 172.21.15.43:0/3918255821 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4010690 con 0x7fe7ec0fe7a0 2024-04-25T13:55:19.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.178+0000 7fe7f4314640 1 -- 172.21.15.43:0/3918255821 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ec1a91c0 con 0x7fe7ec0fe7a0 2024-04-25T13:55:19.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.179+0000 7fe7f4314640 1 -- 172.21.15.43:0/3918255821 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ec06a190 con 0x7fe7ec0fe7a0 2024-04-25T13:55:19.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:18 smithi175 ceph-mon[32649]: pgmap v334: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 207 B/s wr, 6 op/s 2024-04-25T13:55:19.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.181+0000 7fe7e37fe640 1 -- 172.21.15.43:0/3918255821 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7fe7e4005000 con 0x7fe7ec0fe7a0 2024-04-25T13:55:19.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.182+0000 7fe7e37fe640 1 --2- 172.21.15.43:0/3918255821 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe7d80afc60 0x7fe7d80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:19.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.182+0000 7fe7e37fe640 1 -- 172.21.15.43:0/3918255821 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9467+0+0 (secure 0 0 0) 0x7fe7e40dfc80 con 0x7fe7ec0fe7a0 2024-04-25T13:55:19.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.182+0000 7fe7f20b0640 1 --2- 172.21.15.43:0/3918255821 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe7d80afc60 0x7fe7d80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:19.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.183+0000 7fe7f20b0640 1 --2- 172.21.15.43:0/3918255821 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe7d80afc60 0x7fe7d80b2170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8004770 tx=0x7fe7e80058d0 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:19.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.186+0000 7fe7e37fe640 1 -- 172.21.15.43:0/3918255821 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe7e4053ff0 con 0x7fe7ec0fe7a0 2024-04-25T13:55:19.263 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:18 smithi043 ceph-mon[29195]: pgmap v334: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 207 B/s wr, 6 op/s 2024-04-25T13:55:19.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:18 smithi161 ceph-mon[32696]: pgmap v334: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 207 B/s wr, 6 op/s 2024-04-25T13:55:19.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.375+0000 7fe7f4314640 1 -- 172.21.15.43:0/3918255821 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7ec1a9520 con 0x7fe7ec0fe7a0 2024-04-25T13:55:19.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.376+0000 7fe7e37fe640 1 -- 172.21.15.43:0/3918255821 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+25250 (secure 0 0 0) 0x7fe7e40a8110 con 0x7fe7ec0fe7a0 2024-04-25T13:55:19.376 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:55:19.377 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":95,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:55:16.905528+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":94,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":94,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/2028903966":"2024-04-26T13:44:35.638372+0000","172.21.15.43:0/21237256":"2024-04-26T13:44:35.638372+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1369825389":"2024-04-26T13:44:35.638372+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/2307776489":"2024-04-26T13:44:35.638372+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/2478639579":"2024-04-26T13:44:35.638372+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6800/2478639579":"2024-04-26T13:44:35.638372+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:55:19.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.379+0000 7fe7f4314640 1 -- 172.21.15.43:0/3918255821 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe7d80afc60 msgr2=0x7fe7d80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:19.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.379+0000 7fe7f4314640 1 --2- 172.21.15.43:0/3918255821 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe7d80afc60 0x7fe7d80b2170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8004770 tx=0x7fe7e80058d0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.379+0000 7fe7f4314640 1 -- 172.21.15.43:0/3918255821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ec0fe7a0 msgr2=0x7fe7ec1a8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:19.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.379+0000 7fe7f4314640 1 --2- 172.21.15.43:0/3918255821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ec0fe7a0 0x7fe7ec1a8470 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400eb10 tx=0x7fe7e400c2d0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.379+0000 7fe7f4314640 1 -- 172.21.15.43:0/3918255821 shutdown_connections 2024-04-25T13:55:19.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.379+0000 7fe7f4314640 1 --2- 172.21.15.43:0/3918255821 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe7d80afc60 0x7fe7d80b2170 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.379+0000 7fe7f4314640 1 --2- 172.21.15.43:0/3918255821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ec0fe7a0 0x7fe7ec1a8470 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.379+0000 7fe7f4314640 1 --2- 172.21.15.43:0/3918255821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7ec108e50 0x7fe7ec0fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.379+0000 7fe7f4314640 1 --2- 172.21.15.43:0/3918255821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7ec108a40 0x7fe7ec0fdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.379+0000 7fe7f4314640 1 -- 172.21.15.43:0/3918255821 >> 172.21.15.43:0/3918255821 conn(0x7fe7ec0fd840 msgr2=0x7fe7ec0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:19.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.379+0000 7fe7f4314640 1 -- 172.21.15.43:0/3918255821 shutdown_connections 2024-04-25T13:55:19.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.379+0000 7fe7f4314640 1 -- 172.21.15.43:0/3918255821 wait complete. 2024-04-25T13:55:19.391 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:37:25.931659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:06.202688+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:07.348534+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 94, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:42:11.056739+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 94, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:55:19.391 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:55:19.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.508+0000 7fadec56c640 1 -- 172.21.15.43:0/866462705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fade4109fd0 msgr2=0x7fade4103c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:19.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.508+0000 7fadec56c640 1 --2- 172.21.15.43:0/866462705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fade4109fd0 0x7fade4103c60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fade0009900 tx=0x7fade002a410 comp rx=0 tx=0).stop 2024-04-25T13:55:19.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.508+0000 7fadec56c640 1 -- 172.21.15.43:0/866462705 shutdown_connections 2024-04-25T13:55:19.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.508+0000 7fadec56c640 1 --2- 172.21.15.43:0/866462705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fade41042d0 0x7fade4110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.508+0000 7fadec56c640 1 --2- 172.21.15.43:0/866462705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fade4109fd0 0x7fade4103c60 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.508+0000 7fadec56c640 1 --2- 172.21.15.43:0/866462705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade4109b30 0x7fade4103720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.508+0000 7fadec56c640 1 -- 172.21.15.43:0/866462705 >> 172.21.15.43:0/866462705 conn(0x7fade4079280 msgr2=0x7fade40796c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:19.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.508+0000 7fadec56c640 1 -- 172.21.15.43:0/866462705 shutdown_connections 2024-04-25T13:55:19.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.508+0000 7fadec56c640 1 -- 172.21.15.43:0/866462705 wait complete. 2024-04-25T13:55:19.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.509+0000 7fadec56c640 1 Processor -- start 2024-04-25T13:55:19.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.509+0000 7fadec56c640 1 -- start start 2024-04-25T13:55:19.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.509+0000 7fadec56c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fade41042d0 0x7fade419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:19.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.509+0000 7fadec56c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade4109b30 0x7fade419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:19.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.509+0000 7fadec56c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fade4109fd0 0x7fade41a8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:19.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.509+0000 7fadec56c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fade4113bd0 con 0x7fade41042d0 2024-04-25T13:55:19.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.509+0000 7fadec56c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fade4113a50 con 0x7fade4109fd0 2024-04-25T13:55:19.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.509+0000 7fadec56c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fade4113d50 con 0x7fade4109b30 2024-04-25T13:55:19.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.509+0000 7fadea308640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fade41042d0 0x7fade419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:19.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.509+0000 7fadea308640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fade41042d0 0x7fade419d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51892/0 (socket says 172.21.15.43:51892) 2024-04-25T13:55:19.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.509+0000 7fadea308640 1 -- 172.21.15.43:0/2345627193 learned_addr learned my addr 172.21.15.43:0/2345627193 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:19.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.509+0000 7fade9b07640 1 --2- 172.21.15.43:0/2345627193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade4109b30 0x7fade419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:19.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.509+0000 7fadeab09640 1 --2- 172.21.15.43:0/2345627193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fade4109fd0 0x7fade41a8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:19.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.509+0000 7fadea308640 1 -- 172.21.15.43:0/2345627193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade4109b30 msgr2=0x7fade419dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:19.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.510+0000 7fadea308640 1 --2- 172.21.15.43:0/2345627193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade4109b30 0x7fade419dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.510+0000 7fadea308640 1 -- 172.21.15.43:0/2345627193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fade4109fd0 msgr2=0x7fade41a8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:19.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.510+0000 7fadea308640 1 --2- 172.21.15.43:0/2345627193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fade4109fd0 0x7fade41a8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.510+0000 7fadea308640 1 -- 172.21.15.43:0/2345627193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade41a8aa0 con 0x7fade41042d0 2024-04-25T13:55:19.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.510+0000 7fade9b07640 1 --2- 172.21.15.43:0/2345627193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade4109b30 0x7fade419dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:55:19.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.510+0000 7fadea308640 1 --2- 172.21.15.43:0/2345627193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fade41042d0 0x7fade419d670 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fadd800d7a0 tx=0x7fadd800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:19.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.510+0000 7fadd77fe640 1 -- 172.21.15.43:0/2345627193 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8017070 con 0x7fade41042d0 2024-04-25T13:55:19.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.510+0000 7fadd77fe640 1 -- 172.21.15.43:0/2345627193 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadd8009c30 con 0x7fade41042d0 2024-04-25T13:55:19.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.510+0000 7fadec56c640 1 -- 172.21.15.43:0/2345627193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade41a8d90 con 0x7fade41042d0 2024-04-25T13:55:19.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.510+0000 7fadd77fe640 1 -- 172.21.15.43:0/2345627193 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd800f620 con 0x7fade41042d0 2024-04-25T13:55:19.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.510+0000 7fadec56c640 1 -- 172.21.15.43:0/2345627193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade41a91f0 con 0x7fade41042d0 2024-04-25T13:55:19.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.511+0000 7fadec56c640 1 -- 172.21.15.43:0/2345627193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade4104e10 con 0x7fade41042d0 2024-04-25T13:55:19.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.513+0000 7fadd77fe640 1 -- 172.21.15.43:0/2345627193 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7fadd801a070 con 0x7fade41042d0 2024-04-25T13:55:19.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.514+0000 7fadd77fe640 1 --2- 172.21.15.43:0/2345627193 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fadd00afc60 0x7fadd00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:19.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.514+0000 7fade9b07640 1 --2- 172.21.15.43:0/2345627193 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fadd00afc60 0x7fadd00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:19.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.514+0000 7fadd77fe640 1 -- 172.21.15.43:0/2345627193 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9467+0+0 (secure 0 0 0) 0x7fadd80deee0 con 0x7fade41042d0 2024-04-25T13:55:19.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.514+0000 7fade9b07640 1 --2- 172.21.15.43:0/2345627193 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fadd00afc60 0x7fadd00b2170 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fade00057c0 tx=0x7fade0009680 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:19.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.518+0000 7fadd77fe640 1 -- 172.21.15.43:0/2345627193 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fadd8010e20 con 0x7fade41042d0 2024-04-25T13:55:19.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.704+0000 7fadec56c640 1 -- 172.21.15.43:0/2345627193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fade41a9450 con 0x7fade41042d0 2024-04-25T13:55:19.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.704+0000 7fadd77fe640 1 -- 172.21.15.43:0/2345627193 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7fadd80a73d0 con 0x7fade41042d0 2024-04-25T13:55:19.704 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T13:55:19.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.706+0000 7fadec56c640 1 -- 172.21.15.43:0/2345627193 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fadd00afc60 msgr2=0x7fadd00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:19.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.706+0000 7fadec56c640 1 --2- 172.21.15.43:0/2345627193 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fadd00afc60 0x7fadd00b2170 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fade00057c0 tx=0x7fade0009680 comp rx=0 tx=0).stop 2024-04-25T13:55:19.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.706+0000 7fadec56c640 1 -- 172.21.15.43:0/2345627193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fade41042d0 msgr2=0x7fade419d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:19.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.706+0000 7fadec56c640 1 --2- 172.21.15.43:0/2345627193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fade41042d0 0x7fade419d670 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fadd800d7a0 tx=0x7fadd800dc60 comp rx=0 tx=0).stop 2024-04-25T13:55:19.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.706+0000 7fadec56c640 1 -- 172.21.15.43:0/2345627193 shutdown_connections 2024-04-25T13:55:19.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.706+0000 7fadec56c640 1 --2- 172.21.15.43:0/2345627193 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fadd00afc60 0x7fadd00b2170 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.706+0000 7fadec56c640 1 --2- 172.21.15.43:0/2345627193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fade4109fd0 0x7fade41a8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.706+0000 7fadec56c640 1 --2- 172.21.15.43:0/2345627193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade4109b30 0x7fade419dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.706+0000 7fadec56c640 1 --2- 172.21.15.43:0/2345627193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fade41042d0 0x7fade419d670 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.706+0000 7fadec56c640 1 -- 172.21.15.43:0/2345627193 >> 172.21.15.43:0/2345627193 conn(0x7fade4079280 msgr2=0x7fade4100290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:19.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.706+0000 7fadec56c640 1 -- 172.21.15.43:0/2345627193 shutdown_connections 2024-04-25T13:55:19.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.706+0000 7fadec56c640 1 -- 172.21.15.43:0/2345627193 wait complete. 2024-04-25T13:55:19.718 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:55:19.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.939+0000 7f3524a4c640 1 -- 172.21.15.43:0/3272960888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f352010d3a0 msgr2=0x7f352010f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:19.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.939+0000 7f3524a4c640 1 --2- 172.21.15.43:0/3272960888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f352010d3a0 0x7f352010f7c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3518009ca0 tx=0x7f351802a8c0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.939+0000 7f3524a4c640 1 -- 172.21.15.43:0/3272960888 shutdown_connections 2024-04-25T13:55:19.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.939+0000 7f3524a4c640 1 --2- 172.21.15.43:0/3272960888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f352010d3a0 0x7f352010f7c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.939+0000 7f3524a4c640 1 --2- 172.21.15.43:0/3272960888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3520102b10 0x7f3520102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.939+0000 7f3524a4c640 1 --2- 172.21.15.43:0/3272960888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3520108a40 0x7f35201025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.939+0000 7f3524a4c640 1 -- 172.21.15.43:0/3272960888 >> 172.21.15.43:0/3272960888 conn(0x7f3520078180 msgr2=0x7f35200785c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:19.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.939+0000 7f3524a4c640 1 -- 172.21.15.43:0/3272960888 shutdown_connections 2024-04-25T13:55:19.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.940+0000 7f3524a4c640 1 -- 172.21.15.43:0/3272960888 wait complete. 2024-04-25T13:55:19.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.940+0000 7f3524a4c640 1 Processor -- start 2024-04-25T13:55:19.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.940+0000 7f3524a4c640 1 -- start start 2024-04-25T13:55:19.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f3524a4c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3520102b10 0x7f352019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:19.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f3524a4c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3520108a40 0x7f352019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:19.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f3524a4c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f352010d3a0 0x7f352019edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:19.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f3524a4c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3520112b20 con 0x7f3520102b10 2024-04-25T13:55:19.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f3524a4c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f35201129a0 con 0x7f3520108a40 2024-04-25T13:55:19.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f3524a4c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3520112ca0 con 0x7f352010d3a0 2024-04-25T13:55:19.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f351e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3520102b10 0x7f352019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:19.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f351e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3520102b10 0x7f352019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39966/0 (socket says 172.21.15.43:39966) 2024-04-25T13:55:19.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f351e59c640 1 -- 172.21.15.43:0/2141735952 learned_addr learned my addr 172.21.15.43:0/2141735952 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:19.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f351dd9b640 1 --2- 172.21.15.43:0/2141735952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3520108a40 0x7f352019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:19.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f351ed9d640 1 --2- 172.21.15.43:0/2141735952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f352010d3a0 0x7f352019edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:19.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f351e59c640 1 -- 172.21.15.43:0/2141735952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f352010d3a0 msgr2=0x7f352019edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:19.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f351e59c640 1 --2- 172.21.15.43:0/2141735952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f352010d3a0 0x7f352019edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f351e59c640 1 -- 172.21.15.43:0/2141735952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3520108a40 msgr2=0x7f352019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:19.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f351e59c640 1 --2- 172.21.15.43:0/2141735952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3520108a40 0x7f352019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:19.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f351e59c640 1 -- 172.21.15.43:0/2141735952 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352019f3f0 con 0x7f3520102b10 2024-04-25T13:55:19.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f351e59c640 1 --2- 172.21.15.43:0/2141735952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3520102b10 0x7f352019a590 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f351000d740 tx=0x7f351000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:19.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.941+0000 7f350f7fe640 1 -- 172.21.15.43:0/2141735952 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3510017070 con 0x7f3520102b10 2024-04-25T13:55:19.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.942+0000 7f350f7fe640 1 -- 172.21.15.43:0/2141735952 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f351000de50 con 0x7f3520102b10 2024-04-25T13:55:19.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.942+0000 7f3524a4c640 1 -- 172.21.15.43:0/2141735952 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f352019f6e0 con 0x7f3520102b10 2024-04-25T13:55:19.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.942+0000 7f350f7fe640 1 -- 172.21.15.43:0/2141735952 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3510004c60 con 0x7f3520102b10 2024-04-25T13:55:19.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.942+0000 7f3524a4c640 1 -- 172.21.15.43:0/2141735952 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f352019fbe0 con 0x7f3520102b10 2024-04-25T13:55:19.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.943+0000 7f3524a4c640 1 -- 172.21.15.43:0/2141735952 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35200692e0 con 0x7f3520102b10 2024-04-25T13:55:19.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.944+0000 7f350f7fe640 1 -- 172.21.15.43:0/2141735952 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7f3510004e00 con 0x7f3520102b10 2024-04-25T13:55:19.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.945+0000 7f350f7fe640 1 --2- 172.21.15.43:0/2141735952 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f35080afc60 0x7f35080b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:19.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.945+0000 7f351dd9b640 1 --2- 172.21.15.43:0/2141735952 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f35080afc60 0x7f35080b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:19.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.945+0000 7f350f7fe640 1 -- 172.21.15.43:0/2141735952 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9467+0+0 (secure 0 0 0) 0x7f35100df1b0 con 0x7f3520102b10 2024-04-25T13:55:19.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.946+0000 7f351dd9b640 1 --2- 172.21.15.43:0/2141735952 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f35080afc60 0x7f35080b2170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f352010f980 tx=0x7f3514005f90 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:19.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:19.949+0000 7f350f7fe640 1 -- 172.21.15.43:0/2141735952 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f352019fbe0 con 0x7f3520102b10 2024-04-25T13:55:20.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.139+0000 7f3524a4c640 1 -- 172.21.15.43:0/2141735952 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f35201a70f0 con 0x7f3520102b10 2024-04-25T13:55:20.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.139+0000 7f350f7fe640 1 -- 172.21.15.43:0/2141735952 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) ==== 104+0+11 (secure 0 0 0) 0x7f35100a76a0 con 0x7f3520102b10 2024-04-25T13:55:20.139 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:55:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.142+0000 7f3524a4c640 1 -- 172.21.15.43:0/2141735952 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f35080afc60 msgr2=0x7f35080b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.142+0000 7f3524a4c640 1 --2- 172.21.15.43:0/2141735952 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f35080afc60 0x7f35080b2170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f352010f980 tx=0x7f3514005f90 comp rx=0 tx=0).stop 2024-04-25T13:55:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.142+0000 7f3524a4c640 1 -- 172.21.15.43:0/2141735952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3520102b10 msgr2=0x7f352019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.142+0000 7f3524a4c640 1 --2- 172.21.15.43:0/2141735952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3520102b10 0x7f352019a590 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f351000d740 tx=0x7f351000dc00 comp rx=0 tx=0).stop 2024-04-25T13:55:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.142+0000 7f3524a4c640 1 -- 172.21.15.43:0/2141735952 shutdown_connections 2024-04-25T13:55:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.142+0000 7f3524a4c640 1 --2- 172.21.15.43:0/2141735952 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f35080afc60 0x7f35080b2170 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.142+0000 7f3524a4c640 1 --2- 172.21.15.43:0/2141735952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f352010d3a0 0x7f352019edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.142+0000 7f3524a4c640 1 --2- 172.21.15.43:0/2141735952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3520108a40 0x7f352019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.142+0000 7f3524a4c640 1 --2- 172.21.15.43:0/2141735952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3520102b10 0x7f352019a590 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.142+0000 7f3524a4c640 1 -- 172.21.15.43:0/2141735952 >> 172.21.15.43:0/2141735952 conn(0x7f3520078180 msgr2=0x7f352006b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.142+0000 7f3524a4c640 1 -- 172.21.15.43:0/2141735952 shutdown_connections 2024-04-25T13:55:20.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.142+0000 7f3524a4c640 1 -- 172.21.15.43:0/2141735952 wait complete. 2024-04-25T13:55:20.153 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:55:20.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.269+0000 7fdfca215640 1 -- 172.21.15.43:0/1575712405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfc410e040 msgr2=0x7fdfc4110530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:20.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.269+0000 7fdfca215640 1 --2- 172.21.15.43:0/1575712405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfc410e040 0x7fdfc4110530 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009ca0 tx=0x7fdfbc02a8c0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.269+0000 7fdfca215640 1 -- 172.21.15.43:0/1575712405 shutdown_connections 2024-04-25T13:55:20.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.269+0000 7fdfca215640 1 --2- 172.21.15.43:0/1575712405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfc410e040 0x7fdfc4110530 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.269+0000 7fdfca215640 1 --2- 172.21.15.43:0/1575712405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfc410b650 0x7fdfc410da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.269+0000 7fdfca215640 1 --2- 172.21.15.43:0/1575712405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc4104bf0 0x7fdfc4105000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.269+0000 7fdfca215640 1 -- 172.21.15.43:0/1575712405 >> 172.21.15.43:0/1575712405 conn(0x7fdfc4078100 msgr2=0x7fdfc4078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:20.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.269+0000 7fdfca215640 1 -- 172.21.15.43:0/1575712405 shutdown_connections 2024-04-25T13:55:20.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.269+0000 7fdfca215640 1 -- 172.21.15.43:0/1575712405 wait complete. 2024-04-25T13:55:20.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.270+0000 7fdfca215640 1 Processor -- start 2024-04-25T13:55:20.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.270+0000 7fdfca215640 1 -- start start 2024-04-25T13:55:20.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.270+0000 7fdfca215640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfc4104bf0 0x7fdfc419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:20.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.270+0000 7fdfca215640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfc410b650 0x7fdfc419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:20.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.270+0000 7fdfca215640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc410e040 0x7fdfc419ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:20.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.270+0000 7fdfca215640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4113ba0 con 0x7fdfc4104bf0 2024-04-25T13:55:20.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.270+0000 7fdfca215640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4113a20 con 0x7fdfc410e040 2024-04-25T13:55:20.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.270+0000 7fdfca215640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4113d20 con 0x7fdfc410b650 2024-04-25T13:55:20.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.270+0000 7fdfc37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfc4104bf0 0x7fdfc419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:20.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.270+0000 7fdfc37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfc4104bf0 0x7fdfc419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39978/0 (socket says 172.21.15.43:39978) 2024-04-25T13:55:20.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.270+0000 7fdfc37fe640 1 -- 172.21.15.43:0/1527140828 learned_addr learned my addr 172.21.15.43:0/1527140828 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:20.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.271+0000 7fdfc2ffd640 1 --2- 172.21.15.43:0/1527140828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfc410b650 0x7fdfc419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:20.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.271+0000 7fdfc3fff640 1 --2- 172.21.15.43:0/1527140828 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc410e040 0x7fdfc419ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:20.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.271+0000 7fdfc37fe640 1 -- 172.21.15.43:0/1527140828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfc410b650 msgr2=0x7fdfc419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:20.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.271+0000 7fdfc37fe640 1 --2- 172.21.15.43:0/1527140828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfc410b650 0x7fdfc419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.271+0000 7fdfc37fe640 1 -- 172.21.15.43:0/1527140828 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc410e040 msgr2=0x7fdfc419ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:20.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.271+0000 7fdfc37fe640 1 --2- 172.21.15.43:0/1527140828 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc410e040 0x7fdfc419ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.271+0000 7fdfc37fe640 1 -- 172.21.15.43:0/1527140828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc419f3a0 con 0x7fdfc4104bf0 2024-04-25T13:55:20.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.271+0000 7fdfc37fe640 1 --2- 172.21.15.43:0/1527140828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfc4104bf0 0x7fdfc419a5c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00c950 tx=0x7fdfac00ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:20.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.271+0000 7fdfc0ff9640 1 -- 172.21.15.43:0/1527140828 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac007c70 con 0x7fdfc4104bf0 2024-04-25T13:55:20.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.271+0000 7fdfca215640 1 -- 172.21.15.43:0/1527140828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc419f690 con 0x7fdfc4104bf0 2024-04-25T13:55:20.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.271+0000 7fdfc0ff9640 1 -- 172.21.15.43:0/1527140828 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdfac007e10 con 0x7fdfc4104bf0 2024-04-25T13:55:20.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.271+0000 7fdfca215640 1 -- 172.21.15.43:0/1527140828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc41a7090 con 0x7fdfc4104bf0 2024-04-25T13:55:20.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.271+0000 7fdfc0ff9640 1 -- 172.21.15.43:0/1527140828 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac018740 con 0x7fdfc4104bf0 2024-04-25T13:55:20.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.272+0000 7fdfca215640 1 -- 172.21.15.43:0/1527140828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc406afa0 con 0x7fdfc4104bf0 2024-04-25T13:55:20.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.274+0000 7fdfc0ff9640 1 -- 172.21.15.43:0/1527140828 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7fdfac018980 con 0x7fdfc4104bf0 2024-04-25T13:55:20.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.274+0000 7fdfc0ff9640 1 --2- 172.21.15.43:0/1527140828 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdfb00afc60 0x7fdfb00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:20.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.274+0000 7fdfc2ffd640 1 --2- 172.21.15.43:0/1527140828 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdfb00afc60 0x7fdfb00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:20.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.275+0000 7fdfc0ff9640 1 -- 172.21.15.43:0/1527140828 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9467+0+0 (secure 0 0 0) 0x7fdfac0df4c0 con 0x7fdfc4104bf0 2024-04-25T13:55:20.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.275+0000 7fdfc2ffd640 1 --2- 172.21.15.43:0/1527140828 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdfb00afc60 0x7fdfb00b2170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdfc410e8e0 tx=0x7fdfb4005f90 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:20.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.283+0000 7fdfc0ff9640 1 -- 172.21.15.43:0/1527140828 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdfac014030 con 0x7fdfc4104bf0 2024-04-25T13:55:20.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:19 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3918255821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:55:20.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:19 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2345627193' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:55:20.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:19 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3918255821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:55:20.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:19 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2345627193' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:55:20.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:19 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3918255821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:55:20.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:19 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2345627193' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:55:20.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.469+0000 7fdfca215640 1 -- 172.21.15.43:0/1527140828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdfc41a7260 con 0x7fdfc4104bf0 2024-04-25T13:55:20.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.470+0000 7fdfc0ff9640 1 -- 172.21.15.43:0/1527140828 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) ==== 100+0+11 (secure 0 0 0) 0x7fdfac0a7a50 con 0x7fdfc4104bf0 2024-04-25T13:55:20.470 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-25T13:55:20.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.471+0000 7fdfca215640 1 -- 172.21.15.43:0/1527140828 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdfb00afc60 msgr2=0x7fdfb00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.471+0000 7fdfca215640 1 --2- 172.21.15.43:0/1527140828 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdfb00afc60 0x7fdfb00b2170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdfc410e8e0 tx=0x7fdfb4005f90 comp rx=0 tx=0).stop 2024-04-25T13:55:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.471+0000 7fdfca215640 1 -- 172.21.15.43:0/1527140828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfc4104bf0 msgr2=0x7fdfc419a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.471+0000 7fdfca215640 1 --2- 172.21.15.43:0/1527140828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfc4104bf0 0x7fdfc419a5c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00c950 tx=0x7fdfac00ce10 comp rx=0 tx=0).stop 2024-04-25T13:55:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.472+0000 7fdfca215640 1 -- 172.21.15.43:0/1527140828 shutdown_connections 2024-04-25T13:55:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.472+0000 7fdfca215640 1 --2- 172.21.15.43:0/1527140828 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdfb00afc60 0x7fdfb00b2170 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.472+0000 7fdfca215640 1 --2- 172.21.15.43:0/1527140828 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc410e040 0x7fdfc419ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.472+0000 7fdfca215640 1 --2- 172.21.15.43:0/1527140828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfc410b650 0x7fdfc419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.472+0000 7fdfca215640 1 --2- 172.21.15.43:0/1527140828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfc4104bf0 0x7fdfc419a5c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.472+0000 7fdfca215640 1 -- 172.21.15.43:0/1527140828 >> 172.21.15.43:0/1527140828 conn(0x7fdfc4078100 msgr2=0x7fdfc4101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.472+0000 7fdfca215640 1 -- 172.21.15.43:0/1527140828 shutdown_connections 2024-04-25T13:55:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.472+0000 7fdfca215640 1 -- 172.21.15.43:0/1527140828 wait complete. 2024-04-25T13:55:20.483 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:55:20.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.598+0000 7fb29fd6c640 1 -- 172.21.15.43:0/1104132873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb298104c50 msgr2=0x7fb298105060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:20.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.598+0000 7fb29fd6c640 1 --2- 172.21.15.43:0/1104132873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb298104c50 0x7fb298105060 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009900 tx=0x7fb28c02a510 comp rx=0 tx=0).stop 2024-04-25T13:55:20.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.598+0000 7fb29fd6c640 1 -- 172.21.15.43:0/1104132873 shutdown_connections 2024-04-25T13:55:20.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.598+0000 7fb29fd6c640 1 --2- 172.21.15.43:0/1104132873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb29810e060 0x7fb298110550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.598+0000 7fb29fd6c640 1 --2- 172.21.15.43:0/1104132873 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb29810b6b0 0x7fb29810dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.598+0000 7fb29fd6c640 1 --2- 172.21.15.43:0/1104132873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb298104c50 0x7fb298105060 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.598+0000 7fb29fd6c640 1 -- 172.21.15.43:0/1104132873 >> 172.21.15.43:0/1104132873 conn(0x7fb298078100 msgr2=0x7fb298078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:20.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.598+0000 7fb29fd6c640 1 -- 172.21.15.43:0/1104132873 shutdown_connections 2024-04-25T13:55:20.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.598+0000 7fb29fd6c640 1 -- 172.21.15.43:0/1104132873 wait complete. 2024-04-25T13:55:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.599+0000 7fb29fd6c640 1 Processor -- start 2024-04-25T13:55:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.599+0000 7fb29fd6c640 1 -- start start 2024-04-25T13:55:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.599+0000 7fb29fd6c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb298104c50 0x7fb29819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.599+0000 7fb29fd6c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb29810b6b0 0x7fb29819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.599+0000 7fb29fd6c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29810e060 0x7fb29819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.599+0000 7fb29fd6c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb298113b70 con 0x7fb29810e060 2024-04-25T13:55:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.599+0000 7fb29fd6c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fb2981139f0 con 0x7fb298104c50 2024-04-25T13:55:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.599+0000 7fb29fd6c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb298113cf0 con 0x7fb29810b6b0 2024-04-25T13:55:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.599+0000 7fb29e309640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29810e060 0x7fb29819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.599+0000 7fb29e309640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29810e060 0x7fb29819ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39996/0 (socket says 172.21.15.43:39996) 2024-04-25T13:55:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.599+0000 7fb29d307640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb29810b6b0 0x7fb29819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:20.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.599+0000 7fb29e309640 1 -- 172.21.15.43:0/2109852732 learned_addr learned my addr 172.21.15.43:0/2109852732 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:20.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.599+0000 7fb29db08640 1 --2- 172.21.15.43:0/2109852732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb298104c50 0x7fb29819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:20.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.600+0000 7fb29e309640 1 -- 172.21.15.43:0/2109852732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb29810b6b0 msgr2=0x7fb29819abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:20.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.600+0000 7fb29e309640 1 --2- 172.21.15.43:0/2109852732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb29810b6b0 0x7fb29819abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.600+0000 7fb29e309640 1 -- 172.21.15.43:0/2109852732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb298104c50 msgr2=0x7fb29819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:20.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.600+0000 7fb29e309640 1 --2- 172.21.15.43:0/2109852732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb298104c50 0x7fb29819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.600+0000 7fb29e309640 1 -- 172.21.15.43:0/2109852732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29819f4d0 con 0x7fb29810e060 2024-04-25T13:55:20.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.600+0000 7fb29d307640 1 --2- 172.21.15.43:0/2109852732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb29810b6b0 0x7fb29819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:55:20.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.600+0000 7fb29e309640 1 --2- 172.21.15.43:0/2109852732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29810e060 0x7fb29819ee90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb29000eb10 tx=0x7fb29000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:20.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.600+0000 7fb28affd640 1 -- 172.21.15.43:0/2109852732 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb290004b20 con 0x7fb29810e060 2024-04-25T13:55:20.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.600+0000 7fb29fd6c640 1 -- 172.21.15.43:0/2109852732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb29819f7c0 con 0x7fb29810e060 2024-04-25T13:55:20.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.600+0000 7fb28affd640 1 -- 172.21.15.43:0/2109852732 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb290004cc0 con 0x7fb29810e060 2024-04-25T13:55:20.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.600+0000 7fb28affd640 1 -- 172.21.15.43:0/2109852732 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb290010690 con 0x7fb29810e060 2024-04-25T13:55:20.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.600+0000 7fb29fd6c640 1 -- 172.21.15.43:0/2109852732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2981a7140 con 0x7fb29810e060 2024-04-25T13:55:20.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.601+0000 7fb29fd6c640 1 -- 172.21.15.43:0/2109852732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb29806afa0 con 0x7fb29810e060 2024-04-25T13:55:20.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.603+0000 7fb28affd640 1 -- 172.21.15.43:0/2109852732 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7fb290005000 con 0x7fb29810e060 2024-04-25T13:55:20.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.603+0000 7fb28affd640 1 --2- 172.21.15.43:0/2109852732 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fb2840afc60 0x7fb2840b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:20.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.603+0000 7fb28affd640 1 -- 172.21.15.43:0/2109852732 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9467+0+0 (secure 0 0 0) 0x7fb2900dfb00 con 0x7fb29810e060 2024-04-25T13:55:20.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.604+0000 7fb29db08640 1 --2- 172.21.15.43:0/2109852732 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fb2840afc60 0x7fb2840b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:20.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.604+0000 7fb29db08640 1 --2- 172.21.15.43:0/2109852732 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fb2840afc60 0x7fb2840b2170 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0057c0 tx=0x7fb28c0058d0 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:20.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.611+0000 7fb28affd640 1 -- 172.21.15.43:0/2109852732 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb290053ff0 con 0x7fb29810e060 2024-04-25T13:55:20.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.798+0000 7fb29fd6c640 1 -- 172.21.15.43:0/2109852732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb2981a7310 con 0x7fb29810e060 2024-04-25T13:55:20.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.799+0000 7fb28affd640 1 -- 172.21.15.43:0/2109852732 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v95) ==== 103+0+11 (secure 0 0 0) 0x7fb2900a7ff0 con 0x7fb29810e060 2024-04-25T13:55:20.799 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:55:20.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.801+0000 7fb29fd6c640 1 -- 172.21.15.43:0/2109852732 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fb2840afc60 msgr2=0x7fb2840b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:20.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.801+0000 7fb29fd6c640 1 --2- 172.21.15.43:0/2109852732 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fb2840afc60 0x7fb2840b2170 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0057c0 tx=0x7fb28c0058d0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.801+0000 7fb29fd6c640 1 -- 172.21.15.43:0/2109852732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29810e060 msgr2=0x7fb29819ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:20.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.801+0000 7fb29fd6c640 1 --2- 172.21.15.43:0/2109852732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29810e060 0x7fb29819ee90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb29000eb10 tx=0x7fb29000c2d0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.801+0000 7fb29fd6c640 1 -- 172.21.15.43:0/2109852732 shutdown_connections 2024-04-25T13:55:20.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.801+0000 7fb29fd6c640 1 --2- 172.21.15.43:0/2109852732 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fb2840afc60 0x7fb2840b2170 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.801+0000 7fb29fd6c640 1 --2- 172.21.15.43:0/2109852732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb29810e060 0x7fb29819ee90 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.801+0000 7fb29fd6c640 1 --2- 172.21.15.43:0/2109852732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb29810b6b0 0x7fb29819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.801+0000 7fb29fd6c640 1 --2- 172.21.15.43:0/2109852732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb298104c50 0x7fb29819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.801+0000 7fb29fd6c640 1 -- 172.21.15.43:0/2109852732 >> 172.21.15.43:0/2109852732 conn(0x7fb298078100 msgr2=0x7fb298101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:20.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.801+0000 7fb29fd6c640 1 -- 172.21.15.43:0/2109852732 shutdown_connections 2024-04-25T13:55:20.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.801+0000 7fb29fd6c640 1 -- 172.21.15.43:0/2109852732 wait complete. 2024-04-25T13:55:20.812 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:55:20.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.925+0000 7f387ebba640 1 -- 172.21.15.43:0/2445922181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3878108a20 msgr2=0x7f38781025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:20.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.925+0000 7f387ebba640 1 --2- 172.21.15.43:0/2445922181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3878108a20 0x7f38781025b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3860009900 tx=0x7f386002a410 comp rx=0 tx=0).stop 2024-04-25T13:55:20.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.925+0000 7f387ebba640 1 -- 172.21.15.43:0/2445922181 shutdown_connections 2024-04-25T13:55:20.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.925+0000 7f387ebba640 1 --2- 172.21.15.43:0/2445922181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f387810d380 0x7f387810f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.925+0000 7f387ebba640 1 --2- 172.21.15.43:0/2445922181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3878102af0 0x7f3878102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.925+0000 7f387ebba640 1 --2- 172.21.15.43:0/2445922181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3878108a20 0x7f38781025b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.925+0000 7f387ebba640 1 -- 172.21.15.43:0/2445922181 >> 172.21.15.43:0/2445922181 conn(0x7f3878078100 msgr2=0x7f3878078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:20.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.925+0000 7f387ebba640 1 -- 172.21.15.43:0/2445922181 shutdown_connections 2024-04-25T13:55:20.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.925+0000 7f387ebba640 1 -- 172.21.15.43:0/2445922181 wait complete. 2024-04-25T13:55:20.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f387ebba640 1 Processor -- start 2024-04-25T13:55:20.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f387ebba640 1 -- start start 2024-04-25T13:55:20.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f387ebba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3878102af0 0x7f387819b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:20.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f387ebba640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3878108a20 0x7f387819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:20.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f387ebba640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f387810d380 0x7f387819bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:20.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f387ebba640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3878112a90 con 0x7f3878108a20 2024-04-25T13:55:20.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f387ebba640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f3878112910 con 0x7f387810d380 2024-04-25T13:55:20.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f387ebba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3878112c10 con 0x7f3878102af0 2024-04-25T13:55:20.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f3877fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3878108a20 0x7f387819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:20.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f3877fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3878108a20 0x7f387819b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40016/0 (socket says 172.21.15.43:40016) 2024-04-25T13:55:20.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f3877fff640 1 -- 172.21.15.43:0/273316121 learned_addr learned my addr 172.21.15.43:0/273316121 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:20.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f387c956640 1 --2- 172.21.15.43:0/273316121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3878102af0 0x7f387819b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:20.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f387d157640 1 --2- 172.21.15.43:0/273316121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f387810d380 0x7f387819bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:20.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f3877fff640 1 -- 172.21.15.43:0/273316121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3878102af0 msgr2=0x7f387819b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:20.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f3877fff640 1 --2- 172.21.15.43:0/273316121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3878102af0 0x7f387819b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f3877fff640 1 -- 172.21.15.43:0/273316121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f387810d380 msgr2=0x7f387819bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:20.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f3877fff640 1 --2- 172.21.15.43:0/273316121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f387810d380 0x7f387819bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:20.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f3877fff640 1 -- 172.21.15.43:0/273316121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38781a6710 con 0x7f3878108a20 2024-04-25T13:55:20.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.926+0000 7f387d157640 1 --2- 172.21.15.43:0/273316121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f387810d380 0x7f387819bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:55:20.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.927+0000 7f3877fff640 1 --2- 172.21.15.43:0/273316121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3878108a20 0x7f387819b9d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f386800c970 tx=0x7f386800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:20.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.927+0000 7f3875ffb640 1 -- 172.21.15.43:0/273316121 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3868007c70 con 0x7f3878108a20 2024-04-25T13:55:20.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.927+0000 7f3875ffb640 1 -- 172.21.15.43:0/273316121 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3868007e10 con 0x7f3878108a20 2024-04-25T13:55:20.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.927+0000 7f387ebba640 1 -- 172.21.15.43:0/273316121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38781a6a00 con 0x7f3878108a20 2024-04-25T13:55:20.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.927+0000 7f3875ffb640 1 -- 172.21.15.43:0/273316121 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38680186f0 con 0x7f3878108a20 2024-04-25T13:55:20.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.927+0000 7f387ebba640 1 -- 172.21.15.43:0/273316121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38781a6f50 con 0x7f3878108a20 2024-04-25T13:55:20.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.928+0000 7f387ebba640 1 -- 172.21.15.43:0/273316121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f387806afa0 con 0x7f3878108a20 2024-04-25T13:55:20.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.929+0000 7f3875ffb640 1 -- 172.21.15.43:0/273316121 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7f386800fa90 con 0x7f3878108a20 2024-04-25T13:55:20.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.930+0000 7f3875ffb640 1 --2- 172.21.15.43:0/273316121 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f38640afc60 0x7f38640b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:20.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.930+0000 7f3875ffb640 1 -- 172.21.15.43:0/273316121 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9467+0+0 (secure 0 0 0) 0x7f38680df680 con 0x7f3878108a20 2024-04-25T13:55:20.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.930+0000 7f387c956640 1 --2- 172.21.15.43:0/273316121 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f38640afc60 0x7f38640b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:20.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.931+0000 7f387c956640 1 --2- 172.21.15.43:0/273316121 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f38640afc60 0x7f38640b2170 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3860004770 tx=0x7f38600058d0 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:20.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:20.934+0000 7f3875ffb640 1 -- 172.21.15.43:0/273316121 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3868053ff0 con 0x7f3878108a20 2024-04-25T13:55:21.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.137+0000 7f387ebba640 1 -- 172.21.15.43:0/273316121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f387806a480 con 0x7f3878108a20 2024-04-25T13:55:21.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.138+0000 7f3875ffb640 1 -- 172.21.15.43:0/273316121 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v95) ==== 81+0+943 (secure 0 0 0) 0x7f3868014030 con 0x7f3878108a20 2024-04-25T13:55:21.138 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/775979394 2024-04-26T13:34:57.835176+0000 2024-04-25T13:55:21.138 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1063219824 2024-04-26T13:34:57.835176+0000 2024-04-25T13:55:21.138 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2028903966 2024-04-26T13:44:35.638372+0000 2024-04-25T13:55:21.138 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/21237256 2024-04-26T13:44:35.638372+0000 2024-04-25T13:55:21.138 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/1629086480 2024-04-26T13:34:57.835176+0000 2024-04-25T13:55:21.138 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1369825389 2024-04-26T13:44:35.638372+0000 2024-04-25T13:55:21.138 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/1629086480 2024-04-26T13:34:57.835176+0000 2024-04-25T13:55:21.138 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2307776489 2024-04-26T13:44:35.638372+0000 2024-04-25T13:55:21.138 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/3816223875 2024-04-26T13:34:30.246627+0000 2024-04-25T13:55:21.138 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/2478639579 2024-04-26T13:44:35.638372+0000 2024-04-25T13:55:21.138 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1985552645 2024-04-26T13:34:57.835176+0000 2024-04-25T13:55:21.138 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1274235665 2024-04-26T13:34:30.246627+0000 2024-04-25T13:55:21.139 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/3816223875 2024-04-26T13:34:30.246627+0000 2024-04-25T13:55:21.139 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/2478639579 2024-04-26T13:44:35.638372+0000 2024-04-25T13:55:21.139 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1022690204 2024-04-26T13:34:30.246627+0000 2024-04-25T13:55:21.139 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3992074212 2024-04-26T13:34:30.246627+0000 2024-04-25T13:55:21.140 INFO:teuthology.orchestra.run.smithi043.stderr:listed 16 entries 2024-04-25T13:55:21.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.140+0000 7f387ebba640 1 -- 172.21.15.43:0/273316121 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f38640afc60 msgr2=0x7f38640b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:21.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.140+0000 7f387ebba640 1 --2- 172.21.15.43:0/273316121 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f38640afc60 0x7f38640b2170 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3860004770 tx=0x7f38600058d0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.140+0000 7f387ebba640 1 -- 172.21.15.43:0/273316121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3878108a20 msgr2=0x7f387819b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:21.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.140+0000 7f387ebba640 1 --2- 172.21.15.43:0/273316121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3878108a20 0x7f387819b9d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f386800c970 tx=0x7f386800ce30 comp rx=0 tx=0).stop 2024-04-25T13:55:21.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.140+0000 7f387ebba640 1 -- 172.21.15.43:0/273316121 shutdown_connections 2024-04-25T13:55:21.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.140+0000 7f387ebba640 1 --2- 172.21.15.43:0/273316121 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f38640afc60 0x7f38640b2170 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.140+0000 7f387ebba640 1 --2- 172.21.15.43:0/273316121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f387810d380 0x7f387819bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.140+0000 7f387ebba640 1 --2- 172.21.15.43:0/273316121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3878108a20 0x7f387819b9d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.140+0000 7f387ebba640 1 --2- 172.21.15.43:0/273316121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3878102af0 0x7f387819b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.140+0000 7f387ebba640 1 -- 172.21.15.43:0/273316121 >> 172.21.15.43:0/273316121 conn(0x7f3878078100 msgr2=0x7f38781040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:21.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.140+0000 7f387ebba640 1 -- 172.21.15.43:0/273316121 shutdown_connections 2024-04-25T13:55:21.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.140+0000 7f387ebba640 1 -- 172.21.15.43:0/273316121 wait complete. 2024-04-25T13:55:21.150 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:21 smithi043 ceph-mon[29195]: pgmap v335: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:55:21.150 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:21 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2141735952' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:55:21.150 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:21 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1527140828' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:55:21.150 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:21 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2109852732' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:55:21.151 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T13:55:21.151 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:55:21.168 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:55:21.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:21 smithi175 ceph-mon[32649]: pgmap v335: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:55:21.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:21 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2141735952' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:55:21.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:21 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1527140828' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:55:21.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:21 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2109852732' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:55:21.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.321+0000 7fdf37067640 1 -- 172.21.15.43:0/1617256851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf30102af0 msgr2=0x7fdf30102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:21.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.321+0000 7fdf37067640 1 --2- 172.21.15.43:0/1617256851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf30102af0 0x7fdf30102f00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c009900 tx=0x7fdf1c02a410 comp rx=0 tx=0).stop 2024-04-25T13:55:21.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.322+0000 7fdf37067640 1 -- 172.21.15.43:0/1617256851 shutdown_connections 2024-04-25T13:55:21.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.322+0000 7fdf37067640 1 --2- 172.21.15.43:0/1617256851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf3010d380 0x7fdf3010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.322+0000 7fdf37067640 1 --2- 172.21.15.43:0/1617256851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf30102af0 0x7fdf30102f00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.322+0000 7fdf37067640 1 --2- 172.21.15.43:0/1617256851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf30108a20 0x7fdf301025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.322+0000 7fdf37067640 1 -- 172.21.15.43:0/1617256851 >> 172.21.15.43:0/1617256851 conn(0x7fdf30078110 msgr2=0x7fdf30078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:21.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.322+0000 7fdf37067640 1 -- 172.21.15.43:0/1617256851 shutdown_connections 2024-04-25T13:55:21.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.322+0000 7fdf37067640 1 -- 172.21.15.43:0/1617256851 wait complete. 2024-04-25T13:55:21.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.322+0000 7fdf37067640 1 Processor -- start 2024-04-25T13:55:21.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.322+0000 7fdf37067640 1 -- start start 2024-04-25T13:55:21.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf37067640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf30102af0 0x7fdf3019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:21.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf37067640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf30108a20 0x7fdf3019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:21.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf37067640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf3010d380 0x7fdf3019bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:21.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf37067640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdf30112a90 con 0x7fdf3010d380 2024-04-25T13:55:21.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf37067640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fdf30112910 con 0x7fdf30102af0 2024-04-25T13:55:21.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf37067640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdf30112c10 con 0x7fdf30108a20 2024-04-25T13:55:21.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf35604640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf3010d380 0x7fdf3019bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:21.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf35604640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf3010d380 0x7fdf3019bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40034/0 (socket says 172.21.15.43:40034) 2024-04-25T13:55:21.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf35604640 1 -- 172.21.15.43:0/1369879845 learned_addr learned my addr 172.21.15.43:0/1369879845 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:21.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf34e03640 1 --2- 172.21.15.43:0/1369879845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf30102af0 0x7fdf3019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:21.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf2ffff640 1 --2- 172.21.15.43:0/1369879845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf30108a20 0x7fdf3019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:21.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf35604640 1 -- 172.21.15.43:0/1369879845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf30108a20 msgr2=0x7fdf3019b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:21.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf35604640 1 --2- 172.21.15.43:0/1369879845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf30108a20 0x7fdf3019b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf35604640 1 -- 172.21.15.43:0/1369879845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf30102af0 msgr2=0x7fdf3019b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf35604640 1 --2- 172.21.15.43:0/1369879845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf30102af0 0x7fdf3019b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf35604640 1 -- 172.21.15.43:0/1369879845 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf301a67c0 con 0x7fdf3010d380 2024-04-25T13:55:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf35604640 1 --2- 172.21.15.43:0/1369879845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf3010d380 0x7fdf3019bf30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800eaa0 tx=0x7fdf2800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.323+0000 7fdf2dffb640 1 -- 172.21.15.43:0/1369879845 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800cdb0 con 0x7fdf3010d380 2024-04-25T13:55:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.324+0000 7fdf2dffb640 1 -- 172.21.15.43:0/1369879845 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf28005020 con 0x7fdf3010d380 2024-04-25T13:55:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.324+0000 7fdf2dffb640 1 -- 172.21.15.43:0/1369879845 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf280116d0 con 0x7fdf3010d380 2024-04-25T13:55:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.324+0000 7fdf37067640 1 -- 172.21.15.43:0/1369879845 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf301a6ab0 con 0x7fdf3010d380 2024-04-25T13:55:21.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.324+0000 7fdf37067640 1 -- 172.21.15.43:0/1369879845 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf301a6fd0 con 0x7fdf3010d380 2024-04-25T13:55:21.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.325+0000 7fdf37067640 1 -- 172.21.15.43:0/1369879845 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf3006afa0 con 0x7fdf3010d380 2024-04-25T13:55:21.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.326+0000 7fdf2dffb640 1 -- 172.21.15.43:0/1369879845 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7fdf280051d0 con 0x7fdf3010d380 2024-04-25T13:55:21.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.327+0000 7fdf2dffb640 1 --2- 172.21.15.43:0/1369879845 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdf200afc60 0x7fdf200b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:21.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.327+0000 7fdf34e03640 1 --2- 172.21.15.43:0/1369879845 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdf200afc60 0x7fdf200b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:21.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.327+0000 7fdf2dffb640 1 -- 172.21.15.43:0/1369879845 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9467+0+0 (secure 0 0 0) 0x7fdf280df4f0 con 0x7fdf3010d380 2024-04-25T13:55:21.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.328+0000 7fdf34e03640 1 --2- 172.21.15.43:0/1369879845 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdf200afc60 0x7fdf200b2170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf24005fd0 tx=0x7fdf2400b390 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:21.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.332+0000 7fdf2dffb640 1 -- 172.21.15.43:0/1369879845 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdf28016030 con 0x7fdf3010d380 2024-04-25T13:55:21.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:21 smithi161 ceph-mon[32696]: pgmap v335: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T13:55:21.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:21 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2141735952' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:55:21.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:21 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1527140828' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:55:21.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:21 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2109852732' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:55:21.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.519+0000 7fdf37067640 1 -- 172.21.15.43:0/1369879845 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf30106950 con 0x7fdf3010d380 2024-04-25T13:55:21.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.520+0000 7fdf2dffb640 1 -- 172.21.15.43:0/1369879845 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+25250 (secure 0 0 0) 0x7fdf280a7330 con 0x7fdf3010d380 2024-04-25T13:55:21.520 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:55:21.521 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":95,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:55:16.905528+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":94,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":94,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/2028903966":"2024-04-26T13:44:35.638372+0000","172.21.15.43:0/21237256":"2024-04-26T13:44:35.638372+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1369825389":"2024-04-26T13:44:35.638372+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/2307776489":"2024-04-26T13:44:35.638372+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/2478639579":"2024-04-26T13:44:35.638372+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6800/2478639579":"2024-04-26T13:44:35.638372+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:55:21.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.522+0000 7fdf37067640 1 -- 172.21.15.43:0/1369879845 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdf200afc60 msgr2=0x7fdf200b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:21.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.522+0000 7fdf37067640 1 --2- 172.21.15.43:0/1369879845 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdf200afc60 0x7fdf200b2170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf24005fd0 tx=0x7fdf2400b390 comp rx=0 tx=0).stop 2024-04-25T13:55:21.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.522+0000 7fdf37067640 1 -- 172.21.15.43:0/1369879845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf3010d380 msgr2=0x7fdf3019bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:21.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.522+0000 7fdf37067640 1 --2- 172.21.15.43:0/1369879845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf3010d380 0x7fdf3019bf30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800eaa0 tx=0x7fdf2800ef60 comp rx=0 tx=0).stop 2024-04-25T13:55:21.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.522+0000 7fdf37067640 1 -- 172.21.15.43:0/1369879845 shutdown_connections 2024-04-25T13:55:21.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.522+0000 7fdf37067640 1 --2- 172.21.15.43:0/1369879845 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fdf200afc60 0x7fdf200b2170 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.522+0000 7fdf37067640 1 --2- 172.21.15.43:0/1369879845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf3010d380 0x7fdf3019bf30 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.522+0000 7fdf37067640 1 --2- 172.21.15.43:0/1369879845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf30108a20 0x7fdf3019b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.522+0000 7fdf37067640 1 --2- 172.21.15.43:0/1369879845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf30102af0 0x7fdf3019b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.522+0000 7fdf37067640 1 -- 172.21.15.43:0/1369879845 >> 172.21.15.43:0/1369879845 conn(0x7fdf30078110 msgr2=0x7fdf301040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:21.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.522+0000 7fdf37067640 1 -- 172.21.15.43:0/1369879845 shutdown_connections 2024-04-25T13:55:21.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.522+0000 7fdf37067640 1 -- 172.21.15.43:0/1369879845 wait complete. 2024-04-25T13:55:21.534 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:37:25.931659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:06.202688+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:07.348534+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 94, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:42:11.056739+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 94, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:55:21.534 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:55:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.650+0000 7f20452af640 1 -- 172.21.15.43:0/3537502595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2040109b20 msgr2=0x7f20401036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.650+0000 7f20452af640 1 --2- 172.21.15.43:0/3537502595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2040109b20 0x7f20401036c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2038009900 tx=0x7f203802a410 comp rx=0 tx=0).stop 2024-04-25T13:55:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.650+0000 7f20452af640 1 -- 172.21.15.43:0/3537502595 shutdown_connections 2024-04-25T13:55:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.650+0000 7f20452af640 1 --2- 172.21.15.43:0/3537502595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2040104270 0x7f2040110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.650+0000 7f20452af640 1 --2- 172.21.15.43:0/3537502595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2040109fc0 0x7f2040103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.650+0000 7f20452af640 1 --2- 172.21.15.43:0/3537502595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2040109b20 0x7f20401036c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.650+0000 7f20452af640 1 -- 172.21.15.43:0/3537502595 >> 172.21.15.43:0/3537502595 conn(0x7f20400ff1e0 msgr2=0x7f2040101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.650+0000 7f20452af640 1 -- 172.21.15.43:0/3537502595 shutdown_connections 2024-04-25T13:55:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.650+0000 7f20452af640 1 -- 172.21.15.43:0/3537502595 wait complete. 2024-04-25T13:55:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.651+0000 7f20452af640 1 Processor -- start 2024-04-25T13:55:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.651+0000 7f20452af640 1 -- start start 2024-04-25T13:55:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.651+0000 7f20452af640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2040104270 0x7f204019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.651+0000 7f20452af640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2040109b20 0x7f204019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.651+0000 7f20452af640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2040109fc0 0x7f204019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.651+0000 7f20452af640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2040113bc0 con 0x7f2040109b20 2024-04-25T13:55:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.651+0000 7f20452af640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2040113a40 con 0x7f2040109fc0 2024-04-25T13:55:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.651+0000 7f20452af640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2040113d40 con 0x7f2040104270 2024-04-25T13:55:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.651+0000 7f203e7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2040109b20 0x7f204019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.651+0000 7f203e7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2040109b20 0x7f204019ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40058/0 (socket says 172.21.15.43:40058) 2024-04-25T13:55:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.651+0000 7f203e7fc640 1 -- 172.21.15.43:0/3804275625 learned_addr learned my addr 172.21.15.43:0/3804275625 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.651+0000 7f203f7fe640 1 --2- 172.21.15.43:0/3804275625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2040109fc0 0x7f204019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.651+0000 7f203effd640 1 --2- 172.21.15.43:0/3804275625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2040104270 0x7f204019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.652+0000 7f203e7fc640 1 -- 172.21.15.43:0/3804275625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2040104270 msgr2=0x7f204019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.652+0000 7f203e7fc640 1 --2- 172.21.15.43:0/3804275625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2040104270 0x7f204019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.652+0000 7f203e7fc640 1 -- 172.21.15.43:0/3804275625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2040109fc0 msgr2=0x7f204019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.652+0000 7f203e7fc640 1 --2- 172.21.15.43:0/3804275625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2040109fc0 0x7f204019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.652+0000 7f203e7fc640 1 -- 172.21.15.43:0/3804275625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204019f520 con 0x7f2040109b20 2024-04-25T13:55:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.652+0000 7f203e7fc640 1 --2- 172.21.15.43:0/3804275625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2040109b20 0x7f204019ac20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f203400d740 tx=0x7f203400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.652+0000 7f2027fff640 1 -- 172.21.15.43:0/3804275625 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2034017070 con 0x7f2040109b20 2024-04-25T13:55:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.652+0000 7f2027fff640 1 -- 172.21.15.43:0/3804275625 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f203400de50 con 0x7f2040109b20 2024-04-25T13:55:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.652+0000 7f20452af640 1 -- 172.21.15.43:0/3804275625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204019f810 con 0x7f2040109b20 2024-04-25T13:55:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.652+0000 7f2027fff640 1 -- 172.21.15.43:0/3804275625 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2034003bb0 con 0x7f2040109b20 2024-04-25T13:55:21.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.652+0000 7f20452af640 1 -- 172.21.15.43:0/3804275625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20401a7190 con 0x7f2040109b20 2024-04-25T13:55:21.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.653+0000 7f20452af640 1 -- 172.21.15.43:0/3804275625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2040104e00 con 0x7f2040109b20 2024-04-25T13:55:21.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.655+0000 7f2027fff640 1 -- 172.21.15.43:0/3804275625 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7f2034003d50 con 0x7f2040109b20 2024-04-25T13:55:21.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.656+0000 7f2027fff640 1 --2- 172.21.15.43:0/3804275625 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f20280afc60 0x7f20280b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:21.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.656+0000 7f203effd640 1 --2- 172.21.15.43:0/3804275625 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f20280afc60 0x7f20280b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:21.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.656+0000 7f2027fff640 1 -- 172.21.15.43:0/3804275625 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9467+0+0 (secure 0 0 0) 0x7f20340df1d0 con 0x7f2040109b20 2024-04-25T13:55:21.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.656+0000 7f203effd640 1 --2- 172.21.15.43:0/3804275625 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f20280afc60 0x7f20280b2170 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2038006010 tx=0x7f2038032ba0 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:21.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.660+0000 7f2027fff640 1 -- 172.21.15.43:0/3804275625 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f20340a76c0 con 0x7f2040109b20 2024-04-25T13:55:21.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.845+0000 7f20452af640 1 -- 172.21.15.43:0/3804275625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f20401a7360 con 0x7f2040109b20 2024-04-25T13:55:21.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.845+0000 7f2027fff640 1 -- 172.21.15.43:0/3804275625 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7f20340a6fc0 con 0x7f2040109b20 2024-04-25T13:55:21.845 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T13:55:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.847+0000 7f20452af640 1 -- 172.21.15.43:0/3804275625 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f20280afc60 msgr2=0x7f20280b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.847+0000 7f20452af640 1 --2- 172.21.15.43:0/3804275625 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f20280afc60 0x7f20280b2170 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2038006010 tx=0x7f2038032ba0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.847+0000 7f20452af640 1 -- 172.21.15.43:0/3804275625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2040109b20 msgr2=0x7f204019ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.847+0000 7f20452af640 1 --2- 172.21.15.43:0/3804275625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2040109b20 0x7f204019ac20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f203400d740 tx=0x7f203400dc00 comp rx=0 tx=0).stop 2024-04-25T13:55:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.847+0000 7f20452af640 1 -- 172.21.15.43:0/3804275625 shutdown_connections 2024-04-25T13:55:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.847+0000 7f20452af640 1 --2- 172.21.15.43:0/3804275625 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f20280afc60 0x7f20280b2170 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.847+0000 7f20452af640 1 --2- 172.21.15.43:0/3804275625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2040109fc0 0x7f204019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.847+0000 7f20452af640 1 --2- 172.21.15.43:0/3804275625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2040109b20 0x7f204019ac20 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.847+0000 7f20452af640 1 --2- 172.21.15.43:0/3804275625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2040104270 0x7f204019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.847+0000 7f20452af640 1 -- 172.21.15.43:0/3804275625 >> 172.21.15.43:0/3804275625 conn(0x7f20400ff1e0 msgr2=0x7f2040101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.847+0000 7f20452af640 1 -- 172.21.15.43:0/3804275625 shutdown_connections 2024-04-25T13:55:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.847+0000 7f20452af640 1 -- 172.21.15.43:0/3804275625 wait complete. 2024-04-25T13:55:21.858 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:55:21.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.973+0000 7f2d581f3640 1 -- 172.21.15.43:0/239404730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d50104990 msgr2=0x7f2d50101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.973+0000 7f2d581f3640 1 --2- 172.21.15.43:0/239404730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d50104990 0x7f2d50101b70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c009ca0 tx=0x7f2d4c02a950 comp rx=0 tx=0).stop 2024-04-25T13:55:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.974+0000 7f2d581f3640 1 -- 172.21.15.43:0/239404730 shutdown_connections 2024-04-25T13:55:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.974+0000 7f2d581f3640 1 --2- 172.21.15.43:0/239404730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d501102f0 0x7f2d50112770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.974+0000 7f2d581f3640 1 --2- 172.21.15.43:0/239404730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d501020b0 0x7f2d501024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.974+0000 7f2d581f3640 1 --2- 172.21.15.43:0/239404730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d50104990 0x7f2d50101b70 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.974+0000 7f2d581f3640 1 -- 172.21.15.43:0/239404730 >> 172.21.15.43:0/239404730 conn(0x7f2d50077880 msgr2=0x7f2d50077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.974+0000 7f2d581f3640 1 -- 172.21.15.43:0/239404730 shutdown_connections 2024-04-25T13:55:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.974+0000 7f2d581f3640 1 -- 172.21.15.43:0/239404730 wait complete. 2024-04-25T13:55:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.974+0000 7f2d581f3640 1 Processor -- start 2024-04-25T13:55:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.974+0000 7f2d581f3640 1 -- start start 2024-04-25T13:55:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d581f3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d501020b0 0x7f2d501a2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d581f3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d50104990 0x7f2d501a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d581f3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d501102f0 0x7f2d5019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:21.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d581f3640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2d50115d90 con 0x7f2d50104990 2024-04-25T13:55:21.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d581f3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2d50115c10 con 0x7f2d501020b0 2024-04-25T13:55:21.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d581f3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d50115f10 con 0x7f2d501102f0 2024-04-25T13:55:21.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d5578e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d50104990 0x7f2d501a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:21.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d5578e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d50104990 0x7f2d501a2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40074/0 (socket says 172.21.15.43:40074) 2024-04-25T13:55:21.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d5578e640 1 -- 172.21.15.43:0/695346085 learned_addr learned my addr 172.21.15.43:0/695346085 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:21.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d56790640 1 --2- 172.21.15.43:0/695346085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d501102f0 0x7f2d5019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:21.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d55f8f640 1 --2- 172.21.15.43:0/695346085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d501020b0 0x7f2d501a2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:21.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d5578e640 1 -- 172.21.15.43:0/695346085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d501102f0 msgr2=0x7f2d5019c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:21.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d5578e640 1 --2- 172.21.15.43:0/695346085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d501102f0 0x7f2d5019c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d5578e640 1 -- 172.21.15.43:0/695346085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d501020b0 msgr2=0x7f2d501a2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:21.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d5578e640 1 --2- 172.21.15.43:0/695346085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d501020b0 0x7f2d501a2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:21.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d5578e640 1 -- 172.21.15.43:0/695346085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5019cde0 con 0x7f2d50104990 2024-04-25T13:55:21.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d5578e640 1 --2- 172.21.15.43:0/695346085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d50104990 0x7f2d501a2a70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000d950 tx=0x7f2d4000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:21.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d46ffd640 1 -- 172.21.15.43:0/695346085 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d40017070 con 0x7f2d50104990 2024-04-25T13:55:21.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.975+0000 7f2d46ffd640 1 -- 172.21.15.43:0/695346085 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d40009c30 con 0x7f2d50104990 2024-04-25T13:55:21.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.976+0000 7f2d581f3640 1 -- 172.21.15.43:0/695346085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d5019d070 con 0x7f2d50104990 2024-04-25T13:55:21.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.976+0000 7f2d46ffd640 1 -- 172.21.15.43:0/695346085 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4000f620 con 0x7f2d50104990 2024-04-25T13:55:21.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.976+0000 7f2d581f3640 1 -- 172.21.15.43:0/695346085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d501a92d0 con 0x7f2d50104990 2024-04-25T13:55:21.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.976+0000 7f2d581f3640 1 -- 172.21.15.43:0/695346085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d50102d90 con 0x7f2d50104990 2024-04-25T13:55:21.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.978+0000 7f2d46ffd640 1 -- 172.21.15.43:0/695346085 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7f2d40010460 con 0x7f2d50104990 2024-04-25T13:55:21.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.979+0000 7f2d46ffd640 1 --2- 172.21.15.43:0/695346085 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f2d3c0afce0 0x7f2d3c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:21.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.979+0000 7f2d55f8f640 1 --2- 172.21.15.43:0/695346085 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f2d3c0afce0 0x7f2d3c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:21.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.979+0000 7f2d46ffd640 1 -- 172.21.15.43:0/695346085 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9467+0+0 (secure 0 0 0) 0x7f2d400defe0 con 0x7f2d50104990 2024-04-25T13:55:21.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.979+0000 7f2d55f8f640 1 --2- 172.21.15.43:0/695346085 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f2d3c0afce0 0x7f2d3c0b21f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0094e0 tx=0x7f2d4c02f400 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:21.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:21.982+0000 7f2d46ffd640 1 -- 172.21.15.43:0/695346085 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2d400a7530 con 0x7f2d50104990 2024-04-25T13:55:22.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.172+0000 7f2d581f3640 1 -- 172.21.15.43:0/695346085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2d5006a160 con 0x7f2d50104990 2024-04-25T13:55:22.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.173+0000 7f2d46ffd640 1 -- 172.21.15.43:0/695346085 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) ==== 104+0+11 (secure 0 0 0) 0x7f2d40009de0 con 0x7f2d50104990 2024-04-25T13:55:22.173 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:55:22.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.175+0000 7f2d581f3640 1 -- 172.21.15.43:0/695346085 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f2d3c0afce0 msgr2=0x7f2d3c0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:22.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.175+0000 7f2d581f3640 1 --2- 172.21.15.43:0/695346085 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f2d3c0afce0 0x7f2d3c0b21f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0094e0 tx=0x7f2d4c02f400 comp rx=0 tx=0).stop 2024-04-25T13:55:22.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.175+0000 7f2d581f3640 1 -- 172.21.15.43:0/695346085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d50104990 msgr2=0x7f2d501a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:22.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.175+0000 7f2d581f3640 1 --2- 172.21.15.43:0/695346085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d50104990 0x7f2d501a2a70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000d950 tx=0x7f2d4000de10 comp rx=0 tx=0).stop 2024-04-25T13:55:22.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.175+0000 7f2d581f3640 1 -- 172.21.15.43:0/695346085 shutdown_connections 2024-04-25T13:55:22.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.175+0000 7f2d581f3640 1 --2- 172.21.15.43:0/695346085 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f2d3c0afce0 0x7f2d3c0b21f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.175+0000 7f2d581f3640 1 --2- 172.21.15.43:0/695346085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d501102f0 0x7f2d5019c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.175+0000 7f2d581f3640 1 --2- 172.21.15.43:0/695346085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d50104990 0x7f2d501a2a70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.175+0000 7f2d581f3640 1 --2- 172.21.15.43:0/695346085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d501020b0 0x7f2d501a2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.175+0000 7f2d581f3640 1 -- 172.21.15.43:0/695346085 >> 172.21.15.43:0/695346085 conn(0x7f2d50077880 msgr2=0x7f2d50100980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:22.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.175+0000 7f2d581f3640 1 -- 172.21.15.43:0/695346085 shutdown_connections 2024-04-25T13:55:22.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.175+0000 7f2d581f3640 1 -- 172.21.15.43:0/695346085 wait complete. 2024-04-25T13:55:22.185 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:22 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/273316121' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T13:55:22.185 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:22 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1369879845' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:55:22.185 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:22 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3804275625' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:55:22.186 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:55:22.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.302+0000 7fd4df8a7640 1 -- 172.21.15.43:0/3006446067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4d8104260 msgr2=0x7fd4d8110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.302+0000 7fd4df8a7640 1 --2- 172.21.15.43:0/3006446067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4d8104260 0x7fd4d8110630 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8009ca0 tx=0x7fd4c802a8c0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.302+0000 7fd4df8a7640 1 -- 172.21.15.43:0/3006446067 shutdown_connections 2024-04-25T13:55:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.302+0000 7fd4df8a7640 1 --2- 172.21.15.43:0/3006446067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4d8104260 0x7fd4d8110630 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.302+0000 7fd4df8a7640 1 --2- 172.21.15.43:0/3006446067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4d8109fb0 0x7fd4d8103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.302+0000 7fd4df8a7640 1 --2- 172.21.15.43:0/3006446067 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4d8109b10 0x7fd4d81036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.302+0000 7fd4df8a7640 1 -- 172.21.15.43:0/3006446067 >> 172.21.15.43:0/3006446067 conn(0x7fd4d80ff210 msgr2=0x7fd4d8101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.302+0000 7fd4df8a7640 1 -- 172.21.15.43:0/3006446067 shutdown_connections 2024-04-25T13:55:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.302+0000 7fd4df8a7640 1 -- 172.21.15.43:0/3006446067 wait complete. 2024-04-25T13:55:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.302+0000 7fd4df8a7640 1 Processor -- start 2024-04-25T13:55:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.302+0000 7fd4df8a7640 1 -- start start 2024-04-25T13:55:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4df8a7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4d8104260 0x7fd4d819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4df8a7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4d8109b10 0x7fd4d819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4df8a7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4d8109fb0 0x7fd4d819ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4df8a7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d8113c20 con 0x7fd4d8109b10 2024-04-25T13:55:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4df8a7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d8113aa0 con 0x7fd4d8104260 2024-04-25T13:55:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4df8a7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d8113da0 con 0x7fd4d8109fb0 2024-04-25T13:55:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4dce42640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4d8109b10 0x7fd4d819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4dce42640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4d8109b10 0x7fd4d819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40084/0 (socket says 172.21.15.43:40084) 2024-04-25T13:55:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4dce42640 1 -- 172.21.15.43:0/3829920316 learned_addr learned my addr 172.21.15.43:0/3829920316 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4dde44640 1 --2- 172.21.15.43:0/3829920316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4d8109fb0 0x7fd4d819ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4dd643640 1 --2- 172.21.15.43:0/3829920316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4d8104260 0x7fd4d819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4dce42640 1 -- 172.21.15.43:0/3829920316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4d8109fb0 msgr2=0x7fd4d819ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4dce42640 1 --2- 172.21.15.43:0/3829920316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4d8109fb0 0x7fd4d819ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4dce42640 1 -- 172.21.15.43:0/3829920316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4d8104260 msgr2=0x7fd4d819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4dce42640 1 --2- 172.21.15.43:0/3829920316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4d8104260 0x7fd4d819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4dce42640 1 -- 172.21.15.43:0/3829920316 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d819f460 con 0x7fd4d8109b10 2024-04-25T13:55:22.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4dce42640 1 --2- 172.21.15.43:0/3829920316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4d8109b10 0x7fd4d819ab60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc005d00 tx=0x7fd4cc00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:22.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.303+0000 7fd4d67fc640 1 -- 172.21.15.43:0/3829920316 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc017070 con 0x7fd4d8109b10 2024-04-25T13:55:22.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.304+0000 7fd4d67fc640 1 -- 172.21.15.43:0/3829920316 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4cc009c30 con 0x7fd4d8109b10 2024-04-25T13:55:22.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.304+0000 7fd4df8a7640 1 -- 172.21.15.43:0/3829920316 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d819f750 con 0x7fd4d8109b10 2024-04-25T13:55:22.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.304+0000 7fd4d67fc640 1 -- 172.21.15.43:0/3829920316 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc00f620 con 0x7fd4d8109b10 2024-04-25T13:55:22.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.304+0000 7fd4df8a7640 1 -- 172.21.15.43:0/3829920316 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d81a70d0 con 0x7fd4d8109b10 2024-04-25T13:55:22.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.304+0000 7fd4df8a7640 1 -- 172.21.15.43:0/3829920316 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4d806a160 con 0x7fd4d8109b10 2024-04-25T13:55:22.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.306+0000 7fd4d67fc640 1 -- 172.21.15.43:0/3829920316 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7fd4cc01a070 con 0x7fd4d8109b10 2024-04-25T13:55:22.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.307+0000 7fd4d67fc640 1 --2- 172.21.15.43:0/3829920316 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fd4c00afce0 0x7fd4c00b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:22.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.307+0000 7fd4dd643640 1 --2- 172.21.15.43:0/3829920316 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fd4c00afce0 0x7fd4c00b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:22.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.307+0000 7fd4d67fc640 1 -- 172.21.15.43:0/3829920316 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9467+0+0 (secure 0 0 0) 0x7fd4cc0ded40 con 0x7fd4d8109b10 2024-04-25T13:55:22.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.307+0000 7fd4dd643640 1 --2- 172.21.15.43:0/3829920316 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fd4c00afce0 0x7fd4c00b21f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0005fd0 tx=0x7fd4d0005850 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:22.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.310+0000 7fd4d67fc640 1 -- 172.21.15.43:0/3829920316 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd4cc009de0 con 0x7fd4d8109b10 2024-04-25T13:55:22.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:22 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/273316121' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T13:55:22.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:22 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1369879845' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:55:22.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:22 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3804275625' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:55:22.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:22 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/273316121' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T13:55:22.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:22 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1369879845' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:55:22.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:22 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3804275625' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T13:55:22.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.497+0000 7fd4df8a7640 1 -- 172.21.15.43:0/3829920316 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd4d810bc20 con 0x7fd4d8109b10 2024-04-25T13:55:22.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.498+0000 7fd4d67fc640 1 -- 172.21.15.43:0/3829920316 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) ==== 100+0+11 (secure 0 0 0) 0x7fd4cc0a7250 con 0x7fd4d8109b10 2024-04-25T13:55:22.498 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-25T13:55:22.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.500+0000 7fd4df8a7640 1 -- 172.21.15.43:0/3829920316 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fd4c00afce0 msgr2=0x7fd4c00b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:22.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.500+0000 7fd4df8a7640 1 --2- 172.21.15.43:0/3829920316 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fd4c00afce0 0x7fd4c00b21f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0005fd0 tx=0x7fd4d0005850 comp rx=0 tx=0).stop 2024-04-25T13:55:22.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.500+0000 7fd4df8a7640 1 -- 172.21.15.43:0/3829920316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4d8109b10 msgr2=0x7fd4d819ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:22.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.500+0000 7fd4df8a7640 1 --2- 172.21.15.43:0/3829920316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4d8109b10 0x7fd4d819ab60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc005d00 tx=0x7fd4cc00dde0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.500+0000 7fd4df8a7640 1 -- 172.21.15.43:0/3829920316 shutdown_connections 2024-04-25T13:55:22.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.500+0000 7fd4df8a7640 1 --2- 172.21.15.43:0/3829920316 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fd4c00afce0 0x7fd4c00b21f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.500+0000 7fd4df8a7640 1 --2- 172.21.15.43:0/3829920316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4d8109fb0 0x7fd4d819ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.500+0000 7fd4df8a7640 1 --2- 172.21.15.43:0/3829920316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4d8109b10 0x7fd4d819ab60 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.500+0000 7fd4df8a7640 1 --2- 172.21.15.43:0/3829920316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4d8104260 0x7fd4d819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.500+0000 7fd4df8a7640 1 -- 172.21.15.43:0/3829920316 >> 172.21.15.43:0/3829920316 conn(0x7fd4d80ff210 msgr2=0x7fd4d8106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:22.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.500+0000 7fd4df8a7640 1 -- 172.21.15.43:0/3829920316 shutdown_connections 2024-04-25T13:55:22.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.500+0000 7fd4df8a7640 1 -- 172.21.15.43:0/3829920316 wait complete. 2024-04-25T13:55:22.511 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:55:22.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.626+0000 7f9b381ce640 1 -- 172.21.15.43:0/2484594218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b30102860 msgr2=0x7f9b30102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:22.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.626+0000 7f9b381ce640 1 --2- 172.21.15.43:0/2484594218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b30102860 0x7f9b30102c70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009900 tx=0x7f9b2c02a410 comp rx=0 tx=0).stop 2024-04-25T13:55:22.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.626+0000 7f9b381ce640 1 -- 172.21.15.43:0/2484594218 shutdown_connections 2024-04-25T13:55:22.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.626+0000 7f9b381ce640 1 --2- 172.21.15.43:0/2484594218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b30110400 0x7f9b30112820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.626+0000 7f9b381ce640 1 --2- 172.21.15.43:0/2484594218 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b3010daa0 0x7f9b3010fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.626+0000 7f9b381ce640 1 --2- 172.21.15.43:0/2484594218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b30102860 0x7f9b30102c70 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.626+0000 7f9b381ce640 1 -- 172.21.15.43:0/2484594218 >> 172.21.15.43:0/2484594218 conn(0x7f9b30078100 msgr2=0x7f9b30078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:22.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.626+0000 7f9b381ce640 1 -- 172.21.15.43:0/2484594218 shutdown_connections 2024-04-25T13:55:22.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.626+0000 7f9b381ce640 1 -- 172.21.15.43:0/2484594218 wait complete. 2024-04-25T13:55:22.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.626+0000 7f9b381ce640 1 Processor -- start 2024-04-25T13:55:22.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.626+0000 7f9b381ce640 1 -- start start 2024-04-25T13:55:22.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b381ce640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b30102860 0x7f9b301a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:22.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b381ce640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b3010daa0 0x7f9b301a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:22.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b381ce640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b30110400 0x7f9b3019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:22.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b381ce640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9b30115d70 con 0x7f9b3010daa0 2024-04-25T13:55:22.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b381ce640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9b30115bf0 con 0x7f9b30110400 2024-04-25T13:55:22.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b381ce640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b30115ef0 con 0x7f9b30102860 2024-04-25T13:55:22.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b35769640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b3010daa0 0x7f9b301a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:22.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b35769640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b3010daa0 0x7f9b301a2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40112/0 (socket says 172.21.15.43:40112) 2024-04-25T13:55:22.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b35769640 1 -- 172.21.15.43:0/3484507761 learned_addr learned my addr 172.21.15.43:0/3484507761 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:22.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b35f6a640 1 --2- 172.21.15.43:0/3484507761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b30102860 0x7f9b301a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:22.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b35769640 1 -- 172.21.15.43:0/3484507761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b30102860 msgr2=0x7f9b301a24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:22.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b35769640 1 --2- 172.21.15.43:0/3484507761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b30102860 0x7f9b301a24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b35769640 1 -- 172.21.15.43:0/3484507761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b30110400 msgr2=0x7f9b3019c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:22.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b3676b640 1 --2- 172.21.15.43:0/3484507761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b30110400 0x7f9b3019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:22.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b35769640 1 --2- 172.21.15.43:0/3484507761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b30110400 0x7f9b3019c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b35769640 1 -- 172.21.15.43:0/3484507761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3019cda0 con 0x7f9b3010daa0 2024-04-25T13:55:22.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b3676b640 1 --2- 172.21.15.43:0/3484507761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b30110400 0x7f9b3019c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:55:22.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b35769640 1 --2- 172.21.15.43:0/3484507761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b3010daa0 0x7f9b301a2a30 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000e9c0 tx=0x7f9b2000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:22.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b26ffd640 1 -- 172.21.15.43:0/3484507761 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2000cd80 con 0x7f9b3010daa0 2024-04-25T13:55:22.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b26ffd640 1 -- 172.21.15.43:0/3484507761 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b200054b0 con 0x7f9b3010daa0 2024-04-25T13:55:22.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.627+0000 7f9b381ce640 1 -- 172.21.15.43:0/3484507761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3019d030 con 0x7f9b3010daa0 2024-04-25T13:55:22.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.628+0000 7f9b26ffd640 1 -- 172.21.15.43:0/3484507761 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20010430 con 0x7f9b3010daa0 2024-04-25T13:55:22.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.628+0000 7f9b381ce640 1 -- 172.21.15.43:0/3484507761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b301a9290 con 0x7f9b3010daa0 2024-04-25T13:55:22.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.629+0000 7f9b381ce640 1 -- 172.21.15.43:0/3484507761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3006a710 con 0x7f9b3010daa0 2024-04-25T13:55:22.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.631+0000 7f9b26ffd640 1 -- 172.21.15.43:0/3484507761 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7f9b20004f20 con 0x7f9b3010daa0 2024-04-25T13:55:22.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.632+0000 7f9b26ffd640 1 --2- 172.21.15.43:0/3484507761 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9b1c0afce0 0x7f9b1c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:22.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.632+0000 7f9b35f6a640 1 --2- 172.21.15.43:0/3484507761 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9b1c0afce0 0x7f9b1c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:22.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.632+0000 7f9b26ffd640 1 -- 172.21.15.43:0/3484507761 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9467+0+0 (secure 0 0 0) 0x7f9b200e00e0 con 0x7f9b3010daa0 2024-04-25T13:55:22.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.632+0000 7f9b35f6a640 1 --2- 172.21.15.43:0/3484507761 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9b1c0afce0 0x7f9b1c0b21f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c000c00 tx=0x7f9b2c009680 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:22.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.635+0000 7f9b26ffd640 1 -- 172.21.15.43:0/3484507761 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9b200a8570 con 0x7f9b3010daa0 2024-04-25T13:55:22.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.821+0000 7f9b381ce640 1 -- 172.21.15.43:0/3484507761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f9b301a9520 con 0x7f9b3010daa0 2024-04-25T13:55:22.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.822+0000 7f9b26ffd640 1 -- 172.21.15.43:0/3484507761 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v95) ==== 103+0+11 (secure 0 0 0) 0x7f9b200a7e70 con 0x7f9b3010daa0 2024-04-25T13:55:22.822 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T13:55:22.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.824+0000 7f9b381ce640 1 -- 172.21.15.43:0/3484507761 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9b1c0afce0 msgr2=0x7f9b1c0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:22.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.824+0000 7f9b381ce640 1 --2- 172.21.15.43:0/3484507761 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9b1c0afce0 0x7f9b1c0b21f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c000c00 tx=0x7f9b2c009680 comp rx=0 tx=0).stop 2024-04-25T13:55:22.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.824+0000 7f9b381ce640 1 -- 172.21.15.43:0/3484507761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b3010daa0 msgr2=0x7f9b301a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:22.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.824+0000 7f9b381ce640 1 --2- 172.21.15.43:0/3484507761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b3010daa0 0x7f9b301a2a30 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000e9c0 tx=0x7f9b2000ee80 comp rx=0 tx=0).stop 2024-04-25T13:55:22.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.824+0000 7f9b381ce640 1 -- 172.21.15.43:0/3484507761 shutdown_connections 2024-04-25T13:55:22.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.824+0000 7f9b381ce640 1 --2- 172.21.15.43:0/3484507761 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9b1c0afce0 0x7f9b1c0b21f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.824+0000 7f9b381ce640 1 --2- 172.21.15.43:0/3484507761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b30110400 0x7f9b3019c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.824+0000 7f9b381ce640 1 --2- 172.21.15.43:0/3484507761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b3010daa0 0x7f9b301a2a30 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.824+0000 7f9b381ce640 1 --2- 172.21.15.43:0/3484507761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b30102860 0x7f9b301a24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.824+0000 7f9b381ce640 1 -- 172.21.15.43:0/3484507761 >> 172.21.15.43:0/3484507761 conn(0x7f9b30078100 msgr2=0x7f9b30101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:22.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.824+0000 7f9b381ce640 1 -- 172.21.15.43:0/3484507761 shutdown_connections 2024-04-25T13:55:22.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.824+0000 7f9b381ce640 1 -- 172.21.15.43:0/3484507761 wait complete. 2024-04-25T13:55:22.835 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:55:22.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.948+0000 7f2995b14640 1 -- 172.21.15.43:0/358497463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2990108a10 msgr2=0x7f2990102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:22.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.948+0000 7f2995b14640 1 --2- 172.21.15.43:0/358497463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2990108a10 0x7f2990102610 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2980009900 tx=0x7f298002a410 comp rx=0 tx=0).stop 2024-04-25T13:55:22.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.948+0000 7f2995b14640 1 -- 172.21.15.43:0/358497463 shutdown_connections 2024-04-25T13:55:22.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.948+0000 7f2995b14640 1 --2- 172.21.15.43:0/358497463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29901031c0 0x7f299010f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.948+0000 7f2995b14640 1 --2- 172.21.15.43:0/358497463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2990108eb0 0x7f2990102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.948+0000 7f2995b14640 1 --2- 172.21.15.43:0/358497463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2990108a10 0x7f2990102610 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.948+0000 7f2995b14640 1 -- 172.21.15.43:0/358497463 >> 172.21.15.43:0/358497463 conn(0x7f2990078110 msgr2=0x7f2990078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:22.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.948+0000 7f2995b14640 1 -- 172.21.15.43:0/358497463 shutdown_connections 2024-04-25T13:55:22.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.948+0000 7f2995b14640 1 -- 172.21.15.43:0/358497463 wait complete. 2024-04-25T13:55:22.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.948+0000 7f2995b14640 1 Processor -- start 2024-04-25T13:55:22.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f2995b14640 1 -- start start 2024-04-25T13:55:22.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f2995b14640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29901031c0 0x7f299019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:22.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f2995b14640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2990108a10 0x7f299019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:22.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f2995b14640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2990108eb0 0x7f299019ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:22.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f2995b14640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2990113bd0 con 0x7f2990108eb0 2024-04-25T13:55:22.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f2995b14640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2990113a50 con 0x7f29901031c0 2024-04-25T13:55:22.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f2995b14640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2990113d50 con 0x7f2990108a10 2024-04-25T13:55:22.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f298ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2990108eb0 0x7f299019ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:22.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f298ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2990108eb0 0x7f299019ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40122/0 (socket says 172.21.15.43:40122) 2024-04-25T13:55:22.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f298ffff640 1 -- 172.21.15.43:0/982994522 learned_addr learned my addr 172.21.15.43:0/982994522 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:22.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f298effd640 1 --2- 172.21.15.43:0/982994522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2990108a10 0x7f299019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:22.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f298f7fe640 1 --2- 172.21.15.43:0/982994522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29901031c0 0x7f299019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:22.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f298ffff640 1 -- 172.21.15.43:0/982994522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2990108a10 msgr2=0x7f299019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:22.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f298ffff640 1 --2- 172.21.15.43:0/982994522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2990108a10 0x7f299019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f298ffff640 1 -- 172.21.15.43:0/982994522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29901031c0 msgr2=0x7f299019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:22.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f298ffff640 1 --2- 172.21.15.43:0/982994522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29901031c0 0x7f299019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:22.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f298ffff640 1 -- 172.21.15.43:0/982994522 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299019f4b0 con 0x7f2990108eb0 2024-04-25T13:55:22.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f298f7fe640 1 --2- 172.21.15.43:0/982994522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29901031c0 0x7f299019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:55:22.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.949+0000 7f298ffff640 1 --2- 172.21.15.43:0/982994522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2990108eb0 0x7f299019ee70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f298800eb10 tx=0x7f298800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:22.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.950+0000 7f298cff9640 1 -- 172.21.15.43:0/982994522 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2988004b20 con 0x7f2990108eb0 2024-04-25T13:55:22.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.950+0000 7f298cff9640 1 -- 172.21.15.43:0/982994522 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2988004cc0 con 0x7f2990108eb0 2024-04-25T13:55:22.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.950+0000 7f2995b14640 1 -- 172.21.15.43:0/982994522 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f299019f7a0 con 0x7f2990108eb0 2024-04-25T13:55:22.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.950+0000 7f298cff9640 1 -- 172.21.15.43:0/982994522 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2988010690 con 0x7f2990108eb0 2024-04-25T13:55:22.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.950+0000 7f2995b14640 1 -- 172.21.15.43:0/982994522 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29901a7120 con 0x7f2990108eb0 2024-04-25T13:55:22.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.951+0000 7f2995b14640 1 -- 172.21.15.43:0/982994522 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f299006a160 con 0x7f2990108eb0 2024-04-25T13:55:22.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.952+0000 7f298cff9640 1 -- 172.21.15.43:0/982994522 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7f2988005020 con 0x7f2990108eb0 2024-04-25T13:55:22.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.953+0000 7f298cff9640 1 --2- 172.21.15.43:0/982994522 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f29780afc60 0x7f29780b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:22.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.953+0000 7f298f7fe640 1 --2- 172.21.15.43:0/982994522 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f29780afc60 0x7f29780b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:22.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.953+0000 7f298cff9640 1 -- 172.21.15.43:0/982994522 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9467+0+0 (secure 0 0 0) 0x7f29880dfa80 con 0x7f2990108eb0 2024-04-25T13:55:22.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.953+0000 7f298f7fe640 1 --2- 172.21.15.43:0/982994522 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f29780afc60 0x7f29780b2170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2980006010 tx=0x7f2980000bc0 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:22.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:22.957+0000 7f298cff9640 1 -- 172.21.15.43:0/982994522 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f29880e1e20 con 0x7f2990108eb0 2024-04-25T13:55:23.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:23.157+0000 7f2995b14640 1 -- 172.21.15.43:0/982994522 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2990106f50 con 0x7f2990108eb0 2024-04-25T13:55:23.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:23.158+0000 7f298cff9640 1 -- 172.21.15.43:0/982994522 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v95) ==== 81+0+943 (secure 0 0 0) 0x7f29880a7f10 con 0x7f2990108eb0 2024-04-25T13:55:23.158 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/775979394 2024-04-26T13:34:57.835176+0000 2024-04-25T13:55:23.158 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1063219824 2024-04-26T13:34:57.835176+0000 2024-04-25T13:55:23.158 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2028903966 2024-04-26T13:44:35.638372+0000 2024-04-25T13:55:23.158 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/21237256 2024-04-26T13:44:35.638372+0000 2024-04-25T13:55:23.158 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/1629086480 2024-04-26T13:34:57.835176+0000 2024-04-25T13:55:23.158 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1369825389 2024-04-26T13:44:35.638372+0000 2024-04-25T13:55:23.158 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/1629086480 2024-04-26T13:34:57.835176+0000 2024-04-25T13:55:23.159 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2307776489 2024-04-26T13:44:35.638372+0000 2024-04-25T13:55:23.159 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/3816223875 2024-04-26T13:34:30.246627+0000 2024-04-25T13:55:23.159 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/2478639579 2024-04-26T13:44:35.638372+0000 2024-04-25T13:55:23.159 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1985552645 2024-04-26T13:34:57.835176+0000 2024-04-25T13:55:23.159 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1274235665 2024-04-26T13:34:30.246627+0000 2024-04-25T13:55:23.159 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/3816223875 2024-04-26T13:34:30.246627+0000 2024-04-25T13:55:23.159 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/2478639579 2024-04-26T13:44:35.638372+0000 2024-04-25T13:55:23.160 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1022690204 2024-04-26T13:34:30.246627+0000 2024-04-25T13:55:23.160 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3992074212 2024-04-26T13:34:30.246627+0000 2024-04-25T13:55:23.161 INFO:teuthology.orchestra.run.smithi043.stderr:listed 16 entries 2024-04-25T13:55:23.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:23.160+0000 7f2995b14640 1 -- 172.21.15.43:0/982994522 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f29780afc60 msgr2=0x7f29780b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:23.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:23.160+0000 7f2995b14640 1 --2- 172.21.15.43:0/982994522 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f29780afc60 0x7f29780b2170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2980006010 tx=0x7f2980000bc0 comp rx=0 tx=0).stop 2024-04-25T13:55:23.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:23.160+0000 7f2995b14640 1 -- 172.21.15.43:0/982994522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2990108eb0 msgr2=0x7f299019ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:23.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:23.160+0000 7f2995b14640 1 --2- 172.21.15.43:0/982994522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2990108eb0 0x7f299019ee70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f298800eb10 tx=0x7f298800c2d0 comp rx=0 tx=0).stop 2024-04-25T13:55:23.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:23.160+0000 7f2995b14640 1 -- 172.21.15.43:0/982994522 shutdown_connections 2024-04-25T13:55:23.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:23.160+0000 7f2995b14640 1 --2- 172.21.15.43:0/982994522 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f29780afc60 0x7f29780b2170 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:23.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:23.160+0000 7f2995b14640 1 --2- 172.21.15.43:0/982994522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2990108eb0 0x7f299019ee70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:23.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:23.160+0000 7f2995b14640 1 --2- 172.21.15.43:0/982994522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2990108a10 0x7f299019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:23.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:23.160+0000 7f2995b14640 1 --2- 172.21.15.43:0/982994522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29901031c0 0x7f299019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:23.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:23.160+0000 7f2995b14640 1 -- 172.21.15.43:0/982994522 >> 172.21.15.43:0/982994522 conn(0x7f2990078110 msgr2=0x7f29901040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:23.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:23.160+0000 7f2995b14640 1 -- 172.21.15.43:0/982994522 shutdown_connections 2024-04-25T13:55:23.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:23.160+0000 7f2995b14640 1 -- 172.21.15.43:0/982994522 wait complete. 2024-04-25T13:55:23.170 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:23 smithi043 ceph-mon[29195]: pgmap v336: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:55:23.170 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:23 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/695346085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:55:23.170 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:23 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3829920316' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:55:23.170 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:23 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3484507761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:55:23.171 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi043.front.sepia.ceph.com... 2024-04-25T13:55:23.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:55:23.172 DEBUG:teuthology.orchestra.run.smithi043:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T13:55:23.195 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi043.stderr:ceph-fuse[82945]: fuse finished with error 0 and tester_r 0 2024-04-25T13:55:23.197 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:55:23.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:23 smithi161 ceph-mon[32696]: pgmap v336: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:55:23.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:23 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/695346085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:55:23.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:23 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3829920316' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:55:23.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:23 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3484507761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:55:23.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:23 smithi175 ceph-mon[32649]: pgmap v336: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:55:23.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:23 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/695346085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T13:55:23.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:23 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3829920316' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T13:55:23.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:23 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3484507761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-25T13:55:24.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:24 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/982994522' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T13:55:24.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:24 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/982994522' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T13:55:24.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:24 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/982994522' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T13:55:25.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:25 smithi161 ceph-mon[32696]: pgmap v337: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:55:25.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:25 smithi175 ceph-mon[32649]: pgmap v337: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:55:25.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:25 smithi043 ceph-mon[29195]: pgmap v337: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:55:27.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:27 smithi161 ceph-mon[32696]: pgmap v338: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:55:27.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:27 smithi175 ceph-mon[32649]: pgmap v338: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:55:27.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:27 smithi043 ceph-mon[29195]: pgmap v338: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T13:55:29.298 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T13:55:29.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:55:29.298 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T13:55:29.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:55:29.318 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-25T13:55:29.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:29 smithi161 ceph-mon[32696]: pgmap v339: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 841 B/s wr, 6 op/s 2024-04-25T13:55:29.377 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T13:55:29.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:55:29.377 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:55:29.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:29 smithi175 ceph-mon[32649]: pgmap v339: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 841 B/s wr, 6 op/s 2024-04-25T13:55:29.441 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:29 smithi043 ceph-mon[29195]: pgmap v339: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 841 B/s wr, 6 op/s 2024-04-25T13:55:29.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:55:29.447 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-04-25T13:55:29.546 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-25T13:55:29.556 INFO:tasks.cephadm:Teardown begin 2024-04-25T13:55:29.556 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T13:55:29.557 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:55:29.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.675+0000 7f9c17f3f640 1 -- 172.21.15.43:0/3261119753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c1010d380 msgr2=0x7f9c1010f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:29.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.675+0000 7f9c17f3f640 1 --2- 172.21.15.43:0/3261119753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c1010d380 0x7f9c1010f7a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009ca0 tx=0x7f9c0802a8c0 comp rx=0 tx=0).stop 2024-04-25T13:55:29.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.675+0000 7f9c17f3f640 1 -- 172.21.15.43:0/3261119753 shutdown_connections 2024-04-25T13:55:29.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.675+0000 7f9c17f3f640 1 --2- 172.21.15.43:0/3261119753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c1010d380 0x7f9c1010f7a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:29.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.675+0000 7f9c17f3f640 1 --2- 172.21.15.43:0/3261119753 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c10102af0 0x7f9c10102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:29.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.675+0000 7f9c17f3f640 1 --2- 172.21.15.43:0/3261119753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c10108a20 0x7f9c101025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:29.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.675+0000 7f9c17f3f640 1 -- 172.21.15.43:0/3261119753 >> 172.21.15.43:0/3261119753 conn(0x7f9c10078110 msgr2=0x7f9c10078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:29.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.676+0000 7f9c17f3f640 1 -- 172.21.15.43:0/3261119753 shutdown_connections 2024-04-25T13:55:29.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.676+0000 7f9c17f3f640 1 -- 172.21.15.43:0/3261119753 wait complete. 2024-04-25T13:55:29.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.676+0000 7f9c17f3f640 1 Processor -- start 2024-04-25T13:55:29.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.676+0000 7f9c17f3f640 1 -- start start 2024-04-25T13:55:29.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c17f3f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c10102af0 0x7f9c1019b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:29.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c17f3f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c10108a20 0x7f9c1019b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:29.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c17f3f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c1010d380 0x7f9c1019be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:29.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c17f3f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9c10112ae0 con 0x7f9c10102af0 2024-04-25T13:55:29.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c17f3f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9c10112960 con 0x7f9c1010d380 2024-04-25T13:55:29.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c17f3f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9c10112c60 con 0x7f9c10108a20 2024-04-25T13:55:29.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c15cdb640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c10102af0 0x7f9c1019b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:29.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c15cdb640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c10102af0 0x7f9c1019b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59452/0 (socket says 172.21.15.43:59452) 2024-04-25T13:55:29.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c15cdb640 1 -- 172.21.15.43:0/3516095603 learned_addr learned my addr 172.21.15.43:0/3516095603 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:29.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c154da640 1 --2- 172.21.15.43:0/3516095603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c10108a20 0x7f9c1019b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:29.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c164dc640 1 --2- 172.21.15.43:0/3516095603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c1010d380 0x7f9c1019be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:29.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c15cdb640 1 -- 172.21.15.43:0/3516095603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c10108a20 msgr2=0x7f9c1019b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:29.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c15cdb640 1 --2- 172.21.15.43:0/3516095603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c10108a20 0x7f9c1019b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:29.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c15cdb640 1 -- 172.21.15.43:0/3516095603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c1010d380 msgr2=0x7f9c1019be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:29.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c15cdb640 1 --2- 172.21.15.43:0/3516095603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c1010d380 0x7f9c1019be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:29.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c15cdb640 1 -- 172.21.15.43:0/3516095603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c101a66d0 con 0x7f9c10102af0 2024-04-25T13:55:29.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c15cdb640 1 --2- 172.21.15.43:0/3516095603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c10102af0 0x7f9c1019b3c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00e9c0 tx=0x7f9c0c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:29.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c06ffd640 1 -- 172.21.15.43:0/3516095603 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00cd80 con 0x7f9c10102af0 2024-04-25T13:55:29.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c06ffd640 1 -- 172.21.15.43:0/3516095603 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c0c0054b0 con 0x7f9c10102af0 2024-04-25T13:55:29.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c06ffd640 1 -- 172.21.15.43:0/3516095603 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c010430 con 0x7f9c10102af0 2024-04-25T13:55:29.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c17f3f640 1 -- 172.21.15.43:0/3516095603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c101a69c0 con 0x7f9c10102af0 2024-04-25T13:55:29.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.677+0000 7f9c17f3f640 1 -- 172.21.15.43:0/3516095603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c101a6f10 con 0x7f9c10102af0 2024-04-25T13:55:29.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.678+0000 7f9c17f3f640 1 -- 172.21.15.43:0/3516095603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c10103cd0 con 0x7f9c10102af0 2024-04-25T13:55:29.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.680+0000 7f9c06ffd640 1 -- 172.21.15.43:0/3516095603 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7f9c0c004f20 con 0x7f9c10102af0 2024-04-25T13:55:29.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.681+0000 7f9c06ffd640 1 --2- 172.21.15.43:0/3516095603 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9bfc0afc60 0x7f9bfc0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:29.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.681+0000 7f9c154da640 1 --2- 172.21.15.43:0/3516095603 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9bfc0afc60 0x7f9bfc0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:29.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.681+0000 7f9c06ffd640 1 -- 172.21.15.43:0/3516095603 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9467+0+0 (secure 0 0 0) 0x7f9c0c0dfde0 con 0x7f9c10102af0 2024-04-25T13:55:29.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.681+0000 7f9c154da640 1 --2- 172.21.15.43:0/3516095603 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9bfc0afc60 0x7f9bfc0b2170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9c1010e8b0 tx=0x7f9c00005f90 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:29.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.684+0000 7f9c06ffd640 1 -- 172.21.15.43:0/3516095603 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9c0c0a82d0 con 0x7f9c10102af0 2024-04-25T13:55:29.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.911+0000 7f9c17f3f640 1 -- 172.21.15.43:0/3516095603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c1006afa0 con 0x7f9c10102af0 2024-04-25T13:55:29.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.911+0000 7f9c06ffd640 1 -- 172.21.15.43:0/3516095603 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11885 (secure 0 0 0) 0x7f9c0c0a7bd0 con 0x7f9c10102af0 2024-04-25T13:55:29.910 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:55:29.910 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2642701222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2642701222},{"type":"v1","addr":"172.21.15.43:6839","nonce":2642701222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6841/3777483996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":3777483996},{"type":"v1","addr":"172.21.15.43:6841","nonce":3777483996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T13:42:08.401075+0000","modified":"2024-04-25T13:47:14.010039+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24542,"mds_1":24509,"mds_2":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6839/3323587585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3323587585},{"type":"v1","addr":"172.21.15.175:6839","nonce":3323587585}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.161:6837/1464384320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1464384320},{"type":"v1","addr":"172.21.15.161:6837","nonce":1464384320}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6839/1243414461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":1243414461},{"type":"v1","addr":"172.21.15.161:6839","nonce":1243414461}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24542,"qdb_cluster":[24542,24509,24502]},"id":1}]} 2024-04-25T13:55:29.911 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 29 2024-04-25T13:55:29.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.914+0000 7f9c17f3f640 1 -- 172.21.15.43:0/3516095603 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9bfc0afc60 msgr2=0x7f9bfc0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:29.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.914+0000 7f9c17f3f640 1 --2- 172.21.15.43:0/3516095603 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9bfc0afc60 0x7f9bfc0b2170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9c1010e8b0 tx=0x7f9c00005f90 comp rx=0 tx=0).stop 2024-04-25T13:55:29.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.914+0000 7f9c17f3f640 1 -- 172.21.15.43:0/3516095603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c10102af0 msgr2=0x7f9c1019b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:29.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.914+0000 7f9c17f3f640 1 --2- 172.21.15.43:0/3516095603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c10102af0 0x7f9c1019b3c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00e9c0 tx=0x7f9c0c00ee80 comp rx=0 tx=0).stop 2024-04-25T13:55:29.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.914+0000 7f9c17f3f640 1 -- 172.21.15.43:0/3516095603 shutdown_connections 2024-04-25T13:55:29.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.914+0000 7f9c17f3f640 1 --2- 172.21.15.43:0/3516095603 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f9bfc0afc60 0x7f9bfc0b2170 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:29.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.914+0000 7f9c17f3f640 1 --2- 172.21.15.43:0/3516095603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c1010d380 0x7f9c1019be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:29.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.914+0000 7f9c17f3f640 1 --2- 172.21.15.43:0/3516095603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c10108a20 0x7f9c1019b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:29.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.914+0000 7f9c17f3f640 1 --2- 172.21.15.43:0/3516095603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c10102af0 0x7f9c1019b3c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:29.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.914+0000 7f9c17f3f640 1 -- 172.21.15.43:0/3516095603 >> 172.21.15.43:0/3516095603 conn(0x7f9c10078110 msgr2=0x7f9c101040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:29.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.914+0000 7f9c17f3f640 1 -- 172.21.15.43:0/3516095603 shutdown_connections 2024-04-25T13:55:29.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:29.914+0000 7f9c17f3f640 1 -- 172.21.15.43:0/3516095603 wait complete. 2024-04-25T13:55:29.924 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:55:30.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.040+0000 7fd7027ee640 1 -- 172.21.15.43:0/3222353444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6fc104c20 msgr2=0x7fd6fc105030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:30.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.040+0000 7fd7027ee640 1 --2- 172.21.15.43:0/3222353444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6fc104c20 0x7fd6fc105030 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009900 tx=0x7fd6ec02a410 comp rx=0 tx=0).stop 2024-04-25T13:55:30.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.040+0000 7fd7027ee640 1 -- 172.21.15.43:0/3222353444 shutdown_connections 2024-04-25T13:55:30.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.040+0000 7fd7027ee640 1 --2- 172.21.15.43:0/3222353444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6fc10e070 0x7fd6fc110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.040+0000 7fd7027ee640 1 --2- 172.21.15.43:0/3222353444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6fc10b680 0x7fd6fc10daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.040+0000 7fd7027ee640 1 --2- 172.21.15.43:0/3222353444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6fc104c20 0x7fd6fc105030 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.040+0000 7fd7027ee640 1 -- 172.21.15.43:0/3222353444 >> 172.21.15.43:0/3222353444 conn(0x7fd6fc0fe0c0 msgr2=0x7fd6fc100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:30.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.040+0000 7fd7027ee640 1 -- 172.21.15.43:0/3222353444 shutdown_connections 2024-04-25T13:55:30.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.040+0000 7fd7027ee640 1 -- 172.21.15.43:0/3222353444 wait complete. 2024-04-25T13:55:30.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.041+0000 7fd7027ee640 1 Processor -- start 2024-04-25T13:55:30.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.041+0000 7fd7027ee640 1 -- start start 2024-04-25T13:55:30.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd7027ee640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6fc104c20 0x7fd6fc19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd7027ee640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6fc10b680 0x7fd6fc19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd7027ee640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6fc10e070 0x7fd6fc19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd7027ee640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc113bd0 con 0x7fd6fc10e070 2024-04-25T13:55:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd7027ee640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc113a50 con 0x7fd6fc104c20 2024-04-25T13:55:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd7027ee640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc113d50 con 0x7fd6fc10b680 2024-04-25T13:55:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd700d8b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6fc10e070 0x7fd6fc19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd700d8b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6fc10e070 0x7fd6fc19eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59460/0 (socket says 172.21.15.43:59460) 2024-04-25T13:55:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd700d8b640 1 -- 172.21.15.43:0/2127421233 learned_addr learned my addr 172.21.15.43:0/2127421233 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd6fb7fe640 1 --2- 172.21.15.43:0/2127421233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6fc10b680 0x7fd6fc19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd6fbfff640 1 --2- 172.21.15.43:0/2127421233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6fc104c20 0x7fd6fc19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd700d8b640 1 -- 172.21.15.43:0/2127421233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6fc10b680 msgr2=0x7fd6fc19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd700d8b640 1 --2- 172.21.15.43:0/2127421233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6fc10b680 0x7fd6fc19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd700d8b640 1 -- 172.21.15.43:0/2127421233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6fc104c20 msgr2=0x7fd6fc19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:30.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd700d8b640 1 --2- 172.21.15.43:0/2127421233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6fc104c20 0x7fd6fc19a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd700d8b640 1 -- 172.21.15.43:0/2127421233 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6fc19f4f0 con 0x7fd6fc10e070 2024-04-25T13:55:30.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd700d8b640 1 --2- 172.21.15.43:0/2127421233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6fc10e070 0x7fd6fc19eeb0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400eaa0 tx=0x7fd6f400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:30.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd6f97fa640 1 -- 172.21.15.43:0/2127421233 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f400cdb0 con 0x7fd6fc10e070 2024-04-25T13:55:30.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.042+0000 7fd6f97fa640 1 -- 172.21.15.43:0/2127421233 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6f4005020 con 0x7fd6fc10e070 2024-04-25T13:55:30.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.043+0000 7fd7027ee640 1 -- 172.21.15.43:0/2127421233 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6fc19f7e0 con 0x7fd6fc10e070 2024-04-25T13:55:30.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.043+0000 7fd6f97fa640 1 -- 172.21.15.43:0/2127421233 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f40116d0 con 0x7fd6fc10e070 2024-04-25T13:55:30.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.043+0000 7fd7027ee640 1 -- 172.21.15.43:0/2127421233 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6fc19fce0 con 0x7fd6fc10e070 2024-04-25T13:55:30.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.044+0000 7fd7027ee640 1 -- 172.21.15.43:0/2127421233 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6fc069310 con 0x7fd6fc10e070 2024-04-25T13:55:30.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.045+0000 7fd6f97fa640 1 -- 172.21.15.43:0/2127421233 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7fd6f40051d0 con 0x7fd6fc10e070 2024-04-25T13:55:30.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.046+0000 7fd6f97fa640 1 --2- 172.21.15.43:0/2127421233 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fd6e40afc60 0x7fd6e40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:30.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.046+0000 7fd6fbfff640 1 --2- 172.21.15.43:0/2127421233 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fd6e40afc60 0x7fd6e40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:30.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.046+0000 7fd6f97fa640 1 -- 172.21.15.43:0/2127421233 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9467+0+0 (secure 0 0 0) 0x7fd6f40df8b0 con 0x7fd6fc10e070 2024-04-25T13:55:30.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.046+0000 7fd6fbfff640 1 --2- 172.21.15.43:0/2127421233 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fd6e40afc60 0x7fd6e40b2170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec006010 tx=0x7fd6ec000bc0 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:30.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.049+0000 7fd6f97fa640 1 -- 172.21.15.43:0/2127421233 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd6fc19fce0 con 0x7fd6fc10e070 2024-04-25T13:55:30.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.276+0000 7fd7027ee640 1 -- 172.21.15.43:0/2127421233 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6fc19b9e0 con 0x7fd6fc10e070 2024-04-25T13:55:30.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.277+0000 7fd6f97fa640 1 -- 172.21.15.43:0/2127421233 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11885 (secure 0 0 0) 0x7fd6f4016030 con 0x7fd6fc10e070 2024-04-25T13:55:30.275 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:55:30.276 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/73004272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":73004272},{"type":"v1","addr":"172.21.15.43:6835","nonce":73004272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/624870499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":624870499},{"type":"v1","addr":"172.21.15.43:6837","nonce":624870499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2642701222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2642701222},{"type":"v1","addr":"172.21.15.43:6839","nonce":2642701222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6841/3777483996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":3777483996},{"type":"v1","addr":"172.21.15.43:6841","nonce":3777483996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2054284229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2054284229},{"type":"v1","addr":"172.21.15.175:6833","nonce":2054284229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/519829901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":519829901},{"type":"v1","addr":"172.21.15.161:6833","nonce":519829901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T13:42:08.401075+0000","modified":"2024-04-25T13:47:14.010039+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24542,"mds_1":24509,"mds_2":24502},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24463":{"gid":24463,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1225446538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1225446538},{"type":"v1","addr":"172.21.15.175:6835","nonce":1225446538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.161:6835/2378707176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2378707176},{"type":"v1","addr":"172.21.15.161:6835","nonce":2378707176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2732559521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2732559521},{"type":"v1","addr":"172.21.15.175:6837","nonce":2732559521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6839/3323587585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3323587585},{"type":"v1","addr":"172.21.15.175:6839","nonce":3323587585}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.161:6837/1464384320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1464384320},{"type":"v1","addr":"172.21.15.161:6837","nonce":1464384320}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6839/1243414461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6838","nonce":1243414461},{"type":"v1","addr":"172.21.15.161:6839","nonce":1243414461}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24542,"qdb_cluster":[24542,24509,24502]},"id":1}]} 2024-04-25T13:55:30.276 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 29 2024-04-25T13:55:30.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.278+0000 7fd7027ee640 1 -- 172.21.15.43:0/2127421233 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fd6e40afc60 msgr2=0x7fd6e40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:30.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.279+0000 7fd7027ee640 1 --2- 172.21.15.43:0/2127421233 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fd6e40afc60 0x7fd6e40b2170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec006010 tx=0x7fd6ec000bc0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.279+0000 7fd7027ee640 1 -- 172.21.15.43:0/2127421233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6fc10e070 msgr2=0x7fd6fc19eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.279+0000 7fd7027ee640 1 --2- 172.21.15.43:0/2127421233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6fc10e070 0x7fd6fc19eeb0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400eaa0 tx=0x7fd6f400ef60 comp rx=0 tx=0).stop 2024-04-25T13:55:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.279+0000 7fd7027ee640 1 -- 172.21.15.43:0/2127421233 shutdown_connections 2024-04-25T13:55:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.279+0000 7fd7027ee640 1 --2- 172.21.15.43:0/2127421233 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fd6e40afc60 0x7fd6e40b2170 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.279+0000 7fd7027ee640 1 --2- 172.21.15.43:0/2127421233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6fc10e070 0x7fd6fc19eeb0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.279+0000 7fd7027ee640 1 --2- 172.21.15.43:0/2127421233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6fc10b680 0x7fd6fc19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.279+0000 7fd7027ee640 1 --2- 172.21.15.43:0/2127421233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6fc104c20 0x7fd6fc19a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.279+0000 7fd7027ee640 1 -- 172.21.15.43:0/2127421233 >> 172.21.15.43:0/2127421233 conn(0x7fd6fc0fe0c0 msgr2=0x7fd6fc10e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.279+0000 7fd7027ee640 1 -- 172.21.15.43:0/2127421233 shutdown_connections 2024-04-25T13:55:30.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.279+0000 7fd7027ee640 1 -- 172.21.15.43:0/2127421233 wait complete. 2024-04-25T13:55:30.288 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:30 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/3516095603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:55:30.289 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:55:30.300 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:30 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/3516095603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:55:30.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:30 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/3516095603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:55:30.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.402+0000 7fe5f9429640 1 -- 172.21.15.43:0/1191659738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5f4114ad0 msgr2=0x7fe5f4116ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:30.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.402+0000 7fe5f9429640 1 --2- 172.21.15.43:0/1191659738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5f4114ad0 0x7fe5f4116ef0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009ca0 tx=0x7fe5ec02a950 comp rx=0 tx=0).stop 2024-04-25T13:55:30.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.402+0000 7fe5f9429640 1 -- 172.21.15.43:0/1191659738 shutdown_connections 2024-04-25T13:55:30.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.402+0000 7fe5f9429640 1 --2- 172.21.15.43:0/1191659738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5f4114ad0 0x7fe5f4116ef0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.402+0000 7fe5f9429640 1 --2- 172.21.15.43:0/1191659738 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5f4112170 0x7fe5f4114590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.402+0000 7fe5f9429640 1 --2- 172.21.15.43:0/1191659738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5f4076470 0x7fe5f4076880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.402+0000 7fe5f9429640 1 -- 172.21.15.43:0/1191659738 >> 172.21.15.43:0/1191659738 conn(0x7fe5f40ff1b0 msgr2=0x7fe5f4101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:30.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.402+0000 7fe5f9429640 1 -- 172.21.15.43:0/1191659738 shutdown_connections 2024-04-25T13:55:30.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.402+0000 7fe5f9429640 1 -- 172.21.15.43:0/1191659738 wait complete. 2024-04-25T13:55:30.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.403+0000 7fe5f9429640 1 Processor -- start 2024-04-25T13:55:30.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.403+0000 7fe5f9429640 1 -- start start 2024-04-25T13:55:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.403+0000 7fe5f9429640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5f4076470 0x7fe5f41a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.403+0000 7fe5f9429640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5f4112170 0x7fe5f41a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.403+0000 7fe5f9429640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5f4114ad0 0x7fe5f41a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.403+0000 7fe5f9429640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f411a160 con 0x7fe5f4076470 2024-04-25T13:55:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.403+0000 7fe5f9429640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f4119fe0 con 0x7fe5f4112170 2024-04-25T13:55:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.403+0000 7fe5f9429640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f411a2e0 con 0x7fe5f4114ad0 2024-04-25T13:55:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.404+0000 7fe5f2ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5f4076470 0x7fe5f41a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.404+0000 7fe5f2ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5f4076470 0x7fe5f41a67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59476/0 (socket says 172.21.15.43:59476) 2024-04-25T13:55:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.404+0000 7fe5f2ffd640 1 -- 172.21.15.43:0/1599246001 learned_addr learned my addr 172.21.15.43:0/1599246001 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.404+0000 7fe5ebfff640 1 --2- 172.21.15.43:0/1599246001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5f4112170 0x7fe5f41a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.404+0000 7fe5f2ffd640 1 -- 172.21.15.43:0/1599246001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5f4114ad0 msgr2=0x7fe5f41a09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.404+0000 7fe5f37fe640 1 --2- 172.21.15.43:0/1599246001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5f4114ad0 0x7fe5f41a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.404+0000 7fe5f2ffd640 1 --2- 172.21.15.43:0/1599246001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5f4114ad0 0x7fe5f41a09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.404+0000 7fe5f2ffd640 1 -- 172.21.15.43:0/1599246001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5f4112170 msgr2=0x7fe5f41a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:30.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.404+0000 7fe5f2ffd640 1 --2- 172.21.15.43:0/1599246001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5f4112170 0x7fe5f41a6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.404+0000 7fe5f2ffd640 1 -- 172.21.15.43:0/1599246001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f41a1080 con 0x7fe5f4076470 2024-04-25T13:55:30.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.404+0000 7fe5f2ffd640 1 --2- 172.21.15.43:0/1599246001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5f4076470 0x7fe5f41a67d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400c890 tx=0x7fe5e400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:30.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.404+0000 7fe5f0ff9640 1 -- 172.21.15.43:0/1599246001 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4004220 con 0x7fe5f4076470 2024-04-25T13:55:30.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.404+0000 7fe5f0ff9640 1 -- 172.21.15.43:0/1599246001 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5e4007e40 con 0x7fe5f4076470 2024-04-25T13:55:30.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.404+0000 7fe5f9429640 1 -- 172.21.15.43:0/1599246001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f41a1370 con 0x7fe5f4076470 2024-04-25T13:55:30.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.404+0000 7fe5f0ff9640 1 -- 172.21.15.43:0/1599246001 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4004a00 con 0x7fe5f4076470 2024-04-25T13:55:30.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.404+0000 7fe5f9429640 1 -- 172.21.15.43:0/1599246001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f41ad650 con 0x7fe5f4076470 2024-04-25T13:55:30.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.405+0000 7fe5f9429640 1 -- 172.21.15.43:0/1599246001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f406a190 con 0x7fe5f4076470 2024-04-25T13:55:30.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.407+0000 7fe5f0ff9640 1 -- 172.21.15.43:0/1599246001 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7fe5e40079b0 con 0x7fe5f4076470 2024-04-25T13:55:30.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.408+0000 7fe5f0ff9640 1 --2- 172.21.15.43:0/1599246001 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe5e00afce0 0x7fe5e00b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:30.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.408+0000 7fe5ebfff640 1 --2- 172.21.15.43:0/1599246001 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe5e00afce0 0x7fe5e00b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:30.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.408+0000 7fe5f0ff9640 1 -- 172.21.15.43:0/1599246001 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9467+0+0 (secure 0 0 0) 0x7fe5e40df4f0 con 0x7fe5f4076470 2024-04-25T13:55:30.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.409+0000 7fe5ebfff640 1 --2- 172.21.15.43:0/1599246001 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe5e00afce0 0x7fe5e00b21f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc005e00 tx=0x7fe5dc005c50 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:30.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.412+0000 7fe5f0ff9640 1 -- 172.21.15.43:0/1599246001 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe5e4014030 con 0x7fe5f4076470 2024-04-25T13:55:30.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.599+0000 7fe5f9429640 1 -- 172.21.15.43:0/1599246001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5f41023f0 con 0x7fe5f4076470 2024-04-25T13:55:30.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.600+0000 7fe5f0ff9640 1 -- 172.21.15.43:0/1599246001 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+25250 (secure 0 0 0) 0x7fe5e40a7a80 con 0x7fe5f4076470 2024-04-25T13:55:30.600 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T13:55:30.600 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":95,"fsid":"394efb6c-0308-11ef-bc93-c7b262605968","created":"2024-04-25T13:33:57.051082+0000","modified":"2024-04-25T13:55:16.905528+0000","last_up_change":"2024-04-25T13:41:17.797375+0000","last_in_change":"2024-04-25T13:40:56.845994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:37:25.931659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:06.202688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:07.348534+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":94,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:42:11.056739+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":94,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c8e639a2-eae9-4bfb-8f2c-f94cc7d86943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6803","nonce":532985348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6805","nonce":532985348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6809","nonce":532985348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":532985348},{"type":"v1","addr":"172.21.15.43:6807","nonce":532985348}]},"public_addr":"172.21.15.43:6803/532985348","cluster_addr":"172.21.15.43:6805/532985348","heartbeat_back_addr":"172.21.15.43:6809/532985348","heartbeat_front_addr":"172.21.15.43:6807/532985348","state":["exists","up"]},{"osd":1,"uuid":"060783b1-704f-4e3a-ba2b-b07d8e6b8946","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6801","nonce":2031999337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6803","nonce":2031999337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6807","nonce":2031999337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2031999337},{"type":"v1","addr":"172.21.15.161:6805","nonce":2031999337}]},"public_addr":"172.21.15.161:6801/2031999337","cluster_addr":"172.21.15.161:6803/2031999337","heartbeat_back_addr":"172.21.15.161:6807/2031999337","heartbeat_front_addr":"172.21.15.161:6805/2031999337","state":["exists","up"]},{"osd":2,"uuid":"89fff4e4-9a15-4baf-830e-53c0b1dd33fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6801","nonce":1555612698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6803","nonce":1555612698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6807","nonce":1555612698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1555612698},{"type":"v1","addr":"172.21.15.175:6805","nonce":1555612698}]},"public_addr":"172.21.15.175:6801/1555612698","cluster_addr":"172.21.15.175:6803/1555612698","heartbeat_back_addr":"172.21.15.175:6807/1555612698","heartbeat_front_addr":"172.21.15.175:6805/1555612698","state":["exists","up"]},{"osd":3,"uuid":"86d23f16-1b89-475e-9700-03a3f131daa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6811","nonce":253965514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6813","nonce":253965514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6817","nonce":253965514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":253965514},{"type":"v1","addr":"172.21.15.43:6815","nonce":253965514}]},"public_addr":"172.21.15.43:6811/253965514","cluster_addr":"172.21.15.43:6813/253965514","heartbeat_back_addr":"172.21.15.43:6817/253965514","heartbeat_front_addr":"172.21.15.43:6815/253965514","state":["exists","up"]},{"osd":4,"uuid":"efd85b77-da0c-48de-9338-6d8f5493aef8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6809","nonce":2720970010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6811","nonce":2720970010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6815","nonce":2720970010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":2720970010},{"type":"v1","addr":"172.21.15.161:6813","nonce":2720970010}]},"public_addr":"172.21.15.161:6809/2720970010","cluster_addr":"172.21.15.161:6811/2720970010","heartbeat_back_addr":"172.21.15.161:6815/2720970010","heartbeat_front_addr":"172.21.15.161:6813/2720970010","state":["exists","up"]},{"osd":5,"uuid":"41a6e540-aec0-48a6-a114-8dc9e0a8c0cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6809","nonce":1053472329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6811","nonce":1053472329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6815","nonce":1053472329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1053472329},{"type":"v1","addr":"172.21.15.175:6813","nonce":1053472329}]},"public_addr":"172.21.15.175:6809/1053472329","cluster_addr":"172.21.15.175:6811/1053472329","heartbeat_back_addr":"172.21.15.175:6815/1053472329","heartbeat_front_addr":"172.21.15.175:6813/1053472329","state":["exists","up"]},{"osd":6,"uuid":"42edbda7-0a4e-467b-8432-fd2fed66e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6819","nonce":3787838261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6821","nonce":3787838261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6825","nonce":3787838261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3787838261},{"type":"v1","addr":"172.21.15.43:6823","nonce":3787838261}]},"public_addr":"172.21.15.43:6819/3787838261","cluster_addr":"172.21.15.43:6821/3787838261","heartbeat_back_addr":"172.21.15.43:6825/3787838261","heartbeat_front_addr":"172.21.15.43:6823/3787838261","state":["exists","up"]},{"osd":7,"uuid":"c2ddcb6f-9e91-4c87-a504-c1182a462b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6817","nonce":729366149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6819","nonce":729366149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6823","nonce":729366149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":729366149},{"type":"v1","addr":"172.21.15.161:6821","nonce":729366149}]},"public_addr":"172.21.15.161:6817/729366149","cluster_addr":"172.21.15.161:6819/729366149","heartbeat_back_addr":"172.21.15.161:6823/729366149","heartbeat_front_addr":"172.21.15.161:6821/729366149","state":["exists","up"]},{"osd":8,"uuid":"edadbbdb-521a-4daf-ac1b-8dbed78b06fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6817","nonce":2453339282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6819","nonce":2453339282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6823","nonce":2453339282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2453339282},{"type":"v1","addr":"172.21.15.175:6821","nonce":2453339282}]},"public_addr":"172.21.15.175:6817/2453339282","cluster_addr":"172.21.15.175:6819/2453339282","heartbeat_back_addr":"172.21.15.175:6823/2453339282","heartbeat_front_addr":"172.21.15.175:6821/2453339282","state":["exists","up"]},{"osd":9,"uuid":"424f05d6-5bc6-411f-86be-25a4cfe48ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6827","nonce":844074677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6829","nonce":844074677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6833","nonce":844074677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":844074677},{"type":"v1","addr":"172.21.15.43:6831","nonce":844074677}]},"public_addr":"172.21.15.43:6827/844074677","cluster_addr":"172.21.15.43:6829/844074677","heartbeat_back_addr":"172.21.15.43:6833/844074677","heartbeat_front_addr":"172.21.15.43:6831/844074677","state":["exists","up"]},{"osd":10,"uuid":"e36b0893-8620-4ece-a175-b86a0f944f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6825","nonce":2874955800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6827","nonce":2874955800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6831","nonce":2874955800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":2874955800},{"type":"v1","addr":"172.21.15.161:6829","nonce":2874955800}]},"public_addr":"172.21.15.161:6825/2874955800","cluster_addr":"172.21.15.161:6827/2874955800","heartbeat_back_addr":"172.21.15.161:6831/2874955800","heartbeat_front_addr":"172.21.15.161:6829/2874955800","state":["exists","up"]},{"osd":11,"uuid":"a2e5f0dd-7b17-47e1-b437-933d47a399a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6825","nonce":1911970947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6827","nonce":1911970947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6831","nonce":1911970947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1911970947},{"type":"v1","addr":"172.21.15.175:6829","nonce":1911970947}]},"public_addr":"172.21.15.175:6825/1911970947","cluster_addr":"172.21.15.175:6827/1911970947","heartbeat_back_addr":"172.21.15.175:6831/1911970947","heartbeat_front_addr":"172.21.15.175:6829/1911970947","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:33.855366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:36:58.591984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:22.056219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:37:47.051325+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:12.411571+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:38:37.794524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:04.339263+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:30.140725+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:39:55.570705+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:22.476638+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:40:49.084643+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:15.691402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/775979394":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1063219824":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/2028903966":"2024-04-26T13:44:35.638372+0000","172.21.15.43:0/21237256":"2024-04-26T13:44:35.638372+0000","172.21.15.43:6801/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1369825389":"2024-04-26T13:44:35.638372+0000","172.21.15.43:6800/1629086480":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/2307776489":"2024-04-26T13:44:35.638372+0000","172.21.15.43:6800/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/2478639579":"2024-04-26T13:44:35.638372+0000","172.21.15.43:0/1985552645":"2024-04-26T13:34:57.835176+0000","172.21.15.43:0/1274235665":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6801/3816223875":"2024-04-26T13:34:30.246627+0000","172.21.15.43:6800/2478639579":"2024-04-26T13:44:35.638372+0000","172.21.15.43:0/1022690204":"2024-04-26T13:34:30.246627+0000","172.21.15.43:0/3992074212":"2024-04-26T13:34:30.246627+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:55:30.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.603+0000 7fe5f9429640 1 -- 172.21.15.43:0/1599246001 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe5e00afce0 msgr2=0x7fe5e00b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:30.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.603+0000 7fe5f9429640 1 --2- 172.21.15.43:0/1599246001 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe5e00afce0 0x7fe5e00b21f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc005e00 tx=0x7fe5dc005c50 comp rx=0 tx=0).stop 2024-04-25T13:55:30.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.603+0000 7fe5f9429640 1 -- 172.21.15.43:0/1599246001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5f4076470 msgr2=0x7fe5f41a67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:30.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.603+0000 7fe5f9429640 1 --2- 172.21.15.43:0/1599246001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5f4076470 0x7fe5f41a67d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400c890 tx=0x7fe5e400cd50 comp rx=0 tx=0).stop 2024-04-25T13:55:30.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.603+0000 7fe5f9429640 1 -- 172.21.15.43:0/1599246001 shutdown_connections 2024-04-25T13:55:30.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.603+0000 7fe5f9429640 1 --2- 172.21.15.43:0/1599246001 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe5e00afce0 0x7fe5e00b21f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.603+0000 7fe5f9429640 1 --2- 172.21.15.43:0/1599246001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5f4114ad0 0x7fe5f41a09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.603+0000 7fe5f9429640 1 --2- 172.21.15.43:0/1599246001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5f4112170 0x7fe5f41a6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.603+0000 7fe5f9429640 1 --2- 172.21.15.43:0/1599246001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5f4076470 0x7fe5f41a67d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.603+0000 7fe5f9429640 1 -- 172.21.15.43:0/1599246001 >> 172.21.15.43:0/1599246001 conn(0x7fe5f40ff1b0 msgr2=0x7fe5f40ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:30.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.603+0000 7fe5f9429640 1 -- 172.21.15.43:0/1599246001 shutdown_connections 2024-04-25T13:55:30.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.603+0000 7fe5f9429640 1 -- 172.21.15.43:0/1599246001 wait complete. 2024-04-25T13:55:30.614 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T13:55:30.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.732+0000 7fe319a51640 1 -- 172.21.15.43:0/646381876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe314109fb0 msgr2=0x7fe314103c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:30.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.732+0000 7fe319a51640 1 --2- 172.21.15.43:0/646381876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe314109fb0 0x7fe314103c40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009900 tx=0x7fe2fc02a410 comp rx=0 tx=0).stop 2024-04-25T13:55:30.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.732+0000 7fe319a51640 1 -- 172.21.15.43:0/646381876 shutdown_connections 2024-04-25T13:55:30.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.732+0000 7fe319a51640 1 --2- 172.21.15.43:0/646381876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3141042b0 0x7fe314110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.732+0000 7fe319a51640 1 --2- 172.21.15.43:0/646381876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe314109fb0 0x7fe314103c40 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.732+0000 7fe319a51640 1 --2- 172.21.15.43:0/646381876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe314109b10 0x7fe314103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.732+0000 7fe319a51640 1 -- 172.21.15.43:0/646381876 >> 172.21.15.43:0/646381876 conn(0x7fe3140ff360 msgr2=0x7fe314101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:30.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.732+0000 7fe319a51640 1 -- 172.21.15.43:0/646381876 shutdown_connections 2024-04-25T13:55:30.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.732+0000 7fe319a51640 1 -- 172.21.15.43:0/646381876 wait complete. 2024-04-25T13:55:30.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.733+0000 7fe319a51640 1 Processor -- start 2024-04-25T13:55:30.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.733+0000 7fe319a51640 1 -- start start 2024-04-25T13:55:30.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.733+0000 7fe319a51640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3141042b0 0x7fe31419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:30.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.733+0000 7fe319a51640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe314109b10 0x7fe31419acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:30.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.733+0000 7fe319a51640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe314109fb0 0x7fe31419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:30.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.733+0000 7fe319a51640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe314113bb0 con 0x7fe314109fb0 2024-04-25T13:55:30.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.733+0000 7fe319a51640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe314113a30 con 0x7fe314109b10 2024-04-25T13:55:30.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.733+0000 7fe319a51640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe314113d30 con 0x7fe3141042b0 2024-04-25T13:55:30.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.733+0000 7fe3137fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe314109fb0 0x7fe31419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:30.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.733+0000 7fe3137fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe314109fb0 0x7fe31419ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59492/0 (socket says 172.21.15.43:59492) 2024-04-25T13:55:30.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.733+0000 7fe3137fe640 1 -- 172.21.15.43:0/830588182 learned_addr learned my addr 172.21.15.43:0/830588182 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:30.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.734+0000 7fe312ffd640 1 --2- 172.21.15.43:0/830588182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3141042b0 0x7fe31419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:30.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.734+0000 7fe3127fc640 1 --2- 172.21.15.43:0/830588182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe314109b10 0x7fe31419acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:30.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.734+0000 7fe3137fe640 1 -- 172.21.15.43:0/830588182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3141042b0 msgr2=0x7fe31419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:30.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.734+0000 7fe3137fe640 1 --2- 172.21.15.43:0/830588182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3141042b0 0x7fe31419a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.734+0000 7fe3137fe640 1 -- 172.21.15.43:0/830588182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe314109b10 msgr2=0x7fe31419acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:30.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.734+0000 7fe3137fe640 1 --2- 172.21.15.43:0/830588182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe314109b10 0x7fe31419acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.734+0000 7fe3137fe640 1 -- 172.21.15.43:0/830588182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31419f5b0 con 0x7fe314109fb0 2024-04-25T13:55:30.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.734+0000 7fe3137fe640 1 --2- 172.21.15.43:0/830588182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe314109fb0 0x7fe31419ef70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00eaa0 tx=0x7fe30c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:30.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.734+0000 7fe318a4f640 1 -- 172.21.15.43:0/830588182 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00cdb0 con 0x7fe314109fb0 2024-04-25T13:55:30.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.734+0000 7fe319a51640 1 -- 172.21.15.43:0/830588182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31419f8a0 con 0x7fe314109fb0 2024-04-25T13:55:30.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.734+0000 7fe318a4f640 1 -- 172.21.15.43:0/830588182 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe30c005020 con 0x7fe314109fb0 2024-04-25T13:55:30.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.734+0000 7fe318a4f640 1 -- 172.21.15.43:0/830588182 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0116d0 con 0x7fe314109fb0 2024-04-25T13:55:30.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.734+0000 7fe319a51640 1 -- 172.21.15.43:0/830588182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe31419fd70 con 0x7fe314109fb0 2024-04-25T13:55:30.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.736+0000 7fe319a51640 1 -- 172.21.15.43:0/830588182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3140692e0 con 0x7fe314109fb0 2024-04-25T13:55:30.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.737+0000 7fe318a4f640 1 -- 172.21.15.43:0/830588182 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7fe30c0051d0 con 0x7fe314109fb0 2024-04-25T13:55:30.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.738+0000 7fe318a4f640 1 --2- 172.21.15.43:0/830588182 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe3000afc60 0x7fe3000b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:30.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.738+0000 7fe318a4f640 1 -- 172.21.15.43:0/830588182 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9467+0+0 (secure 0 0 0) 0x7fe30c0df580 con 0x7fe314109fb0 2024-04-25T13:55:30.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.738+0000 7fe312ffd640 1 --2- 172.21.15.43:0/830588182 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe3000afc60 0x7fe3000b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:30.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.739+0000 7fe312ffd640 1 --2- 172.21.15.43:0/830588182 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe3000afc60 0x7fe3000b2170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe304005fd0 tx=0x7fe30400b390 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:30.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.743+0000 7fe318a4f640 1 -- 172.21.15.43:0/830588182 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe30c016030 con 0x7fe314109fb0 2024-04-25T13:55:30.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.970+0000 7fe319a51640 1 -- 172.21.15.43:0/830588182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe3141a72e0 con 0x7fe314109fb0 2024-04-25T13:55:30.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.973+0000 7fe318a4f640 1 -- 172.21.15.43:0/830588182 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7fe30c0a7420 con 0x7fe314109fb0 2024-04-25T13:55:30.971 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T13:55:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.976+0000 7fe319a51640 1 -- 172.21.15.43:0/830588182 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe3000afc60 msgr2=0x7fe3000b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.976+0000 7fe319a51640 1 --2- 172.21.15.43:0/830588182 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe3000afc60 0x7fe3000b2170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe304005fd0 tx=0x7fe30400b390 comp rx=0 tx=0).stop 2024-04-25T13:55:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.976+0000 7fe319a51640 1 -- 172.21.15.43:0/830588182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe314109fb0 msgr2=0x7fe31419ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.976+0000 7fe319a51640 1 --2- 172.21.15.43:0/830588182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe314109fb0 0x7fe31419ef70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00eaa0 tx=0x7fe30c00ef60 comp rx=0 tx=0).stop 2024-04-25T13:55:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.976+0000 7fe319a51640 1 -- 172.21.15.43:0/830588182 shutdown_connections 2024-04-25T13:55:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.976+0000 7fe319a51640 1 --2- 172.21.15.43:0/830588182 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fe3000afc60 0x7fe3000b2170 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.976+0000 7fe319a51640 1 --2- 172.21.15.43:0/830588182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe314109fb0 0x7fe31419ef70 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.976+0000 7fe319a51640 1 --2- 172.21.15.43:0/830588182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe314109b10 0x7fe31419acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.976+0000 7fe319a51640 1 --2- 172.21.15.43:0/830588182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3141042b0 0x7fe31419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.976+0000 7fe319a51640 1 -- 172.21.15.43:0/830588182 >> 172.21.15.43:0/830588182 conn(0x7fe3140ff360 msgr2=0x7fe31410f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.976+0000 7fe319a51640 1 -- 172.21.15.43:0/830588182 shutdown_connections 2024-04-25T13:55:30.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:30.976+0000 7fe319a51640 1 -- 172.21.15.43:0/830588182 wait complete. 2024-04-25T13:55:30.987 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T13:55:31.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.107+0000 7f29274aa640 1 -- 172.21.15.43:0/3104396021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2920109b10 msgr2=0x7f2920103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:31.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.107+0000 7f29274aa640 1 --2- 172.21.15.43:0/3104396021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2920109b10 0x7f2920103700 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f291c009900 tx=0x7f291c02a410 comp rx=0 tx=0).stop 2024-04-25T13:55:31.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.107+0000 7f29274aa640 1 -- 172.21.15.43:0/3104396021 shutdown_connections 2024-04-25T13:55:31.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.107+0000 7f29274aa640 1 --2- 172.21.15.43:0/3104396021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29201042b0 0x7f2920110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:31.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.107+0000 7f29274aa640 1 --2- 172.21.15.43:0/3104396021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2920109fb0 0x7f2920103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:31.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.107+0000 7f29274aa640 1 --2- 172.21.15.43:0/3104396021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2920109b10 0x7f2920103700 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:31.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.107+0000 7f29274aa640 1 -- 172.21.15.43:0/3104396021 >> 172.21.15.43:0/3104396021 conn(0x7f29200ff360 msgr2=0x7f2920101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:31.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.107+0000 7f29274aa640 1 -- 172.21.15.43:0/3104396021 shutdown_connections 2024-04-25T13:55:31.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.107+0000 7f29274aa640 1 -- 172.21.15.43:0/3104396021 wait complete. 2024-04-25T13:55:31.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.108+0000 7f29274aa640 1 Processor -- start 2024-04-25T13:55:31.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.108+0000 7f29274aa640 1 -- start start 2024-04-25T13:55:31.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.108+0000 7f29274aa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29201042b0 0x7f292019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:31.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.108+0000 7f29274aa640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2920109b10 0x7f292019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:31.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.108+0000 7f29274aa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2920109fb0 0x7f292019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:31.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.108+0000 7f29274aa640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2920113bb0 con 0x7f2920109b10 2024-04-25T13:55:31.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.108+0000 7f29274aa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2920113a30 con 0x7f2920109fb0 2024-04-25T13:55:31.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.108+0000 7f29274aa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2920113d30 con 0x7f29201042b0 2024-04-25T13:55:31.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.108+0000 7f2924a45640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2920109b10 0x7f292019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:31.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.109+0000 7f2924a45640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2920109b10 0x7f292019abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59506/0 (socket says 172.21.15.43:59506) 2024-04-25T13:55:31.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.109+0000 7f2924a45640 1 -- 172.21.15.43:0/2866040932 learned_addr learned my addr 172.21.15.43:0/2866040932 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:31.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.109+0000 7f2925a47640 1 --2- 172.21.15.43:0/2866040932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2920109fb0 0x7f292019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:31.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.109+0000 7f2925246640 1 --2- 172.21.15.43:0/2866040932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29201042b0 0x7f292019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:31.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.109+0000 7f2924a45640 1 -- 172.21.15.43:0/2866040932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29201042b0 msgr2=0x7f292019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:31.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.109+0000 7f2924a45640 1 --2- 172.21.15.43:0/2866040932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29201042b0 0x7f292019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:31.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.109+0000 7f2924a45640 1 -- 172.21.15.43:0/2866040932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2920109fb0 msgr2=0x7f292019eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:31.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.109+0000 7f2924a45640 1 --2- 172.21.15.43:0/2866040932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2920109fb0 0x7f292019eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:31.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.109+0000 7f2924a45640 1 -- 172.21.15.43:0/2866040932 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292019f4f0 con 0x7f2920109b10 2024-04-25T13:55:31.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.109+0000 7f2925a47640 1 --2- 172.21.15.43:0/2866040932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2920109fb0 0x7f292019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:55:31.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.109+0000 7f2924a45640 1 --2- 172.21.15.43:0/2866040932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2920109b10 0x7f292019abf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f291000e980 tx=0x7f291000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:31.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.109+0000 7f29167fc640 1 -- 172.21.15.43:0/2866040932 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291000cd80 con 0x7f2920109b10 2024-04-25T13:55:31.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.109+0000 7f29274aa640 1 -- 172.21.15.43:0/2866040932 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292019f7e0 con 0x7f2920109b10 2024-04-25T13:55:31.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.109+0000 7f29167fc640 1 -- 172.21.15.43:0/2866040932 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29100108c0 con 0x7f2920109b10 2024-04-25T13:55:31.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.109+0000 7f29167fc640 1 -- 172.21.15.43:0/2866040932 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910018840 con 0x7f2920109b10 2024-04-25T13:55:31.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.109+0000 7f29274aa640 1 -- 172.21.15.43:0/2866040932 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29201a7160 con 0x7f2920109b10 2024-04-25T13:55:31.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.111+0000 7f29274aa640 1 -- 172.21.15.43:0/2866040932 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29200692e0 con 0x7f2920109b10 2024-04-25T13:55:31.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.112+0000 7f29167fc640 1 -- 172.21.15.43:0/2866040932 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7f291001f020 con 0x7f2920109b10 2024-04-25T13:55:31.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.113+0000 7f29167fc640 1 --2- 172.21.15.43:0/2866040932 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f290c0afc60 0x7f290c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:31.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.113+0000 7f2925246640 1 --2- 172.21.15.43:0/2866040932 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f290c0afc60 0x7f290c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:31.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.113+0000 7f29167fc640 1 -- 172.21.15.43:0/2866040932 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9637+0+0 (secure 0 0 0) 0x7f29100dfa90 con 0x7f2920109b10 2024-04-25T13:55:31.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.114+0000 7f2925246640 1 --2- 172.21.15.43:0/2866040932 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f290c0afc60 0x7f290c0b2170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f291c004770 tx=0x7f291c0058d0 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:31.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.117+0000 7f29167fc640 1 -- 172.21.15.43:0/2866040932 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f29100a7ed0 con 0x7f2920109b10 2024-04-25T13:55:31.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-mon[32649]: pgmap v340: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-04-25T13:55:31.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2127421233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:55:31.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1599246001' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:55:31.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/830588182' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-25T13:55:31.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-mon[32649]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T13:55:31.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-mon[32649]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T13:55:31.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/830588182' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-25T13:55:31.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-mon[32649]: osdmap e96: 12 total, 12 up, 12 in 2024-04-25T13:55:31.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-mon[32649]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-04-25T13:55:31.181 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-c[62806]: ignoring --setuser ceph since I am not root 2024-04-25T13:55:31.181 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-c[62806]: ignoring --setgroup ceph since I am not root 2024-04-25T13:55:31.181 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-mds[62810]: -- 172.21.15.175:0/3000349489 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d73bc67a40 con 0x55d73bcaf180 2024-04-25T13:55:31.181 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-c[62806]: starting mds.c at 2024-04-25T13:55:31.181 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-i[63113]: ignoring --setuser ceph since I am not root 2024-04-25T13:55:31.182 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-i[63113]: ignoring --setgroup ceph since I am not root 2024-04-25T13:55:31.182 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-mds[63117]: -- 172.21.15.175:0/819341967 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563223b71a40 con 0x563223bb9600 2024-04-25T13:55:31.182 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-i[63113]: starting mds.i at 2024-04-25T13:55:31.182 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-f[62499]: ignoring --setuser ceph since I am not root 2024-04-25T13:55:31.182 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-f[62499]: ignoring --setgroup ceph since I am not root 2024-04-25T13:55:31.182 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-mds[62503]: -- 172.21.15.175:0/1690297445 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b46cc4da40 con 0x55b46cc95a80 2024-04-25T13:55:31.182 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-f[62499]: starting mds.f at 2024-04-25T13:55:31.182 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:55:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-f[62499]: 2024-04-25T13:55:31.045+0000 7f7ae6d4d700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6835/0: (98) Address already in use 2024-04-25T13:55:31.290 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:30 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-a[29191]: 2024-04-25T13:55:30.971+0000 7fb1288e4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T13:55:31.290 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:31 smithi043 ceph-mon[29195]: pgmap v340: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-04-25T13:55:31.290 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:31 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2127421233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:55:31.290 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:31 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1599246001' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:55:31.290 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:31 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/830588182' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-25T13:55:31.290 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:31 smithi043 ceph-mon[29195]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T13:55:31.290 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:31 smithi043 ceph-mon[29195]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T13:55:31.291 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:31 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/830588182' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-25T13:55:31.291 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:31 smithi043 ceph-mon[29195]: osdmap e96: 12 total, 12 up, 12 in 2024-04-25T13:55:31.291 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:31 smithi043 ceph-mon[29195]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-04-25T13:55:31.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:31.346+0000 7f29274aa640 1 -- 172.21.15.43:0/2866040932 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f29201a7330 con 0x7f2920109b10 2024-04-25T13:55:31.352 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-e[62493]: ignoring --setuser ceph since I am not root 2024-04-25T13:55:31.352 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-e[62493]: ignoring --setgroup ceph since I am not root 2024-04-25T13:55:31.352 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-mds[62497]: -- 172.21.15.161:0/3316076150 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f0f46b7a40 con 0x55f0f46ffa80 2024-04-25T13:55:31.352 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-e[62493]: starting mds.e at 2024-04-25T13:55:31.353 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-h[62806]: ignoring --setuser ceph since I am not root 2024-04-25T13:55:31.353 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-h[62806]: ignoring --setgroup ceph since I am not root 2024-04-25T13:55:31.353 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-mds[62810]: -- 172.21.15.161:0/3810245138 <== mon.2 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a40f447a40 con 0x55a40f48fa80 2024-04-25T13:55:31.353 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-h[62806]: starting mds.h at 2024-04-25T13:55:31.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-mon[32696]: pgmap v340: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-04-25T13:55:31.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2127421233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T13:55:31.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1599246001' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T13:55:31.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/830588182' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-25T13:55:31.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-mon[32696]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T13:55:31.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-mon[32696]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T13:55:31.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/830588182' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-25T13:55:31.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-mon[32696]: osdmap e96: 12 total, 12 up, 12 in 2024-04-25T13:55:31.354 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-mon[32696]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-04-25T13:55:31.354 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-b[63120]: ignoring --setuser ceph since I am not root 2024-04-25T13:55:31.354 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-b[63120]: ignoring --setgroup ceph since I am not root 2024-04-25T13:55:31.354 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-mds[63124]: -- 172.21.15.161:0/1602932526 <== mon.2 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56139c65da40 con 0x56139c6a5a80 2024-04-25T13:55:31.354 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:55:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-b[63120]: starting mds.b at 2024-04-25T13:55:32.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.045+0000 7f29167fc640 1 -- 172.21.15.43:0/2866040932 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7f29100a77d0 con 0x7f2920109b10 2024-04-25T13:55:32.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.048+0000 7f29274aa640 1 -- 172.21.15.43:0/2866040932 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f290c0afc60 msgr2=0x7f290c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:32.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.048+0000 7f29274aa640 1 --2- 172.21.15.43:0/2866040932 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f290c0afc60 0x7f290c0b2170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f291c004770 tx=0x7f291c0058d0 comp rx=0 tx=0).stop 2024-04-25T13:55:32.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.048+0000 7f29274aa640 1 -- 172.21.15.43:0/2866040932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2920109b10 msgr2=0x7f292019abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:32.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.048+0000 7f29274aa640 1 --2- 172.21.15.43:0/2866040932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2920109b10 0x7f292019abf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f291000e980 tx=0x7f291000ee40 comp rx=0 tx=0).stop 2024-04-25T13:55:32.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.048+0000 7f29274aa640 1 -- 172.21.15.43:0/2866040932 shutdown_connections 2024-04-25T13:55:32.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.048+0000 7f29274aa640 1 --2- 172.21.15.43:0/2866040932 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f290c0afc60 0x7f290c0b2170 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:32.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.048+0000 7f29274aa640 1 --2- 172.21.15.43:0/2866040932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2920109fb0 0x7f292019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:32.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.048+0000 7f29274aa640 1 --2- 172.21.15.43:0/2866040932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2920109b10 0x7f292019abf0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:32.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.048+0000 7f29274aa640 1 --2- 172.21.15.43:0/2866040932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29201042b0 0x7f292019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:32.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.048+0000 7f29274aa640 1 -- 172.21.15.43:0/2866040932 >> 172.21.15.43:0/2866040932 conn(0x7f29200ff360 msgr2=0x7f29200ff770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:32.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.048+0000 7f29274aa640 1 -- 172.21.15.43:0/2866040932 shutdown_connections 2024-04-25T13:55:32.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.048+0000 7f29274aa640 1 -- 172.21.15.43:0/2866040932 wait complete. 2024-04-25T13:55:32.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T13:55:32.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.180+0000 7fcbffe25640 1 -- 172.21.15.43:0/2070591421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbf810d380 msgr2=0x7fcbf810f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:32.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.180+0000 7fcbffe25640 1 --2- 172.21.15.43:0/2070591421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbf810d380 0x7fcbf810f7a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009be0 tx=0x7fcbf002a6c0 comp rx=0 tx=0).stop 2024-04-25T13:55:32.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.180+0000 7fcbffe25640 1 -- 172.21.15.43:0/2070591421 shutdown_connections 2024-04-25T13:55:32.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.180+0000 7fcbffe25640 1 --2- 172.21.15.43:0/2070591421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbf810d380 0x7fcbf810f7a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:32.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.180+0000 7fcbffe25640 1 --2- 172.21.15.43:0/2070591421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf8102af0 0x7fcbf8102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:32.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.180+0000 7fcbffe25640 1 --2- 172.21.15.43:0/2070591421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbf8108a20 0x7fcbf81025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:32.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.180+0000 7fcbffe25640 1 -- 172.21.15.43:0/2070591421 >> 172.21.15.43:0/2070591421 conn(0x7fcbf8078100 msgr2=0x7fcbf8078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:32.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.180+0000 7fcbffe25640 1 -- 172.21.15.43:0/2070591421 shutdown_connections 2024-04-25T13:55:32.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.180+0000 7fcbffe25640 1 -- 172.21.15.43:0/2070591421 wait complete. 2024-04-25T13:55:32.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.181+0000 7fcbffe25640 1 Processor -- start 2024-04-25T13:55:32.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.181+0000 7fcbffe25640 1 -- start start 2024-04-25T13:55:32.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.181+0000 7fcbffe25640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf8102af0 0x7fcbf819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:32.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.181+0000 7fcbffe25640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbf8108a20 0x7fcbf819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:32.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.181+0000 7fcbffe25640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbf810d380 0x7fcbf819ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:32.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.181+0000 7fcbffe25640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf8112ab0 con 0x7fcbf8108a20 2024-04-25T13:55:32.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.181+0000 7fcbffe25640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf8112930 con 0x7fcbf8102af0 2024-04-25T13:55:32.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.181+0000 7fcbffe25640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf8112c30 con 0x7fcbf810d380 2024-04-25T13:55:32.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbfd3c0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbf8108a20 0x7fcbf819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:32.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbfd3c0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbf8108a20 0x7fcbf819ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59530/0 (socket says 172.21.15.43:59530) 2024-04-25T13:55:32.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbfd3c0640 1 -- 172.21.15.43:0/617972880 learned_addr learned my addr 172.21.15.43:0/617972880 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:32.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbfe3c2640 1 --2- 172.21.15.43:0/617972880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbf810d380 0x7fcbf819ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:32.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbfdbc1640 1 --2- 172.21.15.43:0/617972880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf8102af0 0x7fcbf819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:32.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbfd3c0640 1 -- 172.21.15.43:0/617972880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbf810d380 msgr2=0x7fcbf819ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:32.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbfd3c0640 1 --2- 172.21.15.43:0/617972880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbf810d380 0x7fcbf819ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:32.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbfd3c0640 1 -- 172.21.15.43:0/617972880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf8102af0 msgr2=0x7fcbf819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:32.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbfd3c0640 1 --2- 172.21.15.43:0/617972880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf8102af0 0x7fcbf819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:32.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbfd3c0640 1 -- 172.21.15.43:0/617972880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf819f420 con 0x7fcbf8108a20 2024-04-25T13:55:32.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbfdbc1640 1 --2- 172.21.15.43:0/617972880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf8102af0 0x7fcbf819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:55:32.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbfd3c0640 1 --2- 172.21.15.43:0/617972880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbf8108a20 0x7fcbf819ab20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800e980 tx=0x7fcbe800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:32.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbeeffd640 1 -- 172.21.15.43:0/617972880 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800cd80 con 0x7fcbf8108a20 2024-04-25T13:55:32.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbeeffd640 1 -- 172.21.15.43:0/617972880 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcbe80108c0 con 0x7fcbf8108a20 2024-04-25T13:55:32.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbffe25640 1 -- 172.21.15.43:0/617972880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf819f710 con 0x7fcbf8108a20 2024-04-25T13:55:32.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbeeffd640 1 -- 172.21.15.43:0/617972880 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8018880 con 0x7fcbf8108a20 2024-04-25T13:55:32.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.182+0000 7fcbffe25640 1 -- 172.21.15.43:0/617972880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf81a7090 con 0x7fcbf8108a20 2024-04-25T13:55:32.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.183+0000 7fcbffe25640 1 -- 172.21.15.43:0/617972880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf806afa0 con 0x7fcbf8108a20 2024-04-25T13:55:32.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.185+0000 7fcbeeffd640 1 -- 172.21.15.43:0/617972880 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7fcbe801f020 con 0x7fcbf8108a20 2024-04-25T13:55:32.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.186+0000 7fcbeeffd640 1 --2- 172.21.15.43:0/617972880 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fcbe40afc60 0x7fcbe40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:32.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.186+0000 7fcbeeffd640 1 -- 172.21.15.43:0/617972880 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9637+0+0 (secure 0 0 0) 0x7fcbe80dfc30 con 0x7fcbf8108a20 2024-04-25T13:55:32.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.186+0000 7fcbfdbc1640 1 --2- 172.21.15.43:0/617972880 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fcbe40afc60 0x7fcbe40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:32.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.186+0000 7fcbfdbc1640 1 --2- 172.21.15.43:0/617972880 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fcbe40afc60 0x7fcbe40b2170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8103a20 tx=0x7fcbf4005f90 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:32.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.190+0000 7fcbeeffd640 1 -- 172.21.15.43:0/617972880 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcbe8010a70 con 0x7fcbf8108a20 2024-04-25T13:55:32.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:32 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2866040932' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T13:55:32.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:32.378+0000 7fcbffe25640 1 -- 172.21.15.43:0/617972880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcbf81a7260 con 0x7fcbf8108a20 2024-04-25T13:55:32.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:32 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2866040932' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T13:55:32.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:32 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2866040932' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T13:55:33.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.052+0000 7fcbeeffd640 1 -- 172.21.15.43:0/617972880 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) ==== 181+0+0 (secure 0 0 0) 0x7fcbe80a8070 con 0x7fcbf8108a20 2024-04-25T13:55:33.051 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2024-04-25T13:55:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.056+0000 7fcbffe25640 1 -- 172.21.15.43:0/617972880 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fcbe40afc60 msgr2=0x7fcbe40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.056+0000 7fcbffe25640 1 --2- 172.21.15.43:0/617972880 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fcbe40afc60 0x7fcbe40b2170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8103a20 tx=0x7fcbf4005f90 comp rx=0 tx=0).stop 2024-04-25T13:55:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.056+0000 7fcbffe25640 1 -- 172.21.15.43:0/617972880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbf8108a20 msgr2=0x7fcbf819ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.056+0000 7fcbffe25640 1 --2- 172.21.15.43:0/617972880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbf8108a20 0x7fcbf819ab20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800e980 tx=0x7fcbe800ee40 comp rx=0 tx=0).stop 2024-04-25T13:55:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.056+0000 7fcbffe25640 1 -- 172.21.15.43:0/617972880 shutdown_connections 2024-04-25T13:55:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.056+0000 7fcbffe25640 1 --2- 172.21.15.43:0/617972880 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fcbe40afc60 0x7fcbe40b2170 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.056+0000 7fcbffe25640 1 --2- 172.21.15.43:0/617972880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbf810d380 0x7fcbf819ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.056+0000 7fcbffe25640 1 --2- 172.21.15.43:0/617972880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbf8108a20 0x7fcbf819ab20 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.056+0000 7fcbffe25640 1 --2- 172.21.15.43:0/617972880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf8102af0 0x7fcbf819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.056+0000 7fcbffe25640 1 -- 172.21.15.43:0/617972880 >> 172.21.15.43:0/617972880 conn(0x7fcbf8078100 msgr2=0x7fcbf8069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.056+0000 7fcbffe25640 1 -- 172.21.15.43:0/617972880 shutdown_connections 2024-04-25T13:55:33.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.056+0000 7fcbffe25640 1 -- 172.21.15.43:0/617972880 wait complete. 2024-04-25T13:55:33.072 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T13:55:33.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.209+0000 7fb92b534640 1 -- 172.21.15.43:0/1471668713 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb924107930 msgr2=0x7fb924102d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:33.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.209+0000 7fb92b534640 1 --2- 172.21.15.43:0/1471668713 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb924107930 0x7fb924102d60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb920009900 tx=0x7fb92002a410 comp rx=0 tx=0).stop 2024-04-25T13:55:33.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.209+0000 7fb92b534640 1 -- 172.21.15.43:0/1471668713 shutdown_connections 2024-04-25T13:55:33.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.209+0000 7fb92b534640 1 --2- 172.21.15.43:0/1471668713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb92410d420 0x7fb92410f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:33.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.209+0000 7fb92b534640 1 --2- 172.21.15.43:0/1471668713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9241032a0 0x7fb9241036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:33.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.209+0000 7fb92b534640 1 --2- 172.21.15.43:0/1471668713 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb924107930 0x7fb924102d60 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:33.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.209+0000 7fb92b534640 1 -- 172.21.15.43:0/1471668713 >> 172.21.15.43:0/1471668713 conn(0x7fb9240fd860 msgr2=0x7fb9240ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:33.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.209+0000 7fb92b534640 1 -- 172.21.15.43:0/1471668713 shutdown_connections 2024-04-25T13:55:33.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.209+0000 7fb92b534640 1 -- 172.21.15.43:0/1471668713 wait complete. 2024-04-25T13:55:33.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.210+0000 7fb92b534640 1 Processor -- start 2024-04-25T13:55:33.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.210+0000 7fb92b534640 1 -- start start 2024-04-25T13:55:33.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.210+0000 7fb92b534640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9241032a0 0x7fb92419b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:33.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.210+0000 7fb92b534640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb924107930 0x7fb92419b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:33.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.210+0000 7fb92b534640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb92410d420 0x7fb92419bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:33.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.210+0000 7fb92b534640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb924112a90 con 0x7fb92410d420 2024-04-25T13:55:33.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.210+0000 7fb92b534640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fb924112910 con 0x7fb9241032a0 2024-04-25T13:55:33.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.210+0000 7fb92b534640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb924112c10 con 0x7fb924107930 2024-04-25T13:55:33.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.210+0000 7fb929ad1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb92410d420 0x7fb92419bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:33.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.210+0000 7fb929ad1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb92410d420 0x7fb92419bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59538/0 (socket says 172.21.15.43:59538) 2024-04-25T13:55:33.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.210+0000 7fb929ad1640 1 -- 172.21.15.43:0/1587111407 learned_addr learned my addr 172.21.15.43:0/1587111407 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:33.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.210+0000 7fb9292d0640 1 --2- 172.21.15.43:0/1587111407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9241032a0 0x7fb92419b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:33.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.211+0000 7fb928acf640 1 --2- 172.21.15.43:0/1587111407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb924107930 0x7fb92419b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:33.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.211+0000 7fb929ad1640 1 -- 172.21.15.43:0/1587111407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb924107930 msgr2=0x7fb92419b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:33.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.211+0000 7fb929ad1640 1 --2- 172.21.15.43:0/1587111407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb924107930 0x7fb92419b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:33.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.211+0000 7fb929ad1640 1 -- 172.21.15.43:0/1587111407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9241032a0 msgr2=0x7fb92419b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:33.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.211+0000 7fb929ad1640 1 --2- 172.21.15.43:0/1587111407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9241032a0 0x7fb92419b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:33.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.211+0000 7fb929ad1640 1 -- 172.21.15.43:0/1587111407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9241a66d0 con 0x7fb92410d420 2024-04-25T13:55:33.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.211+0000 7fb929ad1640 1 --2- 172.21.15.43:0/1587111407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb92410d420 0x7fb92419bed0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00ccb0 tx=0x7fb91c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:33.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.211+0000 7fb91a7fc640 1 -- 172.21.15.43:0/1587111407 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c00f450 con 0x7fb92410d420 2024-04-25T13:55:33.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.211+0000 7fb91a7fc640 1 -- 172.21.15.43:0/1587111407 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb91c00fa80 con 0x7fb92410d420 2024-04-25T13:55:33.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.211+0000 7fb92b534640 1 -- 172.21.15.43:0/1587111407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9241a69c0 con 0x7fb92410d420 2024-04-25T13:55:33.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.211+0000 7fb91a7fc640 1 -- 172.21.15.43:0/1587111407 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c018a40 con 0x7fb92410d420 2024-04-25T13:55:33.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.211+0000 7fb92b534640 1 -- 172.21.15.43:0/1587111407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9241a6ec0 con 0x7fb92410d420 2024-04-25T13:55:33.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.212+0000 7fb92b534640 1 -- 172.21.15.43:0/1587111407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92406a190 con 0x7fb92410d420 2024-04-25T13:55:33.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.214+0000 7fb91a7fc640 1 -- 172.21.15.43:0/1587111407 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7fb91c00fc30 con 0x7fb92410d420 2024-04-25T13:55:33.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.214+0000 7fb91a7fc640 1 --2- 172.21.15.43:0/1587111407 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fb9100afc60 0x7fb9100b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:33.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.215+0000 7fb9292d0640 1 --2- 172.21.15.43:0/1587111407 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fb9100afc60 0x7fb9100b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:33.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.215+0000 7fb91a7fc640 1 -- 172.21.15.43:0/1587111407 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9083+0+0 (secure 0 0 0) 0x7fb91c0df6a0 con 0x7fb92410d420 2024-04-25T13:55:33.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.215+0000 7fb9292d0640 1 --2- 172.21.15.43:0/1587111407 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fb9100afc60 0x7fb9100b2170 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb9200057c0 tx=0x7fb9200058d0 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:33.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.218+0000 7fb91a7fc640 1 -- 172.21.15.43:0/1587111407 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb91c014030 con 0x7fb92410d420 2024-04-25T13:55:33.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: pgmap v342: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 921 B/s wr, 6 op/s 2024-04-25T13:55:33.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T13:55:33.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T13:55:33.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: Cluster is now healthy 2024-04-25T13:55:33.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2866040932' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-25T13:55:33.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.175:6834/2221634,v1:172.21.15.175:6836/2221634] up:boot 2024-04-25T13:55:33.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.175:6835/987862094,v1:172.21.15.175:6838/987862094] up:boot 2024-04-25T13:55:33.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.175:6837/3021282003,v1:172.21.15.175:6839/3021282003] up:boot 2024-04-25T13:55:33.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.161:6834/928479137,v1:172.21.15.161:6835/928479137] up:boot 2024-04-25T13:55:33.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.161:6836/2401160638,v1:172.21.15.161:6837/2401160638] up:boot 2024-04-25T13:55:33.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: mds.? [v2:172.21.15.161:6838/545284401,v1:172.21.15.161:6839/545284401] up:boot 2024-04-25T13:55:33.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: fsmap 12 up:standby 2024-04-25T13:55:33.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T13:55:33.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T13:55:33.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T13:55:33.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T13:55:33.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T13:55:33.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T13:55:33.353 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:33 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/617972880' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T13:55:33.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:33.404+0000 7fb92b534640 1 -- 172.21.15.43:0/1587111407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb924102240 con 0x7fb92410d420 2024-04-25T13:55:33.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: pgmap v342: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 921 B/s wr, 6 op/s 2024-04-25T13:55:33.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T13:55:33.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T13:55:33.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: Cluster is now healthy 2024-04-25T13:55:33.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2866040932' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-25T13:55:33.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.175:6834/2221634,v1:172.21.15.175:6836/2221634] up:boot 2024-04-25T13:55:33.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.175:6835/987862094,v1:172.21.15.175:6838/987862094] up:boot 2024-04-25T13:55:33.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.175:6837/3021282003,v1:172.21.15.175:6839/3021282003] up:boot 2024-04-25T13:55:33.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.161:6834/928479137,v1:172.21.15.161:6835/928479137] up:boot 2024-04-25T13:55:33.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.161:6836/2401160638,v1:172.21.15.161:6837/2401160638] up:boot 2024-04-25T13:55:33.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: mds.? [v2:172.21.15.161:6838/545284401,v1:172.21.15.161:6839/545284401] up:boot 2024-04-25T13:55:33.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: fsmap 12 up:standby 2024-04-25T13:55:33.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T13:55:33.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T13:55:33.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T13:55:33.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T13:55:33.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T13:55:33.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T13:55:33.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:33 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/617972880' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T13:55:33.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: pgmap v342: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 921 B/s wr, 6 op/s 2024-04-25T13:55:33.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T13:55:33.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T13:55:33.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: Cluster is now healthy 2024-04-25T13:55:33.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2866040932' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-25T13:55:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.175:6834/2221634,v1:172.21.15.175:6836/2221634] up:boot 2024-04-25T13:55:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.175:6835/987862094,v1:172.21.15.175:6838/987862094] up:boot 2024-04-25T13:55:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.175:6837/3021282003,v1:172.21.15.175:6839/3021282003] up:boot 2024-04-25T13:55:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.161:6834/928479137,v1:172.21.15.161:6835/928479137] up:boot 2024-04-25T13:55:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.161:6836/2401160638,v1:172.21.15.161:6837/2401160638] up:boot 2024-04-25T13:55:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: mds.? [v2:172.21.15.161:6838/545284401,v1:172.21.15.161:6839/545284401] up:boot 2024-04-25T13:55:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: fsmap 12 up:standby 2024-04-25T13:55:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T13:55:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T13:55:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T13:55:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T13:55:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T13:55:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: from='mgr.15486 172.21.15.43:0/2978618117' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T13:55:33.463 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:33 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/617972880' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T13:55:34.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.059+0000 7fb91a7fc640 1 -- 172.21.15.43:0/1587111407 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) ==== 169+0+0 (secure 0 0 0) 0x7fb924102240 con 0x7fb92410d420 2024-04-25T13:55:34.058 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2024-04-25T13:55:34.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.062+0000 7fb92b534640 1 -- 172.21.15.43:0/1587111407 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fb9100afc60 msgr2=0x7fb9100b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:34.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.062+0000 7fb92b534640 1 --2- 172.21.15.43:0/1587111407 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fb9100afc60 0x7fb9100b2170 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb9200057c0 tx=0x7fb9200058d0 comp rx=0 tx=0).stop 2024-04-25T13:55:34.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.062+0000 7fb92b534640 1 -- 172.21.15.43:0/1587111407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb92410d420 msgr2=0x7fb92419bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:34.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.062+0000 7fb92b534640 1 --2- 172.21.15.43:0/1587111407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb92410d420 0x7fb92419bed0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00ccb0 tx=0x7fb91c00a620 comp rx=0 tx=0).stop 2024-04-25T13:55:34.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.062+0000 7fb92b534640 1 -- 172.21.15.43:0/1587111407 shutdown_connections 2024-04-25T13:55:34.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.062+0000 7fb92b534640 1 --2- 172.21.15.43:0/1587111407 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7fb9100afc60 0x7fb9100b2170 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb9200057c0 tx=0x7fb9200058d0 comp rx=0 tx=0).stop 2024-04-25T13:55:34.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.063+0000 7fb92b534640 1 --2- 172.21.15.43:0/1587111407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb92410d420 0x7fb92419bed0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:34.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.063+0000 7fb92b534640 1 --2- 172.21.15.43:0/1587111407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb924107930 0x7fb92419b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:34.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.063+0000 7fb92b534640 1 --2- 172.21.15.43:0/1587111407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9241032a0 0x7fb92419b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:34.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.063+0000 7fb92b534640 1 -- 172.21.15.43:0/1587111407 >> 172.21.15.43:0/1587111407 conn(0x7fb9240fd860 msgr2=0x7fb92410e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:34.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.063+0000 7fb92b534640 1 -- 172.21.15.43:0/1587111407 shutdown_connections 2024-04-25T13:55:34.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.063+0000 7fb92b534640 1 -- 172.21.15.43:0/1587111407 wait complete. 2024-04-25T13:55:34.081 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-25T13:55:34.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.207+0000 7f04c1bc5640 1 -- 172.21.15.43:0/886257494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04bc10b6d0 msgr2=0x7f04bc10daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:34.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.207+0000 7f04c1bc5640 1 --2- 172.21.15.43:0/886257494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04bc10b6d0 0x7f04bc10daf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009900 tx=0x7f04b002a410 comp rx=0 tx=0).stop 2024-04-25T13:55:34.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.207+0000 7f04c1bc5640 1 -- 172.21.15.43:0/886257494 shutdown_connections 2024-04-25T13:55:34.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.207+0000 7f04c1bc5640 1 --2- 172.21.15.43:0/886257494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04bc10e0c0 0x7f04bc1105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:34.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.207+0000 7f04c1bc5640 1 --2- 172.21.15.43:0/886257494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04bc10b6d0 0x7f04bc10daf0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:34.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.207+0000 7f04c1bc5640 1 --2- 172.21.15.43:0/886257494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04bc104c70 0x7f04bc105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:34.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.207+0000 7f04c1bc5640 1 -- 172.21.15.43:0/886257494 >> 172.21.15.43:0/886257494 conn(0x7f04bc078110 msgr2=0x7f04bc078550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:34.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.207+0000 7f04c1bc5640 1 -- 172.21.15.43:0/886257494 shutdown_connections 2024-04-25T13:55:34.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.207+0000 7f04c1bc5640 1 -- 172.21.15.43:0/886257494 wait complete. 2024-04-25T13:55:34.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.208+0000 7f04c1bc5640 1 Processor -- start 2024-04-25T13:55:34.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.208+0000 7f04c1bc5640 1 -- start start 2024-04-25T13:55:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.208+0000 7f04c1bc5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04bc104c70 0x7f04bc19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.208+0000 7f04c1bc5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04bc10b6d0 0x7f04bc19ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.208+0000 7f04c1bc5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04bc10e0c0 0x7f04bc19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.208+0000 7f04c1bc5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc113b90 con 0x7f04bc10b6d0 2024-04-25T13:55:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.208+0000 7f04c1bc5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc113a10 con 0x7f04bc104c70 2024-04-25T13:55:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.208+0000 7f04c1bc5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc113d10 con 0x7f04bc10e0c0 2024-04-25T13:55:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.208+0000 7f04baffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04bc10b6d0 0x7f04bc19ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.208+0000 7f04baffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04bc10b6d0 0x7f04bc19ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59550/0 (socket says 172.21.15.43:59550) 2024-04-25T13:55:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.208+0000 7f04baffd640 1 -- 172.21.15.43:0/2174102731 learned_addr learned my addr 172.21.15.43:0/2174102731 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T13:55:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.208+0000 7f04bbfff640 1 --2- 172.21.15.43:0/2174102731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04bc10e0c0 0x7f04bc19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.208+0000 7f04bb7fe640 1 --2- 172.21.15.43:0/2174102731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04bc104c70 0x7f04bc19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.209+0000 7f04baffd640 1 -- 172.21.15.43:0/2174102731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04bc10e0c0 msgr2=0x7f04bc19ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.209+0000 7f04baffd640 1 --2- 172.21.15.43:0/2174102731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04bc10e0c0 0x7f04bc19ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.209+0000 7f04baffd640 1 -- 172.21.15.43:0/2174102731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04bc104c70 msgr2=0x7f04bc19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.209+0000 7f04baffd640 1 --2- 172.21.15.43:0/2174102731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04bc104c70 0x7f04bc19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.209+0000 7f04baffd640 1 -- 172.21.15.43:0/2174102731 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04bc19f570 con 0x7f04bc10b6d0 2024-04-25T13:55:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.209+0000 7f04bb7fe640 1 --2- 172.21.15.43:0/2174102731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04bc104c70 0x7f04bc19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:55:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.209+0000 7f04baffd640 1 --2- 172.21.15.43:0/2174102731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04bc10b6d0 0x7f04bc19ac70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f04b0005940 tx=0x7f04b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.209+0000 7f04b8ff9640 1 -- 172.21.15.43:0/2174102731 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b003f030 con 0x7f04bc10b6d0 2024-04-25T13:55:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.209+0000 7f04b8ff9640 1 -- 172.21.15.43:0/2174102731 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04b0003c90 con 0x7f04bc10b6d0 2024-04-25T13:55:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.209+0000 7f04c1bc5640 1 -- 172.21.15.43:0/2174102731 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04bc19f800 con 0x7f04bc10b6d0 2024-04-25T13:55:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.209+0000 7f04b8ff9640 1 -- 172.21.15.43:0/2174102731 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0035070 con 0x7f04bc10b6d0 2024-04-25T13:55:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.209+0000 7f04c1bc5640 1 -- 172.21.15.43:0/2174102731 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04bc19fd40 con 0x7f04bc10b6d0 2024-04-25T13:55:34.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.210+0000 7f04c1bc5640 1 -- 172.21.15.43:0/2174102731 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04bc06a160 con 0x7f04bc10b6d0 2024-04-25T13:55:34.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.212+0000 7f04b8ff9640 1 -- 172.21.15.43:0/2174102731 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 26) ==== 147651+0+0 (secure 0 0 0) 0x7f04b0042030 con 0x7f04bc10b6d0 2024-04-25T13:55:34.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.212+0000 7f04b8ff9640 1 --2- 172.21.15.43:0/2174102731 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f04a40afce0 0x7f04a40b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:55:34.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.212+0000 7f04b8ff9640 1 -- 172.21.15.43:0/2174102731 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8582+0+0 (secure 0 0 0) 0x7f04b00ff930 con 0x7f04bc10b6d0 2024-04-25T13:55:34.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.212+0000 7f04bb7fe640 1 --2- 172.21.15.43:0/2174102731 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f04a40afce0 0x7f04a40b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:55:34.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.213+0000 7f04bb7fe640 1 --2- 172.21.15.43:0/2174102731 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f04a40afce0 0x7f04a40b21f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0058c0 tx=0x7f04ac005850 comp rx=0 tx=0).ready entity=mgr.15486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:55:34.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.216+0000 7f04b8ff9640 1 -- 172.21.15.43:0/2174102731 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f04b00c8190 con 0x7f04bc10b6d0 2024-04-25T13:55:34.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:34 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/617972880' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T13:55:34.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:34 smithi161 ceph-mon[32696]: osdmap e97: 12 total, 12 up, 12 in 2024-04-25T13:55:34.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:34 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1587111407' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T13:55:34.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:34.411+0000 7f04c1bc5640 1 -- 172.21.15.43:0/2174102731 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f04bc1a7240 con 0x7f04bc10b6d0 2024-04-25T13:55:34.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:34 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/617972880' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T13:55:34.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:34 smithi175 ceph-mon[32649]: osdmap e97: 12 total, 12 up, 12 in 2024-04-25T13:55:34.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:34 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1587111407' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T13:55:34.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:34 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/617972880' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T13:55:34.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:34 smithi043 ceph-mon[29195]: osdmap e97: 12 total, 12 up, 12 in 2024-04-25T13:55:34.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:34 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1587111407' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T13:55:35.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:35.060+0000 7f04b8ff9640 1 -- 172.21.15.43:0/2174102731 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v99) ==== 178+0+0 (secure 0 0 0) 0x7f04b00c7a90 con 0x7f04bc10b6d0 2024-04-25T13:55:35.060 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data_ec' removed 2024-04-25T13:55:35.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:35.064+0000 7f04c1bc5640 1 -- 172.21.15.43:0/2174102731 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f04a40afce0 msgr2=0x7f04a40b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:35.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:35.064+0000 7f04c1bc5640 1 --2- 172.21.15.43:0/2174102731 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f04a40afce0 0x7f04a40b21f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0058c0 tx=0x7f04ac005850 comp rx=0 tx=0).stop 2024-04-25T13:55:35.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:35.064+0000 7f04c1bc5640 1 -- 172.21.15.43:0/2174102731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04bc10b6d0 msgr2=0x7f04bc19ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:55:35.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:35.064+0000 7f04c1bc5640 1 --2- 172.21.15.43:0/2174102731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04bc10b6d0 0x7f04bc19ac70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f04b0005940 tx=0x7f04b00042f0 comp rx=0 tx=0).stop 2024-04-25T13:55:35.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:35.064+0000 7f04c1bc5640 1 -- 172.21.15.43:0/2174102731 shutdown_connections 2024-04-25T13:55:35.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:35.064+0000 7f04c1bc5640 1 --2- 172.21.15.43:0/2174102731 >> [v2:172.21.15.43:6800/1964865924,v1:172.21.15.43:6801/1964865924] conn(0x7f04a40afce0 0x7f04a40b21f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:35.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:35.064+0000 7f04c1bc5640 1 --2- 172.21.15.43:0/2174102731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04bc10e0c0 0x7f04bc19ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:35.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:35.064+0000 7f04c1bc5640 1 --2- 172.21.15.43:0/2174102731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04bc10b6d0 0x7f04bc19ac70 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:35.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:35.064+0000 7f04c1bc5640 1 --2- 172.21.15.43:0/2174102731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04bc104c70 0x7f04bc19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:55:35.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:35.064+0000 7f04c1bc5640 1 -- 172.21.15.43:0/2174102731 >> 172.21.15.43:0/2174102731 conn(0x7f04bc078110 msgr2=0x7f04bc101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:55:35.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:35.065+0000 7f04c1bc5640 1 -- 172.21.15.43:0/2174102731 shutdown_connections 2024-04-25T13:55:35.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T13:55:35.065+0000 7f04c1bc5640 1 -- 172.21.15.43:0/2174102731 wait complete. 2024-04-25T13:55:35.085 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T13:55:35.140 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T13:55:35.168 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T13:55:35.199 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-25T13:55:35.200 DEBUG:teuthology.orchestra.run.smithi043:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-25T13:55:35.216 DEBUG:teuthology.orchestra.run.smithi161:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-25T13:55:35.232 DEBUG:teuthology.orchestra.run.smithi175:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-25T13:55:35.257 INFO:tasks.cephadm:Stopping all daemons... 2024-04-25T13:55:35.258 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-04-25T13:55:35.258 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mon.a 2024-04-25T13:55:35.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:35 smithi161 ceph-mon[32696]: pgmap v344: 97 pgs: 97 active+clean; 577 KiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:55:35.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:35 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/1587111407' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T13:55:35.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:35 smithi161 ceph-mon[32696]: osdmap e98: 12 total, 12 up, 12 in 2024-04-25T13:55:35.352 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:35 smithi161 ceph-mon[32696]: from='client.? 172.21.15.43:0/2174102731' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T13:55:35.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:35 smithi175 ceph-mon[32649]: pgmap v344: 97 pgs: 97 active+clean; 577 KiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:55:35.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:35 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/1587111407' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T13:55:35.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:35 smithi175 ceph-mon[32649]: osdmap e98: 12 total, 12 up, 12 in 2024-04-25T13:55:35.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:35 smithi175 ceph-mon[32649]: from='client.? 172.21.15.43:0/2174102731' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T13:55:35.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:35 smithi043 ceph-mon[29195]: pgmap v344: 97 pgs: 97 active+clean; 577 KiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T13:55:35.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:35 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/1587111407' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T13:55:35.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:35 smithi043 ceph-mon[29195]: osdmap e98: 12 total, 12 up, 12 in 2024-04-25T13:55:35.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:35 smithi043 ceph-mon[29195]: from='client.? 172.21.15.43:0/2174102731' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T13:55:35.462 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:35 smithi043 systemd[1]: Stopping Ceph mon.a for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:55:35.962 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-a[29191]: 2024-04-25T13:55:35.547+0000 7fb12e0ef700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:55:35.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-a[29191]: 2024-04-25T13:55:35.547+0000 7fb12e0ef700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-04-25T13:55:35.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:35 smithi043 podman[89271]: 2024-04-25 13:55:35.792850806 +0000 UTC m=+0.346800182 container died 7b328ba066183ad3cc0c3bd28d4771a41df5460d4cb3a6388e79753ed4737bfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T13:55:36.448 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:36 smithi043 podman[89271]: 2024-04-25 13:55:36.173467928 +0000 UTC m=+0.727417312 container cleanup 7b328ba066183ad3cc0c3bd28d4771a41df5460d4cb3a6388e79753ed4737bfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T13:55:36.449 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 13:55:36 smithi043 bash[89271]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-a 2024-04-25T13:55:36.599 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mon.a.service' 2024-04-25T13:55:36.654 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:55:36.654 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-04-25T13:55:36.654 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-04-25T13:55:36.654 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mon.b 2024-04-25T13:55:36.952 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:36 smithi161 systemd[1]: Stopping Ceph mon.b for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:55:37.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:36 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-b[32692]: 2024-04-25T13:55:36.952+0000 7fe582ef1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:55:37.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:36 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-b[32692]: 2024-04-25T13:55:36.952+0000 7fe582ef1700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-04-25T13:55:37.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:37 smithi161 podman[68533]: 2024-04-25 13:55:37.014550717 +0000 UTC m=+0.166595107 container died 14956c53ff8c8a4503e457ce012c69601455daf51f8eadd7943a8b94996a13c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-b, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_CLEAN=True) 2024-04-25T13:55:37.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:37 smithi161 podman[68533]: 2024-04-25 13:55:37.403546555 +0000 UTC m=+0.555590954 container cleanup 14956c53ff8c8a4503e457ce012c69601455daf51f8eadd7943a8b94996a13c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-b, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0) 2024-04-25T13:55:37.602 INFO:journalctl@ceph.mon.b.smithi161.stdout:Apr 25 13:55:37 smithi161 bash[68533]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-b 2024-04-25T13:55:37.818 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mon.b.service' 2024-04-25T13:55:37.877 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:55:37.877 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-04-25T13:55:37.877 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-04-25T13:55:37.877 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mon.c 2024-04-25T13:55:38.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:37 smithi175 systemd[1]: Stopping Ceph mon.c for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:55:38.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:38 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-c[32632]: 2024-04-25T13:55:38.181+0000 7f26c6687700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:55:38.599 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:38 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-c[32632]: 2024-04-25T13:55:38.181+0000 7f26c6687700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-04-25T13:55:38.600 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:38 smithi175 podman[68732]: 2024-04-25 13:55:38.315999662 +0000 UTC m=+0.245116318 container died e114fb4bd2be29ad39d25d28fcb771addedadee2d7f9de21dbd0caf2c5af68d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T13:55:38.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:38 smithi175 podman[68732]: 2024-04-25 13:55:38.691958735 +0000 UTC m=+0.621075389 container cleanup e114fb4bd2be29ad39d25d28fcb771addedadee2d7f9de21dbd0caf2c5af68d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-c, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True) 2024-04-25T13:55:38.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Apr 25 13:55:38 smithi175 bash[68732]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mon-c 2024-04-25T13:55:39.162 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mon.c.service' 2024-04-25T13:55:39.209 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:55:39.209 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-04-25T13:55:39.209 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-04-25T13:55:39.210 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mgr.x 2024-04-25T13:55:39.528 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:55:39 smithi043 systemd[1]: Stopping Ceph mgr.x for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:55:39.528 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:55:39 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:55:39.527+0000 7f27dde12700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:55:39.528 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:55:39 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x[29427]: 2024-04-25T13:55:39.527+0000 7f27dde12700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-25T13:55:39.887 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:55:39 smithi043 podman[89396]: 2024-04-25 13:55:39.569423768 +0000 UTC m=+0.157071044 container died e53013c69ed7876d3e71f25132e62942faf8c6e168ca36eabeb11d2147e70a4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T13:55:40.212 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:55:39 smithi043 podman[89396]: 2024-04-25 13:55:39.98779245 +0000 UTC m=+0.575439723 container cleanup e53013c69ed7876d3e71f25132e62942faf8c6e168ca36eabeb11d2147e70a4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-04-25T13:55:40.212 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:55:39 smithi043 bash[89396]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x 2024-04-25T13:55:40.465 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 13:55:40 smithi043 podman[89410]: 2024-04-25 13:55:40.214581335 +0000 UTC m=+0.649187611 container remove e53013c69ed7876d3e71f25132e62942faf8c6e168ca36eabeb11d2147e70a4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-x, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T13:55:40.470 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mgr.x.service' 2024-04-25T13:55:40.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:55:40.505 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-04-25T13:55:40.505 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-04-25T13:55:40.506 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mgr.y 2024-04-25T13:55:40.852 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:55:40 smithi161 systemd[1]: Stopping Ceph mgr.y for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:55:41.207 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:55:40 smithi161 podman[68652]: 2024-04-25 13:55:40.89321594 +0000 UTC m=+0.194553641 container died 82c31b9b38fbbe31830349c57bcf35dc0be7e60a43fdeedcf66864388e187c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-25T13:55:41.542 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:55:41 smithi161 podman[68652]: 2024-04-25 13:55:41.31716591 +0000 UTC m=+0.618503616 container cleanup 82c31b9b38fbbe31830349c57bcf35dc0be7e60a43fdeedcf66864388e187c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-25T13:55:41.542 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:55:41 smithi161 bash[68652]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y 2024-04-25T13:55:41.544 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:55:41 smithi161 podman[68665]: 2024-04-25 13:55:41.543638492 +0000 UTC m=+0.650784571 container remove 82c31b9b38fbbe31830349c57bcf35dc0be7e60a43fdeedcf66864388e187c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-25T13:55:41.783 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mgr.y.service' 2024-04-25T13:55:41.803 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:55:41 smithi161 systemd[1]: ceph-394efb6c-0308-11ef-bc93-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-04-25T13:55:41.803 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:55:41 smithi161 systemd[1]: ceph-394efb6c-0308-11ef-bc93-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-04-25T13:55:41.803 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:55:41 smithi161 systemd[1]: Stopped Ceph mgr.y for 394efb6c-0308-11ef-bc93-c7b262605968. 2024-04-25T13:55:41.804 INFO:journalctl@ceph.mgr.y.smithi161.stdout:Apr 25 13:55:41 smithi161 systemd[1]: ceph-394efb6c-0308-11ef-bc93-c7b262605968@mgr.y.service: Consumed 20.363s CPU time. 2024-04-25T13:55:41.816 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:55:41.816 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-04-25T13:55:41.816 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-04-25T13:55:41.816 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mgr.z 2024-04-25T13:55:42.168 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:55:41 smithi175 systemd[1]: Stopping Ceph mgr.z for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:55:42.430 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:55:42 smithi175 podman[68854]: 2024-04-25 13:55:42.169515741 +0000 UTC m=+0.159361102 container died 9fc3d5ee637af315479522fa78977c37c218383536a5fdbdcc27c25ff8c8f572 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-25T13:55:42.799 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:55:42 smithi175 podman[68854]: 2024-04-25 13:55:42.565117568 +0000 UTC m=+0.554962981 container cleanup 9fc3d5ee637af315479522fa78977c37c218383536a5fdbdcc27c25ff8c8f572 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T13:55:42.799 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Apr 25 13:55:42 smithi175 bash[68854]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mgr-z 2024-04-25T13:55:42.904 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mgr.z.service' 2024-04-25T13:55:42.937 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:55:42.937 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-04-25T13:55:42.937 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-25T13:55:42.937 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.0 2024-04-25T13:55:43.241 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:55:42 smithi043 systemd[1]: Stopping Ceph osd.0 for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:55:43.712 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:55:43 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-0[44092]: 2024-04-25T13:55:43.241+0000 7f31515da700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:55:43.712 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:55:43 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-0[44092]: 2024-04-25T13:55:43.241+0000 7f31515da700 -1 osd.0 99 *** Got signal Terminated *** 2024-04-25T13:55:43.712 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:55:43 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-0[44092]: 2024-04-25T13:55:43.241+0000 7f31515da700 -1 osd.0 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T13:55:49.084 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:55:48 smithi043 podman[89518]: 2024-04-25 13:55:48.807340168 +0000 UTC m=+5.679529049 container died b8ac860d9b6cc0c92f4882a1f2b1ed132dc91574f7b48e8cb368afcfeed60722 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T13:55:49.462 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:55:49 smithi043 podman[89518]: 2024-04-25 13:55:49.184841863 +0000 UTC m=+6.057030744 container cleanup b8ac860d9b6cc0c92f4882a1f2b1ed132dc91574f7b48e8cb368afcfeed60722 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-25T13:55:49.462 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:55:49 smithi043 bash[89518]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-0 2024-04-25T13:55:49.738 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:55:49 smithi043 podman[89535]: 2024-04-25 13:55:49.488371069 +0000 UTC m=+0.674566310 container remove b8ac860d9b6cc0c92f4882a1f2b1ed132dc91574f7b48e8cb368afcfeed60722 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240424) 2024-04-25T13:55:49.992 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:55:49 smithi043 podman[89626]: 2024-04-25 13:55:49.721284497 +0000 UTC m=+0.019125882 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:55:49.992 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:55:49 smithi043 podman[89626]: 2024-04-25 13:55:49.862566379 +0000 UTC m=+0.160407825 container create 4063ab6e3c9b8a9bc54d299c03408f3cd76a7cfaf5a4cc00c2534970e4dfde08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2) 2024-04-25T13:55:50.418 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:55:50 smithi043 podman[89626]: 2024-04-25 13:55:50.107228015 +0000 UTC m=+0.405069413 container init 4063ab6e3c9b8a9bc54d299c03408f3cd76a7cfaf5a4cc00c2534970e4dfde08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T13:55:50.418 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:55:50 smithi043 podman[89626]: 2024-04-25 13:55:50.11061859 +0000 UTC m=+0.408459977 container start 4063ab6e3c9b8a9bc54d299c03408f3cd76a7cfaf5a4cc00c2534970e4dfde08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-0-deactivate, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T13:55:50.418 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:55:50 smithi043 podman[89626]: 2024-04-25 13:55:50.210883218 +0000 UTC m=+0.508724613 container attach 4063ab6e3c9b8a9bc54d299c03408f3cd76a7cfaf5a4cc00c2534970e4dfde08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-0-deactivate, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-25T13:55:50.712 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 13:55:50 smithi043 podman[89626]: 2024-04-25 13:55:50.419566249 +0000 UTC m=+0.717407642 container died 4063ab6e3c9b8a9bc54d299c03408f3cd76a7cfaf5a4cc00c2534970e4dfde08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-25T13:55:51.076 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.0.service' 2024-04-25T13:55:51.118 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:55:51.118 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-25T13:55:51.118 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-25T13:55:51.119 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.1 2024-04-25T13:55:51.446 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:55:51 smithi161 systemd[1]: Stopping Ceph osd.1 for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:55:51.852 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:55:51 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-1[37301]: 2024-04-25T13:55:51.446+0000 7fa372856700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:55:51.852 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:55:51 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-1[37301]: 2024-04-25T13:55:51.446+0000 7fa372856700 -1 osd.1 99 *** Got signal Terminated *** 2024-04-25T13:55:51.852 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:55:51 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-1[37301]: 2024-04-25T13:55:51.446+0000 7fa372856700 -1 osd.1 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T13:55:57.230 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:55:56 smithi161 podman[68789]: 2024-04-25 13:55:56.875684185 +0000 UTC m=+5.554376999 container died 24b92d2c19f109dcabed047bd48e443f52b0e9f1eeb04352f9c96454ffc011b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-1, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-25T13:55:57.602 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:55:57 smithi161 podman[68789]: 2024-04-25 13:55:57.338257068 +0000 UTC m=+6.016949883 container cleanup 24b92d2c19f109dcabed047bd48e443f52b0e9f1eeb04352f9c96454ffc011b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-1, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-25T13:55:57.602 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:55:57 smithi161 bash[68789]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-1 2024-04-25T13:55:58.006 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:55:57 smithi161 podman[68807]: 2024-04-25 13:55:57.648446514 +0000 UTC m=+0.767446511 container remove 24b92d2c19f109dcabed047bd48e443f52b0e9f1eeb04352f9c96454ffc011b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-25T13:55:58.275 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:55:58 smithi161 podman[68898]: 2024-04-25 13:55:57.910108838 +0000 UTC m=+0.018256303 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:55:58.276 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:55:58 smithi161 podman[68898]: 2024-04-25 13:55:58.041182678 +0000 UTC m=+0.149330196 container create ba55d178c42b09b140c39087cbdc5d3202c3c0d69fafd19426d336abd765bf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-25T13:55:58.571 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:55:58 smithi161 podman[68898]: 2024-04-25 13:55:58.276811619 +0000 UTC m=+0.384959080 container init ba55d178c42b09b140c39087cbdc5d3202c3c0d69fafd19426d336abd765bf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-1-deactivate, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-25T13:55:58.571 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:55:58 smithi161 podman[68898]: 2024-04-25 13:55:58.280604554 +0000 UTC m=+0.388752003 container start ba55d178c42b09b140c39087cbdc5d3202c3c0d69fafd19426d336abd765bf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-25T13:55:58.571 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:55:58 smithi161 podman[68898]: 2024-04-25 13:55:58.368731635 +0000 UTC m=+0.476879094 container attach ba55d178c42b09b140c39087cbdc5d3202c3c0d69fafd19426d336abd765bf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-1-deactivate, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2) 2024-04-25T13:55:58.852 INFO:journalctl@ceph.osd.1.smithi161.stdout:Apr 25 13:55:58 smithi161 podman[68898]: 2024-04-25 13:55:58.572695725 +0000 UTC m=+0.680843182 container died ba55d178c42b09b140c39087cbdc5d3202c3c0d69fafd19426d336abd765bf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T13:55:59.267 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.1.service' 2024-04-25T13:55:59.309 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:55:59.309 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-25T13:55:59.309 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-25T13:55:59.309 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.2 2024-04-25T13:55:59.627 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:55:59 smithi175 systemd[1]: Stopping Ceph osd.2 for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:55:59.930 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:55:59 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-2[37797]: 2024-04-25T13:55:59.627+0000 7f873b7e5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:55:59.930 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:55:59 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-2[37797]: 2024-04-25T13:55:59.627+0000 7f873b7e5700 -1 osd.2 99 *** Got signal Terminated *** 2024-04-25T13:55:59.930 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:55:59 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-2[37797]: 2024-04-25T13:55:59.627+0000 7f873b7e5700 -1 osd.2 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T13:56:05.411 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:56:05 smithi175 podman[68989]: 2024-04-25 13:56:05.100567197 +0000 UTC m=+5.595530574 container died 568b274f1b6b4ec2f0aec36c6a567ea05679346fe47381e5296be0bc50cb6652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-04-25T13:56:05.680 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:56:05 smithi175 podman[68989]: 2024-04-25 13:56:05.494783779 +0000 UTC m=+5.989747159 container cleanup 568b274f1b6b4ec2f0aec36c6a567ea05679346fe47381e5296be0bc50cb6652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-25T13:56:05.680 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:56:05 smithi175 bash[68989]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-2 2024-04-25T13:56:06.104 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:56:05 smithi175 podman[69008]: 2024-04-25 13:56:05.771519902 +0000 UTC m=+0.668257124 container remove 568b274f1b6b4ec2f0aec36c6a567ea05679346fe47381e5296be0bc50cb6652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-25T13:56:06.373 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:56:06 smithi175 podman[69098]: 2024-04-25 13:56:06.008463535 +0000 UTC m=+0.018225149 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:56:06.374 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:56:06 smithi175 podman[69098]: 2024-04-25 13:56:06.122383389 +0000 UTC m=+0.132144989 container create 57e830c90bba9f266312dac57fb8781892cca45ed1098e6cfae28adf5897f3aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-25T13:56:06.664 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:56:06 smithi175 podman[69098]: 2024-04-25 13:56:06.375214646 +0000 UTC m=+0.384976250 container init 57e830c90bba9f266312dac57fb8781892cca45ed1098e6cfae28adf5897f3aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T13:56:06.664 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:56:06 smithi175 podman[69098]: 2024-04-25 13:56:06.378351967 +0000 UTC m=+0.388113573 container start 57e830c90bba9f266312dac57fb8781892cca45ed1098e6cfae28adf5897f3aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-25T13:56:06.664 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:56:06 smithi175 podman[69098]: 2024-04-25 13:56:06.475171348 +0000 UTC m=+0.484932956 container attach 57e830c90bba9f266312dac57fb8781892cca45ed1098e6cfae28adf5897f3aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-25T13:56:06.930 INFO:journalctl@ceph.osd.2.smithi175.stdout:Apr 25 13:56:06 smithi175 podman[69098]: 2024-04-25 13:56:06.665422898 +0000 UTC m=+0.675184500 container died 57e830c90bba9f266312dac57fb8781892cca45ed1098e6cfae28adf5897f3aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-25T13:56:07.355 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.2.service' 2024-04-25T13:56:07.396 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:56:07.396 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-25T13:56:07.396 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-25T13:56:07.396 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.3 2024-04-25T13:56:07.712 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:56:07 smithi043 systemd[1]: Stopping Ceph osd.3 for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:56:08.212 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:56:07 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-3[50642]: 2024-04-25T13:56:07.738+0000 7fe6e4bbd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:56:08.212 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:56:07 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-3[50642]: 2024-04-25T13:56:07.738+0000 7fe6e4bbd700 -1 osd.3 99 *** Got signal Terminated *** 2024-04-25T13:56:08.212 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:56:07 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-3[50642]: 2024-04-25T13:56:07.738+0000 7fe6e4bbd700 -1 osd.3 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T13:56:10.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:10 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:10.208+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:10.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:10 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:10.086+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:11.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:11 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:11.234+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:11.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:11 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:11.046+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:11.431 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:11 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:11.004+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:11.712 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:56:11 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-3[50642]: 2024-04-25T13:56:11.458+0000 7fe6e1173700 -1 osd.3 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.104002+0000 front 2024-04-25T13:55:46.103965+0000 (oldest deadline 2024-04-25T13:56:10.804140+0000) 2024-04-25T13:56:11.754 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:11 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:11.368+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:12.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:11 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:11.720+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:12.430 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:12 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:12.052+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:12.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:12 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:12.256+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:12.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:12 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:12.085+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:12.602 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:12 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:12.332+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:12.962 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:56:12 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-3[50642]: 2024-04-25T13:56:12.505+0000 7fe6e1173700 -1 osd.3 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.104002+0000 front 2024-04-25T13:55:46.103965+0000 (oldest deadline 2024-04-25T13:56:10.804140+0000) 2024-04-25T13:56:12.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:12 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:12.717+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:13.430 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:13.044+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:13.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:13.279+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:13.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:13.040+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:13.455 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:56:13 smithi043 podman[89747]: 2024-04-25 13:56:13.181753696 +0000 UTC m=+5.582618270 container died d45a644223d4ca6e162e193bc3ec18e5e1191e9d4103b2876fde7f275aadcbd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-3, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-25T13:56:13.602 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:13 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:13.298+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:13.712 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:13 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:13.702+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:13.712 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:56:13 smithi043 podman[89747]: 2024-04-25 13:56:13.555275165 +0000 UTC m=+5.956139738 container cleanup d45a644223d4ca6e162e193bc3ec18e5e1191e9d4103b2876fde7f275aadcbd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-25T13:56:13.712 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:56:13 smithi043 bash[89747]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-3 2024-04-25T13:56:14.186 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:56:13 smithi043 podman[89764]: 2024-04-25 13:56:13.823629624 +0000 UTC m=+0.645467529 container remove d45a644223d4ca6e162e193bc3ec18e5e1191e9d4103b2876fde7f275aadcbd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-3, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5) 2024-04-25T13:56:14.284 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:14 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:14.007+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:14.285 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:14 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:14.014+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:14.460 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:56:14 smithi043 podman[89854]: 2024-04-25 13:56:14.090928689 +0000 UTC m=+0.018676419 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:56:14.460 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:56:14 smithi043 podman[89854]: 2024-04-25 13:56:14.216303317 +0000 UTC m=+0.144051077 container create 013ca4b2aa3023de3ede0037837944ceea77d4cd2a5458337218558f99760949 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True) 2024-04-25T13:56:14.602 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:14 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:14.283+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:14.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:14 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:14.285+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:14.711 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:56:14 smithi043 podman[89854]: 2024-04-25 13:56:14.461124519 +0000 UTC m=+0.388872245 container init 013ca4b2aa3023de3ede0037837944ceea77d4cd2a5458337218558f99760949 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T13:56:14.711 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:56:14 smithi043 podman[89854]: 2024-04-25 13:56:14.464855386 +0000 UTC m=+0.392603105 container start 013ca4b2aa3023de3ede0037837944ceea77d4cd2a5458337218558f99760949 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-25T13:56:14.711 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:56:14 smithi043 podman[89854]: 2024-04-25 13:56:14.568991979 +0000 UTC m=+0.496739712 container attach 013ca4b2aa3023de3ede0037837944ceea77d4cd2a5458337218558f99760949 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T13:56:14.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:14 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:14.711+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:14.962 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 13:56:14 smithi043 podman[89854]: 2024-04-25 13:56:14.774502238 +0000 UTC m=+0.702249957 container died 013ca4b2aa3023de3ede0037837944ceea77d4cd2a5458337218558f99760949 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T13:56:15.277 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:15 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:15.023+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:15.277 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:15 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:15.029+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:15.436 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.3.service' 2024-04-25T13:56:15.480 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:56:15.480 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-25T13:56:15.480 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-25T13:56:15.480 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.4 2024-04-25T13:56:15.508 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:15 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:15.237+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:15.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:15 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:15.278+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:15.791 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:15 smithi161 systemd[1]: Stopping Ceph osd.4 for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:56:15.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:15 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:15.673+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:16.102 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:15 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4[43822]: 2024-04-25T13:56:15.792+0000 7fbf1ebf1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:56:16.102 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:15 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4[43822]: 2024-04-25T13:56:15.792+0000 7fbf1ebf1700 -1 osd.4 99 *** Got signal Terminated *** 2024-04-25T13:56:16.103 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:15 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4[43822]: 2024-04-25T13:56:15.792+0000 7fbf1ebf1700 -1 osd.4 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T13:56:16.284 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:16 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:16.021+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:16.285 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:15 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:15.974+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:16.602 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:16 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:16.278+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:16.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:16 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:16.285+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:16.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:16 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:16.705+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:17.293 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:16 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:16.980+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:17.293 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:17 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:17.061+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:17.602 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:17 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:17.296+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:17.602 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:17 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:17.504+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:17.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:17 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:17.293+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:17.712 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:17 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:17.245+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:18.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:17 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:17.736+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:18.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:17 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:17.736+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:18.311 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:18 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:18.083+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:18.312 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:18 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:18.083+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:53.045141+0000 front 2024-04-25T13:55:53.045303+0000 (oldest deadline 2024-04-25T13:56:17.745106+0000) 2024-04-25T13:56:18.312 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:17 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:17.973+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:18.312 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:17 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:17.973+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:18.602 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:18 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:18.541+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:18.602 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:18 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:18.335+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:18.603 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:18 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4[43822]: 2024-04-25T13:56:18.326+0000 7fbf1b1a7700 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.482361+0000 front 2024-04-25T13:55:51.482388+0000 (oldest deadline 2024-04-25T13:56:17.382504+0000) 2024-04-25T13:56:18.624 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:18 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:18.312+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:18.711 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:18 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:18.239+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:18.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:18 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:18.712+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:18.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:18 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:18.712+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:19.321 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:19 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:19.003+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:19.321 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:19 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:19.003+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:19.322 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:19 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:19.097+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:19.322 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:19 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:19.097+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:53.045141+0000 front 2024-04-25T13:55:53.045303+0000 (oldest deadline 2024-04-25T13:56:17.745106+0000) 2024-04-25T13:56:19.574 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:19 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:19.311+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:19.574 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:19 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4[43822]: 2024-04-25T13:56:19.338+0000 7fbf1b1a7700 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.482361+0000 front 2024-04-25T13:55:51.482388+0000 (oldest deadline 2024-04-25T13:56:17.382504+0000) 2024-04-25T13:56:19.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:19 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:19.322+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:19.712 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:19 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:19.273+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:19.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:19 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:19.574+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:20.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:19 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:19.746+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:20.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:19 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:19.746+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:20.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:20 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:20.273+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:20.431 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:20 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:20.074+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:20.431 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:20 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:20.074+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:53.045141+0000 front 2024-04-25T13:55:53.045303+0000 (oldest deadline 2024-04-25T13:56:17.745106+0000) 2024-04-25T13:56:20.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:20 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:20.024+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:20.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:20 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:20.024+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:20.602 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:20 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:20.541+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:20.602 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:20 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4[43822]: 2024-04-25T13:56:20.360+0000 7fbf1b1a7700 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.482361+0000 front 2024-04-25T13:55:51.482388+0000 (oldest deadline 2024-04-25T13:56:17.382504+0000) 2024-04-25T13:56:20.602 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:20 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:20.297+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:20.602 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:20 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:20.297+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:20.712 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:20 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:20.289+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:21.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:20 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:20.732+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:21.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:20 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:20.732+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:21.287 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:21 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:21.005+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:21.287 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:21 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:21.005+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:21.288 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:21 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:21.102+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:21.288 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:21 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:21.102+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:53.045141+0000 front 2024-04-25T13:55:53.045303+0000 (oldest deadline 2024-04-25T13:56:17.745106+0000) 2024-04-25T13:56:21.443 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:21 smithi161 podman[69028]: 2024-04-25 13:56:21.125896828 +0000 UTC m=+5.447425176 container died a7bae7bcbf2c36220ce0b06a1edc7b04a2afbe189bd2654d11e22c36de3a749a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-25T13:56:21.443 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:21 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:21.309+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:21.443 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:21 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:21.309+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:21.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:21 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:21.287+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:21.712 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:21 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:21.259+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:21.767 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:21 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:21.522+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:21.767 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:21 smithi161 podman[69028]: 2024-04-25 13:56:21.534259809 +0000 UTC m=+5.855788210 container cleanup a7bae7bcbf2c36220ce0b06a1edc7b04a2afbe189bd2654d11e22c36de3a749a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424) 2024-04-25T13:56:21.767 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:21 smithi161 bash[69028]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4 2024-04-25T13:56:22.076 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:21 smithi161 podman[69048]: 2024-04-25 13:56:21.76870729 +0000 UTC m=+0.640695673 container remove a7bae7bcbf2c36220ce0b06a1edc7b04a2afbe189bd2654d11e22c36de3a749a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-25T13:56:22.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:21 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:21.740+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:22.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:21 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:21.740+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:22.265 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:21 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:21.964+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:22.265 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:21 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:21.964+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:22.266 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:22 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:22.135+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:22.266 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:22 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:22.135+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:53.045141+0000 front 2024-04-25T13:55:53.045303+0000 (oldest deadline 2024-04-25T13:56:17.745106+0000) 2024-04-25T13:56:22.352 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:22 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:22.324+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:22.352 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:22 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:22.324+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:22.352 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:22 smithi161 podman[69134]: 2024-04-25 13:56:21.980247515 +0000 UTC m=+0.018132930 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:56:22.352 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:22 smithi161 podman[69134]: 2024-04-25 13:56:22.094811876 +0000 UTC m=+0.132697288 container create 2f7846f300d3708551a8839b8285685b0c8d7e2262bdf521717d8865261d4798 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-25T13:56:22.353 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:22 smithi161 podman[69134]: 2024-04-25 13:56:22.322699633 +0000 UTC m=+0.360585044 container init 2f7846f300d3708551a8839b8285685b0c8d7e2262bdf521717d8865261d4798 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-25T13:56:22.353 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:22 smithi161 podman[69134]: 2024-04-25 13:56:22.326133006 +0000 UTC m=+0.364018408 container start 2f7846f300d3708551a8839b8285685b0c8d7e2262bdf521717d8865261d4798 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-25T13:56:22.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:22 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:22.265+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:22.700 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:22 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:22.298+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:22.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:22 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:22.540+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:22.852 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:22 smithi161 podman[69134]: 2024-04-25 13:56:22.422374124 +0000 UTC m=+0.460259526 container attach 2f7846f300d3708551a8839b8285685b0c8d7e2262bdf521717d8865261d4798 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T13:56:22.852 INFO:journalctl@ceph.osd.4.smithi161.stdout:Apr 25 13:56:22 smithi161 podman[69134]: 2024-04-25 13:56:22.62624199 +0000 UTC m=+0.664127384 container died 2f7846f300d3708551a8839b8285685b0c8d7e2262bdf521717d8865261d4798 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS) 2024-04-25T13:56:22.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:22 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:22.700+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:22.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:22 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:22.700+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:23.257 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:22 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:22.966+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:23.257 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:22 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:22.966+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:23.257 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:23 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:23.145+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:23.257 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:23 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:23.145+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:53.045141+0000 front 2024-04-25T13:55:53.045303+0000 (oldest deadline 2024-04-25T13:56:17.745106+0000) 2024-04-25T13:56:23.295 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.4.service' 2024-04-25T13:56:23.373 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:56:23.373 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-25T13:56:23.373 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-25T13:56:23.374 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.5 2024-04-25T13:56:23.602 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:23 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:23.497+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:23.602 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:23 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:23.369+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:23.603 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:23 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:23.369+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:23.680 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:23 smithi175 systemd[1]: Stopping Ceph osd.5 for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:56:23.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:23 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:23.257+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:23.697 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:23 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:23.341+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:23.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:23 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:23.697+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:23.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:23 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:23.697+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:23.965 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:23 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:23.698+0000 7f7220b12700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:56:23.965 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:23 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:23.698+0000 7f7220b12700 -1 osd.5 99 *** Got signal Terminated *** 2024-04-25T13:56:23.965 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:23 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:23.698+0000 7f7220b12700 -1 osd.5 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T13:56:24.264 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:23 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:23.965+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:24.265 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:23 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:23.965+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:24.265 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:24 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:24.168+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:24.265 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:24 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:24.168+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:53.045141+0000 front 2024-04-25T13:55:53.045303+0000 (oldest deadline 2024-04-25T13:56:17.745106+0000) 2024-04-25T13:56:24.649 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:24 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:24.327+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:24.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:24 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:24.265+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:24.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:24 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:24.533+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:24.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:24 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:24.374+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:24.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:24 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:24.374+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:24.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:24 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:24.650+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:24.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:24 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:24.650+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:25.245 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:24 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:24.983+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:25.245 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:24 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:24.983+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:25.246 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:25 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:25.175+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:25.246 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:25 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:25.175+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:53.045141+0000 front 2024-04-25T13:55:53.045303+0000 (oldest deadline 2024-04-25T13:56:17.745106+0000) 2024-04-25T13:56:25.661 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:25 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:25.286+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:25.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:25 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:25.245+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:25.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:25 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:25.513+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:25.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:25 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:25.513+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:25.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:25 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:25.423+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:25.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:25 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:25.423+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:25.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:25 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:25.662+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:25.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:25 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:25.662+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:26.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:26 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:26.228+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:26.431 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:26 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:26.127+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:26.431 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:26 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:26.127+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:53.045141+0000 front 2024-04-25T13:55:53.045303+0000 (oldest deadline 2024-04-25T13:56:17.745106+0000) 2024-04-25T13:56:26.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:25 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:25.998+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:26.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:25 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:25.998+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:26.650 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:26 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:26.281+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:26.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:26 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:26.511+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:26.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:26 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:26.511+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:26.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:26 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:26.413+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:26.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:26 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:26.413+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:26.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:26 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:26.651+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:26.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:26 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:26.651+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:27.430 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:27 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:27.165+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:27.430 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:27 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:27.165+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:53.045141+0000 front 2024-04-25T13:55:53.045303+0000 (oldest deadline 2024-04-25T13:56:17.745106+0000) 2024-04-25T13:56:27.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:27 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:27.214+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:27.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:27 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:27.214+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:27.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:27 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:27.000+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:27.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:27 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:27.000+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:27.645 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:27 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:27.282+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:27.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:27 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:27.529+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:27.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:27 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:27.529+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:27.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:27 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:27.415+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:27.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:27 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:27.415+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:27.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:27 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:27.415+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:27.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:27 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:27.645+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:27.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:27 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:27.645+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:27.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:27 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:27.645+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:28.234 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:27 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:27.961+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:28.234 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:27 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:27.961+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:28.235 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:28 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:28.118+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:46.044064+0000 front 2024-04-25T13:55:46.043965+0000 (oldest deadline 2024-04-25T13:56:10.143943+0000) 2024-04-25T13:56:28.235 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:28 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-25T13:56:28.118+0000 7f72190c0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:53.045141+0000 front 2024-04-25T13:55:53.045303+0000 (oldest deadline 2024-04-25T13:56:17.745106+0000) 2024-04-25T13:56:28.601 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:28 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:28.262+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:28.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:28 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:28.234+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:28.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:28 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:28.234+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:28.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:28 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:28.562+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:28.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:28 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:28.562+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:28.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:28 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:28.401+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:28.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:28 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:28.401+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:28.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:28 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:28.401+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:28.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:28 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:28.601+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:28.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:28 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:28.601+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:28.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:28 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:28.601+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:29.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:29 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:29.233+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:29.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:29 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:29.233+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:29.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:29 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:28.998+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:29.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:29 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:28.998+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:29.431 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:29 smithi175 podman[69218]: 2024-04-25 13:56:29.133254383 +0000 UTC m=+5.568466713 container stop a42309889fb3aaf18f40a392db64c24400f8a08abbb92c9139da5a68df3db901 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424) 2024-04-25T13:56:29.431 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:29 smithi175 podman[69218]: 2024-04-25 13:56:29.158795071 +0000 UTC m=+5.594007413 container died a42309889fb3aaf18f40a392db64c24400f8a08abbb92c9139da5a68df3db901 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, io.buildah.version=1.33.5) 2024-04-25T13:56:29.616 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:29 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:29.309+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:29.616 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:29 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:29.309+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:03.310491+0000 front 2024-04-25T13:56:03.310536+0000 (oldest deadline 2024-04-25T13:56:29.210719+0000) 2024-04-25T13:56:29.732 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:29 smithi175 podman[69218]: 2024-04-25 13:56:29.557095179 +0000 UTC m=+5.992307508 container cleanup a42309889fb3aaf18f40a392db64c24400f8a08abbb92c9139da5a68df3db901 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T13:56:29.732 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:29 smithi175 bash[69218]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5 2024-04-25T13:56:29.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:29 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:29.513+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:29.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:29 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:29.513+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:29.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:29 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:29.415+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:29.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:29 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:29.415+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:29.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:29 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:29.415+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:29.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:29 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:29.616+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:29.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:29 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:29.616+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:29.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:29 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:29.616+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:30.169 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:29 smithi175 podman[69235]: 2024-04-25 13:56:29.733621784 +0000 UTC m=+0.593528960 container remove a42309889fb3aaf18f40a392db64c24400f8a08abbb92c9139da5a68df3db901 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-25T13:56:30.170 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:29 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:29.960+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:30.170 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:29 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:29.960+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:30.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:30 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:30.271+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:30.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:30 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:30.271+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:30.430 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:30 smithi175 podman[69323]: 2024-04-25 13:56:30.073281423 +0000 UTC m=+0.017795399 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:56:30.430 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:30 smithi175 podman[69323]: 2024-04-25 13:56:30.184750342 +0000 UTC m=+0.129264352 container create 8cf3744c13ba71c5508b7483c0b237345e2c04dae82f312fb6302c292b6cb8ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-25T13:56:30.712 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:30 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:30.358+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:30.713 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:30 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:30.358+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:03.310491+0000 front 2024-04-25T13:56:03.310536+0000 (oldest deadline 2024-04-25T13:56:29.210719+0000) 2024-04-25T13:56:30.713 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:30 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:30.576+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:30.713 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:30 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:30.576+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:30.713 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:30 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:30.576+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:30.730 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:30 smithi175 podman[69323]: 2024-04-25 13:56:30.437496516 +0000 UTC m=+0.382010489 container init 8cf3744c13ba71c5508b7483c0b237345e2c04dae82f312fb6302c292b6cb8ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T13:56:30.730 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:30 smithi175 podman[69323]: 2024-04-25 13:56:30.440791583 +0000 UTC m=+0.385305554 container start 8cf3744c13ba71c5508b7483c0b237345e2c04dae82f312fb6302c292b6cb8ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-25T13:56:30.730 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:30 smithi175 podman[69323]: 2024-04-25 13:56:30.528899054 +0000 UTC m=+0.473413040 container attach 8cf3744c13ba71c5508b7483c0b237345e2c04dae82f312fb6302c292b6cb8ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T13:56:30.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:30 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:30.543+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:30.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:30 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:30.543+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:30.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:30 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:30.461+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:30.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:30 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:30.461+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:30.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:30 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:30.461+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:30.989 INFO:journalctl@ceph.osd.5.smithi175.stdout:Apr 25 13:56:30 smithi175 podman[69323]: 2024-04-25 13:56:30.731794369 +0000 UTC m=+0.676308341 container died 8cf3744c13ba71c5508b7483c0b237345e2c04dae82f312fb6302c292b6cb8ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-25T13:56:31.320 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:30 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:30.989+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:31.320 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:30 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:30.989+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:31.320 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:30 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:30.989+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:31.358 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.5.service' 2024-04-25T13:56:31.401 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:56:31.401 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-25T13:56:31.401 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-25T13:56:31.401 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.6 2024-04-25T13:56:31.601 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:31 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:31.320+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:31.601 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:31 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:31.320+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:03.310491+0000 front 2024-04-25T13:56:03.310536+0000 (oldest deadline 2024-04-25T13:56:29.210719+0000) 2024-04-25T13:56:31.601 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:31 smithi043 systemd[1]: Stopping Ceph osd.6 for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:56:31.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:31.320+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:31.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:31.320+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:31.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:31.584+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:31.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:31.584+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:31.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:31.500+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:31.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:31.500+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:31.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:31 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:31.500+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:31.962 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:31 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:31.725+0000 7f496e032700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:56:31.962 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:31 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:31.725+0000 7f496e032700 -1 osd.6 99 *** Got signal Terminated *** 2024-04-25T13:56:31.962 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:31 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:31.725+0000 7f496e032700 -1 osd.6 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T13:56:31.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:31 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:31.600+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:31.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:31 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:31.600+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:31.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:31 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:31.600+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:32.271 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:31.945+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:32.271 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:31.945+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:32.271 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:31 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:31.945+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:32.635 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:32 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:32.277+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:32.636 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:32 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:32.277+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:03.310491+0000 front 2024-04-25T13:56:03.310536+0000 (oldest deadline 2024-04-25T13:56:29.210719+0000) 2024-04-25T13:56:32.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:32 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:32.270+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:32.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:32 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:32.270+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:32.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:32 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:32.630+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:32.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:32 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:32.630+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:32.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:32 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:32.518+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:32.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:32 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:32.518+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:32.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:32 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:32.518+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:32.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:32 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:32.636+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:32.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:32 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:32.636+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:32.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:32 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:32.636+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:33.269 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:32 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:32.940+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:33.270 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:32 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:32.940+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:33.270 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:32 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:32.940+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:33.626 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:33 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:33.288+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:33.627 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:33 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:33.288+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:03.310491+0000 front 2024-04-25T13:56:03.310536+0000 (oldest deadline 2024-04-25T13:56:29.210719+0000) 2024-04-25T13:56:33.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:33 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:33.270+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:33.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:33 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:33.270+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:33.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:33 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:33.610+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:33.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:33 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:33.610+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:33.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:33 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:33.610+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.356710+0000 front 2024-04-25T13:56:12.356840+0000 (oldest deadline 2024-04-25T13:56:33.357154+0000) 2024-04-25T13:56:33.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:33 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:33.527+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:33.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:33 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:33.527+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:33.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:33 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:33.527+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:33.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:33 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:33.627+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:33.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:33 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:33.627+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:33.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:33 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:33.627+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:34.180 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:33 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:33.925+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:34.180 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:33 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:33.925+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:34.180 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:33 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:33.925+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:34.672 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:34 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:34.320+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:34.672 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:34 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:34.320+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:03.310491+0000 front 2024-04-25T13:56:03.310536+0000 (oldest deadline 2024-04-25T13:56:29.210719+0000) 2024-04-25T13:56:34.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:34 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:34.237+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:34.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:34 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:34.237+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:34.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:34 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:34.237+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:34.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:34 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:34.600+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:34.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:34 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:34.600+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:34.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:34 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:34.600+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.356710+0000 front 2024-04-25T13:56:12.356840+0000 (oldest deadline 2024-04-25T13:56:33.357154+0000) 2024-04-25T13:56:34.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:34 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:34.549+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:34.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:34 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:34.549+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:34.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:34 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:34.549+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:34.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:34 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:34.673+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:34.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:34 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:34.673+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:34.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:34 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:34.673+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:34.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:34 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:34.673+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:35.192 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:34 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:34.933+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:35.192 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:34 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:34.933+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:35.192 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:34 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:34.933+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:35.663 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:35.363+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:35.663 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:35.363+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:03.310491+0000 front 2024-04-25T13:56:03.310536+0000 (oldest deadline 2024-04-25T13:56:29.210719+0000) 2024-04-25T13:56:35.679 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:35 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:35.192+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:35.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:35 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:35.192+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:35.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:35 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:35.192+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:35.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:35 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:35.597+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:35.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:35 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:35.597+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:35.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:35 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:35.597+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.356710+0000 front 2024-04-25T13:56:12.356840+0000 (oldest deadline 2024-04-25T13:56:33.357154+0000) 2024-04-25T13:56:35.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:35 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:35.590+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:35.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:35 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:35.590+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:35.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:35 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:35.590+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:35.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:35 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:35.590+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:35.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:35.664+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:35.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:35.664+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:35.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:35.664+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:35.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:35 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:35.664+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:36.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:36 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:36.201+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:36.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:36 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:36.201+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:36.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:36 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:36.201+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:36.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:35 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:35.958+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:36.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:35 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:35.958+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:36.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:35 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:35.958+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:36.619 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:36.354+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.707869+0000 front 2024-04-25T13:55:54.707956+0000 (oldest deadline 2024-04-25T13:56:17.007981+0000) 2024-04-25T13:56:36.620 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6[57374]: 2024-04-25T13:56:36.354+0000 7f49665e0700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:03.310491+0000 front 2024-04-25T13:56:03.310536+0000 (oldest deadline 2024-04-25T13:56:29.210719+0000) 2024-04-25T13:56:36.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:36 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:36.599+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:36.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:36 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:36.599+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:36.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:36 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:36.599+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.356710+0000 front 2024-04-25T13:56:12.356840+0000 (oldest deadline 2024-04-25T13:56:33.357154+0000) 2024-04-25T13:56:36.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:36 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:36.587+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:36.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:36 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:36.587+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:36.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:36 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:36.587+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:36.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:36 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:36.587+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:36.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:36.620+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:36.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:36.620+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:36.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:36.620+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:36.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:36 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:36.620+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:37.245 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:36 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:36.935+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:37.245 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:36 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:36.935+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:37.245 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:36 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:36.935+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:37.358 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:37 smithi043 podman[89970]: 2024-04-25 13:56:37.082345017 +0000 UTC m=+5.482117215 container died 59845db09814c09bdeecbaf003786a84ba9b14da25993f33196eb7b5aea337ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-25T13:56:37.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:37 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:37.245+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:37.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:37 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:37.245+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:37.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:37 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:37.245+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:37.712 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:37 smithi043 podman[89970]: 2024-04-25 13:56:37.450547428 +0000 UTC m=+5.850319624 container cleanup 59845db09814c09bdeecbaf003786a84ba9b14da25993f33196eb7b5aea337ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=) 2024-04-25T13:56:37.712 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:37 smithi043 bash[89970]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6 2024-04-25T13:56:37.713 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:37 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:37.589+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:37.713 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:37 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:37.589+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:37.713 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:37 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:37.589+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:37.713 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:37 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:37.589+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:37.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:37 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:37.588+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:37.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:37 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:37.588+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:37.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:37 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:37.588+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.356710+0000 front 2024-04-25T13:56:12.356840+0000 (oldest deadline 2024-04-25T13:56:33.357154+0000) 2024-04-25T13:56:37.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:37 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:37.559+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:37.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:37 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:37.559+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:37.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:37 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:37.559+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:37.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:37 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:37.559+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:38.070 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:37 smithi043 podman[89990]: 2024-04-25 13:56:37.743621747 +0000 UTC m=+0.654293905 container remove 59845db09814c09bdeecbaf003786a84ba9b14da25993f33196eb7b5aea337ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-25T13:56:38.180 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:37 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:37.927+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:38.180 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:37 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:37.927+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:38.180 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:37 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:37.927+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:38.363 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:38 smithi043 podman[90082]: 2024-04-25 13:56:37.973176016 +0000 UTC m=+0.018340958 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:56:38.363 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:38 smithi043 podman[90082]: 2024-04-25 13:56:38.103181536 +0000 UTC m=+0.148346493 container create 816ef2946c3840eb1048812863b7323bd08cec803e13ff9aac99770a449c6479 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2) 2024-04-25T13:56:38.669 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:38 smithi043 podman[90082]: 2024-04-25 13:56:38.364132292 +0000 UTC m=+0.409297216 container init 816ef2946c3840eb1048812863b7323bd08cec803e13ff9aac99770a449c6479 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T13:56:38.669 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:38 smithi043 podman[90082]: 2024-04-25 13:56:38.367916975 +0000 UTC m=+0.413081899 container start 816ef2946c3840eb1048812863b7323bd08cec803e13ff9aac99770a449c6479 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-25T13:56:38.669 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:38 smithi043 podman[90082]: 2024-04-25 13:56:38.447235505 +0000 UTC m=+0.492400429 container attach 816ef2946c3840eb1048812863b7323bd08cec803e13ff9aac99770a449c6479 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T13:56:38.669 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:38 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:38.585+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:38.670 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:38 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:38.585+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:38.670 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:38 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:38.585+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:38.670 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:38 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:38.585+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:38.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:38 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:38.290+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:38.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:38 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:38.290+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:38.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:38 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:38.290+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:38.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:38 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:38.594+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:38.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:38 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:38.594+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:38.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:38 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:38.594+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.356710+0000 front 2024-04-25T13:56:12.356840+0000 (oldest deadline 2024-04-25T13:56:33.357154+0000) 2024-04-25T13:56:38.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:38 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:38.564+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:38.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:38 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:38.564+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:38.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:38 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:38.564+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:38.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:38 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:38.564+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:38.962 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 13:56:38 smithi043 podman[90082]: 2024-04-25 13:56:38.670478301 +0000 UTC m=+0.715643232 container died 816ef2946c3840eb1048812863b7323bd08cec803e13ff9aac99770a449c6479 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-6-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True) 2024-04-25T13:56:39.180 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:38 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:38.915+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:39.180 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:38 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:38.915+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:39.180 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:38 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:38.915+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:39.318 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.6.service' 2024-04-25T13:56:39.359 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:56:39.359 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-25T13:56:39.359 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-04-25T13:56:39.360 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.7 2024-04-25T13:56:39.677 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:39 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:39.541+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:39.678 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:39 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:39.541+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:39.678 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:39 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:39.541+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:39.678 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:39 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:39.541+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:39.678 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:39 smithi161 systemd[1]: Stopping Ceph osd.7 for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:56:39.678 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:39 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:39.560+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:39.678 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:39 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:39.560+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:39.678 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:39 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:39.560+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.356710+0000 front 2024-04-25T13:56:12.356840+0000 (oldest deadline 2024-04-25T13:56:33.357154+0000) 2024-04-25T13:56:39.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:39 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:39.262+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:39.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:39 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:39.262+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:39.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:39 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:39.262+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:39.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:39 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:39.565+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:39.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:39 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:39.565+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:39.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:39 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:39.565+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:39.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:39 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:39.565+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:40.102 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:39 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:39.678+0000 7f2fa7202700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:56:40.102 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:39 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:39.678+0000 7f2fa7202700 -1 osd.7 99 *** Got signal Terminated *** 2024-04-25T13:56:40.102 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:39 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:39.678+0000 7f2fa7202700 -1 osd.7 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T13:56:40.245 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:39 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:39.934+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:40.246 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:39 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:39.934+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:40.246 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:39 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:39.934+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:40.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:40 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:40.246+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:40.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:40 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:40.246+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:40.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:40 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:40.246+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:40.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:40 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:40.532+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:40.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:40 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:40.532+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:40.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:40 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:40.532+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.356710+0000 front 2024-04-25T13:56:12.356840+0000 (oldest deadline 2024-04-25T13:56:33.357154+0000) 2024-04-25T13:56:40.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:40 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:40.541+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:40.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:40 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:40.541+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:40.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:40 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:40.541+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:40.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:40 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:40.541+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:40.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:40 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:40.612+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:40.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:40 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:40.612+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:40.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:40 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:40.612+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:40.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:40 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:40.612+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:41.223 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:40 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:40.939+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:41.223 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:40 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:40.939+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:41.224 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:40 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:40.939+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:41.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:41 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:41.224+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:41.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:41 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:41.224+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:41.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:41 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:41.224+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:41.754 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:41 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:41.554+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:41.754 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:41 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:41.554+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:41.754 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:41 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:41.554+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.356710+0000 front 2024-04-25T13:56:12.356840+0000 (oldest deadline 2024-04-25T13:56:33.357154+0000) 2024-04-25T13:56:41.754 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:41 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:41.492+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:41.754 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:41 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:41.492+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:41.755 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:41 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:41.492+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:41.755 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:41 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:41.492+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:41.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:41 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:41.569+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:41.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:41 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:41.569+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:41.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:41 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:41.569+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:41.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:41 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:41.569+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:42.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:41 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:41.960+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:42.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:41 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:41.960+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:42.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:41 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:41.960+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:42.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:42 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:42.201+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:42.431 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:42 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:42.201+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:42.431 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:42 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:42.201+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:42.431 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:42 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:42.201+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:18.446826+0000 front 2024-04-25T13:56:18.446779+0000 (oldest deadline 2024-04-25T13:56:41.346875+0000) 2024-04-25T13:56:42.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:42 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:42.532+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:42.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:42 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:42.532+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:42.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:42 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:42.532+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.356710+0000 front 2024-04-25T13:56:12.356840+0000 (oldest deadline 2024-04-25T13:56:33.357154+0000) 2024-04-25T13:56:42.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:42 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:42.531+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:42.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:42 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:42.531+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:42.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:42 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:42.531+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:42.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:42 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:42.531+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:42.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:42 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:42.531+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:42.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:42 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:42.568+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:42.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:42 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:42.568+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:42.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:42 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:42.568+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:42.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:42 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:42.568+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:43.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:43 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:43.010+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:43.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:43 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:43.010+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:43.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:43 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:43.010+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:43.431 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:43 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:43.198+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:43.431 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:43 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:43.198+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:43.431 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:43 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:43.198+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:43.431 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:43 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:43.198+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:18.446826+0000 front 2024-04-25T13:56:18.446779+0000 (oldest deadline 2024-04-25T13:56:41.346875+0000) 2024-04-25T13:56:43.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:43 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:43.494+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:43.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:43 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:43.494+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:43.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:43 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:43.494+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.356710+0000 front 2024-04-25T13:56:12.356840+0000 (oldest deadline 2024-04-25T13:56:33.357154+0000) 2024-04-25T13:56:43.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:43 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:43.494+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:18.558846+0000 front 2024-04-25T13:56:18.558813+0000 (oldest deadline 2024-04-25T13:56:43.258972+0000) 2024-04-25T13:56:43.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:43 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:43.570+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:43.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:43 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:43.570+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:43.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:43 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:43.570+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:43.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:43 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:43.570+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:43.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:43 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:43.570+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:43.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:43 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:43.609+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:43.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:43 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:43.609+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:43.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:43 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:43.609+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:43.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:43 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:43.609+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:44.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:44 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:44.026+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:44.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:44 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:44.026+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:44.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:44 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:44.026+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:44.431 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:44 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:44.230+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:44.431 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:44 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:44.230+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:44.432 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:44 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:44.230+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:44.432 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:44 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:44.230+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:18.446826+0000 front 2024-04-25T13:56:18.446779+0000 (oldest deadline 2024-04-25T13:56:41.346875+0000) 2024-04-25T13:56:44.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:44 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:44.497+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:56.053430+0000 front 2024-04-25T13:55:56.053399+0000 (oldest deadline 2024-04-25T13:56:17.153574+0000) 2024-04-25T13:56:44.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:44 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:44.497+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.454680+0000 front 2024-04-25T13:56:02.454736+0000 (oldest deadline 2024-04-25T13:56:25.354788+0000) 2024-04-25T13:56:44.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:44 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:44.497+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.356710+0000 front 2024-04-25T13:56:12.356840+0000 (oldest deadline 2024-04-25T13:56:33.357154+0000) 2024-04-25T13:56:44.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:44 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7[50840]: 2024-04-25T13:56:44.497+0000 7f2fa37b8700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:18.558846+0000 front 2024-04-25T13:56:18.558813+0000 (oldest deadline 2024-04-25T13:56:43.258972+0000) 2024-04-25T13:56:44.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:44 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:44.575+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:44.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:44 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:44.575+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:44.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:44 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:44.575+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:44.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:44 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:44.575+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:44.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:44 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:44.575+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:44.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:44 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:44.624+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:44.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:44 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:44.624+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:44.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:44 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:44.624+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:44.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:44 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:44.624+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:45.276 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:45 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:45.000+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:45.276 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:45 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:45.000+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:45.276 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:45 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:45.000+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:45.276 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:45 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:45.000+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:56:45.528 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:45 smithi161 podman[69242]: 2024-04-25 13:56:45.247192955 +0000 UTC m=+5.690663906 container died 9320861af33d861e4fbf2bd4d1d5f0c8196f97ffc6641691c00fd6cac43f9787 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-25T13:56:45.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:45 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:45.276+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:45.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:45 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:45.276+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:45.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:45 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:45.276+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:45.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:45 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:45.276+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:18.446826+0000 front 2024-04-25T13:56:18.446779+0000 (oldest deadline 2024-04-25T13:56:41.346875+0000) 2024-04-25T13:56:45.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:45 smithi161 podman[69242]: 2024-04-25 13:56:45.629146101 +0000 UTC m=+6.072617053 container cleanup 9320861af33d861e4fbf2bd4d1d5f0c8196f97ffc6641691c00fd6cac43f9787 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T13:56:45.852 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:45 smithi161 bash[69242]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7 2024-04-25T13:56:45.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:45 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:45.612+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:45.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:45 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:45.612+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:45.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:45 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:45.612+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:45.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:45 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:45.612+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:45.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:45 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:45.612+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:45.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:45 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:45.621+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:45.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:45 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:45.621+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:45.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:45 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:45.621+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:45.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:45 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:45.621+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:45.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:45 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:45.621+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.439555+0000 front 2024-04-25T13:56:20.439598+0000 (oldest deadline 2024-04-25T13:56:45.139485+0000) 2024-04-25T13:56:46.250 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:45 smithi161 podman[69271]: 2024-04-25 13:56:45.889160872 +0000 UTC m=+0.637848653 container remove 9320861af33d861e4fbf2bd4d1d5f0c8196f97ffc6641691c00fd6cac43f9787 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424) 2024-04-25T13:56:46.281 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:45 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:45.997+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:46.281 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:45 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:45.997+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:46.281 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:45 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:45.997+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:46.281 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:45 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:45.997+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:56:46.574 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:46 smithi161 podman[69361]: 2024-04-25 13:56:46.15435507 +0000 UTC m=+0.017844450 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:56:46.575 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:46 smithi161 podman[69361]: 2024-04-25 13:56:46.265079125 +0000 UTC m=+0.128568536 container create 80804b6454d1f3652fa6e422076bffba70bb5a9f428d417557d4fe61f4f62f49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-04-25T13:56:46.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:46 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:46.280+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:46.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:46 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:46.281+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:46.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:46 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:46.281+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:46.680 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:46 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:46.281+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:18.446826+0000 front 2024-04-25T13:56:18.446779+0000 (oldest deadline 2024-04-25T13:56:41.346875+0000) 2024-04-25T13:56:46.853 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:46 smithi161 podman[69361]: 2024-04-25 13:56:46.576274796 +0000 UTC m=+0.439764162 container init 80804b6454d1f3652fa6e422076bffba70bb5a9f428d417557d4fe61f4f62f49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-25T13:56:46.853 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:46 smithi161 podman[69361]: 2024-04-25 13:56:46.579580138 +0000 UTC m=+0.443069505 container start 80804b6454d1f3652fa6e422076bffba70bb5a9f428d417557d4fe61f4f62f49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-25T13:56:46.853 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:46 smithi161 podman[69361]: 2024-04-25 13:56:46.684388654 +0000 UTC m=+0.547878028 container attach 80804b6454d1f3652fa6e422076bffba70bb5a9f428d417557d4fe61f4f62f49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0) 2024-04-25T13:56:46.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:46 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:46.657+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:46.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:46 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:46.657+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:46.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:46 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:46.657+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:46.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:46 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:46.657+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:46.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:46 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:46.657+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:46.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:46 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:46.670+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:46.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:46 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:46.670+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:46.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:46 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:46.670+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:46.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:46 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:46.670+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:46.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:46 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:46.670+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.439555+0000 front 2024-04-25T13:56:20.439598+0000 (oldest deadline 2024-04-25T13:56:45.139485+0000) 2024-04-25T13:56:47.236 INFO:journalctl@ceph.osd.7.smithi161.stdout:Apr 25 13:56:46 smithi161 podman[69361]: 2024-04-25 13:56:46.877823846 +0000 UTC m=+0.741313222 container died 80804b6454d1f3652fa6e422076bffba70bb5a9f428d417557d4fe61f4f62f49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-7-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-25T13:56:47.278 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:47 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:47.024+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:47.278 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:47 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:47.024+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:47.278 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:47 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:47.024+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:47.278 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:47 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:47.024+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:56:47.562 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.7.service' 2024-04-25T13:56:47.601 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:56:47.601 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-04-25T13:56:47.601 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-04-25T13:56:47.602 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.8 2024-04-25T13:56:47.627 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:47 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:47.276+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:47.627 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:47 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:47.276+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:47.627 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:47 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:47.276+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:47.627 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:47 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:47.276+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:18.446826+0000 front 2024-04-25T13:56:18.446779+0000 (oldest deadline 2024-04-25T13:56:41.346875+0000) 2024-04-25T13:56:47.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:47 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:47.617+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:47.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:47 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:47.617+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:47.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:47 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:47.617+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:47.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:47 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:47.617+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:47.853 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:47 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:47.617+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:47.930 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:47 smithi175 systemd[1]: Stopping Ceph osd.8 for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:56:47.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:47 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:47.710+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:47.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:47 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:47.710+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:47.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:47 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:47.710+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:47.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:47 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:47.710+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:47.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:47 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:47.710+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.439555+0000 front 2024-04-25T13:56:20.439598+0000 (oldest deadline 2024-04-25T13:56:45.139485+0000) 2024-04-25T13:56:48.324 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:48 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:48.069+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:48.324 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:48 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:48.069+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:48.325 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:48 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:48.069+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:48.325 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:48 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:48.069+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:56:48.325 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:47 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:47.933+0000 7efdc1a50700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:56:48.325 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:47 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:47.933+0000 7efdc1a50700 -1 osd.8 99 *** Got signal Terminated *** 2024-04-25T13:56:48.325 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:47 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:47.933+0000 7efdc1a50700 -1 osd.8 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T13:56:48.325 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:48 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:48.324+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:48.325 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:48 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:48.324+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:48.325 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:48 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:48.324+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:48.325 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:48 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:48.324+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:18.446826+0000 front 2024-04-25T13:56:18.446779+0000 (oldest deadline 2024-04-25T13:56:41.346875+0000) 2024-04-25T13:56:49.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:48 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:48.641+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:49.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:48 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:48.641+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:49.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:48 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:48.641+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:49.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:48 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:48.641+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:49.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:48 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:48.641+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:49.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:48 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:48.734+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:49.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:48 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:48.734+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:49.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:48 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:48.734+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:49.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:48 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:48.734+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:49.213 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:48 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:48.734+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.439555+0000 front 2024-04-25T13:56:20.439598+0000 (oldest deadline 2024-04-25T13:56:45.139485+0000) 2024-04-25T13:56:49.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:49 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:49.287+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:49.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:49 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:49.287+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:49.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:49 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:49.287+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:49.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:49 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:49.287+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:18.446826+0000 front 2024-04-25T13:56:18.446779+0000 (oldest deadline 2024-04-25T13:56:41.346875+0000) 2024-04-25T13:56:49.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:49 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:49.095+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:49.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:49 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:49.095+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:49.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:49 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:49.095+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:49.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:49 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:49.095+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:56:50.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:49 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:49.623+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:50.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:49 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:49.623+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:50.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:49 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:49.623+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:50.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:49 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:49.623+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:50.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:49 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:49.623+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:50.113 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:49 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:49.740+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:50.114 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:49 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:49.740+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:50.114 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:49 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:49.740+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:50.114 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:49 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:49.740+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:50.114 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:49 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:49.740+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.439555+0000 front 2024-04-25T13:56:20.439598+0000 (oldest deadline 2024-04-25T13:56:45.139485+0000) 2024-04-25T13:56:50.114 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:49 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:49.740+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:25.140141+0000 front 2024-04-25T13:56:25.140177+0000 (oldest deadline 2024-04-25T13:56:49.239958+0000) 2024-04-25T13:56:50.346 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:50 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:50.094+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:50.346 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:50 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:50.094+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:50.346 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:50 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:50.094+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:50.346 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:50 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:50.094+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:56:50.347 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:50 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:50.282+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:50.347 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:50 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:50.282+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:50.347 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:50 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:50.282+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:50.347 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:50 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:50.282+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:18.446826+0000 front 2024-04-25T13:56:18.446779+0000 (oldest deadline 2024-04-25T13:56:41.346875+0000) 2024-04-25T13:56:50.347 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:50 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:50.282+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:28.348643+0000 front 2024-04-25T13:56:28.348594+0000 (oldest deadline 2024-04-25T13:56:49.949309+0000) 2024-04-25T13:56:50.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:50 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:50.593+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:50.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:50 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:50.593+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:50.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:50 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:50.593+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:50.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:50 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:50.593+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:50.852 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:50 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:50.593+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:50.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:50 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:50.704+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:50.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:50 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:50.704+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:50.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:50 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:50.704+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:50.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:50 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:50.704+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:50.963 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:50 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:50.704+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.439555+0000 front 2024-04-25T13:56:20.439598+0000 (oldest deadline 2024-04-25T13:56:45.139485+0000) 2024-04-25T13:56:50.963 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:50 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:50.704+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:25.140141+0000 front 2024-04-25T13:56:25.140177+0000 (oldest deadline 2024-04-25T13:56:49.239958+0000) 2024-04-25T13:56:51.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:51 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:51.246+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:51.431 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:51 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:51.246+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:51.431 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:51 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:51.246+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:51.431 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:51 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:51.246+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:18.446826+0000 front 2024-04-25T13:56:18.446779+0000 (oldest deadline 2024-04-25T13:56:41.346875+0000) 2024-04-25T13:56:51.431 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:51 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:51.246+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:28.348643+0000 front 2024-04-25T13:56:28.348594+0000 (oldest deadline 2024-04-25T13:56:49.949309+0000) 2024-04-25T13:56:51.432 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:51 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:51.054+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:51.432 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:51 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:51.054+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:51.432 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:51 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:51.054+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:51.432 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:51 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:51.054+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:56:51.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:51 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:51.685+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:51.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:51 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:51.685+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:51.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:51 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:51.685+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:51.963 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:51 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:51.685+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:51.963 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:51 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:51.685+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.439555+0000 front 2024-04-25T13:56:20.439598+0000 (oldest deadline 2024-04-25T13:56:45.139485+0000) 2024-04-25T13:56:51.963 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:51 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:51.685+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:25.140141+0000 front 2024-04-25T13:56:25.140177+0000 (oldest deadline 2024-04-25T13:56:49.239958+0000) 2024-04-25T13:56:52.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:51 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:51.642+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:52.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:51 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:51.642+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:52.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:51 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:51.642+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:52.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:51 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:51.642+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:52.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:51 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:51.642+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:52.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:52 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:52.231+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.042459+0000 front 2024-04-25T13:55:45.042572+0000 (oldest deadline 2024-04-25T13:56:09.742313+0000) 2024-04-25T13:56:52.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:52 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:52.231+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:00.943895+0000 front 2024-04-25T13:56:00.943927+0000 (oldest deadline 2024-04-25T13:56:26.244094+0000) 2024-04-25T13:56:52.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:52 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:52.231+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:12.645742+0000 front 2024-04-25T13:56:12.645684+0000 (oldest deadline 2024-04-25T13:56:33.745561+0000) 2024-04-25T13:56:52.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:52 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:52.231+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:18.446826+0000 front 2024-04-25T13:56:18.446779+0000 (oldest deadline 2024-04-25T13:56:41.346875+0000) 2024-04-25T13:56:52.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:52 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8[51042]: 2024-04-25T13:56:52.231+0000 7efdbe006700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:28.348643+0000 front 2024-04-25T13:56:28.348594+0000 (oldest deadline 2024-04-25T13:56:49.949309+0000) 2024-04-25T13:56:52.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:52 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:52.100+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:52.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:52 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:52.100+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:52.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:52 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:52.100+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:52.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:52 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:52.100+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:56:52.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:52 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:52.100+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:56:52.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:52 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:52.708+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:52.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:52 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:52.708+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:52.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:52 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:52.708+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:52.963 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:52 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:52.708+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:52.963 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:52 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:52.708+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.439555+0000 front 2024-04-25T13:56:20.439598+0000 (oldest deadline 2024-04-25T13:56:45.139485+0000) 2024-04-25T13:56:52.963 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:52 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:52.708+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:25.140141+0000 front 2024-04-25T13:56:25.140177+0000 (oldest deadline 2024-04-25T13:56:49.239958+0000) 2024-04-25T13:56:53.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:52 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:52.670+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:53.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:52 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:52.670+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:53.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:52 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:52.670+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:53.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:52 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:52.670+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:53.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:52 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:52.670+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:53.430 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:53 smithi175 podman[69428]: 2024-04-25 13:56:53.384016398 +0000 UTC m=+5.589065849 container died 31dc633df15ea0f538b9e685eb345e6d8a8226bf2cc4fafbcc8f9e44b23a6c8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-25T13:56:53.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:53 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:53.138+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:53.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:53 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:53.138+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:53.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:53 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:53.138+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:53.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:53 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:53.138+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:56:53.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:53 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:53.138+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:56:53.930 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:53 smithi175 podman[69428]: 2024-04-25 13:56:53.75074263 +0000 UTC m=+5.955792083 container cleanup 31dc633df15ea0f538b9e685eb345e6d8a8226bf2cc4fafbcc8f9e44b23a6c8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-25T13:56:53.930 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:53 smithi175 bash[69428]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8 2024-04-25T13:56:54.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:53 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:53.686+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:54.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:53 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:53.686+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:54.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:53 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:53.686+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:54.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:53 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:53.686+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:54.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:53 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:53.686+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:54.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:53 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:53.686+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.645895+0000 front 2024-04-25T13:56:27.646033+0000 (oldest deadline 2024-04-25T13:56:52.846275+0000) 2024-04-25T13:56:54.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:53 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:53.731+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:54.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:53 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:53.731+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:54.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:53 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:53.731+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:54.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:53 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:53.731+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:54.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:53 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:53.731+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.439555+0000 front 2024-04-25T13:56:20.439598+0000 (oldest deadline 2024-04-25T13:56:45.139485+0000) 2024-04-25T13:56:54.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:53 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:53.731+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:25.140141+0000 front 2024-04-25T13:56:25.140177+0000 (oldest deadline 2024-04-25T13:56:49.239958+0000) 2024-04-25T13:56:54.361 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:54 smithi175 podman[69457]: 2024-04-25 13:56:54.019013116 +0000 UTC m=+0.628897662 container remove 31dc633df15ea0f538b9e685eb345e6d8a8226bf2cc4fafbcc8f9e44b23a6c8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.license=GPLv2) 2024-04-25T13:56:54.361 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:54 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:54.124+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:54.361 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:54 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:54.124+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:54.361 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:54 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:54.124+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:54.362 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:54 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:54.124+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:56:54.362 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:54 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:54.124+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:56:54.630 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:54 smithi175 podman[69548]: 2024-04-25 13:56:54.265011374 +0000 UTC m=+0.018213014 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:56:54.630 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:54 smithi175 podman[69548]: 2024-04-25 13:56:54.369665226 +0000 UTC m=+0.122866898 container create dca40ecba11c461f2ae8e70d533daa1dab4e96355ce614ed7c4c7bd5de2a7da6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-25T13:56:54.917 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:54 smithi175 podman[69548]: 2024-04-25 13:56:54.631288851 +0000 UTC m=+0.384490486 container init dca40ecba11c461f2ae8e70d533daa1dab4e96355ce614ed7c4c7bd5de2a7da6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-25T13:56:54.918 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:54 smithi175 podman[69548]: 2024-04-25 13:56:54.634781755 +0000 UTC m=+0.387983390 container start dca40ecba11c461f2ae8e70d533daa1dab4e96355ce614ed7c4c7bd5de2a7da6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T13:56:54.918 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:54 smithi175 podman[69548]: 2024-04-25 13:56:54.730636089 +0000 UTC m=+0.483837715 container attach dca40ecba11c461f2ae8e70d533daa1dab4e96355ce614ed7c4c7bd5de2a7da6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8-deactivate, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T13:56:55.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:54 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:54.681+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:55.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:54 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:54.681+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:55.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:54 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:54.681+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:55.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:54 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:54.681+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:55.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:54 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:54.681+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:55.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:54 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:54.681+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.645895+0000 front 2024-04-25T13:56:27.646033+0000 (oldest deadline 2024-04-25T13:56:52.846275+0000) 2024-04-25T13:56:55.180 INFO:journalctl@ceph.osd.8.smithi175.stdout:Apr 25 13:56:54 smithi175 podman[69548]: 2024-04-25 13:56:54.919099838 +0000 UTC m=+0.672301459 container died dca40ecba11c461f2ae8e70d533daa1dab4e96355ce614ed7c4c7bd5de2a7da6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-8-deactivate, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-25T13:56:55.180 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:55 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:55.080+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:55.180 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:55 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:55.080+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:55.180 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:55 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:55.080+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:55.180 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:55 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:55.080+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:56:55.180 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:55 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:55.080+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:56:55.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:54 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:54.717+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:55.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:54 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:54.717+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:55.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:54 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:54.717+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:55.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:54 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:54.717+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:55.213 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:54 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:54.717+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.439555+0000 front 2024-04-25T13:56:20.439598+0000 (oldest deadline 2024-04-25T13:56:45.139485+0000) 2024-04-25T13:56:55.213 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:54 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:54.717+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:25.140141+0000 front 2024-04-25T13:56:25.140177+0000 (oldest deadline 2024-04-25T13:56:49.239958+0000) 2024-04-25T13:56:55.607 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.8.service' 2024-04-25T13:56:55.688 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:56:55.688 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-04-25T13:56:55.688 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-04-25T13:56:55.688 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.9 2024-04-25T13:56:55.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:55 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:55.685+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:55.963 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:55 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:55.685+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:55.963 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:55 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:55.685+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:55.963 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:55 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:55.685+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:55.963 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:55 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:55.685+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.439555+0000 front 2024-04-25T13:56:20.439598+0000 (oldest deadline 2024-04-25T13:56:45.139485+0000) 2024-04-25T13:56:55.963 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:55 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:55.685+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:25.140141+0000 front 2024-04-25T13:56:25.140177+0000 (oldest deadline 2024-04-25T13:56:49.239958+0000) 2024-04-25T13:56:55.963 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:55 smithi043 systemd[1]: Stopping Ceph osd.9 for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:56:56.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:55 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:55.651+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:56.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:55 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:55.651+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:56.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:55 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:55.651+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:56.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:55 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:55.651+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:56.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:55 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:55.651+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:56.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:55 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:55.651+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.645895+0000 front 2024-04-25T13:56:27.646033+0000 (oldest deadline 2024-04-25T13:56:52.846275+0000) 2024-04-25T13:56:56.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:56 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:56.100+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:56.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:56 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:56.100+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:56.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:56 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:56.100+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:56.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:56 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:56.100+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:56:56.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:56 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:56.100+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:56:56.462 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:56 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:56.011+0000 7f7eb9c4f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:56:56.462 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:56 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:56.011+0000 7f7eb9c4f700 -1 osd.9 99 *** Got signal Terminated *** 2024-04-25T13:56:56.462 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:56 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:56.011+0000 7f7eb9c4f700 -1 osd.9 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T13:56:57.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:56 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:56.693+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:57.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:56 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:56.693+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:57.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:56 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:56.693+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:57.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:56 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:56.693+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:57.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:56 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:56.693+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:57.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:56 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:56.693+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.645895+0000 front 2024-04-25T13:56:27.646033+0000 (oldest deadline 2024-04-25T13:56:52.846275+0000) 2024-04-25T13:56:57.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:56 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:56.716+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:57.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:56 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:56.716+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:57.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:56 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:56.716+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:57.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:56 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:56.716+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:57.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:56 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:56.716+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.439555+0000 front 2024-04-25T13:56:20.439598+0000 (oldest deadline 2024-04-25T13:56:45.139485+0000) 2024-04-25T13:56:57.213 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:56 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:56.716+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:25.140141+0000 front 2024-04-25T13:56:25.140177+0000 (oldest deadline 2024-04-25T13:56:49.239958+0000) 2024-04-25T13:56:57.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:57 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:57.064+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:57.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:57 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:57.064+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:57.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:57 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:57.064+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:57.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:57 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:57.064+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:56:57.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:57 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:57.064+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:56:58.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:57 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:57.702+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:58.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:57 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:57.702+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:58.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:57 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:57.702+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:58.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:57 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:57.702+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:58.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:57 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:57.702+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:58.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:57 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:57.702+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.645895+0000 front 2024-04-25T13:56:27.646033+0000 (oldest deadline 2024-04-25T13:56:52.846275+0000) 2024-04-25T13:56:58.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:57 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:57.735+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:58.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:57 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:57.735+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:58.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:57 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:57.735+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:58.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:57 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:57.735+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:58.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:57 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:57.735+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.439555+0000 front 2024-04-25T13:56:20.439598+0000 (oldest deadline 2024-04-25T13:56:45.139485+0000) 2024-04-25T13:56:58.212 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:57 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:57.735+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:25.140141+0000 front 2024-04-25T13:56:25.140177+0000 (oldest deadline 2024-04-25T13:56:49.239958+0000) 2024-04-25T13:56:58.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:58 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:58.056+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:58.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:58 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:58.056+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:58.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:58 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:58.056+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:58.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:58 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:58.056+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:56:58.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:58 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:58.056+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:56:58.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:58 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:58.709+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:58.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:58 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:58.709+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:58.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:58 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:58.709+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:58.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:58 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:58.709+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:58.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:58 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:58.709+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.439555+0000 front 2024-04-25T13:56:20.439598+0000 (oldest deadline 2024-04-25T13:56:45.139485+0000) 2024-04-25T13:56:58.963 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:58 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:58.709+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:25.140141+0000 front 2024-04-25T13:56:25.140177+0000 (oldest deadline 2024-04-25T13:56:49.239958+0000) 2024-04-25T13:56:59.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:58 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:58.685+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:56:59.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:58 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:58.685+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:56:59.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:58 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:58.685+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:56:59.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:58 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:58.685+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:56:59.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:58 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:58.685+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:56:59.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:58 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:58.685+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.645895+0000 front 2024-04-25T13:56:27.646033+0000 (oldest deadline 2024-04-25T13:56:52.846275+0000) 2024-04-25T13:56:59.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:59 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:59.101+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:56:59.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:59 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:59.101+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:56:59.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:59 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:59.101+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:56:59.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:59 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:59.101+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:56:59.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:56:59 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:56:59.101+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:56:59.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:59 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:59.678+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:56:59.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:59 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:59.678+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:56:59.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:59 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:59.678+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:56:59.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:59 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:59.678+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:56:59.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:59 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:59.678+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.439555+0000 front 2024-04-25T13:56:20.439598+0000 (oldest deadline 2024-04-25T13:56:45.139485+0000) 2024-04-25T13:56:59.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:56:59 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:56:59.678+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:25.140141+0000 front 2024-04-25T13:56:25.140177+0000 (oldest deadline 2024-04-25T13:56:49.239958+0000) 2024-04-25T13:57:00.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:59 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:59.730+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:57:00.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:59 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:59.730+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:57:00.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:59 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:59.730+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:57:00.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:59 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:59.730+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:57:00.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:59 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:59.730+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:57:00.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:56:59 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:56:59.730+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.645895+0000 front 2024-04-25T13:56:27.646033+0000 (oldest deadline 2024-04-25T13:56:52.846275+0000) 2024-04-25T13:57:00.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:00 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:00.091+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:00.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:00 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:00.091+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:00.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:00 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:00.091+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:00.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:00 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:00.091+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:00.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:00 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:00.091+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:00.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:57:00 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:57:00.644+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:44.035141+0000 front 2024-04-25T13:55:44.034872+0000 (oldest deadline 2024-04-25T13:56:11.035747+0000) 2024-04-25T13:57:00.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:57:00 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:57:00.644+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:51.036521+0000 front 2024-04-25T13:55:51.036360+0000 (oldest deadline 2024-04-25T13:56:16.936233+0000) 2024-04-25T13:57:00.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:57:00 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:57:00.644+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:01.637451+0000 front 2024-04-25T13:56:01.637396+0000 (oldest deadline 2024-04-25T13:56:27.537447+0000) 2024-04-25T13:57:00.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:57:00 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:57:00.644+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:09.238319+0000 front 2024-04-25T13:56:09.238299+0000 (oldest deadline 2024-04-25T13:56:34.538436+0000) 2024-04-25T13:57:00.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:57:00 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:57:00.644+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.439555+0000 front 2024-04-25T13:56:20.439598+0000 (oldest deadline 2024-04-25T13:56:45.139485+0000) 2024-04-25T13:57:00.962 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:57:00 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9[64434]: 2024-04-25T13:57:00.644+0000 7f7eb21fd700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:25.140141+0000 front 2024-04-25T13:56:25.140177+0000 (oldest deadline 2024-04-25T13:56:49.239958+0000) 2024-04-25T13:57:01.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:00 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:00.688+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:57:01.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:00 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:00.688+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:57:01.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:00 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:00.688+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:57:01.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:00 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:00.688+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:57:01.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:00 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:00.688+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:57:01.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:00 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:00.688+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.645895+0000 front 2024-04-25T13:56:27.646033+0000 (oldest deadline 2024-04-25T13:56:52.846275+0000) 2024-04-25T13:57:01.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:00 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:00.688+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:34.547534+0000 front 2024-04-25T13:56:34.547489+0000 (oldest deadline 2024-04-25T13:57:00.447299+0000) 2024-04-25T13:57:01.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:01 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:01.057+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:01.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:01 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:01.057+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:01.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:01 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:01.057+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:01.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:01 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:01.057+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:01.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:01 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:01.057+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:01.744 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:57:01 smithi043 podman[90199]: 2024-04-25 13:57:01.493315227 +0000 UTC m=+5.605046037 container died 8b5a23d664ad6e90e50d5fb69ee5f8781889aa1646a15f66bdccdb72d8c1e735 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T13:57:02.019 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:57:01 smithi043 podman[90199]: 2024-04-25 13:57:01.83586656 +0000 UTC m=+5.947597370 container cleanup 8b5a23d664ad6e90e50d5fb69ee5f8781889aa1646a15f66bdccdb72d8c1e735 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T13:57:02.019 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:57:01 smithi043 bash[90199]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9 2024-04-25T13:57:02.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:01 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:01.640+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:57:02.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:01 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:01.640+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:57:02.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:01 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:01.640+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:57:02.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:01 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:01.640+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:57:02.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:01 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:01.640+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:57:02.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:01 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:01.640+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.645895+0000 front 2024-04-25T13:56:27.646033+0000 (oldest deadline 2024-04-25T13:56:52.846275+0000) 2024-04-25T13:57:02.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:01 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:01.640+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:34.547534+0000 front 2024-04-25T13:56:34.547489+0000 (oldest deadline 2024-04-25T13:57:00.447299+0000) 2024-04-25T13:57:02.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:02 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:02.087+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:02.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:02 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:02.087+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:02.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:02 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:02.087+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:02.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:02 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:02.087+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:02.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:02 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:02.087+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:02.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:02 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:02.087+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:36.699523+0000 front 2024-04-25T13:56:36.699578+0000 (oldest deadline 2024-04-25T13:57:01.399465+0000) 2024-04-25T13:57:02.431 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:57:02 smithi043 podman[90217]: 2024-04-25 13:57:02.020181326 +0000 UTC m=+0.522439852 container remove 8b5a23d664ad6e90e50d5fb69ee5f8781889aa1646a15f66bdccdb72d8c1e735 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-04-25T13:57:02.712 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:57:02 smithi043 podman[90310]: 2024-04-25 13:57:02.359868125 +0000 UTC m=+0.018195154 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:57:02.712 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:57:02 smithi043 podman[90310]: 2024-04-25 13:57:02.496235285 +0000 UTC m=+0.154562302 container create 0f649ddd9790fb8f5589fbacf1543a23a31cf7f6f62d1306aa10727d03908cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424) 2024-04-25T13:57:03.095 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:57:02 smithi043 podman[90310]: 2024-04-25 13:57:02.790624013 +0000 UTC m=+0.448951030 container init 0f649ddd9790fb8f5589fbacf1543a23a31cf7f6f62d1306aa10727d03908cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-25T13:57:03.095 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:57:02 smithi043 podman[90310]: 2024-04-25 13:57:02.793835839 +0000 UTC m=+0.452162856 container start 0f649ddd9790fb8f5589fbacf1543a23a31cf7f6f62d1306aa10727d03908cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9-deactivate, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T13:57:03.095 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:57:02 smithi043 podman[90310]: 2024-04-25 13:57:02.857292808 +0000 UTC m=+0.515619828 container attach 0f649ddd9790fb8f5589fbacf1543a23a31cf7f6f62d1306aa10727d03908cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T13:57:03.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:02 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:02.611+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:57:03.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:02 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:02.611+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:57:03.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:02 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:02.611+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:57:03.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:02 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:02.611+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:57:03.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:02 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:02.611+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:57:03.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:02 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:02.611+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.645895+0000 front 2024-04-25T13:56:27.646033+0000 (oldest deadline 2024-04-25T13:56:52.846275+0000) 2024-04-25T13:57:03.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:02 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:02.611+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:34.547534+0000 front 2024-04-25T13:56:34.547489+0000 (oldest deadline 2024-04-25T13:57:00.447299+0000) 2024-04-25T13:57:03.379 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 13:57:03 smithi043 podman[90310]: 2024-04-25 13:57:03.096239785 +0000 UTC m=+0.754566804 container died 0f649ddd9790fb8f5589fbacf1543a23a31cf7f6f62d1306aa10727d03908cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-25T13:57:03.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:03 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:03.100+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:03.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:03 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:03.100+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:03.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:03 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:03.100+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:03.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:03 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:03.100+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:03.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:03 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:03.100+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:03.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:03 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:03.100+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:36.699523+0000 front 2024-04-25T13:56:36.699578+0000 (oldest deadline 2024-04-25T13:57:01.399465+0000) 2024-04-25T13:57:03.679 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.9.service' 2024-04-25T13:57:03.718 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:57:03.718 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-04-25T13:57:03.719 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-04-25T13:57:03.720 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.10 2024-04-25T13:57:04.056 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:03 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:03.632+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:57:04.057 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:03 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:03.632+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:57:04.057 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:03 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:03.632+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:57:04.057 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:03 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:03.632+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:57:04.057 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:03 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:03.632+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:57:04.057 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:03 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:03.632+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.645895+0000 front 2024-04-25T13:56:27.646033+0000 (oldest deadline 2024-04-25T13:56:52.846275+0000) 2024-04-25T13:57:04.057 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:03 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:03.632+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:34.547534+0000 front 2024-04-25T13:56:34.547489+0000 (oldest deadline 2024-04-25T13:57:00.447299+0000) 2024-04-25T13:57:04.057 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:03 smithi161 systemd[1]: Stopping Ceph osd.10 for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:57:04.057 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:04 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:04.056+0000 7ff5d353c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:57:04.057 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:04 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:04.056+0000 7ff5d353c700 -1 osd.10 99 *** Got signal Terminated *** 2024-04-25T13:57:04.057 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:04 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:04.056+0000 7ff5d353c700 -1 osd.10 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T13:57:04.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:04 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:04.122+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:04.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:04 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:04.122+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:04.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:04 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:04.122+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:04.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:04 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:04.122+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:04.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:04 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:04.122+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:04.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:04 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:04.122+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:36.699523+0000 front 2024-04-25T13:56:36.699578+0000 (oldest deadline 2024-04-25T13:57:01.399465+0000) 2024-04-25T13:57:05.106 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:04 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:04.654+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:57:05.106 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:04 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:04.654+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:57:05.106 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:04 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:04.654+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:57:05.106 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:04 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:04.654+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:57:05.106 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:04 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:04.654+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:57:05.106 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:04 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:04.654+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.645895+0000 front 2024-04-25T13:56:27.646033+0000 (oldest deadline 2024-04-25T13:56:52.846275+0000) 2024-04-25T13:57:05.106 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:04 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:04.654+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:34.547534+0000 front 2024-04-25T13:56:34.547489+0000 (oldest deadline 2024-04-25T13:57:00.447299+0000) 2024-04-25T13:57:05.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:05 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:05.116+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:05.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:05 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:05.116+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:05.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:05 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:05.116+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:05.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:05 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:05.116+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:05.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:05 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:05.116+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:05.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:05 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:05.116+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:36.699523+0000 front 2024-04-25T13:56:36.699578+0000 (oldest deadline 2024-04-25T13:57:01.399465+0000) 2024-04-25T13:57:06.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:05 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:05.659+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:57:06.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:05 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:05.659+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:57:06.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:05 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:05.659+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:57:06.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:05 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:05.659+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:57:06.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:05 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:05.659+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:57:06.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:05 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:05.659+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.645895+0000 front 2024-04-25T13:56:27.646033+0000 (oldest deadline 2024-04-25T13:56:52.846275+0000) 2024-04-25T13:57:06.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:05 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:05.659+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:34.547534+0000 front 2024-04-25T13:56:34.547489+0000 (oldest deadline 2024-04-25T13:57:00.447299+0000) 2024-04-25T13:57:06.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:06 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:06.120+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:06.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:06 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:06.120+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:06.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:06 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:06.120+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:06.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:06 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:06.120+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:06.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:06 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:06.120+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:06.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:06 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:06.120+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:36.699523+0000 front 2024-04-25T13:56:36.699578+0000 (oldest deadline 2024-04-25T13:57:01.399465+0000) 2024-04-25T13:57:07.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:06 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:06.615+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:57:07.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:06 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:06.615+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:57:07.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:06 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:06.615+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:57:07.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:06 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:06.615+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:57:07.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:06 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:06.615+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:57:07.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:06 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:06.615+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.645895+0000 front 2024-04-25T13:56:27.646033+0000 (oldest deadline 2024-04-25T13:56:52.846275+0000) 2024-04-25T13:57:07.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:06 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:06.615+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:34.547534+0000 front 2024-04-25T13:56:34.547489+0000 (oldest deadline 2024-04-25T13:57:00.447299+0000) 2024-04-25T13:57:07.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:07 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:07.125+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:07.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:07 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:07.125+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:07.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:07 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:07.125+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:07.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:07 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:07.125+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:07.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:07 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:07.125+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:07.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:07 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:07.125+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:36.699523+0000 front 2024-04-25T13:56:36.699578+0000 (oldest deadline 2024-04-25T13:57:01.399465+0000) 2024-04-25T13:57:08.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:07 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:07.652+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:57:08.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:07 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:07.652+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:57:08.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:07 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:07.652+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:57:08.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:07 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:07.652+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:57:08.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:07 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:07.652+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:57:08.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:07 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:07.652+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.645895+0000 front 2024-04-25T13:56:27.646033+0000 (oldest deadline 2024-04-25T13:56:52.846275+0000) 2024-04-25T13:57:08.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:07 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:07.652+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:34.547534+0000 front 2024-04-25T13:56:34.547489+0000 (oldest deadline 2024-04-25T13:57:00.447299+0000) 2024-04-25T13:57:08.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:08 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:08.151+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:08.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:08 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:08.151+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:08.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:08 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:08.151+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:08.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:08 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:08.151+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:08.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:08 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:08.151+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:08.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:08 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:08.151+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:36.699523+0000 front 2024-04-25T13:56:36.699578+0000 (oldest deadline 2024-04-25T13:57:01.399465+0000) 2024-04-25T13:57:09.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:08 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:08.660+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:47.440157+0000 front 2024-04-25T13:55:47.440174+0000 (oldest deadline 2024-04-25T13:56:10.939900+0000) 2024-04-25T13:57:09.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:08 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:08.660+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:54.440871+0000 front 2024-04-25T13:55:54.440896+0000 (oldest deadline 2024-04-25T13:56:19.741099+0000) 2024-04-25T13:57:09.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:08 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:08.660+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:56:02.542847+0000 front 2024-04-25T13:56:02.542737+0000 (oldest deadline 2024-04-25T13:56:26.642645+0000) 2024-04-25T13:57:09.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:08 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:08.660+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T13:56:11.943877+0000 front 2024-04-25T13:56:11.943989+0000 (oldest deadline 2024-04-25T13:56:34.843603+0000) 2024-04-25T13:57:09.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:08 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:08.660+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:20.645005+0000 front 2024-04-25T13:56:20.644978+0000 (oldest deadline 2024-04-25T13:56:42.345020+0000) 2024-04-25T13:57:09.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:08 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:08.660+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.645895+0000 front 2024-04-25T13:56:27.646033+0000 (oldest deadline 2024-04-25T13:56:52.846275+0000) 2024-04-25T13:57:09.103 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:08 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10[57476]: 2024-04-25T13:57:08.660+0000 7ff5cbaea700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:34.547534+0000 front 2024-04-25T13:56:34.547489+0000 (oldest deadline 2024-04-25T13:57:00.447299+0000) 2024-04-25T13:57:09.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:09 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:09.115+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:09.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:09 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:09.115+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:09.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:09 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:09.115+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:09.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:09 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:09.115+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:09.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:09 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:09.115+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:09.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:09 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:09.115+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:36.699523+0000 front 2024-04-25T13:56:36.699578+0000 (oldest deadline 2024-04-25T13:57:01.399465+0000) 2024-04-25T13:57:09.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:09 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:09.115+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6820 osd.7 since back 2024-04-25T13:56:43.700284+0000 front 2024-04-25T13:56:43.700359+0000 (oldest deadline 2024-04-25T13:57:09.000386+0000) 2024-04-25T13:57:09.723 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:09 smithi161 podman[69466]: 2024-04-25 13:57:09.42639322 +0000 UTC m=+5.500607657 container died a97233b2df9a8f81fe028bcd32dccddcbd9da85e3b800e68200109e068b3e896 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T13:57:10.070 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:09 smithi161 podman[69466]: 2024-04-25 13:57:09.814991663 +0000 UTC m=+5.889206100 container cleanup a97233b2df9a8f81fe028bcd32dccddcbd9da85e3b800e68200109e068b3e896 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T13:57:10.070 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:09 smithi161 bash[69466]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10 2024-04-25T13:57:10.352 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:10 smithi161 podman[69485]: 2024-04-25 13:57:10.071633091 +0000 UTC m=+0.639643933 container remove a97233b2df9a8f81fe028bcd32dccddcbd9da85e3b800e68200109e068b3e896 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2) 2024-04-25T13:57:10.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:10 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:10.119+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:10.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:10 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:10.119+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:10.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:10 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:10.119+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:10.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:10 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:10.119+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:10.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:10 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:10.119+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:10.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:10 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:10.119+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:36.699523+0000 front 2024-04-25T13:56:36.699578+0000 (oldest deadline 2024-04-25T13:57:01.399465+0000) 2024-04-25T13:57:10.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:10 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:10.119+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6820 osd.7 since back 2024-04-25T13:56:43.700284+0000 front 2024-04-25T13:56:43.700359+0000 (oldest deadline 2024-04-25T13:57:09.000386+0000) 2024-04-25T13:57:10.760 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:10 smithi161 podman[69573]: 2024-04-25 13:57:10.335347848 +0000 UTC m=+0.018650064 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:57:10.760 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:10 smithi161 podman[69573]: 2024-04-25 13:57:10.458899357 +0000 UTC m=+0.142201575 container create b35dd52bd1355cfe4d04979e40616054be1eb975886752ba312faa09a36b37b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-25T13:57:10.760 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:10 smithi161 podman[69573]: 2024-04-25 13:57:10.678052061 +0000 UTC m=+0.361354278 container init b35dd52bd1355cfe4d04979e40616054be1eb975886752ba312faa09a36b37b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-04-25T13:57:10.760 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:10 smithi161 podman[69573]: 2024-04-25 13:57:10.681100531 +0000 UTC m=+0.364402749 container start b35dd52bd1355cfe4d04979e40616054be1eb975886752ba312faa09a36b37b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-25T13:57:10.761 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:10 smithi161 podman[69573]: 2024-04-25 13:57:10.760999837 +0000 UTC m=+0.444302055 container attach b35dd52bd1355cfe4d04979e40616054be1eb975886752ba312faa09a36b37b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T13:57:11.102 INFO:journalctl@ceph.osd.10.smithi161.stdout:Apr 25 13:57:10 smithi161 podman[69573]: 2024-04-25 13:57:10.973200513 +0000 UTC m=+0.656502748 container died b35dd52bd1355cfe4d04979e40616054be1eb975886752ba312faa09a36b37b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-25T13:57:11.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:11 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:11.148+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:11.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:11 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:11.148+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:11.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:11 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:11.148+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:11.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:11 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:11.148+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:11.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:11 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:11.148+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:11.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:11 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:11.148+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:36.699523+0000 front 2024-04-25T13:56:36.699578+0000 (oldest deadline 2024-04-25T13:57:01.399465+0000) 2024-04-25T13:57:11.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:11 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:11.148+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6820 osd.7 since back 2024-04-25T13:56:43.700284+0000 front 2024-04-25T13:56:43.700359+0000 (oldest deadline 2024-04-25T13:57:09.000386+0000) 2024-04-25T13:57:11.537 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.10.service' 2024-04-25T13:57:11.573 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:57:11.573 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-04-25T13:57:11.573 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-04-25T13:57:11.573 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.11 2024-04-25T13:57:11.877 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:11 smithi175 systemd[1]: Stopping Ceph osd.11 for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:57:11.877 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:11 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:11.877+0000 7ff21446f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:57:11.877 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:11 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:11.877+0000 7ff21446f700 -1 osd.11 99 *** Got signal Terminated *** 2024-04-25T13:57:11.877 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:11 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:11.877+0000 7ff21446f700 -1 osd.11 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T13:57:12.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:12 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:12.139+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:12.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:12 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:12.139+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:12.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:12 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:12.139+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:12.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:12 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:12.139+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:12.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:12 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:12.139+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:12.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:12 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:12.139+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:36.699523+0000 front 2024-04-25T13:56:36.699578+0000 (oldest deadline 2024-04-25T13:57:01.399465+0000) 2024-04-25T13:57:12.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:12 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:12.139+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6820 osd.7 since back 2024-04-25T13:56:43.700284+0000 front 2024-04-25T13:56:43.700359+0000 (oldest deadline 2024-04-25T13:57:09.000386+0000) 2024-04-25T13:57:13.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:13.117+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:13.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:13.117+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:13.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:13.117+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:13.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:13.117+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:13.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:13.117+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:13.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:13.117+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:36.699523+0000 front 2024-04-25T13:56:36.699578+0000 (oldest deadline 2024-04-25T13:57:01.399465+0000) 2024-04-25T13:57:13.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:13 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:13.117+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6820 osd.7 since back 2024-04-25T13:56:43.700284+0000 front 2024-04-25T13:56:43.700359+0000 (oldest deadline 2024-04-25T13:57:09.000386+0000) 2024-04-25T13:57:14.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:14 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:14.120+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:14.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:14 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:14.120+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:14.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:14 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:14.120+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:14.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:14 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:14.120+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:14.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:14 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:14.120+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:14.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:14 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:14.120+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:36.699523+0000 front 2024-04-25T13:56:36.699578+0000 (oldest deadline 2024-04-25T13:57:01.399465+0000) 2024-04-25T13:57:14.431 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:14 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:14.120+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6820 osd.7 since back 2024-04-25T13:56:43.700284+0000 front 2024-04-25T13:56:43.700359+0000 (oldest deadline 2024-04-25T13:57:09.000386+0000) 2024-04-25T13:57:15.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:15 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:15.152+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:15.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:15 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:15.152+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:15.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:15 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:15.152+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:15.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:15 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:15.152+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:15.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:15 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:15.152+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:15.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:15 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:15.152+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:36.699523+0000 front 2024-04-25T13:56:36.699578+0000 (oldest deadline 2024-04-25T13:57:01.399465+0000) 2024-04-25T13:57:15.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:15 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:15.152+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6820 osd.7 since back 2024-04-25T13:56:43.700284+0000 front 2024-04-25T13:56:43.700359+0000 (oldest deadline 2024-04-25T13:57:09.000386+0000) 2024-04-25T13:57:16.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:16 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:16.115+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T13:55:45.490152+0000 front 2024-04-25T13:55:45.489967+0000 (oldest deadline 2024-04-25T13:56:09.490700+0000) 2024-04-25T13:57:16.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:16 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:16.115+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6804 osd.1 since back 2024-04-25T13:55:52.892553+0000 front 2024-04-25T13:55:52.892622+0000 (oldest deadline 2024-04-25T13:56:17.592582+0000) 2024-04-25T13:57:16.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:16 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:16.115+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-04-25T13:55:59.694795+0000 front 2024-04-25T13:55:59.694637+0000 (oldest deadline 2024-04-25T13:56:30.295527+0000) 2024-04-25T13:57:16.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:16 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:16.115+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6812 osd.4 since back 2024-04-25T13:56:19.697501+0000 front 2024-04-25T13:56:19.697318+0000 (oldest deadline 2024-04-25T13:56:44.997348+0000) 2024-04-25T13:57:16.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:16 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:16.115+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-04-25T13:56:27.298452+0000 front 2024-04-25T13:56:27.298386+0000 (oldest deadline 2024-04-25T13:56:51.398514+0000) 2024-04-25T13:57:16.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:16 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:16.115+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T13:56:36.699523+0000 front 2024-04-25T13:56:36.699578+0000 (oldest deadline 2024-04-25T13:57:01.399465+0000) 2024-04-25T13:57:16.430 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:16 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11[57811]: 2024-04-25T13:57:16.115+0000 7ff20ca1d700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.161:6820 osd.7 since back 2024-04-25T13:56:43.700284+0000 front 2024-04-25T13:56:43.700359+0000 (oldest deadline 2024-04-25T13:57:09.000386+0000) 2024-04-25T13:57:17.627 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:17 smithi175 podman[69655]: 2024-04-25 13:57:17.357671423 +0000 UTC m=+5.583519732 container died 36c60b97fd897d8db82f93ce574a4c9656f682ca8e65ed75087931668e60be87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T13:57:17.930 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:17 smithi175 podman[69655]: 2024-04-25 13:57:17.727146253 +0000 UTC m=+5.952994561 container cleanup 36c60b97fd897d8db82f93ce574a4c9656f682ca8e65ed75087931668e60be87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T13:57:17.930 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:17 smithi175 bash[69655]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11 2024-04-25T13:57:18.337 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:17 smithi175 podman[69672]: 2024-04-25 13:57:17.986599903 +0000 UTC m=+0.626077354 container remove 36c60b97fd897d8db82f93ce574a4c9656f682ca8e65ed75087931668e60be87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.vendor=CentOS) 2024-04-25T13:57:18.589 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:18 smithi175 podman[69762]: 2024-04-25 13:57:18.241226661 +0000 UTC m=+0.018074090 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T13:57:18.589 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:18 smithi175 podman[69762]: 2024-04-25 13:57:18.345779067 +0000 UTC m=+0.122626491 container create b164fb47fd37534898608074ac9156250f12e70eabb8b003b234e39609dcec77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-25T13:57:18.883 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:18 smithi175 podman[69762]: 2024-04-25 13:57:18.590342469 +0000 UTC m=+0.367189894 container init b164fb47fd37534898608074ac9156250f12e70eabb8b003b234e39609dcec77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240424, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T13:57:18.883 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:18 smithi175 podman[69762]: 2024-04-25 13:57:18.59419812 +0000 UTC m=+0.371045546 container start b164fb47fd37534898608074ac9156250f12e70eabb8b003b234e39609dcec77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11-deactivate, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424) 2024-04-25T13:57:18.883 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:18 smithi175 podman[69762]: 2024-04-25 13:57:18.673531973 +0000 UTC m=+0.450379426 container attach b164fb47fd37534898608074ac9156250f12e70eabb8b003b234e39609dcec77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-04-25T13:57:19.175 INFO:journalctl@ceph.osd.11.smithi175.stdout:Apr 25 13:57:18 smithi175 podman[69762]: 2024-04-25 13:57:18.88444816 +0000 UTC m=+0.661295576 container died b164fb47fd37534898608074ac9156250f12e70eabb8b003b234e39609dcec77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T13:57:19.456 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@osd.11.service' 2024-04-25T13:57:19.494 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:57:19.494 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-04-25T13:57:19.495 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-04-25T13:57:19.495 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.a 2024-04-25T13:57:19.820 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 13:57:19 smithi043 systemd[1]: Stopping Ceph mds.a for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:57:20.212 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 13:57:19 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-a[70819]: 2024-04-25T13:57:19.820+0000 7f4acf477700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:57:20.212 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 13:57:19 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-a[70819]: 2024-04-25T13:57:19.820+0000 7f4acf477700 -1 mds.a *** got signal Terminated *** 2024-04-25T13:57:24.020 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 13:57:23 smithi043 podman[90427]: 2024-04-25 13:57:23.731877781 +0000 UTC m=+4.034713946 container died 2f7c26f4bdf0627f1ebc60a65e443f677ed0df6cf09f97c2653ccbdf73e177d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T13:57:24.379 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 13:57:24 smithi043 podman[90427]: 2024-04-25 13:57:24.120170361 +0000 UTC m=+4.423006515 container cleanup 2f7c26f4bdf0627f1ebc60a65e443f677ed0df6cf09f97c2653ccbdf73e177d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-a, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-25T13:57:24.379 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 13:57:24 smithi043 bash[90427]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-a 2024-04-25T13:57:24.488 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.a.service' 2024-04-25T13:57:24.524 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:57:24.524 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-04-25T13:57:24.525 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-04-25T13:57:24.525 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.d 2024-04-25T13:57:24.712 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 13:57:24 smithi043 systemd[1]: Stopping Ceph mds.d for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:57:25.212 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 13:57:24 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-d[69860]: 2024-04-25T13:57:24.848+0000 7f1e0d43c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:57:25.212 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 13:57:24 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-d[69860]: 2024-04-25T13:57:24.848+0000 7f1e0d43c700 -1 mds.d *** got signal Terminated *** 2024-04-25T13:57:27.712 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 13:57:27 smithi043 podman[90560]: 2024-04-25 13:57:27.451340088 +0000 UTC m=+2.700019942 container died 021c444aa0385f498925c735c9c62f5c3fa6fef76b63e5d268e5ca12d382043c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-d, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-25T13:57:28.182 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 13:57:27 smithi043 podman[90560]: 2024-04-25 13:57:27.790931471 +0000 UTC m=+3.039611322 container cleanup 021c444aa0385f498925c735c9c62f5c3fa6fef76b63e5d268e5ca12d382043c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-d, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS) 2024-04-25T13:57:28.183 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 13:57:27 smithi043 bash[90560]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-d 2024-04-25T13:57:28.183 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 13:57:27 smithi043 podman[90573]: 2024-04-25 13:57:27.975265868 +0000 UTC m=+0.526218821 container remove 021c444aa0385f498925c735c9c62f5c3fa6fef76b63e5d268e5ca12d382043c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424) 2024-04-25T13:57:28.204 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.d.service' 2024-04-25T13:57:28.237 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:57:28.237 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-04-25T13:57:28.238 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-04-25T13:57:28.238 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.g 2024-04-25T13:57:28.462 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 13:57:28 smithi043 systemd[1]: Stopping Ceph mds.g for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:57:28.962 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 13:57:28 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-g[70467]: 2024-04-25T13:57:28.569+0000 7fbc84ecd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:57:28.962 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 13:57:28 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-g[70467]: 2024-04-25T13:57:28.569+0000 7fbc84ecd700 -1 mds.g *** got signal Terminated *** 2024-04-25T13:57:32.860 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 13:57:32 smithi043 podman[90680]: 2024-04-25 13:57:32.579853275 +0000 UTC m=+4.118791389 container died 4921775bc5ab0cc2b7fc82957996508cc433ee11fcb0f3ca361a73f63e60d951 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-g, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T13:57:33.212 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 13:57:32 smithi043 podman[90680]: 2024-04-25 13:57:32.952207699 +0000 UTC m=+4.491145827 container cleanup 4921775bc5ab0cc2b7fc82957996508cc433ee11fcb0f3ca361a73f63e60d951 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-g, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-04-25T13:57:33.212 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 13:57:32 smithi043 bash[90680]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-g 2024-04-25T13:57:33.478 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.g.service' 2024-04-25T13:57:33.510 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:57:33.511 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-04-25T13:57:33.511 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-04-25T13:57:33.511 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.j 2024-04-25T13:57:33.712 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 13:57:33 smithi043 systemd[1]: Stopping Ceph mds.j for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:57:34.212 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 13:57:33 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-j[69518]: 2024-04-25T13:57:33.839+0000 7f10e85ef700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:57:34.212 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 13:57:33 smithi043 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-j[69518]: 2024-04-25T13:57:33.839+0000 7f10e85ef700 -1 mds.j *** got signal Terminated *** 2024-04-25T13:57:36.889 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 13:57:36 smithi043 podman[90801]: 2024-04-25 13:57:36.566907756 +0000 UTC m=+2.833801035 container died ed5e607ea94a953f8b77acc8cdc3b4d417a507c32990b98de1cbd653904237c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-j, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-25T13:57:37.172 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 13:57:36 smithi043 podman[90801]: 2024-04-25 13:57:36.981170666 +0000 UTC m=+3.248063953 container cleanup ed5e607ea94a953f8b77acc8cdc3b4d417a507c32990b98de1cbd653904237c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-j, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T13:57:37.172 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 13:57:36 smithi043 bash[90801]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-j 2024-04-25T13:57:37.423 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 13:57:37 smithi043 podman[90815]: 2024-04-25 13:57:37.173792842 +0000 UTC m=+0.597711917 container remove ed5e607ea94a953f8b77acc8cdc3b4d417a507c32990b98de1cbd653904237c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-j, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0) 2024-04-25T13:57:37.427 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.j.service' 2024-04-25T13:57:37.458 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:57:37.459 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-04-25T13:57:37.459 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-04-25T13:57:37.459 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.b 2024-04-25T13:57:37.765 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:57:37 smithi161 systemd[1]: Stopping Ceph mds.b for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:57:38.102 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:57:37 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-b[63120]: 2024-04-25T13:57:37.765+0000 7f458bce5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:57:38.102 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:57:37 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-b[63120]: 2024-04-25T13:57:37.765+0000 7f458bce5700 -1 mds.b *** got signal Terminated *** 2024-04-25T13:57:39.352 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:57:39 smithi161 podman[69692]: 2024-04-25 13:57:39.086210703 +0000 UTC m=+1.431960515 container died 86b9b2d5216230b6ecabf0ea77bde76edc5b42b101a1b2f17e79b41440972281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-b, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424) 2024-04-25T13:57:39.852 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:57:39 smithi161 podman[69692]: 2024-04-25 13:57:39.548349209 +0000 UTC m=+1.894099027 container cleanup 86b9b2d5216230b6ecabf0ea77bde76edc5b42b101a1b2f17e79b41440972281 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-25T13:57:39.852 INFO:journalctl@ceph.mds.b.smithi161.stdout:Apr 25 13:57:39 smithi161 bash[69692]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-b 2024-04-25T13:57:40.017 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.b.service' 2024-04-25T13:57:40.051 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:57:40.051 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-04-25T13:57:40.051 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-04-25T13:57:40.052 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.e 2024-04-25T13:57:40.602 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:57:40 smithi161 systemd[1]: Stopping Ceph mds.e for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:57:40.602 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:57:40 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-e[62493]: 2024-04-25T13:57:40.377+0000 7f16bb452700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:57:40.602 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:57:40 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-e[62493]: 2024-04-25T13:57:40.377+0000 7f16bb452700 -1 mds.e *** got signal Terminated *** 2024-04-25T13:57:43.352 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:57:43 smithi161 podman[69813]: 2024-04-25 13:57:43.071362685 +0000 UTC m=+2.804242450 container died 10ebf54f12861cc3e37d87d59869b9f056dfe8a0ab2100286e6332f753fdf9bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424) 2024-04-25T13:57:43.702 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:57:43 smithi161 podman[69813]: 2024-04-25 13:57:43.460432043 +0000 UTC m=+3.193311796 container cleanup 10ebf54f12861cc3e37d87d59869b9f056dfe8a0ab2100286e6332f753fdf9bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-e, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=) 2024-04-25T13:57:43.702 INFO:journalctl@ceph.mds.e.smithi161.stdout:Apr 25 13:57:43 smithi161 bash[69813]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-e 2024-04-25T13:57:43.838 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.e.service' 2024-04-25T13:57:43.869 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:57:43.869 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-04-25T13:57:43.870 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-04-25T13:57:43.870 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.h 2024-04-25T13:57:44.102 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:57:43 smithi161 systemd[1]: Stopping Ceph mds.h for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:57:44.602 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:57:44 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-h[62806]: 2024-04-25T13:57:44.180+0000 7f99605b0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:57:44.602 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:57:44 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-h[62806]: 2024-04-25T13:57:44.180+0000 7f99605b0700 -1 mds.h *** got signal Terminated *** 2024-04-25T13:57:47.352 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:57:47 smithi161 podman[69934]: 2024-04-25 13:57:47.083983597 +0000 UTC m=+2.993807164 container died a7774c16359258fcf9e6667086584dc8c221469d2faf6c5d62db0939427f9b89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-h, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424) 2024-04-25T13:57:47.702 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:57:47 smithi161 podman[69934]: 2024-04-25 13:57:47.384659803 +0000 UTC m=+3.294483364 container cleanup a7774c16359258fcf9e6667086584dc8c221469d2faf6c5d62db0939427f9b89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-h, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-25T13:57:47.702 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:57:47 smithi161 bash[69934]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-h 2024-04-25T13:57:47.702 INFO:journalctl@ceph.mds.h.smithi161.stdout:Apr 25 13:57:47 smithi161 podman[69959]: 2024-04-25 13:57:47.59106579 +0000 UTC m=+0.511829784 container remove a7774c16359258fcf9e6667086584dc8c221469d2faf6c5d62db0939427f9b89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-25T13:57:47.723 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.h.service' 2024-04-25T13:57:47.757 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:57:47.757 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-04-25T13:57:47.757 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-04-25T13:57:47.757 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.k 2024-04-25T13:57:48.067 INFO:journalctl@ceph.mds.k.smithi161.stdout:Apr 25 13:57:47 smithi161 systemd[1]: Stopping Ceph mds.k for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:57:48.352 INFO:journalctl@ceph.mds.k.smithi161.stdout:Apr 25 13:57:48 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-k[62174]: 2024-04-25T13:57:48.067+0000 7f5780e14700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:57:48.352 INFO:journalctl@ceph.mds.k.smithi161.stdout:Apr 25 13:57:48 smithi161 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-k[62174]: 2024-04-25T13:57:48.067+0000 7f5780e14700 -1 mds.k *** got signal Terminated *** 2024-04-25T13:57:50.042 INFO:journalctl@ceph.mds.k.smithi161.stdout:Apr 25 13:57:49 smithi161 podman[70068]: 2024-04-25 13:57:49.746273815 +0000 UTC m=+1.775894377 container died 494c77886a8115e14912b90ba7c04da7b72b944d0e8f1e563a712eb05f52be13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True) 2024-04-25T13:57:50.352 INFO:journalctl@ceph.mds.k.smithi161.stdout:Apr 25 13:57:50 smithi161 podman[70068]: 2024-04-25 13:57:50.043272489 +0000 UTC m=+2.072893062 container cleanup 494c77886a8115e14912b90ba7c04da7b72b944d0e8f1e563a712eb05f52be13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0) 2024-04-25T13:57:50.352 INFO:journalctl@ceph.mds.k.smithi161.stdout:Apr 25 13:57:50 smithi161 bash[70068]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-k 2024-04-25T13:57:50.352 INFO:journalctl@ceph.mds.k.smithi161.stdout:Apr 25 13:57:50 smithi161 podman[70082]: 2024-04-25 13:57:50.269184818 +0000 UTC m=+0.522560541 container remove 494c77886a8115e14912b90ba7c04da7b72b944d0e8f1e563a712eb05f52be13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-k, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-25T13:57:50.379 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.k.service' 2024-04-25T13:57:50.411 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:57:50.411 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-04-25T13:57:50.411 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-04-25T13:57:50.411 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.c 2024-04-25T13:57:50.833 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:57:50 smithi175 systemd[1]: Stopping Ceph mds.c for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:57:51.180 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:57:50 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-c[62806]: 2024-04-25T13:57:50.833+0000 7f54704a2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:57:51.180 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:57:50 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-c[62806]: 2024-04-25T13:57:50.833+0000 7f54704a2700 -1 mds.c *** got signal Terminated *** 2024-04-25T13:57:55.125 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:57:54 smithi175 podman[69870]: 2024-04-25 13:57:54.845896103 +0000 UTC m=+4.235446420 container died d610ee93c0250e4270c869e2bb5caa38dc4fa52bc9bd6d4ca30b3d5bf559d98c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-04-25T13:57:55.430 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:57:55 smithi175 podman[69870]: 2024-04-25 13:57:55.201072055 +0000 UTC m=+4.590622376 container cleanup d610ee93c0250e4270c869e2bb5caa38dc4fa52bc9bd6d4ca30b3d5bf559d98c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-c, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-25T13:57:55.430 INFO:journalctl@ceph.mds.c.smithi175.stdout:Apr 25 13:57:55 smithi175 bash[69870]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-c 2024-04-25T13:57:55.637 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.c.service' 2024-04-25T13:57:55.672 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:57:55.673 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-04-25T13:57:55.673 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-04-25T13:57:55.673 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.f 2024-04-25T13:57:56.003 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:57:55 smithi175 systemd[1]: Stopping Ceph mds.f for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:57:56.430 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:57:56 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-f[62499]: 2024-04-25T13:57:56.003+0000 7f7ae4d49700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:57:56.430 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:57:56 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-f[62499]: 2024-04-25T13:57:56.003+0000 7f7ae4d49700 -1 mds.f *** got signal Terminated *** 2024-04-25T13:57:59.346 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:57:59 smithi175 podman[70001]: 2024-04-25 13:57:59.06710713 +0000 UTC m=+3.178414405 container died 3e9f9d20bd7cc1d5b2d9a911393706c69f6847f41acb5c09258cf3dc43ab60ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-25T13:57:59.679 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:57:59 smithi175 podman[70001]: 2024-04-25 13:57:59.429592218 +0000 UTC m=+3.540899492 container cleanup 3e9f9d20bd7cc1d5b2d9a911393706c69f6847f41acb5c09258cf3dc43ab60ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-25T13:57:59.679 INFO:journalctl@ceph.mds.f.smithi175.stdout:Apr 25 13:57:59 smithi175 bash[70001]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-f 2024-04-25T13:57:59.806 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.f.service' 2024-04-25T13:57:59.838 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:57:59.838 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-04-25T13:57:59.838 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-04-25T13:57:59.838 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.i 2024-04-25T13:57:59.930 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:57:59 smithi175 systemd[1]: Stopping Ceph mds.i for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:58:00.430 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:58:00 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-i[63113]: 2024-04-25T13:58:00.166+0000 7fecf96bb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:58:00.430 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:58:00 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-i[63113]: 2024-04-25T13:58:00.166+0000 7fecf96bb700 -1 mds.i *** got signal Terminated *** 2024-04-25T13:58:03.349 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:58:03 smithi175 podman[70121]: 2024-04-25 13:58:03.065584581 +0000 UTC m=+3.006788183 container died 62894fc2b3e920ff1f6c7f6fbe4f14cebd202c8ebd171bad50d8a125131a04ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2) 2024-04-25T13:58:03.680 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:58:03 smithi175 podman[70121]: 2024-04-25 13:58:03.441474751 +0000 UTC m=+3.382678353 container cleanup 62894fc2b3e920ff1f6c7f6fbe4f14cebd202c8ebd171bad50d8a125131a04ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-i, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T13:58:03.680 INFO:journalctl@ceph.mds.i.smithi175.stdout:Apr 25 13:58:03 smithi175 bash[70121]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-i 2024-04-25T13:58:03.869 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.i.service' 2024-04-25T13:58:03.900 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:58:03.900 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-04-25T13:58:03.900 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-04-25T13:58:03.900 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.l 2024-04-25T13:58:04.227 INFO:journalctl@ceph.mds.l.smithi175.stdout:Apr 25 13:58:03 smithi175 systemd[1]: Stopping Ceph mds.l for 394efb6c-0308-11ef-bc93-c7b262605968... 2024-04-25T13:58:04.680 INFO:journalctl@ceph.mds.l.smithi175.stdout:Apr 25 13:58:04 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-l[62190]: 2024-04-25T13:58:04.228+0000 7ff01bd70700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T13:58:04.680 INFO:journalctl@ceph.mds.l.smithi175.stdout:Apr 25 13:58:04 smithi175 ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-l[62190]: 2024-04-25T13:58:04.228+0000 7ff01bd70700 -1 mds.l *** got signal Terminated *** 2024-04-25T13:58:06.928 INFO:journalctl@ceph.mds.l.smithi175.stdout:Apr 25 13:58:06 smithi175 podman[70240]: 2024-04-25 13:58:06.666125804 +0000 UTC m=+2.553767278 container died 74aee067583211b81c4bd41959843b0954ed39fea974aa41482dc123a8413083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-l, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T13:58:07.180 INFO:journalctl@ceph.mds.l.smithi175.stdout:Apr 25 13:58:07 smithi175 podman[70240]: 2024-04-25 13:58:07.020857174 +0000 UTC m=+2.908498637 container cleanup 74aee067583211b81c4bd41959843b0954ed39fea974aa41482dc123a8413083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T13:58:07.180 INFO:journalctl@ceph.mds.l.smithi175.stdout:Apr 25 13:58:07 smithi175 bash[70240]: ceph-394efb6c-0308-11ef-bc93-c7b262605968-mds-l 2024-04-25T13:58:07.396 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-394efb6c-0308-11ef-bc93-c7b262605968@mds.l.service' 2024-04-25T13:58:07.426 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T13:58:07.426 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-04-25T13:58:07.426 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 394efb6c-0308-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-25T13:58:07.627 INFO:teuthology.orchestra.run.smithi043.stdout:Deleting cluster with fsid: 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:58:10.143 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 394efb6c-0308-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-25T13:58:10.332 INFO:teuthology.orchestra.run.smithi161.stdout:Deleting cluster with fsid: 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:58:12.798 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 394efb6c-0308-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-25T13:58:12.987 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:58:15.293 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T13:58:15.326 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T13:58:15.358 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T13:58:15.384 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-25T13:58:15.385 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673172/remote/smithi043/crash 2024-04-25T13:58:15.386 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/crash -- . 2024-04-25T13:58:15.415 INFO:teuthology.orchestra.run.smithi043.stderr:tar: /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-25T13:58:15.415 INFO:teuthology.orchestra.run.smithi043.stderr:tar: Error is not recoverable: exiting now 2024-04-25T13:58:15.417 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673172/remote/smithi161/crash 2024-04-25T13:58:15.418 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/crash -- . 2024-04-25T13:58:15.469 INFO:teuthology.orchestra.run.smithi161.stderr:tar: /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-25T13:58:15.469 INFO:teuthology.orchestra.run.smithi161.stderr:tar: Error is not recoverable: exiting now 2024-04-25T13:58:15.471 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673172/remote/smithi175/crash 2024-04-25T13:58:15.473 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/crash -- . 2024-04-25T13:58:15.503 INFO:teuthology.orchestra.run.smithi175.stderr:tar: /var/lib/ceph/394efb6c-0308-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-25T13:58:15.503 INFO:teuthology.orchestra.run.smithi175.stderr:tar: Error is not recoverable: exiting now 2024-04-25T13:58:15.504 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-25T13:58:15.505 DEBUG:teuthology.orchestra.run.smithi043:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-25T13:58:15.541 INFO:tasks.cephadm:Compressing logs... 2024-04-25T13:58:15.541 DEBUG:teuthology.orchestra.run.smithi043:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T13:58:15.584 DEBUG:teuthology.orchestra.run.smithi161:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T13:58:15.587 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T13:58:15.609 INFO:teuthology.orchestra.run.smithi043.stderr:find: ‘/var/log/rbd-target-api’gzip -5: No such file or directory --verbose 2024-04-25T13:58:15.609 INFO:teuthology.orchestra.run.smithi043.stderr: -- /var/log/ceph/ceph-client.0.log 2024-04-25T13:58:15.609 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.log 2024-04-25T13:58:15.609 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-25T13:58:15.611 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.g.log 2024-04-25T13:58:15.612 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.j.log 2024-04-25T13:58:15.612 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-25T13:58:15.612 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.0.log 2024-04-25T13:58:15.612 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mgr.x.log 2024-04-25T13:58:15.612 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mon.a.log 2024-04-25T13:58:15.612 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.6.log 2024-04-25T13:58:15.612 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-25T13:58:15.618 INFO:teuthology.orchestra.run.smithi175.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.log 2024-04-25T13:58:15.618 INFO:teuthology.orchestra.run.smithi175.stderr:: No such file or directory 2024-04-25T13:58:15.618 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-25T13:58:15.618 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.f.log 2024-04-25T13:58:15.618 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-25T13:58:15.618 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-25T13:58:15.618 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.c.log 2024-04-25T13:58:15.618 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.audit.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mon.c.log 2024-04-25T13:58:15.619 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mgr.z.log 2024-04-25T13:58:15.619 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mon.c.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-25T13:58:15.619 INFO:teuthology.orchestra.run.smithi175.stderr: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.i.log 2024-04-25T13:58:15.619 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-25T13:58:15.619 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.i.log: 90.4% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-25T13:58:15.619 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.11.log 2024-04-25T13:58:15.619 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.cephadm.log: 83.7% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-25T13:58:15.619 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.8.log 2024-04-25T13:58:15.620 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.a.log 2024-04-25T13:58:15.620 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-25T13:58:15.620 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.d.log 2024-04-25T13:58:15.620 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.9.log 2024-04-25T13:58:15.620 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-25T13:58:15.620 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-04-25T13:58:15.625 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.11.log: 91.9% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mgr.z.log.gz 2024-04-25T13:58:15.625 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-25T13:58:15.625 INFO:teuthology.orchestra.run.smithi161.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.log 2024-04-25T13:58:15.625 INFO:teuthology.orchestra.run.smithi161.stderr:: No such file or directory 2024-04-25T13:58:15.625 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-25T13:58:15.626 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.7.log 2024-04-25T13:58:15.626 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.b.log 2024-04-25T13:58:15.626 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-25T13:58:15.626 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-25T13:58:15.626 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.4.log: gzip -5 --verbose --/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.1.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mgr.y.log 2024-04-25T13:58:15.626 INFO:teuthology.orchestra.run.smithi161.stderr: 87.5% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-25T13:58:15.626 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.h.log 2024-04-25T13:58:15.626 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.10.log 2024-04-25T13:58:15.626 INFO:teuthology.orchestra.run.smithi161.stderr: 90.4% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-25T13:58:15.626 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-25T13:58:15.626 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.10.log: 91.9% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mgr.y.log.gz 2024-04-25T13:58:15.630 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.e.log 2024-04-25T13:58:15.630 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-25T13:58:15.631 INFO:teuthology.orchestra.run.smithi161.stderr: 83.8% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-25T13:58:15.631 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mon.b.log 2024-04-25T13:58:15.638 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.l.log 2024-04-25T13:58:15.640 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.k.log 2024-04-25T13:58:15.648 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-25T13:58:15.650 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-25T13:58:15.665 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 94.4% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.k.log.gz 2024-04-25T13:58:15.668 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.l.log: 94.6% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.l.log.gz 2024-04-25T13:58:15.670 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.admin.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-04-25T13:58:15.670 INFO:teuthology.orchestra.run.smithi161.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-25T13:58:15.671 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/cephadm.log: 91.1% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-25T13:58:15.671 INFO:teuthology.orchestra.run.smithi175.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-25T13:58:15.708 INFO:teuthology.orchestra.run.smithi161.stderr: 91.0% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-25T13:58:15.741 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.audit.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.g.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.j.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.3.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.0.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mgr.x.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mon.a.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.6.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.cephadm.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.a.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-volume.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.d.log: /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.9.log: 84.1% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-25T13:58:15.741 INFO:teuthology.orchestra.run.smithi043.stderr: 94.6% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.g.log.gz 2024-04-25T13:58:15.741 INFO:teuthology.orchestra.run.smithi043.stderr: 94.5% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.a.log.gz 2024-04-25T13:58:15.741 INFO:teuthology.orchestra.run.smithi043.stderr: 87.5% 94.5% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.d.log.gz 2024-04-25T13:58:15.742 INFO:teuthology.orchestra.run.smithi043.stderr: 90.2% 93.3% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-25T13:58:15.742 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-25T13:58:15.742 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-25T13:58:15.742 INFO:teuthology.orchestra.run.smithi043.stderr: 94.6% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.j.log.gz 2024-04-25T13:58:15.753 INFO:teuthology.orchestra.run.smithi043.stderr: 91.1% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-25T13:58:15.994 INFO:teuthology.orchestra.run.smithi175.stderr: 92.0% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mon.c.log.gz 2024-04-25T13:58:16.043 INFO:teuthology.orchestra.run.smithi043.stderr: 90.1% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mgr.x.log.gz 2024-04-25T13:58:16.073 INFO:teuthology.orchestra.run.smithi175.stderr: 94.0% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.f.log.gz 2024-04-25T13:58:16.190 INFO:teuthology.orchestra.run.smithi161.stderr: 91.9% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mon.b.log.gz 2024-04-25T13:58:16.356 INFO:teuthology.orchestra.run.smithi161.stderr: 94.3% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.e.log.gz 2024-04-25T13:58:16.487 INFO:teuthology.orchestra.run.smithi043.stderr: 90.4% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mon.a.log.gz 2024-04-25T13:58:19.197 INFO:teuthology.orchestra.run.smithi175.stderr: 95.3% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.c.log.gz 2024-04-25T13:58:23.810 INFO:teuthology.orchestra.run.smithi175.stderr: 94.1% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.i.log.gz 2024-04-25T13:58:24.544 INFO:teuthology.orchestra.run.smithi175.stderr: 91.6% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.8.log.gz 2024-04-25T13:58:25.332 INFO:teuthology.orchestra.run.smithi161.stderr: 92.0% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.10.log.gz 2024-04-25T13:58:26.141 INFO:teuthology.orchestra.run.smithi043.stderr: 91.7% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-25T13:58:26.578 INFO:teuthology.orchestra.run.smithi175.stderr: 91.7% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.11.log.gz 2024-04-25T13:58:27.109 INFO:teuthology.orchestra.run.smithi043.stderr: 91.6% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.6.log.gz 2024-04-25T13:58:27.484 INFO:teuthology.orchestra.run.smithi161.stderr: 91.8% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-25T13:58:27.753 INFO:teuthology.orchestra.run.smithi175.stderr: 91.6% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-25T13:58:28.040 INFO:teuthology.orchestra.run.smithi161.stderr: 91.6% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-25T13:58:28.616 INFO:teuthology.orchestra.run.smithi161.stderr: 94.0% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.h.log.gz 2024-04-25T13:58:28.785 INFO:teuthology.orchestra.run.smithi043.stderr: 91.5% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-25T13:58:29.299 INFO:teuthology.orchestra.run.smithi175.stderr: 91.4% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-25T13:58:29.301 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-04-25T13:58:29.301 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m13.700s 2024-04-25T13:58:29.301 INFO:teuthology.orchestra.run.smithi175.stderr:user 0m56.588s 2024-04-25T13:58:29.302 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m1.686s 2024-04-25T13:58:29.519 INFO:teuthology.orchestra.run.smithi161.stderr: 91.5% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.7.log.gz 2024-04-25T13:58:31.816 INFO:teuthology.orchestra.run.smithi043.stderr: 91.6% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-osd.9.log.gz 2024-04-25T13:58:31.818 INFO:teuthology.orchestra.run.smithi043.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-04-25T13:58:31.820 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-04-25T13:58:31.820 INFO:teuthology.orchestra.run.smithi043.stderr:real 0m16.222s 2024-04-25T13:58:31.821 INFO:teuthology.orchestra.run.smithi043.stderr:user 1m6.626s 2024-04-25T13:58:31.821 INFO:teuthology.orchestra.run.smithi043.stderr:sys 0m1.863s 2024-04-25T13:59:09.568 INFO:teuthology.orchestra.run.smithi161.stderr: 93.4% -- replaced with /var/log/ceph/394efb6c-0308-11ef-bc93-c7b262605968/ceph-mds.b.log.gz 2024-04-25T13:59:09.570 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-04-25T13:59:09.570 INFO:teuthology.orchestra.run.smithi161.stderr:real 0m53.970s 2024-04-25T13:59:09.570 INFO:teuthology.orchestra.run.smithi161.stderr:user 1m52.014s 2024-04-25T13:59:09.571 INFO:teuthology.orchestra.run.smithi161.stderr:sys 0m3.394s 2024-04-25T13:59:09.571 INFO:tasks.cephadm:Archiving logs... 2024-04-25T13:59:09.571 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673172/remote/smithi043/log 2024-04-25T13:59:09.572 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T13:59:19.437 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673172/remote/smithi161/log 2024-04-25T13:59:19.438 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T13:59:34.951 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673172/remote/smithi175/log 2024-04-25T13:59:34.953 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T13:59:43.091 INFO:tasks.cephadm:Removing cluster... 2024-04-25T13:59:43.091 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 394efb6c-0308-11ef-bc93-c7b262605968 --force 2024-04-25T13:59:43.292 INFO:teuthology.orchestra.run.smithi043.stdout:Deleting cluster with fsid: 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:59:43.626 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 394efb6c-0308-11ef-bc93-c7b262605968 --force 2024-04-25T13:59:43.817 INFO:teuthology.orchestra.run.smithi161.stdout:Deleting cluster with fsid: 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:59:44.199 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 394efb6c-0308-11ef-bc93-c7b262605968 --force 2024-04-25T13:59:44.389 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: 394efb6c-0308-11ef-bc93-c7b262605968 2024-04-25T13:59:44.777 INFO:tasks.cephadm:Removing cephadm ... 2024-04-25T13:59:44.778 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-25T13:59:44.797 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-25T13:59:44.814 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-25T13:59:44.829 INFO:tasks.cephadm:Teardown complete 2024-04-25T13:59:44.830 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T13:59:44.841 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T13:59:44.842 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T13:59:44.845 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T13:59:44.857 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T13:59:44.962 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T13:59:44.972 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T13:59:44.972 DEBUG:teuthology.orchestra.run.smithi043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:59:44.975 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:59:44.977 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:59:44.989 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:59:44.990 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:59:44.991 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:59:44.994 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:59:44.994 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2024-04-25T13:59:44.994 INFO:teuthology.orchestra.run.smithi161.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 +973us[ +969us] +/- 56ms 2024-04-25T13:59:44.994 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 18 -1731us[-1734us] +/- 67ms 2024-04-25T13:59:44.994 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +572us[ +568us] +/- 72ms 2024-04-25T13:59:44.994 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:59:44.995 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:59:44.995 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-04-25T13:59:44.995 INFO:teuthology.orchestra.run.smithi043.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 +992us[ +993us] +/- 56ms 2024-04-25T13:59:44.995 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 -1717us[-1717us] +/- 67ms 2024-04-25T13:59:44.996 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +630us[ +630us] +/- 72ms 2024-04-25T13:59:44.996 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:59:44.997 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:59:44.997 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-04-25T13:59:44.997 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 +987us[ +990us] +/- 56ms 2024-04-25T13:59:44.997 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 16 -1715us[-1713us] +/- 67ms 2024-04-25T13:59:44.997 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +600us[ +602us] +/- 72ms 2024-04-25T13:59:44.997 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:59:44.998 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T13:59:45.018 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T13:59:45.019 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T13:59:45.029 DEBUG:teuthology.orchestra.run.smithi043:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T13:59:45.119 DEBUG:teuthology.orchestra.run.smithi161:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T13:59:45.183 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T13:59:45.246 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:59:45.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:59:45.275 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:59:45.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:59:45.303 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:59:45.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:59:45.329 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T13:59:45.340 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T13:59:45.350 INFO:teuthology.task.internal:Duration was 1982.876746 seconds 2024-04-25T13:59:45.351 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T13:59:45.361 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T13:59:45.361 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T13:59:45.364 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T13:59:45.366 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T13:59:45.400 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:59:45.402 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:59:45.406 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:59:45.749 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T13:59:45.749 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T13:59:45.749 DEBUG:teuthology.orchestra.run.smithi043:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T13:59:45.811 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2024-04-25T13:59:45.812 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T13:59:45.841 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T13:59:45.841 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T13:59:45.861 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T13:59:45.861 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T13:59:45.864 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T13:59:45.884 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T13:59:45.926 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T13:59:45.927 DEBUG:teuthology.orchestra.run.smithi043:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T13:59:45.932 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T13:59:45.949 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T13:59:46.318 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T13:59:46.334 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T13:59:46.334 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T13:59:46.359 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T13:59:46.383 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T13:59:46.408 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T13:59:46.428 DEBUG:teuthology.orchestra.run.smithi043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:59:46.430 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:59:46.433 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:59:46.451 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = core 2024-04-25T13:59:46.454 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2024-04-25T13:59:46.471 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-04-25T13:59:46.489 DEBUG:teuthology.orchestra.run.smithi043:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:59:46.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:59:46.518 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:59:46.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:59:46.533 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:59:46.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:59:46.547 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T13:59:46.559 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T13:59:46.560 DEBUG:teuthology.misc:Transferring archived files from smithi043:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673172/remote/smithi043 2024-04-25T13:59:46.560 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T13:59:46.603 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673172/remote/smithi161 2024-04-25T13:59:46.603 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T13:59:46.638 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673172/remote/smithi175 2024-04-25T13:59:46.639 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T13:59:46.675 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T13:59:46.675 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T13:59:46.679 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T13:59:46.682 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T13:59:46.724 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T13:59:46.738 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T13:59:46.738 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T13:59:46.748 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T13:59:46.748 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T13:59:46.751 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T13:59:46.753 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T13:59:46.763 INFO:teuthology.orchestra.run.smithi043.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 13:59 /home/ubuntu/cephtest 2024-04-25T13:59:46.765 INFO:teuthology.orchestra.run.smithi161.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 13:59 /home/ubuntu/cephtest 2024-04-25T13:59:46.778 INFO:teuthology.orchestra.run.smithi175.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 13:59 /home/ubuntu/cephtest 2024-04-25T13:59:46.779 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T13:59:46.791 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T13:59:46.818 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/fsstress}} duration: 1982.8767457008362 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-04-25T13:59:46.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T13:59:46.898 INFO:teuthology.run:pass